2023-10-06T01:02:29.685 INFO:root:teuthology version: 0.0.1.dev194+g54e62bc 2023-10-06T01:02:29.686 DEBUG:teuthology.run:Teuthology command: teuthology --description fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/acls} --verbose --archive /home/teuthworker/archive/yuriw-2023-10-05_23:52:50-fs-wip-yuri-testing-2023-10-05-0730-quincy-distro-default-smithi/7412076 --name yuriw-2023-10-05_23:52:50-fs-wip-yuri-testing-2023-10-05-0730-quincy-distro-default-smithi --owner scheduled_yuriw@teuthology -- /home/teuthworker/archive/yuriw-2023-10-05_23:52:50-fs-wip-yuri-testing-2023-10-05-0730-quincy-distro-default-smithi/7412076/orig.config.yaml 2023-10-06T01:02:29.729 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-06T01:02:29.817 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/yuriw-2023-10-05_23:52:50-fs-wip-yuri-testing-2023-10-05-0730-quincy-distro-default-smithi/7412076 branch: wip-yuri-testing-2023-10-05-0730-quincy description: fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/acls} email: yweinste@redhat.com first_in_suite: false job_id: '7412076' kernel: client: branch: testing kdb: true sha1: distro ktype: upstream last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi name: yuriw-2023-10-05_23:52:50-fs-wip-yuri-testing-2023-10-05-0730-quincy-distro-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: rhel os_version: '8.4' overrides: admin_socket: branch: wip-yuri-testing-2023-10-05-0730-quincy ceph: cephfs: ec_profile: - m=2 - k=2 - crush-failure-domain=osd conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 pid file: '' rados mon op timeout: 900 rados osd op timeout: 900 global: ms die on skipped message: false mds: debug mds: 20 debug ms: 1 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon op complaint time: 120 osd: bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug ms: 1 debug osd: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - overall HEALTH_ - \(FS_DEGRADED\) - \(MDS_FAILED\) - \(MDS_DEGRADED\) - \(FS_WITH_FAILED_MDS\) - \(MDS_DAMAGE\) - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(FS_INLINE_DATA_DEPRECATED\) - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding sha1: 736ac5ba72cb47af7d6f6666b1e100f7e20a20e2 ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: 736ac5ba72cb47af7d6f6666b1e100f7e20a20e2 kclient: syntax: v1 selinux: whitelist: - scontext=system_u:system_r:logrotate_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-yuri-testing-2023-10-05-0730-quincy sha1: f1e315a9732d36c05ec316678e2397dc58561c7f owner: scheduled_yuriw@teuthology priority: 75 repo: https://github.com/ceph/ceph-ci.git roles: - - mon.a - mgr.y - mds.a - mds.c - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - client.2 - - mon.b - mon.c - mgr.x - mds.b - mds.d - osd.4 - osd.5 - osd.6 - osd.7 - client.1 - client.3 seed: 7519 sha1: 736ac5ba72cb47af7d6f6666b1e100f7e20a20e2 sleep_before_teardown: 0 subset: 111/12000 suite: fs suite_branch: wip-yuri-testing-2023-10-05-0730-quincy suite_path: /home/teuthworker/src/github.com_ceph_ceph-c_f1e315a9732d36c05ec316678e2397dc58561c7f/qa suite_relpath: qa suite_repo: https://github.com/ceph/ceph-ci.git suite_sha1: f1e315a9732d36c05ec316678e2397dc58561c7f targets: smithi050.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBKNGwEbc6nlhWoKK2q/JhlTxbDL2wf4lDilA3fqVkNmcpM06tHVG2H4l8DQtDEChZDi+48ybGg1N08TuW8IhDMU= smithi155.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBBYL47B2Oj0XSQy1usBWrapTgdPTyjkqN9X8T4+wAERbtbSyf0pYd/LV/R2exAsVzKanHGm0Q73YeL8X62HIFE0= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - ceph: null - kclient: null - cephfs_test_runner: fail_on_skip: false modules: - tasks.cephfs.test_acls teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return yaml.ktype == 'upstream' end - local function is_kdistro() return yaml.ktype == 'distro' end - local function is_fuse() return false end - local function syntax_version() return yaml.overrides.kclient.syntax end teuthology_branch: main teuthology_sha1: 54e62bcbac4e53d9685e08328b790d3b20d71cae timestamp: 2023-10-05_23:52:50 tube: smithi user: yuriw verbose: true worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2830 2023-10-06T01:02:29.818 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/github.com_ceph_ceph-c_f1e315a9732d36c05ec316678e2397dc58561c7f/qa; will attempt to use it 2023-10-06T01:02:29.819 INFO:teuthology.run:Found tasks at /home/teuthworker/src/github.com_ceph_ceph-c_f1e315a9732d36c05ec316678e2397dc58561c7f/qa/tasks 2023-10-06T01:02:29.819 INFO:teuthology.run_tasks:Running task internal.check_packages... 2023-10-06T01:02:29.820 INFO:teuthology.task.internal:Checking packages... 2023-10-06T01:02:29.844 INFO:teuthology.task.internal:Checking packages for os_type 'rhel', flavor 'default' and ceph hash '736ac5ba72cb47af7d6f6666b1e100f7e20a20e2' 2023-10-06T01:02:29.844 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2023-10-06T01:02:29.844 INFO:teuthology.packaging:ref: None 2023-10-06T01:02:29.844 INFO:teuthology.packaging:tag: None 2023-10-06T01:02:29.844 INFO:teuthology.packaging:branch: wip-yuri-testing-2023-10-05-0730-quincy 2023-10-06T01:02:29.845 INFO:teuthology.packaging:sha1: 736ac5ba72cb47af7d6f6666b1e100f7e20a20e2 2023-10-06T01:02:29.845 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&ref=wip-yuri-testing-2023-10-05-0730-quincy 2023-10-06T01:02:30.095 INFO:teuthology.task.internal:Found packages for ceph version 17.2.6-1296.g736ac5ba 2023-10-06T01:02:30.095 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2023-10-06T01:02:30.106 INFO:teuthology.task.internal:no buildpackages task found 2023-10-06T01:02:30.106 INFO:teuthology.run_tasks:Running task internal.save_config... 2023-10-06T01:02:30.169 INFO:teuthology.task.internal:Saving configuration 2023-10-06T01:02:30.185 INFO:teuthology.run_tasks:Running task internal.check_lock... 2023-10-06T01:02:30.202 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-10-06T01:02:30.228 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi050.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-10-05_23:52:50-fs-wip-yuri-testing-2023-10-05-0730-quincy-distro-default-smithi/7412076', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.4', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-06 00:57:04.246927', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBKNGwEbc6nlhWoKK2q/JhlTxbDL2wf4lDilA3fqVkNmcpM06tHVG2H4l8DQtDEChZDi+48ybGg1N08TuW8IhDMU='} 2023-10-06T01:02:30.252 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi155.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-10-05_23:52:50-fs-wip-yuri-testing-2023-10-05-0730-quincy-distro-default-smithi/7412076', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.4', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-06 00:57:04.248805', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBBYL47B2Oj0XSQy1usBWrapTgdPTyjkqN9X8T4+wAERbtbSyf0pYd/LV/R2exAsVzKanHGm0Q73YeL8X62HIFE0='} 2023-10-06T01:02:30.252 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2023-10-06T01:02:30.263 INFO:teuthology.task.internal:roles: ubuntu@smithi050.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'] 2023-10-06T01:02:30.263 INFO:teuthology.task.internal:roles: ubuntu@smithi155.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3'] 2023-10-06T01:02:30.263 INFO:teuthology.run_tasks:Running task console_log... 2023-10-06T01:02:30.352 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7faf3d5efb80>, signals=[15]) 2023-10-06T01:02:30.353 INFO:teuthology.run_tasks:Running task internal.connect... 2023-10-06T01:02:30.364 INFO:teuthology.task.internal:Opening connections... 2023-10-06T01:02:30.364 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi050.front.sepia.ceph.com 2023-10-06T01:02:30.365 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi050.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-06T01:02:30.434 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi155.front.sepia.ceph.com 2023-10-06T01:02:30.435 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi155.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-06T01:02:30.498 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2023-10-06T01:02:30.505 DEBUG:teuthology.orchestra.run.smithi050:> uname -m 2023-10-06T01:02:30.523 INFO:teuthology.orchestra.run.smithi050.stdout:x86_64 2023-10-06T01:02:30.524 DEBUG:teuthology.orchestra.run.smithi050:> cat /etc/os-release 2023-10-06T01:02:30.581 INFO:teuthology.orchestra.run.smithi050.stdout:NAME="Red Hat Enterprise Linux" 2023-10-06T01:02:30.581 INFO:teuthology.orchestra.run.smithi050.stdout:VERSION="8.4 (Ootpa)" 2023-10-06T01:02:30.581 INFO:teuthology.orchestra.run.smithi050.stdout:ID="rhel" 2023-10-06T01:02:30.581 INFO:teuthology.orchestra.run.smithi050.stdout:ID_LIKE="fedora" 2023-10-06T01:02:30.582 INFO:teuthology.orchestra.run.smithi050.stdout:VERSION_ID="8.4" 2023-10-06T01:02:30.582 INFO:teuthology.orchestra.run.smithi050.stdout:PLATFORM_ID="platform:el8" 2023-10-06T01:02:30.582 INFO:teuthology.orchestra.run.smithi050.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)" 2023-10-06T01:02:30.582 INFO:teuthology.orchestra.run.smithi050.stdout:ANSI_COLOR="0;31" 2023-10-06T01:02:30.582 INFO:teuthology.orchestra.run.smithi050.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA" 2023-10-06T01:02:30.582 INFO:teuthology.orchestra.run.smithi050.stdout:HOME_URL="https://www.redhat.com/" 2023-10-06T01:02:30.582 INFO:teuthology.orchestra.run.smithi050.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-10-06T01:02:30.582 INFO:teuthology.orchestra.run.smithi050.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-10-06T01:02:30.582 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-10-06T01:02:30.582 INFO:teuthology.orchestra.run.smithi050.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-10-06T01:02:30.583 INFO:teuthology.orchestra.run.smithi050.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4 2023-10-06T01:02:30.583 INFO:teuthology.orchestra.run.smithi050.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-10-06T01:02:30.583 INFO:teuthology.orchestra.run.smithi050.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4" 2023-10-06T01:02:30.583 INFO:teuthology.lock.ops:Updating smithi050.front.sepia.ceph.com on lock server 2023-10-06T01:02:30.608 DEBUG:teuthology.orchestra.run.smithi155:> uname -m 2023-10-06T01:02:30.623 INFO:teuthology.orchestra.run.smithi155.stdout:x86_64 2023-10-06T01:02:30.623 DEBUG:teuthology.orchestra.run.smithi155:> cat /etc/os-release 2023-10-06T01:02:30.675 INFO:teuthology.orchestra.run.smithi155.stdout:NAME="Red Hat Enterprise Linux" 2023-10-06T01:02:30.675 INFO:teuthology.orchestra.run.smithi155.stdout:VERSION="8.4 (Ootpa)" 2023-10-06T01:02:30.675 INFO:teuthology.orchestra.run.smithi155.stdout:ID="rhel" 2023-10-06T01:02:30.675 INFO:teuthology.orchestra.run.smithi155.stdout:ID_LIKE="fedora" 2023-10-06T01:02:30.675 INFO:teuthology.orchestra.run.smithi155.stdout:VERSION_ID="8.4" 2023-10-06T01:02:30.675 INFO:teuthology.orchestra.run.smithi155.stdout:PLATFORM_ID="platform:el8" 2023-10-06T01:02:30.676 INFO:teuthology.orchestra.run.smithi155.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)" 2023-10-06T01:02:30.676 INFO:teuthology.orchestra.run.smithi155.stdout:ANSI_COLOR="0;31" 2023-10-06T01:02:30.676 INFO:teuthology.orchestra.run.smithi155.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA" 2023-10-06T01:02:30.676 INFO:teuthology.orchestra.run.smithi155.stdout:HOME_URL="https://www.redhat.com/" 2023-10-06T01:02:30.676 INFO:teuthology.orchestra.run.smithi155.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-10-06T01:02:30.676 INFO:teuthology.orchestra.run.smithi155.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-10-06T01:02:30.676 INFO:teuthology.orchestra.run.smithi155.stdout: 2023-10-06T01:02:30.676 INFO:teuthology.orchestra.run.smithi155.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-10-06T01:02:30.676 INFO:teuthology.orchestra.run.smithi155.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4 2023-10-06T01:02:30.677 INFO:teuthology.orchestra.run.smithi155.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-10-06T01:02:30.677 INFO:teuthology.orchestra.run.smithi155.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4" 2023-10-06T01:02:30.677 INFO:teuthology.lock.ops:Updating smithi155.front.sepia.ceph.com on lock server 2023-10-06T01:02:30.699 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2023-10-06T01:02:30.711 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2023-10-06T01:02:30.735 INFO:teuthology.task.internal:Checking for old test directory... 2023-10-06T01:02:30.736 DEBUG:teuthology.orchestra.run.smithi050:> test '!' -e /home/ubuntu/cephtest 2023-10-06T01:02:30.738 DEBUG:teuthology.orchestra.run.smithi155:> test '!' -e /home/ubuntu/cephtest 2023-10-06T01:02:30.752 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2023-10-06T01:02:30.774 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2023-10-06T01:02:30.774 DEBUG:teuthology.orchestra.run.smithi050:> test -z $(ls -A /var/lib/ceph) 2023-10-06T01:02:30.795 DEBUG:teuthology.orchestra.run.smithi155:> test -z $(ls -A /var/lib/ceph) 2023-10-06T01:02:30.809 INFO:teuthology.orchestra.run.smithi155.stderr:ls: cannot access '/var/lib/ceph': No such file or directory 2023-10-06T01:02:30.810 INFO:teuthology.orchestra.run.smithi050.stderr:ls: cannot access '/var/lib/ceph': No such file or directory 2023-10-06T01:02:30.811 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2023-10-06T01:02:30.872 INFO:teuthology.run_tasks:Running task kernel... 2023-10-06T01:02:30.889 INFO:teuthology.task.kernel:normalize config orig: {'client': {'branch': 'testing'}, 'kdb': True, 'sha1': 'distro'} 2023-10-06T01:02:30.889 INFO:teuthology.task.kernel:normalize config final: {'client.0': {'branch': 'testing'}, 'client.2': {'branch': 'testing'}, 'client.1': {'branch': 'testing'}, 'client.3': {'branch': 'testing'}} 2023-10-06T01:02:30.889 INFO:teuthology.task.kernel:config {'client.0': {'branch': 'testing'}, 'client.1': {'branch': 'testing'}}, timeout 300 2023-10-06T01:02:30.889 DEBUG:teuthology.orchestra.run.smithi050:> test -f /run/.containerenv -o -f /.dockerenv 2023-10-06T01:02:30.890 DEBUG:teuthology.orchestra.run.smithi155:> test -f /run/.containerenv -o -f /.dockerenv 2023-10-06T01:02:30.902 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-06T01:02:30.903 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F8%2Fx86_64&ref=testing 2023-10-06T01:02:30.907 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-06T01:02:30.907 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F8%2Fx86_64&ref=testing 2023-10-06T01:02:31.070 DEBUG:teuthology.task.kernel:sha1 for client.1 is fef64f93da2bbe59bfa57cc5e0530b4dcd2f9c7c 2023-10-06T01:02:31.078 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "fef64f93da2bbe59bfa57cc5e0530b4dcd2f9c7c"... 2023-10-06T01:02:31.078 DEBUG:teuthology.orchestra.run.smithi155:> uname -r 2023-10-06T01:02:31.094 INFO:teuthology.orchestra.run.smithi155.stdout:4.18.0-305.25.1.el8_4.x86_64 2023-10-06T01:02:31.094 DEBUG:teuthology.task.kernel:current kernel version is 4.18.0-305.25.1.el8_4.x86_64 vs fef64f93da2bbe59bfa57cc5e0530b4dcd2f9c7c 2023-10-06T01:02:31.095 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2023-10-06T01:02:31.095 DEBUG:teuthology.orchestra.run.smithi155:> sudo yum upgrade -y linux-firmware 2023-10-06T01:02:31.155 DEBUG:teuthology.task.kernel:sha1 for client.0 is fef64f93da2bbe59bfa57cc5e0530b4dcd2f9c7c 2023-10-06T01:02:31.155 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "fef64f93da2bbe59bfa57cc5e0530b4dcd2f9c7c"... 2023-10-06T01:02:31.155 DEBUG:teuthology.orchestra.run.smithi050:> uname -r 2023-10-06T01:02:31.172 INFO:teuthology.orchestra.run.smithi050.stdout:4.18.0-305.25.1.el8_4.x86_64 2023-10-06T01:02:31.173 DEBUG:teuthology.task.kernel:current kernel version is 4.18.0-305.25.1.el8_4.x86_64 vs fef64f93da2bbe59bfa57cc5e0530b4dcd2f9c7c 2023-10-06T01:02:31.173 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2023-10-06T01:02:31.173 DEBUG:teuthology.orchestra.run.smithi050:> sudo yum upgrade -y linux-firmware 2023-10-06T01:02:32.574 INFO:teuthology.orchestra.run.smithi155.stdout:Updating Subscription Management repositories. 2023-10-06T01:02:32.575 INFO:teuthology.orchestra.run.smithi155.stdout:Unable to read consumer identity 2023-10-06T01:02:32.767 INFO:teuthology.orchestra.run.smithi050.stdout:Updating Subscription Management repositories. 2023-10-06T01:02:32.767 INFO:teuthology.orchestra.run.smithi050.stdout:Unable to read consumer identity 2023-10-06T01:02:34.063 INFO:teuthology.orchestra.run.smithi155.stdout:Copr repo for python3-asyncssh owned by ceph 18 kB/s | 3.5 kB 00:00 2023-10-06T01:02:34.203 INFO:teuthology.orchestra.run.smithi050.stdout:Copr repo for python3-asyncssh owned by ceph 26 kB/s | 3.5 kB 00:00 2023-10-06T01:02:35.527 INFO:teuthology.orchestra.run.smithi155.stdout:Extra Packages for Enterprise Linux 10 MB/s | 16 MB 00:01 2023-10-06T01:02:35.581 INFO:teuthology.orchestra.run.smithi050.stdout:Extra Packages for Enterprise Linux 12 MB/s | 16 MB 00:01 2023-10-06T01:02:38.820 INFO:teuthology.orchestra.run.smithi155.stdout:lab-extras 4.4 MB/s | 24 kB 00:00 2023-10-06T01:02:39.109 INFO:teuthology.orchestra.run.smithi050.stdout:lab-extras 4.2 MB/s | 24 kB 00:00 2023-10-06T01:02:39.723 INFO:teuthology.orchestra.run.smithi155.stdout:Dependencies resolved. 2023-10-06T01:02:39.724 INFO:teuthology.orchestra.run.smithi155.stdout:Nothing to do. 2023-10-06T01:02:39.724 INFO:teuthology.orchestra.run.smithi155.stdout:Complete! 2023-10-06T01:02:39.839 INFO:teuthology.task.kernel:Downloading kernel fef64f93da2bbe59bfa57cc5e0530b4dcd2f9c7c on client.1... 2023-10-06T01:02:39.839 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F8%2Fx86_64&sha1=fef64f93da2bbe59bfa57cc5e0530b4dcd2f9c7c 2023-10-06T01:02:40.035 INFO:teuthology.orchestra.run.smithi050.stdout:Dependencies resolved. 2023-10-06T01:02:40.036 INFO:teuthology.orchestra.run.smithi050.stdout:Nothing to do. 2023-10-06T01:02:40.036 INFO:teuthology.orchestra.run.smithi050.stdout:Complete! 2023-10-06T01:02:40.064 INFO:teuthology.task.kernel:fetching, builder baseurl is https://3.chacra.ceph.com/r/kernel/testing/fef64f93da2bbe59bfa57cc5e0530b4dcd2f9c7c/centos/8/flavors/default/x86_64/ 2023-10-06T01:02:40.064 DEBUG:teuthology.orchestra.run.smithi155:> rm -f /tmp/kernel.x86_64.rpm && echo kernel-6.5.0_rc7_gfef64f93da2b-1.x86_64.rpm | wget -nv -O /tmp/kernel.x86_64.rpm --base=https://3.chacra.ceph.com/r/kernel/testing/fef64f93da2bbe59bfa57cc5e0530b4dcd2f9c7c/centos/8/flavors/default/x86_64/ --input-file=- 2023-10-06T01:02:40.067 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi155.front.sepia.ceph.com to complete... 2023-10-06T01:02:40.146 INFO:teuthology.task.kernel:Downloading kernel fef64f93da2bbe59bfa57cc5e0530b4dcd2f9c7c on client.0... 2023-10-06T01:02:40.147 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F8%2Fx86_64&sha1=fef64f93da2bbe59bfa57cc5e0530b4dcd2f9c7c 2023-10-06T01:02:40.370 INFO:teuthology.task.kernel:fetching, builder baseurl is https://3.chacra.ceph.com/r/kernel/testing/fef64f93da2bbe59bfa57cc5e0530b4dcd2f9c7c/centos/8/flavors/default/x86_64/ 2023-10-06T01:02:40.370 DEBUG:teuthology.orchestra.run.smithi050:> rm -f /tmp/kernel.x86_64.rpm && echo kernel-6.5.0_rc7_gfef64f93da2b-1.x86_64.rpm | wget -nv -O /tmp/kernel.x86_64.rpm --base=https://3.chacra.ceph.com/r/kernel/testing/fef64f93da2bbe59bfa57cc5e0530b4dcd2f9c7c/centos/8/flavors/default/x86_64/ --input-file=- 2023-10-06T01:02:40.372 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi050.front.sepia.ceph.com to complete... 2023-10-06T01:02:58.919 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06 01:02:58 URL:https://3.chacra.ceph.com/r/kernel/testing/fef64f93da2bbe59bfa57cc5e0530b4dcd2f9c7c/centos/8/flavors/default/x86_64/kernel-6.5.0_rc7_gfef64f93da2b-1.x86_64.rpm [380759012/380759012] -> "/tmp/kernel.x86_64.rpm" [1] 2023-10-06T01:02:58.919 INFO:teuthology.orchestra.run.smithi050.stderr:FINISHED --2023-10-06 01:02:58-- 2023-10-06T01:02:58.919 INFO:teuthology.orchestra.run.smithi050.stderr:Total wall clock time: 19s 2023-10-06T01:02:58.919 INFO:teuthology.orchestra.run.smithi050.stderr:Downloaded: 1 files, 363M in 18s (20.2 MB/s) 2023-10-06T01:02:58.920 INFO:teuthology.task.kernel:Installing kernel fef64f93da2bbe59bfa57cc5e0530b4dcd2f9c7c on client.0... 2023-10-06T01:02:58.920 DEBUG:teuthology.orchestra.run.smithi050:> sudo rpm -ivh --oldpackage --replacefiles --replacepkgs /tmp/kernel.x86_64.rpm 2023-10-06T01:03:00.745 INFO:teuthology.orchestra.run.smithi050.stdout:Verifying... ######################################## 2023-10-06T01:03:01.173 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing... ######################################## 2023-10-06T01:03:01.314 INFO:teuthology.orchestra.run.smithi050.stdout:Updating / installing... 2023-10-06T01:03:11.596 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-06 01:03:11 URL:https://3.chacra.ceph.com/r/kernel/testing/fef64f93da2bbe59bfa57cc5e0530b4dcd2f9c7c/centos/8/flavors/default/x86_64/kernel-6.5.0_rc7_gfef64f93da2b-1.x86_64.rpm [380759012/380759012] -> "/tmp/kernel.x86_64.rpm" [1] 2023-10-06T01:03:11.596 INFO:teuthology.orchestra.run.smithi155.stderr:FINISHED --2023-10-06 01:03:11-- 2023-10-06T01:03:11.596 INFO:teuthology.orchestra.run.smithi155.stderr:Total wall clock time: 32s 2023-10-06T01:03:11.596 INFO:teuthology.orchestra.run.smithi155.stderr:Downloaded: 1 files, 363M in 31s (11.7 MB/s) 2023-10-06T01:03:11.597 INFO:teuthology.task.kernel:Installing kernel fef64f93da2bbe59bfa57cc5e0530b4dcd2f9c7c on client.1... 2023-10-06T01:03:11.598 DEBUG:teuthology.orchestra.run.smithi155:> sudo rpm -ivh --oldpackage --replacefiles --replacepkgs /tmp/kernel.x86_64.rpm 2023-10-06T01:03:13.335 INFO:teuthology.orchestra.run.smithi155.stdout:Verifying... ######################################## 2023-10-06T01:03:13.769 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing... ######################################## 2023-10-06T01:03:13.894 INFO:teuthology.orchestra.run.smithi155.stdout:Updating / installing... 2023-10-06T01:03:41.981 INFO:teuthology.orchestra.run.smithi050.stdout:kernel-6.5.0_rc7_gfef64f93da2b-1 ######################################## 2023-10-06T01:03:51.962 INFO:teuthology.orchestra.run.smithi155.stdout:kernel-6.5.0_rc7_gfef64f93da2b-1 ######################################## 2023-10-06T01:04:06.935 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi050.front.sepia.ceph.com, path=/tmp/kernel.x86_64.rpm, version=None) 2023-10-06T01:04:06.935 DEBUG:teuthology.orchestra.run.smithi050:> rpm -qlp /tmp/kernel.x86_64.rpm 2023-10-06T01:04:06.995 INFO:teuthology.orchestra.run.smithi050.stdout:/boot/System.map-6.5.0-rc7-gfef64f93da2b 2023-10-06T01:04:06.996 INFO:teuthology.orchestra.run.smithi050.stdout:/boot/config-6.5.0-rc7-gfef64f93da2b 2023-10-06T01:04:06.996 INFO:teuthology.orchestra.run.smithi050.stdout:/boot/vmlinuz-6.5.0-rc7-gfef64f93da2b 2023-10-06T01:04:06.996 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b 2023-10-06T01:04:06.996 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel 2023-10-06T01:04:06.996 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch 2023-10-06T01:04:06.996 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86 2023-10-06T01:04:06.996 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto 2023-10-06T01:04:06.996 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/blowfish-x86_64.ko 2023-10-06T01:04:06.996 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2023-10-06T01:04:06.997 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2023-10-06T01:04:06.997 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/camellia-x86_64.ko 2023-10-06T01:04:06.997 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2023-10-06T01:04:06.997 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2023-10-06T01:04:06.997 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/crc32-pclmul.ko 2023-10-06T01:04:06.997 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/crc32c-intel.ko 2023-10-06T01:04:06.997 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2023-10-06T01:04:06.997 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2023-10-06T01:04:06.997 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2023-10-06T01:04:06.997 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2023-10-06T01:04:06.997 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/serpent-avx2.ko 2023-10-06T01:04:06.997 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2023-10-06T01:04:06.998 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/sha1-ssse3.ko 2023-10-06T01:04:06.998 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/sha256-ssse3.ko 2023-10-06T01:04:06.998 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/sha512-ssse3.ko 2023-10-06T01:04:06.998 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2023-10-06T01:04:06.998 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2023-10-06T01:04:06.998 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/twofish-x86_64.ko 2023-10-06T01:04:06.998 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/kernel 2023-10-06T01:04:06.998 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/kernel/cpu 2023-10-06T01:04:06.998 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/kernel/cpu/mce 2023-10-06T01:04:06.998 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2023-10-06T01:04:06.998 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/kvm 2023-10-06T01:04:06.999 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/kvm/kvm-amd.ko 2023-10-06T01:04:06.999 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/kvm/kvm-intel.ko 2023-10-06T01:04:06.999 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/kvm/kvm.ko 2023-10-06T01:04:06.999 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto 2023-10-06T01:04:06.999 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/ansi_cprng.ko 2023-10-06T01:04:06.999 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/anubis.ko 2023-10-06T01:04:06.999 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/arc4.ko 2023-10-06T01:04:06.999 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/async_tx 2023-10-06T01:04:06.999 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/async_tx/async_memcpy.ko 2023-10-06T01:04:06.999 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/async_tx/async_pq.ko 2023-10-06T01:04:06.999 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/async_tx/async_raid6_recov.ko 2023-10-06T01:04:06.999 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/async_tx/async_tx.ko 2023-10-06T01:04:07.000 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/async_tx/async_xor.ko 2023-10-06T01:04:07.000 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/async_tx/raid6test.ko 2023-10-06T01:04:07.000 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/authenc.ko 2023-10-06T01:04:07.000 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/authencesn.ko 2023-10-06T01:04:07.000 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/blake2b_generic.ko 2023-10-06T01:04:07.000 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/blowfish_common.ko 2023-10-06T01:04:07.000 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/blowfish_generic.ko 2023-10-06T01:04:07.000 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/camellia_generic.ko 2023-10-06T01:04:07.000 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/cast5_generic.ko 2023-10-06T01:04:07.000 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/cast6_generic.ko 2023-10-06T01:04:07.000 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/cast_common.ko 2023-10-06T01:04:07.000 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/ccm.ko 2023-10-06T01:04:07.001 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/cmac.ko 2023-10-06T01:04:07.001 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/crc32_generic.ko 2023-10-06T01:04:07.001 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/crypto_engine.ko 2023-10-06T01:04:07.001 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/crypto_user.ko 2023-10-06T01:04:07.001 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/cts.ko 2023-10-06T01:04:07.001 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/des_generic.ko 2023-10-06T01:04:07.001 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/dh_generic.ko 2023-10-06T01:04:07.001 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/echainiv.ko 2023-10-06T01:04:07.001 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/essiv.ko 2023-10-06T01:04:07.001 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/fcrypt.ko 2023-10-06T01:04:07.001 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/khazad.ko 2023-10-06T01:04:07.001 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/lz4.ko 2023-10-06T01:04:07.002 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/lz4hc.ko 2023-10-06T01:04:07.002 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/md4.ko 2023-10-06T01:04:07.002 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/michael_mic.ko 2023-10-06T01:04:07.002 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/pcbc.ko 2023-10-06T01:04:07.002 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/pcrypt.ko 2023-10-06T01:04:07.002 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/rmd160.ko 2023-10-06T01:04:07.002 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/seed.ko 2023-10-06T01:04:07.002 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/serpent_generic.ko 2023-10-06T01:04:07.002 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/tcrypt.ko 2023-10-06T01:04:07.002 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/tea.ko 2023-10-06T01:04:07.002 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/twofish_common.ko 2023-10-06T01:04:07.002 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/twofish_generic.ko 2023-10-06T01:04:07.003 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/vmac.ko 2023-10-06T01:04:07.003 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/wp512.ko 2023-10-06T01:04:07.003 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/xcbc.ko 2023-10-06T01:04:07.003 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/xor.ko 2023-10-06T01:04:07.003 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/xxhash_generic.ko 2023-10-06T01:04:07.003 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers 2023-10-06T01:04:07.003 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/acpi 2023-10-06T01:04:07.003 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/acpi/acpi_ipmi.ko 2023-10-06T01:04:07.003 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/acpi/acpi_pad.ko 2023-10-06T01:04:07.003 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/acpi/custom_method.ko 2023-10-06T01:04:07.003 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/acpi/ec_sys.ko 2023-10-06T01:04:07.003 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/acpi/platform_profile.ko 2023-10-06T01:04:07.004 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/acpi/sbs.ko 2023-10-06T01:04:07.004 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/acpi/sbshc.ko 2023-10-06T01:04:07.004 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/acpi/video.ko 2023-10-06T01:04:07.004 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata 2023-10-06T01:04:07.004 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/acard-ahci.ko 2023-10-06T01:04:07.004 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/ahci_platform.ko 2023-10-06T01:04:07.004 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/ata_generic.ko 2023-10-06T01:04:07.004 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/libahci_platform.ko 2023-10-06T01:04:07.004 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_acpi.ko 2023-10-06T01:04:07.004 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_ali.ko 2023-10-06T01:04:07.004 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_amd.ko 2023-10-06T01:04:07.004 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_artop.ko 2023-10-06T01:04:07.005 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_atiixp.ko 2023-10-06T01:04:07.005 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_atp867x.ko 2023-10-06T01:04:07.005 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_cmd640.ko 2023-10-06T01:04:07.005 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_cmd64x.ko 2023-10-06T01:04:07.005 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_cypress.ko 2023-10-06T01:04:07.005 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_efar.ko 2023-10-06T01:04:07.005 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_hpt366.ko 2023-10-06T01:04:07.005 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_hpt37x.ko 2023-10-06T01:04:07.005 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_hpt3x2n.ko 2023-10-06T01:04:07.005 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_hpt3x3.ko 2023-10-06T01:04:07.005 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_it8213.ko 2023-10-06T01:04:07.005 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_it821x.ko 2023-10-06T01:04:07.006 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_jmicron.ko 2023-10-06T01:04:07.006 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_marvell.ko 2023-10-06T01:04:07.006 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_mpiix.ko 2023-10-06T01:04:07.006 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_netcell.ko 2023-10-06T01:04:07.006 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_ninja32.ko 2023-10-06T01:04:07.006 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_ns87410.ko 2023-10-06T01:04:07.006 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_ns87415.ko 2023-10-06T01:04:07.006 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_oldpiix.ko 2023-10-06T01:04:07.006 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_opti.ko 2023-10-06T01:04:07.006 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_optidma.ko 2023-10-06T01:04:07.006 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_pcmcia.ko 2023-10-06T01:04:07.007 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_pdc2027x.ko 2023-10-06T01:04:07.007 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_pdc202xx_old.ko 2023-10-06T01:04:07.007 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_piccolo.ko 2023-10-06T01:04:07.007 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_rdc.ko 2023-10-06T01:04:07.007 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_sch.ko 2023-10-06T01:04:07.007 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_serverworks.ko 2023-10-06T01:04:07.007 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_sil680.ko 2023-10-06T01:04:07.007 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_sis.ko 2023-10-06T01:04:07.007 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_sl82c105.ko 2023-10-06T01:04:07.007 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_triflex.ko 2023-10-06T01:04:07.007 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_via.ko 2023-10-06T01:04:07.007 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pdc_adma.ko 2023-10-06T01:04:07.008 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/sata_inic162x.ko 2023-10-06T01:04:07.008 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/sata_mv.ko 2023-10-06T01:04:07.008 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/sata_nv.ko 2023-10-06T01:04:07.008 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/sata_promise.ko 2023-10-06T01:04:07.008 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/sata_qstor.ko 2023-10-06T01:04:07.008 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/sata_sil.ko 2023-10-06T01:04:07.008 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/sata_sil24.ko 2023-10-06T01:04:07.008 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/sata_sis.ko 2023-10-06T01:04:07.008 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/sata_svw.ko 2023-10-06T01:04:07.008 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/sata_sx4.ko 2023-10-06T01:04:07.008 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/sata_uli.ko 2023-10-06T01:04:07.008 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/sata_via.ko 2023-10-06T01:04:07.009 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/sata_vsc.ko 2023-10-06T01:04:07.009 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/auxdisplay 2023-10-06T01:04:07.009 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/auxdisplay/ks0108.ko 2023-10-06T01:04:07.009 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/base 2023-10-06T01:04:07.009 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/base/regmap 2023-10-06T01:04:07.009 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/base/regmap/regmap-i2c.ko 2023-10-06T01:04:07.009 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/base/regmap/regmap-mmio.ko 2023-10-06T01:04:07.009 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/bcma 2023-10-06T01:04:07.009 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/bcma/bcma.ko 2023-10-06T01:04:07.009 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block 2023-10-06T01:04:07.009 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/aoe 2023-10-06T01:04:07.009 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/aoe/aoe.ko 2023-10-06T01:04:07.010 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/brd.ko 2023-10-06T01:04:07.010 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/drbd 2023-10-06T01:04:07.010 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/drbd/drbd.ko 2023-10-06T01:04:07.010 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/floppy.ko 2023-10-06T01:04:07.010 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/loop.ko 2023-10-06T01:04:07.010 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/mtip32xx 2023-10-06T01:04:07.010 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/mtip32xx/mtip32xx.ko 2023-10-06T01:04:07.010 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/nbd.ko 2023-10-06T01:04:07.010 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/null_blk 2023-10-06T01:04:07.010 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/null_blk/null_blk.ko 2023-10-06T01:04:07.010 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/pktcdvd.ko 2023-10-06T01:04:07.010 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/rbd.ko 2023-10-06T01:04:07.011 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/virtio_blk.ko 2023-10-06T01:04:07.011 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/xen-blkback 2023-10-06T01:04:07.011 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/xen-blkback/xen-blkback.ko 2023-10-06T01:04:07.011 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/xen-blkfront.ko 2023-10-06T01:04:07.011 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/zram 2023-10-06T01:04:07.011 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/zram/zram.ko 2023-10-06T01:04:07.011 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char 2023-10-06T01:04:07.011 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/hangcheck-timer.ko 2023-10-06T01:04:07.011 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/hw_random 2023-10-06T01:04:07.011 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/hw_random/amd-rng.ko 2023-10-06T01:04:07.011 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/hw_random/intel-rng.ko 2023-10-06T01:04:07.011 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/hw_random/timeriomem-rng.ko 2023-10-06T01:04:07.012 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/hw_random/via-rng.ko 2023-10-06T01:04:07.012 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/hw_random/virtio-rng.ko 2023-10-06T01:04:07.012 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/ipmi 2023-10-06T01:04:07.012 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/ipmi/ipmi_devintf.ko 2023-10-06T01:04:07.012 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2023-10-06T01:04:07.012 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2023-10-06T01:04:07.012 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/ipmi/ipmi_si.ko 2023-10-06T01:04:07.012 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/ipmi/ipmi_ssif.ko 2023-10-06T01:04:07.012 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2023-10-06T01:04:07.012 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/lp.ko 2023-10-06T01:04:07.012 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/mwave 2023-10-06T01:04:07.012 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/mwave/mwave.ko 2023-10-06T01:04:07.013 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/ppdev.ko 2023-10-06T01:04:07.013 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/tlclk.ko 2023-10-06T01:04:07.013 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/tpm 2023-10-06T01:04:07.013 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/tpm/tpm.ko 2023-10-06T01:04:07.013 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/tpm/tpm_atmel.ko 2023-10-06T01:04:07.013 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/tpm/tpm_infineon.ko 2023-10-06T01:04:07.013 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/tpm/tpm_nsc.ko 2023-10-06T01:04:07.013 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/tpm/tpm_tis.ko 2023-10-06T01:04:07.013 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/tpm/tpm_tis_core.ko 2023-10-06T01:04:07.013 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/uv_mmtimer.ko 2023-10-06T01:04:07.013 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/virtio_console.ko 2023-10-06T01:04:07.013 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/cpufreq 2023-10-06T01:04:07.014 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/cpufreq/acpi-cpufreq.ko 2023-10-06T01:04:07.014 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2023-10-06T01:04:07.014 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/cpufreq/p4-clockmod.ko 2023-10-06T01:04:07.014 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/cpufreq/pcc-cpufreq.ko 2023-10-06T01:04:07.014 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/cpufreq/powernow-k8.ko 2023-10-06T01:04:07.014 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/cpufreq/speedstep-lib.ko 2023-10-06T01:04:07.014 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/crypto 2023-10-06T01:04:07.014 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/crypto/ccp 2023-10-06T01:04:07.014 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/crypto/ccp/ccp-crypto.ko 2023-10-06T01:04:07.014 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/crypto/ccp/ccp.ko 2023-10-06T01:04:07.014 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/crypto/intel 2023-10-06T01:04:07.014 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/crypto/intel/qat 2023-10-06T01:04:07.015 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/crypto/intel/qat/qat_common 2023-10-06T01:04:07.015 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2023-10-06T01:04:07.015 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/crypto/intel/qat/qat_dh895xcc 2023-10-06T01:04:07.015 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2023-10-06T01:04:07.015 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/crypto/padlock-aes.ko 2023-10-06T01:04:07.015 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/crypto/padlock-sha.ko 2023-10-06T01:04:07.015 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/crypto/virtio 2023-10-06T01:04:07.015 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/crypto/virtio/virtio_crypto.ko 2023-10-06T01:04:07.015 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/dca 2023-10-06T01:04:07.015 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/dca/dca.ko 2023-10-06T01:04:07.015 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/devfreq 2023-10-06T01:04:07.015 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/devfreq/governor_simpleondemand.ko 2023-10-06T01:04:07.016 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/dma 2023-10-06T01:04:07.016 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/dma/dw 2023-10-06T01:04:07.016 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/dma/dw/dw_dmac.ko 2023-10-06T01:04:07.016 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/dma/ioat 2023-10-06T01:04:07.016 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/dma/ioat/ioatdma.ko 2023-10-06T01:04:07.016 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/edac 2023-10-06T01:04:07.016 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/edac/amd64_edac.ko 2023-10-06T01:04:07.016 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/edac/e752x_edac.ko 2023-10-06T01:04:07.016 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/edac/edac_mce_amd.ko 2023-10-06T01:04:07.016 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/edac/i3000_edac.ko 2023-10-06T01:04:07.016 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/edac/i3200_edac.ko 2023-10-06T01:04:07.016 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/edac/i5100_edac.ko 2023-10-06T01:04:07.017 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/edac/i5400_edac.ko 2023-10-06T01:04:07.017 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/edac/i7300_edac.ko 2023-10-06T01:04:07.017 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/edac/i7core_edac.ko 2023-10-06T01:04:07.017 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/edac/i82975x_edac.ko 2023-10-06T01:04:07.017 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/edac/ie31200_edac.ko 2023-10-06T01:04:07.017 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/edac/sb_edac.ko 2023-10-06T01:04:07.017 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/edac/x38_edac.ko 2023-10-06T01:04:07.017 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/firmware 2023-10-06T01:04:07.017 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/firmware/edd.ko 2023-10-06T01:04:07.017 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/firmware/iscsi_ibft.ko 2023-10-06T01:04:07.017 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/gpio 2023-10-06T01:04:07.017 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/gpio/gpio-ich.ko 2023-10-06T01:04:07.018 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/gpio/gpio-viperboard.ko 2023-10-06T01:04:07.018 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid 2023-10-06T01:04:07.018 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-appleir.ko 2023-10-06T01:04:07.018 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-aureal.ko 2023-10-06T01:04:07.018 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-axff.ko 2023-10-06T01:04:07.018 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-dr.ko 2023-10-06T01:04:07.018 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-elecom.ko 2023-10-06T01:04:07.018 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-elo.ko 2023-10-06T01:04:07.018 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-emsff.ko 2023-10-06T01:04:07.018 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-gaff.ko 2023-10-06T01:04:07.018 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-gt683r.ko 2023-10-06T01:04:07.018 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-gyration.ko 2023-10-06T01:04:07.019 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-holtek-kbd.ko 2023-10-06T01:04:07.019 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-holtek-mouse.ko 2023-10-06T01:04:07.019 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-holtekff.ko 2023-10-06T01:04:07.019 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-hyperv.ko 2023-10-06T01:04:07.019 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-icade.ko 2023-10-06T01:04:07.019 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-keytouch.ko 2023-10-06T01:04:07.019 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-kye.ko 2023-10-06T01:04:07.019 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-lcpower.ko 2023-10-06T01:04:07.019 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-led.ko 2023-10-06T01:04:07.019 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-lenovo.ko 2023-10-06T01:04:07.019 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-logitech-dj.ko 2023-10-06T01:04:07.019 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-logitech-hidpp.ko 2023-10-06T01:04:07.020 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-multitouch.ko 2023-10-06T01:04:07.020 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-ortek.ko 2023-10-06T01:04:07.020 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-penmount.ko 2023-10-06T01:04:07.020 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-petalynx.ko 2023-10-06T01:04:07.020 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-picolcd.ko 2023-10-06T01:04:07.020 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-pl.ko 2023-10-06T01:04:07.020 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-plantronics.ko 2023-10-06T01:04:07.020 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-primax.ko 2023-10-06T01:04:07.020 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-rmi.ko 2023-10-06T01:04:07.020 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-roccat-arvo.ko 2023-10-06T01:04:07.020 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-roccat-common.ko 2023-10-06T01:04:07.020 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-roccat-isku.ko 2023-10-06T01:04:07.021 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-roccat-kone.ko 2023-10-06T01:04:07.021 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-roccat-koneplus.ko 2023-10-06T01:04:07.021 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-roccat-konepure.ko 2023-10-06T01:04:07.021 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-roccat-kovaplus.ko 2023-10-06T01:04:07.021 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-roccat-lua.ko 2023-10-06T01:04:07.021 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-roccat-pyra.ko 2023-10-06T01:04:07.021 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-roccat-ryos.ko 2023-10-06T01:04:07.021 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-roccat-savu.ko 2023-10-06T01:04:07.021 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-roccat.ko 2023-10-06T01:04:07.021 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-saitek.ko 2023-10-06T01:04:07.021 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-samsung.ko 2023-10-06T01:04:07.021 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-sensor-hub.ko 2023-10-06T01:04:07.022 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-sjoy.ko 2023-10-06T01:04:07.022 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-sony.ko 2023-10-06T01:04:07.022 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-speedlink.ko 2023-10-06T01:04:07.022 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-steelseries.ko 2023-10-06T01:04:07.022 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-sunplus.ko 2023-10-06T01:04:07.022 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-thrustmaster.ko 2023-10-06T01:04:07.022 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-tivo.ko 2023-10-06T01:04:07.022 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-tmff.ko 2023-10-06T01:04:07.022 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-topseed.ko 2023-10-06T01:04:07.022 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-twinhan.ko 2023-10-06T01:04:07.022 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-uclogic.ko 2023-10-06T01:04:07.022 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-waltop.ko 2023-10-06T01:04:07.023 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-wiimote.ko 2023-10-06T01:04:07.023 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-xinmo.ko 2023-10-06T01:04:07.023 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-zpff.ko 2023-10-06T01:04:07.023 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-zydacron.ko 2023-10-06T01:04:07.023 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/uhid.ko 2023-10-06T01:04:07.023 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/wacom.ko 2023-10-06T01:04:07.023 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hv 2023-10-06T01:04:07.023 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hv/hv_balloon.ko 2023-10-06T01:04:07.023 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hv/hv_utils.ko 2023-10-06T01:04:07.023 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hv/hv_vmbus.ko 2023-10-06T01:04:07.023 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon 2023-10-06T01:04:07.023 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/abituguru.ko 2023-10-06T01:04:07.024 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/abituguru3.ko 2023-10-06T01:04:07.024 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/acpi_power_meter.ko 2023-10-06T01:04:07.024 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ad7414.ko 2023-10-06T01:04:07.024 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ad7418.ko 2023-10-06T01:04:07.024 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/adc128d818.ko 2023-10-06T01:04:07.024 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/adm1025.ko 2023-10-06T01:04:07.024 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/adm1026.ko 2023-10-06T01:04:07.024 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/adm1029.ko 2023-10-06T01:04:07.024 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/adm1031.ko 2023-10-06T01:04:07.024 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/adm9240.ko 2023-10-06T01:04:07.024 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ads7828.ko 2023-10-06T01:04:07.024 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/adt7410.ko 2023-10-06T01:04:07.025 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/adt7411.ko 2023-10-06T01:04:07.025 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/adt7462.ko 2023-10-06T01:04:07.025 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/adt7470.ko 2023-10-06T01:04:07.025 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/adt7475.ko 2023-10-06T01:04:07.025 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/adt7x10.ko 2023-10-06T01:04:07.025 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/amc6821.ko 2023-10-06T01:04:07.025 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/applesmc.ko 2023-10-06T01:04:07.025 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/asb100.ko 2023-10-06T01:04:07.025 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/asc7621.ko 2023-10-06T01:04:07.025 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/asus_atk0110.ko 2023-10-06T01:04:07.025 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/atxp1.ko 2023-10-06T01:04:07.025 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/coretemp.ko 2023-10-06T01:04:07.026 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/dell-smm-hwmon.ko 2023-10-06T01:04:07.026 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/dme1737.ko 2023-10-06T01:04:07.026 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ds1621.ko 2023-10-06T01:04:07.026 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ds620.ko 2023-10-06T01:04:07.026 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/emc1403.ko 2023-10-06T01:04:07.026 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/emc6w201.ko 2023-10-06T01:04:07.026 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/f71805f.ko 2023-10-06T01:04:07.026 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/f71882fg.ko 2023-10-06T01:04:07.026 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/f75375s.ko 2023-10-06T01:04:07.026 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/fam15h_power.ko 2023-10-06T01:04:07.026 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/fschmd.ko 2023-10-06T01:04:07.026 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/g760a.ko 2023-10-06T01:04:07.027 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/g762.ko 2023-10-06T01:04:07.027 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/gl518sm.ko 2023-10-06T01:04:07.027 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/gl520sm.ko 2023-10-06T01:04:07.027 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/hwmon-vid.ko 2023-10-06T01:04:07.027 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/i5500_temp.ko 2023-10-06T01:04:07.027 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/i5k_amb.ko 2023-10-06T01:04:07.027 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ibmaem.ko 2023-10-06T01:04:07.027 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ibmpex.ko 2023-10-06T01:04:07.027 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ina209.ko 2023-10-06T01:04:07.027 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ina2xx.ko 2023-10-06T01:04:07.027 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/it87.ko 2023-10-06T01:04:07.027 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/k10temp.ko 2023-10-06T01:04:07.028 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/k8temp.ko 2023-10-06T01:04:07.028 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lineage-pem.ko 2023-10-06T01:04:07.028 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm63.ko 2023-10-06T01:04:07.028 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm73.ko 2023-10-06T01:04:07.028 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm75.ko 2023-10-06T01:04:07.028 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm77.ko 2023-10-06T01:04:07.028 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm78.ko 2023-10-06T01:04:07.028 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm80.ko 2023-10-06T01:04:07.028 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm83.ko 2023-10-06T01:04:07.028 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm85.ko 2023-10-06T01:04:07.028 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm87.ko 2023-10-06T01:04:07.028 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm90.ko 2023-10-06T01:04:07.029 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm92.ko 2023-10-06T01:04:07.029 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm93.ko 2023-10-06T01:04:07.029 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm95234.ko 2023-10-06T01:04:07.029 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm95241.ko 2023-10-06T01:04:07.029 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm95245.ko 2023-10-06T01:04:07.029 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ltc2945.ko 2023-10-06T01:04:07.029 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ltc4151.ko 2023-10-06T01:04:07.029 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ltc4215.ko 2023-10-06T01:04:07.029 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ltc4222.ko 2023-10-06T01:04:07.029 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ltc4245.ko 2023-10-06T01:04:07.029 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ltc4260.ko 2023-10-06T01:04:07.029 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ltc4261.ko 2023-10-06T01:04:07.030 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/max16065.ko 2023-10-06T01:04:07.030 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/max1619.ko 2023-10-06T01:04:07.030 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/max1668.ko 2023-10-06T01:04:07.030 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/max197.ko 2023-10-06T01:04:07.030 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/max6639.ko 2023-10-06T01:04:07.030 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/max6650.ko 2023-10-06T01:04:07.030 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/max6697.ko 2023-10-06T01:04:07.030 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/mcp3021.ko 2023-10-06T01:04:07.030 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/nct6683.ko 2023-10-06T01:04:07.030 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/nct6775-core.ko 2023-10-06T01:04:07.030 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/nct6775.ko 2023-10-06T01:04:07.030 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/nct7802.ko 2023-10-06T01:04:07.031 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pc87360.ko 2023-10-06T01:04:07.031 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pc87427.ko 2023-10-06T01:04:07.031 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pcf8591.ko 2023-10-06T01:04:07.031 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pmbus 2023-10-06T01:04:07.031 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pmbus/adm1275.ko 2023-10-06T01:04:07.031 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pmbus/lm25066.ko 2023-10-06T01:04:07.031 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pmbus/ltc2978.ko 2023-10-06T01:04:07.031 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pmbus/max16064.ko 2023-10-06T01:04:07.031 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pmbus/max34440.ko 2023-10-06T01:04:07.031 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pmbus/max8688.ko 2023-10-06T01:04:07.031 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pmbus/pmbus.ko 2023-10-06T01:04:07.031 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2023-10-06T01:04:07.032 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pmbus/tps40422.ko 2023-10-06T01:04:07.032 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pmbus/ucd9000.ko 2023-10-06T01:04:07.032 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pmbus/ucd9200.ko 2023-10-06T01:04:07.032 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pmbus/zl6100.ko 2023-10-06T01:04:07.032 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/powr1220.ko 2023-10-06T01:04:07.032 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/sch5627.ko 2023-10-06T01:04:07.032 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/sch5636.ko 2023-10-06T01:04:07.032 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/sch56xx-common.ko 2023-10-06T01:04:07.032 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/sht15.ko 2023-10-06T01:04:07.032 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/sht21.ko 2023-10-06T01:04:07.032 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/shtc1.ko 2023-10-06T01:04:07.032 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/sis5595.ko 2023-10-06T01:04:07.033 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/smsc47b397.ko 2023-10-06T01:04:07.033 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/smsc47m1.ko 2023-10-06T01:04:07.033 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/smsc47m192.ko 2023-10-06T01:04:07.033 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/thmc50.ko 2023-10-06T01:04:07.033 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/tmp102.ko 2023-10-06T01:04:07.033 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/tmp103.ko 2023-10-06T01:04:07.033 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/tmp401.ko 2023-10-06T01:04:07.033 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/tmp421.ko 2023-10-06T01:04:07.033 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/via-cputemp.ko 2023-10-06T01:04:07.033 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/via686a.ko 2023-10-06T01:04:07.033 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/vt1211.ko 2023-10-06T01:04:07.033 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/vt8231.ko 2023-10-06T01:04:07.034 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/w83627ehf.ko 2023-10-06T01:04:07.034 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/w83627hf.ko 2023-10-06T01:04:07.034 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/w83781d.ko 2023-10-06T01:04:07.034 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/w83791d.ko 2023-10-06T01:04:07.034 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/w83792d.ko 2023-10-06T01:04:07.034 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/w83793.ko 2023-10-06T01:04:07.034 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/w83795.ko 2023-10-06T01:04:07.034 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/w83l785ts.ko 2023-10-06T01:04:07.034 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/w83l786ng.ko 2023-10-06T01:04:07.034 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c 2023-10-06T01:04:07.034 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/algos 2023-10-06T01:04:07.034 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2023-10-06T01:04:07.035 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2023-10-06T01:04:07.035 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses 2023-10-06T01:04:07.035 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2023-10-06T01:04:07.035 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-amd756.ko 2023-10-06T01:04:07.035 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-amd8111.ko 2023-10-06T01:04:07.035 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2023-10-06T01:04:07.035 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-designware-core.ko 2023-10-06T01:04:07.035 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2023-10-06T01:04:07.035 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2023-10-06T01:04:07.035 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2023-10-06T01:04:07.035 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-i801.ko 2023-10-06T01:04:07.035 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-isch.ko 2023-10-06T01:04:07.036 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-ismt.ko 2023-10-06T01:04:07.036 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2023-10-06T01:04:07.036 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-nforce2.ko 2023-10-06T01:04:07.036 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-parport.ko 2023-10-06T01:04:07.036 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2023-10-06T01:04:07.036 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-piix4.ko 2023-10-06T01:04:07.036 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-scmi.ko 2023-10-06T01:04:07.036 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-simtec.ko 2023-10-06T01:04:07.036 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-sis96x.ko 2023-10-06T01:04:07.036 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2023-10-06T01:04:07.036 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-via.ko 2023-10-06T01:04:07.036 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-viapro.ko 2023-10-06T01:04:07.037 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-viperboard.ko 2023-10-06T01:04:07.037 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/i2c-dev.ko 2023-10-06T01:04:07.037 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/i2c-mux.ko 2023-10-06T01:04:07.037 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/i2c-slave-eeprom.ko 2023-10-06T01:04:07.037 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/i2c-smbus.ko 2023-10-06T01:04:07.037 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/i2c-stub.ko 2023-10-06T01:04:07.037 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband 2023-10-06T01:04:07.037 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/core 2023-10-06T01:04:07.037 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/core/ib_cm.ko 2023-10-06T01:04:07.037 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/core/ib_core.ko 2023-10-06T01:04:07.037 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/core/ib_umad.ko 2023-10-06T01:04:07.037 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/core/ib_uverbs.ko 2023-10-06T01:04:07.038 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/core/iw_cm.ko 2023-10-06T01:04:07.038 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/core/rdma_cm.ko 2023-10-06T01:04:07.038 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/core/rdma_ucm.ko 2023-10-06T01:04:07.038 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/hw 2023-10-06T01:04:07.038 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/hw/cxgb4 2023-10-06T01:04:07.038 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2023-10-06T01:04:07.038 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/hw/mlx4 2023-10-06T01:04:07.038 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2023-10-06T01:04:07.038 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/hw/mlx5 2023-10-06T01:04:07.038 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2023-10-06T01:04:07.038 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/hw/mthca 2023-10-06T01:04:07.038 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2023-10-06T01:04:07.039 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/ulp 2023-10-06T01:04:07.039 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/ulp/ipoib 2023-10-06T01:04:07.039 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2023-10-06T01:04:07.039 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/ulp/iser 2023-10-06T01:04:07.039 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2023-10-06T01:04:07.039 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/ulp/isert 2023-10-06T01:04:07.039 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2023-10-06T01:04:07.039 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/ulp/srp 2023-10-06T01:04:07.039 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2023-10-06T01:04:07.039 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/ulp/srpt 2023-10-06T01:04:07.039 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2023-10-06T01:04:07.039 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input 2023-10-06T01:04:07.040 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/gameport 2023-10-06T01:04:07.040 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/gameport/emu10k1-gp.ko 2023-10-06T01:04:07.040 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/gameport/fm801-gp.ko 2023-10-06T01:04:07.040 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/gameport/gameport.ko 2023-10-06T01:04:07.040 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/gameport/lightning.ko 2023-10-06T01:04:07.040 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/gameport/ns558.ko 2023-10-06T01:04:07.040 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/joydev.ko 2023-10-06T01:04:07.040 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/keyboard 2023-10-06T01:04:07.040 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/keyboard/gpio_keys.ko 2023-10-06T01:04:07.040 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/mouse 2023-10-06T01:04:07.040 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/mouse/appletouch.ko 2023-10-06T01:04:07.040 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/mouse/bcm5974.ko 2023-10-06T01:04:07.041 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/mouse/cyapatp.ko 2023-10-06T01:04:07.041 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/mouse/elan_i2c.ko 2023-10-06T01:04:07.041 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/mouse/sermouse.ko 2023-10-06T01:04:07.041 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/mouse/synaptics_i2c.ko 2023-10-06T01:04:07.041 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/mouse/synaptics_usb.ko 2023-10-06T01:04:07.041 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/mouse/vsxxxaa.ko 2023-10-06T01:04:07.041 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/rmi4 2023-10-06T01:04:07.041 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/rmi4/rmi_core.ko 2023-10-06T01:04:07.041 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/serio 2023-10-06T01:04:07.041 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/serio/altera_ps2.ko 2023-10-06T01:04:07.041 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/serio/arc_ps2.ko 2023-10-06T01:04:07.041 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/serio/hyperv-keyboard.ko 2023-10-06T01:04:07.042 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/serio/serio_raw.ko 2023-10-06T01:04:07.042 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/sparse-keymap.ko 2023-10-06T01:04:07.042 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/iommu 2023-10-06T01:04:07.042 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/iommu/amd 2023-10-06T01:04:07.042 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/iommu/amd/iommu_v2.ko 2023-10-06T01:04:07.042 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds 2023-10-06T01:04:07.042 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/leds-blinkm.ko 2023-10-06T01:04:07.042 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/leds-lm3530.ko 2023-10-06T01:04:07.042 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/leds-lp3944.ko 2023-10-06T01:04:07.042 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/leds-ss4200.ko 2023-10-06T01:04:07.042 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/trigger 2023-10-06T01:04:07.042 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/trigger/ledtrig-audio.ko 2023-10-06T01:04:07.043 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2023-10-06T01:04:07.043 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/trigger/ledtrig-camera.ko 2023-10-06T01:04:07.043 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2023-10-06T01:04:07.043 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2023-10-06T01:04:07.043 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2023-10-06T01:04:07.043 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/trigger/ledtrig-timer.ko 2023-10-06T01:04:07.043 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/trigger/ledtrig-transient.ko 2023-10-06T01:04:07.043 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md 2023-10-06T01:04:07.043 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/bcache 2023-10-06T01:04:07.043 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/bcache/bcache.ko 2023-10-06T01:04:07.043 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-bio-prison.ko 2023-10-06T01:04:07.043 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-cache-smq.ko 2023-10-06T01:04:07.044 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-cache.ko 2023-10-06T01:04:07.044 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-crypt.ko 2023-10-06T01:04:07.044 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-delay.ko 2023-10-06T01:04:07.044 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-flakey.ko 2023-10-06T01:04:07.044 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-log-userspace.ko 2023-10-06T01:04:07.044 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-multipath.ko 2023-10-06T01:04:07.044 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-queue-length.ko 2023-10-06T01:04:07.044 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-raid.ko 2023-10-06T01:04:07.044 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-round-robin.ko 2023-10-06T01:04:07.044 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-service-time.ko 2023-10-06T01:04:07.044 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-switch.ko 2023-10-06T01:04:07.044 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-thin-pool.ko 2023-10-06T01:04:07.045 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-verity.ko 2023-10-06T01:04:07.045 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/faulty.ko 2023-10-06T01:04:07.045 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/linear.ko 2023-10-06T01:04:07.045 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/multipath.ko 2023-10-06T01:04:07.045 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/persistent-data 2023-10-06T01:04:07.045 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2023-10-06T01:04:07.045 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/raid0.ko 2023-10-06T01:04:07.045 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/raid1.ko 2023-10-06T01:04:07.045 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/raid10.ko 2023-10-06T01:04:07.045 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/raid456.ko 2023-10-06T01:04:07.045 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/message 2023-10-06T01:04:07.046 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/message/fusion 2023-10-06T01:04:07.046 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/message/fusion/mptbase.ko 2023-10-06T01:04:07.046 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/message/fusion/mptctl.ko 2023-10-06T01:04:07.046 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/message/fusion/mptfc.ko 2023-10-06T01:04:07.046 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/message/fusion/mptlan.ko 2023-10-06T01:04:07.046 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/message/fusion/mptsas.ko 2023-10-06T01:04:07.046 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/message/fusion/mptscsih.ko 2023-10-06T01:04:07.046 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/message/fusion/mptspi.ko 2023-10-06T01:04:07.046 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/mfd 2023-10-06T01:04:07.046 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/mfd/lpc_ich.ko 2023-10-06T01:04:07.046 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/mfd/lpc_sch.ko 2023-10-06T01:04:07.046 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/mfd/mfd-core.ko 2023-10-06T01:04:07.047 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/mfd/sm501.ko 2023-10-06T01:04:07.047 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/mfd/viperboard.ko 2023-10-06T01:04:07.047 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/mfd/vx855.ko 2023-10-06T01:04:07.047 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/mfd/wl1273-core.ko 2023-10-06T01:04:07.047 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc 2023-10-06T01:04:07.047 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/altera-stapl 2023-10-06T01:04:07.047 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2023-10-06T01:04:07.047 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/apds9802als.ko 2023-10-06T01:04:07.047 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/apds990x.ko 2023-10-06T01:04:07.047 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/bh1770glc.ko 2023-10-06T01:04:07.047 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/cb710 2023-10-06T01:04:07.047 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/cb710/cb710.ko 2023-10-06T01:04:07.048 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/eeprom 2023-10-06T01:04:07.048 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/eeprom/at24.ko 2023-10-06T01:04:07.048 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/eeprom/eeprom.ko 2023-10-06T01:04:07.048 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2023-10-06T01:04:07.048 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/eeprom/max6875.ko 2023-10-06T01:04:07.048 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/enclosure.ko 2023-10-06T01:04:07.048 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/hpilo.ko 2023-10-06T01:04:07.048 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/isl29003.ko 2023-10-06T01:04:07.048 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/isl29020.ko 2023-10-06T01:04:07.048 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/lis3lv02d 2023-10-06T01:04:07.048 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2023-10-06T01:04:07.048 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2023-10-06T01:04:07.049 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/mei 2023-10-06T01:04:07.049 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/mei/mei-me.ko 2023-10-06T01:04:07.049 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/mei/mei-txe.ko 2023-10-06T01:04:07.049 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/mei/mei.ko 2023-10-06T01:04:07.049 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/sgi-gru 2023-10-06T01:04:07.049 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/sgi-gru/gru.ko 2023-10-06T01:04:07.049 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/sgi-xp 2023-10-06T01:04:07.049 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/sgi-xp/xp.ko 2023-10-06T01:04:07.049 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/sgi-xp/xpc.ko 2023-10-06T01:04:07.049 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/sgi-xp/xpnet.ko 2023-10-06T01:04:07.049 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/tifm_7xx1.ko 2023-10-06T01:04:07.049 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/tifm_core.ko 2023-10-06T01:04:07.050 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/tsl2550.ko 2023-10-06T01:04:07.050 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/vmw_balloon.ko 2023-10-06T01:04:07.050 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/vmw_vmci 2023-10-06T01:04:07.050 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2023-10-06T01:04:07.050 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net 2023-10-06T01:04:07.050 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/bonding 2023-10-06T01:04:07.050 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/bonding/bonding.ko 2023-10-06T01:04:07.050 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/dsa 2023-10-06T01:04:07.050 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/dsa/b53 2023-10-06T01:04:07.050 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/dsa/b53/b53_common.ko 2023-10-06T01:04:07.050 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/dsa/bcm-sf2.ko 2023-10-06T01:04:07.050 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/dsa/mv88e6060.ko 2023-10-06T01:04:07.051 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/dsa/mv88e6xxx 2023-10-06T01:04:07.051 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2023-10-06T01:04:07.051 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/dummy.ko 2023-10-06T01:04:07.051 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/eql.ko 2023-10-06T01:04:07.051 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet 2023-10-06T01:04:07.051 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/3com 2023-10-06T01:04:07.051 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2023-10-06T01:04:07.051 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2023-10-06T01:04:07.051 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/3com/3c59x.ko 2023-10-06T01:04:07.051 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/3com/typhoon.ko 2023-10-06T01:04:07.051 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/8390 2023-10-06T01:04:07.051 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/8390/8390.ko 2023-10-06T01:04:07.052 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2023-10-06T01:04:07.052 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2023-10-06T01:04:07.052 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2023-10-06T01:04:07.052 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/adaptec 2023-10-06T01:04:07.052 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/adaptec/starfire.ko 2023-10-06T01:04:07.052 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/agere 2023-10-06T01:04:07.052 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/agere/et131x.ko 2023-10-06T01:04:07.052 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/alteon 2023-10-06T01:04:07.052 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/alteon/acenic.ko 2023-10-06T01:04:07.052 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/altera 2023-10-06T01:04:07.052 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/altera/altera_tse.ko 2023-10-06T01:04:07.052 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/amd 2023-10-06T01:04:07.053 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/amd/amd8111e.ko 2023-10-06T01:04:07.053 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2023-10-06T01:04:07.053 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/amd/pcnet32.ko 2023-10-06T01:04:07.053 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/atheros 2023-10-06T01:04:07.053 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/atheros/alx 2023-10-06T01:04:07.053 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2023-10-06T01:04:07.053 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/atheros/atl1c 2023-10-06T01:04:07.053 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2023-10-06T01:04:07.053 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/atheros/atl1e 2023-10-06T01:04:07.053 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2023-10-06T01:04:07.053 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/atheros/atlx 2023-10-06T01:04:07.053 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2023-10-06T01:04:07.054 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2023-10-06T01:04:07.054 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/broadcom 2023-10-06T01:04:07.054 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/broadcom/b44.ko 2023-10-06T01:04:07.054 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2023-10-06T01:04:07.054 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/broadcom/bnx2x 2023-10-06T01:04:07.054 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2023-10-06T01:04:07.054 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/broadcom/cnic.ko 2023-10-06T01:04:07.054 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/broadcom/genet 2023-10-06T01:04:07.054 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2023-10-06T01:04:07.054 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/broadcom/tg3.ko 2023-10-06T01:04:07.054 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/brocade 2023-10-06T01:04:07.055 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/brocade/bna 2023-10-06T01:04:07.055 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2023-10-06T01:04:07.055 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/chelsio 2023-10-06T01:04:07.055 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/chelsio/cxgb 2023-10-06T01:04:07.055 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2023-10-06T01:04:07.055 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/chelsio/cxgb3 2023-10-06T01:04:07.055 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2023-10-06T01:04:07.055 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/chelsio/cxgb4 2023-10-06T01:04:07.055 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2023-10-06T01:04:07.055 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/chelsio/cxgb4vf 2023-10-06T01:04:07.055 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2023-10-06T01:04:07.055 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/chelsio/libcxgb 2023-10-06T01:04:07.056 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2023-10-06T01:04:07.056 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/cisco 2023-10-06T01:04:07.056 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/cisco/enic 2023-10-06T01:04:07.056 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2023-10-06T01:04:07.056 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/dec 2023-10-06T01:04:07.056 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/dec/tulip 2023-10-06T01:04:07.056 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2023-10-06T01:04:07.056 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2023-10-06T01:04:07.056 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2023-10-06T01:04:07.056 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2023-10-06T01:04:07.056 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2023-10-06T01:04:07.056 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2023-10-06T01:04:07.057 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/dlink 2023-10-06T01:04:07.057 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/dlink/dl2k.ko 2023-10-06T01:04:07.057 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/dlink/sundance.ko 2023-10-06T01:04:07.057 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/dnet.ko 2023-10-06T01:04:07.057 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/emulex 2023-10-06T01:04:07.057 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/emulex/benet 2023-10-06T01:04:07.057 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2023-10-06T01:04:07.057 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/ethoc.ko 2023-10-06T01:04:07.057 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/fealnx.ko 2023-10-06T01:04:07.057 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel 2023-10-06T01:04:07.057 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/e100.ko 2023-10-06T01:04:07.057 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/e1000 2023-10-06T01:04:07.058 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2023-10-06T01:04:07.058 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/e1000e 2023-10-06T01:04:07.058 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2023-10-06T01:04:07.058 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/fm10k 2023-10-06T01:04:07.058 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2023-10-06T01:04:07.058 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/i40e 2023-10-06T01:04:07.058 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2023-10-06T01:04:07.058 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/iavf 2023-10-06T01:04:07.058 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2023-10-06T01:04:07.058 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/igb 2023-10-06T01:04:07.058 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/igb/igb.ko 2023-10-06T01:04:07.059 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/igbvf 2023-10-06T01:04:07.059 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2023-10-06T01:04:07.059 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/ixgbe 2023-10-06T01:04:07.059 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2023-10-06T01:04:07.059 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/ixgbevf 2023-10-06T01:04:07.059 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2023-10-06T01:04:07.059 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/jme.ko 2023-10-06T01:04:07.059 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/marvell 2023-10-06T01:04:07.059 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2023-10-06T01:04:07.059 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/marvell/skge.ko 2023-10-06T01:04:07.059 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/marvell/sky2.ko 2023-10-06T01:04:07.059 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/mellanox 2023-10-06T01:04:07.060 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/mellanox/mlx4 2023-10-06T01:04:07.060 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2023-10-06T01:04:07.060 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2023-10-06T01:04:07.060 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/mellanox/mlx5 2023-10-06T01:04:07.060 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/mellanox/mlx5/core 2023-10-06T01:04:07.060 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2023-10-06T01:04:07.060 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/micrel 2023-10-06T01:04:07.060 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2023-10-06T01:04:07.060 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/myricom 2023-10-06T01:04:07.060 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/myricom/myri10ge 2023-10-06T01:04:07.060 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2023-10-06T01:04:07.060 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/natsemi 2023-10-06T01:04:07.060 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2023-10-06T01:04:07.061 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2023-10-06T01:04:07.061 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/neterion 2023-10-06T01:04:07.061 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/neterion/s2io.ko 2023-10-06T01:04:07.061 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/nvidia 2023-10-06T01:04:07.061 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2023-10-06T01:04:07.061 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/packetengines 2023-10-06T01:04:07.061 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2023-10-06T01:04:07.061 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2023-10-06T01:04:07.061 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/qlogic 2023-10-06T01:04:07.061 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/qlogic/netxen 2023-10-06T01:04:07.061 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2023-10-06T01:04:07.061 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2023-10-06T01:04:07.062 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/qlogic/qlcnic 2023-10-06T01:04:07.062 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2023-10-06T01:04:07.062 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/rdc 2023-10-06T01:04:07.062 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/rdc/r6040.ko 2023-10-06T01:04:07.062 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/realtek 2023-10-06T01:04:07.062 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/realtek/8139cp.ko 2023-10-06T01:04:07.062 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/realtek/8139too.ko 2023-10-06T01:04:07.062 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/realtek/atp.ko 2023-10-06T01:04:07.062 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/realtek/r8169.ko 2023-10-06T01:04:07.062 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/rocker 2023-10-06T01:04:07.062 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/rocker/rocker.ko 2023-10-06T01:04:07.063 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/sfc 2023-10-06T01:04:07.063 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/sfc/sfc.ko 2023-10-06T01:04:07.063 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/silan 2023-10-06T01:04:07.063 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/silan/sc92031.ko 2023-10-06T01:04:07.063 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/sis 2023-10-06T01:04:07.063 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/sis/sis190.ko 2023-10-06T01:04:07.063 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/sis/sis900.ko 2023-10-06T01:04:07.063 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/smsc 2023-10-06T01:04:07.063 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/smsc/epic100.ko 2023-10-06T01:04:07.063 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2023-10-06T01:04:07.063 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2023-10-06T01:04:07.063 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2023-10-06T01:04:07.064 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/stmicro 2023-10-06T01:04:07.064 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/stmicro/stmmac 2023-10-06T01:04:07.064 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2023-10-06T01:04:07.064 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2023-10-06T01:04:07.064 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/sun 2023-10-06T01:04:07.064 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/sun/cassini.ko 2023-10-06T01:04:07.064 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/sun/niu.ko 2023-10-06T01:04:07.064 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/sun/sungem.ko 2023-10-06T01:04:07.064 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/sun/sunhme.ko 2023-10-06T01:04:07.064 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/tehuti 2023-10-06T01:04:07.064 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2023-10-06T01:04:07.064 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/ti 2023-10-06T01:04:07.065 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/ti/tlan.ko 2023-10-06T01:04:07.065 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/via 2023-10-06T01:04:07.065 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/via/via-rhine.ko 2023-10-06T01:04:07.065 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/via/via-velocity.ko 2023-10-06T01:04:07.065 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/wiznet 2023-10-06T01:04:07.065 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/wiznet/w5100.ko 2023-10-06T01:04:07.065 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/wiznet/w5300.ko 2023-10-06T01:04:07.065 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/xircom 2023-10-06T01:04:07.065 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2023-10-06T01:04:07.065 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/geneve.ko 2023-10-06T01:04:07.065 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/hyperv 2023-10-06T01:04:07.065 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/hyperv/hv_netvsc.ko 2023-10-06T01:04:07.066 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ieee802154 2023-10-06T01:04:07.066 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ieee802154/fakelb.ko 2023-10-06T01:04:07.066 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ifb.ko 2023-10-06T01:04:07.066 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ipvlan 2023-10-06T01:04:07.066 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ipvlan/ipvlan.ko 2023-10-06T01:04:07.066 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/macvlan.ko 2023-10-06T01:04:07.066 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/macvtap.ko 2023-10-06T01:04:07.066 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/mdio 2023-10-06T01:04:07.066 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/mdio.ko 2023-10-06T01:04:07.066 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2023-10-06T01:04:07.066 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/mdio/mdio-bitbang.ko 2023-10-06T01:04:07.066 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/mdio/mdio-regmap.ko 2023-10-06T01:04:07.067 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/mii.ko 2023-10-06T01:04:07.067 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/net_failover.ko 2023-10-06T01:04:07.067 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/netconsole.ko 2023-10-06T01:04:07.067 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/nlmon.ko 2023-10-06T01:04:07.067 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/pcs 2023-10-06T01:04:07.067 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/pcs/pcs-lynx.ko 2023-10-06T01:04:07.067 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/pcs/pcs_xpcs.ko 2023-10-06T01:04:07.067 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy 2023-10-06T01:04:07.067 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/amd.ko 2023-10-06T01:04:07.067 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/bcm-phy-lib.ko 2023-10-06T01:04:07.067 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/bcm-phy-ptp.ko 2023-10-06T01:04:07.067 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/bcm7xxx.ko 2023-10-06T01:04:07.068 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/bcm87xx.ko 2023-10-06T01:04:07.068 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/broadcom.ko 2023-10-06T01:04:07.068 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/cicada.ko 2023-10-06T01:04:07.068 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/davicom.ko 2023-10-06T01:04:07.068 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/dp83640.ko 2023-10-06T01:04:07.068 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/et1011c.ko 2023-10-06T01:04:07.068 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/icplus.ko 2023-10-06T01:04:07.068 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/lxt.ko 2023-10-06T01:04:07.068 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/marvell.ko 2023-10-06T01:04:07.068 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/micrel.ko 2023-10-06T01:04:07.068 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/national.ko 2023-10-06T01:04:07.068 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/phylink.ko 2023-10-06T01:04:07.069 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/qsemi.ko 2023-10-06T01:04:07.069 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/realtek.ko 2023-10-06T01:04:07.069 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/smsc.ko 2023-10-06T01:04:07.069 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/ste10Xp.ko 2023-10-06T01:04:07.069 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/vitesse.ko 2023-10-06T01:04:07.069 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ppp 2023-10-06T01:04:07.069 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ppp/bsd_comp.ko 2023-10-06T01:04:07.069 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ppp/ppp_async.ko 2023-10-06T01:04:07.069 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ppp/ppp_deflate.ko 2023-10-06T01:04:07.069 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ppp/ppp_generic.ko 2023-10-06T01:04:07.069 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ppp/ppp_mppe.ko 2023-10-06T01:04:07.069 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ppp/ppp_synctty.ko 2023-10-06T01:04:07.070 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ppp/pppoe.ko 2023-10-06T01:04:07.070 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ppp/pppox.ko 2023-10-06T01:04:07.070 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ppp/pptp.ko 2023-10-06T01:04:07.070 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/slip 2023-10-06T01:04:07.070 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/slip/slhc.ko 2023-10-06T01:04:07.070 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/slip/slip.ko 2023-10-06T01:04:07.070 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/sungem_phy.ko 2023-10-06T01:04:07.070 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/tap.ko 2023-10-06T01:04:07.070 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/team 2023-10-06T01:04:07.070 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/team/team.ko 2023-10-06T01:04:07.070 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/team/team_mode_activebackup.ko 2023-10-06T01:04:07.070 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/team/team_mode_broadcast.ko 2023-10-06T01:04:07.071 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/team/team_mode_loadbalance.ko 2023-10-06T01:04:07.071 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/team/team_mode_random.ko 2023-10-06T01:04:07.071 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/team/team_mode_roundrobin.ko 2023-10-06T01:04:07.071 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/tun.ko 2023-10-06T01:04:07.071 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/veth.ko 2023-10-06T01:04:07.071 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/virtio_net.ko 2023-10-06T01:04:07.071 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/vmxnet3 2023-10-06T01:04:07.071 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/vmxnet3/vmxnet3.ko 2023-10-06T01:04:07.071 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/vxlan 2023-10-06T01:04:07.071 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/vxlan/vxlan.ko 2023-10-06T01:04:07.071 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/xen-netback 2023-10-06T01:04:07.071 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/xen-netback/xen-netback.ko 2023-10-06T01:04:07.071 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/xen-netfront.ko 2023-10-06T01:04:07.072 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ntb 2023-10-06T01:04:07.072 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ntb/ntb.ko 2023-10-06T01:04:07.072 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/nvme 2023-10-06T01:04:07.072 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/nvme/host 2023-10-06T01:04:07.072 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/nvme/host/nvme-core.ko 2023-10-06T01:04:07.072 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/nvme/host/nvme.ko 2023-10-06T01:04:07.072 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/parport 2023-10-06T01:04:07.072 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/parport/parport.ko 2023-10-06T01:04:07.072 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/parport/parport_cs.ko 2023-10-06T01:04:07.072 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/parport/parport_pc.ko 2023-10-06T01:04:07.072 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/parport/parport_serial.ko 2023-10-06T01:04:07.072 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pci 2023-10-06T01:04:07.073 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pci/hotplug 2023-10-06T01:04:07.073 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2023-10-06T01:04:07.073 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pci/pcie 2023-10-06T01:04:07.073 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pci/pcie/aer_inject.ko 2023-10-06T01:04:07.073 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pci/xen-pcifront.ko 2023-10-06T01:04:07.073 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pcmcia 2023-10-06T01:04:07.073 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pcmcia/i82092.ko 2023-10-06T01:04:07.073 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pcmcia/pd6729.ko 2023-10-06T01:04:07.073 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pcmcia/yenta_socket.ko 2023-10-06T01:04:07.073 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pinctrl 2023-10-06T01:04:07.073 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pinctrl/intel 2023-10-06T01:04:07.073 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2023-10-06T01:04:07.074 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform 2023-10-06T01:04:07.074 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86 2023-10-06T01:04:07.074 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/acer-wmi.ko 2023-10-06T01:04:07.074 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/acerhdf.ko 2023-10-06T01:04:07.074 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/apple-gmux.ko 2023-10-06T01:04:07.074 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/asus-laptop.ko 2023-10-06T01:04:07.074 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/asus-nb-wmi.ko 2023-10-06T01:04:07.074 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/asus-wmi.ko 2023-10-06T01:04:07.074 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/classmate-laptop.ko 2023-10-06T01:04:07.074 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/eeepc-laptop.ko 2023-10-06T01:04:07.074 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/eeepc-wmi.ko 2023-10-06T01:04:07.074 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/fujitsu-laptop.ko 2023-10-06T01:04:07.075 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/fujitsu-tablet.ko 2023-10-06T01:04:07.075 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/hdaps.ko 2023-10-06T01:04:07.075 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/intel 2023-10-06T01:04:07.075 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/intel/intel-rst.ko 2023-10-06T01:04:07.075 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/intel_ips.ko 2023-10-06T01:04:07.075 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/msi-wmi.ko 2023-10-06T01:04:07.075 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/mxm-wmi.ko 2023-10-06T01:04:07.075 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/panasonic-laptop.ko 2023-10-06T01:04:07.075 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/samsung-laptop.ko 2023-10-06T01:04:07.075 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/samsung-q10.ko 2023-10-06T01:04:07.075 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/topstar-laptop.ko 2023-10-06T01:04:07.075 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2023-10-06T01:04:07.076 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/toshiba_haps.ko 2023-10-06T01:04:07.076 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/wmi-bmof.ko 2023-10-06T01:04:07.076 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/wmi.ko 2023-10-06T01:04:07.076 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/powercap 2023-10-06T01:04:07.076 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/powercap/intel_rapl_common.ko 2023-10-06T01:04:07.076 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/powercap/intel_rapl_msr.ko 2023-10-06T01:04:07.076 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pps 2023-10-06T01:04:07.076 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pps/clients 2023-10-06T01:04:07.076 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pps/clients/pps-gpio.ko 2023-10-06T01:04:07.076 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pps/clients/pps-ldisc.ko 2023-10-06T01:04:07.076 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pps/clients/pps_parport.ko 2023-10-06T01:04:07.076 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pps/pps_core.ko 2023-10-06T01:04:07.076 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ptp 2023-10-06T01:04:07.077 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ptp/ptp.ko 2023-10-06T01:04:07.077 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ptp/ptp_kvm.ko 2023-10-06T01:04:07.077 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc 2023-10-06T01:04:07.077 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-bq32k.ko 2023-10-06T01:04:07.077 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-bq4802.ko 2023-10-06T01:04:07.077 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-ds1286.ko 2023-10-06T01:04:07.077 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-ds1307.ko 2023-10-06T01:04:07.077 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-ds1374.ko 2023-10-06T01:04:07.077 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-ds1511.ko 2023-10-06T01:04:07.077 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-ds1553.ko 2023-10-06T01:04:07.077 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-ds1672.ko 2023-10-06T01:04:07.077 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-ds1742.ko 2023-10-06T01:04:07.078 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-ds2404.ko 2023-10-06T01:04:07.078 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-ds3232.ko 2023-10-06T01:04:07.078 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-em3027.ko 2023-10-06T01:04:07.078 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-fm3130.ko 2023-10-06T01:04:07.078 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-isl12022.ko 2023-10-06T01:04:07.078 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-isl1208.ko 2023-10-06T01:04:07.078 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-m41t80.ko 2023-10-06T01:04:07.078 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-m48t35.ko 2023-10-06T01:04:07.078 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-m48t59.ko 2023-10-06T01:04:07.078 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-max6900.ko 2023-10-06T01:04:07.078 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-msm6242.ko 2023-10-06T01:04:07.078 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-pcf2127.ko 2023-10-06T01:04:07.079 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-pcf85063.ko 2023-10-06T01:04:07.079 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-pcf8523.ko 2023-10-06T01:04:07.079 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-pcf8563.ko 2023-10-06T01:04:07.079 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-pcf8583.ko 2023-10-06T01:04:07.079 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-rp5c01.ko 2023-10-06T01:04:07.079 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-rs5c372.ko 2023-10-06T01:04:07.079 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-rv3029c2.ko 2023-10-06T01:04:07.079 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-rx8025.ko 2023-10-06T01:04:07.079 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-rx8581.ko 2023-10-06T01:04:07.079 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-stk17ta8.ko 2023-10-06T01:04:07.079 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-x1205.ko 2023-10-06T01:04:07.079 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi 2023-10-06T01:04:07.080 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/3w-9xxx.ko 2023-10-06T01:04:07.080 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/3w-sas.ko 2023-10-06T01:04:07.080 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/3w-xxxx.ko 2023-10-06T01:04:07.080 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/BusLogic.ko 2023-10-06T01:04:07.080 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/a100u2w.ko 2023-10-06T01:04:07.080 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/aacraid 2023-10-06T01:04:07.080 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/aacraid/aacraid.ko 2023-10-06T01:04:07.080 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/advansys.ko 2023-10-06T01:04:07.080 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/aic7xxx 2023-10-06T01:04:07.080 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2023-10-06T01:04:07.080 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2023-10-06T01:04:07.080 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/am53c974.ko 2023-10-06T01:04:07.080 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/arcmsr 2023-10-06T01:04:07.081 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/arcmsr/arcmsr.ko 2023-10-06T01:04:07.081 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/atp870u.ko 2023-10-06T01:04:07.081 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/be2iscsi 2023-10-06T01:04:07.081 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2023-10-06T01:04:07.081 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/bfa 2023-10-06T01:04:07.081 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/bfa/bfa.ko 2023-10-06T01:04:07.081 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/bnx2fc 2023-10-06T01:04:07.081 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2023-10-06T01:04:07.081 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/bnx2i 2023-10-06T01:04:07.081 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/bnx2i/bnx2i.ko 2023-10-06T01:04:07.081 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/ch.ko 2023-10-06T01:04:07.081 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/csiostor 2023-10-06T01:04:07.082 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/csiostor/csiostor.ko 2023-10-06T01:04:07.082 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/cxgbi 2023-10-06T01:04:07.082 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/cxgbi/cxgb3i 2023-10-06T01:04:07.082 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2023-10-06T01:04:07.082 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/cxgbi/cxgb4i 2023-10-06T01:04:07.082 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2023-10-06T01:04:07.082 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2023-10-06T01:04:07.082 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/dc395x.ko 2023-10-06T01:04:07.082 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/device_handler 2023-10-06T01:04:07.082 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/device_handler/scsi_dh_alua.ko 2023-10-06T01:04:07.082 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/device_handler/scsi_dh_emc.ko 2023-10-06T01:04:07.082 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/device_handler/scsi_dh_hp_sw.ko 2023-10-06T01:04:07.083 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/device_handler/scsi_dh_rdac.ko 2023-10-06T01:04:07.083 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/dmx3191d.ko 2023-10-06T01:04:07.083 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/esas2r 2023-10-06T01:04:07.083 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/esas2r/esas2r.ko 2023-10-06T01:04:07.083 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/esp_scsi.ko 2023-10-06T01:04:07.083 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/fcoe 2023-10-06T01:04:07.083 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/fcoe/fcoe.ko 2023-10-06T01:04:07.083 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/fcoe/libfcoe.ko 2023-10-06T01:04:07.083 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/fnic 2023-10-06T01:04:07.083 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/fnic/fnic.ko 2023-10-06T01:04:07.083 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/hpsa.ko 2023-10-06T01:04:07.083 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/hptiop.ko 2023-10-06T01:04:07.084 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/hv_storvsc.ko 2023-10-06T01:04:07.084 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/initio.ko 2023-10-06T01:04:07.084 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/ipr.ko 2023-10-06T01:04:07.084 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/ips.ko 2023-10-06T01:04:07.084 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/isci 2023-10-06T01:04:07.084 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/isci/isci.ko 2023-10-06T01:04:07.084 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2023-10-06T01:04:07.084 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/iscsi_tcp.ko 2023-10-06T01:04:07.084 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/libfc 2023-10-06T01:04:07.084 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/libfc/libfc.ko 2023-10-06T01:04:07.084 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/libiscsi.ko 2023-10-06T01:04:07.084 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/libiscsi_tcp.ko 2023-10-06T01:04:07.084 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/libsas 2023-10-06T01:04:07.085 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/libsas/libsas.ko 2023-10-06T01:04:07.085 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/lpfc 2023-10-06T01:04:07.085 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/lpfc/lpfc.ko 2023-10-06T01:04:07.085 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/megaraid 2023-10-06T01:04:07.085 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/megaraid.ko 2023-10-06T01:04:07.085 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2023-10-06T01:04:07.085 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2023-10-06T01:04:07.085 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2023-10-06T01:04:07.085 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/mpt3sas 2023-10-06T01:04:07.085 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2023-10-06T01:04:07.085 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/mvsas 2023-10-06T01:04:07.085 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/mvsas/mvsas.ko 2023-10-06T01:04:07.086 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/mvumi.ko 2023-10-06T01:04:07.086 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/pm8001 2023-10-06T01:04:07.086 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/pm8001/pm80xx.ko 2023-10-06T01:04:07.086 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/pmcraid.ko 2023-10-06T01:04:07.086 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/qla1280.ko 2023-10-06T01:04:07.086 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/qla2xxx 2023-10-06T01:04:07.086 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2023-10-06T01:04:07.086 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2023-10-06T01:04:07.086 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/qla4xxx 2023-10-06T01:04:07.086 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2023-10-06T01:04:07.086 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/raid_class.ko 2023-10-06T01:04:07.086 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/scsi_debug.ko 2023-10-06T01:04:07.087 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/scsi_transport_fc.ko 2023-10-06T01:04:07.087 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/scsi_transport_iscsi.ko 2023-10-06T01:04:07.087 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/scsi_transport_sas.ko 2023-10-06T01:04:07.087 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/scsi_transport_spi.ko 2023-10-06T01:04:07.087 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/scsi_transport_srp.ko 2023-10-06T01:04:07.087 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/ses.ko 2023-10-06T01:04:07.087 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/st.ko 2023-10-06T01:04:07.087 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/stex.ko 2023-10-06T01:04:07.087 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/sym53c8xx_2 2023-10-06T01:04:07.087 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2023-10-06T01:04:07.087 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/virtio_scsi.ko 2023-10-06T01:04:07.087 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/vmw_pvscsi.ko 2023-10-06T01:04:07.088 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/wd719x.ko 2023-10-06T01:04:07.088 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ssb 2023-10-06T01:04:07.088 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ssb/ssb.ko 2023-10-06T01:04:07.088 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/target 2023-10-06T01:04:07.088 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/target/iscsi 2023-10-06T01:04:07.088 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2023-10-06T01:04:07.088 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/target/loopback 2023-10-06T01:04:07.088 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/target/loopback/tcm_loop.ko 2023-10-06T01:04:07.088 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/target/target_core_file.ko 2023-10-06T01:04:07.088 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/target/target_core_iblock.ko 2023-10-06T01:04:07.088 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/target/target_core_mod.ko 2023-10-06T01:04:07.088 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/target/target_core_pscsi.ko 2023-10-06T01:04:07.089 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/target/target_core_user.ko 2023-10-06T01:04:07.089 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/target/tcm_fc 2023-10-06T01:04:07.089 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/target/tcm_fc/tcm_fc.ko 2023-10-06T01:04:07.089 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal 2023-10-06T01:04:07.089 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel 2023-10-06T01:04:07.089 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/int340x_thermal 2023-10-06T01:04:07.089 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2023-10-06T01:04:07.089 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2023-10-06T01:04:07.089 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2023-10-06T01:04:07.089 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2023-10-06T01:04:07.089 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2023-10-06T01:04:07.089 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2023-10-06T01:04:07.090 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2023-10-06T01:04:07.090 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2023-10-06T01:04:07.090 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2023-10-06T01:04:07.090 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2023-10-06T01:04:07.090 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2023-10-06T01:04:07.090 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2023-10-06T01:04:07.090 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2023-10-06T01:04:07.090 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2023-10-06T01:04:07.090 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2023-10-06T01:04:07.090 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/tty 2023-10-06T01:04:07.090 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/tty/ipwireless 2023-10-06T01:04:07.090 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/tty/ipwireless/ipwireless.ko 2023-10-06T01:04:07.091 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/tty/n_gsm.ko 2023-10-06T01:04:07.091 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/tty/n_hdlc.ko 2023-10-06T01:04:07.091 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/tty/nozomi.ko 2023-10-06T01:04:07.091 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/tty/serial 2023-10-06T01:04:07.091 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/tty/serial/8250 2023-10-06T01:04:07.091 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/tty/serial/8250/serial_cs.ko 2023-10-06T01:04:07.091 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/tty/serial/arc_uart.ko 2023-10-06T01:04:07.091 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/tty/serial/jsm 2023-10-06T01:04:07.091 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/tty/serial/jsm/jsm.ko 2023-10-06T01:04:07.091 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/tty/synclink_gt.ko 2023-10-06T01:04:07.091 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ufs 2023-10-06T01:04:07.091 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ufs/core 2023-10-06T01:04:07.092 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ufs/core/ufshcd-core.ko 2023-10-06T01:04:07.092 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ufs/host 2023-10-06T01:04:07.092 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ufs/host/ufshcd-pci.ko 2023-10-06T01:04:07.092 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/uio 2023-10-06T01:04:07.092 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/uio/uio.ko 2023-10-06T01:04:07.092 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/uio/uio_aec.ko 2023-10-06T01:04:07.092 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/uio/uio_cif.ko 2023-10-06T01:04:07.092 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/uio/uio_pci_generic.ko 2023-10-06T01:04:07.092 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/uio/uio_sercos3.ko 2023-10-06T01:04:07.092 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb 2023-10-06T01:04:07.092 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/class 2023-10-06T01:04:07.092 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/class/cdc-acm.ko 2023-10-06T01:04:07.093 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/class/cdc-wdm.ko 2023-10-06T01:04:07.093 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/class/usblp.ko 2023-10-06T01:04:07.093 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/class/usbtmc.ko 2023-10-06T01:04:07.093 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/host 2023-10-06T01:04:07.093 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/host/sl811-hcd.ko 2023-10-06T01:04:07.093 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/image 2023-10-06T01:04:07.093 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/image/mdc800.ko 2023-10-06T01:04:07.093 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/image/microtek.ko 2023-10-06T01:04:07.093 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc 2023-10-06T01:04:07.093 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/adutux.ko 2023-10-06T01:04:07.093 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/appledisplay.ko 2023-10-06T01:04:07.093 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/emi26.ko 2023-10-06T01:04:07.093 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/emi62.ko 2023-10-06T01:04:07.094 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/ezusb.ko 2023-10-06T01:04:07.094 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/idmouse.ko 2023-10-06T01:04:07.094 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/iowarrior.ko 2023-10-06T01:04:07.094 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/isight_firmware.ko 2023-10-06T01:04:07.094 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/ldusb.ko 2023-10-06T01:04:07.094 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/legousbtower.ko 2023-10-06T01:04:07.094 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/sisusbvga 2023-10-06T01:04:07.094 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2023-10-06T01:04:07.094 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/trancevibrator.ko 2023-10-06T01:04:07.094 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/usb3503.ko 2023-10-06T01:04:07.094 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/usblcd.ko 2023-10-06T01:04:07.095 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/usbsevseg.ko 2023-10-06T01:04:07.095 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/uss720.ko 2023-10-06T01:04:07.095 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/yurex.ko 2023-10-06T01:04:07.095 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/phy 2023-10-06T01:04:07.095 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/phy/phy-generic.ko 2023-10-06T01:04:07.095 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial 2023-10-06T01:04:07.095 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/aircable.ko 2023-10-06T01:04:07.095 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/ark3116.ko 2023-10-06T01:04:07.095 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/belkin_sa.ko 2023-10-06T01:04:07.095 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/ch341.ko 2023-10-06T01:04:07.095 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/cp210x.ko 2023-10-06T01:04:07.095 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/cyberjack.ko 2023-10-06T01:04:07.096 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/cypress_m8.ko 2023-10-06T01:04:07.096 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/digi_acceleport.ko 2023-10-06T01:04:07.096 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/empeg.ko 2023-10-06T01:04:07.096 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/ftdi_sio.ko 2023-10-06T01:04:07.096 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/garmin_gps.ko 2023-10-06T01:04:07.096 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/io_edgeport.ko 2023-10-06T01:04:07.096 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/io_ti.ko 2023-10-06T01:04:07.096 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/ipaq.ko 2023-10-06T01:04:07.096 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/ipw.ko 2023-10-06T01:04:07.096 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/ir-usb.ko 2023-10-06T01:04:07.096 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/iuu_phoenix.ko 2023-10-06T01:04:07.096 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/keyspan.ko 2023-10-06T01:04:07.097 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/keyspan_pda.ko 2023-10-06T01:04:07.097 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/kl5kusb105.ko 2023-10-06T01:04:07.097 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/kobil_sct.ko 2023-10-06T01:04:07.097 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/mct_u232.ko 2023-10-06T01:04:07.097 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/mos7720.ko 2023-10-06T01:04:07.097 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/mos7840.ko 2023-10-06T01:04:07.097 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/navman.ko 2023-10-06T01:04:07.097 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/omninet.ko 2023-10-06T01:04:07.097 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/opticon.ko 2023-10-06T01:04:07.097 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/option.ko 2023-10-06T01:04:07.097 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/oti6858.ko 2023-10-06T01:04:07.097 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/pl2303.ko 2023-10-06T01:04:07.097 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/qcaux.ko 2023-10-06T01:04:07.098 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/qcserial.ko 2023-10-06T01:04:07.098 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/quatech2.ko 2023-10-06T01:04:07.098 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/safe_serial.ko 2023-10-06T01:04:07.098 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/sierra.ko 2023-10-06T01:04:07.098 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/spcp8x5.ko 2023-10-06T01:04:07.098 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/ssu100.ko 2023-10-06T01:04:07.098 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/symbolserial.ko 2023-10-06T01:04:07.098 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2023-10-06T01:04:07.098 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/usb-serial-simple.ko 2023-10-06T01:04:07.098 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/usb_debug.ko 2023-10-06T01:04:07.098 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/usb_wwan.ko 2023-10-06T01:04:07.098 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/visor.ko 2023-10-06T01:04:07.099 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/whiteheat.ko 2023-10-06T01:04:07.099 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/xsens_mt.ko 2023-10-06T01:04:07.099 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage 2023-10-06T01:04:07.099 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/uas.ko 2023-10-06T01:04:07.099 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/ums-alauda.ko 2023-10-06T01:04:07.099 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/ums-cypress.ko 2023-10-06T01:04:07.099 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/ums-datafab.ko 2023-10-06T01:04:07.099 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/ums-eneub6250.ko 2023-10-06T01:04:07.099 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/ums-freecom.ko 2023-10-06T01:04:07.099 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/ums-isd200.ko 2023-10-06T01:04:07.099 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/ums-jumpshot.ko 2023-10-06T01:04:07.099 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/ums-karma.ko 2023-10-06T01:04:07.100 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/ums-onetouch.ko 2023-10-06T01:04:07.100 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/ums-realtek.ko 2023-10-06T01:04:07.100 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/ums-sddr09.ko 2023-10-06T01:04:07.100 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/ums-sddr55.ko 2023-10-06T01:04:07.100 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/ums-usbat.ko 2023-10-06T01:04:07.100 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/usb-storage.ko 2023-10-06T01:04:07.100 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/usbip 2023-10-06T01:04:07.100 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/usbip/usbip-core.ko 2023-10-06T01:04:07.100 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/usbip/usbip-host.ko 2023-10-06T01:04:07.100 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/usbip/vhci-hcd.ko 2023-10-06T01:04:07.100 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/vfio 2023-10-06T01:04:07.100 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/vfio/pci 2023-10-06T01:04:07.101 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/vfio/pci/vfio-pci-core.ko 2023-10-06T01:04:07.101 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/vfio/pci/vfio-pci.ko 2023-10-06T01:04:07.101 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/vfio/vfio.ko 2023-10-06T01:04:07.101 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/vfio/vfio_iommu_type1.ko 2023-10-06T01:04:07.101 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/vhost 2023-10-06T01:04:07.101 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/vhost/vhost.ko 2023-10-06T01:04:07.101 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/vhost/vhost_iotlb.ko 2023-10-06T01:04:07.101 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/vhost/vhost_net.ko 2023-10-06T01:04:07.101 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/vhost/vhost_scsi.ko 2023-10-06T01:04:07.101 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/video 2023-10-06T01:04:07.101 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/video/backlight 2023-10-06T01:04:07.101 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/video/backlight/apple_bl.ko 2023-10-06T01:04:07.102 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/video/backlight/lcd.ko 2023-10-06T01:04:07.102 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/video/backlight/platform_lcd.ko 2023-10-06T01:04:07.102 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/virtio 2023-10-06T01:04:07.102 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/virtio/virtio.ko 2023-10-06T01:04:07.102 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/virtio/virtio_balloon.ko 2023-10-06T01:04:07.102 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/virtio/virtio_mmio.ko 2023-10-06T01:04:07.102 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/virtio/virtio_pci.ko 2023-10-06T01:04:07.102 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/virtio/virtio_pci_legacy_dev.ko 2023-10-06T01:04:07.102 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/virtio/virtio_pci_modern_dev.ko 2023-10-06T01:04:07.102 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/virtio/virtio_ring.ko 2023-10-06T01:04:07.102 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1 2023-10-06T01:04:07.102 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/masters 2023-10-06T01:04:07.102 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/masters/ds2482.ko 2023-10-06T01:04:07.103 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/masters/ds2490.ko 2023-10-06T01:04:07.103 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/slaves 2023-10-06T01:04:07.103 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/slaves/w1_ds2406.ko 2023-10-06T01:04:07.103 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/slaves/w1_ds2408.ko 2023-10-06T01:04:07.103 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/slaves/w1_ds2413.ko 2023-10-06T01:04:07.103 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/slaves/w1_ds2423.ko 2023-10-06T01:04:07.103 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/slaves/w1_ds2431.ko 2023-10-06T01:04:07.103 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/slaves/w1_ds2433.ko 2023-10-06T01:04:07.103 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/slaves/w1_ds2780.ko 2023-10-06T01:04:07.103 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/slaves/w1_ds2781.ko 2023-10-06T01:04:07.103 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/slaves/w1_ds28e04.ko 2023-10-06T01:04:07.103 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/slaves/w1_smem.ko 2023-10-06T01:04:07.104 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/slaves/w1_therm.ko 2023-10-06T01:04:07.104 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/wire.ko 2023-10-06T01:04:07.104 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog 2023-10-06T01:04:07.104 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/alim1535_wdt.ko 2023-10-06T01:04:07.104 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/alim7101_wdt.ko 2023-10-06T01:04:07.104 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/f71808e_wdt.ko 2023-10-06T01:04:07.104 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/hpwdt.ko 2023-10-06T01:04:07.104 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/i6300esb.ko 2023-10-06T01:04:07.104 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/iTCO_vendor_support.ko 2023-10-06T01:04:07.104 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/iTCO_wdt.ko 2023-10-06T01:04:07.104 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/ib700wdt.ko 2023-10-06T01:04:07.104 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/ibmasr.ko 2023-10-06T01:04:07.105 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/ie6xx_wdt.ko 2023-10-06T01:04:07.105 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/it8712f_wdt.ko 2023-10-06T01:04:07.105 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/it87_wdt.ko 2023-10-06T01:04:07.105 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/machzwd.ko 2023-10-06T01:04:07.105 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/nv_tco.ko 2023-10-06T01:04:07.105 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/pcwd_pci.ko 2023-10-06T01:04:07.105 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/pcwd_usb.ko 2023-10-06T01:04:07.105 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2023-10-06T01:04:07.105 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/sch311x_wdt.ko 2023-10-06T01:04:07.105 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/softdog.ko 2023-10-06T01:04:07.105 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/sp5100_tco.ko 2023-10-06T01:04:07.105 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/via_wdt.ko 2023-10-06T01:04:07.106 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/w83627hf_wdt.ko 2023-10-06T01:04:07.106 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/w83877f_wdt.ko 2023-10-06T01:04:07.106 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/w83977f_wdt.ko 2023-10-06T01:04:07.106 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/wdt_pci.ko 2023-10-06T01:04:07.106 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/xen_wdt.ko 2023-10-06T01:04:07.106 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/xen 2023-10-06T01:04:07.106 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/xen/xen-acpi-processor.ko 2023-10-06T01:04:07.106 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/xen/xen-evtchn.ko 2023-10-06T01:04:07.106 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/xen/xen-gntalloc.ko 2023-10-06T01:04:07.106 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/xen/xen-gntdev.ko 2023-10-06T01:04:07.106 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/xen/xen-pciback 2023-10-06T01:04:07.106 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2023-10-06T01:04:07.106 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/xen/xen-privcmd.ko 2023-10-06T01:04:07.107 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/xen/xenfs 2023-10-06T01:04:07.107 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/xen/xenfs/xenfs.ko 2023-10-06T01:04:07.107 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs 2023-10-06T01:04:07.107 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/9p 2023-10-06T01:04:07.107 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/9p/9p.ko 2023-10-06T01:04:07.107 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/affs 2023-10-06T01:04:07.107 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/affs/affs.ko 2023-10-06T01:04:07.107 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/befs 2023-10-06T01:04:07.107 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/befs/befs.ko 2023-10-06T01:04:07.107 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/binfmt_misc.ko 2023-10-06T01:04:07.107 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/btrfs 2023-10-06T01:04:07.107 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/btrfs/btrfs.ko 2023-10-06T01:04:07.108 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/cachefiles 2023-10-06T01:04:07.108 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/cachefiles/cachefiles.ko 2023-10-06T01:04:07.108 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ceph 2023-10-06T01:04:07.108 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ceph/ceph.ko 2023-10-06T01:04:07.108 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/coda 2023-10-06T01:04:07.108 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/coda/coda.ko 2023-10-06T01:04:07.108 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/cramfs 2023-10-06T01:04:07.108 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/cramfs/cramfs.ko 2023-10-06T01:04:07.108 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/dlm 2023-10-06T01:04:07.108 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/dlm/dlm.ko 2023-10-06T01:04:07.108 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ecryptfs 2023-10-06T01:04:07.108 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ecryptfs/ecryptfs.ko 2023-10-06T01:04:07.108 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/f2fs 2023-10-06T01:04:07.109 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/f2fs/f2fs.ko 2023-10-06T01:04:07.109 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/fat 2023-10-06T01:04:07.109 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/fat/fat.ko 2023-10-06T01:04:07.109 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/fat/msdos.ko 2023-10-06T01:04:07.109 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/fat/vfat.ko 2023-10-06T01:04:07.109 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/fscache 2023-10-06T01:04:07.109 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/fscache/fscache.ko 2023-10-06T01:04:07.109 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/fuse 2023-10-06T01:04:07.109 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/fuse/cuse.ko 2023-10-06T01:04:07.109 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/fuse/fuse.ko 2023-10-06T01:04:07.109 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/gfs2 2023-10-06T01:04:07.109 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/gfs2/gfs2.ko 2023-10-06T01:04:07.110 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/hfs 2023-10-06T01:04:07.110 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/hfs/hfs.ko 2023-10-06T01:04:07.110 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/hfsplus 2023-10-06T01:04:07.110 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/hfsplus/hfsplus.ko 2023-10-06T01:04:07.110 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/isofs 2023-10-06T01:04:07.110 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/isofs/isofs.ko 2023-10-06T01:04:07.110 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/jfs 2023-10-06T01:04:07.110 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/jfs/jfs.ko 2023-10-06T01:04:07.110 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/lockd 2023-10-06T01:04:07.110 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/lockd/lockd.ko 2023-10-06T01:04:07.110 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/minix 2023-10-06T01:04:07.110 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/minix/minix.ko 2023-10-06T01:04:07.111 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/netfs 2023-10-06T01:04:07.111 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/netfs/netfs.ko 2023-10-06T01:04:07.111 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfs 2023-10-06T01:04:07.111 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfs/blocklayout 2023-10-06T01:04:07.111 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2023-10-06T01:04:07.111 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfs/filelayout 2023-10-06T01:04:07.111 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2023-10-06T01:04:07.111 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfs/flexfilelayout 2023-10-06T01:04:07.111 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2023-10-06T01:04:07.111 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfs/nfs.ko 2023-10-06T01:04:07.111 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfs/nfsv3.ko 2023-10-06T01:04:07.111 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfs/nfsv4.ko 2023-10-06T01:04:07.112 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfs_common 2023-10-06T01:04:07.112 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfs_common/grace.ko 2023-10-06T01:04:07.112 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfs_common/nfs_acl.ko 2023-10-06T01:04:07.112 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfsd 2023-10-06T01:04:07.112 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfsd/nfsd.ko 2023-10-06T01:04:07.112 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nilfs2 2023-10-06T01:04:07.112 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nilfs2/nilfs2.ko 2023-10-06T01:04:07.112 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls 2023-10-06T01:04:07.112 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/mac-celtic.ko 2023-10-06T01:04:07.112 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/mac-centeuro.ko 2023-10-06T01:04:07.112 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/mac-croatian.ko 2023-10-06T01:04:07.112 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/mac-cyrillic.ko 2023-10-06T01:04:07.113 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/mac-gaelic.ko 2023-10-06T01:04:07.113 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/mac-greek.ko 2023-10-06T01:04:07.113 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/mac-iceland.ko 2023-10-06T01:04:07.113 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/mac-inuit.ko 2023-10-06T01:04:07.113 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/mac-roman.ko 2023-10-06T01:04:07.113 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/mac-romanian.ko 2023-10-06T01:04:07.113 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/mac-turkish.ko 2023-10-06T01:04:07.113 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp1250.ko 2023-10-06T01:04:07.113 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp1251.ko 2023-10-06T01:04:07.113 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp1255.ko 2023-10-06T01:04:07.113 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp737.ko 2023-10-06T01:04:07.113 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp775.ko 2023-10-06T01:04:07.113 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp850.ko 2023-10-06T01:04:07.114 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp852.ko 2023-10-06T01:04:07.114 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp855.ko 2023-10-06T01:04:07.114 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp857.ko 2023-10-06T01:04:07.114 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp860.ko 2023-10-06T01:04:07.114 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp861.ko 2023-10-06T01:04:07.114 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp862.ko 2023-10-06T01:04:07.114 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp863.ko 2023-10-06T01:04:07.114 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp864.ko 2023-10-06T01:04:07.114 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp865.ko 2023-10-06T01:04:07.114 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp866.ko 2023-10-06T01:04:07.114 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp869.ko 2023-10-06T01:04:07.114 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp874.ko 2023-10-06T01:04:07.115 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp932.ko 2023-10-06T01:04:07.115 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp936.ko 2023-10-06T01:04:07.115 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp949.ko 2023-10-06T01:04:07.115 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp950.ko 2023-10-06T01:04:07.115 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_euc-jp.ko 2023-10-06T01:04:07.115 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_iso8859-1.ko 2023-10-06T01:04:07.115 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_iso8859-13.ko 2023-10-06T01:04:07.115 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_iso8859-14.ko 2023-10-06T01:04:07.115 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_iso8859-15.ko 2023-10-06T01:04:07.115 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_iso8859-2.ko 2023-10-06T01:04:07.115 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_iso8859-3.ko 2023-10-06T01:04:07.115 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_iso8859-4.ko 2023-10-06T01:04:07.116 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_iso8859-5.ko 2023-10-06T01:04:07.116 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_iso8859-6.ko 2023-10-06T01:04:07.116 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_iso8859-7.ko 2023-10-06T01:04:07.116 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_iso8859-9.ko 2023-10-06T01:04:07.116 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_koi8-r.ko 2023-10-06T01:04:07.116 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_koi8-ru.ko 2023-10-06T01:04:07.116 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_koi8-u.ko 2023-10-06T01:04:07.116 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_utf8.ko 2023-10-06T01:04:07.116 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ocfs2 2023-10-06T01:04:07.116 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ocfs2/cluster 2023-10-06T01:04:07.116 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2023-10-06T01:04:07.116 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ocfs2/dlm 2023-10-06T01:04:07.117 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2023-10-06T01:04:07.117 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ocfs2/dlmfs 2023-10-06T01:04:07.117 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2023-10-06T01:04:07.117 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ocfs2/ocfs2.ko 2023-10-06T01:04:07.117 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2023-10-06T01:04:07.117 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ocfs2/ocfs2_stack_user.ko 2023-10-06T01:04:07.117 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ocfs2/ocfs2_stackglue.ko 2023-10-06T01:04:07.117 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/overlayfs 2023-10-06T01:04:07.117 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/overlayfs/overlay.ko 2023-10-06T01:04:07.117 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/pstore 2023-10-06T01:04:07.117 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/pstore/ramoops.ko 2023-10-06T01:04:07.117 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/reiserfs 2023-10-06T01:04:07.117 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/reiserfs/reiserfs.ko 2023-10-06T01:04:07.118 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/romfs 2023-10-06T01:04:07.118 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/romfs/romfs.ko 2023-10-06T01:04:07.118 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/smb 2023-10-06T01:04:07.118 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/smb/client 2023-10-06T01:04:07.118 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/smb/client/cifs.ko 2023-10-06T01:04:07.118 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/smb/common 2023-10-06T01:04:07.118 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/smb/common/cifs_arc4.ko 2023-10-06T01:04:07.118 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/smb/common/cifs_md4.ko 2023-10-06T01:04:07.118 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/squashfs 2023-10-06T01:04:07.118 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/squashfs/squashfs.ko 2023-10-06T01:04:07.118 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/sysv 2023-10-06T01:04:07.118 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/sysv/sysv.ko 2023-10-06T01:04:07.119 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/udf 2023-10-06T01:04:07.119 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/udf/udf.ko 2023-10-06T01:04:07.119 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ufs 2023-10-06T01:04:07.119 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ufs/ufs.ko 2023-10-06T01:04:07.119 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/xfs 2023-10-06T01:04:07.119 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/xfs/xfs.ko 2023-10-06T01:04:07.119 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/kernel 2023-10-06T01:04:07.119 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/kernel/rcu 2023-10-06T01:04:07.119 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/kernel/rcu/rcutorture.ko 2023-10-06T01:04:07.119 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/kernel/torture.ko 2023-10-06T01:04:07.119 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/kernel/trace 2023-10-06T01:04:07.119 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/kernel/trace/ring_buffer_benchmark.ko 2023-10-06T01:04:07.120 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib 2023-10-06T01:04:07.120 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/asn1_encoder.ko 2023-10-06T01:04:07.120 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/crc-itu-t.ko 2023-10-06T01:04:07.120 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/crc8.ko 2023-10-06T01:04:07.120 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/crypto 2023-10-06T01:04:07.120 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/crypto/libarc4.ko 2023-10-06T01:04:07.120 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/crypto/libdes.ko 2023-10-06T01:04:07.120 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/libcrc32c.ko 2023-10-06T01:04:07.120 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/lru_cache.ko 2023-10-06T01:04:07.120 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/lz4 2023-10-06T01:04:07.120 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/lz4/lz4_compress.ko 2023-10-06T01:04:07.120 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/lz4/lz4hc_compress.ko 2023-10-06T01:04:07.121 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/math 2023-10-06T01:04:07.121 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/math/cordic.ko 2023-10-06T01:04:07.121 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/raid6 2023-10-06T01:04:07.121 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/raid6/raid6_pq.ko 2023-10-06T01:04:07.121 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/reed_solomon 2023-10-06T01:04:07.121 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/reed_solomon/reed_solomon.ko 2023-10-06T01:04:07.121 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/ts_bm.ko 2023-10-06T01:04:07.121 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/ts_fsm.ko 2023-10-06T01:04:07.121 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/ts_kmp.ko 2023-10-06T01:04:07.121 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/zstd 2023-10-06T01:04:07.121 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/zstd/zstd_compress.ko 2023-10-06T01:04:07.121 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/mm 2023-10-06T01:04:07.121 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/mm/hwpoison-inject.ko 2023-10-06T01:04:07.122 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net 2023-10-06T01:04:07.122 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/6lowpan 2023-10-06T01:04:07.122 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/6lowpan/6lowpan.ko 2023-10-06T01:04:07.122 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/6lowpan/nhc_dest.ko 2023-10-06T01:04:07.122 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/6lowpan/nhc_fragment.ko 2023-10-06T01:04:07.122 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/6lowpan/nhc_hop.ko 2023-10-06T01:04:07.122 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/6lowpan/nhc_ipv6.ko 2023-10-06T01:04:07.122 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/6lowpan/nhc_mobility.ko 2023-10-06T01:04:07.122 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/6lowpan/nhc_routing.ko 2023-10-06T01:04:07.122 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/6lowpan/nhc_udp.ko 2023-10-06T01:04:07.122 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/802 2023-10-06T01:04:07.122 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/802/garp.ko 2023-10-06T01:04:07.123 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/802/mrp.ko 2023-10-06T01:04:07.123 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/802/p8022.ko 2023-10-06T01:04:07.123 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/802/psnap.ko 2023-10-06T01:04:07.123 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/802/stp.ko 2023-10-06T01:04:07.123 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/8021q 2023-10-06T01:04:07.123 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/8021q/8021q.ko 2023-10-06T01:04:07.123 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/9p 2023-10-06T01:04:07.123 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/9p/9pnet.ko 2023-10-06T01:04:07.123 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/9p/9pnet_fd.ko 2023-10-06T01:04:07.123 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/9p/9pnet_rdma.ko 2023-10-06T01:04:07.123 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/9p/9pnet_virtio.ko 2023-10-06T01:04:07.123 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/batman-adv 2023-10-06T01:04:07.124 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/batman-adv/batman-adv.ko 2023-10-06T01:04:07.124 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge 2023-10-06T01:04:07.124 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/br_netfilter.ko 2023-10-06T01:04:07.124 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/bridge.ko 2023-10-06T01:04:07.124 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter 2023-10-06T01:04:07.124 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_802_3.ko 2023-10-06T01:04:07.124 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_among.ko 2023-10-06T01:04:07.124 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_arp.ko 2023-10-06T01:04:07.124 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_arpreply.ko 2023-10-06T01:04:07.124 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_dnat.ko 2023-10-06T01:04:07.124 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_ip.ko 2023-10-06T01:04:07.124 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_ip6.ko 2023-10-06T01:04:07.125 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_limit.ko 2023-10-06T01:04:07.125 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_log.ko 2023-10-06T01:04:07.125 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_mark.ko 2023-10-06T01:04:07.125 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_mark_m.ko 2023-10-06T01:04:07.125 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_nflog.ko 2023-10-06T01:04:07.125 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_pkttype.ko 2023-10-06T01:04:07.125 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_redirect.ko 2023-10-06T01:04:07.125 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_snat.ko 2023-10-06T01:04:07.125 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_stp.ko 2023-10-06T01:04:07.125 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_vlan.ko 2023-10-06T01:04:07.125 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebtable_broute.ko 2023-10-06T01:04:07.125 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebtable_filter.ko 2023-10-06T01:04:07.126 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebtable_nat.ko 2023-10-06T01:04:07.126 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebtables.ko 2023-10-06T01:04:07.126 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/nf_conntrack_bridge.ko 2023-10-06T01:04:07.126 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2023-10-06T01:04:07.126 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2023-10-06T01:04:07.126 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ceph 2023-10-06T01:04:07.126 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ceph/libceph.ko 2023-10-06T01:04:07.126 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/core 2023-10-06T01:04:07.126 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/core/failover.ko 2023-10-06T01:04:07.126 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/core/pktgen.ko 2023-10-06T01:04:07.126 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/dccp 2023-10-06T01:04:07.126 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/dccp/dccp.ko 2023-10-06T01:04:07.127 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/dccp/dccp_diag.ko 2023-10-06T01:04:07.127 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/dccp/dccp_ipv4.ko 2023-10-06T01:04:07.127 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/dccp/dccp_ipv6.ko 2023-10-06T01:04:07.127 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/dns_resolver 2023-10-06T01:04:07.127 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/dns_resolver/dns_resolver.ko 2023-10-06T01:04:07.127 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/dsa 2023-10-06T01:04:07.127 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/dsa/dsa_core.ko 2023-10-06T01:04:07.127 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/dsa/tag_brcm.ko 2023-10-06T01:04:07.127 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/dsa/tag_dsa.ko 2023-10-06T01:04:07.127 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/dsa/tag_none.ko 2023-10-06T01:04:07.127 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/dsa/tag_trailer.ko 2023-10-06T01:04:07.127 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ieee802154 2023-10-06T01:04:07.127 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ieee802154/6lowpan 2023-10-06T01:04:07.128 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2023-10-06T01:04:07.128 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ieee802154/ieee802154.ko 2023-10-06T01:04:07.128 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ieee802154/ieee802154_socket.ko 2023-10-06T01:04:07.128 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4 2023-10-06T01:04:07.128 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/ah4.ko 2023-10-06T01:04:07.128 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/esp4.ko 2023-10-06T01:04:07.128 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/fou.ko 2023-10-06T01:04:07.128 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/gre.ko 2023-10-06T01:04:07.128 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/inet_diag.ko 2023-10-06T01:04:07.128 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/ip_gre.ko 2023-10-06T01:04:07.128 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/ip_tunnel.ko 2023-10-06T01:04:07.129 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/ip_vti.ko 2023-10-06T01:04:07.129 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/ipcomp.ko 2023-10-06T01:04:07.129 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/ipip.ko 2023-10-06T01:04:07.129 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter 2023-10-06T01:04:07.129 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/arp_tables.ko 2023-10-06T01:04:07.129 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/arpt_mangle.ko 2023-10-06T01:04:07.129 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/arptable_filter.ko 2023-10-06T01:04:07.129 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/ipt_ECN.ko 2023-10-06T01:04:07.129 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2023-10-06T01:04:07.129 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/ipt_ah.ko 2023-10-06T01:04:07.129 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2023-10-06T01:04:07.129 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/iptable_mangle.ko 2023-10-06T01:04:07.129 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/iptable_nat.ko 2023-10-06T01:04:07.130 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/iptable_raw.ko 2023-10-06T01:04:07.130 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/iptable_security.ko 2023-10-06T01:04:07.130 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2023-10-06T01:04:07.130 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2023-10-06T01:04:07.130 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2023-10-06T01:04:07.130 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2023-10-06T01:04:07.130 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2023-10-06T01:04:07.130 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2023-10-06T01:04:07.130 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2023-10-06T01:04:07.130 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2023-10-06T01:04:07.130 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2023-10-06T01:04:07.131 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2023-10-06T01:04:07.131 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/tcp_bic.ko 2023-10-06T01:04:07.131 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/tcp_dctcp.ko 2023-10-06T01:04:07.131 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/tcp_diag.ko 2023-10-06T01:04:07.131 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/tcp_highspeed.ko 2023-10-06T01:04:07.131 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/tcp_htcp.ko 2023-10-06T01:04:07.131 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/tcp_hybla.ko 2023-10-06T01:04:07.131 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/tcp_illinois.ko 2023-10-06T01:04:07.131 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/tcp_lp.ko 2023-10-06T01:04:07.131 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/tcp_scalable.ko 2023-10-06T01:04:07.131 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/tcp_vegas.ko 2023-10-06T01:04:07.131 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/tcp_veno.ko 2023-10-06T01:04:07.131 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/tcp_westwood.ko 2023-10-06T01:04:07.132 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/tcp_yeah.ko 2023-10-06T01:04:07.132 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/tunnel4.ko 2023-10-06T01:04:07.132 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/udp_diag.ko 2023-10-06T01:04:07.132 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/udp_tunnel.ko 2023-10-06T01:04:07.132 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/xfrm4_tunnel.ko 2023-10-06T01:04:07.132 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6 2023-10-06T01:04:07.132 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/ah6.ko 2023-10-06T01:04:07.132 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/esp6.ko 2023-10-06T01:04:07.132 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/fou6.ko 2023-10-06T01:04:07.132 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/ip6_tunnel.ko 2023-10-06T01:04:07.132 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/ip6_udp_tunnel.ko 2023-10-06T01:04:07.132 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/ip6_vti.ko 2023-10-06T01:04:07.133 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/ipcomp6.ko 2023-10-06T01:04:07.133 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter 2023-10-06T01:04:07.133 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6_tables.ko 2023-10-06T01:04:07.133 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2023-10-06T01:04:07.133 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2023-10-06T01:04:07.133 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6t_ah.ko 2023-10-06T01:04:07.133 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2023-10-06T01:04:07.133 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6t_frag.ko 2023-10-06T01:04:07.133 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2023-10-06T01:04:07.133 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2023-10-06T01:04:07.133 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6t_mh.ko 2023-10-06T01:04:07.133 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2023-10-06T01:04:07.134 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6t_rt.ko 2023-10-06T01:04:07.134 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6table_filter.ko 2023-10-06T01:04:07.134 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2023-10-06T01:04:07.134 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6table_nat.ko 2023-10-06T01:04:07.134 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6table_raw.ko 2023-10-06T01:04:07.134 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6table_security.ko 2023-10-06T01:04:07.134 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2023-10-06T01:04:07.134 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2023-10-06T01:04:07.134 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2023-10-06T01:04:07.134 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2023-10-06T01:04:07.134 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2023-10-06T01:04:07.134 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2023-10-06T01:04:07.135 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2023-10-06T01:04:07.135 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2023-10-06T01:04:07.135 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/sit.ko 2023-10-06T01:04:07.135 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/tunnel6.ko 2023-10-06T01:04:07.135 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/xfrm6_tunnel.ko 2023-10-06T01:04:07.135 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/key 2023-10-06T01:04:07.135 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/key/af_key.ko 2023-10-06T01:04:07.135 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/l2tp 2023-10-06T01:04:07.135 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/l2tp/l2tp_core.ko 2023-10-06T01:04:07.135 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/l2tp/l2tp_debugfs.ko 2023-10-06T01:04:07.135 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/l2tp/l2tp_eth.ko 2023-10-06T01:04:07.135 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/l2tp/l2tp_ip.ko 2023-10-06T01:04:07.136 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/l2tp/l2tp_ip6.ko 2023-10-06T01:04:07.136 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/l2tp/l2tp_netlink.ko 2023-10-06T01:04:07.136 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/l2tp/l2tp_ppp.ko 2023-10-06T01:04:07.136 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/llc 2023-10-06T01:04:07.136 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/llc/llc.ko 2023-10-06T01:04:07.136 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/mac802154 2023-10-06T01:04:07.136 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/mac802154/mac802154.ko 2023-10-06T01:04:07.136 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/mpls 2023-10-06T01:04:07.136 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/mpls/mpls_gso.ko 2023-10-06T01:04:07.136 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter 2023-10-06T01:04:07.136 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset 2023-10-06T01:04:07.136 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set.ko 2023-10-06T01:04:07.137 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2023-10-06T01:04:07.137 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2023-10-06T01:04:07.137 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2023-10-06T01:04:07.137 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2023-10-06T01:04:07.137 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2023-10-06T01:04:07.137 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2023-10-06T01:04:07.137 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2023-10-06T01:04:07.137 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2023-10-06T01:04:07.137 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2023-10-06T01:04:07.137 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2023-10-06T01:04:07.137 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2023-10-06T01:04:07.137 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2023-10-06T01:04:07.137 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2023-10-06T01:04:07.138 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2023-10-06T01:04:07.138 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_list_set.ko 2023-10-06T01:04:07.138 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs 2023-10-06T01:04:07.138 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs/ip_vs.ko 2023-10-06T01:04:07.138 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2023-10-06T01:04:07.138 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2023-10-06T01:04:07.138 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2023-10-06T01:04:07.138 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2023-10-06T01:04:07.138 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2023-10-06T01:04:07.138 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2023-10-06T01:04:07.138 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2023-10-06T01:04:07.138 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2023-10-06T01:04:07.139 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2023-10-06T01:04:07.139 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2023-10-06T01:04:07.139 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2023-10-06T01:04:07.139 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2023-10-06T01:04:07.139 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2023-10-06T01:04:07.139 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_conncount.ko 2023-10-06T01:04:07.139 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_conntrack.ko 2023-10-06T01:04:07.139 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_conntrack_amanda.ko 2023-10-06T01:04:07.139 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_conntrack_broadcast.ko 2023-10-06T01:04:07.139 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_conntrack_ftp.ko 2023-10-06T01:04:07.139 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_conntrack_h323.ko 2023-10-06T01:04:07.139 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_conntrack_irc.ko 2023-10-06T01:04:07.140 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2023-10-06T01:04:07.140 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_conntrack_netlink.ko 2023-10-06T01:04:07.140 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_conntrack_pptp.ko 2023-10-06T01:04:07.140 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_conntrack_sane.ko 2023-10-06T01:04:07.140 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_conntrack_sip.ko 2023-10-06T01:04:07.140 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_conntrack_snmp.ko 2023-10-06T01:04:07.140 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_conntrack_tftp.ko 2023-10-06T01:04:07.140 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_dup_netdev.ko 2023-10-06T01:04:07.140 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_flow_table.ko 2023-10-06T01:04:07.140 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_flow_table_inet.ko 2023-10-06T01:04:07.140 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_log_syslog.ko 2023-10-06T01:04:07.140 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_nat.ko 2023-10-06T01:04:07.141 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_nat_amanda.ko 2023-10-06T01:04:07.141 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_nat_ftp.ko 2023-10-06T01:04:07.141 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_nat_irc.ko 2023-10-06T01:04:07.141 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_nat_sip.ko 2023-10-06T01:04:07.141 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_nat_tftp.ko 2023-10-06T01:04:07.141 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_synproxy_core.ko 2023-10-06T01:04:07.141 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_tables.ko 2023-10-06T01:04:07.141 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nfnetlink.ko 2023-10-06T01:04:07.141 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nfnetlink_acct.ko 2023-10-06T01:04:07.141 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nfnetlink_log.ko 2023-10-06T01:04:07.141 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nfnetlink_osf.ko 2023-10-06T01:04:07.141 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nfnetlink_queue.ko 2023-10-06T01:04:07.142 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_chain_nat.ko 2023-10-06T01:04:07.142 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_compat.ko 2023-10-06T01:04:07.142 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_ct.ko 2023-10-06T01:04:07.142 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_dup_netdev.ko 2023-10-06T01:04:07.142 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_fib.ko 2023-10-06T01:04:07.142 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_fwd_netdev.ko 2023-10-06T01:04:07.142 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_hash.ko 2023-10-06T01:04:07.142 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_limit.ko 2023-10-06T01:04:07.142 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_log.ko 2023-10-06T01:04:07.142 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_masq.ko 2023-10-06T01:04:07.142 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_nat.ko 2023-10-06T01:04:07.142 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_numgen.ko 2023-10-06T01:04:07.143 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_queue.ko 2023-10-06T01:04:07.143 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_quota.ko 2023-10-06T01:04:07.143 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_redir.ko 2023-10-06T01:04:07.143 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_reject.ko 2023-10-06T01:04:07.143 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_reject_inet.ko 2023-10-06T01:04:07.143 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_socket.ko 2023-10-06T01:04:07.143 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_tunnel.ko 2023-10-06T01:04:07.143 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_AUDIT.ko 2023-10-06T01:04:07.143 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_CHECKSUM.ko 2023-10-06T01:04:07.143 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_CLASSIFY.ko 2023-10-06T01:04:07.143 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_CONNSECMARK.ko 2023-10-06T01:04:07.143 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_CT.ko 2023-10-06T01:04:07.143 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_DSCP.ko 2023-10-06T01:04:07.144 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_HL.ko 2023-10-06T01:04:07.144 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_HMARK.ko 2023-10-06T01:04:07.144 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_IDLETIMER.ko 2023-10-06T01:04:07.144 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_LED.ko 2023-10-06T01:04:07.144 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_LOG.ko 2023-10-06T01:04:07.144 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_MASQUERADE.ko 2023-10-06T01:04:07.144 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_NETMAP.ko 2023-10-06T01:04:07.144 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_NFLOG.ko 2023-10-06T01:04:07.144 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_NFQUEUE.ko 2023-10-06T01:04:07.144 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_RATEEST.ko 2023-10-06T01:04:07.144 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_REDIRECT.ko 2023-10-06T01:04:07.144 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_SECMARK.ko 2023-10-06T01:04:07.145 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_TCPMSS.ko 2023-10-06T01:04:07.145 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2023-10-06T01:04:07.145 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_TEE.ko 2023-10-06T01:04:07.145 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_TPROXY.ko 2023-10-06T01:04:07.145 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_TRACE.ko 2023-10-06T01:04:07.145 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_addrtype.ko 2023-10-06T01:04:07.145 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_bpf.ko 2023-10-06T01:04:07.145 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_cgroup.ko 2023-10-06T01:04:07.145 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_cluster.ko 2023-10-06T01:04:07.145 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_comment.ko 2023-10-06T01:04:07.145 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_connbytes.ko 2023-10-06T01:04:07.145 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_connlabel.ko 2023-10-06T01:04:07.146 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_connlimit.ko 2023-10-06T01:04:07.146 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_connmark.ko 2023-10-06T01:04:07.146 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_conntrack.ko 2023-10-06T01:04:07.146 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_cpu.ko 2023-10-06T01:04:07.146 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_dccp.ko 2023-10-06T01:04:07.146 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_devgroup.ko 2023-10-06T01:04:07.146 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_dscp.ko 2023-10-06T01:04:07.146 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_ecn.ko 2023-10-06T01:04:07.146 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_esp.ko 2023-10-06T01:04:07.146 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_hashlimit.ko 2023-10-06T01:04:07.146 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_helper.ko 2023-10-06T01:04:07.146 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_hl.ko 2023-10-06T01:04:07.147 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_ipcomp.ko 2023-10-06T01:04:07.147 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_iprange.ko 2023-10-06T01:04:07.147 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_ipvs.ko 2023-10-06T01:04:07.147 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_l2tp.ko 2023-10-06T01:04:07.147 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_length.ko 2023-10-06T01:04:07.147 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_limit.ko 2023-10-06T01:04:07.147 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_mac.ko 2023-10-06T01:04:07.147 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_mark.ko 2023-10-06T01:04:07.147 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_multiport.ko 2023-10-06T01:04:07.147 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_nat.ko 2023-10-06T01:04:07.147 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_nfacct.ko 2023-10-06T01:04:07.147 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_osf.ko 2023-10-06T01:04:07.147 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_owner.ko 2023-10-06T01:04:07.148 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_physdev.ko 2023-10-06T01:04:07.148 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_pkttype.ko 2023-10-06T01:04:07.148 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_policy.ko 2023-10-06T01:04:07.148 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_quota.ko 2023-10-06T01:04:07.148 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_rateest.ko 2023-10-06T01:04:07.148 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_realm.ko 2023-10-06T01:04:07.148 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_recent.ko 2023-10-06T01:04:07.148 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_sctp.ko 2023-10-06T01:04:07.148 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_set.ko 2023-10-06T01:04:07.148 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_socket.ko 2023-10-06T01:04:07.148 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_state.ko 2023-10-06T01:04:07.148 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_statistic.ko 2023-10-06T01:04:07.149 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_string.ko 2023-10-06T01:04:07.149 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_tcpmss.ko 2023-10-06T01:04:07.149 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_time.ko 2023-10-06T01:04:07.149 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_u32.ko 2023-10-06T01:04:07.149 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netlink 2023-10-06T01:04:07.149 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netlink/netlink_diag.ko 2023-10-06T01:04:07.149 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/nsh 2023-10-06T01:04:07.149 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/nsh/nsh.ko 2023-10-06T01:04:07.149 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/openvswitch 2023-10-06T01:04:07.149 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/openvswitch/openvswitch.ko 2023-10-06T01:04:07.149 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/openvswitch/vport-geneve.ko 2023-10-06T01:04:07.149 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/openvswitch/vport-gre.ko 2023-10-06T01:04:07.150 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/openvswitch/vport-vxlan.ko 2023-10-06T01:04:07.150 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/packet 2023-10-06T01:04:07.150 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/packet/af_packet_diag.ko 2023-10-06T01:04:07.150 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/rds 2023-10-06T01:04:07.150 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/rds/rds.ko 2023-10-06T01:04:07.150 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/rds/rds_rdma.ko 2023-10-06T01:04:07.150 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/rds/rds_tcp.ko 2023-10-06T01:04:07.150 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched 2023-10-06T01:04:07.150 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/act_csum.ko 2023-10-06T01:04:07.150 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/act_gact.ko 2023-10-06T01:04:07.150 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/act_ipt.ko 2023-10-06T01:04:07.150 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/act_mirred.ko 2023-10-06T01:04:07.151 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/act_nat.ko 2023-10-06T01:04:07.151 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/act_pedit.ko 2023-10-06T01:04:07.151 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/act_police.ko 2023-10-06T01:04:07.151 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/act_simple.ko 2023-10-06T01:04:07.151 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/act_skbedit.ko 2023-10-06T01:04:07.151 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/act_vlan.ko 2023-10-06T01:04:07.151 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/cls_basic.ko 2023-10-06T01:04:07.151 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/cls_bpf.ko 2023-10-06T01:04:07.151 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/cls_flow.ko 2023-10-06T01:04:07.151 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/cls_fw.ko 2023-10-06T01:04:07.151 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/cls_route.ko 2023-10-06T01:04:07.151 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/cls_u32.ko 2023-10-06T01:04:07.152 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/em_cmp.ko 2023-10-06T01:04:07.152 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/em_ipset.ko 2023-10-06T01:04:07.152 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/em_meta.ko 2023-10-06T01:04:07.152 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/em_nbyte.ko 2023-10-06T01:04:07.152 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/em_text.ko 2023-10-06T01:04:07.152 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/em_u32.ko 2023-10-06T01:04:07.152 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_choke.ko 2023-10-06T01:04:07.152 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_codel.ko 2023-10-06T01:04:07.152 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_drr.ko 2023-10-06T01:04:07.152 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_fq.ko 2023-10-06T01:04:07.152 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_gred.ko 2023-10-06T01:04:07.152 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_hfsc.ko 2023-10-06T01:04:07.153 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_hhf.ko 2023-10-06T01:04:07.153 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_htb.ko 2023-10-06T01:04:07.153 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_ingress.ko 2023-10-06T01:04:07.153 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_mqprio.ko 2023-10-06T01:04:07.153 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_mqprio_lib.ko 2023-10-06T01:04:07.153 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_multiq.ko 2023-10-06T01:04:07.153 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_netem.ko 2023-10-06T01:04:07.153 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_pie.ko 2023-10-06T01:04:07.153 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_plug.ko 2023-10-06T01:04:07.153 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_prio.ko 2023-10-06T01:04:07.153 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_qfq.ko 2023-10-06T01:04:07.153 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_red.ko 2023-10-06T01:04:07.154 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_sfb.ko 2023-10-06T01:04:07.154 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_sfq.ko 2023-10-06T01:04:07.154 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_tbf.ko 2023-10-06T01:04:07.154 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_teql.ko 2023-10-06T01:04:07.154 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sctp 2023-10-06T01:04:07.154 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sctp/sctp.ko 2023-10-06T01:04:07.154 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sctp/sctp_diag.ko 2023-10-06T01:04:07.154 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sunrpc 2023-10-06T01:04:07.154 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sunrpc/auth_gss 2023-10-06T01:04:07.154 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2023-10-06T01:04:07.154 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2023-10-06T01:04:07.154 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sunrpc/sunrpc.ko 2023-10-06T01:04:07.155 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sunrpc/xprtrdma 2023-10-06T01:04:07.155 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2023-10-06T01:04:07.155 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/tipc 2023-10-06T01:04:07.155 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/tipc/diag.ko 2023-10-06T01:04:07.155 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/tipc/tipc.ko 2023-10-06T01:04:07.155 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/unix 2023-10-06T01:04:07.155 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/unix/unix_diag.ko 2023-10-06T01:04:07.155 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/vmw_vsock 2023-10-06T01:04:07.155 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2023-10-06T01:04:07.155 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2023-10-06T01:04:07.155 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/vmw_vsock/vsock.ko 2023-10-06T01:04:07.155 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/vmw_vsock/vsock_diag.ko 2023-10-06T01:04:07.156 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/vmw_vsock/vsock_loopback.ko 2023-10-06T01:04:07.156 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/xfrm 2023-10-06T01:04:07.156 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/xfrm/xfrm_ipcomp.ko 2023-10-06T01:04:07.156 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/security 2023-10-06T01:04:07.156 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/security/keys 2023-10-06T01:04:07.156 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/security/keys/encrypted-keys 2023-10-06T01:04:07.156 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/security/keys/encrypted-keys/encrypted-keys.ko 2023-10-06T01:04:07.156 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/security/keys/trusted-keys 2023-10-06T01:04:07.156 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/security/keys/trusted-keys/trusted.ko 2023-10-06T01:04:07.156 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/virt 2023-10-06T01:04:07.156 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/virt/lib 2023-10-06T01:04:07.156 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/virt/lib/irqbypass.ko 2023-10-06T01:04:07.157 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/modules.alias 2023-10-06T01:04:07.157 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/modules.alias.bin 2023-10-06T01:04:07.157 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/modules.builtin 2023-10-06T01:04:07.157 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/modules.builtin.bin 2023-10-06T01:04:07.157 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/modules.builtin.modinfo 2023-10-06T01:04:07.157 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/modules.dep 2023-10-06T01:04:07.157 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/modules.dep.bin 2023-10-06T01:04:07.157 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/modules.devname 2023-10-06T01:04:07.157 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/modules.order 2023-10-06T01:04:07.157 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/modules.softdep 2023-10-06T01:04:07.157 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/modules.symbols 2023-10-06T01:04:07.157 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/modules.symbols.bin 2023-10-06T01:04:07.158 DEBUG:teuthology.task.kernel:get_image_version: 6.5.0-rc7-gfef64f93da2b 2023-10-06T01:04:07.158 DEBUG:teuthology.orchestra.run.smithi050:> rpm --scripts -qp /tmp/kernel.x86_64.rpm 2023-10-06T01:04:07.183 INFO:teuthology.orchestra.run.smithi050.stdout:postinstall scriptlet (using /bin/sh): 2023-10-06T01:04:07.183 INFO:teuthology.orchestra.run.smithi050.stdout:if [ -x /sbin/installkernel -a -r /boot/vmlinuz-6.5.0-rc7-gfef64f93da2b -a -r /boot/System.map-6.5.0-rc7-gfef64f93da2b ]; then 2023-10-06T01:04:07.183 INFO:teuthology.orchestra.run.smithi050.stdout:cp /boot/vmlinuz-6.5.0-rc7-gfef64f93da2b /boot/.vmlinuz-6.5.0-rc7-gfef64f93da2b-rpm 2023-10-06T01:04:07.183 INFO:teuthology.orchestra.run.smithi050.stdout:cp /boot/System.map-6.5.0-rc7-gfef64f93da2b /boot/.System.map-6.5.0-rc7-gfef64f93da2b-rpm 2023-10-06T01:04:07.184 INFO:teuthology.orchestra.run.smithi050.stdout:rm -f /boot/vmlinuz-6.5.0-rc7-gfef64f93da2b /boot/System.map-6.5.0-rc7-gfef64f93da2b 2023-10-06T01:04:07.184 INFO:teuthology.orchestra.run.smithi050.stdout:/sbin/installkernel 6.5.0-rc7-gfef64f93da2b /boot/.vmlinuz-6.5.0-rc7-gfef64f93da2b-rpm /boot/.System.map-6.5.0-rc7-gfef64f93da2b-rpm 2023-10-06T01:04:07.184 INFO:teuthology.orchestra.run.smithi050.stdout:rm -f /boot/.vmlinuz-6.5.0-rc7-gfef64f93da2b-rpm /boot/.System.map-6.5.0-rc7-gfef64f93da2b-rpm 2023-10-06T01:04:07.184 INFO:teuthology.orchestra.run.smithi050.stdout:fi 2023-10-06T01:04:07.184 INFO:teuthology.orchestra.run.smithi050.stdout:preuninstall scriptlet (using /bin/sh): 2023-10-06T01:04:07.184 INFO:teuthology.orchestra.run.smithi050.stdout:if [ -x /sbin/new-kernel-pkg ]; then 2023-10-06T01:04:07.184 INFO:teuthology.orchestra.run.smithi050.stdout:new-kernel-pkg --remove 6.5.0-rc7-gfef64f93da2b --rminitrd --initrdfile=/boot/initramfs-6.5.0-rc7-gfef64f93da2b.img 2023-10-06T01:04:07.184 INFO:teuthology.orchestra.run.smithi050.stdout:elif [ -x /usr/bin/kernel-install ]; then 2023-10-06T01:04:07.184 INFO:teuthology.orchestra.run.smithi050.stdout:kernel-install remove 6.5.0-rc7-gfef64f93da2b 2023-10-06T01:04:07.184 INFO:teuthology.orchestra.run.smithi050.stdout:fi 2023-10-06T01:04:07.184 INFO:teuthology.orchestra.run.smithi050.stdout:postuninstall scriptlet (using /bin/sh): 2023-10-06T01:04:07.184 INFO:teuthology.orchestra.run.smithi050.stdout:if [ -x /sbin/update-bootloader ]; then 2023-10-06T01:04:07.185 INFO:teuthology.orchestra.run.smithi050.stdout:/sbin/update-bootloader --remove 6.5.0-rc7-gfef64f93da2b 2023-10-06T01:04:07.185 INFO:teuthology.orchestra.run.smithi050.stdout:fi 2023-10-06T01:04:07.186 DEBUG:teuthology.orchestra.run.smithi050:> sudo rpm -qi grub2-tools 2023-10-06T01:04:07.262 INFO:teuthology.orchestra.run.smithi050.stdout:Name : grub2-tools 2023-10-06T01:04:07.262 INFO:teuthology.orchestra.run.smithi050.stdout:Epoch : 1 2023-10-06T01:04:07.262 INFO:teuthology.orchestra.run.smithi050.stdout:Version : 2.02 2023-10-06T01:04:07.262 INFO:teuthology.orchestra.run.smithi050.stdout:Release : 99.el8_4.1 2023-10-06T01:04:07.263 INFO:teuthology.orchestra.run.smithi050.stdout:Architecture: x86_64 2023-10-06T01:04:07.263 INFO:teuthology.orchestra.run.smithi050.stdout:Install Date: Wed 21 Dec 2022 01:02:32 PM UTC 2023-10-06T01:04:07.263 INFO:teuthology.orchestra.run.smithi050.stdout:Group : System Environment/Base 2023-10-06T01:04:07.263 INFO:teuthology.orchestra.run.smithi050.stdout:Size : 9264631 2023-10-06T01:04:07.263 INFO:teuthology.orchestra.run.smithi050.stdout:License : GPLv3+ 2023-10-06T01:04:07.263 INFO:teuthology.orchestra.run.smithi050.stdout:Signature : RSA/SHA256, Thu 09 Sep 2021 09:41:55 AM UTC, Key ID 199e2f91fd431d51 2023-10-06T01:04:07.263 INFO:teuthology.orchestra.run.smithi050.stdout:Source RPM : grub2-2.02-99.el8_4.1.src.rpm 2023-10-06T01:04:07.263 INFO:teuthology.orchestra.run.smithi050.stdout:Build Date : Tue 18 May 2021 07:46:34 AM UTC 2023-10-06T01:04:07.263 INFO:teuthology.orchestra.run.smithi050.stdout:Build Host : x86-vm-07.build.eng.bos.redhat.com 2023-10-06T01:04:07.263 INFO:teuthology.orchestra.run.smithi050.stdout:Relocations : (not relocatable) 2023-10-06T01:04:07.263 INFO:teuthology.orchestra.run.smithi050.stdout:Packager : Red Hat, Inc. 2023-10-06T01:04:07.263 INFO:teuthology.orchestra.run.smithi050.stdout:Vendor : Red Hat, Inc. 2023-10-06T01:04:07.264 INFO:teuthology.orchestra.run.smithi050.stdout:URL : http://www.gnu.org/software/grub/ 2023-10-06T01:04:07.264 INFO:teuthology.orchestra.run.smithi050.stdout:Summary : Support tools for GRUB. 2023-10-06T01:04:07.264 INFO:teuthology.orchestra.run.smithi050.stdout:Description : 2023-10-06T01:04:07.264 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-10-06T01:04:07.264 INFO:teuthology.orchestra.run.smithi050.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2023-10-06T01:04:07.264 INFO:teuthology.orchestra.run.smithi050.stdout:customizable bootloader with modular architecture. It supports a rich 2023-10-06T01:04:07.264 INFO:teuthology.orchestra.run.smithi050.stdout:variety of kernel formats, file systems, computer architectures and 2023-10-06T01:04:07.264 INFO:teuthology.orchestra.run.smithi050.stdout:hardware devices. 2023-10-06T01:04:07.264 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-10-06T01:04:07.264 INFO:teuthology.orchestra.run.smithi050.stdout:This subpackage provides tools for support of all platforms. 2023-10-06T01:04:07.265 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2023-10-06T01:04:07.265 INFO:teuthology.task.kernel:Updating grub on smithi050 to boot 6.5.0-rc7-gfef64f93da2b 2023-10-06T01:04:07.265 DEBUG:teuthology.orchestra.run.smithi050:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2023-10-06T01:04:10.174 INFO:teuthology.orchestra.run.smithi050.stderr:Generating grub configuration file ... 2023-10-06T01:04:12.295 INFO:teuthology.orchestra.run.smithi050.stderr:done 2023-10-06T01:04:12.296 DEBUG:teuthology.orchestra.run.smithi050:> mktemp 2023-10-06T01:04:12.325 INFO:teuthology.orchestra.run.smithi050.stdout:/tmp/tmp.ohpACKPPOl 2023-10-06T01:04:12.325 DEBUG:teuthology.orchestra.run.smithi050:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.ohpACKPPOl 2023-10-06T01:04:12.406 DEBUG:teuthology.orchestra.run.smithi050:> sudo chmod 0666 /tmp/tmp.ohpACKPPOl 2023-10-06T01:04:12.564 DEBUG:teuthology.orchestra.remote:smithi050:/tmp/tmp.ohpACKPPOl is 6KB 2023-10-06T01:04:12.612 DEBUG:teuthology.orchestra.run.smithi050:> rm -fr /tmp/tmp.ohpACKPPOl 2023-10-06T01:04:12.626 DEBUG:teuthology.orchestra.run.smithi050:> sudo /bin/ls /boot/loader/entries || true 2023-10-06T01:04:12.697 INFO:teuthology.orchestra.run.smithi050.stdout:298e228f3b5e401e8ac0f5ae159a2e06-0-rescue.conf 2023-10-06T01:04:12.697 INFO:teuthology.orchestra.run.smithi050.stdout:298e228f3b5e401e8ac0f5ae159a2e06-4.18.0-305.25.1.el8_4.x86_64.conf 2023-10-06T01:04:12.697 INFO:teuthology.orchestra.run.smithi050.stdout:298e228f3b5e401e8ac0f5ae159a2e06-4.18.0-425.3.1.el8.x86_64.conf 2023-10-06T01:04:12.697 INFO:teuthology.orchestra.run.smithi050.stdout:298e228f3b5e401e8ac0f5ae159a2e06-4.18.0-80.el8.x86_64.conf 2023-10-06T01:04:12.697 INFO:teuthology.orchestra.run.smithi050.stdout:298e228f3b5e401e8ac0f5ae159a2e06-6.5.0-rc7-gfef64f93da2b.conf 2023-10-06T01:04:12.698 DEBUG:teuthology.orchestra.run.smithi050:> sudo grub2-set-default 298e228f3b5e401e8ac0f5ae159a2e06-6.5.0-rc7-gfef64f93da2b 2023-10-06T01:04:12.868 DEBUG:teuthology.orchestra.run.smithi050:> sudo shutdown -r now 2023-10-06T01:04:15.813 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi155.front.sepia.ceph.com, path=/tmp/kernel.x86_64.rpm, version=None) 2023-10-06T01:04:15.813 DEBUG:teuthology.orchestra.run.smithi155:> rpm -qlp /tmp/kernel.x86_64.rpm 2023-10-06T01:04:15.908 INFO:teuthology.orchestra.run.smithi155.stdout:/boot/System.map-6.5.0-rc7-gfef64f93da2b 2023-10-06T01:04:15.909 INFO:teuthology.orchestra.run.smithi155.stdout:/boot/config-6.5.0-rc7-gfef64f93da2b 2023-10-06T01:04:15.909 INFO:teuthology.orchestra.run.smithi155.stdout:/boot/vmlinuz-6.5.0-rc7-gfef64f93da2b 2023-10-06T01:04:15.909 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b 2023-10-06T01:04:15.909 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel 2023-10-06T01:04:15.909 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch 2023-10-06T01:04:15.909 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86 2023-10-06T01:04:15.909 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto 2023-10-06T01:04:15.909 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/blowfish-x86_64.ko 2023-10-06T01:04:15.909 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2023-10-06T01:04:15.909 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2023-10-06T01:04:15.910 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/camellia-x86_64.ko 2023-10-06T01:04:15.910 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2023-10-06T01:04:15.910 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2023-10-06T01:04:15.910 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/crc32-pclmul.ko 2023-10-06T01:04:15.910 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/crc32c-intel.ko 2023-10-06T01:04:15.910 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2023-10-06T01:04:15.910 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2023-10-06T01:04:15.910 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2023-10-06T01:04:15.910 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2023-10-06T01:04:15.910 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/serpent-avx2.ko 2023-10-06T01:04:15.910 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2023-10-06T01:04:15.911 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/sha1-ssse3.ko 2023-10-06T01:04:15.911 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/sha256-ssse3.ko 2023-10-06T01:04:15.911 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/sha512-ssse3.ko 2023-10-06T01:04:15.911 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2023-10-06T01:04:15.911 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2023-10-06T01:04:15.911 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/twofish-x86_64.ko 2023-10-06T01:04:15.911 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/kernel 2023-10-06T01:04:15.911 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/kernel/cpu 2023-10-06T01:04:15.911 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/kernel/cpu/mce 2023-10-06T01:04:15.911 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2023-10-06T01:04:15.911 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/kvm 2023-10-06T01:04:15.911 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/kvm/kvm-amd.ko 2023-10-06T01:04:15.912 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/kvm/kvm-intel.ko 2023-10-06T01:04:15.912 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/kvm/kvm.ko 2023-10-06T01:04:15.912 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto 2023-10-06T01:04:15.912 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/ansi_cprng.ko 2023-10-06T01:04:15.912 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/anubis.ko 2023-10-06T01:04:15.912 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/arc4.ko 2023-10-06T01:04:15.912 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/async_tx 2023-10-06T01:04:15.912 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/async_tx/async_memcpy.ko 2023-10-06T01:04:15.912 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/async_tx/async_pq.ko 2023-10-06T01:04:15.912 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/async_tx/async_raid6_recov.ko 2023-10-06T01:04:15.912 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/async_tx/async_tx.ko 2023-10-06T01:04:15.913 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/async_tx/async_xor.ko 2023-10-06T01:04:15.913 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/async_tx/raid6test.ko 2023-10-06T01:04:15.913 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/authenc.ko 2023-10-06T01:04:15.913 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/authencesn.ko 2023-10-06T01:04:15.913 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/blake2b_generic.ko 2023-10-06T01:04:15.913 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/blowfish_common.ko 2023-10-06T01:04:15.913 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/blowfish_generic.ko 2023-10-06T01:04:15.913 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/camellia_generic.ko 2023-10-06T01:04:15.913 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/cast5_generic.ko 2023-10-06T01:04:15.913 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/cast6_generic.ko 2023-10-06T01:04:15.913 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/cast_common.ko 2023-10-06T01:04:15.914 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/ccm.ko 2023-10-06T01:04:15.914 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/cmac.ko 2023-10-06T01:04:15.914 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/crc32_generic.ko 2023-10-06T01:04:15.914 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/crypto_engine.ko 2023-10-06T01:04:15.914 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/crypto_user.ko 2023-10-06T01:04:15.914 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/cts.ko 2023-10-06T01:04:15.914 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/des_generic.ko 2023-10-06T01:04:15.914 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/dh_generic.ko 2023-10-06T01:04:15.914 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/echainiv.ko 2023-10-06T01:04:15.914 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/essiv.ko 2023-10-06T01:04:15.914 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/fcrypt.ko 2023-10-06T01:04:15.914 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/khazad.ko 2023-10-06T01:04:15.915 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/lz4.ko 2023-10-06T01:04:15.915 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/lz4hc.ko 2023-10-06T01:04:15.915 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/md4.ko 2023-10-06T01:04:15.915 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/michael_mic.ko 2023-10-06T01:04:15.915 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/pcbc.ko 2023-10-06T01:04:15.915 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/pcrypt.ko 2023-10-06T01:04:15.915 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/rmd160.ko 2023-10-06T01:04:15.915 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/seed.ko 2023-10-06T01:04:15.915 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/serpent_generic.ko 2023-10-06T01:04:15.915 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/tcrypt.ko 2023-10-06T01:04:15.915 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/tea.ko 2023-10-06T01:04:15.916 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/twofish_common.ko 2023-10-06T01:04:15.916 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/twofish_generic.ko 2023-10-06T01:04:15.916 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/vmac.ko 2023-10-06T01:04:15.916 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/wp512.ko 2023-10-06T01:04:15.916 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/xcbc.ko 2023-10-06T01:04:15.916 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/xor.ko 2023-10-06T01:04:15.916 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/xxhash_generic.ko 2023-10-06T01:04:15.916 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers 2023-10-06T01:04:15.916 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/acpi 2023-10-06T01:04:15.916 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/acpi/acpi_ipmi.ko 2023-10-06T01:04:15.916 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/acpi/acpi_pad.ko 2023-10-06T01:04:15.916 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/acpi/custom_method.ko 2023-10-06T01:04:15.917 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/acpi/ec_sys.ko 2023-10-06T01:04:15.917 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/acpi/platform_profile.ko 2023-10-06T01:04:15.917 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/acpi/sbs.ko 2023-10-06T01:04:15.917 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/acpi/sbshc.ko 2023-10-06T01:04:15.917 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/acpi/video.ko 2023-10-06T01:04:15.917 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata 2023-10-06T01:04:15.917 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/acard-ahci.ko 2023-10-06T01:04:15.917 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/ahci_platform.ko 2023-10-06T01:04:15.917 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/ata_generic.ko 2023-10-06T01:04:15.917 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/libahci_platform.ko 2023-10-06T01:04:15.917 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_acpi.ko 2023-10-06T01:04:15.917 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_ali.ko 2023-10-06T01:04:15.918 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_amd.ko 2023-10-06T01:04:15.918 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_artop.ko 2023-10-06T01:04:15.918 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_atiixp.ko 2023-10-06T01:04:15.918 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_atp867x.ko 2023-10-06T01:04:15.918 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_cmd640.ko 2023-10-06T01:04:15.918 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_cmd64x.ko 2023-10-06T01:04:15.918 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_cypress.ko 2023-10-06T01:04:15.918 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_efar.ko 2023-10-06T01:04:15.918 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_hpt366.ko 2023-10-06T01:04:15.918 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_hpt37x.ko 2023-10-06T01:04:15.918 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_hpt3x2n.ko 2023-10-06T01:04:15.919 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_hpt3x3.ko 2023-10-06T01:04:15.919 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_it8213.ko 2023-10-06T01:04:15.919 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_it821x.ko 2023-10-06T01:04:15.919 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_jmicron.ko 2023-10-06T01:04:15.919 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_marvell.ko 2023-10-06T01:04:15.919 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_mpiix.ko 2023-10-06T01:04:15.919 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_netcell.ko 2023-10-06T01:04:15.919 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_ninja32.ko 2023-10-06T01:04:15.919 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_ns87410.ko 2023-10-06T01:04:15.919 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_ns87415.ko 2023-10-06T01:04:15.919 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_oldpiix.ko 2023-10-06T01:04:15.919 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_opti.ko 2023-10-06T01:04:15.920 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_optidma.ko 2023-10-06T01:04:15.920 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_pcmcia.ko 2023-10-06T01:04:15.920 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_pdc2027x.ko 2023-10-06T01:04:15.920 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_pdc202xx_old.ko 2023-10-06T01:04:15.920 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_piccolo.ko 2023-10-06T01:04:15.920 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_rdc.ko 2023-10-06T01:04:15.920 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_sch.ko 2023-10-06T01:04:15.920 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_serverworks.ko 2023-10-06T01:04:15.920 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_sil680.ko 2023-10-06T01:04:15.920 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_sis.ko 2023-10-06T01:04:15.920 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_sl82c105.ko 2023-10-06T01:04:15.920 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_triflex.ko 2023-10-06T01:04:15.921 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_via.ko 2023-10-06T01:04:15.921 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pdc_adma.ko 2023-10-06T01:04:15.921 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/sata_inic162x.ko 2023-10-06T01:04:15.921 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/sata_mv.ko 2023-10-06T01:04:15.921 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/sata_nv.ko 2023-10-06T01:04:15.921 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/sata_promise.ko 2023-10-06T01:04:15.921 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/sata_qstor.ko 2023-10-06T01:04:15.921 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/sata_sil.ko 2023-10-06T01:04:15.921 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/sata_sil24.ko 2023-10-06T01:04:15.921 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/sata_sis.ko 2023-10-06T01:04:15.921 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/sata_svw.ko 2023-10-06T01:04:15.921 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/sata_sx4.ko 2023-10-06T01:04:15.922 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/sata_uli.ko 2023-10-06T01:04:15.922 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/sata_via.ko 2023-10-06T01:04:15.922 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/sata_vsc.ko 2023-10-06T01:04:15.922 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/auxdisplay 2023-10-06T01:04:15.922 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/auxdisplay/ks0108.ko 2023-10-06T01:04:15.922 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/base 2023-10-06T01:04:15.922 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/base/regmap 2023-10-06T01:04:15.922 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/base/regmap/regmap-i2c.ko 2023-10-06T01:04:15.922 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/base/regmap/regmap-mmio.ko 2023-10-06T01:04:15.922 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/bcma 2023-10-06T01:04:15.922 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/bcma/bcma.ko 2023-10-06T01:04:15.922 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block 2023-10-06T01:04:15.923 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/aoe 2023-10-06T01:04:15.923 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/aoe/aoe.ko 2023-10-06T01:04:15.923 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/brd.ko 2023-10-06T01:04:15.923 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/drbd 2023-10-06T01:04:15.923 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/drbd/drbd.ko 2023-10-06T01:04:15.923 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/floppy.ko 2023-10-06T01:04:15.923 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/loop.ko 2023-10-06T01:04:15.923 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/mtip32xx 2023-10-06T01:04:15.923 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/mtip32xx/mtip32xx.ko 2023-10-06T01:04:15.923 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/nbd.ko 2023-10-06T01:04:15.923 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/null_blk 2023-10-06T01:04:15.923 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/null_blk/null_blk.ko 2023-10-06T01:04:15.924 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/pktcdvd.ko 2023-10-06T01:04:15.924 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/rbd.ko 2023-10-06T01:04:15.924 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/virtio_blk.ko 2023-10-06T01:04:15.924 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/xen-blkback 2023-10-06T01:04:15.924 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/xen-blkback/xen-blkback.ko 2023-10-06T01:04:15.924 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/xen-blkfront.ko 2023-10-06T01:04:15.924 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/zram 2023-10-06T01:04:15.924 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/zram/zram.ko 2023-10-06T01:04:15.924 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char 2023-10-06T01:04:15.924 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/hangcheck-timer.ko 2023-10-06T01:04:15.924 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/hw_random 2023-10-06T01:04:15.924 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/hw_random/amd-rng.ko 2023-10-06T01:04:15.925 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/hw_random/intel-rng.ko 2023-10-06T01:04:15.925 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/hw_random/timeriomem-rng.ko 2023-10-06T01:04:15.925 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/hw_random/via-rng.ko 2023-10-06T01:04:15.925 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/hw_random/virtio-rng.ko 2023-10-06T01:04:15.925 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/ipmi 2023-10-06T01:04:15.925 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/ipmi/ipmi_devintf.ko 2023-10-06T01:04:15.925 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2023-10-06T01:04:15.925 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2023-10-06T01:04:15.925 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/ipmi/ipmi_si.ko 2023-10-06T01:04:15.925 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/ipmi/ipmi_ssif.ko 2023-10-06T01:04:15.925 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2023-10-06T01:04:15.926 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/lp.ko 2023-10-06T01:04:15.926 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/mwave 2023-10-06T01:04:15.926 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/mwave/mwave.ko 2023-10-06T01:04:15.926 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/ppdev.ko 2023-10-06T01:04:15.926 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/tlclk.ko 2023-10-06T01:04:15.926 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/tpm 2023-10-06T01:04:15.926 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/tpm/tpm.ko 2023-10-06T01:04:15.926 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/tpm/tpm_atmel.ko 2023-10-06T01:04:15.926 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/tpm/tpm_infineon.ko 2023-10-06T01:04:15.926 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/tpm/tpm_nsc.ko 2023-10-06T01:04:15.926 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/tpm/tpm_tis.ko 2023-10-06T01:04:15.926 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/tpm/tpm_tis_core.ko 2023-10-06T01:04:15.927 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/uv_mmtimer.ko 2023-10-06T01:04:15.927 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/virtio_console.ko 2023-10-06T01:04:15.927 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/cpufreq 2023-10-06T01:04:15.927 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/cpufreq/acpi-cpufreq.ko 2023-10-06T01:04:15.927 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2023-10-06T01:04:15.927 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/cpufreq/p4-clockmod.ko 2023-10-06T01:04:15.927 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/cpufreq/pcc-cpufreq.ko 2023-10-06T01:04:15.927 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/cpufreq/powernow-k8.ko 2023-10-06T01:04:15.927 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/cpufreq/speedstep-lib.ko 2023-10-06T01:04:15.927 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/crypto 2023-10-06T01:04:15.927 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/crypto/ccp 2023-10-06T01:04:15.927 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/crypto/ccp/ccp-crypto.ko 2023-10-06T01:04:15.928 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/crypto/ccp/ccp.ko 2023-10-06T01:04:15.928 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/crypto/intel 2023-10-06T01:04:15.928 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/crypto/intel/qat 2023-10-06T01:04:15.928 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/crypto/intel/qat/qat_common 2023-10-06T01:04:15.928 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2023-10-06T01:04:15.928 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/crypto/intel/qat/qat_dh895xcc 2023-10-06T01:04:15.928 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2023-10-06T01:04:15.928 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/crypto/padlock-aes.ko 2023-10-06T01:04:15.928 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/crypto/padlock-sha.ko 2023-10-06T01:04:15.928 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/crypto/virtio 2023-10-06T01:04:15.928 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/crypto/virtio/virtio_crypto.ko 2023-10-06T01:04:15.928 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/dca 2023-10-06T01:04:15.929 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/dca/dca.ko 2023-10-06T01:04:15.929 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/devfreq 2023-10-06T01:04:15.929 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/devfreq/governor_simpleondemand.ko 2023-10-06T01:04:15.929 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/dma 2023-10-06T01:04:15.929 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/dma/dw 2023-10-06T01:04:15.929 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/dma/dw/dw_dmac.ko 2023-10-06T01:04:15.929 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/dma/ioat 2023-10-06T01:04:15.929 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/dma/ioat/ioatdma.ko 2023-10-06T01:04:15.929 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/edac 2023-10-06T01:04:15.929 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/edac/amd64_edac.ko 2023-10-06T01:04:15.929 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/edac/e752x_edac.ko 2023-10-06T01:04:15.929 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/edac/edac_mce_amd.ko 2023-10-06T01:04:15.930 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/edac/i3000_edac.ko 2023-10-06T01:04:15.930 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/edac/i3200_edac.ko 2023-10-06T01:04:15.930 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/edac/i5100_edac.ko 2023-10-06T01:04:15.930 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/edac/i5400_edac.ko 2023-10-06T01:04:15.930 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/edac/i7300_edac.ko 2023-10-06T01:04:15.930 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/edac/i7core_edac.ko 2023-10-06T01:04:15.930 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/edac/i82975x_edac.ko 2023-10-06T01:04:15.930 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/edac/ie31200_edac.ko 2023-10-06T01:04:15.930 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/edac/sb_edac.ko 2023-10-06T01:04:15.930 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/edac/x38_edac.ko 2023-10-06T01:04:15.930 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/firmware 2023-10-06T01:04:15.931 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/firmware/edd.ko 2023-10-06T01:04:15.931 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/firmware/iscsi_ibft.ko 2023-10-06T01:04:15.931 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/gpio 2023-10-06T01:04:15.931 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/gpio/gpio-ich.ko 2023-10-06T01:04:15.931 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/gpio/gpio-viperboard.ko 2023-10-06T01:04:15.931 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid 2023-10-06T01:04:15.931 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-appleir.ko 2023-10-06T01:04:15.931 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-aureal.ko 2023-10-06T01:04:15.931 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-axff.ko 2023-10-06T01:04:15.931 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-dr.ko 2023-10-06T01:04:15.931 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-elecom.ko 2023-10-06T01:04:15.931 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-elo.ko 2023-10-06T01:04:15.932 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-emsff.ko 2023-10-06T01:04:15.932 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-gaff.ko 2023-10-06T01:04:15.932 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-gt683r.ko 2023-10-06T01:04:15.932 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-gyration.ko 2023-10-06T01:04:15.932 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-holtek-kbd.ko 2023-10-06T01:04:15.932 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-holtek-mouse.ko 2023-10-06T01:04:15.932 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-holtekff.ko 2023-10-06T01:04:15.932 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-hyperv.ko 2023-10-06T01:04:15.932 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-icade.ko 2023-10-06T01:04:15.932 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-keytouch.ko 2023-10-06T01:04:15.932 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-kye.ko 2023-10-06T01:04:15.932 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-lcpower.ko 2023-10-06T01:04:15.933 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-led.ko 2023-10-06T01:04:15.933 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-lenovo.ko 2023-10-06T01:04:15.933 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-logitech-dj.ko 2023-10-06T01:04:15.933 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-logitech-hidpp.ko 2023-10-06T01:04:15.933 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-multitouch.ko 2023-10-06T01:04:15.933 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-ortek.ko 2023-10-06T01:04:15.933 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-penmount.ko 2023-10-06T01:04:15.933 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-petalynx.ko 2023-10-06T01:04:15.933 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-picolcd.ko 2023-10-06T01:04:15.933 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-pl.ko 2023-10-06T01:04:15.933 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-plantronics.ko 2023-10-06T01:04:15.933 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-primax.ko 2023-10-06T01:04:15.934 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-rmi.ko 2023-10-06T01:04:15.934 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-roccat-arvo.ko 2023-10-06T01:04:15.934 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-roccat-common.ko 2023-10-06T01:04:15.934 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-roccat-isku.ko 2023-10-06T01:04:15.934 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-roccat-kone.ko 2023-10-06T01:04:15.934 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-roccat-koneplus.ko 2023-10-06T01:04:15.934 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-roccat-konepure.ko 2023-10-06T01:04:15.934 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-roccat-kovaplus.ko 2023-10-06T01:04:15.934 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-roccat-lua.ko 2023-10-06T01:04:15.934 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-roccat-pyra.ko 2023-10-06T01:04:15.934 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-roccat-ryos.ko 2023-10-06T01:04:15.934 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-roccat-savu.ko 2023-10-06T01:04:15.935 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-roccat.ko 2023-10-06T01:04:15.935 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-saitek.ko 2023-10-06T01:04:15.935 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-samsung.ko 2023-10-06T01:04:15.935 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-sensor-hub.ko 2023-10-06T01:04:15.935 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-sjoy.ko 2023-10-06T01:04:15.935 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-sony.ko 2023-10-06T01:04:15.935 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-speedlink.ko 2023-10-06T01:04:15.935 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-steelseries.ko 2023-10-06T01:04:15.935 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-sunplus.ko 2023-10-06T01:04:15.935 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-thrustmaster.ko 2023-10-06T01:04:15.935 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-tivo.ko 2023-10-06T01:04:15.935 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-tmff.ko 2023-10-06T01:04:15.936 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-topseed.ko 2023-10-06T01:04:15.936 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-twinhan.ko 2023-10-06T01:04:15.936 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-uclogic.ko 2023-10-06T01:04:15.936 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-waltop.ko 2023-10-06T01:04:15.936 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-wiimote.ko 2023-10-06T01:04:15.936 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-xinmo.ko 2023-10-06T01:04:15.936 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-zpff.ko 2023-10-06T01:04:15.936 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-zydacron.ko 2023-10-06T01:04:15.936 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/uhid.ko 2023-10-06T01:04:15.936 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/wacom.ko 2023-10-06T01:04:15.936 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hv 2023-10-06T01:04:15.936 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hv/hv_balloon.ko 2023-10-06T01:04:15.937 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hv/hv_utils.ko 2023-10-06T01:04:15.937 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hv/hv_vmbus.ko 2023-10-06T01:04:15.937 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon 2023-10-06T01:04:15.937 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/abituguru.ko 2023-10-06T01:04:15.937 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/abituguru3.ko 2023-10-06T01:04:15.937 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/acpi_power_meter.ko 2023-10-06T01:04:15.937 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ad7414.ko 2023-10-06T01:04:15.937 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ad7418.ko 2023-10-06T01:04:15.937 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/adc128d818.ko 2023-10-06T01:04:15.937 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/adm1025.ko 2023-10-06T01:04:15.937 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/adm1026.ko 2023-10-06T01:04:15.937 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/adm1029.ko 2023-10-06T01:04:15.937 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/adm1031.ko 2023-10-06T01:04:15.938 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/adm9240.ko 2023-10-06T01:04:15.938 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ads7828.ko 2023-10-06T01:04:15.938 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/adt7410.ko 2023-10-06T01:04:15.938 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/adt7411.ko 2023-10-06T01:04:15.938 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/adt7462.ko 2023-10-06T01:04:15.938 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/adt7470.ko 2023-10-06T01:04:15.938 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/adt7475.ko 2023-10-06T01:04:15.938 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/adt7x10.ko 2023-10-06T01:04:15.938 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/amc6821.ko 2023-10-06T01:04:15.938 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/applesmc.ko 2023-10-06T01:04:15.938 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/asb100.ko 2023-10-06T01:04:15.938 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/asc7621.ko 2023-10-06T01:04:15.939 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/asus_atk0110.ko 2023-10-06T01:04:15.939 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/atxp1.ko 2023-10-06T01:04:15.939 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/coretemp.ko 2023-10-06T01:04:15.939 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/dell-smm-hwmon.ko 2023-10-06T01:04:15.939 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/dme1737.ko 2023-10-06T01:04:15.939 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ds1621.ko 2023-10-06T01:04:15.939 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ds620.ko 2023-10-06T01:04:15.939 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/emc1403.ko 2023-10-06T01:04:15.939 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/emc6w201.ko 2023-10-06T01:04:15.939 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/f71805f.ko 2023-10-06T01:04:15.939 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/f71882fg.ko 2023-10-06T01:04:15.940 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/f75375s.ko 2023-10-06T01:04:15.940 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/fam15h_power.ko 2023-10-06T01:04:15.940 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/fschmd.ko 2023-10-06T01:04:15.940 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/g760a.ko 2023-10-06T01:04:15.940 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/g762.ko 2023-10-06T01:04:15.940 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/gl518sm.ko 2023-10-06T01:04:15.940 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/gl520sm.ko 2023-10-06T01:04:15.940 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/hwmon-vid.ko 2023-10-06T01:04:15.940 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/i5500_temp.ko 2023-10-06T01:04:15.940 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/i5k_amb.ko 2023-10-06T01:04:15.940 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ibmaem.ko 2023-10-06T01:04:15.940 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ibmpex.ko 2023-10-06T01:04:15.940 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ina209.ko 2023-10-06T01:04:15.941 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ina2xx.ko 2023-10-06T01:04:15.941 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/it87.ko 2023-10-06T01:04:15.941 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/k10temp.ko 2023-10-06T01:04:15.941 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/k8temp.ko 2023-10-06T01:04:15.941 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lineage-pem.ko 2023-10-06T01:04:15.941 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm63.ko 2023-10-06T01:04:15.941 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm73.ko 2023-10-06T01:04:15.941 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm75.ko 2023-10-06T01:04:15.941 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm77.ko 2023-10-06T01:04:15.941 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm78.ko 2023-10-06T01:04:15.941 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm80.ko 2023-10-06T01:04:15.941 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm83.ko 2023-10-06T01:04:15.942 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm85.ko 2023-10-06T01:04:15.942 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm87.ko 2023-10-06T01:04:15.942 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm90.ko 2023-10-06T01:04:15.942 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm92.ko 2023-10-06T01:04:15.942 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm93.ko 2023-10-06T01:04:15.942 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm95234.ko 2023-10-06T01:04:15.942 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm95241.ko 2023-10-06T01:04:15.942 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm95245.ko 2023-10-06T01:04:15.942 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ltc2945.ko 2023-10-06T01:04:15.942 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ltc4151.ko 2023-10-06T01:04:15.942 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ltc4215.ko 2023-10-06T01:04:15.942 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ltc4222.ko 2023-10-06T01:04:15.943 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ltc4245.ko 2023-10-06T01:04:15.943 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ltc4260.ko 2023-10-06T01:04:15.943 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ltc4261.ko 2023-10-06T01:04:15.943 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/max16065.ko 2023-10-06T01:04:15.943 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/max1619.ko 2023-10-06T01:04:15.943 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/max1668.ko 2023-10-06T01:04:15.943 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/max197.ko 2023-10-06T01:04:15.943 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/max6639.ko 2023-10-06T01:04:15.943 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/max6650.ko 2023-10-06T01:04:15.943 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/max6697.ko 2023-10-06T01:04:15.943 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/mcp3021.ko 2023-10-06T01:04:15.943 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/nct6683.ko 2023-10-06T01:04:15.944 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/nct6775-core.ko 2023-10-06T01:04:15.944 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/nct6775.ko 2023-10-06T01:04:15.944 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/nct7802.ko 2023-10-06T01:04:15.944 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pc87360.ko 2023-10-06T01:04:15.944 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pc87427.ko 2023-10-06T01:04:15.944 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pcf8591.ko 2023-10-06T01:04:15.944 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pmbus 2023-10-06T01:04:15.944 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pmbus/adm1275.ko 2023-10-06T01:04:15.944 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pmbus/lm25066.ko 2023-10-06T01:04:15.944 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pmbus/ltc2978.ko 2023-10-06T01:04:15.944 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pmbus/max16064.ko 2023-10-06T01:04:15.944 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pmbus/max34440.ko 2023-10-06T01:04:15.945 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pmbus/max8688.ko 2023-10-06T01:04:15.945 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pmbus/pmbus.ko 2023-10-06T01:04:15.945 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2023-10-06T01:04:15.945 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pmbus/tps40422.ko 2023-10-06T01:04:15.945 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pmbus/ucd9000.ko 2023-10-06T01:04:15.945 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pmbus/ucd9200.ko 2023-10-06T01:04:15.945 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pmbus/zl6100.ko 2023-10-06T01:04:15.945 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/powr1220.ko 2023-10-06T01:04:15.945 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/sch5627.ko 2023-10-06T01:04:15.945 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/sch5636.ko 2023-10-06T01:04:15.945 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/sch56xx-common.ko 2023-10-06T01:04:15.945 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/sht15.ko 2023-10-06T01:04:15.946 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/sht21.ko 2023-10-06T01:04:15.946 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/shtc1.ko 2023-10-06T01:04:15.946 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/sis5595.ko 2023-10-06T01:04:15.946 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/smsc47b397.ko 2023-10-06T01:04:15.946 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/smsc47m1.ko 2023-10-06T01:04:15.946 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/smsc47m192.ko 2023-10-06T01:04:15.946 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/thmc50.ko 2023-10-06T01:04:15.946 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/tmp102.ko 2023-10-06T01:04:15.946 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/tmp103.ko 2023-10-06T01:04:15.946 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/tmp401.ko 2023-10-06T01:04:15.946 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/tmp421.ko 2023-10-06T01:04:15.946 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/via-cputemp.ko 2023-10-06T01:04:15.947 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/via686a.ko 2023-10-06T01:04:15.947 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/vt1211.ko 2023-10-06T01:04:15.947 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/vt8231.ko 2023-10-06T01:04:15.947 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/w83627ehf.ko 2023-10-06T01:04:15.947 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/w83627hf.ko 2023-10-06T01:04:15.947 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/w83781d.ko 2023-10-06T01:04:15.947 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/w83791d.ko 2023-10-06T01:04:15.947 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/w83792d.ko 2023-10-06T01:04:15.947 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/w83793.ko 2023-10-06T01:04:15.947 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/w83795.ko 2023-10-06T01:04:15.947 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/w83l785ts.ko 2023-10-06T01:04:15.947 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/w83l786ng.ko 2023-10-06T01:04:15.948 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c 2023-10-06T01:04:15.948 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/algos 2023-10-06T01:04:15.948 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2023-10-06T01:04:15.948 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2023-10-06T01:04:15.948 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses 2023-10-06T01:04:15.948 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2023-10-06T01:04:15.948 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-amd756.ko 2023-10-06T01:04:15.948 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-amd8111.ko 2023-10-06T01:04:15.948 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2023-10-06T01:04:15.948 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-designware-core.ko 2023-10-06T01:04:15.948 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2023-10-06T01:04:15.948 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2023-10-06T01:04:15.949 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2023-10-06T01:04:15.949 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-i801.ko 2023-10-06T01:04:15.949 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-isch.ko 2023-10-06T01:04:15.949 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-ismt.ko 2023-10-06T01:04:15.949 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2023-10-06T01:04:15.949 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-nforce2.ko 2023-10-06T01:04:15.949 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-parport.ko 2023-10-06T01:04:15.949 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2023-10-06T01:04:15.949 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-piix4.ko 2023-10-06T01:04:15.949 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-scmi.ko 2023-10-06T01:04:15.949 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-simtec.ko 2023-10-06T01:04:15.949 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-sis96x.ko 2023-10-06T01:04:15.950 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2023-10-06T01:04:15.950 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-via.ko 2023-10-06T01:04:15.950 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-viapro.ko 2023-10-06T01:04:15.950 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-viperboard.ko 2023-10-06T01:04:15.950 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/i2c-dev.ko 2023-10-06T01:04:15.950 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/i2c-mux.ko 2023-10-06T01:04:15.950 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/i2c-slave-eeprom.ko 2023-10-06T01:04:15.950 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/i2c-smbus.ko 2023-10-06T01:04:15.950 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/i2c-stub.ko 2023-10-06T01:04:15.950 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband 2023-10-06T01:04:15.950 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/core 2023-10-06T01:04:15.950 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/core/ib_cm.ko 2023-10-06T01:04:15.951 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/core/ib_core.ko 2023-10-06T01:04:15.951 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/core/ib_umad.ko 2023-10-06T01:04:15.951 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/core/ib_uverbs.ko 2023-10-06T01:04:15.951 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/core/iw_cm.ko 2023-10-06T01:04:15.951 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/core/rdma_cm.ko 2023-10-06T01:04:15.951 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/core/rdma_ucm.ko 2023-10-06T01:04:15.951 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/hw 2023-10-06T01:04:15.951 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/hw/cxgb4 2023-10-06T01:04:15.951 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2023-10-06T01:04:15.951 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/hw/mlx4 2023-10-06T01:04:15.951 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2023-10-06T01:04:15.951 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/hw/mlx5 2023-10-06T01:04:15.952 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2023-10-06T01:04:15.952 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/hw/mthca 2023-10-06T01:04:15.952 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2023-10-06T01:04:15.952 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/ulp 2023-10-06T01:04:15.952 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/ulp/ipoib 2023-10-06T01:04:15.952 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2023-10-06T01:04:15.952 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/ulp/iser 2023-10-06T01:04:15.952 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2023-10-06T01:04:15.952 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/ulp/isert 2023-10-06T01:04:15.952 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2023-10-06T01:04:15.952 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/ulp/srp 2023-10-06T01:04:15.952 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2023-10-06T01:04:15.952 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/ulp/srpt 2023-10-06T01:04:15.953 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2023-10-06T01:04:15.953 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input 2023-10-06T01:04:15.953 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/gameport 2023-10-06T01:04:15.953 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/gameport/emu10k1-gp.ko 2023-10-06T01:04:15.953 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/gameport/fm801-gp.ko 2023-10-06T01:04:15.953 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/gameport/gameport.ko 2023-10-06T01:04:15.953 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/gameport/lightning.ko 2023-10-06T01:04:15.953 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/gameport/ns558.ko 2023-10-06T01:04:15.953 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/joydev.ko 2023-10-06T01:04:15.953 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/keyboard 2023-10-06T01:04:15.953 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/keyboard/gpio_keys.ko 2023-10-06T01:04:15.953 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/mouse 2023-10-06T01:04:15.954 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/mouse/appletouch.ko 2023-10-06T01:04:15.954 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/mouse/bcm5974.ko 2023-10-06T01:04:15.954 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/mouse/cyapatp.ko 2023-10-06T01:04:15.954 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/mouse/elan_i2c.ko 2023-10-06T01:04:15.954 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/mouse/sermouse.ko 2023-10-06T01:04:15.954 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/mouse/synaptics_i2c.ko 2023-10-06T01:04:15.954 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/mouse/synaptics_usb.ko 2023-10-06T01:04:15.954 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/mouse/vsxxxaa.ko 2023-10-06T01:04:15.954 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/rmi4 2023-10-06T01:04:15.954 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/rmi4/rmi_core.ko 2023-10-06T01:04:15.954 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/serio 2023-10-06T01:04:15.954 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/serio/altera_ps2.ko 2023-10-06T01:04:15.955 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/serio/arc_ps2.ko 2023-10-06T01:04:15.955 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/serio/hyperv-keyboard.ko 2023-10-06T01:04:15.955 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/serio/serio_raw.ko 2023-10-06T01:04:15.955 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/sparse-keymap.ko 2023-10-06T01:04:15.955 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/iommu 2023-10-06T01:04:15.955 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/iommu/amd 2023-10-06T01:04:15.955 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/iommu/amd/iommu_v2.ko 2023-10-06T01:04:15.955 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds 2023-10-06T01:04:15.955 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/leds-blinkm.ko 2023-10-06T01:04:15.955 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/leds-lm3530.ko 2023-10-06T01:04:15.955 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/leds-lp3944.ko 2023-10-06T01:04:15.955 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/leds-ss4200.ko 2023-10-06T01:04:15.956 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/trigger 2023-10-06T01:04:15.956 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/trigger/ledtrig-audio.ko 2023-10-06T01:04:15.956 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2023-10-06T01:04:15.956 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/trigger/ledtrig-camera.ko 2023-10-06T01:04:15.956 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2023-10-06T01:04:15.956 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2023-10-06T01:04:15.956 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2023-10-06T01:04:15.956 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/trigger/ledtrig-timer.ko 2023-10-06T01:04:15.956 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/trigger/ledtrig-transient.ko 2023-10-06T01:04:15.956 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md 2023-10-06T01:04:15.956 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/bcache 2023-10-06T01:04:15.956 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/bcache/bcache.ko 2023-10-06T01:04:15.957 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-bio-prison.ko 2023-10-06T01:04:15.957 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-cache-smq.ko 2023-10-06T01:04:15.957 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-cache.ko 2023-10-06T01:04:15.957 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-crypt.ko 2023-10-06T01:04:15.957 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-delay.ko 2023-10-06T01:04:15.957 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-flakey.ko 2023-10-06T01:04:15.957 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-log-userspace.ko 2023-10-06T01:04:15.957 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-multipath.ko 2023-10-06T01:04:15.957 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-queue-length.ko 2023-10-06T01:04:15.957 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-raid.ko 2023-10-06T01:04:15.957 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-round-robin.ko 2023-10-06T01:04:15.957 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-service-time.ko 2023-10-06T01:04:15.958 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-switch.ko 2023-10-06T01:04:15.958 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-thin-pool.ko 2023-10-06T01:04:15.958 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-verity.ko 2023-10-06T01:04:15.958 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/faulty.ko 2023-10-06T01:04:15.958 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/linear.ko 2023-10-06T01:04:15.958 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/multipath.ko 2023-10-06T01:04:15.958 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/persistent-data 2023-10-06T01:04:15.958 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2023-10-06T01:04:15.958 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/raid0.ko 2023-10-06T01:04:15.958 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/raid1.ko 2023-10-06T01:04:15.958 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/raid10.ko 2023-10-06T01:04:15.958 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/raid456.ko 2023-10-06T01:04:15.959 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/message 2023-10-06T01:04:15.959 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/message/fusion 2023-10-06T01:04:15.959 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/message/fusion/mptbase.ko 2023-10-06T01:04:15.959 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/message/fusion/mptctl.ko 2023-10-06T01:04:15.959 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/message/fusion/mptfc.ko 2023-10-06T01:04:15.959 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/message/fusion/mptlan.ko 2023-10-06T01:04:15.959 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/message/fusion/mptsas.ko 2023-10-06T01:04:15.959 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/message/fusion/mptscsih.ko 2023-10-06T01:04:15.959 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/message/fusion/mptspi.ko 2023-10-06T01:04:15.959 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/mfd 2023-10-06T01:04:15.959 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/mfd/lpc_ich.ko 2023-10-06T01:04:15.959 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/mfd/lpc_sch.ko 2023-10-06T01:04:15.960 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/mfd/mfd-core.ko 2023-10-06T01:04:15.960 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/mfd/sm501.ko 2023-10-06T01:04:15.960 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/mfd/viperboard.ko 2023-10-06T01:04:15.960 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/mfd/vx855.ko 2023-10-06T01:04:15.960 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/mfd/wl1273-core.ko 2023-10-06T01:04:15.960 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc 2023-10-06T01:04:15.960 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/altera-stapl 2023-10-06T01:04:15.960 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2023-10-06T01:04:15.960 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/apds9802als.ko 2023-10-06T01:04:15.960 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/apds990x.ko 2023-10-06T01:04:15.960 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/bh1770glc.ko 2023-10-06T01:04:15.960 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/cb710 2023-10-06T01:04:15.961 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/cb710/cb710.ko 2023-10-06T01:04:15.961 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/eeprom 2023-10-06T01:04:15.961 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/eeprom/at24.ko 2023-10-06T01:04:15.961 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/eeprom/eeprom.ko 2023-10-06T01:04:15.961 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2023-10-06T01:04:15.961 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/eeprom/max6875.ko 2023-10-06T01:04:15.961 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/enclosure.ko 2023-10-06T01:04:15.961 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/hpilo.ko 2023-10-06T01:04:15.961 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/isl29003.ko 2023-10-06T01:04:15.961 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/isl29020.ko 2023-10-06T01:04:15.961 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/lis3lv02d 2023-10-06T01:04:15.961 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2023-10-06T01:04:15.962 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2023-10-06T01:04:15.962 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/mei 2023-10-06T01:04:15.962 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/mei/mei-me.ko 2023-10-06T01:04:15.962 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/mei/mei-txe.ko 2023-10-06T01:04:15.962 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/mei/mei.ko 2023-10-06T01:04:15.962 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/sgi-gru 2023-10-06T01:04:15.962 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/sgi-gru/gru.ko 2023-10-06T01:04:15.962 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/sgi-xp 2023-10-06T01:04:15.962 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/sgi-xp/xp.ko 2023-10-06T01:04:15.962 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/sgi-xp/xpc.ko 2023-10-06T01:04:15.962 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/sgi-xp/xpnet.ko 2023-10-06T01:04:15.962 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/tifm_7xx1.ko 2023-10-06T01:04:15.963 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/tifm_core.ko 2023-10-06T01:04:15.963 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/tsl2550.ko 2023-10-06T01:04:15.963 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/vmw_balloon.ko 2023-10-06T01:04:15.963 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/vmw_vmci 2023-10-06T01:04:15.963 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2023-10-06T01:04:15.963 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net 2023-10-06T01:04:15.963 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/bonding 2023-10-06T01:04:15.963 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/bonding/bonding.ko 2023-10-06T01:04:15.963 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/dsa 2023-10-06T01:04:15.963 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/dsa/b53 2023-10-06T01:04:15.963 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/dsa/b53/b53_common.ko 2023-10-06T01:04:15.963 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/dsa/bcm-sf2.ko 2023-10-06T01:04:15.964 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/dsa/mv88e6060.ko 2023-10-06T01:04:15.964 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/dsa/mv88e6xxx 2023-10-06T01:04:15.964 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2023-10-06T01:04:15.964 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/dummy.ko 2023-10-06T01:04:15.964 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/eql.ko 2023-10-06T01:04:15.964 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet 2023-10-06T01:04:15.964 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/3com 2023-10-06T01:04:15.964 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2023-10-06T01:04:15.964 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2023-10-06T01:04:15.964 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/3com/3c59x.ko 2023-10-06T01:04:15.964 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/3com/typhoon.ko 2023-10-06T01:04:15.964 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/8390 2023-10-06T01:04:15.965 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/8390/8390.ko 2023-10-06T01:04:15.965 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2023-10-06T01:04:15.965 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2023-10-06T01:04:15.965 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2023-10-06T01:04:15.965 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/adaptec 2023-10-06T01:04:15.965 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/adaptec/starfire.ko 2023-10-06T01:04:15.965 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/agere 2023-10-06T01:04:15.965 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/agere/et131x.ko 2023-10-06T01:04:15.965 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/alteon 2023-10-06T01:04:15.965 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/alteon/acenic.ko 2023-10-06T01:04:15.965 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/altera 2023-10-06T01:04:15.965 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/altera/altera_tse.ko 2023-10-06T01:04:15.966 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/amd 2023-10-06T01:04:15.966 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/amd/amd8111e.ko 2023-10-06T01:04:15.966 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2023-10-06T01:04:15.966 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/amd/pcnet32.ko 2023-10-06T01:04:15.966 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/atheros 2023-10-06T01:04:15.966 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/atheros/alx 2023-10-06T01:04:15.966 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2023-10-06T01:04:15.966 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/atheros/atl1c 2023-10-06T01:04:15.966 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2023-10-06T01:04:15.966 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/atheros/atl1e 2023-10-06T01:04:15.966 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2023-10-06T01:04:15.967 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/atheros/atlx 2023-10-06T01:04:15.967 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2023-10-06T01:04:15.967 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2023-10-06T01:04:15.967 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/broadcom 2023-10-06T01:04:15.967 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/broadcom/b44.ko 2023-10-06T01:04:15.967 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2023-10-06T01:04:15.967 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/broadcom/bnx2x 2023-10-06T01:04:15.967 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2023-10-06T01:04:15.967 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/broadcom/cnic.ko 2023-10-06T01:04:15.967 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/broadcom/genet 2023-10-06T01:04:15.967 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2023-10-06T01:04:15.967 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/broadcom/tg3.ko 2023-10-06T01:04:15.968 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/brocade 2023-10-06T01:04:15.968 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/brocade/bna 2023-10-06T01:04:15.968 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2023-10-06T01:04:15.968 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/chelsio 2023-10-06T01:04:15.968 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/chelsio/cxgb 2023-10-06T01:04:15.968 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2023-10-06T01:04:15.968 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/chelsio/cxgb3 2023-10-06T01:04:15.968 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2023-10-06T01:04:15.968 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/chelsio/cxgb4 2023-10-06T01:04:15.968 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2023-10-06T01:04:15.968 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/chelsio/cxgb4vf 2023-10-06T01:04:15.968 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2023-10-06T01:04:15.969 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/chelsio/libcxgb 2023-10-06T01:04:15.969 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2023-10-06T01:04:15.969 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/cisco 2023-10-06T01:04:15.969 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/cisco/enic 2023-10-06T01:04:15.969 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2023-10-06T01:04:15.969 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/dec 2023-10-06T01:04:15.969 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/dec/tulip 2023-10-06T01:04:15.969 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2023-10-06T01:04:15.969 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2023-10-06T01:04:15.969 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2023-10-06T01:04:15.969 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2023-10-06T01:04:15.969 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2023-10-06T01:04:15.970 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2023-10-06T01:04:15.970 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/dlink 2023-10-06T01:04:15.970 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/dlink/dl2k.ko 2023-10-06T01:04:15.970 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/dlink/sundance.ko 2023-10-06T01:04:15.970 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/dnet.ko 2023-10-06T01:04:15.970 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/emulex 2023-10-06T01:04:15.970 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/emulex/benet 2023-10-06T01:04:15.970 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2023-10-06T01:04:15.970 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/ethoc.ko 2023-10-06T01:04:15.970 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/fealnx.ko 2023-10-06T01:04:15.970 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel 2023-10-06T01:04:15.970 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/e100.ko 2023-10-06T01:04:15.971 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/e1000 2023-10-06T01:04:15.971 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2023-10-06T01:04:15.971 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/e1000e 2023-10-06T01:04:15.971 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2023-10-06T01:04:15.971 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/fm10k 2023-10-06T01:04:15.971 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2023-10-06T01:04:15.971 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/i40e 2023-10-06T01:04:15.971 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2023-10-06T01:04:15.971 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/iavf 2023-10-06T01:04:15.971 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2023-10-06T01:04:15.971 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/igb 2023-10-06T01:04:15.971 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/igb/igb.ko 2023-10-06T01:04:15.972 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/igbvf 2023-10-06T01:04:15.972 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2023-10-06T01:04:15.972 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/ixgbe 2023-10-06T01:04:15.972 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2023-10-06T01:04:15.972 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/ixgbevf 2023-10-06T01:04:15.972 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2023-10-06T01:04:15.972 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/jme.ko 2023-10-06T01:04:15.972 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/marvell 2023-10-06T01:04:15.972 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2023-10-06T01:04:15.972 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/marvell/skge.ko 2023-10-06T01:04:15.972 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/marvell/sky2.ko 2023-10-06T01:04:15.972 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/mellanox 2023-10-06T01:04:15.973 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/mellanox/mlx4 2023-10-06T01:04:15.973 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2023-10-06T01:04:15.973 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2023-10-06T01:04:15.973 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/mellanox/mlx5 2023-10-06T01:04:15.973 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/mellanox/mlx5/core 2023-10-06T01:04:15.973 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2023-10-06T01:04:15.973 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/micrel 2023-10-06T01:04:15.973 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2023-10-06T01:04:15.973 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/myricom 2023-10-06T01:04:15.973 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/myricom/myri10ge 2023-10-06T01:04:15.973 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2023-10-06T01:04:15.973 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/natsemi 2023-10-06T01:04:15.974 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2023-10-06T01:04:15.974 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2023-10-06T01:04:15.974 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/neterion 2023-10-06T01:04:15.974 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/neterion/s2io.ko 2023-10-06T01:04:15.974 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/nvidia 2023-10-06T01:04:15.974 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2023-10-06T01:04:15.974 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/packetengines 2023-10-06T01:04:15.974 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2023-10-06T01:04:15.974 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2023-10-06T01:04:15.974 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/qlogic 2023-10-06T01:04:15.974 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/qlogic/netxen 2023-10-06T01:04:15.974 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2023-10-06T01:04:15.975 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2023-10-06T01:04:15.975 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/qlogic/qlcnic 2023-10-06T01:04:15.975 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2023-10-06T01:04:15.975 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/rdc 2023-10-06T01:04:15.975 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/rdc/r6040.ko 2023-10-06T01:04:15.975 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/realtek 2023-10-06T01:04:15.975 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/realtek/8139cp.ko 2023-10-06T01:04:15.975 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/realtek/8139too.ko 2023-10-06T01:04:15.975 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/realtek/atp.ko 2023-10-06T01:04:15.975 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/realtek/r8169.ko 2023-10-06T01:04:15.975 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/rocker 2023-10-06T01:04:15.975 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/rocker/rocker.ko 2023-10-06T01:04:15.976 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/sfc 2023-10-06T01:04:15.976 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/sfc/sfc.ko 2023-10-06T01:04:15.976 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/silan 2023-10-06T01:04:15.976 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/silan/sc92031.ko 2023-10-06T01:04:15.976 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/sis 2023-10-06T01:04:15.976 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/sis/sis190.ko 2023-10-06T01:04:15.976 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/sis/sis900.ko 2023-10-06T01:04:15.976 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/smsc 2023-10-06T01:04:15.976 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/smsc/epic100.ko 2023-10-06T01:04:15.976 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2023-10-06T01:04:15.976 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2023-10-06T01:04:15.976 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2023-10-06T01:04:15.977 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/stmicro 2023-10-06T01:04:15.977 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/stmicro/stmmac 2023-10-06T01:04:15.977 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2023-10-06T01:04:15.977 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2023-10-06T01:04:15.977 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/sun 2023-10-06T01:04:15.977 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/sun/cassini.ko 2023-10-06T01:04:15.977 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/sun/niu.ko 2023-10-06T01:04:15.977 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/sun/sungem.ko 2023-10-06T01:04:15.977 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/sun/sunhme.ko 2023-10-06T01:04:15.977 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/tehuti 2023-10-06T01:04:15.977 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2023-10-06T01:04:15.977 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/ti 2023-10-06T01:04:15.978 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/ti/tlan.ko 2023-10-06T01:04:15.978 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/via 2023-10-06T01:04:15.978 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/via/via-rhine.ko 2023-10-06T01:04:15.978 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/via/via-velocity.ko 2023-10-06T01:04:15.978 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/wiznet 2023-10-06T01:04:15.978 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/wiznet/w5100.ko 2023-10-06T01:04:15.978 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/wiznet/w5300.ko 2023-10-06T01:04:15.978 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/xircom 2023-10-06T01:04:15.978 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2023-10-06T01:04:15.978 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/geneve.ko 2023-10-06T01:04:15.978 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/hyperv 2023-10-06T01:04:15.978 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/hyperv/hv_netvsc.ko 2023-10-06T01:04:15.979 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ieee802154 2023-10-06T01:04:15.979 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ieee802154/fakelb.ko 2023-10-06T01:04:15.979 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ifb.ko 2023-10-06T01:04:15.979 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ipvlan 2023-10-06T01:04:15.979 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ipvlan/ipvlan.ko 2023-10-06T01:04:15.979 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/macvlan.ko 2023-10-06T01:04:15.979 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/macvtap.ko 2023-10-06T01:04:15.979 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/mdio 2023-10-06T01:04:15.979 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/mdio.ko 2023-10-06T01:04:15.979 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2023-10-06T01:04:15.979 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/mdio/mdio-bitbang.ko 2023-10-06T01:04:15.979 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/mdio/mdio-regmap.ko 2023-10-06T01:04:15.980 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/mii.ko 2023-10-06T01:04:15.980 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/net_failover.ko 2023-10-06T01:04:15.980 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/netconsole.ko 2023-10-06T01:04:15.980 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/nlmon.ko 2023-10-06T01:04:15.980 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/pcs 2023-10-06T01:04:15.980 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/pcs/pcs-lynx.ko 2023-10-06T01:04:15.980 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/pcs/pcs_xpcs.ko 2023-10-06T01:04:15.980 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy 2023-10-06T01:04:15.980 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/amd.ko 2023-10-06T01:04:15.980 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/bcm-phy-lib.ko 2023-10-06T01:04:15.980 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/bcm-phy-ptp.ko 2023-10-06T01:04:15.980 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/bcm7xxx.ko 2023-10-06T01:04:15.981 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/bcm87xx.ko 2023-10-06T01:04:15.981 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/broadcom.ko 2023-10-06T01:04:15.981 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/cicada.ko 2023-10-06T01:04:15.981 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/davicom.ko 2023-10-06T01:04:15.981 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/dp83640.ko 2023-10-06T01:04:15.981 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/et1011c.ko 2023-10-06T01:04:15.981 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/icplus.ko 2023-10-06T01:04:15.981 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/lxt.ko 2023-10-06T01:04:15.981 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/marvell.ko 2023-10-06T01:04:15.981 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/micrel.ko 2023-10-06T01:04:15.981 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/national.ko 2023-10-06T01:04:15.981 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/phylink.ko 2023-10-06T01:04:15.982 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/qsemi.ko 2023-10-06T01:04:15.982 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/realtek.ko 2023-10-06T01:04:15.982 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/smsc.ko 2023-10-06T01:04:15.982 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/ste10Xp.ko 2023-10-06T01:04:15.982 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/vitesse.ko 2023-10-06T01:04:15.982 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ppp 2023-10-06T01:04:15.982 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ppp/bsd_comp.ko 2023-10-06T01:04:15.982 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ppp/ppp_async.ko 2023-10-06T01:04:15.982 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ppp/ppp_deflate.ko 2023-10-06T01:04:15.982 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ppp/ppp_generic.ko 2023-10-06T01:04:15.982 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ppp/ppp_mppe.ko 2023-10-06T01:04:15.982 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ppp/ppp_synctty.ko 2023-10-06T01:04:15.983 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ppp/pppoe.ko 2023-10-06T01:04:15.983 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ppp/pppox.ko 2023-10-06T01:04:15.983 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ppp/pptp.ko 2023-10-06T01:04:15.983 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/slip 2023-10-06T01:04:15.983 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/slip/slhc.ko 2023-10-06T01:04:15.983 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/slip/slip.ko 2023-10-06T01:04:15.983 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/sungem_phy.ko 2023-10-06T01:04:15.983 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/tap.ko 2023-10-06T01:04:15.983 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/team 2023-10-06T01:04:15.983 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/team/team.ko 2023-10-06T01:04:15.983 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/team/team_mode_activebackup.ko 2023-10-06T01:04:15.983 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/team/team_mode_broadcast.ko 2023-10-06T01:04:15.984 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/team/team_mode_loadbalance.ko 2023-10-06T01:04:15.984 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/team/team_mode_random.ko 2023-10-06T01:04:15.984 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/team/team_mode_roundrobin.ko 2023-10-06T01:04:15.984 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/tun.ko 2023-10-06T01:04:15.984 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/veth.ko 2023-10-06T01:04:15.984 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/virtio_net.ko 2023-10-06T01:04:15.984 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/vmxnet3 2023-10-06T01:04:15.984 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/vmxnet3/vmxnet3.ko 2023-10-06T01:04:15.984 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/vxlan 2023-10-06T01:04:15.984 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/vxlan/vxlan.ko 2023-10-06T01:04:15.984 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/xen-netback 2023-10-06T01:04:15.984 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/xen-netback/xen-netback.ko 2023-10-06T01:04:15.985 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/xen-netfront.ko 2023-10-06T01:04:15.985 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ntb 2023-10-06T01:04:15.985 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ntb/ntb.ko 2023-10-06T01:04:15.985 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/nvme 2023-10-06T01:04:15.985 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/nvme/host 2023-10-06T01:04:15.985 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/nvme/host/nvme-core.ko 2023-10-06T01:04:15.985 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/nvme/host/nvme.ko 2023-10-06T01:04:15.985 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/parport 2023-10-06T01:04:15.985 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/parport/parport.ko 2023-10-06T01:04:15.985 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/parport/parport_cs.ko 2023-10-06T01:04:15.985 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/parport/parport_pc.ko 2023-10-06T01:04:15.985 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/parport/parport_serial.ko 2023-10-06T01:04:15.986 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pci 2023-10-06T01:04:15.986 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pci/hotplug 2023-10-06T01:04:15.986 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2023-10-06T01:04:15.986 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pci/pcie 2023-10-06T01:04:15.986 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pci/pcie/aer_inject.ko 2023-10-06T01:04:15.986 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pci/xen-pcifront.ko 2023-10-06T01:04:15.986 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pcmcia 2023-10-06T01:04:15.986 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pcmcia/i82092.ko 2023-10-06T01:04:15.986 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pcmcia/pd6729.ko 2023-10-06T01:04:15.986 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pcmcia/yenta_socket.ko 2023-10-06T01:04:15.986 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pinctrl 2023-10-06T01:04:15.986 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pinctrl/intel 2023-10-06T01:04:15.987 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2023-10-06T01:04:15.987 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform 2023-10-06T01:04:15.987 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86 2023-10-06T01:04:15.987 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/acer-wmi.ko 2023-10-06T01:04:15.987 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/acerhdf.ko 2023-10-06T01:04:15.987 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/apple-gmux.ko 2023-10-06T01:04:15.987 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/asus-laptop.ko 2023-10-06T01:04:15.987 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/asus-nb-wmi.ko 2023-10-06T01:04:15.987 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/asus-wmi.ko 2023-10-06T01:04:15.987 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/classmate-laptop.ko 2023-10-06T01:04:15.987 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/eeepc-laptop.ko 2023-10-06T01:04:15.987 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/eeepc-wmi.ko 2023-10-06T01:04:15.988 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/fujitsu-laptop.ko 2023-10-06T01:04:15.988 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/fujitsu-tablet.ko 2023-10-06T01:04:15.988 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/hdaps.ko 2023-10-06T01:04:15.988 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/intel 2023-10-06T01:04:15.988 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/intel/intel-rst.ko 2023-10-06T01:04:15.988 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/intel_ips.ko 2023-10-06T01:04:15.988 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/msi-wmi.ko 2023-10-06T01:04:15.988 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/mxm-wmi.ko 2023-10-06T01:04:15.988 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/panasonic-laptop.ko 2023-10-06T01:04:15.988 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/samsung-laptop.ko 2023-10-06T01:04:15.988 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/samsung-q10.ko 2023-10-06T01:04:15.988 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/topstar-laptop.ko 2023-10-06T01:04:15.988 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2023-10-06T01:04:15.989 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/toshiba_haps.ko 2023-10-06T01:04:15.989 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/wmi-bmof.ko 2023-10-06T01:04:15.989 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/wmi.ko 2023-10-06T01:04:15.989 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/powercap 2023-10-06T01:04:15.989 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/powercap/intel_rapl_common.ko 2023-10-06T01:04:15.989 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/powercap/intel_rapl_msr.ko 2023-10-06T01:04:15.989 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pps 2023-10-06T01:04:15.989 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pps/clients 2023-10-06T01:04:15.989 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pps/clients/pps-gpio.ko 2023-10-06T01:04:15.989 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pps/clients/pps-ldisc.ko 2023-10-06T01:04:15.989 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pps/clients/pps_parport.ko 2023-10-06T01:04:15.989 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pps/pps_core.ko 2023-10-06T01:04:15.990 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ptp 2023-10-06T01:04:15.990 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ptp/ptp.ko 2023-10-06T01:04:15.990 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ptp/ptp_kvm.ko 2023-10-06T01:04:15.990 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc 2023-10-06T01:04:15.990 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-bq32k.ko 2023-10-06T01:04:15.990 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-bq4802.ko 2023-10-06T01:04:15.990 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-ds1286.ko 2023-10-06T01:04:15.990 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-ds1307.ko 2023-10-06T01:04:15.990 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-ds1374.ko 2023-10-06T01:04:15.990 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-ds1511.ko 2023-10-06T01:04:15.990 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-ds1553.ko 2023-10-06T01:04:15.990 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-ds1672.ko 2023-10-06T01:04:15.991 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-ds1742.ko 2023-10-06T01:04:15.991 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-ds2404.ko 2023-10-06T01:04:15.991 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-ds3232.ko 2023-10-06T01:04:15.991 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-em3027.ko 2023-10-06T01:04:15.991 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-fm3130.ko 2023-10-06T01:04:15.991 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-isl12022.ko 2023-10-06T01:04:15.991 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-isl1208.ko 2023-10-06T01:04:15.991 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-m41t80.ko 2023-10-06T01:04:15.991 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-m48t35.ko 2023-10-06T01:04:15.991 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-m48t59.ko 2023-10-06T01:04:15.991 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-max6900.ko 2023-10-06T01:04:15.991 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-msm6242.ko 2023-10-06T01:04:15.992 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-pcf2127.ko 2023-10-06T01:04:15.992 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-pcf85063.ko 2023-10-06T01:04:15.992 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-pcf8523.ko 2023-10-06T01:04:15.992 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-pcf8563.ko 2023-10-06T01:04:15.992 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-pcf8583.ko 2023-10-06T01:04:15.992 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-rp5c01.ko 2023-10-06T01:04:15.992 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-rs5c372.ko 2023-10-06T01:04:15.992 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-rv3029c2.ko 2023-10-06T01:04:15.992 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-rx8025.ko 2023-10-06T01:04:15.992 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-rx8581.ko 2023-10-06T01:04:15.992 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-stk17ta8.ko 2023-10-06T01:04:15.992 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-x1205.ko 2023-10-06T01:04:15.993 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi 2023-10-06T01:04:15.993 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/3w-9xxx.ko 2023-10-06T01:04:15.993 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/3w-sas.ko 2023-10-06T01:04:15.993 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/3w-xxxx.ko 2023-10-06T01:04:15.993 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/BusLogic.ko 2023-10-06T01:04:15.993 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/a100u2w.ko 2023-10-06T01:04:15.993 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/aacraid 2023-10-06T01:04:15.993 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/aacraid/aacraid.ko 2023-10-06T01:04:15.993 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/advansys.ko 2023-10-06T01:04:15.993 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/aic7xxx 2023-10-06T01:04:15.993 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2023-10-06T01:04:15.993 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2023-10-06T01:04:15.994 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/am53c974.ko 2023-10-06T01:04:15.994 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/arcmsr 2023-10-06T01:04:15.994 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/arcmsr/arcmsr.ko 2023-10-06T01:04:15.994 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/atp870u.ko 2023-10-06T01:04:15.994 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/be2iscsi 2023-10-06T01:04:15.994 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2023-10-06T01:04:15.994 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/bfa 2023-10-06T01:04:15.994 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/bfa/bfa.ko 2023-10-06T01:04:15.994 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/bnx2fc 2023-10-06T01:04:15.994 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2023-10-06T01:04:15.994 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/bnx2i 2023-10-06T01:04:15.994 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/bnx2i/bnx2i.ko 2023-10-06T01:04:15.995 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/ch.ko 2023-10-06T01:04:15.995 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/csiostor 2023-10-06T01:04:15.995 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/csiostor/csiostor.ko 2023-10-06T01:04:15.995 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/cxgbi 2023-10-06T01:04:15.995 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/cxgbi/cxgb3i 2023-10-06T01:04:15.995 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2023-10-06T01:04:15.995 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/cxgbi/cxgb4i 2023-10-06T01:04:15.995 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2023-10-06T01:04:15.995 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2023-10-06T01:04:15.995 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/dc395x.ko 2023-10-06T01:04:15.995 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/device_handler 2023-10-06T01:04:15.995 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/device_handler/scsi_dh_alua.ko 2023-10-06T01:04:15.996 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/device_handler/scsi_dh_emc.ko 2023-10-06T01:04:15.996 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/device_handler/scsi_dh_hp_sw.ko 2023-10-06T01:04:15.996 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/device_handler/scsi_dh_rdac.ko 2023-10-06T01:04:15.996 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/dmx3191d.ko 2023-10-06T01:04:15.996 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/esas2r 2023-10-06T01:04:15.996 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/esas2r/esas2r.ko 2023-10-06T01:04:15.996 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/esp_scsi.ko 2023-10-06T01:04:15.996 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/fcoe 2023-10-06T01:04:15.996 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/fcoe/fcoe.ko 2023-10-06T01:04:15.996 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/fcoe/libfcoe.ko 2023-10-06T01:04:15.996 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/fnic 2023-10-06T01:04:15.996 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/fnic/fnic.ko 2023-10-06T01:04:15.997 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/hpsa.ko 2023-10-06T01:04:15.997 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/hptiop.ko 2023-10-06T01:04:15.997 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/hv_storvsc.ko 2023-10-06T01:04:15.997 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/initio.ko 2023-10-06T01:04:15.997 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/ipr.ko 2023-10-06T01:04:15.997 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/ips.ko 2023-10-06T01:04:15.997 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/isci 2023-10-06T01:04:15.997 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/isci/isci.ko 2023-10-06T01:04:15.997 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2023-10-06T01:04:15.997 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/iscsi_tcp.ko 2023-10-06T01:04:15.997 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/libfc 2023-10-06T01:04:15.997 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/libfc/libfc.ko 2023-10-06T01:04:15.997 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/libiscsi.ko 2023-10-06T01:04:15.998 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/libiscsi_tcp.ko 2023-10-06T01:04:15.998 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/libsas 2023-10-06T01:04:15.998 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/libsas/libsas.ko 2023-10-06T01:04:15.998 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/lpfc 2023-10-06T01:04:15.998 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/lpfc/lpfc.ko 2023-10-06T01:04:15.998 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/megaraid 2023-10-06T01:04:15.998 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/megaraid.ko 2023-10-06T01:04:15.998 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2023-10-06T01:04:15.998 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2023-10-06T01:04:15.998 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2023-10-06T01:04:15.998 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/mpt3sas 2023-10-06T01:04:15.998 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2023-10-06T01:04:15.999 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/mvsas 2023-10-06T01:04:15.999 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/mvsas/mvsas.ko 2023-10-06T01:04:15.999 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/mvumi.ko 2023-10-06T01:04:15.999 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/pm8001 2023-10-06T01:04:15.999 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/pm8001/pm80xx.ko 2023-10-06T01:04:15.999 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/pmcraid.ko 2023-10-06T01:04:15.999 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/qla1280.ko 2023-10-06T01:04:15.999 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/qla2xxx 2023-10-06T01:04:15.999 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2023-10-06T01:04:15.999 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2023-10-06T01:04:15.999 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/qla4xxx 2023-10-06T01:04:15.999 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2023-10-06T01:04:16.000 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/raid_class.ko 2023-10-06T01:04:16.000 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/scsi_debug.ko 2023-10-06T01:04:16.000 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/scsi_transport_fc.ko 2023-10-06T01:04:16.000 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/scsi_transport_iscsi.ko 2023-10-06T01:04:16.000 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/scsi_transport_sas.ko 2023-10-06T01:04:16.000 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/scsi_transport_spi.ko 2023-10-06T01:04:16.000 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/scsi_transport_srp.ko 2023-10-06T01:04:16.000 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/ses.ko 2023-10-06T01:04:16.000 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/st.ko 2023-10-06T01:04:16.000 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/stex.ko 2023-10-06T01:04:16.000 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/sym53c8xx_2 2023-10-06T01:04:16.000 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2023-10-06T01:04:16.001 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/virtio_scsi.ko 2023-10-06T01:04:16.001 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/vmw_pvscsi.ko 2023-10-06T01:04:16.001 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/wd719x.ko 2023-10-06T01:04:16.001 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ssb 2023-10-06T01:04:16.001 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ssb/ssb.ko 2023-10-06T01:04:16.001 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/target 2023-10-06T01:04:16.001 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/target/iscsi 2023-10-06T01:04:16.001 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2023-10-06T01:04:16.001 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/target/loopback 2023-10-06T01:04:16.001 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/target/loopback/tcm_loop.ko 2023-10-06T01:04:16.001 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/target/target_core_file.ko 2023-10-06T01:04:16.001 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/target/target_core_iblock.ko 2023-10-06T01:04:16.002 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/target/target_core_mod.ko 2023-10-06T01:04:16.002 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/target/target_core_pscsi.ko 2023-10-06T01:04:16.002 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/target/target_core_user.ko 2023-10-06T01:04:16.002 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/target/tcm_fc 2023-10-06T01:04:16.002 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/target/tcm_fc/tcm_fc.ko 2023-10-06T01:04:16.002 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal 2023-10-06T01:04:16.002 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel 2023-10-06T01:04:16.002 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/int340x_thermal 2023-10-06T01:04:16.002 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2023-10-06T01:04:16.002 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2023-10-06T01:04:16.002 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2023-10-06T01:04:16.002 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2023-10-06T01:04:16.003 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2023-10-06T01:04:16.003 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2023-10-06T01:04:16.003 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2023-10-06T01:04:16.003 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2023-10-06T01:04:16.003 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2023-10-06T01:04:16.003 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2023-10-06T01:04:16.003 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2023-10-06T01:04:16.003 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2023-10-06T01:04:16.003 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2023-10-06T01:04:16.003 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2023-10-06T01:04:16.003 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2023-10-06T01:04:16.003 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/tty 2023-10-06T01:04:16.004 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/tty/ipwireless 2023-10-06T01:04:16.004 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/tty/ipwireless/ipwireless.ko 2023-10-06T01:04:16.004 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/tty/n_gsm.ko 2023-10-06T01:04:16.004 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/tty/n_hdlc.ko 2023-10-06T01:04:16.004 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/tty/nozomi.ko 2023-10-06T01:04:16.004 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/tty/serial 2023-10-06T01:04:16.004 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/tty/serial/8250 2023-10-06T01:04:16.004 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/tty/serial/8250/serial_cs.ko 2023-10-06T01:04:16.004 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/tty/serial/arc_uart.ko 2023-10-06T01:04:16.004 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/tty/serial/jsm 2023-10-06T01:04:16.004 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/tty/serial/jsm/jsm.ko 2023-10-06T01:04:16.004 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/tty/synclink_gt.ko 2023-10-06T01:04:16.005 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ufs 2023-10-06T01:04:16.005 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ufs/core 2023-10-06T01:04:16.005 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ufs/core/ufshcd-core.ko 2023-10-06T01:04:16.005 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ufs/host 2023-10-06T01:04:16.005 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ufs/host/ufshcd-pci.ko 2023-10-06T01:04:16.005 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/uio 2023-10-06T01:04:16.005 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/uio/uio.ko 2023-10-06T01:04:16.005 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/uio/uio_aec.ko 2023-10-06T01:04:16.005 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/uio/uio_cif.ko 2023-10-06T01:04:16.005 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/uio/uio_pci_generic.ko 2023-10-06T01:04:16.005 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/uio/uio_sercos3.ko 2023-10-06T01:04:16.005 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb 2023-10-06T01:04:16.006 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/class 2023-10-06T01:04:16.006 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/class/cdc-acm.ko 2023-10-06T01:04:16.006 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/class/cdc-wdm.ko 2023-10-06T01:04:16.006 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/class/usblp.ko 2023-10-06T01:04:16.006 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/class/usbtmc.ko 2023-10-06T01:04:16.006 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/host 2023-10-06T01:04:16.006 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/host/sl811-hcd.ko 2023-10-06T01:04:16.006 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/image 2023-10-06T01:04:16.006 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/image/mdc800.ko 2023-10-06T01:04:16.006 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/image/microtek.ko 2023-10-06T01:04:16.006 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc 2023-10-06T01:04:16.006 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/adutux.ko 2023-10-06T01:04:16.007 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/appledisplay.ko 2023-10-06T01:04:16.007 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/emi26.ko 2023-10-06T01:04:16.007 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/emi62.ko 2023-10-06T01:04:16.007 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/ezusb.ko 2023-10-06T01:04:16.007 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/idmouse.ko 2023-10-06T01:04:16.007 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/iowarrior.ko 2023-10-06T01:04:16.007 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/isight_firmware.ko 2023-10-06T01:04:16.007 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/ldusb.ko 2023-10-06T01:04:16.007 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/legousbtower.ko 2023-10-06T01:04:16.007 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/sisusbvga 2023-10-06T01:04:16.007 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2023-10-06T01:04:16.007 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/trancevibrator.ko 2023-10-06T01:04:16.008 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/usb3503.ko 2023-10-06T01:04:16.008 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/usblcd.ko 2023-10-06T01:04:16.008 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/usbsevseg.ko 2023-10-06T01:04:16.008 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/uss720.ko 2023-10-06T01:04:16.008 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/yurex.ko 2023-10-06T01:04:16.008 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/phy 2023-10-06T01:04:16.008 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/phy/phy-generic.ko 2023-10-06T01:04:16.008 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial 2023-10-06T01:04:16.008 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/aircable.ko 2023-10-06T01:04:16.008 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/ark3116.ko 2023-10-06T01:04:16.008 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/belkin_sa.ko 2023-10-06T01:04:16.008 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/ch341.ko 2023-10-06T01:04:16.009 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/cp210x.ko 2023-10-06T01:04:16.009 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/cyberjack.ko 2023-10-06T01:04:16.009 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/cypress_m8.ko 2023-10-06T01:04:16.009 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/digi_acceleport.ko 2023-10-06T01:04:16.009 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/empeg.ko 2023-10-06T01:04:16.009 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/ftdi_sio.ko 2023-10-06T01:04:16.009 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/garmin_gps.ko 2023-10-06T01:04:16.009 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/io_edgeport.ko 2023-10-06T01:04:16.009 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/io_ti.ko 2023-10-06T01:04:16.009 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/ipaq.ko 2023-10-06T01:04:16.009 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/ipw.ko 2023-10-06T01:04:16.009 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/ir-usb.ko 2023-10-06T01:04:16.010 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/iuu_phoenix.ko 2023-10-06T01:04:16.010 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/keyspan.ko 2023-10-06T01:04:16.010 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/keyspan_pda.ko 2023-10-06T01:04:16.010 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/kl5kusb105.ko 2023-10-06T01:04:16.010 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/kobil_sct.ko 2023-10-06T01:04:16.010 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/mct_u232.ko 2023-10-06T01:04:16.010 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/mos7720.ko 2023-10-06T01:04:16.010 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/mos7840.ko 2023-10-06T01:04:16.010 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/navman.ko 2023-10-06T01:04:16.010 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/omninet.ko 2023-10-06T01:04:16.010 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/opticon.ko 2023-10-06T01:04:16.010 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/option.ko 2023-10-06T01:04:16.011 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/oti6858.ko 2023-10-06T01:04:16.011 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/pl2303.ko 2023-10-06T01:04:16.011 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/qcaux.ko 2023-10-06T01:04:16.011 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/qcserial.ko 2023-10-06T01:04:16.011 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/quatech2.ko 2023-10-06T01:04:16.011 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/safe_serial.ko 2023-10-06T01:04:16.011 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/sierra.ko 2023-10-06T01:04:16.011 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/spcp8x5.ko 2023-10-06T01:04:16.011 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/ssu100.ko 2023-10-06T01:04:16.011 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/symbolserial.ko 2023-10-06T01:04:16.011 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2023-10-06T01:04:16.011 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/usb-serial-simple.ko 2023-10-06T01:04:16.011 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/usb_debug.ko 2023-10-06T01:04:16.012 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/usb_wwan.ko 2023-10-06T01:04:16.012 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/visor.ko 2023-10-06T01:04:16.012 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/whiteheat.ko 2023-10-06T01:04:16.012 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/xsens_mt.ko 2023-10-06T01:04:16.012 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage 2023-10-06T01:04:16.012 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/uas.ko 2023-10-06T01:04:16.012 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/ums-alauda.ko 2023-10-06T01:04:16.012 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/ums-cypress.ko 2023-10-06T01:04:16.012 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/ums-datafab.ko 2023-10-06T01:04:16.012 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/ums-eneub6250.ko 2023-10-06T01:04:16.012 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/ums-freecom.ko 2023-10-06T01:04:16.012 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/ums-isd200.ko 2023-10-06T01:04:16.013 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/ums-jumpshot.ko 2023-10-06T01:04:16.013 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/ums-karma.ko 2023-10-06T01:04:16.013 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/ums-onetouch.ko 2023-10-06T01:04:16.013 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/ums-realtek.ko 2023-10-06T01:04:16.013 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/ums-sddr09.ko 2023-10-06T01:04:16.013 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/ums-sddr55.ko 2023-10-06T01:04:16.013 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/ums-usbat.ko 2023-10-06T01:04:16.013 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/usb-storage.ko 2023-10-06T01:04:16.013 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/usbip 2023-10-06T01:04:16.013 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/usbip/usbip-core.ko 2023-10-06T01:04:16.013 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/usbip/usbip-host.ko 2023-10-06T01:04:16.013 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/usbip/vhci-hcd.ko 2023-10-06T01:04:16.014 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/vfio 2023-10-06T01:04:16.014 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/vfio/pci 2023-10-06T01:04:16.014 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/vfio/pci/vfio-pci-core.ko 2023-10-06T01:04:16.014 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/vfio/pci/vfio-pci.ko 2023-10-06T01:04:16.014 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/vfio/vfio.ko 2023-10-06T01:04:16.014 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/vfio/vfio_iommu_type1.ko 2023-10-06T01:04:16.014 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/vhost 2023-10-06T01:04:16.014 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/vhost/vhost.ko 2023-10-06T01:04:16.014 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/vhost/vhost_iotlb.ko 2023-10-06T01:04:16.014 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/vhost/vhost_net.ko 2023-10-06T01:04:16.014 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/vhost/vhost_scsi.ko 2023-10-06T01:04:16.014 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/video 2023-10-06T01:04:16.015 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/video/backlight 2023-10-06T01:04:16.015 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/video/backlight/apple_bl.ko 2023-10-06T01:04:16.015 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/video/backlight/lcd.ko 2023-10-06T01:04:16.015 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/video/backlight/platform_lcd.ko 2023-10-06T01:04:16.015 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/virtio 2023-10-06T01:04:16.015 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/virtio/virtio.ko 2023-10-06T01:04:16.015 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/virtio/virtio_balloon.ko 2023-10-06T01:04:16.015 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/virtio/virtio_mmio.ko 2023-10-06T01:04:16.015 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/virtio/virtio_pci.ko 2023-10-06T01:04:16.015 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/virtio/virtio_pci_legacy_dev.ko 2023-10-06T01:04:16.015 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/virtio/virtio_pci_modern_dev.ko 2023-10-06T01:04:16.015 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/virtio/virtio_ring.ko 2023-10-06T01:04:16.016 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1 2023-10-06T01:04:16.016 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/masters 2023-10-06T01:04:16.016 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/masters/ds2482.ko 2023-10-06T01:04:16.016 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/masters/ds2490.ko 2023-10-06T01:04:16.016 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/slaves 2023-10-06T01:04:16.016 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/slaves/w1_ds2406.ko 2023-10-06T01:04:16.016 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/slaves/w1_ds2408.ko 2023-10-06T01:04:16.016 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/slaves/w1_ds2413.ko 2023-10-06T01:04:16.016 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/slaves/w1_ds2423.ko 2023-10-06T01:04:16.016 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/slaves/w1_ds2431.ko 2023-10-06T01:04:16.016 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/slaves/w1_ds2433.ko 2023-10-06T01:04:16.016 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/slaves/w1_ds2780.ko 2023-10-06T01:04:16.017 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/slaves/w1_ds2781.ko 2023-10-06T01:04:16.017 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/slaves/w1_ds28e04.ko 2023-10-06T01:04:16.017 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/slaves/w1_smem.ko 2023-10-06T01:04:16.017 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/slaves/w1_therm.ko 2023-10-06T01:04:16.017 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/wire.ko 2023-10-06T01:04:16.017 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog 2023-10-06T01:04:16.017 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/alim1535_wdt.ko 2023-10-06T01:04:16.017 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/alim7101_wdt.ko 2023-10-06T01:04:16.017 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/f71808e_wdt.ko 2023-10-06T01:04:16.017 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/hpwdt.ko 2023-10-06T01:04:16.017 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/i6300esb.ko 2023-10-06T01:04:16.017 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/iTCO_vendor_support.ko 2023-10-06T01:04:16.018 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/iTCO_wdt.ko 2023-10-06T01:04:16.018 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/ib700wdt.ko 2023-10-06T01:04:16.018 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/ibmasr.ko 2023-10-06T01:04:16.018 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/ie6xx_wdt.ko 2023-10-06T01:04:16.018 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/it8712f_wdt.ko 2023-10-06T01:04:16.018 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/it87_wdt.ko 2023-10-06T01:04:16.018 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/machzwd.ko 2023-10-06T01:04:16.018 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/nv_tco.ko 2023-10-06T01:04:16.018 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/pcwd_pci.ko 2023-10-06T01:04:16.018 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/pcwd_usb.ko 2023-10-06T01:04:16.018 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2023-10-06T01:04:16.018 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/sch311x_wdt.ko 2023-10-06T01:04:16.019 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/softdog.ko 2023-10-06T01:04:16.019 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/sp5100_tco.ko 2023-10-06T01:04:16.019 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/via_wdt.ko 2023-10-06T01:04:16.019 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/w83627hf_wdt.ko 2023-10-06T01:04:16.019 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/w83877f_wdt.ko 2023-10-06T01:04:16.019 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/w83977f_wdt.ko 2023-10-06T01:04:16.019 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/wdt_pci.ko 2023-10-06T01:04:16.019 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/xen_wdt.ko 2023-10-06T01:04:16.019 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/xen 2023-10-06T01:04:16.019 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/xen/xen-acpi-processor.ko 2023-10-06T01:04:16.019 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/xen/xen-evtchn.ko 2023-10-06T01:04:16.019 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/xen/xen-gntalloc.ko 2023-10-06T01:04:16.019 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/xen/xen-gntdev.ko 2023-10-06T01:04:16.020 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/xen/xen-pciback 2023-10-06T01:04:16.020 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2023-10-06T01:04:16.020 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/xen/xen-privcmd.ko 2023-10-06T01:04:16.020 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/xen/xenfs 2023-10-06T01:04:16.020 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/xen/xenfs/xenfs.ko 2023-10-06T01:04:16.020 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs 2023-10-06T01:04:16.020 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/9p 2023-10-06T01:04:16.020 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/9p/9p.ko 2023-10-06T01:04:16.020 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/affs 2023-10-06T01:04:16.020 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/affs/affs.ko 2023-10-06T01:04:16.020 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/befs 2023-10-06T01:04:16.020 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/befs/befs.ko 2023-10-06T01:04:16.021 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/binfmt_misc.ko 2023-10-06T01:04:16.021 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/btrfs 2023-10-06T01:04:16.021 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/btrfs/btrfs.ko 2023-10-06T01:04:16.021 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/cachefiles 2023-10-06T01:04:16.021 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/cachefiles/cachefiles.ko 2023-10-06T01:04:16.021 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ceph 2023-10-06T01:04:16.021 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ceph/ceph.ko 2023-10-06T01:04:16.021 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/coda 2023-10-06T01:04:16.021 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/coda/coda.ko 2023-10-06T01:04:16.021 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/cramfs 2023-10-06T01:04:16.021 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/cramfs/cramfs.ko 2023-10-06T01:04:16.021 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/dlm 2023-10-06T01:04:16.022 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/dlm/dlm.ko 2023-10-06T01:04:16.022 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ecryptfs 2023-10-06T01:04:16.022 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ecryptfs/ecryptfs.ko 2023-10-06T01:04:16.022 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/f2fs 2023-10-06T01:04:16.022 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/f2fs/f2fs.ko 2023-10-06T01:04:16.022 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/fat 2023-10-06T01:04:16.022 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/fat/fat.ko 2023-10-06T01:04:16.022 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/fat/msdos.ko 2023-10-06T01:04:16.022 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/fat/vfat.ko 2023-10-06T01:04:16.022 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/fscache 2023-10-06T01:04:16.022 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/fscache/fscache.ko 2023-10-06T01:04:16.022 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/fuse 2023-10-06T01:04:16.023 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/fuse/cuse.ko 2023-10-06T01:04:16.023 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/fuse/fuse.ko 2023-10-06T01:04:16.023 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/gfs2 2023-10-06T01:04:16.023 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/gfs2/gfs2.ko 2023-10-06T01:04:16.023 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/hfs 2023-10-06T01:04:16.023 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/hfs/hfs.ko 2023-10-06T01:04:16.023 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/hfsplus 2023-10-06T01:04:16.023 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/hfsplus/hfsplus.ko 2023-10-06T01:04:16.023 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/isofs 2023-10-06T01:04:16.023 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/isofs/isofs.ko 2023-10-06T01:04:16.023 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/jfs 2023-10-06T01:04:16.023 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/jfs/jfs.ko 2023-10-06T01:04:16.024 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/lockd 2023-10-06T01:04:16.024 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/lockd/lockd.ko 2023-10-06T01:04:16.024 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/minix 2023-10-06T01:04:16.024 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/minix/minix.ko 2023-10-06T01:04:16.024 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/netfs 2023-10-06T01:04:16.024 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/netfs/netfs.ko 2023-10-06T01:04:16.024 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfs 2023-10-06T01:04:16.024 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfs/blocklayout 2023-10-06T01:04:16.024 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2023-10-06T01:04:16.024 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfs/filelayout 2023-10-06T01:04:16.024 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2023-10-06T01:04:16.024 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfs/flexfilelayout 2023-10-06T01:04:16.025 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2023-10-06T01:04:16.025 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfs/nfs.ko 2023-10-06T01:04:16.025 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfs/nfsv3.ko 2023-10-06T01:04:16.025 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfs/nfsv4.ko 2023-10-06T01:04:16.025 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfs_common 2023-10-06T01:04:16.025 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfs_common/grace.ko 2023-10-06T01:04:16.025 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfs_common/nfs_acl.ko 2023-10-06T01:04:16.025 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfsd 2023-10-06T01:04:16.025 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfsd/nfsd.ko 2023-10-06T01:04:16.025 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nilfs2 2023-10-06T01:04:16.025 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nilfs2/nilfs2.ko 2023-10-06T01:04:16.025 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls 2023-10-06T01:04:16.026 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/mac-celtic.ko 2023-10-06T01:04:16.026 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/mac-centeuro.ko 2023-10-06T01:04:16.026 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/mac-croatian.ko 2023-10-06T01:04:16.026 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/mac-cyrillic.ko 2023-10-06T01:04:16.026 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/mac-gaelic.ko 2023-10-06T01:04:16.026 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/mac-greek.ko 2023-10-06T01:04:16.026 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/mac-iceland.ko 2023-10-06T01:04:16.026 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/mac-inuit.ko 2023-10-06T01:04:16.026 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/mac-roman.ko 2023-10-06T01:04:16.026 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/mac-romanian.ko 2023-10-06T01:04:16.026 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/mac-turkish.ko 2023-10-06T01:04:16.026 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp1250.ko 2023-10-06T01:04:16.027 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp1251.ko 2023-10-06T01:04:16.027 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp1255.ko 2023-10-06T01:04:16.027 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp737.ko 2023-10-06T01:04:16.027 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp775.ko 2023-10-06T01:04:16.027 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp850.ko 2023-10-06T01:04:16.027 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp852.ko 2023-10-06T01:04:16.027 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp855.ko 2023-10-06T01:04:16.027 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp857.ko 2023-10-06T01:04:16.027 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp860.ko 2023-10-06T01:04:16.027 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp861.ko 2023-10-06T01:04:16.027 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp862.ko 2023-10-06T01:04:16.027 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp863.ko 2023-10-06T01:04:16.027 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp864.ko 2023-10-06T01:04:16.028 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp865.ko 2023-10-06T01:04:16.028 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp866.ko 2023-10-06T01:04:16.028 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp869.ko 2023-10-06T01:04:16.028 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp874.ko 2023-10-06T01:04:16.028 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp932.ko 2023-10-06T01:04:16.028 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp936.ko 2023-10-06T01:04:16.028 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp949.ko 2023-10-06T01:04:16.028 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp950.ko 2023-10-06T01:04:16.028 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_euc-jp.ko 2023-10-06T01:04:16.028 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_iso8859-1.ko 2023-10-06T01:04:16.028 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_iso8859-13.ko 2023-10-06T01:04:16.028 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_iso8859-14.ko 2023-10-06T01:04:16.029 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_iso8859-15.ko 2023-10-06T01:04:16.029 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_iso8859-2.ko 2023-10-06T01:04:16.029 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_iso8859-3.ko 2023-10-06T01:04:16.029 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_iso8859-4.ko 2023-10-06T01:04:16.029 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_iso8859-5.ko 2023-10-06T01:04:16.029 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_iso8859-6.ko 2023-10-06T01:04:16.029 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_iso8859-7.ko 2023-10-06T01:04:16.029 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_iso8859-9.ko 2023-10-06T01:04:16.029 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_koi8-r.ko 2023-10-06T01:04:16.029 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_koi8-ru.ko 2023-10-06T01:04:16.029 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_koi8-u.ko 2023-10-06T01:04:16.029 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_utf8.ko 2023-10-06T01:04:16.030 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ocfs2 2023-10-06T01:04:16.030 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ocfs2/cluster 2023-10-06T01:04:16.030 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2023-10-06T01:04:16.030 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ocfs2/dlm 2023-10-06T01:04:16.030 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2023-10-06T01:04:16.030 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ocfs2/dlmfs 2023-10-06T01:04:16.030 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2023-10-06T01:04:16.030 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ocfs2/ocfs2.ko 2023-10-06T01:04:16.030 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2023-10-06T01:04:16.030 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ocfs2/ocfs2_stack_user.ko 2023-10-06T01:04:16.030 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ocfs2/ocfs2_stackglue.ko 2023-10-06T01:04:16.030 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/overlayfs 2023-10-06T01:04:16.031 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/overlayfs/overlay.ko 2023-10-06T01:04:16.031 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/pstore 2023-10-06T01:04:16.031 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/pstore/ramoops.ko 2023-10-06T01:04:16.031 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/reiserfs 2023-10-06T01:04:16.031 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/reiserfs/reiserfs.ko 2023-10-06T01:04:16.031 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/romfs 2023-10-06T01:04:16.031 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/romfs/romfs.ko 2023-10-06T01:04:16.031 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/smb 2023-10-06T01:04:16.031 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/smb/client 2023-10-06T01:04:16.031 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/smb/client/cifs.ko 2023-10-06T01:04:16.031 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/smb/common 2023-10-06T01:04:16.031 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/smb/common/cifs_arc4.ko 2023-10-06T01:04:16.032 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/smb/common/cifs_md4.ko 2023-10-06T01:04:16.032 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/squashfs 2023-10-06T01:04:16.032 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/squashfs/squashfs.ko 2023-10-06T01:04:16.032 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/sysv 2023-10-06T01:04:16.032 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/sysv/sysv.ko 2023-10-06T01:04:16.032 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/udf 2023-10-06T01:04:16.032 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/udf/udf.ko 2023-10-06T01:04:16.032 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ufs 2023-10-06T01:04:16.032 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ufs/ufs.ko 2023-10-06T01:04:16.032 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/xfs 2023-10-06T01:04:16.032 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/xfs/xfs.ko 2023-10-06T01:04:16.032 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/kernel 2023-10-06T01:04:16.033 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/kernel/rcu 2023-10-06T01:04:16.033 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/kernel/rcu/rcutorture.ko 2023-10-06T01:04:16.033 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/kernel/torture.ko 2023-10-06T01:04:16.033 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/kernel/trace 2023-10-06T01:04:16.033 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/kernel/trace/ring_buffer_benchmark.ko 2023-10-06T01:04:16.033 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib 2023-10-06T01:04:16.033 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/asn1_encoder.ko 2023-10-06T01:04:16.033 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/crc-itu-t.ko 2023-10-06T01:04:16.033 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/crc8.ko 2023-10-06T01:04:16.033 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/crypto 2023-10-06T01:04:16.033 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/crypto/libarc4.ko 2023-10-06T01:04:16.033 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/crypto/libdes.ko 2023-10-06T01:04:16.034 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/libcrc32c.ko 2023-10-06T01:04:16.034 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/lru_cache.ko 2023-10-06T01:04:16.034 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/lz4 2023-10-06T01:04:16.034 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/lz4/lz4_compress.ko 2023-10-06T01:04:16.034 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/lz4/lz4hc_compress.ko 2023-10-06T01:04:16.034 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/math 2023-10-06T01:04:16.034 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/math/cordic.ko 2023-10-06T01:04:16.034 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/raid6 2023-10-06T01:04:16.034 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/raid6/raid6_pq.ko 2023-10-06T01:04:16.034 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/reed_solomon 2023-10-06T01:04:16.034 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/reed_solomon/reed_solomon.ko 2023-10-06T01:04:16.034 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/ts_bm.ko 2023-10-06T01:04:16.035 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/ts_fsm.ko 2023-10-06T01:04:16.035 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/ts_kmp.ko 2023-10-06T01:04:16.035 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/zstd 2023-10-06T01:04:16.035 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/zstd/zstd_compress.ko 2023-10-06T01:04:16.035 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/mm 2023-10-06T01:04:16.035 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/mm/hwpoison-inject.ko 2023-10-06T01:04:16.035 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net 2023-10-06T01:04:16.035 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/6lowpan 2023-10-06T01:04:16.035 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/6lowpan/6lowpan.ko 2023-10-06T01:04:16.035 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/6lowpan/nhc_dest.ko 2023-10-06T01:04:16.035 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/6lowpan/nhc_fragment.ko 2023-10-06T01:04:16.035 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/6lowpan/nhc_hop.ko 2023-10-06T01:04:16.036 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/6lowpan/nhc_ipv6.ko 2023-10-06T01:04:16.036 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/6lowpan/nhc_mobility.ko 2023-10-06T01:04:16.036 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/6lowpan/nhc_routing.ko 2023-10-06T01:04:16.036 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/6lowpan/nhc_udp.ko 2023-10-06T01:04:16.036 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/802 2023-10-06T01:04:16.036 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/802/garp.ko 2023-10-06T01:04:16.036 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/802/mrp.ko 2023-10-06T01:04:16.036 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/802/p8022.ko 2023-10-06T01:04:16.036 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/802/psnap.ko 2023-10-06T01:04:16.036 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/802/stp.ko 2023-10-06T01:04:16.036 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/8021q 2023-10-06T01:04:16.036 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/8021q/8021q.ko 2023-10-06T01:04:16.037 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/9p 2023-10-06T01:04:16.037 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/9p/9pnet.ko 2023-10-06T01:04:16.037 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/9p/9pnet_fd.ko 2023-10-06T01:04:16.037 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/9p/9pnet_rdma.ko 2023-10-06T01:04:16.037 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/9p/9pnet_virtio.ko 2023-10-06T01:04:16.037 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/batman-adv 2023-10-06T01:04:16.037 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/batman-adv/batman-adv.ko 2023-10-06T01:04:16.037 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge 2023-10-06T01:04:16.037 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/br_netfilter.ko 2023-10-06T01:04:16.037 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/bridge.ko 2023-10-06T01:04:16.037 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter 2023-10-06T01:04:16.037 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_802_3.ko 2023-10-06T01:04:16.037 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_among.ko 2023-10-06T01:04:16.038 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_arp.ko 2023-10-06T01:04:16.038 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_arpreply.ko 2023-10-06T01:04:16.038 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_dnat.ko 2023-10-06T01:04:16.038 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_ip.ko 2023-10-06T01:04:16.038 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_ip6.ko 2023-10-06T01:04:16.038 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_limit.ko 2023-10-06T01:04:16.038 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_log.ko 2023-10-06T01:04:16.038 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_mark.ko 2023-10-06T01:04:16.038 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_mark_m.ko 2023-10-06T01:04:16.038 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_nflog.ko 2023-10-06T01:04:16.038 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_pkttype.ko 2023-10-06T01:04:16.038 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_redirect.ko 2023-10-06T01:04:16.039 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_snat.ko 2023-10-06T01:04:16.039 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_stp.ko 2023-10-06T01:04:16.039 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_vlan.ko 2023-10-06T01:04:16.039 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebtable_broute.ko 2023-10-06T01:04:16.039 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebtable_filter.ko 2023-10-06T01:04:16.039 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebtable_nat.ko 2023-10-06T01:04:16.039 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebtables.ko 2023-10-06T01:04:16.039 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/nf_conntrack_bridge.ko 2023-10-06T01:04:16.039 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2023-10-06T01:04:16.039 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2023-10-06T01:04:16.039 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ceph 2023-10-06T01:04:16.039 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ceph/libceph.ko 2023-10-06T01:04:16.040 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/core 2023-10-06T01:04:16.040 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/core/failover.ko 2023-10-06T01:04:16.040 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/core/pktgen.ko 2023-10-06T01:04:16.040 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/dccp 2023-10-06T01:04:16.040 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/dccp/dccp.ko 2023-10-06T01:04:16.040 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/dccp/dccp_diag.ko 2023-10-06T01:04:16.040 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/dccp/dccp_ipv4.ko 2023-10-06T01:04:16.040 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/dccp/dccp_ipv6.ko 2023-10-06T01:04:16.040 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/dns_resolver 2023-10-06T01:04:16.040 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/dns_resolver/dns_resolver.ko 2023-10-06T01:04:16.040 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/dsa 2023-10-06T01:04:16.040 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/dsa/dsa_core.ko 2023-10-06T01:04:16.041 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/dsa/tag_brcm.ko 2023-10-06T01:04:16.041 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/dsa/tag_dsa.ko 2023-10-06T01:04:16.041 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/dsa/tag_none.ko 2023-10-06T01:04:16.041 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/dsa/tag_trailer.ko 2023-10-06T01:04:16.041 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ieee802154 2023-10-06T01:04:16.041 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ieee802154/6lowpan 2023-10-06T01:04:16.041 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2023-10-06T01:04:16.041 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ieee802154/ieee802154.ko 2023-10-06T01:04:16.041 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ieee802154/ieee802154_socket.ko 2023-10-06T01:04:16.041 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4 2023-10-06T01:04:16.041 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/ah4.ko 2023-10-06T01:04:16.041 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/esp4.ko 2023-10-06T01:04:16.042 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/fou.ko 2023-10-06T01:04:16.042 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/gre.ko 2023-10-06T01:04:16.042 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/inet_diag.ko 2023-10-06T01:04:16.042 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/ip_gre.ko 2023-10-06T01:04:16.042 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/ip_tunnel.ko 2023-10-06T01:04:16.042 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/ip_vti.ko 2023-10-06T01:04:16.042 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/ipcomp.ko 2023-10-06T01:04:16.042 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/ipip.ko 2023-10-06T01:04:16.042 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter 2023-10-06T01:04:16.042 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/arp_tables.ko 2023-10-06T01:04:16.042 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/arpt_mangle.ko 2023-10-06T01:04:16.042 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/arptable_filter.ko 2023-10-06T01:04:16.043 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/ipt_ECN.ko 2023-10-06T01:04:16.043 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2023-10-06T01:04:16.043 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/ipt_ah.ko 2023-10-06T01:04:16.043 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2023-10-06T01:04:16.043 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/iptable_mangle.ko 2023-10-06T01:04:16.043 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/iptable_nat.ko 2023-10-06T01:04:16.043 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/iptable_raw.ko 2023-10-06T01:04:16.043 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/iptable_security.ko 2023-10-06T01:04:16.043 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2023-10-06T01:04:16.043 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2023-10-06T01:04:16.043 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2023-10-06T01:04:16.043 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2023-10-06T01:04:16.044 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2023-10-06T01:04:16.044 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2023-10-06T01:04:16.044 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2023-10-06T01:04:16.044 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2023-10-06T01:04:16.044 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2023-10-06T01:04:16.044 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2023-10-06T01:04:16.044 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/tcp_bic.ko 2023-10-06T01:04:16.044 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/tcp_dctcp.ko 2023-10-06T01:04:16.044 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/tcp_diag.ko 2023-10-06T01:04:16.044 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/tcp_highspeed.ko 2023-10-06T01:04:16.044 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/tcp_htcp.ko 2023-10-06T01:04:16.044 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/tcp_hybla.ko 2023-10-06T01:04:16.045 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/tcp_illinois.ko 2023-10-06T01:04:16.045 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/tcp_lp.ko 2023-10-06T01:04:16.045 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/tcp_scalable.ko 2023-10-06T01:04:16.045 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/tcp_vegas.ko 2023-10-06T01:04:16.045 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/tcp_veno.ko 2023-10-06T01:04:16.045 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/tcp_westwood.ko 2023-10-06T01:04:16.045 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/tcp_yeah.ko 2023-10-06T01:04:16.045 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/tunnel4.ko 2023-10-06T01:04:16.045 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/udp_diag.ko 2023-10-06T01:04:16.045 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/udp_tunnel.ko 2023-10-06T01:04:16.045 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/xfrm4_tunnel.ko 2023-10-06T01:04:16.045 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6 2023-10-06T01:04:16.045 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/ah6.ko 2023-10-06T01:04:16.046 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/esp6.ko 2023-10-06T01:04:16.046 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/fou6.ko 2023-10-06T01:04:16.046 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/ip6_tunnel.ko 2023-10-06T01:04:16.046 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/ip6_udp_tunnel.ko 2023-10-06T01:04:16.046 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/ip6_vti.ko 2023-10-06T01:04:16.046 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/ipcomp6.ko 2023-10-06T01:04:16.046 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter 2023-10-06T01:04:16.046 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6_tables.ko 2023-10-06T01:04:16.046 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2023-10-06T01:04:16.046 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2023-10-06T01:04:16.046 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6t_ah.ko 2023-10-06T01:04:16.047 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2023-10-06T01:04:16.047 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6t_frag.ko 2023-10-06T01:04:16.047 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2023-10-06T01:04:16.047 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2023-10-06T01:04:16.047 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6t_mh.ko 2023-10-06T01:04:16.047 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2023-10-06T01:04:16.047 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6t_rt.ko 2023-10-06T01:04:16.047 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6table_filter.ko 2023-10-06T01:04:16.047 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2023-10-06T01:04:16.047 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6table_nat.ko 2023-10-06T01:04:16.047 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6table_raw.ko 2023-10-06T01:04:16.047 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6table_security.ko 2023-10-06T01:04:16.048 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2023-10-06T01:04:16.048 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2023-10-06T01:04:16.048 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2023-10-06T01:04:16.048 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2023-10-06T01:04:16.048 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2023-10-06T01:04:16.048 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2023-10-06T01:04:16.048 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2023-10-06T01:04:16.048 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2023-10-06T01:04:16.048 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/sit.ko 2023-10-06T01:04:16.048 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/tunnel6.ko 2023-10-06T01:04:16.048 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/xfrm6_tunnel.ko 2023-10-06T01:04:16.048 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/key 2023-10-06T01:04:16.049 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/key/af_key.ko 2023-10-06T01:04:16.049 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/l2tp 2023-10-06T01:04:16.049 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/l2tp/l2tp_core.ko 2023-10-06T01:04:16.049 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/l2tp/l2tp_debugfs.ko 2023-10-06T01:04:16.049 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/l2tp/l2tp_eth.ko 2023-10-06T01:04:16.049 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/l2tp/l2tp_ip.ko 2023-10-06T01:04:16.049 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/l2tp/l2tp_ip6.ko 2023-10-06T01:04:16.049 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/l2tp/l2tp_netlink.ko 2023-10-06T01:04:16.049 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/l2tp/l2tp_ppp.ko 2023-10-06T01:04:16.049 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/llc 2023-10-06T01:04:16.049 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/llc/llc.ko 2023-10-06T01:04:16.049 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/mac802154 2023-10-06T01:04:16.050 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/mac802154/mac802154.ko 2023-10-06T01:04:16.050 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/mpls 2023-10-06T01:04:16.050 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/mpls/mpls_gso.ko 2023-10-06T01:04:16.050 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter 2023-10-06T01:04:16.050 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset 2023-10-06T01:04:16.050 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set.ko 2023-10-06T01:04:16.050 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2023-10-06T01:04:16.050 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2023-10-06T01:04:16.050 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2023-10-06T01:04:16.050 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2023-10-06T01:04:16.050 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2023-10-06T01:04:16.050 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2023-10-06T01:04:16.051 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2023-10-06T01:04:16.051 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2023-10-06T01:04:16.051 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2023-10-06T01:04:16.051 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2023-10-06T01:04:16.051 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2023-10-06T01:04:16.051 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2023-10-06T01:04:16.051 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2023-10-06T01:04:16.051 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2023-10-06T01:04:16.051 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_list_set.ko 2023-10-06T01:04:16.051 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs 2023-10-06T01:04:16.051 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs/ip_vs.ko 2023-10-06T01:04:16.051 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2023-10-06T01:04:16.051 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2023-10-06T01:04:16.052 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2023-10-06T01:04:16.052 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2023-10-06T01:04:16.052 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2023-10-06T01:04:16.052 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2023-10-06T01:04:16.052 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2023-10-06T01:04:16.052 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2023-10-06T01:04:16.052 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2023-10-06T01:04:16.052 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2023-10-06T01:04:16.052 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2023-10-06T01:04:16.052 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2023-10-06T01:04:16.052 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2023-10-06T01:04:16.052 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_conncount.ko 2023-10-06T01:04:16.053 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_conntrack.ko 2023-10-06T01:04:16.053 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_conntrack_amanda.ko 2023-10-06T01:04:16.053 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_conntrack_broadcast.ko 2023-10-06T01:04:16.053 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_conntrack_ftp.ko 2023-10-06T01:04:16.053 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_conntrack_h323.ko 2023-10-06T01:04:16.053 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_conntrack_irc.ko 2023-10-06T01:04:16.053 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2023-10-06T01:04:16.053 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_conntrack_netlink.ko 2023-10-06T01:04:16.053 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_conntrack_pptp.ko 2023-10-06T01:04:16.053 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_conntrack_sane.ko 2023-10-06T01:04:16.053 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_conntrack_sip.ko 2023-10-06T01:04:16.053 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_conntrack_snmp.ko 2023-10-06T01:04:16.054 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_conntrack_tftp.ko 2023-10-06T01:04:16.054 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_dup_netdev.ko 2023-10-06T01:04:16.054 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_flow_table.ko 2023-10-06T01:04:16.054 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_flow_table_inet.ko 2023-10-06T01:04:16.054 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_log_syslog.ko 2023-10-06T01:04:16.054 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_nat.ko 2023-10-06T01:04:16.054 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_nat_amanda.ko 2023-10-06T01:04:16.054 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_nat_ftp.ko 2023-10-06T01:04:16.054 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_nat_irc.ko 2023-10-06T01:04:16.054 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_nat_sip.ko 2023-10-06T01:04:16.054 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_nat_tftp.ko 2023-10-06T01:04:16.054 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_synproxy_core.ko 2023-10-06T01:04:16.055 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_tables.ko 2023-10-06T01:04:16.055 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nfnetlink.ko 2023-10-06T01:04:16.055 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nfnetlink_acct.ko 2023-10-06T01:04:16.055 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nfnetlink_log.ko 2023-10-06T01:04:16.055 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nfnetlink_osf.ko 2023-10-06T01:04:16.055 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nfnetlink_queue.ko 2023-10-06T01:04:16.055 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_chain_nat.ko 2023-10-06T01:04:16.055 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_compat.ko 2023-10-06T01:04:16.055 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_ct.ko 2023-10-06T01:04:16.055 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_dup_netdev.ko 2023-10-06T01:04:16.055 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_fib.ko 2023-10-06T01:04:16.055 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_fwd_netdev.ko 2023-10-06T01:04:16.056 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_hash.ko 2023-10-06T01:04:16.056 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_limit.ko 2023-10-06T01:04:16.056 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_log.ko 2023-10-06T01:04:16.056 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_masq.ko 2023-10-06T01:04:16.056 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_nat.ko 2023-10-06T01:04:16.056 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_numgen.ko 2023-10-06T01:04:16.056 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_queue.ko 2023-10-06T01:04:16.056 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_quota.ko 2023-10-06T01:04:16.056 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_redir.ko 2023-10-06T01:04:16.056 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_reject.ko 2023-10-06T01:04:16.056 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_reject_inet.ko 2023-10-06T01:04:16.056 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_socket.ko 2023-10-06T01:04:16.057 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_tunnel.ko 2023-10-06T01:04:16.057 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_AUDIT.ko 2023-10-06T01:04:16.057 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_CHECKSUM.ko 2023-10-06T01:04:16.057 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_CLASSIFY.ko 2023-10-06T01:04:16.057 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_CONNSECMARK.ko 2023-10-06T01:04:16.057 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_CT.ko 2023-10-06T01:04:16.057 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_DSCP.ko 2023-10-06T01:04:16.057 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_HL.ko 2023-10-06T01:04:16.057 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_HMARK.ko 2023-10-06T01:04:16.057 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_IDLETIMER.ko 2023-10-06T01:04:16.057 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_LED.ko 2023-10-06T01:04:16.057 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_LOG.ko 2023-10-06T01:04:16.058 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_MASQUERADE.ko 2023-10-06T01:04:16.058 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_NETMAP.ko 2023-10-06T01:04:16.058 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_NFLOG.ko 2023-10-06T01:04:16.058 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_NFQUEUE.ko 2023-10-06T01:04:16.058 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_RATEEST.ko 2023-10-06T01:04:16.058 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_REDIRECT.ko 2023-10-06T01:04:16.058 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_SECMARK.ko 2023-10-06T01:04:16.058 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_TCPMSS.ko 2023-10-06T01:04:16.058 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2023-10-06T01:04:16.058 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_TEE.ko 2023-10-06T01:04:16.058 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_TPROXY.ko 2023-10-06T01:04:16.058 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_TRACE.ko 2023-10-06T01:04:16.059 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_addrtype.ko 2023-10-06T01:04:16.059 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_bpf.ko 2023-10-06T01:04:16.059 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_cgroup.ko 2023-10-06T01:04:16.059 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_cluster.ko 2023-10-06T01:04:16.059 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_comment.ko 2023-10-06T01:04:16.059 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_connbytes.ko 2023-10-06T01:04:16.059 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_connlabel.ko 2023-10-06T01:04:16.059 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_connlimit.ko 2023-10-06T01:04:16.059 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_connmark.ko 2023-10-06T01:04:16.059 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_conntrack.ko 2023-10-06T01:04:16.059 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_cpu.ko 2023-10-06T01:04:16.059 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_dccp.ko 2023-10-06T01:04:16.060 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_devgroup.ko 2023-10-06T01:04:16.060 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_dscp.ko 2023-10-06T01:04:16.060 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_ecn.ko 2023-10-06T01:04:16.060 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_esp.ko 2023-10-06T01:04:16.060 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_hashlimit.ko 2023-10-06T01:04:16.060 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_helper.ko 2023-10-06T01:04:16.060 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_hl.ko 2023-10-06T01:04:16.060 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_ipcomp.ko 2023-10-06T01:04:16.060 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_iprange.ko 2023-10-06T01:04:16.060 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_ipvs.ko 2023-10-06T01:04:16.060 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_l2tp.ko 2023-10-06T01:04:16.060 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_length.ko 2023-10-06T01:04:16.061 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_limit.ko 2023-10-06T01:04:16.061 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_mac.ko 2023-10-06T01:04:16.061 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_mark.ko 2023-10-06T01:04:16.061 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_multiport.ko 2023-10-06T01:04:16.061 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_nat.ko 2023-10-06T01:04:16.061 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_nfacct.ko 2023-10-06T01:04:16.061 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_osf.ko 2023-10-06T01:04:16.061 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_owner.ko 2023-10-06T01:04:16.061 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_physdev.ko 2023-10-06T01:04:16.061 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_pkttype.ko 2023-10-06T01:04:16.061 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_policy.ko 2023-10-06T01:04:16.061 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_quota.ko 2023-10-06T01:04:16.061 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_rateest.ko 2023-10-06T01:04:16.062 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_realm.ko 2023-10-06T01:04:16.062 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_recent.ko 2023-10-06T01:04:16.062 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_sctp.ko 2023-10-06T01:04:16.062 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_set.ko 2023-10-06T01:04:16.062 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_socket.ko 2023-10-06T01:04:16.062 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_state.ko 2023-10-06T01:04:16.062 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_statistic.ko 2023-10-06T01:04:16.062 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_string.ko 2023-10-06T01:04:16.062 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_tcpmss.ko 2023-10-06T01:04:16.062 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_time.ko 2023-10-06T01:04:16.062 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_u32.ko 2023-10-06T01:04:16.063 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netlink 2023-10-06T01:04:16.063 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netlink/netlink_diag.ko 2023-10-06T01:04:16.063 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/nsh 2023-10-06T01:04:16.063 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/nsh/nsh.ko 2023-10-06T01:04:16.063 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/openvswitch 2023-10-06T01:04:16.063 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/openvswitch/openvswitch.ko 2023-10-06T01:04:16.063 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/openvswitch/vport-geneve.ko 2023-10-06T01:04:16.063 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/openvswitch/vport-gre.ko 2023-10-06T01:04:16.063 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/openvswitch/vport-vxlan.ko 2023-10-06T01:04:16.063 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/packet 2023-10-06T01:04:16.063 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/packet/af_packet_diag.ko 2023-10-06T01:04:16.063 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/rds 2023-10-06T01:04:16.063 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/rds/rds.ko 2023-10-06T01:04:16.064 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/rds/rds_rdma.ko 2023-10-06T01:04:16.064 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/rds/rds_tcp.ko 2023-10-06T01:04:16.064 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched 2023-10-06T01:04:16.064 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/act_csum.ko 2023-10-06T01:04:16.064 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/act_gact.ko 2023-10-06T01:04:16.064 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/act_ipt.ko 2023-10-06T01:04:16.064 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/act_mirred.ko 2023-10-06T01:04:16.064 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/act_nat.ko 2023-10-06T01:04:16.064 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/act_pedit.ko 2023-10-06T01:04:16.064 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/act_police.ko 2023-10-06T01:04:16.064 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/act_simple.ko 2023-10-06T01:04:16.064 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/act_skbedit.ko 2023-10-06T01:04:16.065 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/act_vlan.ko 2023-10-06T01:04:16.065 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/cls_basic.ko 2023-10-06T01:04:16.065 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/cls_bpf.ko 2023-10-06T01:04:16.065 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/cls_flow.ko 2023-10-06T01:04:16.065 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/cls_fw.ko 2023-10-06T01:04:16.065 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/cls_route.ko 2023-10-06T01:04:16.065 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/cls_u32.ko 2023-10-06T01:04:16.065 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/em_cmp.ko 2023-10-06T01:04:16.065 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/em_ipset.ko 2023-10-06T01:04:16.065 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/em_meta.ko 2023-10-06T01:04:16.065 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/em_nbyte.ko 2023-10-06T01:04:16.065 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/em_text.ko 2023-10-06T01:04:16.066 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/em_u32.ko 2023-10-06T01:04:16.066 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_choke.ko 2023-10-06T01:04:16.066 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_codel.ko 2023-10-06T01:04:16.066 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_drr.ko 2023-10-06T01:04:16.066 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_fq.ko 2023-10-06T01:04:16.066 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_gred.ko 2023-10-06T01:04:16.066 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_hfsc.ko 2023-10-06T01:04:16.066 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_hhf.ko 2023-10-06T01:04:16.066 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_htb.ko 2023-10-06T01:04:16.066 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_ingress.ko 2023-10-06T01:04:16.066 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_mqprio.ko 2023-10-06T01:04:16.066 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_mqprio_lib.ko 2023-10-06T01:04:16.067 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_multiq.ko 2023-10-06T01:04:16.067 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_netem.ko 2023-10-06T01:04:16.067 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_pie.ko 2023-10-06T01:04:16.067 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_plug.ko 2023-10-06T01:04:16.067 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_prio.ko 2023-10-06T01:04:16.067 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_qfq.ko 2023-10-06T01:04:16.067 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_red.ko 2023-10-06T01:04:16.067 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_sfb.ko 2023-10-06T01:04:16.067 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_sfq.ko 2023-10-06T01:04:16.067 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_tbf.ko 2023-10-06T01:04:16.067 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_teql.ko 2023-10-06T01:04:16.067 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sctp 2023-10-06T01:04:16.068 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sctp/sctp.ko 2023-10-06T01:04:16.068 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sctp/sctp_diag.ko 2023-10-06T01:04:16.068 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sunrpc 2023-10-06T01:04:16.068 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sunrpc/auth_gss 2023-10-06T01:04:16.068 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2023-10-06T01:04:16.068 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2023-10-06T01:04:16.068 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sunrpc/sunrpc.ko 2023-10-06T01:04:16.068 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sunrpc/xprtrdma 2023-10-06T01:04:16.068 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2023-10-06T01:04:16.068 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/tipc 2023-10-06T01:04:16.068 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/tipc/diag.ko 2023-10-06T01:04:16.068 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/tipc/tipc.ko 2023-10-06T01:04:16.069 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/unix 2023-10-06T01:04:16.069 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/unix/unix_diag.ko 2023-10-06T01:04:16.069 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/vmw_vsock 2023-10-06T01:04:16.069 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2023-10-06T01:04:16.069 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2023-10-06T01:04:16.069 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/vmw_vsock/vsock.ko 2023-10-06T01:04:16.069 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/vmw_vsock/vsock_diag.ko 2023-10-06T01:04:16.069 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/vmw_vsock/vsock_loopback.ko 2023-10-06T01:04:16.069 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/xfrm 2023-10-06T01:04:16.069 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/xfrm/xfrm_ipcomp.ko 2023-10-06T01:04:16.069 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/security 2023-10-06T01:04:16.069 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/security/keys 2023-10-06T01:04:16.070 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/security/keys/encrypted-keys 2023-10-06T01:04:16.070 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/security/keys/encrypted-keys/encrypted-keys.ko 2023-10-06T01:04:16.070 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/security/keys/trusted-keys 2023-10-06T01:04:16.070 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/security/keys/trusted-keys/trusted.ko 2023-10-06T01:04:16.070 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/virt 2023-10-06T01:04:16.070 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/virt/lib 2023-10-06T01:04:16.070 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/virt/lib/irqbypass.ko 2023-10-06T01:04:16.070 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/modules.alias 2023-10-06T01:04:16.070 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/modules.alias.bin 2023-10-06T01:04:16.070 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/modules.builtin 2023-10-06T01:04:16.070 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/modules.builtin.bin 2023-10-06T01:04:16.070 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/modules.builtin.modinfo 2023-10-06T01:04:16.070 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/modules.dep 2023-10-06T01:04:16.071 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/modules.dep.bin 2023-10-06T01:04:16.071 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/modules.devname 2023-10-06T01:04:16.071 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/modules.order 2023-10-06T01:04:16.071 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/modules.softdep 2023-10-06T01:04:16.071 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/modules.symbols 2023-10-06T01:04:16.071 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/modules.symbols.bin 2023-10-06T01:04:16.071 DEBUG:teuthology.task.kernel:get_image_version: 6.5.0-rc7-gfef64f93da2b 2023-10-06T01:04:16.072 DEBUG:teuthology.orchestra.run.smithi155:> rpm --scripts -qp /tmp/kernel.x86_64.rpm 2023-10-06T01:04:16.095 INFO:teuthology.orchestra.run.smithi155.stdout:postinstall scriptlet (using /bin/sh): 2023-10-06T01:04:16.095 INFO:teuthology.orchestra.run.smithi155.stdout:if [ -x /sbin/installkernel -a -r /boot/vmlinuz-6.5.0-rc7-gfef64f93da2b -a -r /boot/System.map-6.5.0-rc7-gfef64f93da2b ]; then 2023-10-06T01:04:16.095 INFO:teuthology.orchestra.run.smithi155.stdout:cp /boot/vmlinuz-6.5.0-rc7-gfef64f93da2b /boot/.vmlinuz-6.5.0-rc7-gfef64f93da2b-rpm 2023-10-06T01:04:16.095 INFO:teuthology.orchestra.run.smithi155.stdout:cp /boot/System.map-6.5.0-rc7-gfef64f93da2b /boot/.System.map-6.5.0-rc7-gfef64f93da2b-rpm 2023-10-06T01:04:16.095 INFO:teuthology.orchestra.run.smithi155.stdout:rm -f /boot/vmlinuz-6.5.0-rc7-gfef64f93da2b /boot/System.map-6.5.0-rc7-gfef64f93da2b 2023-10-06T01:04:16.095 INFO:teuthology.orchestra.run.smithi155.stdout:/sbin/installkernel 6.5.0-rc7-gfef64f93da2b /boot/.vmlinuz-6.5.0-rc7-gfef64f93da2b-rpm /boot/.System.map-6.5.0-rc7-gfef64f93da2b-rpm 2023-10-06T01:04:16.095 INFO:teuthology.orchestra.run.smithi155.stdout:rm -f /boot/.vmlinuz-6.5.0-rc7-gfef64f93da2b-rpm /boot/.System.map-6.5.0-rc7-gfef64f93da2b-rpm 2023-10-06T01:04:16.095 INFO:teuthology.orchestra.run.smithi155.stdout:fi 2023-10-06T01:04:16.096 INFO:teuthology.orchestra.run.smithi155.stdout:preuninstall scriptlet (using /bin/sh): 2023-10-06T01:04:16.096 INFO:teuthology.orchestra.run.smithi155.stdout:if [ -x /sbin/new-kernel-pkg ]; then 2023-10-06T01:04:16.096 INFO:teuthology.orchestra.run.smithi155.stdout:new-kernel-pkg --remove 6.5.0-rc7-gfef64f93da2b --rminitrd --initrdfile=/boot/initramfs-6.5.0-rc7-gfef64f93da2b.img 2023-10-06T01:04:16.096 INFO:teuthology.orchestra.run.smithi155.stdout:elif [ -x /usr/bin/kernel-install ]; then 2023-10-06T01:04:16.096 INFO:teuthology.orchestra.run.smithi155.stdout:kernel-install remove 6.5.0-rc7-gfef64f93da2b 2023-10-06T01:04:16.096 INFO:teuthology.orchestra.run.smithi155.stdout:fi 2023-10-06T01:04:16.096 INFO:teuthology.orchestra.run.smithi155.stdout:postuninstall scriptlet (using /bin/sh): 2023-10-06T01:04:16.096 INFO:teuthology.orchestra.run.smithi155.stdout:if [ -x /sbin/update-bootloader ]; then 2023-10-06T01:04:16.096 INFO:teuthology.orchestra.run.smithi155.stdout:/sbin/update-bootloader --remove 6.5.0-rc7-gfef64f93da2b 2023-10-06T01:04:16.096 INFO:teuthology.orchestra.run.smithi155.stdout:fi 2023-10-06T01:04:16.097 DEBUG:teuthology.orchestra.run.smithi155:> sudo rpm -qi grub2-tools 2023-10-06T01:04:16.172 INFO:teuthology.orchestra.run.smithi155.stdout:Name : grub2-tools 2023-10-06T01:04:16.172 INFO:teuthology.orchestra.run.smithi155.stdout:Epoch : 1 2023-10-06T01:04:16.172 INFO:teuthology.orchestra.run.smithi155.stdout:Version : 2.02 2023-10-06T01:04:16.172 INFO:teuthology.orchestra.run.smithi155.stdout:Release : 99.el8_4.1 2023-10-06T01:04:16.172 INFO:teuthology.orchestra.run.smithi155.stdout:Architecture: x86_64 2023-10-06T01:04:16.173 INFO:teuthology.orchestra.run.smithi155.stdout:Install Date: Wed 21 Dec 2022 01:02:32 PM UTC 2023-10-06T01:04:16.173 INFO:teuthology.orchestra.run.smithi155.stdout:Group : System Environment/Base 2023-10-06T01:04:16.173 INFO:teuthology.orchestra.run.smithi155.stdout:Size : 9264631 2023-10-06T01:04:16.173 INFO:teuthology.orchestra.run.smithi155.stdout:License : GPLv3+ 2023-10-06T01:04:16.173 INFO:teuthology.orchestra.run.smithi155.stdout:Signature : RSA/SHA256, Thu 09 Sep 2021 09:41:55 AM UTC, Key ID 199e2f91fd431d51 2023-10-06T01:04:16.173 INFO:teuthology.orchestra.run.smithi155.stdout:Source RPM : grub2-2.02-99.el8_4.1.src.rpm 2023-10-06T01:04:16.173 INFO:teuthology.orchestra.run.smithi155.stdout:Build Date : Tue 18 May 2021 07:46:34 AM UTC 2023-10-06T01:04:16.173 INFO:teuthology.orchestra.run.smithi155.stdout:Build Host : x86-vm-07.build.eng.bos.redhat.com 2023-10-06T01:04:16.173 INFO:teuthology.orchestra.run.smithi155.stdout:Relocations : (not relocatable) 2023-10-06T01:04:16.173 INFO:teuthology.orchestra.run.smithi155.stdout:Packager : Red Hat, Inc. 2023-10-06T01:04:16.173 INFO:teuthology.orchestra.run.smithi155.stdout:Vendor : Red Hat, Inc. 2023-10-06T01:04:16.173 INFO:teuthology.orchestra.run.smithi155.stdout:URL : http://www.gnu.org/software/grub/ 2023-10-06T01:04:16.174 INFO:teuthology.orchestra.run.smithi155.stdout:Summary : Support tools for GRUB. 2023-10-06T01:04:16.174 INFO:teuthology.orchestra.run.smithi155.stdout:Description : 2023-10-06T01:04:16.174 INFO:teuthology.orchestra.run.smithi155.stdout: 2023-10-06T01:04:16.174 INFO:teuthology.orchestra.run.smithi155.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2023-10-06T01:04:16.174 INFO:teuthology.orchestra.run.smithi155.stdout:customizable bootloader with modular architecture. It supports a rich 2023-10-06T01:04:16.174 INFO:teuthology.orchestra.run.smithi155.stdout:variety of kernel formats, file systems, computer architectures and 2023-10-06T01:04:16.174 INFO:teuthology.orchestra.run.smithi155.stdout:hardware devices. 2023-10-06T01:04:16.174 INFO:teuthology.orchestra.run.smithi155.stdout: 2023-10-06T01:04:16.174 INFO:teuthology.orchestra.run.smithi155.stdout:This subpackage provides tools for support of all platforms. 2023-10-06T01:04:16.177 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2023-10-06T01:04:16.177 INFO:teuthology.task.kernel:Updating grub on smithi155 to boot 6.5.0-rc7-gfef64f93da2b 2023-10-06T01:04:16.177 DEBUG:teuthology.orchestra.run.smithi155:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2023-10-06T01:04:20.730 INFO:teuthology.orchestra.run.smithi155.stderr:Generating grub configuration file ... 2023-10-06T01:04:22.988 INFO:teuthology.orchestra.run.smithi155.stderr:done 2023-10-06T01:04:22.990 DEBUG:teuthology.orchestra.run.smithi155:> mktemp 2023-10-06T01:04:23.017 INFO:teuthology.orchestra.run.smithi155.stdout:/tmp/tmp.UJWSlntd4j 2023-10-06T01:04:23.018 DEBUG:teuthology.orchestra.run.smithi155:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.UJWSlntd4j 2023-10-06T01:04:23.088 DEBUG:teuthology.orchestra.run.smithi155:> sudo chmod 0666 /tmp/tmp.UJWSlntd4j 2023-10-06T01:04:23.251 DEBUG:teuthology.orchestra.remote:smithi155:/tmp/tmp.UJWSlntd4j is 6KB 2023-10-06T01:04:23.299 DEBUG:teuthology.orchestra.run.smithi155:> rm -fr /tmp/tmp.UJWSlntd4j 2023-10-06T01:04:23.313 DEBUG:teuthology.orchestra.run.smithi155:> sudo /bin/ls /boot/loader/entries || true 2023-10-06T01:04:23.395 INFO:teuthology.orchestra.run.smithi155.stdout:298e228f3b5e401e8ac0f5ae159a2e06-0-rescue.conf 2023-10-06T01:04:23.396 INFO:teuthology.orchestra.run.smithi155.stdout:298e228f3b5e401e8ac0f5ae159a2e06-4.18.0-305.25.1.el8_4.x86_64.conf 2023-10-06T01:04:23.396 INFO:teuthology.orchestra.run.smithi155.stdout:298e228f3b5e401e8ac0f5ae159a2e06-4.18.0-425.3.1.el8.x86_64.conf 2023-10-06T01:04:23.396 INFO:teuthology.orchestra.run.smithi155.stdout:298e228f3b5e401e8ac0f5ae159a2e06-4.18.0-80.el8.x86_64.conf 2023-10-06T01:04:23.396 INFO:teuthology.orchestra.run.smithi155.stdout:298e228f3b5e401e8ac0f5ae159a2e06-6.5.0-rc7-gfef64f93da2b.conf 2023-10-06T01:04:23.397 DEBUG:teuthology.orchestra.run.smithi155:> sudo grub2-set-default 298e228f3b5e401e8ac0f5ae159a2e06-6.5.0-rc7-gfef64f93da2b 2023-10-06T01:04:23.548 DEBUG:teuthology.orchestra.run.smithi155:> sudo shutdown -r now 2023-10-06T01:04:42.886 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2023-10-06T01:04:42.887 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi050.front.sepia.ceph.com' 2023-10-06T01:04:42.887 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi050.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-06T01:04:53.558 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2023-10-06T01:04:53.558 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi155.front.sepia.ceph.com' 2023-10-06T01:04:53.559 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi155.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-06T01:05:01.306 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.50 2023-10-06T01:05:10.310 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi050.front.sepia.ceph.com' 2023-10-06T01:05:10.310 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi050.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-06T01:05:12.062 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.155 2023-10-06T01:05:21.070 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi155.front.sepia.ceph.com' 2023-10-06T01:05:21.071 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi155.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-06T01:05:24.122 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.155 2023-10-06T01:05:36.131 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi155.front.sepia.ceph.com' 2023-10-06T01:05:36.132 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi155.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-06T01:06:10.346 DEBUG:teuthology.orchestra.remote:timed out 2023-10-06T01:06:22.358 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi050.front.sepia.ceph.com' 2023-10-06T01:06:22.359 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi050.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-06T01:06:22.688 DEBUG:teuthology.orchestra.run.smithi050:> true 2023-10-06T01:06:23.261 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi050.front.sepia.ceph.com' 2023-10-06T01:06:23.261 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.5.0-rc7-gfef64f93da2b"... 2023-10-06T01:06:23.262 DEBUG:teuthology.orchestra.run.smithi050:> uname -r 2023-10-06T01:06:23.298 INFO:teuthology.orchestra.run.smithi050.stdout:6.5.0-rc7-gfef64f93da2b 2023-10-06T01:06:23.298 DEBUG:teuthology.task.kernel:current kernel version is 6.5.0-rc7-gfef64f93da2b vs 6.5.0-rc7-gfef64f93da2b 2023-10-06T01:06:23.298 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2023-10-06T01:06:23.298 DEBUG:teuthology.task.kernel:Distro of this test job: rhel 2023-10-06T01:06:24.299 DEBUG:teuthology.parallel:result is None 2023-10-06T01:06:36.134 DEBUG:teuthology.orchestra.remote:timed out 2023-10-06T01:06:51.135 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi155.front.sepia.ceph.com' 2023-10-06T01:06:51.135 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi155.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-06T01:06:51.517 DEBUG:teuthology.orchestra.run.smithi155:> true 2023-10-06T01:06:51.934 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi155.front.sepia.ceph.com' 2023-10-06T01:06:51.934 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.5.0-rc7-gfef64f93da2b"... 2023-10-06T01:06:51.934 DEBUG:teuthology.orchestra.run.smithi155:> uname -r 2023-10-06T01:06:51.969 INFO:teuthology.orchestra.run.smithi155.stdout:6.5.0-rc7-gfef64f93da2b 2023-10-06T01:06:51.969 DEBUG:teuthology.task.kernel:current kernel version is 6.5.0-rc7-gfef64f93da2b vs 6.5.0-rc7-gfef64f93da2b 2023-10-06T01:06:51.969 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2023-10-06T01:06:51.970 DEBUG:teuthology.task.kernel:Distro of this test job: rhel 2023-10-06T01:06:52.970 DEBUG:teuthology.parallel:result is None 2023-10-06T01:06:52.971 INFO:teuthology.run_tasks:Running task internal.base... 2023-10-06T01:06:52.980 INFO:teuthology.task.internal:Creating test directory... 2023-10-06T01:06:52.981 DEBUG:teuthology.orchestra.run.smithi050:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-10-06T01:06:52.986 DEBUG:teuthology.orchestra.run.smithi155:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-10-06T01:06:53.025 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2023-10-06T01:06:53.032 INFO:teuthology.run_tasks:Running task internal.archive... 2023-10-06T01:06:53.059 INFO:teuthology.task.internal:Creating archive directory... 2023-10-06T01:06:53.059 DEBUG:teuthology.orchestra.run.smithi050:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-10-06T01:06:53.066 DEBUG:teuthology.orchestra.run.smithi155:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-10-06T01:06:53.122 INFO:teuthology.run_tasks:Running task internal.coredump... 2023-10-06T01:06:53.128 INFO:teuthology.task.internal:Enabling coredump saving... 2023-10-06T01:06:53.128 DEBUG:teuthology.orchestra.run.smithi050:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-10-06T01:06:53.133 DEBUG:teuthology.orchestra.run.smithi155:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-10-06T01:06:53.271 INFO:teuthology.orchestra.run.smithi155.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-10-06T01:06:53.273 INFO:teuthology.orchestra.run.smithi050.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-10-06T01:06:53.305 INFO:teuthology.orchestra.run.smithi155.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-10-06T01:06:53.309 INFO:teuthology.orchestra.run.smithi050.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-10-06T01:06:53.313 INFO:teuthology.run_tasks:Running task internal.sudo... 2023-10-06T01:06:53.320 INFO:teuthology.task.internal:Configuring sudo... 2023-10-06T01:06:53.320 DEBUG:teuthology.orchestra.run.smithi050:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-10-06T01:06:53.324 DEBUG:teuthology.orchestra.run.smithi155:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-10-06T01:06:53.386 INFO:teuthology.run_tasks:Running task internal.syslog... 2023-10-06T01:06:53.395 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2023-10-06T01:06:53.395 DEBUG:teuthology.orchestra.run.smithi050:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-10-06T01:06:53.399 DEBUG:teuthology.orchestra.run.smithi155:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-10-06T01:06:53.435 DEBUG:teuthology.orchestra.run.smithi050:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-10-06T01:06:53.535 DEBUG:teuthology.orchestra.run.smithi050:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2023-10-06T01:06:53.665 DEBUG:teuthology.orchestra.run.smithi050:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-10-06T01:06:53.728 DEBUG:teuthology.orchestra.run.smithi050:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2023-10-06T01:06:53.807 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2023-10-06T01:06:53.807 DEBUG:teuthology.orchestra.run.smithi050:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-10-06T01:06:53.881 DEBUG:teuthology.orchestra.run.smithi155:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-10-06T01:06:53.946 DEBUG:teuthology.orchestra.run.smithi155:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2023-10-06T01:06:54.049 DEBUG:teuthology.orchestra.run.smithi155:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-10-06T01:06:54.113 DEBUG:teuthology.orchestra.run.smithi155:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2023-10-06T01:06:54.189 DEBUG:teuthology.orchestra.run.smithi155:> set -ex 2023-10-06T01:06:54.190 DEBUG:teuthology.orchestra.run.smithi155:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-10-06T01:06:54.251 DEBUG:teuthology.orchestra.run.smithi050:> sudo service rsyslog restart 2023-10-06T01:06:54.255 DEBUG:teuthology.orchestra.run.smithi155:> sudo service rsyslog restart 2023-10-06T01:06:54.363 INFO:teuthology.orchestra.run.smithi050.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-10-06T01:06:54.401 INFO:teuthology.orchestra.run.smithi155.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-10-06T01:06:54.767 INFO:teuthology.run_tasks:Running task internal.timer... 2023-10-06T01:06:54.774 INFO:teuthology.task.internal:Starting timer... 2023-10-06T01:06:54.774 INFO:teuthology.run_tasks:Running task pcp... 2023-10-06T01:06:54.846 INFO:teuthology.run_tasks:Running task selinux... 2023-10-06T01:06:54.884 DEBUG:teuthology.task:Applying overrides for task selinux: {'whitelist': ['scontext=system_u:system_r:logrotate_t:s0']} 2023-10-06T01:06:54.885 DEBUG:teuthology.orchestra.run.smithi050:> sudo service auditd rotate 2023-10-06T01:06:55.024 INFO:teuthology.orchestra.run.smithi050.stdout:Rotating logs: [ OK ] 2023-10-06T01:06:55.028 DEBUG:teuthology.orchestra.run.smithi155:> sudo service auditd rotate 2023-10-06T01:06:55.153 INFO:teuthology.orchestra.run.smithi155.stdout:Rotating logs: [ OK ] 2023-10-06T01:06:55.156 DEBUG:teuthology.task.selinux:Getting current SELinux state 2023-10-06T01:06:55.156 DEBUG:teuthology.orchestra.run.smithi050:> /usr/sbin/getenforce 2023-10-06T01:06:55.200 INFO:teuthology.orchestra.run.smithi050.stdout:Permissive 2023-10-06T01:06:55.200 DEBUG:teuthology.orchestra.run.smithi155:> /usr/sbin/getenforce 2023-10-06T01:06:55.243 INFO:teuthology.orchestra.run.smithi155.stdout:Permissive 2023-10-06T01:06:55.243 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi050.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi155.front.sepia.ceph.com': 'permissive'} 2023-10-06T01:06:55.243 DEBUG:teuthology.orchestra.run.smithi050:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-10-06T01:06:55.308 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-06T01:06:55.309 DEBUG:teuthology.orchestra.run.smithi155:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-10-06T01:06:55.372 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-06T01:06:55.373 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2023-10-06T01:06:55.373 DEBUG:teuthology.orchestra.run.smithi050:> sudo /usr/sbin/setenforce permissive 2023-10-06T01:06:55.437 DEBUG:teuthology.orchestra.run.smithi155:> sudo /usr/sbin/setenforce permissive 2023-10-06T01:06:55.500 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2023-10-06T01:06:55.511 DEBUG:teuthology.repo_utils:Setting repo remote to https://git.ceph.com/ceph-cm-ansible.git 2023-10-06T01:06:55.516 INFO:teuthology.repo_utils:Fetching main from origin 2023-10-06T01:06:55.642 INFO:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2023-10-06T01:06:55.658 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2023-10-06T01:06:55.659 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi050.front.sepia.ceph.com,smithi155.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2023-10-06T01:18:15.309 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi050.front.sepia.ceph.com'), Remote(name='ubuntu@smithi155.front.sepia.ceph.com')] 2023-10-06T01:18:15.310 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi050.front.sepia.ceph.com' 2023-10-06T01:18:15.311 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi050.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-06T01:18:15.398 DEBUG:teuthology.orchestra.run.smithi050:> true 2023-10-06T01:18:15.501 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi050.front.sepia.ceph.com' 2023-10-06T01:18:15.501 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi155.front.sepia.ceph.com' 2023-10-06T01:18:15.502 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi155.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-06T01:18:15.590 DEBUG:teuthology.orchestra.run.smithi155:> true 2023-10-06T01:18:15.701 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi155.front.sepia.ceph.com' 2023-10-06T01:18:15.702 INFO:teuthology.run_tasks:Running task clock... 2023-10-06T01:18:15.711 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2023-10-06T01:18:15.711 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-10-06T01:18:15.712 DEBUG:teuthology.orchestra.run.smithi050:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-10-06T01:18:15.716 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-10-06T01:18:15.716 DEBUG:teuthology.orchestra.run.smithi155:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-10-06T01:18:15.780 INFO:teuthology.orchestra.run.smithi050.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2023-10-06T01:18:15.810 INFO:teuthology.orchestra.run.smithi155.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2023-10-06T01:18:15.816 INFO:teuthology.orchestra.run.smithi050.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2023-10-06T01:18:15.845 INFO:teuthology.orchestra.run.smithi155.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2023-10-06T01:18:15.878 INFO:teuthology.orchestra.run.smithi050.stderr:sudo: ntpd: command not found 2023-10-06T01:18:15.905 INFO:teuthology.orchestra.run.smithi155.stderr:sudo: ntpd: command not found 2023-10-06T01:18:15.905 INFO:teuthology.orchestra.run.smithi050.stdout:506 Cannot talk to daemon 2023-10-06T01:18:15.932 INFO:teuthology.orchestra.run.smithi155.stdout:506 Cannot talk to daemon 2023-10-06T01:18:15.939 INFO:teuthology.orchestra.run.smithi050.stderr:Failed to start ntp.service: Unit ntp.service not found. 2023-10-06T01:18:15.965 INFO:teuthology.orchestra.run.smithi155.stderr:Failed to start ntp.service: Unit ntp.service not found. 2023-10-06T01:18:15.974 INFO:teuthology.orchestra.run.smithi050.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2023-10-06T01:18:15.999 INFO:teuthology.orchestra.run.smithi155.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2023-10-06T01:18:16.061 INFO:teuthology.orchestra.run.smithi050.stderr:bash: ntpq: command not found 2023-10-06T01:18:16.066 INFO:teuthology.orchestra.run.smithi050.stdout:210 Number of sources = 4 2023-10-06T01:18:16.067 INFO:teuthology.orchestra.run.smithi050.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-10-06T01:18:16.067 INFO:teuthology.orchestra.run.smithi050.stdout:=============================================================================== 2023-10-06T01:18:16.067 INFO:teuthology.orchestra.run.smithi050.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-06T01:18:16.067 INFO:teuthology.orchestra.run.smithi050.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-06T01:18:16.067 INFO:teuthology.orchestra.run.smithi050.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-06T01:18:16.067 INFO:teuthology.orchestra.run.smithi050.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-06T01:18:16.089 INFO:teuthology.orchestra.run.smithi155.stderr:bash: ntpq: command not found 2023-10-06T01:18:16.094 INFO:teuthology.orchestra.run.smithi155.stdout:210 Number of sources = 4 2023-10-06T01:18:16.094 INFO:teuthology.orchestra.run.smithi155.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-10-06T01:18:16.094 INFO:teuthology.orchestra.run.smithi155.stdout:=============================================================================== 2023-10-06T01:18:16.094 INFO:teuthology.orchestra.run.smithi155.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-06T01:18:16.094 INFO:teuthology.orchestra.run.smithi155.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-06T01:18:16.094 INFO:teuthology.orchestra.run.smithi155.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-06T01:18:16.094 INFO:teuthology.orchestra.run.smithi155.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-06T01:18:16.096 INFO:teuthology.run_tasks:Running task install... 2023-10-06T01:18:16.104 DEBUG:teuthology.task.install:project ceph 2023-10-06T01:18:16.104 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '736ac5ba72cb47af7d6f6666b1e100f7e20a20e2'}} 2023-10-06T01:18:16.104 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel']}, 'flavor': 'default', 'sha1': '736ac5ba72cb47af7d6f6666b1e100f7e20a20e2'} 2023-10-06T01:18:16.104 INFO:teuthology.task.install:Using flavor: default 2023-10-06T01:18:16.110 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2023-10-06T01:18:16.110 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']} 2023-10-06T01:18:16.111 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '736ac5ba72cb47af7d6f6666b1e100f7e20a20e2', 'tag': None, 'wait_for_package': False} 2023-10-06T01:18:16.111 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=736ac5ba72cb47af7d6f6666b1e100f7e20a20e2 2023-10-06T01:18:16.113 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '736ac5ba72cb47af7d6f6666b1e100f7e20a20e2', 'tag': None, 'wait_for_package': False} 2023-10-06T01:18:16.113 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=736ac5ba72cb47af7d6f6666b1e100f7e20a20e2 2023-10-06T01:18:16.332 INFO:teuthology.task.install.rpm:Pulling from https://2.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-05-0730-quincy/736ac5ba72cb47af7d6f6666b1e100f7e20a20e2/centos/8/flavors/default/ 2023-10-06T01:18:16.332 INFO:teuthology.task.install.rpm:Package version is 17.2.6-1296.g736ac5ba 2023-10-06T01:18:16.341 INFO:teuthology.task.install.rpm:Pulling from https://2.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-05-0730-quincy/736ac5ba72cb47af7d6f6666b1e100f7e20a20e2/centos/8/flavors/default/ 2023-10-06T01:18:16.341 INFO:teuthology.task.install.rpm:Package version is 17.2.6-1296.g736ac5ba 2023-10-06T01:18:16.441 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://2.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-05-0730-quincy/736ac5ba72cb47af7d6f6666b1e100f7e20a20e2/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://2.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-05-0730-quincy/736ac5ba72cb47af7d6f6666b1e100f7e20a20e2/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://2.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-05-0730-quincy/736ac5ba72cb47af7d6f6666b1e100f7e20a20e2/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2023-10-06T01:18:16.441 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2023-10-06T01:18:16.441 DEBUG:teuthology.orchestra.run.smithi050:> sudo dd of=/etc/yum.repos.d/ceph.repo 2023-10-06T01:18:16.505 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://2.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-05-0730-quincy/736ac5ba72cb47af7d6f6666b1e100f7e20a20e2/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://2.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-05-0730-quincy/736ac5ba72cb47af7d6f6666b1e100f7e20a20e2/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://2.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-05-0730-quincy/736ac5ba72cb47af7d6f6666b1e100f7e20a20e2/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2023-10-06T01:18:16.505 DEBUG:teuthology.orchestra.run.smithi155:> set -ex 2023-10-06T01:18:16.506 DEBUG:teuthology.orchestra.run.smithi155:> sudo dd of=/etc/yum.repos.d/ceph.repo 2023-10-06T01:18:16.507 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel on remote rpm x86_64 2023-10-06T01:18:16.507 DEBUG:teuthology.orchestra.run.smithi050:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/736ac5ba72cb47af7d6f6666b1e100f7e20a20e2/;g' /etc/yum.repos.d/ceph.repo ; fi 2023-10-06T01:18:16.572 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel on remote rpm x86_64 2023-10-06T01:18:16.572 DEBUG:teuthology.orchestra.run.smithi155:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/736ac5ba72cb47af7d6f6666b1e100f7e20a20e2/;g' /etc/yum.repos.d/ceph.repo ; fi 2023-10-06T01:18:16.612 DEBUG:teuthology.orchestra.run.smithi050:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2023-10-06T01:18:16.676 DEBUG:teuthology.orchestra.run.smithi155:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2023-10-06T01:18:16.703 DEBUG:teuthology.orchestra.run.smithi050:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2023-10-06T01:18:16.764 INFO:teuthology.orchestra.run.smithi050.stdout:check_obsoletes = 1 2023-10-06T01:18:16.765 DEBUG:teuthology.orchestra.run.smithi155:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2023-10-06T01:18:16.767 DEBUG:teuthology.orchestra.run.smithi050:> sudo yum clean all 2023-10-06T01:18:16.825 INFO:teuthology.orchestra.run.smithi155.stdout:check_obsoletes = 1 2023-10-06T01:18:16.829 DEBUG:teuthology.orchestra.run.smithi155:> sudo yum clean all 2023-10-06T01:18:17.262 INFO:teuthology.orchestra.run.smithi050.stdout:Updating Subscription Management repositories. 2023-10-06T01:18:17.288 INFO:teuthology.orchestra.run.smithi155.stdout:Updating Subscription Management repositories. 2023-10-06T01:18:17.606 INFO:teuthology.orchestra.run.smithi050.stdout:44 files removed 2023-10-06T01:18:17.618 INFO:teuthology.orchestra.run.smithi155.stdout:44 files removed 2023-10-06T01:18:17.673 DEBUG:teuthology.orchestra.run.smithi050:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel 2023-10-06T01:18:17.678 DEBUG:teuthology.orchestra.run.smithi155:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel 2023-10-06T01:18:18.140 INFO:teuthology.orchestra.run.smithi155.stdout:Updating Subscription Management repositories. 2023-10-06T01:18:18.168 INFO:teuthology.orchestra.run.smithi050.stdout:Updating Subscription Management repositories. 2023-10-06T01:18:19.283 INFO:teuthology.orchestra.run.smithi155.stdout:ceph packages for x86_64 131 kB/s | 78 kB 00:00 2023-10-06T01:18:19.474 INFO:teuthology.orchestra.run.smithi050.stdout:ceph packages for x86_64 107 kB/s | 78 kB 00:00 2023-10-06T01:18:20.005 INFO:teuthology.orchestra.run.smithi155.stdout:ceph noarch packages 14 kB/s | 9.2 kB 00:00 2023-10-06T01:18:20.147 INFO:teuthology.orchestra.run.smithi050.stdout:ceph noarch packages 15 kB/s | 9.2 kB 00:00 2023-10-06T01:18:20.542 INFO:teuthology.orchestra.run.smithi155.stdout:ceph source packages 2.9 kB/s | 1.4 kB 00:00 2023-10-06T01:18:20.631 INFO:teuthology.orchestra.run.smithi050.stdout:ceph source packages 3.2 kB/s | 1.4 kB 00:00 2023-10-06T01:18:20.680 INFO:teuthology.orchestra.run.smithi155.stdout:Copr repo for python3-asyncssh owned by ceph 33 kB/s | 3.5 kB 00:00 2023-10-06T01:18:20.752 INFO:teuthology.orchestra.run.smithi050.stdout:Copr repo for python3-asyncssh owned by ceph 41 kB/s | 3.5 kB 00:00 2023-10-06T01:18:21.131 INFO:teuthology.orchestra.run.smithi050.stdout:Extra Packages for Enterprise Linux 46 MB/s | 16 MB 00:00 2023-10-06T01:18:24.838 INFO:teuthology.orchestra.run.smithi050.stdout:lab-extras 3.6 MB/s | 24 kB 00:00 2023-10-06T01:18:25.476 INFO:teuthology.orchestra.run.smithi050.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 70 MB/s | 38 MB 00:00 2023-10-06T01:18:26.195 INFO:teuthology.orchestra.run.smithi155.stdout:Extra Packages for Enterprise Linux 2.9 MB/s | 16 MB 00:05 2023-10-06T01:18:29.715 INFO:teuthology.orchestra.run.smithi155.stdout:lab-extras 3.7 MB/s | 24 kB 00:00 2023-10-06T01:18:30.265 INFO:teuthology.orchestra.run.smithi155.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 82 MB/s | 38 MB 00:00 2023-10-06T01:18:31.662 INFO:teuthology.orchestra.run.smithi050.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 70 MB/s | 33 MB 00:00 2023-10-06T01:18:36.124 INFO:teuthology.orchestra.run.smithi155.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 78 MB/s | 33 MB 00:00 2023-10-06T01:18:40.468 INFO:teuthology.orchestra.run.smithi050.stdout:Package librados2-1:12.2.7-9.el8.x86_64 is already installed. 2023-10-06T01:18:40.469 INFO:teuthology.orchestra.run.smithi050.stdout:Package librbd1-1:12.2.7-9.el8.x86_64 is already installed. 2023-10-06T01:18:40.481 INFO:teuthology.orchestra.run.smithi050.stdout:Package NetworkManager-1:1.30.0-13.el8_4.x86_64 is already installed. 2023-10-06T01:18:40.481 INFO:teuthology.orchestra.run.smithi050.stdout:Package iproute-5.9.0-4.el8.x86_64 is already installed. 2023-10-06T01:18:40.482 INFO:teuthology.orchestra.run.smithi050.stdout:Package util-linux-2.32.1-27.el8.x86_64 is already installed. 2023-10-06T01:18:40.483 INFO:teuthology.orchestra.run.smithi050.stdout:Package libacl-devel-2.2.53-1.el8.x86_64 is already installed. 2023-10-06T01:18:40.485 INFO:teuthology.orchestra.run.smithi050.stdout:Package libattr-devel-2.4.48-3.el8.x86_64 is already installed. 2023-10-06T01:18:40.488 INFO:teuthology.orchestra.run.smithi050.stdout:Package xfsdump-3.1.8-2.el8.x86_64 is already installed. 2023-10-06T01:18:40.488 INFO:teuthology.orchestra.run.smithi050.stdout:Package xfsprogs-5.0.0-8.el8.x86_64 is already installed. 2023-10-06T01:18:41.015 INFO:teuthology.orchestra.run.smithi050.stdout:Dependencies resolved. 2023-10-06T01:18:41.028 INFO:teuthology.orchestra.run.smithi050.stdout:====================================================================================================================== 2023-10-06T01:18:41.028 INFO:teuthology.orchestra.run.smithi050.stdout: Package Arch Version Repository Size 2023-10-06T01:18:41.028 INFO:teuthology.orchestra.run.smithi050.stdout:====================================================================================================================== 2023-10-06T01:18:41.028 INFO:teuthology.orchestra.run.smithi050.stdout:Installing: 2023-10-06T01:18:41.028 INFO:teuthology.orchestra.run.smithi050.stdout: bison x86_64 3.0.4-10.el8 rhel-8-for-x86_64-appstream-rpms 688 k 2023-10-06T01:18:41.028 INFO:teuthology.orchestra.run.smithi050.stdout: ceph x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 6.4 k 2023-10-06T01:18:41.028 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-base x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 5.2 M 2023-10-06T01:18:41.028 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-fuse x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 876 k 2023-10-06T01:18:41.028 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-immutable-object-cache x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 162 k 2023-10-06T01:18:41.028 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-mgr x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 1.6 M 2023-10-06T01:18:41.029 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-mgr-cephadm noarch 2:17.2.6-1296.g736ac5ba.el8 ceph-noarch 121 k 2023-10-06T01:18:41.029 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-mgr-dashboard noarch 2:17.2.6-1296.g736ac5ba.el8 ceph-noarch 1.7 M 2023-10-06T01:18:41.029 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-mgr-diskprediction-local noarch 2:17.2.6-1296.g736ac5ba.el8 ceph-noarch 7.4 M 2023-10-06T01:18:41.029 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-mgr-rook noarch 2:17.2.6-1296.g736ac5ba.el8 ceph-noarch 47 k 2023-10-06T01:18:41.029 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-radosgw x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 17 M 2023-10-06T01:18:41.029 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-test x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 52 M 2023-10-06T01:18:41.029 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-volume noarch 2:17.2.6-1296.g736ac5ba.el8 ceph-noarch 267 k 2023-10-06T01:18:41.029 INFO:teuthology.orchestra.run.smithi050.stdout: cephadm noarch 2:17.2.6-1296.g736ac5ba.el8 ceph-noarch 80 k 2023-10-06T01:18:41.029 INFO:teuthology.orchestra.run.smithi050.stdout: cephfs-mirror x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 255 k 2023-10-06T01:18:41.029 INFO:teuthology.orchestra.run.smithi050.stdout: cephfs-top noarch 2:17.2.6-1296.g736ac5ba.el8 ceph-noarch 18 k 2023-10-06T01:18:41.029 INFO:teuthology.orchestra.run.smithi050.stdout: elfutils-libelf-devel x86_64 0.182-3.el8 rhel-8-for-x86_64-baseos-rpms 59 k 2023-10-06T01:18:41.029 INFO:teuthology.orchestra.run.smithi050.stdout: flex x86_64 2.6.1-9.el8 rhel-8-for-x86_64-appstream-rpms 320 k 2023-10-06T01:18:41.029 INFO:teuthology.orchestra.run.smithi050.stdout: libaio-devel x86_64 0.3.112-1.el8 rhel-8-for-x86_64-baseos-rpms 19 k 2023-10-06T01:18:41.030 INFO:teuthology.orchestra.run.smithi050.stdout: libcephfs-devel x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 25 k 2023-10-06T01:18:41.030 INFO:teuthology.orchestra.run.smithi050.stdout: libcephfs2 x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 797 k 2023-10-06T01:18:41.030 INFO:teuthology.orchestra.run.smithi050.stdout: librados-devel x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 130 k 2023-10-06T01:18:41.030 INFO:teuthology.orchestra.run.smithi050.stdout: libtool x86_64 2.4.6-25.el8 rhel-8-for-x86_64-appstream-rpms 709 k 2023-10-06T01:18:41.030 INFO:teuthology.orchestra.run.smithi050.stdout: libuuid-devel x86_64 2.32.1-27.el8 rhel-8-for-x86_64-baseos-rpms 97 k 2023-10-06T01:18:41.030 INFO:teuthology.orchestra.run.smithi050.stdout: openssl-devel x86_64 1:1.1.1g-15.el8_3 rhel-8-for-x86_64-baseos-rpms 2.3 M 2023-10-06T01:18:41.030 INFO:teuthology.orchestra.run.smithi050.stdout: python3-cephfs x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 190 k 2023-10-06T01:18:41.030 INFO:teuthology.orchestra.run.smithi050.stdout: python3-rados x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 371 k 2023-10-06T01:18:41.030 INFO:teuthology.orchestra.run.smithi050.stdout: python3-rbd x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 358 k 2023-10-06T01:18:41.030 INFO:teuthology.orchestra.run.smithi050.stdout: python3-rgw x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 107 k 2023-10-06T01:18:41.030 INFO:teuthology.orchestra.run.smithi050.stdout: rbd-fuse x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 90 k 2023-10-06T01:18:41.031 INFO:teuthology.orchestra.run.smithi050.stdout: rbd-mirror x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 3.5 M 2023-10-06T01:18:41.031 INFO:teuthology.orchestra.run.smithi050.stdout: rbd-nbd x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 173 k 2023-10-06T01:18:41.031 INFO:teuthology.orchestra.run.smithi050.stdout: xfsprogs-devel x86_64 5.0.0-8.el8 rhel-8-for-x86_64-baseos-rpms 70 k 2023-10-06T01:18:41.031 INFO:teuthology.orchestra.run.smithi050.stdout:Upgrading: 2023-10-06T01:18:41.031 INFO:teuthology.orchestra.run.smithi050.stdout: librados2 x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 3.5 M 2023-10-06T01:18:41.031 INFO:teuthology.orchestra.run.smithi050.stdout: librbd1 x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 3.6 M 2023-10-06T01:18:41.031 INFO:teuthology.orchestra.run.smithi050.stdout:Installing dependencies: 2023-10-06T01:18:41.031 INFO:teuthology.orchestra.run.smithi050.stdout: automake noarch 1.16.1-7.el8 rhel-8-for-x86_64-appstream-rpms 713 k 2023-10-06T01:18:41.031 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-common x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 23 M 2023-10-06T01:18:41.031 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-grafana-dashboards noarch 2:17.2.6-1296.g736ac5ba.el8 ceph-noarch 23 k 2023-10-06T01:18:41.031 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-mds x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 2.3 M 2023-10-06T01:18:41.032 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-mgr-modules-core noarch 2:17.2.6-1296.g736ac5ba.el8 ceph-noarch 238 k 2023-10-06T01:18:41.032 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-mon x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 3.9 M 2023-10-06T01:18:41.032 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-osd x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 17 M 2023-10-06T01:18:41.032 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-prometheus-alerts noarch 2:17.2.6-1296.g736ac5ba.el8 ceph-noarch 14 k 2023-10-06T01:18:41.032 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-selinux x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 24 k 2023-10-06T01:18:41.032 INFO:teuthology.orchestra.run.smithi050.stdout: fuse x86_64 2.9.7-12.el8 rhel-8-for-x86_64-baseos-rpms 83 k 2023-10-06T01:18:41.032 INFO:teuthology.orchestra.run.smithi050.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2023-10-06T01:18:41.032 INFO:teuthology.orchestra.run.smithi050.stdout: jq x86_64 1.5-12.el8 rhel-8-for-x86_64-appstream-rpms 161 k 2023-10-06T01:18:41.032 INFO:teuthology.orchestra.run.smithi050.stdout: keyutils-libs-devel x86_64 1.5.10-6.el8 rhel-8-for-x86_64-baseos-rpms 48 k 2023-10-06T01:18:41.032 INFO:teuthology.orchestra.run.smithi050.stdout: krb5-devel x86_64 1.18.2-8.3.el8_4 rhel-8-for-x86_64-baseos-rpms 559 k 2023-10-06T01:18:41.032 INFO:teuthology.orchestra.run.smithi050.stdout: libcephsqlite x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 174 k 2023-10-06T01:18:41.032 INFO:teuthology.orchestra.run.smithi050.stdout: libcom_err-devel x86_64 1.45.6-1.el8 rhel-8-for-x86_64-baseos-rpms 38 k 2023-10-06T01:18:41.033 INFO:teuthology.orchestra.run.smithi050.stdout: libgfortran x86_64 8.4.1-1.el8 rhel-8-for-x86_64-baseos-rpms 639 k 2023-10-06T01:18:41.033 INFO:teuthology.orchestra.run.smithi050.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2023-10-06T01:18:41.033 INFO:teuthology.orchestra.run.smithi050.stdout: libquadmath x86_64 8.4.1-1.el8 rhel-8-for-x86_64-baseos-rpms 169 k 2023-10-06T01:18:41.033 INFO:teuthology.orchestra.run.smithi050.stdout: librabbitmq x86_64 0.9.0-3.el8 rhel-8-for-x86_64-baseos-rpms 47 k 2023-10-06T01:18:41.033 INFO:teuthology.orchestra.run.smithi050.stdout: libradosstriper1 x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 507 k 2023-10-06T01:18:41.033 INFO:teuthology.orchestra.run.smithi050.stdout: librdkafka x86_64 0.11.4-1.el8 rhel-8-for-x86_64-appstream-rpms 353 k 2023-10-06T01:18:41.033 INFO:teuthology.orchestra.run.smithi050.stdout: librgw2 x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 5.6 M 2023-10-06T01:18:41.033 INFO:teuthology.orchestra.run.smithi050.stdout: libselinux-devel x86_64 2.9-5.el8 rhel-8-for-x86_64-baseos-rpms 200 k 2023-10-06T01:18:41.033 INFO:teuthology.orchestra.run.smithi050.stdout: libsepol-devel x86_64 2.9-2.el8 rhel-8-for-x86_64-baseos-rpms 86 k 2023-10-06T01:18:41.033 INFO:teuthology.orchestra.run.smithi050.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2023-10-06T01:18:41.033 INFO:teuthology.orchestra.run.smithi050.stdout: libverto-devel x86_64 0.3.0-5.el8 rhel-8-for-x86_64-baseos-rpms 18 k 2023-10-06T01:18:41.034 INFO:teuthology.orchestra.run.smithi050.stdout: lttng-ust x86_64 2.8.1-11.el8 rhel-8-for-x86_64-appstream-rpms 259 k 2023-10-06T01:18:41.034 INFO:teuthology.orchestra.run.smithi050.stdout: oniguruma x86_64 6.8.2-2.el8 rhel-8-for-x86_64-appstream-rpms 187 k 2023-10-06T01:18:41.034 INFO:teuthology.orchestra.run.smithi050.stdout: openblas x86_64 0.3.12-1.el8 rhel-8-for-x86_64-appstream-rpms 4.6 M 2023-10-06T01:18:41.034 INFO:teuthology.orchestra.run.smithi050.stdout: openblas-threads x86_64 0.3.12-1.el8 rhel-8-for-x86_64-appstream-rpms 4.7 M 2023-10-06T01:18:41.034 INFO:teuthology.orchestra.run.smithi050.stdout: pcre2-devel x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 605 k 2023-10-06T01:18:41.034 INFO:teuthology.orchestra.run.smithi050.stdout: pcre2-utf16 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 229 k 2023-10-06T01:18:41.034 INFO:teuthology.orchestra.run.smithi050.stdout: pcre2-utf32 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 220 k 2023-10-06T01:18:41.034 INFO:teuthology.orchestra.run.smithi050.stdout: python3-asyncssh noarch 2.7.0-2.el8 epel 476 k 2023-10-06T01:18:41.034 INFO:teuthology.orchestra.run.smithi050.stdout: python3-babel noarch 2.5.1-5.el8 rhel-8-for-x86_64-appstream-rpms 4.8 M 2023-10-06T01:18:41.034 INFO:teuthology.orchestra.run.smithi050.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2023-10-06T01:18:41.035 INFO:teuthology.orchestra.run.smithi050.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2023-10-06T01:18:41.035 INFO:teuthology.orchestra.run.smithi050.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2023-10-06T01:18:41.035 INFO:teuthology.orchestra.run.smithi050.stdout: python3-ceph-argparse x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 45 k 2023-10-06T01:18:41.035 INFO:teuthology.orchestra.run.smithi050.stdout: python3-ceph-common x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 115 k 2023-10-06T01:18:41.035 INFO:teuthology.orchestra.run.smithi050.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2023-10-06T01:18:41.035 INFO:teuthology.orchestra.run.smithi050.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2023-10-06T01:18:41.035 INFO:teuthology.orchestra.run.smithi050.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2023-10-06T01:18:41.035 INFO:teuthology.orchestra.run.smithi050.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2023-10-06T01:18:41.035 INFO:teuthology.orchestra.run.smithi050.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2023-10-06T01:18:41.035 INFO:teuthology.orchestra.run.smithi050.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2023-10-06T01:18:41.035 INFO:teuthology.orchestra.run.smithi050.stdout: python3-jinja2 noarch 2.10.1-2.el8_0 rhel-8-for-x86_64-appstream-rpms 538 k 2023-10-06T01:18:41.036 INFO:teuthology.orchestra.run.smithi050.stdout: python3-jsonpatch noarch 1.21-2.el8 rhel-8-for-x86_64-appstream-rpms 27 k 2023-10-06T01:18:41.036 INFO:teuthology.orchestra.run.smithi050.stdout: python3-jsonpointer noarch 1.10-11.el8 rhel-8-for-x86_64-appstream-rpms 20 k 2023-10-06T01:18:41.036 INFO:teuthology.orchestra.run.smithi050.stdout: python3-jwt noarch 1.6.1-2.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2023-10-06T01:18:41.036 INFO:teuthology.orchestra.run.smithi050.stdout: python3-kubernetes noarch 1:11.0.0-6.el8 epel 1.2 M 2023-10-06T01:18:41.036 INFO:teuthology.orchestra.run.smithi050.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2023-10-06T01:18:41.036 INFO:teuthology.orchestra.run.smithi050.stdout: python3-mako noarch 1.0.6-13.el8 rhel-8-for-x86_64-appstream-rpms 157 k 2023-10-06T01:18:41.036 INFO:teuthology.orchestra.run.smithi050.stdout: python3-markupsafe x86_64 0.23-19.el8 rhel-8-for-x86_64-appstream-rpms 39 k 2023-10-06T01:18:41.036 INFO:teuthology.orchestra.run.smithi050.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2023-10-06T01:18:41.036 INFO:teuthology.orchestra.run.smithi050.stdout: python3-natsort noarch 7.1.1-2.el8 epel 60 k 2023-10-06T01:18:41.037 INFO:teuthology.orchestra.run.smithi050.stdout: python3-numpy x86_64 1:1.14.3-9.el8 rhel-8-for-x86_64-appstream-rpms 3.7 M 2023-10-06T01:18:41.037 INFO:teuthology.orchestra.run.smithi050.stdout: python3-numpy-f2py x86_64 1:1.14.3-9.el8 rhel-8-for-x86_64-appstream-rpms 225 k 2023-10-06T01:18:41.037 INFO:teuthology.orchestra.run.smithi050.stdout: python3-oauthlib noarch 2.1.0-1.el8 rhel-8-for-x86_64-baseos-rpms 155 k 2023-10-06T01:18:41.037 INFO:teuthology.orchestra.run.smithi050.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2023-10-06T01:18:41.037 INFO:teuthology.orchestra.run.smithi050.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2023-10-06T01:18:41.037 INFO:teuthology.orchestra.run.smithi050.stdout: python3-prettytable noarch 0.7.2-14.el8 rhel-8-for-x86_64-appstream-rpms 44 k 2023-10-06T01:18:41.037 INFO:teuthology.orchestra.run.smithi050.stdout: python3-pyasn1 noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 126 k 2023-10-06T01:18:41.037 INFO:teuthology.orchestra.run.smithi050.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 110 k 2023-10-06T01:18:41.037 INFO:teuthology.orchestra.run.smithi050.stdout: python3-pytz noarch 2017.2-9.el8 rhel-8-for-x86_64-appstream-rpms 54 k 2023-10-06T01:18:41.037 INFO:teuthology.orchestra.run.smithi050.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2023-10-06T01:18:41.037 INFO:teuthology.orchestra.run.smithi050.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2023-10-06T01:18:41.037 INFO:teuthology.orchestra.run.smithi050.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2023-10-06T01:18:41.038 INFO:teuthology.orchestra.run.smithi050.stdout: python3-rsa noarch 4.9-2.el8 epel 64 k 2023-10-06T01:18:41.038 INFO:teuthology.orchestra.run.smithi050.stdout: python3-scipy x86_64 1.0.0-20.module+el8.1.0+3334+5cb623d7 rhel-8-for-x86_64-appstream-rpms 15 M 2023-10-06T01:18:41.038 INFO:teuthology.orchestra.run.smithi050.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2023-10-06T01:18:41.038 INFO:teuthology.orchestra.run.smithi050.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2023-10-06T01:18:41.038 INFO:teuthology.orchestra.run.smithi050.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2023-10-06T01:18:41.038 INFO:teuthology.orchestra.run.smithi050.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2023-10-06T01:18:41.038 INFO:teuthology.orchestra.run.smithi050.stdout: python3-waitress noarch 1.4.3-1.el8 epel 255 k 2023-10-06T01:18:41.038 INFO:teuthology.orchestra.run.smithi050.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2023-10-06T01:18:41.038 INFO:teuthology.orchestra.run.smithi050.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2023-10-06T01:18:41.038 INFO:teuthology.orchestra.run.smithi050.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2023-10-06T01:18:41.038 INFO:teuthology.orchestra.run.smithi050.stdout: python3-werkzeug noarch 0.12.2-4.el8 rhel-8-for-x86_64-appstream-rpms 457 k 2023-10-06T01:18:41.038 INFO:teuthology.orchestra.run.smithi050.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2023-10-06T01:18:41.039 INFO:teuthology.orchestra.run.smithi050.stdout: socat x86_64 1.7.3.3-2.el8 rhel-8-for-x86_64-appstream-rpms 302 k 2023-10-06T01:18:41.039 INFO:teuthology.orchestra.run.smithi050.stdout: thrift x86_64 0.13.0-2.el8 epel 1.7 M 2023-10-06T01:18:41.039 INFO:teuthology.orchestra.run.smithi050.stdout: xmlstarlet x86_64 1.6.1-20.el8 lab-extras 70 k 2023-10-06T01:18:41.039 INFO:teuthology.orchestra.run.smithi050.stdout: zlib-devel x86_64 1.2.11-17.el8 rhel-8-for-x86_64-baseos-rpms 58 k 2023-10-06T01:18:41.039 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-10-06T01:18:41.039 INFO:teuthology.orchestra.run.smithi050.stdout:Transaction Summary 2023-10-06T01:18:41.039 INFO:teuthology.orchestra.run.smithi050.stdout:====================================================================================================================== 2023-10-06T01:18:41.039 INFO:teuthology.orchestra.run.smithi050.stdout:Install 118 Packages 2023-10-06T01:18:41.039 INFO:teuthology.orchestra.run.smithi050.stdout:Upgrade 2 Packages 2023-10-06T01:18:41.039 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-10-06T01:18:41.041 INFO:teuthology.orchestra.run.smithi050.stdout:Total download size: 201 M 2023-10-06T01:18:41.041 INFO:teuthology.orchestra.run.smithi050.stdout:Downloading Packages: 2023-10-06T01:18:41.353 INFO:teuthology.orchestra.run.smithi050.stdout:(1/120): ceph-17.2.6-1296.g736ac5ba.el8.x86_64. 42 kB/s | 6.4 kB 00:00 2023-10-06T01:18:41.644 INFO:teuthology.orchestra.run.smithi050.stdout:(2/120): ceph-fuse-17.2.6-1296.g736ac5ba.el8.x8 2.9 MB/s | 876 kB 00:00 2023-10-06T01:18:41.683 INFO:teuthology.orchestra.run.smithi050.stdout:(3/120): ceph-immutable-object-cache-17.2.6-129 4.1 MB/s | 162 kB 00:00 2023-10-06T01:18:42.031 INFO:teuthology.orchestra.run.smithi050.stdout:(4/120): ceph-mds-17.2.6-1296.g736ac5ba.el8.x86 6.6 MB/s | 2.3 MB 00:00 2023-10-06T01:18:42.156 INFO:teuthology.orchestra.run.smithi050.stdout:(5/120): ceph-base-17.2.6-1296.g736ac5ba.el8.x8 5.4 MB/s | 5.2 MB 00:00 2023-10-06T01:18:42.253 INFO:teuthology.orchestra.run.smithi050.stdout:(6/120): ceph-mgr-17.2.6-1296.g736ac5ba.el8.x86 7.1 MB/s | 1.6 MB 00:00 2023-10-06T01:18:42.571 INFO:teuthology.orchestra.run.smithi050.stdout:(7/120): ceph-mon-17.2.6-1296.g736ac5ba.el8.x86 9.5 MB/s | 3.9 MB 00:00 2023-10-06T01:18:43.977 INFO:teuthology.orchestra.run.smithi050.stdout:(8/120): ceph-osd-17.2.6-1296.g736ac5ba.el8.x86 9.7 MB/s | 17 MB 00:01 2023-10-06T01:18:44.060 INFO:teuthology.orchestra.run.smithi050.stdout:(9/120): ceph-common-17.2.6-1296.g736ac5ba.el8. 8.2 MB/s | 23 MB 00:02 2023-10-06T01:18:44.061 INFO:teuthology.orchestra.run.smithi050.stdout:(10/120): ceph-selinux-17.2.6-1296.g736ac5ba.el 291 kB/s | 24 kB 00:00 2023-10-06T01:18:44.136 INFO:teuthology.orchestra.run.smithi050.stdout:(11/120): cephfs-mirror-17.2.6-1296.g736ac5ba.e 3.3 MB/s | 255 kB 00:00 2023-10-06T01:18:44.199 INFO:teuthology.orchestra.run.smithi050.stdout:(12/120): libcephfs-devel-17.2.6-1296.g736ac5ba 392 kB/s | 25 kB 00:00 2023-10-06T01:18:44.282 INFO:teuthology.orchestra.run.smithi050.stdout:(13/120): libcephfs2-17.2.6-1296.g736ac5ba.el8. 9.5 MB/s | 797 kB 00:00 2023-10-06T01:18:44.335 INFO:teuthology.orchestra.run.smithi050.stdout:(14/120): libcephsqlite-17.2.6-1296.g736ac5ba.e 3.2 MB/s | 174 kB 00:00 2023-10-06T01:18:44.430 INFO:teuthology.orchestra.run.smithi050.stdout:(15/120): ceph-radosgw-17.2.6-1296.g736ac5ba.el 9.0 MB/s | 17 MB 00:01 2023-10-06T01:18:44.432 INFO:teuthology.orchestra.run.smithi050.stdout:(16/120): librados-devel-17.2.6-1296.g736ac5ba. 1.3 MB/s | 130 kB 00:00 2023-10-06T01:18:44.444 INFO:teuthology.orchestra.run.smithi155.stdout:Package librados2-1:12.2.7-9.el8.x86_64 is already installed. 2023-10-06T01:18:44.445 INFO:teuthology.orchestra.run.smithi155.stdout:Package librbd1-1:12.2.7-9.el8.x86_64 is already installed. 2023-10-06T01:18:44.456 INFO:teuthology.orchestra.run.smithi155.stdout:Package NetworkManager-1:1.30.0-13.el8_4.x86_64 is already installed. 2023-10-06T01:18:44.457 INFO:teuthology.orchestra.run.smithi155.stdout:Package iproute-5.9.0-4.el8.x86_64 is already installed. 2023-10-06T01:18:44.457 INFO:teuthology.orchestra.run.smithi155.stdout:Package util-linux-2.32.1-27.el8.x86_64 is already installed. 2023-10-06T01:18:44.458 INFO:teuthology.orchestra.run.smithi155.stdout:Package libacl-devel-2.2.53-1.el8.x86_64 is already installed. 2023-10-06T01:18:44.460 INFO:teuthology.orchestra.run.smithi155.stdout:Package libattr-devel-2.4.48-3.el8.x86_64 is already installed. 2023-10-06T01:18:44.463 INFO:teuthology.orchestra.run.smithi155.stdout:Package xfsdump-3.1.8-2.el8.x86_64 is already installed. 2023-10-06T01:18:44.464 INFO:teuthology.orchestra.run.smithi155.stdout:Package xfsprogs-5.0.0-8.el8.x86_64 is already installed. 2023-10-06T01:18:44.481 INFO:teuthology.orchestra.run.smithi050.stdout:(17/120): libradosstriper1-17.2.6-1296.g736ac5b 9.8 MB/s | 507 kB 00:00 2023-10-06T01:18:44.548 INFO:teuthology.orchestra.run.smithi050.stdout:(18/120): python3-ceph-argparse-17.2.6-1296.g73 661 kB/s | 45 kB 00:00 2023-10-06T01:18:44.625 INFO:teuthology.orchestra.run.smithi050.stdout:(19/120): python3-ceph-common-17.2.6-1296.g736a 1.5 MB/s | 115 kB 00:00 2023-10-06T01:18:44.707 INFO:teuthology.orchestra.run.smithi050.stdout:(20/120): python3-cephfs-17.2.6-1296.g736ac5ba. 2.3 MB/s | 190 kB 00:00 2023-10-06T01:18:44.798 INFO:teuthology.orchestra.run.smithi050.stdout:(21/120): python3-rados-17.2.6-1296.g736ac5ba.e 4.0 MB/s | 371 kB 00:00 2023-10-06T01:18:44.824 INFO:teuthology.orchestra.run.smithi050.stdout:(22/120): librgw2-17.2.6-1296.g736ac5ba.el8.x86 14 MB/s | 5.6 MB 00:00 2023-10-06T01:18:44.848 INFO:teuthology.orchestra.run.smithi050.stdout:(23/120): python3-rbd-17.2.6-1296.g736ac5ba.el8 7.1 MB/s | 358 kB 00:00 2023-10-06T01:18:44.877 INFO:teuthology.orchestra.run.smithi050.stdout:(24/120): python3-rgw-17.2.6-1296.g736ac5ba.el8 2.0 MB/s | 107 kB 00:00 2023-10-06T01:18:44.889 INFO:teuthology.orchestra.run.smithi050.stdout:(25/120): rbd-fuse-17.2.6-1296.g736ac5ba.el8.x8 2.2 MB/s | 90 kB 00:00 2023-10-06T01:18:44.959 INFO:teuthology.orchestra.run.smithi155.stdout:Dependencies resolved. 2023-10-06T01:18:44.971 INFO:teuthology.orchestra.run.smithi155.stdout:====================================================================================================================== 2023-10-06T01:18:44.971 INFO:teuthology.orchestra.run.smithi155.stdout: Package Arch Version Repository Size 2023-10-06T01:18:44.971 INFO:teuthology.orchestra.run.smithi155.stdout:====================================================================================================================== 2023-10-06T01:18:44.971 INFO:teuthology.orchestra.run.smithi155.stdout:Installing: 2023-10-06T01:18:44.972 INFO:teuthology.orchestra.run.smithi155.stdout: bison x86_64 3.0.4-10.el8 rhel-8-for-x86_64-appstream-rpms 688 k 2023-10-06T01:18:44.972 INFO:teuthology.orchestra.run.smithi155.stdout: ceph x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 6.4 k 2023-10-06T01:18:44.972 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-base x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 5.2 M 2023-10-06T01:18:44.972 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-fuse x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 876 k 2023-10-06T01:18:44.972 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-immutable-object-cache x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 162 k 2023-10-06T01:18:44.972 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-mgr x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 1.6 M 2023-10-06T01:18:44.972 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-mgr-cephadm noarch 2:17.2.6-1296.g736ac5ba.el8 ceph-noarch 121 k 2023-10-06T01:18:44.973 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-mgr-dashboard noarch 2:17.2.6-1296.g736ac5ba.el8 ceph-noarch 1.7 M 2023-10-06T01:18:44.973 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-mgr-diskprediction-local noarch 2:17.2.6-1296.g736ac5ba.el8 ceph-noarch 7.4 M 2023-10-06T01:18:44.973 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-mgr-rook noarch 2:17.2.6-1296.g736ac5ba.el8 ceph-noarch 47 k 2023-10-06T01:18:44.973 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-radosgw x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 17 M 2023-10-06T01:18:44.973 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-test x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 52 M 2023-10-06T01:18:44.973 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-volume noarch 2:17.2.6-1296.g736ac5ba.el8 ceph-noarch 267 k 2023-10-06T01:18:44.973 INFO:teuthology.orchestra.run.smithi155.stdout: cephadm noarch 2:17.2.6-1296.g736ac5ba.el8 ceph-noarch 80 k 2023-10-06T01:18:44.973 INFO:teuthology.orchestra.run.smithi155.stdout: cephfs-mirror x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 255 k 2023-10-06T01:18:44.974 INFO:teuthology.orchestra.run.smithi155.stdout: cephfs-top noarch 2:17.2.6-1296.g736ac5ba.el8 ceph-noarch 18 k 2023-10-06T01:18:44.974 INFO:teuthology.orchestra.run.smithi155.stdout: elfutils-libelf-devel x86_64 0.182-3.el8 rhel-8-for-x86_64-baseos-rpms 59 k 2023-10-06T01:18:44.974 INFO:teuthology.orchestra.run.smithi155.stdout: flex x86_64 2.6.1-9.el8 rhel-8-for-x86_64-appstream-rpms 320 k 2023-10-06T01:18:44.974 INFO:teuthology.orchestra.run.smithi155.stdout: libaio-devel x86_64 0.3.112-1.el8 rhel-8-for-x86_64-baseos-rpms 19 k 2023-10-06T01:18:44.974 INFO:teuthology.orchestra.run.smithi155.stdout: libcephfs-devel x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 25 k 2023-10-06T01:18:44.974 INFO:teuthology.orchestra.run.smithi155.stdout: libcephfs2 x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 797 k 2023-10-06T01:18:44.974 INFO:teuthology.orchestra.run.smithi155.stdout: librados-devel x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 130 k 2023-10-06T01:18:44.975 INFO:teuthology.orchestra.run.smithi155.stdout: libtool x86_64 2.4.6-25.el8 rhel-8-for-x86_64-appstream-rpms 709 k 2023-10-06T01:18:44.975 INFO:teuthology.orchestra.run.smithi155.stdout: libuuid-devel x86_64 2.32.1-27.el8 rhel-8-for-x86_64-baseos-rpms 97 k 2023-10-06T01:18:44.975 INFO:teuthology.orchestra.run.smithi155.stdout: openssl-devel x86_64 1:1.1.1g-15.el8_3 rhel-8-for-x86_64-baseos-rpms 2.3 M 2023-10-06T01:18:44.975 INFO:teuthology.orchestra.run.smithi155.stdout: python3-cephfs x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 190 k 2023-10-06T01:18:44.975 INFO:teuthology.orchestra.run.smithi155.stdout: python3-rados x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 371 k 2023-10-06T01:18:44.975 INFO:teuthology.orchestra.run.smithi155.stdout: python3-rbd x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 358 k 2023-10-06T01:18:44.975 INFO:teuthology.orchestra.run.smithi155.stdout: python3-rgw x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 107 k 2023-10-06T01:18:44.975 INFO:teuthology.orchestra.run.smithi155.stdout: rbd-fuse x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 90 k 2023-10-06T01:18:44.976 INFO:teuthology.orchestra.run.smithi155.stdout: rbd-mirror x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 3.5 M 2023-10-06T01:18:44.976 INFO:teuthology.orchestra.run.smithi155.stdout: rbd-nbd x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 173 k 2023-10-06T01:18:44.976 INFO:teuthology.orchestra.run.smithi155.stdout: xfsprogs-devel x86_64 5.0.0-8.el8 rhel-8-for-x86_64-baseos-rpms 70 k 2023-10-06T01:18:44.976 INFO:teuthology.orchestra.run.smithi155.stdout:Upgrading: 2023-10-06T01:18:44.976 INFO:teuthology.orchestra.run.smithi155.stdout: librados2 x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 3.5 M 2023-10-06T01:18:44.976 INFO:teuthology.orchestra.run.smithi155.stdout: librbd1 x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 3.6 M 2023-10-06T01:18:44.976 INFO:teuthology.orchestra.run.smithi155.stdout:Installing dependencies: 2023-10-06T01:18:44.976 INFO:teuthology.orchestra.run.smithi155.stdout: automake noarch 1.16.1-7.el8 rhel-8-for-x86_64-appstream-rpms 713 k 2023-10-06T01:18:44.977 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-common x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 23 M 2023-10-06T01:18:44.977 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-grafana-dashboards noarch 2:17.2.6-1296.g736ac5ba.el8 ceph-noarch 23 k 2023-10-06T01:18:44.977 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-mds x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 2.3 M 2023-10-06T01:18:44.977 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-mgr-modules-core noarch 2:17.2.6-1296.g736ac5ba.el8 ceph-noarch 238 k 2023-10-06T01:18:44.977 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-mon x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 3.9 M 2023-10-06T01:18:44.977 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-osd x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 17 M 2023-10-06T01:18:44.977 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-prometheus-alerts noarch 2:17.2.6-1296.g736ac5ba.el8 ceph-noarch 14 k 2023-10-06T01:18:44.977 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-selinux x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 24 k 2023-10-06T01:18:44.978 INFO:teuthology.orchestra.run.smithi155.stdout: fuse x86_64 2.9.7-12.el8 rhel-8-for-x86_64-baseos-rpms 83 k 2023-10-06T01:18:44.978 INFO:teuthology.orchestra.run.smithi155.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2023-10-06T01:18:44.978 INFO:teuthology.orchestra.run.smithi155.stdout: jq x86_64 1.5-12.el8 rhel-8-for-x86_64-appstream-rpms 161 k 2023-10-06T01:18:44.978 INFO:teuthology.orchestra.run.smithi155.stdout: keyutils-libs-devel x86_64 1.5.10-6.el8 rhel-8-for-x86_64-baseos-rpms 48 k 2023-10-06T01:18:44.978 INFO:teuthology.orchestra.run.smithi155.stdout: krb5-devel x86_64 1.18.2-8.3.el8_4 rhel-8-for-x86_64-baseos-rpms 559 k 2023-10-06T01:18:44.978 INFO:teuthology.orchestra.run.smithi155.stdout: libcephsqlite x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 174 k 2023-10-06T01:18:44.978 INFO:teuthology.orchestra.run.smithi155.stdout: libcom_err-devel x86_64 1.45.6-1.el8 rhel-8-for-x86_64-baseos-rpms 38 k 2023-10-06T01:18:44.979 INFO:teuthology.orchestra.run.smithi155.stdout: libgfortran x86_64 8.4.1-1.el8 rhel-8-for-x86_64-baseos-rpms 639 k 2023-10-06T01:18:44.979 INFO:teuthology.orchestra.run.smithi155.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2023-10-06T01:18:44.979 INFO:teuthology.orchestra.run.smithi155.stdout: libquadmath x86_64 8.4.1-1.el8 rhel-8-for-x86_64-baseos-rpms 169 k 2023-10-06T01:18:44.979 INFO:teuthology.orchestra.run.smithi155.stdout: librabbitmq x86_64 0.9.0-3.el8 rhel-8-for-x86_64-baseos-rpms 47 k 2023-10-06T01:18:44.979 INFO:teuthology.orchestra.run.smithi155.stdout: libradosstriper1 x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 507 k 2023-10-06T01:18:44.979 INFO:teuthology.orchestra.run.smithi155.stdout: librdkafka x86_64 0.11.4-1.el8 rhel-8-for-x86_64-appstream-rpms 353 k 2023-10-06T01:18:44.979 INFO:teuthology.orchestra.run.smithi155.stdout: librgw2 x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 5.6 M 2023-10-06T01:18:44.979 INFO:teuthology.orchestra.run.smithi155.stdout: libselinux-devel x86_64 2.9-5.el8 rhel-8-for-x86_64-baseos-rpms 200 k 2023-10-06T01:18:44.980 INFO:teuthology.orchestra.run.smithi155.stdout: libsepol-devel x86_64 2.9-2.el8 rhel-8-for-x86_64-baseos-rpms 86 k 2023-10-06T01:18:44.980 INFO:teuthology.orchestra.run.smithi155.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2023-10-06T01:18:44.980 INFO:teuthology.orchestra.run.smithi155.stdout: libverto-devel x86_64 0.3.0-5.el8 rhel-8-for-x86_64-baseos-rpms 18 k 2023-10-06T01:18:44.980 INFO:teuthology.orchestra.run.smithi155.stdout: lttng-ust x86_64 2.8.1-11.el8 rhel-8-for-x86_64-appstream-rpms 259 k 2023-10-06T01:18:44.980 INFO:teuthology.orchestra.run.smithi155.stdout: oniguruma x86_64 6.8.2-2.el8 rhel-8-for-x86_64-appstream-rpms 187 k 2023-10-06T01:18:44.980 INFO:teuthology.orchestra.run.smithi155.stdout: openblas x86_64 0.3.12-1.el8 rhel-8-for-x86_64-appstream-rpms 4.6 M 2023-10-06T01:18:44.980 INFO:teuthology.orchestra.run.smithi155.stdout: openblas-threads x86_64 0.3.12-1.el8 rhel-8-for-x86_64-appstream-rpms 4.7 M 2023-10-06T01:18:44.980 INFO:teuthology.orchestra.run.smithi155.stdout: pcre2-devel x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 605 k 2023-10-06T01:18:44.980 INFO:teuthology.orchestra.run.smithi155.stdout: pcre2-utf16 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 229 k 2023-10-06T01:18:44.981 INFO:teuthology.orchestra.run.smithi155.stdout: pcre2-utf32 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 220 k 2023-10-06T01:18:44.981 INFO:teuthology.orchestra.run.smithi155.stdout: python3-asyncssh noarch 2.7.0-2.el8 epel 476 k 2023-10-06T01:18:44.981 INFO:teuthology.orchestra.run.smithi155.stdout: python3-babel noarch 2.5.1-5.el8 rhel-8-for-x86_64-appstream-rpms 4.8 M 2023-10-06T01:18:44.981 INFO:teuthology.orchestra.run.smithi155.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2023-10-06T01:18:44.981 INFO:teuthology.orchestra.run.smithi155.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2023-10-06T01:18:44.981 INFO:teuthology.orchestra.run.smithi155.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2023-10-06T01:18:44.981 INFO:teuthology.orchestra.run.smithi155.stdout: python3-ceph-argparse x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 45 k 2023-10-06T01:18:44.982 INFO:teuthology.orchestra.run.smithi155.stdout: python3-ceph-common x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 115 k 2023-10-06T01:18:44.982 INFO:teuthology.orchestra.run.smithi155.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2023-10-06T01:18:44.982 INFO:teuthology.orchestra.run.smithi155.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2023-10-06T01:18:44.982 INFO:teuthology.orchestra.run.smithi155.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2023-10-06T01:18:44.982 INFO:teuthology.orchestra.run.smithi155.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2023-10-06T01:18:44.982 INFO:teuthology.orchestra.run.smithi155.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2023-10-06T01:18:44.983 INFO:teuthology.orchestra.run.smithi155.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2023-10-06T01:18:44.983 INFO:teuthology.orchestra.run.smithi155.stdout: python3-jinja2 noarch 2.10.1-2.el8_0 rhel-8-for-x86_64-appstream-rpms 538 k 2023-10-06T01:18:44.983 INFO:teuthology.orchestra.run.smithi155.stdout: python3-jsonpatch noarch 1.21-2.el8 rhel-8-for-x86_64-appstream-rpms 27 k 2023-10-06T01:18:44.983 INFO:teuthology.orchestra.run.smithi155.stdout: python3-jsonpointer noarch 1.10-11.el8 rhel-8-for-x86_64-appstream-rpms 20 k 2023-10-06T01:18:44.983 INFO:teuthology.orchestra.run.smithi155.stdout: python3-jwt noarch 1.6.1-2.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2023-10-06T01:18:44.983 INFO:teuthology.orchestra.run.smithi155.stdout: python3-kubernetes noarch 1:11.0.0-6.el8 epel 1.2 M 2023-10-06T01:18:44.984 INFO:teuthology.orchestra.run.smithi155.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2023-10-06T01:18:44.984 INFO:teuthology.orchestra.run.smithi155.stdout: python3-mako noarch 1.0.6-13.el8 rhel-8-for-x86_64-appstream-rpms 157 k 2023-10-06T01:18:44.984 INFO:teuthology.orchestra.run.smithi155.stdout: python3-markupsafe x86_64 0.23-19.el8 rhel-8-for-x86_64-appstream-rpms 39 k 2023-10-06T01:18:44.984 INFO:teuthology.orchestra.run.smithi155.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2023-10-06T01:18:44.984 INFO:teuthology.orchestra.run.smithi155.stdout: python3-natsort noarch 7.1.1-2.el8 epel 60 k 2023-10-06T01:18:44.985 INFO:teuthology.orchestra.run.smithi155.stdout: python3-numpy x86_64 1:1.14.3-9.el8 rhel-8-for-x86_64-appstream-rpms 3.7 M 2023-10-06T01:18:44.985 INFO:teuthology.orchestra.run.smithi155.stdout: python3-numpy-f2py x86_64 1:1.14.3-9.el8 rhel-8-for-x86_64-appstream-rpms 225 k 2023-10-06T01:18:44.985 INFO:teuthology.orchestra.run.smithi155.stdout: python3-oauthlib noarch 2.1.0-1.el8 rhel-8-for-x86_64-baseos-rpms 155 k 2023-10-06T01:18:44.985 INFO:teuthology.orchestra.run.smithi155.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2023-10-06T01:18:44.985 INFO:teuthology.orchestra.run.smithi155.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2023-10-06T01:18:44.985 INFO:teuthology.orchestra.run.smithi155.stdout: python3-prettytable noarch 0.7.2-14.el8 rhel-8-for-x86_64-appstream-rpms 44 k 2023-10-06T01:18:44.985 INFO:teuthology.orchestra.run.smithi155.stdout: python3-pyasn1 noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 126 k 2023-10-06T01:18:44.986 INFO:teuthology.orchestra.run.smithi155.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 110 k 2023-10-06T01:18:44.986 INFO:teuthology.orchestra.run.smithi155.stdout: python3-pytz noarch 2017.2-9.el8 rhel-8-for-x86_64-appstream-rpms 54 k 2023-10-06T01:18:44.986 INFO:teuthology.orchestra.run.smithi155.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2023-10-06T01:18:44.986 INFO:teuthology.orchestra.run.smithi155.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2023-10-06T01:18:44.986 INFO:teuthology.orchestra.run.smithi155.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2023-10-06T01:18:44.986 INFO:teuthology.orchestra.run.smithi155.stdout: python3-rsa noarch 4.9-2.el8 epel 64 k 2023-10-06T01:18:44.986 INFO:teuthology.orchestra.run.smithi155.stdout: python3-scipy x86_64 1.0.0-20.module+el8.1.0+3334+5cb623d7 rhel-8-for-x86_64-appstream-rpms 15 M 2023-10-06T01:18:44.987 INFO:teuthology.orchestra.run.smithi155.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2023-10-06T01:18:44.987 INFO:teuthology.orchestra.run.smithi155.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2023-10-06T01:18:44.987 INFO:teuthology.orchestra.run.smithi155.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2023-10-06T01:18:44.987 INFO:teuthology.orchestra.run.smithi155.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2023-10-06T01:18:44.987 INFO:teuthology.orchestra.run.smithi155.stdout: python3-waitress noarch 1.4.3-1.el8 epel 255 k 2023-10-06T01:18:44.987 INFO:teuthology.orchestra.run.smithi155.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2023-10-06T01:18:44.987 INFO:teuthology.orchestra.run.smithi155.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2023-10-06T01:18:44.988 INFO:teuthology.orchestra.run.smithi155.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2023-10-06T01:18:44.988 INFO:teuthology.orchestra.run.smithi155.stdout: python3-werkzeug noarch 0.12.2-4.el8 rhel-8-for-x86_64-appstream-rpms 457 k 2023-10-06T01:18:44.988 INFO:teuthology.orchestra.run.smithi155.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2023-10-06T01:18:44.988 INFO:teuthology.orchestra.run.smithi155.stdout: socat x86_64 1.7.3.3-2.el8 rhel-8-for-x86_64-appstream-rpms 302 k 2023-10-06T01:18:44.988 INFO:teuthology.orchestra.run.smithi155.stdout: thrift x86_64 0.13.0-2.el8 epel 1.7 M 2023-10-06T01:18:44.988 INFO:teuthology.orchestra.run.smithi155.stdout: xmlstarlet x86_64 1.6.1-20.el8 lab-extras 70 k 2023-10-06T01:18:44.989 INFO:teuthology.orchestra.run.smithi155.stdout: zlib-devel x86_64 1.2.11-17.el8 rhel-8-for-x86_64-baseos-rpms 58 k 2023-10-06T01:18:44.989 INFO:teuthology.orchestra.run.smithi155.stdout: 2023-10-06T01:18:44.989 INFO:teuthology.orchestra.run.smithi155.stdout:Transaction Summary 2023-10-06T01:18:44.989 INFO:teuthology.orchestra.run.smithi155.stdout:====================================================================================================================== 2023-10-06T01:18:44.989 INFO:teuthology.orchestra.run.smithi155.stdout:Install 118 Packages 2023-10-06T01:18:44.989 INFO:teuthology.orchestra.run.smithi155.stdout:Upgrade 2 Packages 2023-10-06T01:18:44.989 INFO:teuthology.orchestra.run.smithi155.stdout: 2023-10-06T01:18:44.990 INFO:teuthology.orchestra.run.smithi050.stdout:(26/120): rbd-nbd-17.2.6-1296.g736ac5ba.el8.x86 2.0 MB/s | 173 kB 00:00 2023-10-06T01:18:44.990 INFO:teuthology.orchestra.run.smithi155.stdout:Total download size: 201 M 2023-10-06T01:18:44.990 INFO:teuthology.orchestra.run.smithi155.stdout:Downloading Packages: 2023-10-06T01:18:45.056 INFO:teuthology.orchestra.run.smithi050.stdout:(27/120): ceph-grafana-dashboards-17.2.6-1296.g 276 kB/s | 23 kB 00:00 2023-10-06T01:18:45.105 INFO:teuthology.orchestra.run.smithi050.stdout:(28/120): rbd-mirror-17.2.6-1296.g736ac5ba.el8. 15 MB/s | 3.5 MB 00:00 2023-10-06T01:18:45.107 INFO:teuthology.orchestra.run.smithi050.stdout:(29/120): ceph-mgr-cephadm-17.2.6-1296.g736ac5b 2.3 MB/s | 121 kB 00:00 2023-10-06T01:18:45.239 INFO:teuthology.orchestra.run.smithi050.stdout:(30/120): ceph-mgr-dashboard-17.2.6-1296.g736ac 13 MB/s | 1.7 MB 00:00 2023-10-06T01:18:45.279 INFO:teuthology.orchestra.run.smithi050.stdout:(31/120): ceph-mgr-modules-core-17.2.6-1296.g73 6.0 MB/s | 238 kB 00:00 2023-10-06T01:18:45.316 INFO:teuthology.orchestra.run.smithi050.stdout:(32/120): ceph-mgr-rook-17.2.6-1296.g736ac5ba.e 1.3 MB/s | 47 kB 00:00 2023-10-06T01:18:45.352 INFO:teuthology.orchestra.run.smithi050.stdout:(33/120): ceph-prometheus-alerts-17.2.6-1296.g7 401 kB/s | 14 kB 00:00 2023-10-06T01:18:45.400 INFO:teuthology.orchestra.run.smithi050.stdout:(34/120): ceph-volume-17.2.6-1296.g736ac5ba.el8 5.5 MB/s | 267 kB 00:00 2023-10-06T01:18:45.443 INFO:teuthology.orchestra.run.smithi050.stdout:(35/120): cephadm-17.2.6-1296.g736ac5ba.el8.noa 1.8 MB/s | 80 kB 00:00 2023-10-06T01:18:45.458 INFO:teuthology.orchestra.run.smithi155.stdout:(1/120): ceph-17.2.6-1296.g736ac5ba.el8.x86_64. 53 kB/s | 6.4 kB 00:00 2023-10-06T01:18:45.485 INFO:teuthology.orchestra.run.smithi050.stdout:(36/120): cephfs-top-17.2.6-1296.g736ac5ba.el8. 434 kB/s | 18 kB 00:00 2023-10-06T01:18:45.880 INFO:teuthology.orchestra.run.smithi155.stdout:(2/120): ceph-fuse-17.2.6-1296.g736ac5ba.el8.x8 2.0 MB/s | 876 kB 00:00 2023-10-06T01:18:45.978 INFO:teuthology.orchestra.run.smithi155.stdout:(3/120): ceph-immutable-object-cache-17.2.6-129 1.6 MB/s | 162 kB 00:00 2023-10-06T01:18:46.021 INFO:teuthology.orchestra.run.smithi050.stdout:(37/120): ceph-mgr-diskprediction-local-17.2.6- 8.1 MB/s | 7.4 MB 00:00 2023-10-06T01:18:46.077 INFO:teuthology.orchestra.run.smithi050.stdout:(38/120): gperftools-libs-2.7-9.el8.x86_64.rpm 518 kB/s | 306 kB 00:00 2023-10-06T01:18:46.162 INFO:teuthology.orchestra.run.smithi050.stdout:(39/120): libunwind-1.3.1-3.el8.x86_64.rpm 887 kB/s | 75 kB 00:00 2023-10-06T01:18:46.333 INFO:teuthology.orchestra.run.smithi050.stdout:(40/120): python3-asyncssh-2.7.0-2.el8.noarch.r 2.7 MB/s | 476 kB 00:00 2023-10-06T01:18:46.347 INFO:teuthology.orchestra.run.smithi155.stdout:(4/120): ceph-base-17.2.6-1296.g736ac5ba.el8.x8 5.1 MB/s | 5.2 MB 00:01 2023-10-06T01:18:46.417 INFO:teuthology.orchestra.run.smithi050.stdout:(41/120): python3-bcrypt-3.1.6-2.el8.1.x86_64.r 519 kB/s | 44 kB 00:00 2023-10-06T01:18:46.445 INFO:teuthology.orchestra.run.smithi050.stdout:(42/120): liboath-2.6.2-3.el8.x86_64.rpm 139 kB/s | 59 kB 00:00 2023-10-06T01:18:46.504 INFO:teuthology.orchestra.run.smithi050.stdout:(43/120): python3-beautifulsoup4-4.6.3-2.el8.1. 2.1 MB/s | 185 kB 00:00 2023-10-06T01:18:46.528 INFO:teuthology.orchestra.run.smithi155.stdout:(5/120): ceph-mds-17.2.6-1296.g736ac5ba.el8.x86 4.2 MB/s | 2.3 MB 00:00 2023-10-06T01:18:46.530 INFO:teuthology.orchestra.run.smithi050.stdout:(44/120): python3-cachetools-3.1.1-4.el8.noarch 393 kB/s | 33 kB 00:00 2023-10-06T01:18:46.551 INFO:teuthology.orchestra.run.smithi155.stdout:(6/120): ceph-mgr-17.2.6-1296.g736ac5ba.el8.x86 7.7 MB/s | 1.6 MB 00:00 2023-10-06T01:18:46.587 INFO:teuthology.orchestra.run.smithi050.stdout:(45/120): python3-certifi-2018.10.15-7.el8.noar 195 kB/s | 16 kB 00:00 2023-10-06T01:18:46.678 INFO:teuthology.orchestra.run.smithi050.stdout:(46/120): python3-cherrypy-18.4.0-1.el8.noarch. 4.2 MB/s | 384 kB 00:00 2023-10-06T01:18:46.698 INFO:teuthology.orchestra.run.smithi050.stdout:(47/120): python3-cheroot-8.5.2-1.el8.noarch.rp 1.0 MB/s | 173 kB 00:00 2023-10-06T01:18:46.763 INFO:teuthology.orchestra.run.smithi050.stdout:(48/120): python3-google-auth-1.1.1-10.el8.noar 957 kB/s | 81 kB 00:00 2023-10-06T01:18:46.782 INFO:teuthology.orchestra.run.smithi050.stdout:(49/120): python3-jaraco-6.2-6.el8.noarch.rpm 132 kB/s | 11 kB 00:00 2023-10-06T01:18:46.847 INFO:teuthology.orchestra.run.smithi050.stdout:(50/120): python3-jaraco-functools-2.0-4.el8.no 210 kB/s | 18 kB 00:00 2023-10-06T01:18:46.931 INFO:teuthology.orchestra.run.smithi050.stdout:(51/120): python3-logutils-0.3.5-11.el8.noarch. 581 kB/s | 49 kB 00:00 2023-10-06T01:18:47.018 INFO:teuthology.orchestra.run.smithi050.stdout:(52/120): python3-more-itertools-7.2.0-3.el8.no 695 kB/s | 59 kB 00:00 2023-10-06T01:18:47.043 INFO:teuthology.orchestra.run.smithi050.stdout:(53/120): python3-kubernetes-11.0.0-6.el8.noarc 4.5 MB/s | 1.2 MB 00:00 2023-10-06T01:18:47.101 INFO:teuthology.orchestra.run.smithi050.stdout:(54/120): python3-natsort-7.1.1-2.el8.noarch.rp 712 kB/s | 60 kB 00:00 2023-10-06T01:18:47.135 INFO:teuthology.orchestra.run.smithi050.stdout:(55/120): python3-pecan-1.3.2-9.el8.noarch.rpm 3.0 MB/s | 283 kB 00:00 2023-10-06T01:18:47.185 INFO:teuthology.orchestra.run.smithi050.stdout:(56/120): python3-portend-2.6-1.el8.noarch.rpm 186 kB/s | 16 kB 00:00 2023-10-06T01:18:47.221 INFO:teuthology.orchestra.run.smithi050.stdout:(57/120): python3-repoze-lru-0.7-6.el8.noarch.r 396 kB/s | 34 kB 00:00 2023-10-06T01:18:47.271 INFO:teuthology.orchestra.run.smithi050.stdout:(58/120): python3-routes-2.4.1-12.el8.noarch.rp 2.2 MB/s | 196 kB 00:00 2023-10-06T01:18:47.305 INFO:teuthology.orchestra.run.smithi050.stdout:(59/120): python3-rsa-4.9-2.el8.noarch.rpm 756 kB/s | 64 kB 00:00 2023-10-06T01:18:47.356 INFO:teuthology.orchestra.run.smithi050.stdout:(60/120): python3-simplegeneric-0.8.1-17.el8.no 222 kB/s | 19 kB 00:00 2023-10-06T01:18:47.369 INFO:teuthology.orchestra.run.smithi155.stdout:(7/120): ceph-mon-17.2.6-1296.g736ac5ba.el8.x86 4.7 MB/s | 3.9 MB 00:00 2023-10-06T01:18:47.389 INFO:teuthology.orchestra.run.smithi050.stdout:(61/120): python3-singledispatch-3.4.0.3-18.el8 286 kB/s | 24 kB 00:00 2023-10-06T01:18:47.440 INFO:teuthology.orchestra.run.smithi050.stdout:(62/120): python3-tempora-1.14.1-5.el8.noarch.r 348 kB/s | 29 kB 00:00 2023-10-06T01:18:47.473 INFO:teuthology.orchestra.run.smithi050.stdout:(63/120): python3-trustme-0.6.0-4.el8.noarch.rp 329 kB/s | 27 kB 00:00 2023-10-06T01:18:47.528 INFO:teuthology.orchestra.run.smithi050.stdout:(64/120): python3-waitress-1.4.3-1.el8.noarch.r 2.8 MB/s | 255 kB 00:00 2023-10-06T01:18:47.561 INFO:teuthology.orchestra.run.smithi050.stdout:(65/120): python3-webob-1.8.5-1.el8.1.noarch.rp 2.8 MB/s | 251 kB 00:00 2023-10-06T01:18:47.612 INFO:teuthology.orchestra.run.smithi050.stdout:(66/120): python3-websocket-client-0.56.0-5.el8 727 kB/s | 61 kB 00:00 2023-10-06T01:18:47.646 INFO:teuthology.orchestra.run.smithi050.stdout:(67/120): python3-webtest-2.0.33-1.el8.noarch.r 1.0 MB/s | 85 kB 00:00 2023-10-06T01:18:47.696 INFO:teuthology.orchestra.run.smithi050.stdout:(68/120): python3-zc-lockfile-2.0-2.el8.noarch. 274 kB/s | 23 kB 00:00 2023-10-06T01:18:47.701 INFO:teuthology.orchestra.run.smithi050.stdout:(69/120): xmlstarlet-1.6.1-20.el8.x86_64.rpm 16 MB/s | 70 kB 00:00 2023-10-06T01:18:47.735 INFO:teuthology.orchestra.run.smithi050.stdout:(70/120): libaio-devel-0.3.112-1.el8.x86_64.rpm 550 kB/s | 19 kB 00:00 2023-10-06T01:18:47.750 INFO:teuthology.orchestra.run.smithi050.stdout:(71/120): python3-jwt-1.6.1-2.el8.noarch.rpm 2.9 MB/s | 43 kB 00:00 2023-10-06T01:18:47.767 INFO:teuthology.orchestra.run.smithi050.stdout:(72/120): python3-oauthlib-2.1.0-1.el8.noarch.r 8.9 MB/s | 155 kB 00:00 2023-10-06T01:18:47.784 INFO:teuthology.orchestra.run.smithi050.stdout:(73/120): pcre2-utf32-10.32-2.el8.x86_64.rpm 13 MB/s | 220 kB 00:00 2023-10-06T01:18:47.798 INFO:teuthology.orchestra.run.smithi050.stdout:(74/120): keyutils-libs-devel-1.5.10-6.el8.x86_ 3.5 MB/s | 48 kB 00:00 2023-10-06T01:18:47.816 INFO:teuthology.orchestra.run.smithi050.stdout:(75/120): pcre2-utf16-10.32-2.el8.x86_64.rpm 12 MB/s | 229 kB 00:00 2023-10-06T01:18:47.825 INFO:teuthology.orchestra.run.smithi050.stdout:(76/120): thrift-0.13.0-2.el8.x86_64.rpm 9.7 MB/s | 1.7 MB 00:00 2023-10-06T01:18:47.830 INFO:teuthology.orchestra.run.smithi050.stdout:(77/120): python3-requests-oauthlib-1.0.0-1.el8 3.2 MB/s | 43 kB 00:00 2023-10-06T01:18:47.842 INFO:teuthology.orchestra.run.smithi050.stdout:(78/120): libverto-devel-0.3.0-5.el8.x86_64.rpm 1.4 MB/s | 18 kB 00:00 2023-10-06T01:18:47.870 INFO:teuthology.orchestra.run.smithi050.stdout:(79/120): pcre2-devel-10.32-2.el8.x86_64.rpm 21 MB/s | 605 kB 00:00 2023-10-06T01:18:47.885 INFO:teuthology.orchestra.run.smithi050.stdout:(80/120): fuse-2.9.7-12.el8.x86_64.rpm 5.7 MB/s | 83 kB 00:00 2023-10-06T01:18:47.904 INFO:teuthology.orchestra.run.smithi050.stdout:(81/120): openssl-devel-1.1.1g-15.el8_3.x86_64. 30 MB/s | 2.3 MB 00:00 2023-10-06T01:18:47.906 INFO:teuthology.orchestra.run.smithi050.stdout:(82/120): elfutils-libelf-devel-0.182-3.el8.x86 2.8 MB/s | 59 kB 00:00 2023-10-06T01:18:47.919 INFO:teuthology.orchestra.run.smithi050.stdout:(83/120): libcom_err-devel-1.45.6-1.el8.x86_64. 2.8 MB/s | 38 kB 00:00 2023-10-06T01:18:47.921 INFO:teuthology.orchestra.run.smithi050.stdout:(84/120): libquadmath-8.4.1-1.el8.x86_64.rpm 9.8 MB/s | 169 kB 00:00 2023-10-06T01:18:47.934 INFO:teuthology.orchestra.run.smithi050.stdout:(85/120): libsepol-devel-2.9-2.el8.x86_64.rpm 5.9 MB/s | 86 kB 00:00 2023-10-06T01:18:47.935 INFO:teuthology.orchestra.run.smithi050.stdout:(86/120): zlib-devel-1.2.11-17.el8.x86_64.rpm 4.0 MB/s | 58 kB 00:00 2023-10-06T01:18:47.946 INFO:teuthology.orchestra.run.smithi050.stdout:(87/120): librabbitmq-0.9.0-3.el8.x86_64.rpm 3.7 MB/s | 47 kB 00:00 2023-10-06T01:18:47.957 INFO:teuthology.orchestra.run.smithi050.stdout:(88/120): krb5-devel-1.18.2-8.3.el8_4.x86_64.rp 25 MB/s | 559 kB 00:00 2023-10-06T01:18:47.969 INFO:teuthology.orchestra.run.smithi050.stdout:(89/120): libgfortran-8.4.1-1.el8.x86_64.rpm 28 MB/s | 639 kB 00:00 2023-10-06T01:18:47.971 INFO:teuthology.orchestra.run.smithi050.stdout:(90/120): xfsprogs-devel-5.0.0-8.el8.x86_64.rpm 5.2 MB/s | 70 kB 00:00 2023-10-06T01:18:47.985 INFO:teuthology.orchestra.run.smithi050.stdout:(91/120): libselinux-devel-2.9-5.el8.x86_64.rpm 13 MB/s | 200 kB 00:00 2023-10-06T01:18:47.986 INFO:teuthology.orchestra.run.smithi050.stdout:(92/120): libuuid-devel-2.32.1-27.el8.x86_64.rp 6.3 MB/s | 97 kB 00:00 2023-10-06T01:18:47.999 INFO:teuthology.orchestra.run.smithi050.stdout:(93/120): python3-prettytable-0.7.2-14.el8.noar 3.4 MB/s | 44 kB 00:00 2023-10-06T01:18:48.012 INFO:teuthology.orchestra.run.smithi050.stdout:(94/120): python3-jsonpatch-1.21-2.el8.noarch.r 2.1 MB/s | 27 kB 00:00 2023-10-06T01:18:48.027 INFO:teuthology.orchestra.run.smithi050.stdout:(95/120): jq-1.5-12.el8.x86_64.rpm 11 MB/s | 161 kB 00:00 2023-10-06T01:18:48.048 INFO:teuthology.orchestra.run.smithi050.stdout:(96/120): flex-2.6.1-9.el8.x86_64.rpm 15 MB/s | 320 kB 00:00 2023-10-06T01:18:48.071 INFO:teuthology.orchestra.run.smithi050.stdout:(97/120): python3-werkzeug-0.12.2-4.el8.noarch. 20 MB/s | 457 kB 00:00 2023-10-06T01:18:48.202 INFO:teuthology.orchestra.run.smithi050.stdout:(98/120): python3-babel-2.5.1-5.el8.noarch.rpm 37 MB/s | 4.8 MB 00:00 2023-10-06T01:18:48.215 INFO:teuthology.orchestra.run.smithi050.stdout:(99/120): python3-markupsafe-0.23-19.el8.x86_64 2.9 MB/s | 39 kB 00:00 2023-10-06T01:18:48.243 INFO:teuthology.orchestra.run.smithi050.stdout:(100/120): bison-3.0.4-10.el8.x86_64.rpm 25 MB/s | 688 kB 00:00 2023-10-06T01:18:48.262 INFO:teuthology.orchestra.run.smithi050.stdout:(101/120): lttng-ust-2.8.1-11.el8.x86_64.rpm 14 MB/s | 259 kB 00:00 2023-10-06T01:18:48.280 INFO:teuthology.orchestra.run.smithi050.stdout:(102/120): python3-numpy-f2py-1.14.3-9.el8.x86_ 12 MB/s | 225 kB 00:00 2023-10-06T01:18:48.313 INFO:teuthology.orchestra.run.smithi155.stdout:(8/120): ceph-osd-17.2.6-1296.g736ac5ba.el8.x86 9.5 MB/s | 17 MB 00:01 2023-10-06T01:18:48.336 INFO:teuthology.orchestra.run.smithi050.stdout:(103/120): python3-scipy-1.0.0-20.module+el8.1. 41 MB/s | 15 MB 00:00 2023-10-06T01:18:48.340 INFO:teuthology.orchestra.run.smithi050.stdout:(104/120): python3-pyasn1-0.3.7-6.el8.noarch.rp 2.0 MB/s | 126 kB 00:00 2023-10-06T01:18:48.343 INFO:teuthology.orchestra.run.smithi155.stdout:(9/120): ceph-selinux-17.2.6-1296.g736ac5ba.el8 814 kB/s | 24 kB 00:00 2023-10-06T01:18:48.357 INFO:teuthology.orchestra.run.smithi050.stdout:(105/120): oniguruma-6.8.2-2.el8.x86_64.rpm 11 MB/s | 187 kB 00:00 2023-10-06T01:18:48.381 INFO:teuthology.orchestra.run.smithi050.stdout:(106/120): python3-jinja2-2.10.1-2.el8_0.noarch 22 MB/s | 538 kB 00:00 2023-10-06T01:18:48.402 INFO:teuthology.orchestra.run.smithi050.stdout:(107/120): socat-1.7.3.3-2.el8.x86_64.rpm 14 MB/s | 302 kB 00:00 2023-10-06T01:18:48.429 INFO:teuthology.orchestra.run.smithi050.stdout:(108/120): python3-numpy-1.14.3-9.el8.x86_64.rp 40 MB/s | 3.7 MB 00:00 2023-10-06T01:18:48.431 INFO:teuthology.orchestra.run.smithi050.stdout:(109/120): python3-mako-1.0.6-13.el8.noarch.rpm 5.4 MB/s | 157 kB 00:00 2023-10-06T01:18:48.445 INFO:teuthology.orchestra.run.smithi050.stdout:(110/120): python3-pyasn1-modules-0.3.7-6.el8.n 6.9 MB/s | 110 kB 00:00 2023-10-06T01:18:48.452 INFO:teuthology.orchestra.run.smithi050.stdout:(111/120): librdkafka-0.11.4-1.el8.x86_64.rpm 17 MB/s | 353 kB 00:00 2023-10-06T01:18:48.458 INFO:teuthology.orchestra.run.smithi050.stdout:(112/120): python3-jsonpointer-1.10-11.el8.noar 1.6 MB/s | 20 kB 00:00 2023-10-06T01:18:48.471 INFO:teuthology.orchestra.run.smithi050.stdout:(113/120): python3-pytz-2017.2-9.el8.noarch.rpm 3.9 MB/s | 54 kB 00:00 2023-10-06T01:18:48.479 INFO:teuthology.orchestra.run.smithi050.stdout:(114/120): libtool-2.4.6-25.el8.x86_64.rpm 25 MB/s | 709 kB 00:00 2023-10-06T01:18:48.595 INFO:teuthology.orchestra.run.smithi050.stdout:(115/120): openblas-threads-0.3.12-1.el8.x86_64 38 MB/s | 4.7 MB 00:00 2023-10-06T01:18:48.620 INFO:teuthology.orchestra.run.smithi050.stdout:(116/120): openblas-0.3.12-1.el8.x86_64.rpm 33 MB/s | 4.6 MB 00:00 2023-10-06T01:18:48.634 INFO:teuthology.orchestra.run.smithi050.stdout:(117/120): automake-1.16.1-7.el8.noarch.rpm 18 MB/s | 713 kB 00:00 2023-10-06T01:18:49.238 INFO:teuthology.orchestra.run.smithi155.stdout:(10/120): ceph-common-17.2.6-1296.g736ac5ba.el8 6.0 MB/s | 23 MB 00:03 2023-10-06T01:18:49.307 INFO:teuthology.orchestra.run.smithi155.stdout:(11/120): cephfs-mirror-17.2.6-1296.g736ac5ba.e 3.6 MB/s | 255 kB 00:00 2023-10-06T01:18:49.371 INFO:teuthology.orchestra.run.smithi155.stdout:(12/120): libcephfs-devel-17.2.6-1296.g736ac5ba 394 kB/s | 25 kB 00:00 2023-10-06T01:18:49.573 INFO:teuthology.orchestra.run.smithi155.stdout:(13/120): libcephfs2-17.2.6-1296.g736ac5ba.el8. 3.9 MB/s | 797 kB 00:00 2023-10-06T01:18:49.632 INFO:teuthology.orchestra.run.smithi155.stdout:(14/120): libcephsqlite-17.2.6-1296.g736ac5ba.e 2.9 MB/s | 174 kB 00:00 2023-10-06T01:18:49.683 INFO:teuthology.orchestra.run.smithi155.stdout:(15/120): librados-devel-17.2.6-1296.g736ac5ba. 2.5 MB/s | 130 kB 00:00 2023-10-06T01:18:49.783 INFO:teuthology.orchestra.run.smithi050.stdout:(118/120): ceph-test-17.2.6-1296.g736ac5ba.el8. 9.0 MB/s | 52 MB 00:05 2023-10-06T01:18:49.790 INFO:teuthology.orchestra.run.smithi155.stdout:(16/120): libradosstriper1-17.2.6-1296.g736ac5b 4.6 MB/s | 507 kB 00:00 2023-10-06T01:18:50.059 INFO:teuthology.orchestra.run.smithi050.stdout:(119/120): librados2-17.2.6-1296.g736ac5ba.el8. 2.4 MB/s | 3.5 MB 00:01 2023-10-06T01:18:50.284 INFO:teuthology.orchestra.run.smithi050.stdout:(120/120): librbd1-17.2.6-1296.g736ac5ba.el8.x8 2.2 MB/s | 3.6 MB 00:01 2023-10-06T01:18:50.291 INFO:teuthology.orchestra.run.smithi050.stdout:-------------------------------------------------------------------------------- 2023-10-06T01:18:50.291 INFO:teuthology.orchestra.run.smithi050.stdout:Total 22 MB/s | 201 MB 00:09 2023-10-06T01:18:50.367 INFO:teuthology.orchestra.run.smithi050.stdout:Running transaction check 2023-10-06T01:18:50.504 INFO:teuthology.orchestra.run.smithi050.stdout:Transaction check succeeded. 2023-10-06T01:18:50.505 INFO:teuthology.orchestra.run.smithi050.stdout:Running transaction test 2023-10-06T01:18:50.616 INFO:teuthology.orchestra.run.smithi155.stdout:(17/120): librgw2-17.2.6-1296.g736ac5ba.el8.x86 6.7 MB/s | 5.6 MB 00:00 2023-10-06T01:18:50.671 INFO:teuthology.orchestra.run.smithi155.stdout:(18/120): ceph-radosgw-17.2.6-1296.g736ac5ba.el 5.1 MB/s | 17 MB 00:03 2023-10-06T01:18:50.673 INFO:teuthology.orchestra.run.smithi155.stdout:(19/120): python3-ceph-argparse-17.2.6-1296.g73 799 kB/s | 45 kB 00:00 2023-10-06T01:18:50.700 INFO:teuthology.orchestra.run.smithi155.stdout:(20/120): python3-ceph-common-17.2.6-1296.g736a 4.0 MB/s | 115 kB 00:00 2023-10-06T01:18:50.707 INFO:teuthology.orchestra.run.smithi155.stdout:(21/120): python3-cephfs-17.2.6-1296.g736ac5ba. 5.5 MB/s | 190 kB 00:00 2023-10-06T01:18:50.757 INFO:teuthology.orchestra.run.smithi155.stdout:(22/120): python3-rbd-17.2.6-1296.g736ac5ba.el8 7.0 MB/s | 358 kB 00:00 2023-10-06T01:18:50.785 INFO:teuthology.orchestra.run.smithi155.stdout:(23/120): python3-rados-17.2.6-1296.g736ac5ba.e 4.3 MB/s | 371 kB 00:00 2023-10-06T01:18:50.791 INFO:teuthology.orchestra.run.smithi155.stdout:(24/120): python3-rgw-17.2.6-1296.g736ac5ba.el8 3.1 MB/s | 107 kB 00:00 2023-10-06T01:18:50.819 INFO:teuthology.orchestra.run.smithi155.stdout:(25/120): rbd-fuse-17.2.6-1296.g736ac5ba.el8.x8 2.6 MB/s | 90 kB 00:00 2023-10-06T01:18:50.866 INFO:teuthology.orchestra.run.smithi155.stdout:(26/120): rbd-nbd-17.2.6-1296.g736ac5ba.el8.x86 3.6 MB/s | 173 kB 00:00 2023-10-06T01:18:50.909 INFO:teuthology.orchestra.run.smithi155.stdout:(27/120): ceph-grafana-dashboards-17.2.6-1296.g 549 kB/s | 23 kB 00:00 2023-10-06T01:18:50.954 INFO:teuthology.orchestra.run.smithi155.stdout:(28/120): ceph-mgr-cephadm-17.2.6-1296.g736ac5b 2.6 MB/s | 121 kB 00:00 2023-10-06T01:18:51.230 INFO:teuthology.orchestra.run.smithi155.stdout:(29/120): rbd-mirror-17.2.6-1296.g736ac5ba.el8. 7.9 MB/s | 3.5 MB 00:00 2023-10-06T01:18:51.257 INFO:teuthology.orchestra.run.smithi155.stdout:(30/120): ceph-mgr-dashboard-17.2.6-1296.g736ac 5.6 MB/s | 1.7 MB 00:00 2023-10-06T01:18:51.308 INFO:teuthology.orchestra.run.smithi155.stdout:(31/120): ceph-mgr-modules-core-17.2.6-1296.g73 4.6 MB/s | 238 kB 00:00 2023-10-06T01:18:51.352 INFO:teuthology.orchestra.run.smithi155.stdout:(32/120): ceph-mgr-rook-17.2.6-1296.g736ac5ba.e 1.1 MB/s | 47 kB 00:00 2023-10-06T01:18:51.393 INFO:teuthology.orchestra.run.smithi155.stdout:(33/120): ceph-prometheus-alerts-17.2.6-1296.g7 349 kB/s | 14 kB 00:00 2023-10-06T01:18:51.446 INFO:teuthology.orchestra.run.smithi155.stdout:(34/120): ceph-volume-17.2.6-1296.g736ac5ba.el8 5.0 MB/s | 267 kB 00:00 2023-10-06T01:18:51.490 INFO:teuthology.orchestra.run.smithi155.stdout:(35/120): cephadm-17.2.6-1296.g736ac5ba.el8.noa 1.8 MB/s | 80 kB 00:00 2023-10-06T01:18:51.533 INFO:teuthology.orchestra.run.smithi155.stdout:(36/120): cephfs-top-17.2.6-1296.g736ac5ba.el8. 425 kB/s | 18 kB 00:00 2023-10-06T01:18:51.723 INFO:teuthology.orchestra.run.smithi155.stdout:(37/120): gperftools-libs-2.7-9.el8.x86_64.rpm 1.6 MB/s | 306 kB 00:00 2023-10-06T01:18:51.742 INFO:teuthology.orchestra.run.smithi155.stdout:(38/120): liboath-2.6.2-3.el8.x86_64.rpm 3.2 MB/s | 59 kB 00:00 2023-10-06T01:18:51.778 INFO:teuthology.orchestra.run.smithi155.stdout:(39/120): libunwind-1.3.1-3.el8.x86_64.rpm 2.1 MB/s | 75 kB 00:00 2023-10-06T01:18:51.909 INFO:teuthology.orchestra.run.smithi155.stdout:(40/120): python3-asyncssh-2.7.0-2.el8.noarch.r 3.5 MB/s | 476 kB 00:00 2023-10-06T01:18:51.933 INFO:teuthology.orchestra.run.smithi155.stdout:(41/120): python3-bcrypt-3.1.6-2.el8.1.x86_64.r 1.8 MB/s | 44 kB 00:00 2023-10-06T01:18:52.143 INFO:teuthology.orchestra.run.smithi155.stdout:(42/120): ceph-test-17.2.6-1296.g736ac5ba.el8.x 14 MB/s | 52 MB 00:03 2023-10-06T01:18:52.145 INFO:teuthology.orchestra.run.smithi155.stdout:(43/120): python3-beautifulsoup4-4.6.3-2.el8.1. 876 kB/s | 185 kB 00:00 2023-10-06T01:18:52.171 INFO:teuthology.orchestra.run.smithi155.stdout:(44/120): ceph-mgr-diskprediction-local-17.2.6- 7.9 MB/s | 7.4 MB 00:00 2023-10-06T01:18:52.176 INFO:teuthology.orchestra.run.smithi155.stdout:(45/120): python3-certifi-2018.10.15-7.el8.noar 517 kB/s | 16 kB 00:00 2023-10-06T01:18:52.251 INFO:teuthology.orchestra.run.smithi155.stdout:(46/120): python3-cachetools-3.1.1-4.el8.noarch 306 kB/s | 33 kB 00:00 2023-10-06T01:18:52.287 INFO:teuthology.orchestra.run.smithi155.stdout:(47/120): python3-google-auth-1.1.1-10.el8.noar 2.3 MB/s | 81 kB 00:00 2023-10-06T01:18:52.304 INFO:teuthology.orchestra.run.smithi155.stdout:(48/120): python3-jaraco-6.2-6.el8.noarch.rpm 644 kB/s | 11 kB 00:00 2023-10-06T01:18:52.318 INFO:teuthology.orchestra.run.smithi155.stdout:(49/120): python3-cheroot-8.5.2-1.el8.noarch.rp 1.2 MB/s | 173 kB 00:00 2023-10-06T01:18:52.322 INFO:teuthology.orchestra.run.smithi155.stdout:(50/120): python3-jaraco-functools-2.0-4.el8.no 990 kB/s | 18 kB 00:00 2023-10-06T01:18:52.341 INFO:teuthology.orchestra.run.smithi155.stdout:(51/120): python3-logutils-0.3.5-11.el8.noarch. 2.7 MB/s | 49 kB 00:00 2023-10-06T01:18:52.358 INFO:teuthology.orchestra.run.smithi155.stdout:(52/120): python3-more-itertools-7.2.0-3.el8.no 3.2 MB/s | 59 kB 00:00 2023-10-06T01:18:52.370 INFO:teuthology.orchestra.run.smithi050.stdout:Transaction test succeeded. 2023-10-06T01:18:52.375 INFO:teuthology.orchestra.run.smithi050.stdout:Running transaction 2023-10-06T01:18:52.377 INFO:teuthology.orchestra.run.smithi155.stdout:(53/120): python3-natsort-7.1.1-2.el8.noarch.rp 3.3 MB/s | 60 kB 00:00 2023-10-06T01:18:52.448 INFO:teuthology.orchestra.run.smithi155.stdout:(54/120): python3-pecan-1.3.2-9.el8.noarch.rpm 3.9 MB/s | 283 kB 00:00 2023-10-06T01:18:52.466 INFO:teuthology.orchestra.run.smithi155.stdout:(55/120): python3-portend-2.6-1.el8.noarch.rpm 890 kB/s | 16 kB 00:00 2023-10-06T01:18:52.484 INFO:teuthology.orchestra.run.smithi155.stdout:(56/120): python3-repoze-lru-0.7-6.el8.noarch.r 1.9 MB/s | 34 kB 00:00 2023-10-06T01:18:52.537 INFO:teuthology.orchestra.run.smithi155.stdout:(57/120): python3-routes-2.4.1-12.el8.noarch.rp 3.6 MB/s | 196 kB 00:00 2023-10-06T01:18:52.555 INFO:teuthology.orchestra.run.smithi155.stdout:(58/120): python3-rsa-4.9-2.el8.noarch.rpm 3.4 MB/s | 64 kB 00:00 2023-10-06T01:18:52.568 INFO:teuthology.orchestra.run.smithi155.stdout:(59/120): python3-cherrypy-18.4.0-1.el8.noarch. 983 kB/s | 384 kB 00:00 2023-10-06T01:18:52.573 INFO:teuthology.orchestra.run.smithi155.stdout:(60/120): python3-simplegeneric-0.8.1-17.el8.no 1.0 MB/s | 19 kB 00:00 2023-10-06T01:18:52.591 INFO:teuthology.orchestra.run.smithi155.stdout:(61/120): python3-tempora-1.14.1-5.el8.noarch.r 1.6 MB/s | 29 kB 00:00 2023-10-06T01:18:52.602 INFO:teuthology.orchestra.run.smithi155.stdout:(62/120): python3-singledispatch-3.4.0.3-18.el8 701 kB/s | 24 kB 00:00 2023-10-06T01:18:52.608 INFO:teuthology.orchestra.run.smithi155.stdout:(63/120): python3-kubernetes-11.0.0-6.el8.noarc 4.0 MB/s | 1.2 MB 00:00 2023-10-06T01:18:52.609 INFO:teuthology.orchestra.run.smithi155.stdout:(64/120): python3-trustme-0.6.0-4.el8.noarch.rp 1.5 MB/s | 27 kB 00:00 2023-10-06T01:18:52.627 INFO:teuthology.orchestra.run.smithi155.stdout:(65/120): python3-websocket-client-0.56.0-5.el8 3.3 MB/s | 61 kB 00:00 2023-10-06T01:18:52.663 INFO:teuthology.orchestra.run.smithi155.stdout:(66/120): python3-webtest-2.0.33-1.el8.noarch.r 2.4 MB/s | 85 kB 00:00 2023-10-06T01:18:52.677 INFO:teuthology.orchestra.run.smithi155.stdout:(67/120): python3-webob-1.8.5-1.el8.1.noarch.rp 3.6 MB/s | 251 kB 00:00 2023-10-06T01:18:52.681 INFO:teuthology.orchestra.run.smithi155.stdout:(68/120): python3-zc-lockfile-2.0-2.el8.noarch. 1.3 MB/s | 23 kB 00:00 2023-10-06T01:18:52.686 INFO:teuthology.orchestra.run.smithi155.stdout:(69/120): xmlstarlet-1.6.1-20.el8.x86_64.rpm 15 MB/s | 70 kB 00:00 2023-10-06T01:18:52.717 INFO:teuthology.orchestra.run.smithi155.stdout:(70/120): libaio-devel-0.3.112-1.el8.x86_64.rpm 602 kB/s | 19 kB 00:00 2023-10-06T01:18:52.732 INFO:teuthology.orchestra.run.smithi155.stdout:(71/120): python3-jwt-1.6.1-2.el8.noarch.rpm 2.9 MB/s | 43 kB 00:00 2023-10-06T01:18:52.748 INFO:teuthology.orchestra.run.smithi155.stdout:(72/120): python3-oauthlib-2.1.0-1.el8.noarch.r 9.6 MB/s | 155 kB 00:00 2023-10-06T01:18:52.766 INFO:teuthology.orchestra.run.smithi155.stdout:(73/120): pcre2-utf32-10.32-2.el8.x86_64.rpm 12 MB/s | 220 kB 00:00 2023-10-06T01:18:52.780 INFO:teuthology.orchestra.run.smithi155.stdout:(74/120): keyutils-libs-devel-1.5.10-6.el8.x86_ 3.2 MB/s | 48 kB 00:00 2023-10-06T01:18:52.797 INFO:teuthology.orchestra.run.smithi155.stdout:(75/120): pcre2-utf16-10.32-2.el8.x86_64.rpm 14 MB/s | 229 kB 00:00 2023-10-06T01:18:52.804 INFO:teuthology.orchestra.run.smithi155.stdout:(76/120): python3-waitress-1.4.3-1.el8.noarch.r 1.2 MB/s | 255 kB 00:00 2023-10-06T01:18:52.813 INFO:teuthology.orchestra.run.smithi155.stdout:(77/120): python3-requests-oauthlib-1.0.0-1.el8 2.7 MB/s | 43 kB 00:00 2023-10-06T01:18:52.827 INFO:teuthology.orchestra.run.smithi155.stdout:(78/120): libverto-devel-0.3.0-5.el8.x86_64.rpm 1.2 MB/s | 18 kB 00:00 2023-10-06T01:18:52.854 INFO:teuthology.orchestra.run.smithi155.stdout:(79/120): pcre2-devel-10.32-2.el8.x86_64.rpm 23 MB/s | 605 kB 00:00 2023-10-06T01:18:52.870 INFO:teuthology.orchestra.run.smithi155.stdout:(80/120): fuse-2.9.7-12.el8.x86_64.rpm 5.1 MB/s | 83 kB 00:00 2023-10-06T01:18:52.883 INFO:teuthology.orchestra.run.smithi155.stdout:(81/120): openssl-devel-1.1.1g-15.el8_3.x86_64. 29 MB/s | 2.3 MB 00:00 2023-10-06T01:18:52.885 INFO:teuthology.orchestra.run.smithi155.stdout:(82/120): elfutils-libelf-devel-0.182-3.el8.x86 3.9 MB/s | 59 kB 00:00 2023-10-06T01:18:52.899 INFO:teuthology.orchestra.run.smithi155.stdout:(83/120): libquadmath-8.4.1-1.el8.x86_64.rpm 11 MB/s | 169 kB 00:00 2023-10-06T01:18:52.899 INFO:teuthology.orchestra.run.smithi155.stdout:(84/120): libcom_err-devel-1.45.6-1.el8.x86_64. 2.6 MB/s | 38 kB 00:00 2023-10-06T01:18:52.913 INFO:teuthology.orchestra.run.smithi155.stdout:(85/120): zlib-devel-1.2.11-17.el8.x86_64.rpm 4.2 MB/s | 58 kB 00:00 2023-10-06T01:18:52.914 INFO:teuthology.orchestra.run.smithi155.stdout:(86/120): libsepol-devel-2.9-2.el8.x86_64.rpm 5.5 MB/s | 86 kB 00:00 2023-10-06T01:18:52.927 INFO:teuthology.orchestra.run.smithi155.stdout:(87/120): librabbitmq-0.9.0-3.el8.x86_64.rpm 3.5 MB/s | 47 kB 00:00 2023-10-06T01:18:52.936 INFO:teuthology.orchestra.run.smithi155.stdout:(88/120): krb5-devel-1.18.2-8.3.el8_4.x86_64.rp 26 MB/s | 559 kB 00:00 2023-10-06T01:18:52.951 INFO:teuthology.orchestra.run.smithi155.stdout:(89/120): libgfortran-8.4.1-1.el8.x86_64.rpm 25 MB/s | 639 kB 00:00 2023-10-06T01:18:52.953 INFO:teuthology.orchestra.run.smithi155.stdout:(90/120): xfsprogs-devel-5.0.0-8.el8.x86_64.rpm 4.0 MB/s | 70 kB 00:00 2023-10-06T01:18:52.968 INFO:teuthology.orchestra.run.smithi155.stdout:(91/120): libselinux-devel-2.9-5.el8.x86_64.rpm 12 MB/s | 200 kB 00:00 2023-10-06T01:18:52.969 INFO:teuthology.orchestra.run.smithi155.stdout:(92/120): libuuid-devel-2.32.1-27.el8.x86_64.rp 6.1 MB/s | 97 kB 00:00 2023-10-06T01:18:52.983 INFO:teuthology.orchestra.run.smithi155.stdout:(93/120): python3-prettytable-0.7.2-14.el8.noar 3.2 MB/s | 44 kB 00:00 2023-10-06T01:18:52.997 INFO:teuthology.orchestra.run.smithi155.stdout:(94/120): python3-jsonpatch-1.21-2.el8.noarch.r 1.9 MB/s | 27 kB 00:00 2023-10-06T01:18:53.012 INFO:teuthology.orchestra.run.smithi155.stdout:(95/120): jq-1.5-12.el8.x86_64.rpm 10 MB/s | 161 kB 00:00 2023-10-06T01:18:53.032 INFO:teuthology.orchestra.run.smithi155.stdout:(96/120): flex-2.6.1-9.el8.x86_64.rpm 16 MB/s | 320 kB 00:00 2023-10-06T01:18:53.054 INFO:teuthology.orchestra.run.smithi155.stdout:(97/120): python3-werkzeug-0.12.2-4.el8.noarch. 20 MB/s | 457 kB 00:00 2023-10-06T01:18:53.145 INFO:teuthology.orchestra.run.smithi155.stdout:(98/120): thrift-0.13.0-2.el8.x86_64.rpm 3.7 MB/s | 1.7 MB 00:00 2023-10-06T01:18:53.173 INFO:teuthology.orchestra.run.smithi155.stdout:(99/120): python3-markupsafe-0.23-19.el8.x86_64 1.4 MB/s | 39 kB 00:00 2023-10-06T01:18:53.190 INFO:teuthology.orchestra.run.smithi155.stdout:(100/120): python3-babel-2.5.1-5.el8.noarch.rpm 35 MB/s | 4.8 MB 00:00 2023-10-06T01:18:53.206 INFO:teuthology.orchestra.run.smithi155.stdout:(101/120): bison-3.0.4-10.el8.x86_64.rpm 20 MB/s | 688 kB 00:00 2023-10-06T01:18:53.212 INFO:teuthology.orchestra.run.smithi155.stdout:(102/120): lttng-ust-2.8.1-11.el8.x86_64.rpm 12 MB/s | 259 kB 00:00 2023-10-06T01:18:53.225 INFO:teuthology.orchestra.run.smithi155.stdout:(103/120): python3-numpy-f2py-1.14.3-9.el8.x86_ 11 MB/s | 225 kB 00:00 2023-10-06T01:18:53.230 INFO:teuthology.orchestra.run.smithi155.stdout:(104/120): python3-pyasn1-0.3.7-6.el8.noarch.rp 6.9 MB/s | 126 kB 00:00 2023-10-06T01:18:53.248 INFO:teuthology.orchestra.run.smithi155.stdout:(105/120): oniguruma-6.8.2-2.el8.x86_64.rpm 10 MB/s | 187 kB 00:00 2023-10-06T01:18:53.277 INFO:teuthology.orchestra.run.smithi155.stdout:(106/120): python3-jinja2-2.10.1-2.el8_0.noarch 19 MB/s | 538 kB 00:00 2023-10-06T01:18:53.323 INFO:teuthology.orchestra.run.smithi155.stdout:(107/120): python3-scipy-1.0.0-20.module+el8.1. 41 MB/s | 15 MB 00:00 2023-10-06T01:18:53.330 INFO:teuthology.orchestra.run.smithi155.stdout:(108/120): socat-1.7.3.3-2.el8.x86_64.rpm 5.5 MB/s | 302 kB 00:00 2023-10-06T01:18:53.341 INFO:teuthology.orchestra.run.smithi155.stdout:(109/120): python3-mako-1.0.6-13.el8.noarch.rpm 8.6 MB/s | 157 kB 00:00 2023-10-06T01:18:53.350 INFO:teuthology.orchestra.run.smithi155.stdout:(110/120): python3-pyasn1-modules-0.3.7-6.el8.n 5.5 MB/s | 110 kB 00:00 2023-10-06T01:18:53.372 INFO:teuthology.orchestra.run.smithi155.stdout:(111/120): python3-numpy-1.14.3-9.el8.x86_64.rp 26 MB/s | 3.7 MB 00:00 2023-10-06T01:18:53.373 INFO:teuthology.orchestra.run.smithi155.stdout:(112/120): python3-jsonpointer-1.10-11.el8.noar 880 kB/s | 20 kB 00:00 2023-10-06T01:18:53.375 INFO:teuthology.orchestra.run.smithi155.stdout:(113/120): librdkafka-0.11.4-1.el8.x86_64.rpm 10 MB/s | 353 kB 00:00 2023-10-06T01:18:53.391 INFO:teuthology.orchestra.run.smithi155.stdout:(114/120): python3-pytz-2017.2-9.el8.noarch.rpm 3.0 MB/s | 54 kB 00:00 2023-10-06T01:18:53.402 INFO:teuthology.orchestra.run.smithi155.stdout:(115/120): libtool-2.4.6-25.el8.x86_64.rpm 23 MB/s | 709 kB 00:00 2023-10-06T01:18:53.438 INFO:teuthology.orchestra.run.smithi155.stdout:(116/120): automake-1.16.1-7.el8.noarch.rpm 20 MB/s | 713 kB 00:00 2023-10-06T01:18:53.507 INFO:teuthology.orchestra.run.smithi155.stdout:(117/120): openblas-threads-0.3.12-1.el8.x86_64 36 MB/s | 4.7 MB 00:00 2023-10-06T01:18:53.528 INFO:teuthology.orchestra.run.smithi155.stdout:(118/120): openblas-0.3.12-1.el8.x86_64.rpm 34 MB/s | 4.6 MB 00:00 2023-10-06T01:18:53.793 INFO:teuthology.orchestra.run.smithi155.stdout:(119/120): librbd1-17.2.6-1296.g736ac5ba.el8.x8 13 MB/s | 3.6 MB 00:00 2023-10-06T01:18:53.847 INFO:teuthology.orchestra.run.smithi155.stdout:(120/120): librados2-17.2.6-1296.g736ac5ba.el8. 8.5 MB/s | 3.5 MB 00:00 2023-10-06T01:18:53.852 INFO:teuthology.orchestra.run.smithi155.stdout:-------------------------------------------------------------------------------- 2023-10-06T01:18:53.853 INFO:teuthology.orchestra.run.smithi155.stdout:Total 23 MB/s | 201 MB 00:08 2023-10-06T01:18:53.922 INFO:teuthology.orchestra.run.smithi155.stdout:Running transaction check 2023-10-06T01:18:54.047 INFO:teuthology.orchestra.run.smithi155.stdout:Transaction check succeeded. 2023-10-06T01:18:54.047 INFO:teuthology.orchestra.run.smithi155.stdout:Running transaction test 2023-10-06T01:18:55.813 INFO:teuthology.orchestra.run.smithi155.stdout:Transaction test succeeded. 2023-10-06T01:18:55.817 INFO:teuthology.orchestra.run.smithi155.stdout:Running transaction 2023-10-06T01:18:57.300 INFO:teuthology.orchestra.run.smithi050.stdout: Preparing : 1/1 2023-10-06T01:18:57.497 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : liboath-2.6.2-3.el8.x86_64 1/122 2023-10-06T01:18:57.744 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : librdkafka-0.11.4-1.el8.x86_64 2/122 2023-10-06T01:18:57.931 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: librdkafka-0.11.4-1.el8.x86_64 2/122 2023-10-06T01:18:58.202 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 3/122 2023-10-06T01:18:58.667 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 3/122 2023-10-06T01:18:59.144 INFO:teuthology.orchestra.run.smithi050.stdout: Upgrading : librados2-2:17.2.6-1296.g736ac5ba.el8.x86_64 4/122 2023-10-06T01:18:59.636 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: librados2-2:17.2.6-1296.g736ac5ba.el8.x86_64 4/122 2023-10-06T01:18:59.885 INFO:teuthology.orchestra.run.smithi050.stdout: Upgrading : librbd1-2:17.2.6-1296.g736ac5ba.el8.x86_64 5/122 2023-10-06T01:19:00.033 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: librbd1-2:17.2.6-1296.g736ac5ba.el8.x86_64 5/122 2023-10-06T01:19:00.219 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : libcephfs2-2:17.2.6-1296.g736ac5ba.el8.x86_64 6/122 2023-10-06T01:19:00.348 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: libcephfs2-2:17.2.6-1296.g736ac5ba.el8.x86_64 6/122 2023-10-06T01:19:00.433 INFO:teuthology.orchestra.run.smithi155.stdout: Preparing : 1/1 2023-10-06T01:19:00.545 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-rados-2:17.2.6-1296.g736ac5ba.el8.x86_64 7/122 2023-10-06T01:19:00.670 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : liboath-2.6.2-3.el8.x86_64 1/122 2023-10-06T01:19:00.856 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : librdkafka-0.11.4-1.el8.x86_64 2/122 2023-10-06T01:19:00.922 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : librabbitmq-0.9.0-3.el8.x86_64 8/122 2023-10-06T01:19:01.024 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: librdkafka-0.11.4-1.el8.x86_64 2/122 2023-10-06T01:19:01.273 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 3/122 2023-10-06T01:19:01.710 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : thrift-0.13.0-2.el8.x86_64 9/122 2023-10-06T01:19:01.715 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 3/122 2023-10-06T01:19:01.902 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : librgw2-2:17.2.6-1296.g736ac5ba.el8.x86_64 10/122 2023-10-06T01:19:02.076 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: librgw2-2:17.2.6-1296.g736ac5ba.el8.x86_64 10/122 2023-10-06T01:19:02.317 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 11/122 2023-10-06T01:19:02.431 INFO:teuthology.orchestra.run.smithi155.stdout: Upgrading : librados2-2:17.2.6-1296.g736ac5ba.el8.x86_64 4/122 2023-10-06T01:19:02.541 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 12/122 2023-10-06T01:19:02.751 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : libcephsqlite-2:17.2.6-1296.g736ac5ba.el8.x86_64 13/122 2023-10-06T01:19:02.896 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: libcephsqlite-2:17.2.6-1296.g736ac5ba.el8.x86_64 13/122 2023-10-06T01:19:02.898 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: librados2-2:17.2.6-1296.g736ac5ba.el8.x86_64 4/122 2023-10-06T01:19:03.064 INFO:teuthology.orchestra.run.smithi155.stdout: Upgrading : librbd1-2:17.2.6-1296.g736ac5ba.el8.x86_64 5/122 2023-10-06T01:19:03.076 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : libradosstriper1-2:17.2.6-1296.g736ac5ba.el8.x86 14/122 2023-10-06T01:19:03.168 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: libradosstriper1-2:17.2.6-1296.g736ac5ba.el8.x86 14/122 2023-10-06T01:19:03.222 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: librbd1-2:17.2.6-1296.g736ac5ba.el8.x86_64 5/122 2023-10-06T01:19:03.394 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-pytz-2017.2-9.el8.noarch 15/122 2023-10-06T01:19:03.431 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : libcephfs2-2:17.2.6-1296.g736ac5ba.el8.x86_64 6/122 2023-10-06T01:19:03.540 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: libcephfs2-2:17.2.6-1296.g736ac5ba.el8.x86_64 6/122 2023-10-06T01:19:03.694 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 16/122 2023-10-06T01:19:03.720 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-rados-2:17.2.6-1296.g736ac5ba.el8.x86_64 7/122 2023-10-06T01:19:04.086 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : librabbitmq-0.9.0-3.el8.x86_64 8/122 2023-10-06T01:19:04.537 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 17/122 2023-10-06T01:19:04.696 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : zlib-devel-1.2.11-17.el8.x86_64 18/122 2023-10-06T01:19:04.807 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : thrift-0.13.0-2.el8.x86_64 9/122 2023-10-06T01:19:04.885 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : libquadmath-8.4.1-1.el8.x86_64 19/122 2023-10-06T01:19:05.006 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : librgw2-2:17.2.6-1296.g736ac5ba.el8.x86_64 10/122 2023-10-06T01:19:05.046 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: libquadmath-8.4.1-1.el8.x86_64 19/122 2023-10-06T01:19:05.150 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: librgw2-2:17.2.6-1296.g736ac5ba.el8.x86_64 10/122 2023-10-06T01:19:05.251 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : libgfortran-8.4.1-1.el8.x86_64 20/122 2023-10-06T01:19:05.387 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 11/122 2023-10-06T01:19:05.601 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 12/122 2023-10-06T01:19:05.789 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : libcephsqlite-2:17.2.6-1296.g736ac5ba.el8.x86_64 13/122 2023-10-06T01:19:05.912 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: libgfortran-8.4.1-1.el8.x86_64 20/122 2023-10-06T01:19:05.925 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: libcephsqlite-2:17.2.6-1296.g736ac5ba.el8.x86_64 13/122 2023-10-06T01:19:06.089 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : libradosstriper1-2:17.2.6-1296.g736ac5ba.el8.x86 14/122 2023-10-06T01:19:06.159 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : openblas-threads-0.3.12-1.el8.x86_64 21/122 2023-10-06T01:19:06.185 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: libradosstriper1-2:17.2.6-1296.g736ac5ba.el8.x86 14/122 2023-10-06T01:19:06.371 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-pytz-2017.2-9.el8.noarch 15/122 2023-10-06T01:19:06.683 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 16/122 2023-10-06T01:19:06.804 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: openblas-threads-0.3.12-1.el8.x86_64 21/122 2023-10-06T01:19:07.001 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : openblas-0.3.12-1.el8.x86_64 22/122 2023-10-06T01:19:07.353 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 17/122 2023-10-06T01:19:07.514 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : zlib-devel-1.2.11-17.el8.x86_64 18/122 2023-10-06T01:19:07.689 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : libquadmath-8.4.1-1.el8.x86_64 19/122 2023-10-06T01:19:07.846 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: libquadmath-8.4.1-1.el8.x86_64 19/122 2023-10-06T01:19:07.926 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: openblas-0.3.12-1.el8.x86_64 22/122 2023-10-06T01:19:08.005 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : libgfortran-8.4.1-1.el8.x86_64 20/122 2023-10-06T01:19:08.186 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-numpy-1:1.14.3-9.el8.x86_64 23/122 2023-10-06T01:19:08.495 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 24/122 2023-10-06T01:19:08.654 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: libgfortran-8.4.1-1.el8.x86_64 20/122 2023-10-06T01:19:08.794 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 25/122 2023-10-06T01:19:08.797 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : openblas-threads-0.3.12-1.el8.x86_64 21/122 2023-10-06T01:19:08.976 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-ceph-common-2:17.2.6-1296.g736ac5ba.el8. 26/122 2023-10-06T01:19:09.135 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-ceph-argparse-2:17.2.6-1296.g736ac5ba.el 27/122 2023-10-06T01:19:09.395 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: openblas-threads-0.3.12-1.el8.x86_64 21/122 2023-10-06T01:19:09.563 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : openblas-0.3.12-1.el8.x86_64 22/122 2023-10-06T01:19:09.648 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-cephfs-2:17.2.6-1296.g736ac5ba.el8.x86_6 28/122 2023-10-06T01:19:09.908 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 29/122 2023-10-06T01:19:10.235 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 30/122 2023-10-06T01:19:10.488 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: openblas-0.3.12-1.el8.x86_64 22/122 2023-10-06T01:19:10.492 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-numpy-f2py-1:1.14.3-9.el8.x86_64 31/122 2023-10-06T01:19:10.806 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-numpy-1:1.14.3-9.el8.x86_64 23/122 2023-10-06T01:19:11.070 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 24/122 2023-10-06T01:19:11.312 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 25/122 2023-10-06T01:19:11.471 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-ceph-common-2:17.2.6-1296.g736ac5ba.el8. 26/122 2023-10-06T01:19:11.593 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-ceph-argparse-2:17.2.6-1296.g736ac5ba.el 27/122 2023-10-06T01:19:11.880 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-cephfs-2:17.2.6-1296.g736ac5ba.el8.x86_6 28/122 2023-10-06T01:19:12.383 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 29/122 2023-10-06T01:19:12.675 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 30/122 2023-10-06T01:19:12.921 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-numpy-f2py-1:1.14.3-9.el8.x86_64 31/122 2023-10-06T01:19:13.044 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-9.el8.x86_64 31/122 2023-10-06T01:19:13.443 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-scipy-1.0.0-20.module+el8.1.0+3334+5cb62 32/122 2023-10-06T01:19:14.650 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-mako-1.0.6-13.el8.noarch 33/122 2023-10-06T01:19:15.044 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-babel-2.5.1-5.el8.noarch 34/122 2023-10-06T01:19:15.339 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-jinja2-2.10.1-2.el8_0.noarch 35/122 2023-10-06T01:19:15.368 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-9.el8.x86_64 31/122 2023-10-06T01:19:15.569 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-rsa-4.9-2.el8.noarch 36/122 2023-10-06T01:19:15.744 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-scipy-1.0.0-20.module+el8.1.0+3334+5cb62 32/122 2023-10-06T01:19:15.789 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 37/122 2023-10-06T01:19:16.016 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-rgw-2:17.2.6-1296.g736ac5ba.el8.x86_64 38/122 2023-10-06T01:19:16.243 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-rbd-2:17.2.6-1296.g736ac5ba.el8.x86_64 39/122 2023-10-06T01:19:16.549 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : librados-devel-2:17.2.6-1296.g736ac5ba.el8.x86_6 40/122 2023-10-06T01:19:16.801 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : automake-1.16.1-7.el8.noarch 41/122 2023-10-06T01:19:16.876 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-mako-1.0.6-13.el8.noarch 33/122 2023-10-06T01:19:16.985 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 42/122 2023-10-06T01:19:17.215 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 43/122 2023-10-06T01:19:17.278 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-babel-2.5.1-5.el8.noarch 34/122 2023-10-06T01:19:17.407 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : socat-1.7.3.3-2.el8.x86_64 44/122 2023-10-06T01:19:17.549 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-jinja2-2.10.1-2.el8_0.noarch 35/122 2023-10-06T01:19:17.583 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : oniguruma-6.8.2-2.el8.x86_64 45/122 2023-10-06T01:19:17.674 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: oniguruma-6.8.2-2.el8.x86_64 45/122 2023-10-06T01:19:17.795 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-rsa-4.9-2.el8.noarch 36/122 2023-10-06T01:19:17.885 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : jq-1.5-12.el8.x86_64 46/122 2023-10-06T01:19:18.017 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 37/122 2023-10-06T01:19:18.057 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 47/122 2023-10-06T01:19:18.218 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-rgw-2:17.2.6-1296.g736ac5ba.el8.x86_64 38/122 2023-10-06T01:19:18.249 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : libuuid-devel-2.32.1-27.el8.x86_64 48/122 2023-10-06T01:19:18.396 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-rbd-2:17.2.6-1296.g736ac5ba.el8.x86_64 39/122 2023-10-06T01:19:18.456 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : libsepol-devel-2.9-2.el8.x86_64 49/122 2023-10-06T01:19:18.654 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : libcom_err-devel-1.45.6-1.el8.x86_64 50/122 2023-10-06T01:19:18.715 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : librados-devel-2:17.2.6-1296.g736ac5ba.el8.x86_6 40/122 2023-10-06T01:19:18.886 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : fuse-2.9.7-12.el8.x86_64 51/122 2023-10-06T01:19:18.940 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : automake-1.16.1-7.el8.noarch 41/122 2023-10-06T01:19:19.050 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : libverto-devel-0.3.0-5.el8.x86_64 52/122 2023-10-06T01:19:19.155 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 42/122 2023-10-06T01:19:19.291 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : pcre2-utf16-10.32-2.el8.x86_64 53/122 2023-10-06T01:19:19.344 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 43/122 2023-10-06T01:19:19.466 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : keyutils-libs-devel-1.5.10-6.el8.x86_64 54/122 2023-10-06T01:19:19.576 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : socat-1.7.3.3-2.el8.x86_64 44/122 2023-10-06T01:19:19.737 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : oniguruma-6.8.2-2.el8.x86_64 45/122 2023-10-06T01:19:19.836 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: oniguruma-6.8.2-2.el8.x86_64 45/122 2023-10-06T01:19:19.845 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : pcre2-utf32-10.32-2.el8.x86_64 55/122 2023-10-06T01:19:20.040 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : jq-1.5-12.el8.x86_64 46/122 2023-10-06T01:19:20.140 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : pcre2-devel-10.32-2.el8.x86_64 56/122 2023-10-06T01:19:20.201 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 47/122 2023-10-06T01:19:20.378 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : libuuid-devel-2.32.1-27.el8.x86_64 48/122 2023-10-06T01:19:20.412 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : libselinux-devel-2.9-5.el8.x86_64 57/122 2023-10-06T01:19:20.576 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : libsepol-devel-2.9-2.el8.x86_64 49/122 2023-10-06T01:19:20.758 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : libcom_err-devel-1.45.6-1.el8.x86_64 50/122 2023-10-06T01:19:20.771 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : krb5-devel-1.18.2-8.3.el8_4.x86_64 58/122 2023-10-06T01:19:20.957 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : fuse-2.9.7-12.el8.x86_64 51/122 2023-10-06T01:19:20.995 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : xmlstarlet-1.6.1-20.el8.x86_64 59/122 2023-10-06T01:19:21.153 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : libverto-devel-0.3.0-5.el8.x86_64 52/122 2023-10-06T01:19:21.188 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 60/122 2023-10-06T01:19:21.344 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : pcre2-utf16-10.32-2.el8.x86_64 53/122 2023-10-06T01:19:21.482 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 61/122 2023-10-06T01:19:21.518 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : keyutils-libs-devel-1.5.10-6.el8.x86_64 54/122 2023-10-06T01:19:21.711 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-waitress-1.4.3-1.el8.noarch 62/122 2023-10-06T01:19:21.889 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : pcre2-utf32-10.32-2.el8.x86_64 55/122 2023-10-06T01:19:21.968 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 63/122 2023-10-06T01:19:22.106 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 64/122 2023-10-06T01:19:22.212 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : pcre2-devel-10.32-2.el8.x86_64 56/122 2023-10-06T01:19:22.300 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 65/122 2023-10-06T01:19:22.447 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : libselinux-devel-2.9-5.el8.x86_64 57/122 2023-10-06T01:19:22.517 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 66/122 2023-10-06T01:19:22.757 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : krb5-devel-1.18.2-8.3.el8_4.x86_64 58/122 2023-10-06T01:19:22.783 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 67/122 2023-10-06T01:19:22.923 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : xmlstarlet-1.6.1-20.el8.x86_64 59/122 2023-10-06T01:19:23.006 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-natsort-7.1.1-2.el8.noarch 68/122 2023-10-06T01:19:23.107 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 60/122 2023-10-06T01:19:23.238 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 69/122 2023-10-06T01:19:23.372 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 61/122 2023-10-06T01:19:23.409 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 70/122 2023-10-06T01:19:23.589 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-waitress-1.4.3-1.el8.noarch 62/122 2023-10-06T01:19:23.705 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 71/122 2023-10-06T01:19:23.829 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 63/122 2023-10-06T01:19:23.950 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 72/122 2023-10-06T01:19:23.959 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 64/122 2023-10-06T01:19:24.093 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 65/122 2023-10-06T01:19:24.191 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 73/122 2023-10-06T01:19:24.333 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 66/122 2023-10-06T01:19:24.520 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-portend-2.6-1.el8.noarch 74/122 2023-10-06T01:19:24.575 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 67/122 2023-10-06T01:19:24.800 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-natsort-7.1.1-2.el8.noarch 68/122 2023-10-06T01:19:24.826 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 75/122 2023-10-06T01:19:24.991 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 69/122 2023-10-06T01:19:25.081 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 76/122 2023-10-06T01:19:25.146 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 70/122 2023-10-06T01:19:25.396 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 77/122 2023-10-06T01:19:25.413 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 71/122 2023-10-06T01:19:25.654 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 72/122 2023-10-06T01:19:25.887 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 73/122 2023-10-06T01:19:26.182 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-portend-2.6-1.el8.noarch 74/122 2023-10-06T01:19:26.456 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 75/122 2023-10-06T01:19:26.652 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 76/122 2023-10-06T01:19:26.903 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 78/122 2023-10-06T01:19:26.931 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 77/122 2023-10-06T01:19:27.266 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-kubernetes-1:11.0.0-6.el8.noarch 79/122 2023-10-06T01:19:27.534 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 80/122 2023-10-06T01:19:27.877 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 81/122 2023-10-06T01:19:28.181 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 82/122 2023-10-06T01:19:28.324 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 78/122 2023-10-06T01:19:28.587 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 83/122 2023-10-06T01:19:28.660 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-kubernetes-1:11.0.0-6.el8.noarch 79/122 2023-10-06T01:19:28.893 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-asyncssh-2.7.0-2.el8.noarch 84/122 2023-10-06T01:19:28.927 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 80/122 2023-10-06T01:19:29.106 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 85/122 2023-10-06T01:19:29.247 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 81/122 2023-10-06T01:19:29.340 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 86/122 2023-10-06T01:19:29.519 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 82/122 2023-10-06T01:19:29.875 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 83/122 2023-10-06T01:19:30.106 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-asyncssh-2.7.0-2.el8.noarch 84/122 2023-10-06T01:19:30.290 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 85/122 2023-10-06T01:19:30.519 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 86/122 2023-10-06T01:19:36.807 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: ceph-common-2:17.2.6-1296.g736ac5ba.el8.x86_64 87/122 2023-10-06T01:19:37.090 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : ceph-common-2:17.2.6-1296.g736ac5ba.el8.x86_64 87/122 2023-10-06T01:19:37.824 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: ceph-common-2:17.2.6-1296.g736ac5ba.el8.x86_64 87/122 2023-10-06T01:19:38.035 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: ceph-common-2:17.2.6-1296.g736ac5ba.el8.x86_64 87/122 2023-10-06T01:19:38.134 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : ceph-base-2:17.2.6-1296.g736ac5ba.el8.x86_64 88/122 2023-10-06T01:19:38.310 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : ceph-common-2:17.2.6-1296.g736ac5ba.el8.x86_64 87/122 2023-10-06T01:19:38.328 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: ceph-base-2:17.2.6-1296.g736ac5ba.el8.x86_64 88/122 2023-10-06T01:19:38.488 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : ceph-selinux-2:17.2.6-1296.g736ac5ba.el8.x86_64 89/122 2023-10-06T01:19:38.991 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: ceph-common-2:17.2.6-1296.g736ac5ba.el8.x86_64 87/122 2023-10-06T01:19:39.311 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : ceph-base-2:17.2.6-1296.g736ac5ba.el8.x86_64 88/122 2023-10-06T01:19:39.481 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: ceph-base-2:17.2.6-1296.g736ac5ba.el8.x86_64 88/122 2023-10-06T01:19:39.608 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : ceph-selinux-2:17.2.6-1296.g736ac5ba.el8.x86_64 89/122 2023-10-06T01:19:58.718 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: ceph-selinux-2:17.2.6-1296.g736ac5ba.el8.x86_64 89/122 2023-10-06T01:19:58.718 INFO:teuthology.orchestra.run.smithi050.stdout:skipping the directory /sys 2023-10-06T01:19:58.718 INFO:teuthology.orchestra.run.smithi050.stdout:skipping the directory /proc 2023-10-06T01:19:58.718 INFO:teuthology.orchestra.run.smithi050.stdout:skipping the directory /dev 2023-10-06T01:19:58.718 INFO:teuthology.orchestra.run.smithi050.stdout:skipping the directory /run 2023-10-06T01:19:58.718 INFO:teuthology.orchestra.run.smithi050.stdout:skipping the directory /mnt 2023-10-06T01:19:58.718 INFO:teuthology.orchestra.run.smithi050.stdout:skipping the directory /var/tmp 2023-10-06T01:19:58.718 INFO:teuthology.orchestra.run.smithi050.stdout:skipping the directory /home 2023-10-06T01:19:58.718 INFO:teuthology.orchestra.run.smithi050.stdout:skipping the directory /tmp 2023-10-06T01:19:58.719 INFO:teuthology.orchestra.run.smithi050.stdout:skipping the directory /dev 2023-10-06T01:19:58.719 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-10-06T01:19:59.042 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: ceph-selinux-2:17.2.6-1296.g736ac5ba.el8.x86_64 89/122 2023-10-06T01:19:59.042 INFO:teuthology.orchestra.run.smithi155.stdout:skipping the directory /sys 2023-10-06T01:19:59.043 INFO:teuthology.orchestra.run.smithi155.stdout:skipping the directory /proc 2023-10-06T01:19:59.043 INFO:teuthology.orchestra.run.smithi155.stdout:skipping the directory /dev 2023-10-06T01:19:59.043 INFO:teuthology.orchestra.run.smithi155.stdout:skipping the directory /run 2023-10-06T01:19:59.043 INFO:teuthology.orchestra.run.smithi155.stdout:skipping the directory /mnt 2023-10-06T01:19:59.043 INFO:teuthology.orchestra.run.smithi155.stdout:skipping the directory /var/tmp 2023-10-06T01:19:59.043 INFO:teuthology.orchestra.run.smithi155.stdout:skipping the directory /home 2023-10-06T01:19:59.043 INFO:teuthology.orchestra.run.smithi155.stdout:skipping the directory /tmp 2023-10-06T01:19:59.043 INFO:teuthology.orchestra.run.smithi155.stdout:skipping the directory /dev 2023-10-06T01:19:59.043 INFO:teuthology.orchestra.run.smithi155.stdout: 2023-10-06T01:19:59.195 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : ceph-volume-2:17.2.6-1296.g736ac5ba.el8.noarch 90/122 2023-10-06T01:19:59.481 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : ceph-volume-2:17.2.6-1296.g736ac5ba.el8.noarch 90/122 2023-10-06T01:20:00.930 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: ceph-volume-2:17.2.6-1296.g736ac5ba.el8.noarch 90/122 2023-10-06T01:20:01.131 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : ceph-osd-2:17.2.6-1296.g736ac5ba.el8.x86_64 91/122 2023-10-06T01:20:01.134 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: ceph-volume-2:17.2.6-1296.g736ac5ba.el8.noarch 90/122 2023-10-06T01:20:01.324 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : ceph-osd-2:17.2.6-1296.g736ac5ba.el8.x86_64 91/122 2023-10-06T01:20:01.434 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: ceph-osd-2:17.2.6-1296.g736ac5ba.el8.x86_64 91/122 2023-10-06T01:20:01.611 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: ceph-osd-2:17.2.6-1296.g736ac5ba.el8.x86_64 91/122 2023-10-06T01:20:01.619 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : ceph-mds-2:17.2.6-1296.g736ac5ba.el8.x86_64 92/122 2023-10-06T01:20:01.789 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : ceph-mds-2:17.2.6-1296.g736ac5ba.el8.x86_64 92/122 2023-10-06T01:20:02.111 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: ceph-mds-2:17.2.6-1296.g736ac5ba.el8.x86_64 92/122 2023-10-06T01:20:02.258 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: ceph-mds-2:17.2.6-1296.g736ac5ba.el8.x86_64 92/122 2023-10-06T01:20:02.286 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : ceph-mon-2:17.2.6-1296.g736ac5ba.el8.x86_64 93/122 2023-10-06T01:20:02.328 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: ceph-mon-2:17.2.6-1296.g736ac5ba.el8.x86_64 93/122 2023-10-06T01:20:02.417 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : ceph-mon-2:17.2.6-1296.g736ac5ba.el8.x86_64 93/122 2023-10-06T01:20:02.458 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: ceph-mon-2:17.2.6-1296.g736ac5ba.el8.x86_64 93/122 2023-10-06T01:20:06.774 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: cephadm-2:17.2.6-1296.g736ac5ba.el8.noarch 94/122 2023-10-06T01:20:06.830 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: cephadm-2:17.2.6-1296.g736ac5ba.el8.noarch 94/122 2023-10-06T01:20:06.994 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : cephadm-2:17.2.6-1296.g736ac5ba.el8.noarch 94/122 2023-10-06T01:20:07.017 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : cephadm-2:17.2.6-1296.g736ac5ba.el8.noarch 94/122 2023-10-06T01:20:07.181 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : ceph-prometheus-alerts-2:17.2.6-1296.g736ac5ba.e 95/122 2023-10-06T01:20:07.244 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : ceph-prometheus-alerts-2:17.2.6-1296.g736ac5ba.e 95/122 2023-10-06T01:20:07.366 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : ceph-grafana-dashboards-2:17.2.6-1296.g736ac5ba. 96/122 2023-10-06T01:20:07.440 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : ceph-grafana-dashboards-2:17.2.6-1296.g736ac5ba. 96/122 2023-10-06T01:20:07.583 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : ceph-mgr-cephadm-2:17.2.6-1296.g736ac5ba.el8.noa 97/122 2023-10-06T01:20:07.658 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : ceph-mgr-cephadm-2:17.2.6-1296.g736ac5ba.el8.noa 97/122 2023-10-06T01:20:07.853 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: ceph-mgr-cephadm-2:17.2.6-1296.g736ac5ba.el8.noa 97/122 2023-10-06T01:20:07.939 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: ceph-mgr-cephadm-2:17.2.6-1296.g736ac5ba.el8.noa 97/122 2023-10-06T01:20:08.080 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : ceph-mgr-dashboard-2:17.2.6-1296.g736ac5ba.el8.n 98/122 2023-10-06T01:20:08.180 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : ceph-mgr-dashboard-2:17.2.6-1296.g736ac5ba.el8.n 98/122 2023-10-06T01:20:09.201 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: ceph-mgr-dashboard-2:17.2.6-1296.g736ac5ba.el8.n 98/122 2023-10-06T01:20:09.362 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : ceph-mgr-diskprediction-local-2:17.2.6-1296.g736 99/122 2023-10-06T01:20:09.370 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: ceph-mgr-dashboard-2:17.2.6-1296.g736ac5ba.el8.n 98/122 2023-10-06T01:20:09.504 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:17.2.6-1296.g736 99/122 2023-10-06T01:20:09.559 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : ceph-mgr-diskprediction-local-2:17.2.6-1296.g736 99/122 2023-10-06T01:20:09.706 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:17.2.6-1296.g736 99/122 2023-10-06T01:20:09.909 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : ceph-mgr-modules-core-2:17.2.6-1296.g736ac5ba.el 100/122 2023-10-06T01:20:10.114 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : ceph-mgr-2:17.2.6-1296.g736ac5ba.el8.x86_64 101/122 2023-10-06T01:20:10.134 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : ceph-mgr-modules-core-2:17.2.6-1296.g736ac5ba.el 100/122 2023-10-06T01:20:10.184 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: ceph-mgr-2:17.2.6-1296.g736ac5ba.el8.x86_64 101/122 2023-10-06T01:20:10.312 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : ceph-mgr-rook-2:17.2.6-1296.g736ac5ba.el8.noarch 102/122 2023-10-06T01:20:10.339 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: ceph-mgr-rook-2:17.2.6-1296.g736ac5ba.el8.noarch 102/122 2023-10-06T01:20:10.389 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : ceph-mgr-2:17.2.6-1296.g736ac5ba.el8.x86_64 101/122 2023-10-06T01:20:10.460 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: ceph-mgr-2:17.2.6-1296.g736ac5ba.el8.x86_64 101/122 2023-10-06T01:20:10.600 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : ceph-mgr-rook-2:17.2.6-1296.g736ac5ba.el8.noarch 102/122 2023-10-06T01:20:10.629 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: ceph-mgr-rook-2:17.2.6-1296.g736ac5ba.el8.noarch 102/122 2023-10-06T01:20:12.105 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : ceph-2:17.2.6-1296.g736ac5ba.el8.x86_64 103/122 2023-10-06T01:20:12.347 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : ceph-radosgw-2:17.2.6-1296.g736ac5ba.el8.x86_64 104/122 2023-10-06T01:20:12.464 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : ceph-2:17.2.6-1296.g736ac5ba.el8.x86_64 103/122 2023-10-06T01:20:12.474 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: ceph-radosgw-2:17.2.6-1296.g736ac5ba.el8.x86_64 104/122 2023-10-06T01:20:12.646 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : ceph-immutable-object-cache-2:17.2.6-1296.g736ac 105/122 2023-10-06T01:20:12.719 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: ceph-immutable-object-cache-2:17.2.6-1296.g736ac 105/122 2023-10-06T01:20:12.730 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : ceph-radosgw-2:17.2.6-1296.g736ac5ba.el8.x86_64 104/122 2023-10-06T01:20:12.845 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: ceph-radosgw-2:17.2.6-1296.g736ac5ba.el8.x86_64 104/122 2023-10-06T01:20:12.879 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : cephfs-mirror-2:17.2.6-1296.g736ac5ba.el8.x86_64 106/122 2023-10-06T01:20:13.068 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : ceph-immutable-object-cache-2:17.2.6-1296.g736ac 105/122 2023-10-06T01:20:13.148 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: ceph-immutable-object-cache-2:17.2.6-1296.g736ac 105/122 2023-10-06T01:20:13.291 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: cephfs-mirror-2:17.2.6-1296.g736ac5ba.el8.x86_64 106/122 2023-10-06T01:20:13.367 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : cephfs-mirror-2:17.2.6-1296.g736ac5ba.el8.x86_64 106/122 2023-10-06T01:20:13.479 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : rbd-mirror-2:17.2.6-1296.g736ac5ba.el8.x86_64 107/122 2023-10-06T01:20:13.804 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: cephfs-mirror-2:17.2.6-1296.g736ac5ba.el8.x86_64 106/122 2023-10-06T01:20:14.018 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : rbd-mirror-2:17.2.6-1296.g736ac5ba.el8.x86_64 107/122 2023-10-06T01:20:18.867 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: rbd-mirror-2:17.2.6-1296.g736ac5ba.el8.x86_64 107/122 2023-10-06T01:20:19.770 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: rbd-mirror-2:17.2.6-1296.g736ac5ba.el8.x86_64 107/122 2023-10-06T01:20:20.165 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : ceph-test-2:17.2.6-1296.g736ac5ba.el8.x86_64 108/122 2023-10-06T01:20:20.538 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : openssl-devel-1:1.1.1g-15.el8_3.x86_64 109/122 2023-10-06T01:20:20.778 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : ceph-fuse-2:17.2.6-1296.g736ac5ba.el8.x86_64 110/122 2023-10-06T01:20:21.008 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : xfsprogs-devel-5.0.0-8.el8.x86_64 111/122 2023-10-06T01:20:21.198 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : ceph-test-2:17.2.6-1296.g736ac5ba.el8.x86_64 108/122 2023-10-06T01:20:21.219 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : libtool-2.4.6-25.el8.x86_64 112/122 2023-10-06T01:20:21.246 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: libtool-2.4.6-25.el8.x86_64 112/122 2023-10-06T01:20:21.391 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : libcephfs-devel-2:17.2.6-1296.g736ac5ba.el8.x86_ 113/122 2023-10-06T01:20:21.525 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : elfutils-libelf-devel-0.182-3.el8.x86_64 114/122 2023-10-06T01:20:21.638 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : openssl-devel-1:1.1.1g-15.el8_3.x86_64 109/122 2023-10-06T01:20:21.729 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : cephfs-top-2:17.2.6-1296.g736ac5ba.el8.noarch 115/122 2023-10-06T01:20:21.912 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : rbd-fuse-2:17.2.6-1296.g736ac5ba.el8.x86_64 116/122 2023-10-06T01:20:21.999 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : ceph-fuse-2:17.2.6-1296.g736ac5ba.el8.x86_64 110/122 2023-10-06T01:20:22.162 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : rbd-nbd-2:17.2.6-1296.g736ac5ba.el8.x86_64 117/122 2023-10-06T01:20:22.256 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : xfsprogs-devel-5.0.0-8.el8.x86_64 111/122 2023-10-06T01:20:22.385 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : bison-3.0.4-10.el8.x86_64 118/122 2023-10-06T01:20:22.457 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : libtool-2.4.6-25.el8.x86_64 112/122 2023-10-06T01:20:22.468 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: bison-3.0.4-10.el8.x86_64 118/122 2023-10-06T01:20:22.486 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: libtool-2.4.6-25.el8.x86_64 112/122 2023-10-06T01:20:22.639 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : libcephfs-devel-2:17.2.6-1296.g736ac5ba.el8.x86_ 113/122 2023-10-06T01:20:22.643 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : flex-2.6.1-9.el8.x86_64 119/122 2023-10-06T01:20:22.667 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: flex-2.6.1-9.el8.x86_64 119/122 2023-10-06T01:20:22.814 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : libaio-devel-0.3.112-1.el8.x86_64 120/122 2023-10-06T01:20:22.814 INFO:teuthology.orchestra.run.smithi155.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 121/122 2023-10-06T01:20:22.831 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : elfutils-libelf-devel-0.182-3.el8.x86_64 114/122 2023-10-06T01:20:22.985 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : cephfs-top-2:17.2.6-1296.g736ac5ba.el8.noarch 115/122 2023-10-06T01:20:23.042 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 121/122 2023-10-06T01:20:23.042 INFO:teuthology.orchestra.run.smithi155.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 122/122 2023-10-06T01:20:23.186 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : rbd-fuse-2:17.2.6-1296.g736ac5ba.el8.x86_64 116/122 2023-10-06T01:20:23.429 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 122/122 2023-10-06T01:20:23.429 INFO:teuthology.orchestra.run.smithi155.stdout:Couldn't write '0' to 'kernel/yama/ptrace_scope', ignoring: No such file or directory 2023-10-06T01:20:23.429 INFO:teuthology.orchestra.run.smithi155.stdout: 2023-10-06T01:20:23.495 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : rbd-nbd-2:17.2.6-1296.g736ac5ba.el8.x86_64 117/122 2023-10-06T01:20:23.715 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : bison-3.0.4-10.el8.x86_64 118/122 2023-10-06T01:20:23.799 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: bison-3.0.4-10.el8.x86_64 118/122 2023-10-06T01:20:23.999 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : flex-2.6.1-9.el8.x86_64 119/122 2023-10-06T01:20:24.025 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: flex-2.6.1-9.el8.x86_64 119/122 2023-10-06T01:20:24.203 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : libaio-devel-0.3.112-1.el8.x86_64 120/122 2023-10-06T01:20:24.203 INFO:teuthology.orchestra.run.smithi050.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 121/122 2023-10-06T01:20:24.329 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : ceph-2:17.2.6-1296.g736ac5ba.el8.x86_64 1/122 2023-10-06T01:20:24.329 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : ceph-base-2:17.2.6-1296.g736ac5ba.el8.x86_64 2/122 2023-10-06T01:20:24.329 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : ceph-common-2:17.2.6-1296.g736ac5ba.el8.x86_64 3/122 2023-10-06T01:20:24.329 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : ceph-fuse-2:17.2.6-1296.g736ac5ba.el8.x86_64 4/122 2023-10-06T01:20:24.329 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : ceph-immutable-object-cache-2:17.2.6-1296.g736ac 5/122 2023-10-06T01:20:24.329 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : ceph-mds-2:17.2.6-1296.g736ac5ba.el8.x86_64 6/122 2023-10-06T01:20:24.329 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : ceph-mgr-2:17.2.6-1296.g736ac5ba.el8.x86_64 7/122 2023-10-06T01:20:24.329 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : ceph-mon-2:17.2.6-1296.g736ac5ba.el8.x86_64 8/122 2023-10-06T01:20:24.330 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : ceph-osd-2:17.2.6-1296.g736ac5ba.el8.x86_64 9/122 2023-10-06T01:20:24.330 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : ceph-radosgw-2:17.2.6-1296.g736ac5ba.el8.x86_64 10/122 2023-10-06T01:20:24.330 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : ceph-selinux-2:17.2.6-1296.g736ac5ba.el8.x86_64 11/122 2023-10-06T01:20:24.330 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : ceph-test-2:17.2.6-1296.g736ac5ba.el8.x86_64 12/122 2023-10-06T01:20:24.330 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : cephfs-mirror-2:17.2.6-1296.g736ac5ba.el8.x86_64 13/122 2023-10-06T01:20:24.330 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : libcephfs-devel-2:17.2.6-1296.g736ac5ba.el8.x86_ 14/122 2023-10-06T01:20:24.330 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : libcephfs2-2:17.2.6-1296.g736ac5ba.el8.x86_64 15/122 2023-10-06T01:20:24.330 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : libcephsqlite-2:17.2.6-1296.g736ac5ba.el8.x86_64 16/122 2023-10-06T01:20:24.330 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : librados-devel-2:17.2.6-1296.g736ac5ba.el8.x86_6 17/122 2023-10-06T01:20:24.330 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : libradosstriper1-2:17.2.6-1296.g736ac5ba.el8.x86 18/122 2023-10-06T01:20:24.330 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : librgw2-2:17.2.6-1296.g736ac5ba.el8.x86_64 19/122 2023-10-06T01:20:24.331 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-ceph-argparse-2:17.2.6-1296.g736ac5ba.el 20/122 2023-10-06T01:20:24.331 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-ceph-common-2:17.2.6-1296.g736ac5ba.el8. 21/122 2023-10-06T01:20:24.331 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-cephfs-2:17.2.6-1296.g736ac5ba.el8.x86_6 22/122 2023-10-06T01:20:24.331 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-rados-2:17.2.6-1296.g736ac5ba.el8.x86_64 23/122 2023-10-06T01:20:24.331 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-rbd-2:17.2.6-1296.g736ac5ba.el8.x86_64 24/122 2023-10-06T01:20:24.331 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-rgw-2:17.2.6-1296.g736ac5ba.el8.x86_64 25/122 2023-10-06T01:20:24.331 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : rbd-fuse-2:17.2.6-1296.g736ac5ba.el8.x86_64 26/122 2023-10-06T01:20:24.331 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : rbd-mirror-2:17.2.6-1296.g736ac5ba.el8.x86_64 27/122 2023-10-06T01:20:24.331 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : rbd-nbd-2:17.2.6-1296.g736ac5ba.el8.x86_64 28/122 2023-10-06T01:20:24.331 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : ceph-grafana-dashboards-2:17.2.6-1296.g736ac5ba. 29/122 2023-10-06T01:20:24.339 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : ceph-mgr-cephadm-2:17.2.6-1296.g736ac5ba.el8.noa 30/122 2023-10-06T01:20:24.339 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : ceph-mgr-dashboard-2:17.2.6-1296.g736ac5ba.el8.n 31/122 2023-10-06T01:20:24.339 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : ceph-mgr-diskprediction-local-2:17.2.6-1296.g736 32/122 2023-10-06T01:20:24.340 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : ceph-mgr-modules-core-2:17.2.6-1296.g736ac5ba.el 33/122 2023-10-06T01:20:24.340 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : ceph-mgr-rook-2:17.2.6-1296.g736ac5ba.el8.noarch 34/122 2023-10-06T01:20:24.340 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : ceph-prometheus-alerts-2:17.2.6-1296.g736ac5ba.e 35/122 2023-10-06T01:20:24.340 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : ceph-volume-2:17.2.6-1296.g736ac5ba.el8.noarch 36/122 2023-10-06T01:20:24.340 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : cephadm-2:17.2.6-1296.g736ac5ba.el8.noarch 37/122 2023-10-06T01:20:24.340 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : cephfs-top-2:17.2.6-1296.g736ac5ba.el8.noarch 38/122 2023-10-06T01:20:24.340 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 39/122 2023-10-06T01:20:24.340 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 40/122 2023-10-06T01:20:24.340 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 41/122 2023-10-06T01:20:24.340 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-asyncssh-2.7.0-2.el8.noarch 42/122 2023-10-06T01:20:24.340 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 43/122 2023-10-06T01:20:24.341 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 44/122 2023-10-06T01:20:24.341 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 45/122 2023-10-06T01:20:24.341 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 46/122 2023-10-06T01:20:24.341 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 47/122 2023-10-06T01:20:24.341 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 48/122 2023-10-06T01:20:24.341 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 49/122 2023-10-06T01:20:24.341 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 50/122 2023-10-06T01:20:24.341 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 51/122 2023-10-06T01:20:24.341 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-kubernetes-1:11.0.0-6.el8.noarch 52/122 2023-10-06T01:20:24.341 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 53/122 2023-10-06T01:20:24.341 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 54/122 2023-10-06T01:20:24.341 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-natsort-7.1.1-2.el8.noarch 55/122 2023-10-06T01:20:24.342 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 56/122 2023-10-06T01:20:24.342 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-portend-2.6-1.el8.noarch 57/122 2023-10-06T01:20:24.342 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 58/122 2023-10-06T01:20:24.342 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 59/122 2023-10-06T01:20:24.342 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-rsa-4.9-2.el8.noarch 60/122 2023-10-06T01:20:24.342 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 61/122 2023-10-06T01:20:24.342 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 62/122 2023-10-06T01:20:24.342 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 63/122 2023-10-06T01:20:24.342 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 64/122 2023-10-06T01:20:24.342 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-waitress-1.4.3-1.el8.noarch 65/122 2023-10-06T01:20:24.342 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 66/122 2023-10-06T01:20:24.343 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 67/122 2023-10-06T01:20:24.343 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 68/122 2023-10-06T01:20:24.343 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 69/122 2023-10-06T01:20:24.343 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : thrift-0.13.0-2.el8.x86_64 70/122 2023-10-06T01:20:24.343 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : xmlstarlet-1.6.1-20.el8.x86_64 71/122 2023-10-06T01:20:24.343 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : libaio-devel-0.3.112-1.el8.x86_64 72/122 2023-10-06T01:20:24.343 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 73/122 2023-10-06T01:20:24.343 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 74/122 2023-10-06T01:20:24.343 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : pcre2-utf32-10.32-2.el8.x86_64 75/122 2023-10-06T01:20:24.343 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : keyutils-libs-devel-1.5.10-6.el8.x86_64 76/122 2023-10-06T01:20:24.343 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : pcre2-utf16-10.32-2.el8.x86_64 77/122 2023-10-06T01:20:24.343 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 78/122 2023-10-06T01:20:24.344 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : openssl-devel-1:1.1.1g-15.el8_3.x86_64 79/122 2023-10-06T01:20:24.344 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : libverto-devel-0.3.0-5.el8.x86_64 80/122 2023-10-06T01:20:24.344 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : pcre2-devel-10.32-2.el8.x86_64 81/122 2023-10-06T01:20:24.344 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : fuse-2.9.7-12.el8.x86_64 82/122 2023-10-06T01:20:24.344 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : elfutils-libelf-devel-0.182-3.el8.x86_64 83/122 2023-10-06T01:20:24.344 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : libquadmath-8.4.1-1.el8.x86_64 84/122 2023-10-06T01:20:24.344 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : libcom_err-devel-1.45.6-1.el8.x86_64 85/122 2023-10-06T01:20:24.344 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : libsepol-devel-2.9-2.el8.x86_64 86/122 2023-10-06T01:20:24.344 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : zlib-devel-1.2.11-17.el8.x86_64 87/122 2023-10-06T01:20:24.344 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : librabbitmq-0.9.0-3.el8.x86_64 88/122 2023-10-06T01:20:24.344 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : krb5-devel-1.18.2-8.3.el8_4.x86_64 89/122 2023-10-06T01:20:24.344 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : libgfortran-8.4.1-1.el8.x86_64 90/122 2023-10-06T01:20:24.345 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : xfsprogs-devel-5.0.0-8.el8.x86_64 91/122 2023-10-06T01:20:24.345 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : libselinux-devel-2.9-5.el8.x86_64 92/122 2023-10-06T01:20:24.345 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : libuuid-devel-2.32.1-27.el8.x86_64 93/122 2023-10-06T01:20:24.345 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-scipy-1.0.0-20.module+el8.1.0+3334+5cb62 94/122 2023-10-06T01:20:24.345 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 95/122 2023-10-06T01:20:24.345 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 96/122 2023-10-06T01:20:24.345 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : jq-1.5-12.el8.x86_64 97/122 2023-10-06T01:20:24.345 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : flex-2.6.1-9.el8.x86_64 98/122 2023-10-06T01:20:24.345 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 99/122 2023-10-06T01:20:24.345 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-babel-2.5.1-5.el8.noarch 100/122 2023-10-06T01:20:24.345 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 101/122 2023-10-06T01:20:24.345 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : bison-3.0.4-10.el8.x86_64 102/122 2023-10-06T01:20:24.346 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 103/122 2023-10-06T01:20:24.346 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-numpy-f2py-1:1.14.3-9.el8.x86_64 104/122 2023-10-06T01:20:24.346 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 105/122 2023-10-06T01:20:24.346 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-numpy-1:1.14.3-9.el8.x86_64 106/122 2023-10-06T01:20:24.346 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : oniguruma-6.8.2-2.el8.x86_64 107/122 2023-10-06T01:20:24.346 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-jinja2-2.10.1-2.el8_0.noarch 108/122 2023-10-06T01:20:24.346 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : socat-1.7.3.3-2.el8.x86_64 109/122 2023-10-06T01:20:24.346 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-mako-1.0.6-13.el8.noarch 110/122 2023-10-06T01:20:24.346 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 111/122 2023-10-06T01:20:24.346 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : librdkafka-0.11.4-1.el8.x86_64 112/122 2023-10-06T01:20:24.346 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 113/122 2023-10-06T01:20:24.346 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : libtool-2.4.6-25.el8.x86_64 114/122 2023-10-06T01:20:24.347 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-pytz-2017.2-9.el8.noarch 115/122 2023-10-06T01:20:24.347 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : openblas-threads-0.3.12-1.el8.x86_64 116/122 2023-10-06T01:20:24.347 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : openblas-0.3.12-1.el8.x86_64 117/122 2023-10-06T01:20:24.347 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : automake-1.16.1-7.el8.noarch 118/122 2023-10-06T01:20:24.347 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : librados2-2:17.2.6-1296.g736ac5ba.el8.x86_64 119/122 2023-10-06T01:20:24.347 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 120/122 2023-10-06T01:20:24.347 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : librbd1-2:17.2.6-1296.g736ac5ba.el8.x86_64 121/122 2023-10-06T01:20:24.472 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 121/122 2023-10-06T01:20:24.472 INFO:teuthology.orchestra.run.smithi050.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 122/122 2023-10-06T01:20:24.872 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 122/122 2023-10-06T01:20:24.872 INFO:teuthology.orchestra.run.smithi050.stdout:Couldn't write '0' to 'kernel/yama/ptrace_scope', ignoring: No such file or directory 2023-10-06T01:20:24.872 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-10-06T01:20:25.904 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : ceph-2:17.2.6-1296.g736ac5ba.el8.x86_64 1/122 2023-10-06T01:20:25.904 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : ceph-base-2:17.2.6-1296.g736ac5ba.el8.x86_64 2/122 2023-10-06T01:20:25.904 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : ceph-common-2:17.2.6-1296.g736ac5ba.el8.x86_64 3/122 2023-10-06T01:20:25.904 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : ceph-fuse-2:17.2.6-1296.g736ac5ba.el8.x86_64 4/122 2023-10-06T01:20:25.904 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : ceph-immutable-object-cache-2:17.2.6-1296.g736ac 5/122 2023-10-06T01:20:25.904 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : ceph-mds-2:17.2.6-1296.g736ac5ba.el8.x86_64 6/122 2023-10-06T01:20:25.904 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : ceph-mgr-2:17.2.6-1296.g736ac5ba.el8.x86_64 7/122 2023-10-06T01:20:25.904 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : ceph-mon-2:17.2.6-1296.g736ac5ba.el8.x86_64 8/122 2023-10-06T01:20:25.905 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : ceph-osd-2:17.2.6-1296.g736ac5ba.el8.x86_64 9/122 2023-10-06T01:20:25.905 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : ceph-radosgw-2:17.2.6-1296.g736ac5ba.el8.x86_64 10/122 2023-10-06T01:20:25.905 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : ceph-selinux-2:17.2.6-1296.g736ac5ba.el8.x86_64 11/122 2023-10-06T01:20:25.905 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : ceph-test-2:17.2.6-1296.g736ac5ba.el8.x86_64 12/122 2023-10-06T01:20:25.905 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : cephfs-mirror-2:17.2.6-1296.g736ac5ba.el8.x86_64 13/122 2023-10-06T01:20:25.905 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : libcephfs-devel-2:17.2.6-1296.g736ac5ba.el8.x86_ 14/122 2023-10-06T01:20:25.905 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : libcephfs2-2:17.2.6-1296.g736ac5ba.el8.x86_64 15/122 2023-10-06T01:20:25.905 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : libcephsqlite-2:17.2.6-1296.g736ac5ba.el8.x86_64 16/122 2023-10-06T01:20:25.905 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : librados-devel-2:17.2.6-1296.g736ac5ba.el8.x86_6 17/122 2023-10-06T01:20:25.905 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : libradosstriper1-2:17.2.6-1296.g736ac5ba.el8.x86 18/122 2023-10-06T01:20:25.905 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : librgw2-2:17.2.6-1296.g736ac5ba.el8.x86_64 19/122 2023-10-06T01:20:25.906 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-ceph-argparse-2:17.2.6-1296.g736ac5ba.el 20/122 2023-10-06T01:20:25.906 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-ceph-common-2:17.2.6-1296.g736ac5ba.el8. 21/122 2023-10-06T01:20:25.906 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-cephfs-2:17.2.6-1296.g736ac5ba.el8.x86_6 22/122 2023-10-06T01:20:25.906 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-rados-2:17.2.6-1296.g736ac5ba.el8.x86_64 23/122 2023-10-06T01:20:25.906 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-rbd-2:17.2.6-1296.g736ac5ba.el8.x86_64 24/122 2023-10-06T01:20:25.906 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-rgw-2:17.2.6-1296.g736ac5ba.el8.x86_64 25/122 2023-10-06T01:20:25.906 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : rbd-fuse-2:17.2.6-1296.g736ac5ba.el8.x86_64 26/122 2023-10-06T01:20:25.906 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : rbd-mirror-2:17.2.6-1296.g736ac5ba.el8.x86_64 27/122 2023-10-06T01:20:25.914 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : rbd-nbd-2:17.2.6-1296.g736ac5ba.el8.x86_64 28/122 2023-10-06T01:20:25.914 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : ceph-grafana-dashboards-2:17.2.6-1296.g736ac5ba. 29/122 2023-10-06T01:20:25.914 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : ceph-mgr-cephadm-2:17.2.6-1296.g736ac5ba.el8.noa 30/122 2023-10-06T01:20:25.914 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : ceph-mgr-dashboard-2:17.2.6-1296.g736ac5ba.el8.n 31/122 2023-10-06T01:20:25.915 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : ceph-mgr-diskprediction-local-2:17.2.6-1296.g736 32/122 2023-10-06T01:20:25.915 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : ceph-mgr-modules-core-2:17.2.6-1296.g736ac5ba.el 33/122 2023-10-06T01:20:25.915 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : ceph-mgr-rook-2:17.2.6-1296.g736ac5ba.el8.noarch 34/122 2023-10-06T01:20:25.915 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : ceph-prometheus-alerts-2:17.2.6-1296.g736ac5ba.e 35/122 2023-10-06T01:20:25.915 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : ceph-volume-2:17.2.6-1296.g736ac5ba.el8.noarch 36/122 2023-10-06T01:20:25.915 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : cephadm-2:17.2.6-1296.g736ac5ba.el8.noarch 37/122 2023-10-06T01:20:25.915 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : cephfs-top-2:17.2.6-1296.g736ac5ba.el8.noarch 38/122 2023-10-06T01:20:25.915 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 39/122 2023-10-06T01:20:25.915 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 40/122 2023-10-06T01:20:25.915 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 41/122 2023-10-06T01:20:25.915 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-asyncssh-2.7.0-2.el8.noarch 42/122 2023-10-06T01:20:25.916 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 43/122 2023-10-06T01:20:25.916 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 44/122 2023-10-06T01:20:25.916 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 45/122 2023-10-06T01:20:25.916 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 46/122 2023-10-06T01:20:25.916 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 47/122 2023-10-06T01:20:25.916 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 48/122 2023-10-06T01:20:25.916 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 49/122 2023-10-06T01:20:25.916 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 50/122 2023-10-06T01:20:25.916 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 51/122 2023-10-06T01:20:25.916 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-kubernetes-1:11.0.0-6.el8.noarch 52/122 2023-10-06T01:20:25.916 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 53/122 2023-10-06T01:20:25.917 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 54/122 2023-10-06T01:20:25.917 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-natsort-7.1.1-2.el8.noarch 55/122 2023-10-06T01:20:25.917 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 56/122 2023-10-06T01:20:25.917 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-portend-2.6-1.el8.noarch 57/122 2023-10-06T01:20:25.917 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 58/122 2023-10-06T01:20:25.917 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 59/122 2023-10-06T01:20:25.917 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-rsa-4.9-2.el8.noarch 60/122 2023-10-06T01:20:25.917 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 61/122 2023-10-06T01:20:25.917 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 62/122 2023-10-06T01:20:25.917 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 63/122 2023-10-06T01:20:25.917 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 64/122 2023-10-06T01:20:25.917 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-waitress-1.4.3-1.el8.noarch 65/122 2023-10-06T01:20:25.918 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 66/122 2023-10-06T01:20:25.918 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 67/122 2023-10-06T01:20:25.918 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 68/122 2023-10-06T01:20:25.918 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 69/122 2023-10-06T01:20:25.918 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : thrift-0.13.0-2.el8.x86_64 70/122 2023-10-06T01:20:25.918 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : xmlstarlet-1.6.1-20.el8.x86_64 71/122 2023-10-06T01:20:25.918 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : libaio-devel-0.3.112-1.el8.x86_64 72/122 2023-10-06T01:20:25.918 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 73/122 2023-10-06T01:20:25.918 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 74/122 2023-10-06T01:20:25.918 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : pcre2-utf32-10.32-2.el8.x86_64 75/122 2023-10-06T01:20:25.918 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : keyutils-libs-devel-1.5.10-6.el8.x86_64 76/122 2023-10-06T01:20:25.918 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : pcre2-utf16-10.32-2.el8.x86_64 77/122 2023-10-06T01:20:25.919 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 78/122 2023-10-06T01:20:25.919 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : openssl-devel-1:1.1.1g-15.el8_3.x86_64 79/122 2023-10-06T01:20:25.919 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : libverto-devel-0.3.0-5.el8.x86_64 80/122 2023-10-06T01:20:25.919 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : pcre2-devel-10.32-2.el8.x86_64 81/122 2023-10-06T01:20:25.919 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : fuse-2.9.7-12.el8.x86_64 82/122 2023-10-06T01:20:25.919 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : elfutils-libelf-devel-0.182-3.el8.x86_64 83/122 2023-10-06T01:20:25.919 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : libquadmath-8.4.1-1.el8.x86_64 84/122 2023-10-06T01:20:25.919 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : libcom_err-devel-1.45.6-1.el8.x86_64 85/122 2023-10-06T01:20:25.919 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : libsepol-devel-2.9-2.el8.x86_64 86/122 2023-10-06T01:20:25.919 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : zlib-devel-1.2.11-17.el8.x86_64 87/122 2023-10-06T01:20:25.919 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : librabbitmq-0.9.0-3.el8.x86_64 88/122 2023-10-06T01:20:25.919 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : krb5-devel-1.18.2-8.3.el8_4.x86_64 89/122 2023-10-06T01:20:25.920 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : libgfortran-8.4.1-1.el8.x86_64 90/122 2023-10-06T01:20:25.920 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : xfsprogs-devel-5.0.0-8.el8.x86_64 91/122 2023-10-06T01:20:25.920 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : libselinux-devel-2.9-5.el8.x86_64 92/122 2023-10-06T01:20:25.920 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : libuuid-devel-2.32.1-27.el8.x86_64 93/122 2023-10-06T01:20:25.920 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-scipy-1.0.0-20.module+el8.1.0+3334+5cb62 94/122 2023-10-06T01:20:25.920 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 95/122 2023-10-06T01:20:25.920 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 96/122 2023-10-06T01:20:25.920 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : jq-1.5-12.el8.x86_64 97/122 2023-10-06T01:20:25.920 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : flex-2.6.1-9.el8.x86_64 98/122 2023-10-06T01:20:25.920 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 99/122 2023-10-06T01:20:25.920 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-babel-2.5.1-5.el8.noarch 100/122 2023-10-06T01:20:25.920 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 101/122 2023-10-06T01:20:25.921 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : bison-3.0.4-10.el8.x86_64 102/122 2023-10-06T01:20:25.921 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 103/122 2023-10-06T01:20:25.921 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-numpy-f2py-1:1.14.3-9.el8.x86_64 104/122 2023-10-06T01:20:25.921 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 105/122 2023-10-06T01:20:25.921 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-numpy-1:1.14.3-9.el8.x86_64 106/122 2023-10-06T01:20:25.921 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : oniguruma-6.8.2-2.el8.x86_64 107/122 2023-10-06T01:20:25.921 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-jinja2-2.10.1-2.el8_0.noarch 108/122 2023-10-06T01:20:25.921 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : socat-1.7.3.3-2.el8.x86_64 109/122 2023-10-06T01:20:25.921 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-mako-1.0.6-13.el8.noarch 110/122 2023-10-06T01:20:25.921 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 111/122 2023-10-06T01:20:25.921 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : librdkafka-0.11.4-1.el8.x86_64 112/122 2023-10-06T01:20:25.921 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 113/122 2023-10-06T01:20:25.921 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : libtool-2.4.6-25.el8.x86_64 114/122 2023-10-06T01:20:25.922 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-pytz-2017.2-9.el8.noarch 115/122 2023-10-06T01:20:25.922 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : openblas-threads-0.3.12-1.el8.x86_64 116/122 2023-10-06T01:20:25.922 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : openblas-0.3.12-1.el8.x86_64 117/122 2023-10-06T01:20:25.922 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : automake-1.16.1-7.el8.noarch 118/122 2023-10-06T01:20:25.922 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : librados2-2:17.2.6-1296.g736ac5ba.el8.x86_64 119/122 2023-10-06T01:20:25.922 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 120/122 2023-10-06T01:20:25.922 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : librbd1-2:17.2.6-1296.g736ac5ba.el8.x86_64 121/122 2023-10-06T01:20:26.675 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 122/122 2023-10-06T01:20:26.675 INFO:teuthology.orchestra.run.smithi155.stdout:Last metadata expiration check: 0:01:51 ago on Fri 06 Oct 2023 01:18:35 AM UTC. 2023-10-06T01:20:28.230 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 122/122 2023-10-06T01:20:28.231 INFO:teuthology.orchestra.run.smithi050.stdout:Last metadata expiration check: 0:01:57 ago on Fri 06 Oct 2023 01:18:31 AM UTC. 2023-10-06T01:20:28.749 INFO:teuthology.orchestra.run.smithi155.stdout:Installed products updated. 2023-10-06T01:20:28.881 INFO:teuthology.orchestra.run.smithi155.stdout: 2023-10-06T01:20:28.882 INFO:teuthology.orchestra.run.smithi155.stdout:Upgraded: 2023-10-06T01:20:28.882 INFO:teuthology.orchestra.run.smithi155.stdout: librados2-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T01:20:28.882 INFO:teuthology.orchestra.run.smithi155.stdout: librbd1-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T01:20:28.882 INFO:teuthology.orchestra.run.smithi155.stdout:Installed: 2023-10-06T01:20:28.882 INFO:teuthology.orchestra.run.smithi155.stdout: automake-1.16.1-7.el8.noarch 2023-10-06T01:20:28.882 INFO:teuthology.orchestra.run.smithi155.stdout: bison-3.0.4-10.el8.x86_64 2023-10-06T01:20:28.883 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T01:20:28.883 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-base-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T01:20:28.883 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-common-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T01:20:28.883 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-fuse-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T01:20:28.883 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-grafana-dashboards-2:17.2.6-1296.g736ac5ba.el8.noarch 2023-10-06T01:20:28.883 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-immutable-object-cache-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T01:20:28.883 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-mds-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T01:20:28.884 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-mgr-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T01:20:28.884 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-mgr-cephadm-2:17.2.6-1296.g736ac5ba.el8.noarch 2023-10-06T01:20:28.884 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-mgr-dashboard-2:17.2.6-1296.g736ac5ba.el8.noarch 2023-10-06T01:20:28.884 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-mgr-diskprediction-local-2:17.2.6-1296.g736ac5ba.el8.noarch 2023-10-06T01:20:28.884 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-mgr-modules-core-2:17.2.6-1296.g736ac5ba.el8.noarch 2023-10-06T01:20:28.884 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-mgr-rook-2:17.2.6-1296.g736ac5ba.el8.noarch 2023-10-06T01:20:28.884 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-mon-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T01:20:28.884 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-osd-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T01:20:28.885 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-prometheus-alerts-2:17.2.6-1296.g736ac5ba.el8.noarch 2023-10-06T01:20:28.885 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-radosgw-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T01:20:28.885 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-selinux-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T01:20:28.885 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-test-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T01:20:28.885 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-volume-2:17.2.6-1296.g736ac5ba.el8.noarch 2023-10-06T01:20:28.885 INFO:teuthology.orchestra.run.smithi155.stdout: cephadm-2:17.2.6-1296.g736ac5ba.el8.noarch 2023-10-06T01:20:28.885 INFO:teuthology.orchestra.run.smithi155.stdout: cephfs-mirror-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T01:20:28.886 INFO:teuthology.orchestra.run.smithi155.stdout: cephfs-top-2:17.2.6-1296.g736ac5ba.el8.noarch 2023-10-06T01:20:28.886 INFO:teuthology.orchestra.run.smithi155.stdout: elfutils-libelf-devel-0.182-3.el8.x86_64 2023-10-06T01:20:28.886 INFO:teuthology.orchestra.run.smithi155.stdout: flex-2.6.1-9.el8.x86_64 2023-10-06T01:20:28.886 INFO:teuthology.orchestra.run.smithi155.stdout: fuse-2.9.7-12.el8.x86_64 2023-10-06T01:20:28.886 INFO:teuthology.orchestra.run.smithi155.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2023-10-06T01:20:28.886 INFO:teuthology.orchestra.run.smithi155.stdout: jq-1.5-12.el8.x86_64 2023-10-06T01:20:28.886 INFO:teuthology.orchestra.run.smithi155.stdout: keyutils-libs-devel-1.5.10-6.el8.x86_64 2023-10-06T01:20:28.887 INFO:teuthology.orchestra.run.smithi155.stdout: krb5-devel-1.18.2-8.3.el8_4.x86_64 2023-10-06T01:20:28.887 INFO:teuthology.orchestra.run.smithi155.stdout: libaio-devel-0.3.112-1.el8.x86_64 2023-10-06T01:20:28.887 INFO:teuthology.orchestra.run.smithi155.stdout: libcephfs-devel-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T01:20:28.887 INFO:teuthology.orchestra.run.smithi155.stdout: libcephfs2-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T01:20:28.887 INFO:teuthology.orchestra.run.smithi155.stdout: libcephsqlite-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T01:20:28.887 INFO:teuthology.orchestra.run.smithi155.stdout: libcom_err-devel-1.45.6-1.el8.x86_64 2023-10-06T01:20:28.887 INFO:teuthology.orchestra.run.smithi155.stdout: libgfortran-8.4.1-1.el8.x86_64 2023-10-06T01:20:28.888 INFO:teuthology.orchestra.run.smithi155.stdout: liboath-2.6.2-3.el8.x86_64 2023-10-06T01:20:28.888 INFO:teuthology.orchestra.run.smithi155.stdout: libquadmath-8.4.1-1.el8.x86_64 2023-10-06T01:20:28.888 INFO:teuthology.orchestra.run.smithi155.stdout: librabbitmq-0.9.0-3.el8.x86_64 2023-10-06T01:20:28.888 INFO:teuthology.orchestra.run.smithi155.stdout: librados-devel-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T01:20:28.888 INFO:teuthology.orchestra.run.smithi155.stdout: libradosstriper1-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T01:20:28.888 INFO:teuthology.orchestra.run.smithi155.stdout: librdkafka-0.11.4-1.el8.x86_64 2023-10-06T01:20:28.888 INFO:teuthology.orchestra.run.smithi155.stdout: librgw2-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T01:20:28.889 INFO:teuthology.orchestra.run.smithi155.stdout: libselinux-devel-2.9-5.el8.x86_64 2023-10-06T01:20:28.889 INFO:teuthology.orchestra.run.smithi155.stdout: libsepol-devel-2.9-2.el8.x86_64 2023-10-06T01:20:28.889 INFO:teuthology.orchestra.run.smithi155.stdout: libtool-2.4.6-25.el8.x86_64 2023-10-06T01:20:28.889 INFO:teuthology.orchestra.run.smithi155.stdout: libunwind-1.3.1-3.el8.x86_64 2023-10-06T01:20:28.889 INFO:teuthology.orchestra.run.smithi155.stdout: libuuid-devel-2.32.1-27.el8.x86_64 2023-10-06T01:20:28.889 INFO:teuthology.orchestra.run.smithi155.stdout: libverto-devel-0.3.0-5.el8.x86_64 2023-10-06T01:20:28.889 INFO:teuthology.orchestra.run.smithi155.stdout: lttng-ust-2.8.1-11.el8.x86_64 2023-10-06T01:20:28.889 INFO:teuthology.orchestra.run.smithi155.stdout: oniguruma-6.8.2-2.el8.x86_64 2023-10-06T01:20:28.890 INFO:teuthology.orchestra.run.smithi155.stdout: openblas-0.3.12-1.el8.x86_64 2023-10-06T01:20:28.890 INFO:teuthology.orchestra.run.smithi155.stdout: openblas-threads-0.3.12-1.el8.x86_64 2023-10-06T01:20:28.890 INFO:teuthology.orchestra.run.smithi155.stdout: openssl-devel-1:1.1.1g-15.el8_3.x86_64 2023-10-06T01:20:28.890 INFO:teuthology.orchestra.run.smithi155.stdout: pcre2-devel-10.32-2.el8.x86_64 2023-10-06T01:20:28.890 INFO:teuthology.orchestra.run.smithi155.stdout: pcre2-utf16-10.32-2.el8.x86_64 2023-10-06T01:20:28.890 INFO:teuthology.orchestra.run.smithi155.stdout: pcre2-utf32-10.32-2.el8.x86_64 2023-10-06T01:20:28.890 INFO:teuthology.orchestra.run.smithi155.stdout: python3-asyncssh-2.7.0-2.el8.noarch 2023-10-06T01:20:28.890 INFO:teuthology.orchestra.run.smithi155.stdout: python3-babel-2.5.1-5.el8.noarch 2023-10-06T01:20:28.891 INFO:teuthology.orchestra.run.smithi155.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2023-10-06T01:20:28.891 INFO:teuthology.orchestra.run.smithi155.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2023-10-06T01:20:28.891 INFO:teuthology.orchestra.run.smithi155.stdout: python3-cachetools-3.1.1-4.el8.noarch 2023-10-06T01:20:28.891 INFO:teuthology.orchestra.run.smithi155.stdout: python3-ceph-argparse-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T01:20:28.891 INFO:teuthology.orchestra.run.smithi155.stdout: python3-ceph-common-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T01:20:28.891 INFO:teuthology.orchestra.run.smithi155.stdout: python3-cephfs-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T01:20:28.891 INFO:teuthology.orchestra.run.smithi155.stdout: python3-certifi-2018.10.15-7.el8.noarch 2023-10-06T01:20:28.891 INFO:teuthology.orchestra.run.smithi155.stdout: python3-cheroot-8.5.2-1.el8.noarch 2023-10-06T01:20:28.892 INFO:teuthology.orchestra.run.smithi155.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2023-10-06T01:20:28.892 INFO:teuthology.orchestra.run.smithi155.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2023-10-06T01:20:28.892 INFO:teuthology.orchestra.run.smithi155.stdout: python3-jaraco-6.2-6.el8.noarch 2023-10-06T01:20:28.892 INFO:teuthology.orchestra.run.smithi155.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2023-10-06T01:20:28.892 INFO:teuthology.orchestra.run.smithi155.stdout: python3-jinja2-2.10.1-2.el8_0.noarch 2023-10-06T01:20:28.892 INFO:teuthology.orchestra.run.smithi155.stdout: python3-jsonpatch-1.21-2.el8.noarch 2023-10-06T01:20:28.892 INFO:teuthology.orchestra.run.smithi155.stdout: python3-jsonpointer-1.10-11.el8.noarch 2023-10-06T01:20:28.892 INFO:teuthology.orchestra.run.smithi155.stdout: python3-jwt-1.6.1-2.el8.noarch 2023-10-06T01:20:28.893 INFO:teuthology.orchestra.run.smithi155.stdout: python3-kubernetes-1:11.0.0-6.el8.noarch 2023-10-06T01:20:28.893 INFO:teuthology.orchestra.run.smithi155.stdout: python3-logutils-0.3.5-11.el8.noarch 2023-10-06T01:20:28.893 INFO:teuthology.orchestra.run.smithi155.stdout: python3-mako-1.0.6-13.el8.noarch 2023-10-06T01:20:28.893 INFO:teuthology.orchestra.run.smithi155.stdout: python3-markupsafe-0.23-19.el8.x86_64 2023-10-06T01:20:28.893 INFO:teuthology.orchestra.run.smithi155.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2023-10-06T01:20:28.893 INFO:teuthology.orchestra.run.smithi155.stdout: python3-natsort-7.1.1-2.el8.noarch 2023-10-06T01:20:28.893 INFO:teuthology.orchestra.run.smithi155.stdout: python3-numpy-1:1.14.3-9.el8.x86_64 2023-10-06T01:20:28.893 INFO:teuthology.orchestra.run.smithi155.stdout: python3-numpy-f2py-1:1.14.3-9.el8.x86_64 2023-10-06T01:20:28.894 INFO:teuthology.orchestra.run.smithi155.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2023-10-06T01:20:28.894 INFO:teuthology.orchestra.run.smithi155.stdout: python3-pecan-1.3.2-9.el8.noarch 2023-10-06T01:20:28.894 INFO:teuthology.orchestra.run.smithi155.stdout: python3-portend-2.6-1.el8.noarch 2023-10-06T01:20:28.894 INFO:teuthology.orchestra.run.smithi155.stdout: python3-prettytable-0.7.2-14.el8.noarch 2023-10-06T01:20:28.894 INFO:teuthology.orchestra.run.smithi155.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2023-10-06T01:20:28.894 INFO:teuthology.orchestra.run.smithi155.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2023-10-06T01:20:28.894 INFO:teuthology.orchestra.run.smithi155.stdout: python3-pytz-2017.2-9.el8.noarch 2023-10-06T01:20:28.895 INFO:teuthology.orchestra.run.smithi155.stdout: python3-rados-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T01:20:28.895 INFO:teuthology.orchestra.run.smithi155.stdout: python3-rbd-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T01:20:28.895 INFO:teuthology.orchestra.run.smithi155.stdout: python3-repoze-lru-0.7-6.el8.noarch 2023-10-06T01:20:28.895 INFO:teuthology.orchestra.run.smithi155.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2023-10-06T01:20:28.895 INFO:teuthology.orchestra.run.smithi155.stdout: python3-rgw-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T01:20:28.895 INFO:teuthology.orchestra.run.smithi155.stdout: python3-routes-2.4.1-12.el8.noarch 2023-10-06T01:20:28.895 INFO:teuthology.orchestra.run.smithi155.stdout: python3-rsa-4.9-2.el8.noarch 2023-10-06T01:20:28.895 INFO:teuthology.orchestra.run.smithi155.stdout: python3-scipy-1.0.0-20.module+el8.1.0+3334+5cb623d7.x86_64 2023-10-06T01:20:28.896 INFO:teuthology.orchestra.run.smithi155.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2023-10-06T01:20:28.896 INFO:teuthology.orchestra.run.smithi155.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2023-10-06T01:20:28.896 INFO:teuthology.orchestra.run.smithi155.stdout: python3-tempora-1.14.1-5.el8.noarch 2023-10-06T01:20:28.896 INFO:teuthology.orchestra.run.smithi155.stdout: python3-trustme-0.6.0-4.el8.noarch 2023-10-06T01:20:28.896 INFO:teuthology.orchestra.run.smithi155.stdout: python3-waitress-1.4.3-1.el8.noarch 2023-10-06T01:20:28.896 INFO:teuthology.orchestra.run.smithi155.stdout: python3-webob-1.8.5-1.el8.1.noarch 2023-10-06T01:20:28.896 INFO:teuthology.orchestra.run.smithi155.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2023-10-06T01:20:28.896 INFO:teuthology.orchestra.run.smithi155.stdout: python3-webtest-2.0.33-1.el8.noarch 2023-10-06T01:20:28.897 INFO:teuthology.orchestra.run.smithi155.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2023-10-06T01:20:28.897 INFO:teuthology.orchestra.run.smithi155.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2023-10-06T01:20:28.897 INFO:teuthology.orchestra.run.smithi155.stdout: rbd-fuse-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T01:20:28.897 INFO:teuthology.orchestra.run.smithi155.stdout: rbd-mirror-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T01:20:28.897 INFO:teuthology.orchestra.run.smithi155.stdout: rbd-nbd-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T01:20:28.897 INFO:teuthology.orchestra.run.smithi155.stdout: socat-1.7.3.3-2.el8.x86_64 2023-10-06T01:20:28.897 INFO:teuthology.orchestra.run.smithi155.stdout: thrift-0.13.0-2.el8.x86_64 2023-10-06T01:20:28.897 INFO:teuthology.orchestra.run.smithi155.stdout: xfsprogs-devel-5.0.0-8.el8.x86_64 2023-10-06T01:20:28.898 INFO:teuthology.orchestra.run.smithi155.stdout: xmlstarlet-1.6.1-20.el8.x86_64 2023-10-06T01:20:28.898 INFO:teuthology.orchestra.run.smithi155.stdout: zlib-devel-1.2.11-17.el8.x86_64 2023-10-06T01:20:28.898 INFO:teuthology.orchestra.run.smithi155.stdout: 2023-10-06T01:20:28.898 INFO:teuthology.orchestra.run.smithi155.stdout:Complete! 2023-10-06T01:20:29.194 DEBUG:teuthology.parallel:result is None 2023-10-06T01:20:30.329 INFO:teuthology.orchestra.run.smithi050.stdout:Installed products updated. 2023-10-06T01:20:30.485 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-10-06T01:20:30.485 INFO:teuthology.orchestra.run.smithi050.stdout:Upgraded: 2023-10-06T01:20:30.486 INFO:teuthology.orchestra.run.smithi050.stdout: librados2-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T01:20:30.486 INFO:teuthology.orchestra.run.smithi050.stdout: librbd1-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T01:20:30.486 INFO:teuthology.orchestra.run.smithi050.stdout:Installed: 2023-10-06T01:20:30.486 INFO:teuthology.orchestra.run.smithi050.stdout: automake-1.16.1-7.el8.noarch 2023-10-06T01:20:30.486 INFO:teuthology.orchestra.run.smithi050.stdout: bison-3.0.4-10.el8.x86_64 2023-10-06T01:20:30.486 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T01:20:30.486 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-base-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T01:20:30.486 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-common-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T01:20:30.486 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-fuse-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T01:20:30.486 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-grafana-dashboards-2:17.2.6-1296.g736ac5ba.el8.noarch 2023-10-06T01:20:30.486 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-immutable-object-cache-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T01:20:30.487 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-mds-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T01:20:30.487 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-mgr-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T01:20:30.487 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-mgr-cephadm-2:17.2.6-1296.g736ac5ba.el8.noarch 2023-10-06T01:20:30.487 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-mgr-dashboard-2:17.2.6-1296.g736ac5ba.el8.noarch 2023-10-06T01:20:30.487 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-mgr-diskprediction-local-2:17.2.6-1296.g736ac5ba.el8.noarch 2023-10-06T01:20:30.487 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-mgr-modules-core-2:17.2.6-1296.g736ac5ba.el8.noarch 2023-10-06T01:20:30.487 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-mgr-rook-2:17.2.6-1296.g736ac5ba.el8.noarch 2023-10-06T01:20:30.487 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-mon-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T01:20:30.487 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-osd-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T01:20:30.487 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-prometheus-alerts-2:17.2.6-1296.g736ac5ba.el8.noarch 2023-10-06T01:20:30.487 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-radosgw-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T01:20:30.487 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-selinux-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T01:20:30.488 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-test-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T01:20:30.488 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-volume-2:17.2.6-1296.g736ac5ba.el8.noarch 2023-10-06T01:20:30.488 INFO:teuthology.orchestra.run.smithi050.stdout: cephadm-2:17.2.6-1296.g736ac5ba.el8.noarch 2023-10-06T01:20:30.488 INFO:teuthology.orchestra.run.smithi050.stdout: cephfs-mirror-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T01:20:30.488 INFO:teuthology.orchestra.run.smithi050.stdout: cephfs-top-2:17.2.6-1296.g736ac5ba.el8.noarch 2023-10-06T01:20:30.488 INFO:teuthology.orchestra.run.smithi050.stdout: elfutils-libelf-devel-0.182-3.el8.x86_64 2023-10-06T01:20:30.488 INFO:teuthology.orchestra.run.smithi050.stdout: flex-2.6.1-9.el8.x86_64 2023-10-06T01:20:30.488 INFO:teuthology.orchestra.run.smithi050.stdout: fuse-2.9.7-12.el8.x86_64 2023-10-06T01:20:30.488 INFO:teuthology.orchestra.run.smithi050.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2023-10-06T01:20:30.488 INFO:teuthology.orchestra.run.smithi050.stdout: jq-1.5-12.el8.x86_64 2023-10-06T01:20:30.488 INFO:teuthology.orchestra.run.smithi050.stdout: keyutils-libs-devel-1.5.10-6.el8.x86_64 2023-10-06T01:20:30.488 INFO:teuthology.orchestra.run.smithi050.stdout: krb5-devel-1.18.2-8.3.el8_4.x86_64 2023-10-06T01:20:30.488 INFO:teuthology.orchestra.run.smithi050.stdout: libaio-devel-0.3.112-1.el8.x86_64 2023-10-06T01:20:30.489 INFO:teuthology.orchestra.run.smithi050.stdout: libcephfs-devel-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T01:20:30.489 INFO:teuthology.orchestra.run.smithi050.stdout: libcephfs2-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T01:20:30.489 INFO:teuthology.orchestra.run.smithi050.stdout: libcephsqlite-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T01:20:30.489 INFO:teuthology.orchestra.run.smithi050.stdout: libcom_err-devel-1.45.6-1.el8.x86_64 2023-10-06T01:20:30.489 INFO:teuthology.orchestra.run.smithi050.stdout: libgfortran-8.4.1-1.el8.x86_64 2023-10-06T01:20:30.489 INFO:teuthology.orchestra.run.smithi050.stdout: liboath-2.6.2-3.el8.x86_64 2023-10-06T01:20:30.489 INFO:teuthology.orchestra.run.smithi050.stdout: libquadmath-8.4.1-1.el8.x86_64 2023-10-06T01:20:30.489 INFO:teuthology.orchestra.run.smithi050.stdout: librabbitmq-0.9.0-3.el8.x86_64 2023-10-06T01:20:30.489 INFO:teuthology.orchestra.run.smithi050.stdout: librados-devel-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T01:20:30.489 INFO:teuthology.orchestra.run.smithi050.stdout: libradosstriper1-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T01:20:30.489 INFO:teuthology.orchestra.run.smithi050.stdout: librdkafka-0.11.4-1.el8.x86_64 2023-10-06T01:20:30.490 INFO:teuthology.orchestra.run.smithi050.stdout: librgw2-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T01:20:30.490 INFO:teuthology.orchestra.run.smithi050.stdout: libselinux-devel-2.9-5.el8.x86_64 2023-10-06T01:20:30.490 INFO:teuthology.orchestra.run.smithi050.stdout: libsepol-devel-2.9-2.el8.x86_64 2023-10-06T01:20:30.490 INFO:teuthology.orchestra.run.smithi050.stdout: libtool-2.4.6-25.el8.x86_64 2023-10-06T01:20:30.490 INFO:teuthology.orchestra.run.smithi050.stdout: libunwind-1.3.1-3.el8.x86_64 2023-10-06T01:20:30.490 INFO:teuthology.orchestra.run.smithi050.stdout: libuuid-devel-2.32.1-27.el8.x86_64 2023-10-06T01:20:30.490 INFO:teuthology.orchestra.run.smithi050.stdout: libverto-devel-0.3.0-5.el8.x86_64 2023-10-06T01:20:30.490 INFO:teuthology.orchestra.run.smithi050.stdout: lttng-ust-2.8.1-11.el8.x86_64 2023-10-06T01:20:30.490 INFO:teuthology.orchestra.run.smithi050.stdout: oniguruma-6.8.2-2.el8.x86_64 2023-10-06T01:20:30.490 INFO:teuthology.orchestra.run.smithi050.stdout: openblas-0.3.12-1.el8.x86_64 2023-10-06T01:20:30.490 INFO:teuthology.orchestra.run.smithi050.stdout: openblas-threads-0.3.12-1.el8.x86_64 2023-10-06T01:20:30.490 INFO:teuthology.orchestra.run.smithi050.stdout: openssl-devel-1:1.1.1g-15.el8_3.x86_64 2023-10-06T01:20:30.491 INFO:teuthology.orchestra.run.smithi050.stdout: pcre2-devel-10.32-2.el8.x86_64 2023-10-06T01:20:30.491 INFO:teuthology.orchestra.run.smithi050.stdout: pcre2-utf16-10.32-2.el8.x86_64 2023-10-06T01:20:30.491 INFO:teuthology.orchestra.run.smithi050.stdout: pcre2-utf32-10.32-2.el8.x86_64 2023-10-06T01:20:30.491 INFO:teuthology.orchestra.run.smithi050.stdout: python3-asyncssh-2.7.0-2.el8.noarch 2023-10-06T01:20:30.491 INFO:teuthology.orchestra.run.smithi050.stdout: python3-babel-2.5.1-5.el8.noarch 2023-10-06T01:20:30.491 INFO:teuthology.orchestra.run.smithi050.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2023-10-06T01:20:30.491 INFO:teuthology.orchestra.run.smithi050.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2023-10-06T01:20:30.491 INFO:teuthology.orchestra.run.smithi050.stdout: python3-cachetools-3.1.1-4.el8.noarch 2023-10-06T01:20:30.491 INFO:teuthology.orchestra.run.smithi050.stdout: python3-ceph-argparse-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T01:20:30.491 INFO:teuthology.orchestra.run.smithi050.stdout: python3-ceph-common-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T01:20:30.491 INFO:teuthology.orchestra.run.smithi050.stdout: python3-cephfs-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T01:20:30.491 INFO:teuthology.orchestra.run.smithi050.stdout: python3-certifi-2018.10.15-7.el8.noarch 2023-10-06T01:20:30.492 INFO:teuthology.orchestra.run.smithi050.stdout: python3-cheroot-8.5.2-1.el8.noarch 2023-10-06T01:20:30.492 INFO:teuthology.orchestra.run.smithi050.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2023-10-06T01:20:30.492 INFO:teuthology.orchestra.run.smithi050.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2023-10-06T01:20:30.492 INFO:teuthology.orchestra.run.smithi050.stdout: python3-jaraco-6.2-6.el8.noarch 2023-10-06T01:20:30.492 INFO:teuthology.orchestra.run.smithi050.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2023-10-06T01:20:30.492 INFO:teuthology.orchestra.run.smithi050.stdout: python3-jinja2-2.10.1-2.el8_0.noarch 2023-10-06T01:20:30.492 INFO:teuthology.orchestra.run.smithi050.stdout: python3-jsonpatch-1.21-2.el8.noarch 2023-10-06T01:20:30.492 INFO:teuthology.orchestra.run.smithi050.stdout: python3-jsonpointer-1.10-11.el8.noarch 2023-10-06T01:20:30.492 INFO:teuthology.orchestra.run.smithi050.stdout: python3-jwt-1.6.1-2.el8.noarch 2023-10-06T01:20:30.492 INFO:teuthology.orchestra.run.smithi050.stdout: python3-kubernetes-1:11.0.0-6.el8.noarch 2023-10-06T01:20:30.492 INFO:teuthology.orchestra.run.smithi050.stdout: python3-logutils-0.3.5-11.el8.noarch 2023-10-06T01:20:30.492 INFO:teuthology.orchestra.run.smithi050.stdout: python3-mako-1.0.6-13.el8.noarch 2023-10-06T01:20:30.492 INFO:teuthology.orchestra.run.smithi050.stdout: python3-markupsafe-0.23-19.el8.x86_64 2023-10-06T01:20:30.493 INFO:teuthology.orchestra.run.smithi050.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2023-10-06T01:20:30.493 INFO:teuthology.orchestra.run.smithi050.stdout: python3-natsort-7.1.1-2.el8.noarch 2023-10-06T01:20:30.493 INFO:teuthology.orchestra.run.smithi050.stdout: python3-numpy-1:1.14.3-9.el8.x86_64 2023-10-06T01:20:30.493 INFO:teuthology.orchestra.run.smithi050.stdout: python3-numpy-f2py-1:1.14.3-9.el8.x86_64 2023-10-06T01:20:30.493 INFO:teuthology.orchestra.run.smithi050.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2023-10-06T01:20:30.493 INFO:teuthology.orchestra.run.smithi050.stdout: python3-pecan-1.3.2-9.el8.noarch 2023-10-06T01:20:30.493 INFO:teuthology.orchestra.run.smithi050.stdout: python3-portend-2.6-1.el8.noarch 2023-10-06T01:20:30.493 INFO:teuthology.orchestra.run.smithi050.stdout: python3-prettytable-0.7.2-14.el8.noarch 2023-10-06T01:20:30.493 INFO:teuthology.orchestra.run.smithi050.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2023-10-06T01:20:30.493 INFO:teuthology.orchestra.run.smithi050.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2023-10-06T01:20:30.493 INFO:teuthology.orchestra.run.smithi050.stdout: python3-pytz-2017.2-9.el8.noarch 2023-10-06T01:20:30.493 INFO:teuthology.orchestra.run.smithi050.stdout: python3-rados-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T01:20:30.493 INFO:teuthology.orchestra.run.smithi050.stdout: python3-rbd-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T01:20:30.494 INFO:teuthology.orchestra.run.smithi050.stdout: python3-repoze-lru-0.7-6.el8.noarch 2023-10-06T01:20:30.494 INFO:teuthology.orchestra.run.smithi050.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2023-10-06T01:20:30.494 INFO:teuthology.orchestra.run.smithi050.stdout: python3-rgw-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T01:20:30.494 INFO:teuthology.orchestra.run.smithi050.stdout: python3-routes-2.4.1-12.el8.noarch 2023-10-06T01:20:30.494 INFO:teuthology.orchestra.run.smithi050.stdout: python3-rsa-4.9-2.el8.noarch 2023-10-06T01:20:30.494 INFO:teuthology.orchestra.run.smithi050.stdout: python3-scipy-1.0.0-20.module+el8.1.0+3334+5cb623d7.x86_64 2023-10-06T01:20:30.494 INFO:teuthology.orchestra.run.smithi050.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2023-10-06T01:20:30.494 INFO:teuthology.orchestra.run.smithi050.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2023-10-06T01:20:30.494 INFO:teuthology.orchestra.run.smithi050.stdout: python3-tempora-1.14.1-5.el8.noarch 2023-10-06T01:20:30.494 INFO:teuthology.orchestra.run.smithi050.stdout: python3-trustme-0.6.0-4.el8.noarch 2023-10-06T01:20:30.494 INFO:teuthology.orchestra.run.smithi050.stdout: python3-waitress-1.4.3-1.el8.noarch 2023-10-06T01:20:30.495 INFO:teuthology.orchestra.run.smithi050.stdout: python3-webob-1.8.5-1.el8.1.noarch 2023-10-06T01:20:30.495 INFO:teuthology.orchestra.run.smithi050.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2023-10-06T01:20:30.495 INFO:teuthology.orchestra.run.smithi050.stdout: python3-webtest-2.0.33-1.el8.noarch 2023-10-06T01:20:30.495 INFO:teuthology.orchestra.run.smithi050.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2023-10-06T01:20:30.495 INFO:teuthology.orchestra.run.smithi050.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2023-10-06T01:20:30.495 INFO:teuthology.orchestra.run.smithi050.stdout: rbd-fuse-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T01:20:30.495 INFO:teuthology.orchestra.run.smithi050.stdout: rbd-mirror-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T01:20:30.495 INFO:teuthology.orchestra.run.smithi050.stdout: rbd-nbd-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T01:20:30.495 INFO:teuthology.orchestra.run.smithi050.stdout: socat-1.7.3.3-2.el8.x86_64 2023-10-06T01:20:30.495 INFO:teuthology.orchestra.run.smithi050.stdout: thrift-0.13.0-2.el8.x86_64 2023-10-06T01:20:30.495 INFO:teuthology.orchestra.run.smithi050.stdout: xfsprogs-devel-5.0.0-8.el8.x86_64 2023-10-06T01:20:30.495 INFO:teuthology.orchestra.run.smithi050.stdout: xmlstarlet-1.6.1-20.el8.x86_64 2023-10-06T01:20:30.496 INFO:teuthology.orchestra.run.smithi050.stdout: zlib-devel-1.2.11-17.el8.x86_64 2023-10-06T01:20:30.496 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-10-06T01:20:30.496 INFO:teuthology.orchestra.run.smithi050.stdout:Complete! 2023-10-06T01:20:30.800 DEBUG:teuthology.parallel:result is None 2023-10-06T01:20:30.801 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=736ac5ba72cb47af7d6f6666b1e100f7e20a20e2 2023-10-06T01:20:31.071 DEBUG:teuthology.orchestra.run.smithi050:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2023-10-06T01:20:31.124 INFO:teuthology.orchestra.run.smithi050.stdout:17.2.6-1296.g736ac5ba.el8 2023-10-06T01:20:31.124 INFO:teuthology.packaging:The installed version of ceph is 17.2.6-1296.g736ac5ba.el8 2023-10-06T01:20:31.124 INFO:teuthology.task.install:The correct ceph version 17.2.6-1296.g736ac5ba is installed. 2023-10-06T01:20:31.125 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=736ac5ba72cb47af7d6f6666b1e100f7e20a20e2 2023-10-06T01:20:31.267 DEBUG:teuthology.orchestra.run.smithi155:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2023-10-06T01:20:31.316 INFO:teuthology.orchestra.run.smithi155.stdout:17.2.6-1296.g736ac5ba.el8 2023-10-06T01:20:31.316 INFO:teuthology.packaging:The installed version of ceph is 17.2.6-1296.g736ac5ba.el8 2023-10-06T01:20:31.316 INFO:teuthology.task.install:The correct ceph version 17.2.6-1296.g736ac5ba is installed. 2023-10-06T01:20:31.316 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2023-10-06T01:20:31.316 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2023-10-06T01:20:31.317 DEBUG:teuthology.orchestra.run.smithi050:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-10-06T01:20:31.401 DEBUG:teuthology.orchestra.run.smithi155:> set -ex 2023-10-06T01:20:31.402 DEBUG:teuthology.orchestra.run.smithi155:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-10-06T01:20:31.483 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2023-10-06T01:20:31.484 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2023-10-06T01:20:31.484 DEBUG:teuthology.orchestra.run.smithi050:> sudo dd of=/usr/bin/daemon-helper 2023-10-06T01:20:31.547 DEBUG:teuthology.orchestra.run.smithi050:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-10-06T01:20:31.650 DEBUG:teuthology.orchestra.run.smithi155:> set -ex 2023-10-06T01:20:31.650 DEBUG:teuthology.orchestra.run.smithi155:> sudo dd of=/usr/bin/daemon-helper 2023-10-06T01:20:31.713 DEBUG:teuthology.orchestra.run.smithi155:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-10-06T01:20:31.815 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2023-10-06T01:20:31.815 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2023-10-06T01:20:31.815 DEBUG:teuthology.orchestra.run.smithi050:> sudo dd of=/usr/bin/adjust-ulimits 2023-10-06T01:20:31.878 DEBUG:teuthology.orchestra.run.smithi050:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-10-06T01:20:31.986 DEBUG:teuthology.orchestra.run.smithi155:> set -ex 2023-10-06T01:20:31.987 DEBUG:teuthology.orchestra.run.smithi155:> sudo dd of=/usr/bin/adjust-ulimits 2023-10-06T01:20:32.047 DEBUG:teuthology.orchestra.run.smithi155:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-10-06T01:20:32.149 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2023-10-06T01:20:32.150 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2023-10-06T01:20:32.150 DEBUG:teuthology.orchestra.run.smithi050:> sudo dd of=/usr/bin/stdin-killer 2023-10-06T01:20:32.217 DEBUG:teuthology.orchestra.run.smithi050:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-10-06T01:20:32.322 DEBUG:teuthology.orchestra.run.smithi155:> set -ex 2023-10-06T01:20:32.322 DEBUG:teuthology.orchestra.run.smithi155:> sudo dd of=/usr/bin/stdin-killer 2023-10-06T01:20:32.382 DEBUG:teuthology.orchestra.run.smithi155:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-10-06T01:20:32.484 INFO:teuthology.run_tasks:Running task ceph... 2023-10-06T01:20:32.556 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2023-10-06T01:20:32.556 DEBUG:teuthology.orchestra.run.smithi050:> sudo chmod 777 /var/log/ceph 2023-10-06T01:20:32.561 DEBUG:teuthology.orchestra.run.smithi155:> sudo chmod 777 /var/log/ceph 2023-10-06T01:20:32.622 INFO:tasks.ceph:Disabling ceph logrotate... 2023-10-06T01:20:32.622 DEBUG:teuthology.orchestra.run.smithi050:> sudo rm -f -- /etc/logrotate.d/ceph 2023-10-06T01:20:32.627 DEBUG:teuthology.orchestra.run.smithi155:> sudo rm -f -- /etc/logrotate.d/ceph 2023-10-06T01:20:33.002 INFO:tasks.ceph:Creating extra log directories... 2023-10-06T01:20:33.002 DEBUG:teuthology.orchestra.run.smithi050:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-10-06T01:20:33.008 DEBUG:teuthology.orchestra.run.smithi155:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-10-06T01:20:33.083 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2023-10-06T01:20:33.084 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2023-10-06T01:20:33.084 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2023-10-06T01:20:33.084 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2023-10-06T01:20:33.084 DEBUG:teuthology.orchestra.run.smithi050:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2023-10-06T01:20:33.121 DEBUG:teuthology.orchestra.run.smithi050:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2023-10-06T01:20:33.330 DEBUG:teuthology.orchestra.run.smithi050:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2023-10-06T01:20:33.394 DEBUG:teuthology.orchestra.run.smithi155:> set -ex 2023-10-06T01:20:33.394 DEBUG:teuthology.orchestra.run.smithi155:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2023-10-06T01:20:33.433 DEBUG:teuthology.orchestra.run.smithi155:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2023-10-06T01:20:33.668 DEBUG:teuthology.orchestra.run.smithi155:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2023-10-06T01:20:33.735 INFO:tasks.ceph:Creating ceph cluster ceph... 2023-10-06T01:20:33.735 INFO:tasks.ceph:config {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2023-10-06T01:20:33.735 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/yuriw-2023-10-05_23:52:50-fs-wip-yuri-testing-2023-10-05-0730-quincy-distro-default-smithi/7412076', 'branch': 'wip-yuri-testing-2023-10-05-0730-quincy', 'description': 'fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/acls}', 'email': 'yweinste@redhat.com', 'first_in_suite': False, 'job_id': '7412076', 'kernel': {'client': {'branch': 'testing'}, 'kdb': True, 'sha1': 'distro'}, 'ktype': 'upstream', 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'name': 'yuriw-2023-10-05_23:52:50-fs-wip-yuri-testing-2023-10-05-0730-quincy-distro-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 4, 'size': 20}}, {'machine': {'disk': 200}}], 'os_type': 'rhel', 'os_version': '8.4', 'overrides': {'admin_socket': {'branch': 'wip-yuri-testing-2023-10-05-0730-quincy'}, 'ceph': {'cephfs': {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd']}, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding'], 'sha1': '736ac5ba72cb47af7d6f6666b1e100f7e20a20e2'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': '736ac5ba72cb47af7d6f6666b1e100f7e20a20e2'}}, 'kclient': {'syntax': 'v1'}, 'selinux': {'whitelist': ['scontext=system_u:system_r:logrotate_t:s0']}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-yuri-testing-2023-10-05-0730-quincy', 'sha1': 'f1e315a9732d36c05ec316678e2397dc58561c7f'}}, 'owner': 'scheduled_yuriw@teuthology', 'priority': 75, 'repo': 'https://github.com/ceph/ceph-ci.git', 'roles': [['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'], ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3']], 'seed': 7519, 'sha1': '736ac5ba72cb47af7d6f6666b1e100f7e20a20e2', 'sleep_before_teardown': 0, 'subset': '111/12000', 'suite': 'fs', 'suite_branch': 'wip-yuri-testing-2023-10-05-0730-quincy', 'suite_path': '/home/teuthworker/src/github.com_ceph_ceph-c_f1e315a9732d36c05ec316678e2397dc58561c7f/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://github.com/ceph/ceph-ci.git', 'suite_sha1': 'f1e315a9732d36c05ec316678e2397dc58561c7f', 'targets': {'smithi050.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBKNGwEbc6nlhWoKK2q/JhlTxbDL2wf4lDilA3fqVkNmcpM06tHVG2H4l8DQtDEChZDi+48ybGg1N08TuW8IhDMU=', 'smithi155.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBBYL47B2Oj0XSQy1usBWrapTgdPTyjkqN9X8T4+wAERbtbSyf0pYd/LV/R2exAsVzKanHGm0Q73YeL8X62HIFE0='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'client': {'branch': 'testing'}, 'kdb': True, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel']}, 'flavor': 'default', 'sha1': '736ac5ba72cb47af7d6f6666b1e100f7e20a20e2'}}, {'ceph': None}, {'kclient': None}, {'cephfs_test_runner': {'fail_on_skip': False, 'modules': ['tasks.cephfs.test_acls']}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': ["local function is_kupstream() return yaml.ktype == 'upstream' end", "local function is_kdistro() return yaml.ktype == 'distro' end", 'local function is_fuse() return false end', 'local function syntax_version() return yaml.overrides.kclient.syntax end']}, 'teuthology_branch': 'main', 'teuthology_sha1': '54e62bcbac4e53d9685e08328b790d3b20d71cae', 'timestamp': '2023-10-05_23:52:50', 'tube': 'smithi', 'user': 'yuriw', 'verbose': True, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.2830'} 2023-10-06T01:20:33.736 DEBUG:teuthology.orchestra.run.smithi050:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-10-06T01:20:33.740 DEBUG:teuthology.orchestra.run.smithi155:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-10-06T01:20:33.776 DEBUG:teuthology.orchestra.run.smithi050:> sudo install -d -m0777 -- /var/run/ceph 2023-10-06T01:20:33.817 DEBUG:teuthology.orchestra.run.smithi155:> sudo install -d -m0777 -- /var/run/ceph 2023-10-06T01:20:33.879 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2023-10-06T01:20:33.879 DEBUG:teuthology.orchestra.run.smithi050:> dd if=/scratch_devs of=/dev/stdout 2023-10-06T01:20:33.916 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-10-06T01:20:33.916 DEBUG:teuthology.orchestra.run.smithi050:> stat /dev/vg_nvme/lv_1 2023-10-06T01:20:33.994 INFO:teuthology.orchestra.run.smithi050.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-10-06T01:20:33.994 INFO:teuthology.orchestra.run.smithi050.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-06T01:20:33.995 INFO:teuthology.orchestra.run.smithi050.stdout:Device: 5h/5d Inode: 452 Links: 1 2023-10-06T01:20:33.995 INFO:teuthology.orchestra.run.smithi050.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-06T01:20:33.995 INFO:teuthology.orchestra.run.smithi050.stdout:Context: system_u:object_r:device_t:s0 2023-10-06T01:20:33.995 INFO:teuthology.orchestra.run.smithi050.stdout:Access: 2023-10-06 01:20:25.271234126 +0000 2023-10-06T01:20:33.995 INFO:teuthology.orchestra.run.smithi050.stdout:Modify: 2023-10-06 01:17:35.957261353 +0000 2023-10-06T01:20:33.995 INFO:teuthology.orchestra.run.smithi050.stdout:Change: 2023-10-06 01:17:35.957261353 +0000 2023-10-06T01:20:33.995 INFO:teuthology.orchestra.run.smithi050.stdout: Birth: - 2023-10-06T01:20:33.995 DEBUG:teuthology.orchestra.run.smithi050:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-10-06T01:20:34.096 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2023-10-06T01:20:34.096 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2023-10-06T01:20:34.096 INFO:teuthology.orchestra.run.smithi050.stderr:512 bytes copied, 0.000245686 s, 2.1 MB/s 2023-10-06T01:20:34.099 DEBUG:teuthology.orchestra.run.smithi050:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-10-06T01:20:34.140 DEBUG:teuthology.orchestra.run.smithi050:> stat /dev/vg_nvme/lv_2 2023-10-06T01:20:34.217 INFO:teuthology.orchestra.run.smithi050.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-10-06T01:20:34.217 INFO:teuthology.orchestra.run.smithi050.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-06T01:20:34.217 INFO:teuthology.orchestra.run.smithi050.stdout:Device: 5h/5d Inode: 458 Links: 1 2023-10-06T01:20:34.217 INFO:teuthology.orchestra.run.smithi050.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-06T01:20:34.217 INFO:teuthology.orchestra.run.smithi050.stdout:Context: system_u:object_r:device_t:s0 2023-10-06T01:20:34.218 INFO:teuthology.orchestra.run.smithi050.stdout:Access: 2023-10-06 01:20:25.271234126 +0000 2023-10-06T01:20:34.218 INFO:teuthology.orchestra.run.smithi050.stdout:Modify: 2023-10-06 01:17:36.731242697 +0000 2023-10-06T01:20:34.218 INFO:teuthology.orchestra.run.smithi050.stdout:Change: 2023-10-06 01:17:36.731242697 +0000 2023-10-06T01:20:34.218 INFO:teuthology.orchestra.run.smithi050.stdout: Birth: - 2023-10-06T01:20:34.218 DEBUG:teuthology.orchestra.run.smithi050:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-10-06T01:20:34.318 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2023-10-06T01:20:34.318 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2023-10-06T01:20:34.318 INFO:teuthology.orchestra.run.smithi050.stderr:512 bytes copied, 0.000189928 s, 2.7 MB/s 2023-10-06T01:20:34.321 DEBUG:teuthology.orchestra.run.smithi050:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-10-06T01:20:34.359 DEBUG:teuthology.orchestra.run.smithi050:> stat /dev/vg_nvme/lv_3 2023-10-06T01:20:34.437 INFO:teuthology.orchestra.run.smithi050.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-10-06T01:20:34.438 INFO:teuthology.orchestra.run.smithi050.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-06T01:20:34.438 INFO:teuthology.orchestra.run.smithi050.stdout:Device: 5h/5d Inode: 464 Links: 1 2023-10-06T01:20:34.438 INFO:teuthology.orchestra.run.smithi050.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-06T01:20:34.438 INFO:teuthology.orchestra.run.smithi050.stdout:Context: system_u:object_r:device_t:s0 2023-10-06T01:20:34.438 INFO:teuthology.orchestra.run.smithi050.stdout:Access: 2023-10-06 01:20:25.272234102 +0000 2023-10-06T01:20:34.438 INFO:teuthology.orchestra.run.smithi050.stdout:Modify: 2023-10-06 01:17:37.499224185 +0000 2023-10-06T01:20:34.438 INFO:teuthology.orchestra.run.smithi050.stdout:Change: 2023-10-06 01:17:37.499224185 +0000 2023-10-06T01:20:34.438 INFO:teuthology.orchestra.run.smithi050.stdout: Birth: - 2023-10-06T01:20:34.439 DEBUG:teuthology.orchestra.run.smithi050:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-10-06T01:20:34.539 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2023-10-06T01:20:34.539 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2023-10-06T01:20:34.540 INFO:teuthology.orchestra.run.smithi050.stderr:512 bytes copied, 0.000189511 s, 2.7 MB/s 2023-10-06T01:20:34.542 DEBUG:teuthology.orchestra.run.smithi050:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-10-06T01:20:34.582 DEBUG:teuthology.orchestra.run.smithi050:> stat /dev/vg_nvme/lv_4 2023-10-06T01:20:34.661 INFO:teuthology.orchestra.run.smithi050.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-10-06T01:20:34.661 INFO:teuthology.orchestra.run.smithi050.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-06T01:20:34.662 INFO:teuthology.orchestra.run.smithi050.stdout:Device: 5h/5d Inode: 470 Links: 1 2023-10-06T01:20:34.662 INFO:teuthology.orchestra.run.smithi050.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-06T01:20:34.662 INFO:teuthology.orchestra.run.smithi050.stdout:Context: system_u:object_r:device_t:s0 2023-10-06T01:20:34.662 INFO:teuthology.orchestra.run.smithi050.stdout:Access: 2023-10-06 01:20:25.272234102 +0000 2023-10-06T01:20:34.662 INFO:teuthology.orchestra.run.smithi050.stdout:Modify: 2023-10-06 01:17:38.292205071 +0000 2023-10-06T01:20:34.662 INFO:teuthology.orchestra.run.smithi050.stdout:Change: 2023-10-06 01:17:38.292205071 +0000 2023-10-06T01:20:34.662 INFO:teuthology.orchestra.run.smithi050.stdout: Birth: - 2023-10-06T01:20:34.662 DEBUG:teuthology.orchestra.run.smithi050:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-10-06T01:20:34.762 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2023-10-06T01:20:34.762 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2023-10-06T01:20:34.762 INFO:teuthology.orchestra.run.smithi050.stderr:512 bytes copied, 0.000173846 s, 2.9 MB/s 2023-10-06T01:20:34.764 DEBUG:teuthology.orchestra.run.smithi050:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-10-06T01:20:34.803 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-10-06T01:20:34.803 DEBUG:teuthology.orchestra.run.smithi155:> set -ex 2023-10-06T01:20:34.803 DEBUG:teuthology.orchestra.run.smithi155:> dd if=/scratch_devs of=/dev/stdout 2023-10-06T01:20:34.843 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-10-06T01:20:34.843 DEBUG:teuthology.orchestra.run.smithi155:> stat /dev/vg_nvme/lv_1 2023-10-06T01:20:34.922 INFO:teuthology.orchestra.run.smithi155.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-10-06T01:20:34.922 INFO:teuthology.orchestra.run.smithi155.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-06T01:20:34.923 INFO:teuthology.orchestra.run.smithi155.stdout:Device: 5h/5d Inode: 452 Links: 1 2023-10-06T01:20:34.923 INFO:teuthology.orchestra.run.smithi155.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-06T01:20:34.923 INFO:teuthology.orchestra.run.smithi155.stdout:Context: system_u:object_r:device_t:s0 2023-10-06T01:20:34.923 INFO:teuthology.orchestra.run.smithi155.stdout:Access: 2023-10-06 01:20:23.751480137 +0000 2023-10-06T01:20:34.923 INFO:teuthology.orchestra.run.smithi155.stdout:Modify: 2023-10-06 01:17:19.811405792 +0000 2023-10-06T01:20:34.923 INFO:teuthology.orchestra.run.smithi155.stdout:Change: 2023-10-06 01:17:19.811405792 +0000 2023-10-06T01:20:34.923 INFO:teuthology.orchestra.run.smithi155.stdout: Birth: - 2023-10-06T01:20:34.923 DEBUG:teuthology.orchestra.run.smithi155:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-10-06T01:20:35.023 INFO:teuthology.orchestra.run.smithi155.stderr:1+0 records in 2023-10-06T01:20:35.023 INFO:teuthology.orchestra.run.smithi155.stderr:1+0 records out 2023-10-06T01:20:35.023 INFO:teuthology.orchestra.run.smithi155.stderr:512 bytes copied, 0.000372791 s, 1.4 MB/s 2023-10-06T01:20:35.026 DEBUG:teuthology.orchestra.run.smithi155:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-10-06T01:20:35.064 DEBUG:teuthology.orchestra.run.smithi155:> stat /dev/vg_nvme/lv_2 2023-10-06T01:20:35.142 INFO:teuthology.orchestra.run.smithi155.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-10-06T01:20:35.143 INFO:teuthology.orchestra.run.smithi155.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-06T01:20:35.143 INFO:teuthology.orchestra.run.smithi155.stdout:Device: 5h/5d Inode: 458 Links: 1 2023-10-06T01:20:35.143 INFO:teuthology.orchestra.run.smithi155.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-06T01:20:35.143 INFO:teuthology.orchestra.run.smithi155.stdout:Context: system_u:object_r:device_t:s0 2023-10-06T01:20:35.143 INFO:teuthology.orchestra.run.smithi155.stdout:Access: 2023-10-06 01:20:23.752480118 +0000 2023-10-06T01:20:35.144 INFO:teuthology.orchestra.run.smithi155.stdout:Modify: 2023-10-06 01:17:20.593390628 +0000 2023-10-06T01:20:35.144 INFO:teuthology.orchestra.run.smithi155.stdout:Change: 2023-10-06 01:17:20.593390628 +0000 2023-10-06T01:20:35.144 INFO:teuthology.orchestra.run.smithi155.stdout: Birth: - 2023-10-06T01:20:35.144 DEBUG:teuthology.orchestra.run.smithi155:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-10-06T01:20:35.241 INFO:teuthology.orchestra.run.smithi155.stderr:1+0 records in 2023-10-06T01:20:35.241 INFO:teuthology.orchestra.run.smithi155.stderr:1+0 records out 2023-10-06T01:20:35.241 INFO:teuthology.orchestra.run.smithi155.stderr:512 bytes copied, 0.000307544 s, 1.7 MB/s 2023-10-06T01:20:35.243 DEBUG:teuthology.orchestra.run.smithi155:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-10-06T01:20:35.281 DEBUG:teuthology.orchestra.run.smithi155:> stat /dev/vg_nvme/lv_3 2023-10-06T01:20:35.358 INFO:teuthology.orchestra.run.smithi155.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-10-06T01:20:35.358 INFO:teuthology.orchestra.run.smithi155.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-06T01:20:35.358 INFO:teuthology.orchestra.run.smithi155.stdout:Device: 5h/5d Inode: 464 Links: 1 2023-10-06T01:20:35.358 INFO:teuthology.orchestra.run.smithi155.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-06T01:20:35.358 INFO:teuthology.orchestra.run.smithi155.stdout:Context: system_u:object_r:device_t:s0 2023-10-06T01:20:35.359 INFO:teuthology.orchestra.run.smithi155.stdout:Access: 2023-10-06 01:20:23.752480118 +0000 2023-10-06T01:20:35.359 INFO:teuthology.orchestra.run.smithi155.stdout:Modify: 2023-10-06 01:17:21.370375563 +0000 2023-10-06T01:20:35.359 INFO:teuthology.orchestra.run.smithi155.stdout:Change: 2023-10-06 01:17:21.370375563 +0000 2023-10-06T01:20:35.359 INFO:teuthology.orchestra.run.smithi155.stdout: Birth: - 2023-10-06T01:20:35.359 DEBUG:teuthology.orchestra.run.smithi155:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-10-06T01:20:35.456 INFO:teuthology.orchestra.run.smithi155.stderr:1+0 records in 2023-10-06T01:20:35.456 INFO:teuthology.orchestra.run.smithi155.stderr:1+0 records out 2023-10-06T01:20:35.456 INFO:teuthology.orchestra.run.smithi155.stderr:512 bytes copied, 0.000301656 s, 1.7 MB/s 2023-10-06T01:20:35.458 DEBUG:teuthology.orchestra.run.smithi155:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-10-06T01:20:35.496 DEBUG:teuthology.orchestra.run.smithi155:> stat /dev/vg_nvme/lv_4 2023-10-06T01:20:35.575 INFO:teuthology.orchestra.run.smithi155.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-10-06T01:20:35.575 INFO:teuthology.orchestra.run.smithi155.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-06T01:20:35.575 INFO:teuthology.orchestra.run.smithi155.stdout:Device: 5h/5d Inode: 470 Links: 1 2023-10-06T01:20:35.576 INFO:teuthology.orchestra.run.smithi155.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-06T01:20:35.576 INFO:teuthology.orchestra.run.smithi155.stdout:Context: system_u:object_r:device_t:s0 2023-10-06T01:20:35.576 INFO:teuthology.orchestra.run.smithi155.stdout:Access: 2023-10-06 01:20:23.752480118 +0000 2023-10-06T01:20:35.576 INFO:teuthology.orchestra.run.smithi155.stdout:Modify: 2023-10-06 01:17:22.163360186 +0000 2023-10-06T01:20:35.576 INFO:teuthology.orchestra.run.smithi155.stdout:Change: 2023-10-06 01:17:22.163360186 +0000 2023-10-06T01:20:35.576 INFO:teuthology.orchestra.run.smithi155.stdout: Birth: - 2023-10-06T01:20:35.577 DEBUG:teuthology.orchestra.run.smithi155:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-10-06T01:20:35.674 INFO:teuthology.orchestra.run.smithi155.stderr:1+0 records in 2023-10-06T01:20:35.674 INFO:teuthology.orchestra.run.smithi155.stderr:1+0 records out 2023-10-06T01:20:35.674 INFO:teuthology.orchestra.run.smithi155.stderr:512 bytes copied, 0.000305163 s, 1.7 MB/s 2023-10-06T01:20:35.676 DEBUG:teuthology.orchestra.run.smithi155:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-10-06T01:20:35.714 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-10-06T01:20:35.714 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi050.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi155.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2023-10-06T01:20:35.714 INFO:tasks.ceph:Generating config... 2023-10-06T01:20:35.715 INFO:tasks.ceph:[client] client mount timeout = 600 2023-10-06T01:20:35.716 INFO:tasks.ceph:[client] debug client = 20 2023-10-06T01:20:35.716 INFO:tasks.ceph:[client] debug ms = 1 2023-10-06T01:20:35.716 INFO:tasks.ceph:[client] pid file = 2023-10-06T01:20:35.716 INFO:tasks.ceph:[client] rados mon op timeout = 900 2023-10-06T01:20:35.716 INFO:tasks.ceph:[client] rados osd op timeout = 900 2023-10-06T01:20:35.716 INFO:tasks.ceph:[global] ms die on skipped message = False 2023-10-06T01:20:35.716 INFO:tasks.ceph:[mds] debug mds = 20 2023-10-06T01:20:35.716 INFO:tasks.ceph:[mds] debug ms = 1 2023-10-06T01:20:35.716 INFO:tasks.ceph:[mds] mds debug frag = True 2023-10-06T01:20:35.716 INFO:tasks.ceph:[mds] mds debug scatterstat = True 2023-10-06T01:20:35.716 INFO:tasks.ceph:[mds] mds op complaint time = 180 2023-10-06T01:20:35.717 INFO:tasks.ceph:[mds] mds verify scatter = True 2023-10-06T01:20:35.717 INFO:tasks.ceph:[mds] osd op complaint time = 180 2023-10-06T01:20:35.717 INFO:tasks.ceph:[mds] rados mon op timeout = 900 2023-10-06T01:20:35.717 INFO:tasks.ceph:[mds] rados osd op timeout = 900 2023-10-06T01:20:35.717 INFO:tasks.ceph:[mgr] debug mgr = 20 2023-10-06T01:20:35.717 INFO:tasks.ceph:[mgr] debug ms = 1 2023-10-06T01:20:35.717 INFO:tasks.ceph:[mon] debug mon = 20 2023-10-06T01:20:35.717 INFO:tasks.ceph:[mon] debug ms = 1 2023-10-06T01:20:35.717 INFO:tasks.ceph:[mon] debug paxos = 20 2023-10-06T01:20:35.717 INFO:tasks.ceph:[mon] mon op complaint time = 120 2023-10-06T01:20:35.717 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2023-10-06T01:20:35.717 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2023-10-06T01:20:35.717 INFO:tasks.ceph:[osd] debug bluefs = 20 2023-10-06T01:20:35.718 INFO:tasks.ceph:[osd] debug bluestore = 20 2023-10-06T01:20:35.718 INFO:tasks.ceph:[osd] debug ms = 1 2023-10-06T01:20:35.718 INFO:tasks.ceph:[osd] debug osd = 20 2023-10-06T01:20:35.718 INFO:tasks.ceph:[osd] debug rocksdb = 10 2023-10-06T01:20:35.718 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2023-10-06T01:20:35.718 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2023-10-06T01:20:35.718 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2023-10-06T01:20:35.718 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2023-10-06T01:20:35.718 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2023-10-06T01:20:35.718 INFO:tasks.ceph:[osd] osd op complaint time = 180 2023-10-06T01:20:35.718 INFO:tasks.ceph:Setting up mon.a... 2023-10-06T01:20:35.719 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2023-10-06T01:20:35.817 INFO:teuthology.orchestra.run.smithi050.stdout:creating /etc/ceph/ceph.keyring 2023-10-06T01:20:35.822 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2023-10-06T01:20:35.912 DEBUG:teuthology.orchestra.run.smithi050:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-10-06T01:20:35.975 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.50'), ('mon.b', '172.21.15.155'), ('mon.c', '[v2:172.21.15.155:3301,v1:172.21.15.155:6790]')] 2023-10-06T01:20:35.975 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.50,172.21.15.155,[v2:172.21.15.155:3301,v1:172.21.15.155:6790]', 'ms die on skipped message': False}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon op complaint time': 120}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds.c': {}, 'mds.b': {}, 'mds.d': {}, 'mds': {'debug mds': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}} 2023-10-06T01:20:35.976 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2023-10-06T01:20:35.976 DEBUG:teuthology.orchestra.run.smithi050:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2023-10-06T01:20:36.013 DEBUG:teuthology.orchestra.run.smithi050:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.50 --add b 172.21.15.155 --addv c '[v2:172.21.15.155:3301,v1:172.21.15.155:6790]' --print /home/ubuntu/cephtest/ceph.monmap 2023-10-06T01:20:36.129 INFO:teuthology.orchestra.run.smithi050.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2023-10-06T01:20:36.129 INFO:teuthology.orchestra.run.smithi050.stdout:monmaptool: generated fsid 0bfd9a6b-1587-4fe4-a89e-e43c00286b4e 2023-10-06T01:20:36.130 INFO:teuthology.orchestra.run.smithi050.stdout:setting min_mon_release = octopus 2023-10-06T01:20:36.130 INFO:teuthology.orchestra.run.smithi050.stdout:epoch 0 2023-10-06T01:20:36.130 INFO:teuthology.orchestra.run.smithi050.stdout:fsid 0bfd9a6b-1587-4fe4-a89e-e43c00286b4e 2023-10-06T01:20:36.130 INFO:teuthology.orchestra.run.smithi050.stdout:last_changed 2023-10-06T01:20:36.129635+0000 2023-10-06T01:20:36.130 INFO:teuthology.orchestra.run.smithi050.stdout:created 2023-10-06T01:20:36.129635+0000 2023-10-06T01:20:36.130 INFO:teuthology.orchestra.run.smithi050.stdout:min_mon_release 15 (octopus) 2023-10-06T01:20:36.130 INFO:teuthology.orchestra.run.smithi050.stdout:election_strategy: 1 2023-10-06T01:20:36.130 INFO:teuthology.orchestra.run.smithi050.stdout:0: [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] mon.a 2023-10-06T01:20:36.130 INFO:teuthology.orchestra.run.smithi050.stdout:1: [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] mon.b 2023-10-06T01:20:36.131 INFO:teuthology.orchestra.run.smithi050.stdout:2: [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] mon.c 2023-10-06T01:20:36.131 INFO:teuthology.orchestra.run.smithi050.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2023-10-06T01:20:36.132 DEBUG:teuthology.orchestra.run.smithi050:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2023-10-06T01:20:36.167 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 0bfd9a6b-1587-4fe4-a89e-e43c00286b4e... 2023-10-06T01:20:36.168 DEBUG:teuthology.orchestra.run.smithi050:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-10-06T01:20:36.212 DEBUG:teuthology.orchestra.run.smithi155:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-10-06T01:20:36.324 INFO:teuthology.orchestra.run.smithi155.stdout:[global] 2023-10-06T01:20:36.324 INFO:teuthology.orchestra.run.smithi155.stdout: chdir = "" 2023-10-06T01:20:36.324 INFO:teuthology.orchestra.run.smithi155.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-10-06T01:20:36.324 INFO:teuthology.orchestra.run.smithi155.stdout: auth supported = cephx 2023-10-06T01:20:36.324 INFO:teuthology.orchestra.run.smithi155.stdout: 2023-10-06T01:20:36.324 INFO:teuthology.orchestra.run.smithi155.stdout: filestore xattr use omap = true 2023-10-06T01:20:36.324 INFO:teuthology.orchestra.run.smithi155.stdout: 2023-10-06T01:20:36.324 INFO:teuthology.orchestra.run.smithi155.stdout: mon clock drift allowed = 1.000 2023-10-06T01:20:36.324 INFO:teuthology.orchestra.run.smithi155.stdout: 2023-10-06T01:20:36.325 INFO:teuthology.orchestra.run.smithi155.stdout: osd crush chooseleaf type = 0 2023-10-06T01:20:36.325 INFO:teuthology.orchestra.run.smithi155.stdout: auth debug = true 2023-10-06T01:20:36.325 INFO:teuthology.orchestra.run.smithi155.stdout: 2023-10-06T01:20:36.325 INFO:teuthology.orchestra.run.smithi155.stdout: ms die on old message = true 2023-10-06T01:20:36.325 INFO:teuthology.orchestra.run.smithi155.stdout: ms die on bug = true 2023-10-06T01:20:36.325 INFO:teuthology.orchestra.run.smithi155.stdout: 2023-10-06T01:20:36.325 INFO:teuthology.orchestra.run.smithi155.stdout: mon max pg per osd = 10000 # >= luminous 2023-10-06T01:20:36.325 INFO:teuthology.orchestra.run.smithi155.stdout: mon pg warn max object skew = 0 2023-10-06T01:20:36.325 INFO:teuthology.orchestra.run.smithi155.stdout: 2023-10-06T01:20:36.325 INFO:teuthology.orchestra.run.smithi155.stdout: # disable pg_autoscaler by default for new pools 2023-10-06T01:20:36.325 INFO:teuthology.orchestra.run.smithi155.stdout: osd_pool_default_pg_autoscale_mode = off 2023-10-06T01:20:36.325 INFO:teuthology.orchestra.run.smithi155.stdout: 2023-10-06T01:20:36.326 INFO:teuthology.orchestra.run.smithi155.stdout: osd pool default size = 2 2023-10-06T01:20:36.326 INFO:teuthology.orchestra.run.smithi155.stdout: 2023-10-06T01:20:36.326 INFO:teuthology.orchestra.run.smithi155.stdout: mon osd allow primary affinity = true 2023-10-06T01:20:36.326 INFO:teuthology.orchestra.run.smithi155.stdout: mon osd allow pg remap = true 2023-10-06T01:20:36.326 INFO:teuthology.orchestra.run.smithi155.stdout: mon warn on legacy crush tunables = false 2023-10-06T01:20:36.326 INFO:teuthology.orchestra.run.smithi155.stdout: mon warn on crush straw calc version zero = false 2023-10-06T01:20:36.326 INFO:teuthology.orchestra.run.smithi155.stdout: mon warn on no sortbitwise = false 2023-10-06T01:20:36.326 INFO:teuthology.orchestra.run.smithi155.stdout: mon warn on osd down out interval zero = false 2023-10-06T01:20:36.326 INFO:teuthology.orchestra.run.smithi155.stdout: mon warn on too few osds = false 2023-10-06T01:20:36.326 INFO:teuthology.orchestra.run.smithi155.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-10-06T01:20:36.326 INFO:teuthology.orchestra.run.smithi155.stdout: mon_warn_on_pool_no_redundancy = false 2023-10-06T01:20:36.326 INFO:teuthology.orchestra.run.smithi155.stdout: mon_allow_pool_size_one = true 2023-10-06T01:20:36.327 INFO:teuthology.orchestra.run.smithi155.stdout: 2023-10-06T01:20:36.327 INFO:teuthology.orchestra.run.smithi155.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-10-06T01:20:36.327 INFO:teuthology.orchestra.run.smithi155.stdout: 2023-10-06T01:20:36.327 INFO:teuthology.orchestra.run.smithi155.stdout: osd default data pool replay window = 5 2023-10-06T01:20:36.327 INFO:teuthology.orchestra.run.smithi155.stdout: 2023-10-06T01:20:36.327 INFO:teuthology.orchestra.run.smithi155.stdout: mon allow pool delete = true 2023-10-06T01:20:36.327 INFO:teuthology.orchestra.run.smithi155.stdout: 2023-10-06T01:20:36.327 INFO:teuthology.orchestra.run.smithi155.stdout: mon cluster log file level = debug 2023-10-06T01:20:36.327 INFO:teuthology.orchestra.run.smithi155.stdout: debug asserts on shutdown = true 2023-10-06T01:20:36.327 INFO:teuthology.orchestra.run.smithi155.stdout: mon health detail to clog = false 2023-10-06T01:20:36.327 INFO:teuthology.orchestra.run.smithi155.stdout: mon host = "172.21.15.50,172.21.15.155,[v2:172.21.15.155:3301,v1:172.21.15.155:6790]" 2023-10-06T01:20:36.327 INFO:teuthology.orchestra.run.smithi155.stdout: ms die on skipped message = False 2023-10-06T01:20:36.328 INFO:teuthology.orchestra.run.smithi155.stdout: fsid = 0bfd9a6b-1587-4fe4-a89e-e43c00286b4e 2023-10-06T01:20:36.328 INFO:teuthology.orchestra.run.smithi155.stdout: 2023-10-06T01:20:36.328 INFO:teuthology.orchestra.run.smithi155.stdout:[osd] 2023-10-06T01:20:36.328 INFO:teuthology.orchestra.run.smithi155.stdout: osd journal size = 100 2023-10-06T01:20:36.328 INFO:teuthology.orchestra.run.smithi155.stdout: 2023-10-06T01:20:36.328 INFO:teuthology.orchestra.run.smithi155.stdout: osd scrub load threshold = 5.0 2023-10-06T01:20:36.328 INFO:teuthology.orchestra.run.smithi155.stdout: osd scrub max interval = 600 2023-10-06T01:20:36.328 INFO:teuthology.orchestra.run.smithi155.stdout: osd mclock profile = high_recovery_ops 2023-10-06T01:20:36.328 INFO:teuthology.orchestra.run.smithi155.stdout: 2023-10-06T01:20:36.328 INFO:teuthology.orchestra.run.smithi155.stdout: osd recover clone overlap = true 2023-10-06T01:20:36.328 INFO:teuthology.orchestra.run.smithi155.stdout: osd recovery max chunk = 1048576 2023-10-06T01:20:36.328 INFO:teuthology.orchestra.run.smithi155.stdout: 2023-10-06T01:20:36.328 INFO:teuthology.orchestra.run.smithi155.stdout: osd debug shutdown = true 2023-10-06T01:20:36.329 INFO:teuthology.orchestra.run.smithi155.stdout: osd debug op order = true 2023-10-06T01:20:36.329 INFO:teuthology.orchestra.run.smithi155.stdout: osd debug verify stray on activate = true 2023-10-06T01:20:36.329 INFO:teuthology.orchestra.run.smithi155.stdout: 2023-10-06T01:20:36.329 INFO:teuthology.orchestra.run.smithi155.stdout: osd open classes on start = true 2023-10-06T01:20:36.329 INFO:teuthology.orchestra.run.smithi155.stdout: osd debug pg log writeout = true 2023-10-06T01:20:36.329 INFO:teuthology.orchestra.run.smithi155.stdout: 2023-10-06T01:20:36.329 INFO:teuthology.orchestra.run.smithi155.stdout: osd deep scrub update digest min age = 30 2023-10-06T01:20:36.329 INFO:teuthology.orchestra.run.smithi155.stdout: 2023-10-06T01:20:36.329 INFO:teuthology.orchestra.run.smithi155.stdout: osd map max advance = 10 2023-10-06T01:20:36.329 INFO:teuthology.orchestra.run.smithi155.stdout: 2023-10-06T01:20:36.329 INFO:teuthology.orchestra.run.smithi155.stdout: journal zero on create = true 2023-10-06T01:20:36.329 INFO:teuthology.orchestra.run.smithi155.stdout: 2023-10-06T01:20:36.329 INFO:teuthology.orchestra.run.smithi155.stdout: filestore ondisk finisher threads = 3 2023-10-06T01:20:36.330 INFO:teuthology.orchestra.run.smithi155.stdout: filestore apply finisher threads = 3 2023-10-06T01:20:36.330 INFO:teuthology.orchestra.run.smithi155.stdout: 2023-10-06T01:20:36.330 INFO:teuthology.orchestra.run.smithi155.stdout: bdev debug aio = true 2023-10-06T01:20:36.330 INFO:teuthology.orchestra.run.smithi155.stdout: osd debug misdirected ops = true 2023-10-06T01:20:36.330 INFO:teuthology.orchestra.run.smithi155.stdout: bluestore block size = 96636764160 2023-10-06T01:20:36.330 INFO:teuthology.orchestra.run.smithi155.stdout: bluestore fsck on mount = True 2023-10-06T01:20:36.330 INFO:teuthology.orchestra.run.smithi155.stdout: debug bluefs = 20 2023-10-06T01:20:36.330 INFO:teuthology.orchestra.run.smithi155.stdout: debug bluestore = 20 2023-10-06T01:20:36.330 INFO:teuthology.orchestra.run.smithi155.stdout: debug ms = 1 2023-10-06T01:20:36.330 INFO:teuthology.orchestra.run.smithi155.stdout: debug osd = 20 2023-10-06T01:20:36.330 INFO:teuthology.orchestra.run.smithi155.stdout: debug rocksdb = 10 2023-10-06T01:20:36.330 INFO:teuthology.orchestra.run.smithi155.stdout: mon osd backfillfull_ratio = 0.85 2023-10-06T01:20:36.331 INFO:teuthology.orchestra.run.smithi155.stdout: mon osd full ratio = 0.9 2023-10-06T01:20:36.331 INFO:teuthology.orchestra.run.smithi155.stdout: mon osd nearfull ratio = 0.8 2023-10-06T01:20:36.331 INFO:teuthology.orchestra.run.smithi155.stdout: osd failsafe full ratio = 0.95 2023-10-06T01:20:36.331 INFO:teuthology.orchestra.run.smithi155.stdout: osd objectstore = bluestore 2023-10-06T01:20:36.331 INFO:teuthology.orchestra.run.smithi155.stdout: osd op complaint time = 180 2023-10-06T01:20:36.331 INFO:teuthology.orchestra.run.smithi155.stdout: 2023-10-06T01:20:36.331 INFO:teuthology.orchestra.run.smithi155.stdout:[mgr] 2023-10-06T01:20:36.331 INFO:teuthology.orchestra.run.smithi155.stdout: debug ms = 1 2023-10-06T01:20:36.331 INFO:teuthology.orchestra.run.smithi155.stdout: debug mgr = 20 2023-10-06T01:20:36.331 INFO:teuthology.orchestra.run.smithi155.stdout: debug mon = 20 2023-10-06T01:20:36.331 INFO:teuthology.orchestra.run.smithi155.stdout: debug auth = 20 2023-10-06T01:20:36.331 INFO:teuthology.orchestra.run.smithi155.stdout: mon reweight min pgs per osd = 4 2023-10-06T01:20:36.331 INFO:teuthology.orchestra.run.smithi155.stdout: mon reweight min bytes per osd = 10 2023-10-06T01:20:36.332 INFO:teuthology.orchestra.run.smithi155.stdout: mgr/telemetry/nag = false 2023-10-06T01:20:36.332 INFO:teuthology.orchestra.run.smithi155.stdout: 2023-10-06T01:20:36.332 INFO:teuthology.orchestra.run.smithi155.stdout:[mon] 2023-10-06T01:20:36.332 INFO:teuthology.orchestra.run.smithi155.stdout: debug ms = 1 2023-10-06T01:20:36.332 INFO:teuthology.orchestra.run.smithi155.stdout: debug mon = 20 2023-10-06T01:20:36.332 INFO:teuthology.orchestra.run.smithi155.stdout: debug paxos = 20 2023-10-06T01:20:36.332 INFO:teuthology.orchestra.run.smithi155.stdout: debug auth = 20 2023-10-06T01:20:36.332 INFO:teuthology.orchestra.run.smithi155.stdout: mon data avail warn = 5 2023-10-06T01:20:36.332 INFO:teuthology.orchestra.run.smithi155.stdout: mon mgr mkfs grace = 240 2023-10-06T01:20:36.332 INFO:teuthology.orchestra.run.smithi155.stdout: mon reweight min pgs per osd = 4 2023-10-06T01:20:36.332 INFO:teuthology.orchestra.run.smithi155.stdout: mon osd reporter subtree level = osd 2023-10-06T01:20:36.332 INFO:teuthology.orchestra.run.smithi155.stdout: mon osd prime pg temp = true 2023-10-06T01:20:36.333 INFO:teuthology.orchestra.run.smithi155.stdout: mon reweight min bytes per osd = 10 2023-10-06T01:20:36.333 INFO:teuthology.orchestra.run.smithi155.stdout: 2023-10-06T01:20:36.333 INFO:teuthology.orchestra.run.smithi155.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-10-06T01:20:36.333 INFO:teuthology.orchestra.run.smithi155.stdout: auth mon ticket ttl = 660 # 11m 2023-10-06T01:20:36.333 INFO:teuthology.orchestra.run.smithi155.stdout: auth service ticket ttl = 240 # 4m 2023-10-06T01:20:36.333 INFO:teuthology.orchestra.run.smithi155.stdout: 2023-10-06T01:20:36.333 INFO:teuthology.orchestra.run.smithi155.stdout: # don't complain about insecure global_id in the test suite 2023-10-06T01:20:36.333 INFO:teuthology.orchestra.run.smithi155.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-10-06T01:20:36.333 INFO:teuthology.orchestra.run.smithi155.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-10-06T01:20:36.333 INFO:teuthology.orchestra.run.smithi155.stdout: 2023-10-06T01:20:36.333 INFO:teuthology.orchestra.run.smithi155.stdout: # 1m isn't quite enough 2023-10-06T01:20:36.333 INFO:teuthology.orchestra.run.smithi155.stdout: mon_down_mkfs_grace = 2m 2023-10-06T01:20:36.333 INFO:teuthology.orchestra.run.smithi155.stdout: 2023-10-06T01:20:36.334 INFO:teuthology.orchestra.run.smithi155.stdout: mon_warn_on_filestore_osds = false 2023-10-06T01:20:36.334 INFO:teuthology.orchestra.run.smithi155.stdout: mon op complaint time = 120 2023-10-06T01:20:36.334 INFO:teuthology.orchestra.run.smithi155.stdout: 2023-10-06T01:20:36.334 INFO:teuthology.orchestra.run.smithi155.stdout:[client] 2023-10-06T01:20:36.334 INFO:teuthology.orchestra.run.smithi155.stdout: rgw cache enabled = true 2023-10-06T01:20:36.334 INFO:teuthology.orchestra.run.smithi155.stdout: rgw enable ops log = true 2023-10-06T01:20:36.334 INFO:teuthology.orchestra.run.smithi155.stdout: rgw enable usage log = true 2023-10-06T01:20:36.334 INFO:teuthology.orchestra.run.smithi155.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-10-06T01:20:36.334 INFO:teuthology.orchestra.run.smithi155.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-10-06T01:20:36.334 INFO:teuthology.orchestra.run.smithi155.stdout: client mount timeout = 600 2023-10-06T01:20:36.334 INFO:teuthology.orchestra.run.smithi155.stdout: debug client = 20 2023-10-06T01:20:36.334 INFO:teuthology.orchestra.run.smithi155.stdout: debug ms = 1 2023-10-06T01:20:36.335 INFO:teuthology.orchestra.run.smithi155.stdout: pid file = "" 2023-10-06T01:20:36.335 INFO:teuthology.orchestra.run.smithi155.stdout: rados mon op timeout = 900 2023-10-06T01:20:36.335 INFO:teuthology.orchestra.run.smithi155.stdout: rados osd op timeout = 900 2023-10-06T01:20:36.335 INFO:teuthology.orchestra.run.smithi155.stdout:[mon.a] 2023-10-06T01:20:36.335 INFO:teuthology.orchestra.run.smithi155.stdout:[mon.b] 2023-10-06T01:20:36.335 INFO:teuthology.orchestra.run.smithi155.stdout:[mon.c] 2023-10-06T01:20:36.335 INFO:teuthology.orchestra.run.smithi155.stdout:[mds.a] 2023-10-06T01:20:36.335 INFO:teuthology.orchestra.run.smithi155.stdout:[mds.c] 2023-10-06T01:20:36.335 INFO:teuthology.orchestra.run.smithi155.stdout:[mds.b] 2023-10-06T01:20:36.335 INFO:teuthology.orchestra.run.smithi155.stdout:[mds.d] 2023-10-06T01:20:36.335 INFO:teuthology.orchestra.run.smithi155.stdout:[mds] 2023-10-06T01:20:36.335 INFO:teuthology.orchestra.run.smithi155.stdout: debug mds = 20 2023-10-06T01:20:36.336 INFO:teuthology.orchestra.run.smithi155.stdout: debug ms = 1 2023-10-06T01:20:36.336 INFO:teuthology.orchestra.run.smithi155.stdout: mds debug frag = True 2023-10-06T01:20:36.336 INFO:teuthology.orchestra.run.smithi155.stdout: mds debug scatterstat = True 2023-10-06T01:20:36.336 INFO:teuthology.orchestra.run.smithi155.stdout: mds op complaint time = 180 2023-10-06T01:20:36.336 INFO:teuthology.orchestra.run.smithi155.stdout: mds verify scatter = True 2023-10-06T01:20:36.336 INFO:teuthology.orchestra.run.smithi155.stdout: osd op complaint time = 180 2023-10-06T01:20:36.336 INFO:teuthology.orchestra.run.smithi155.stdout: rados mon op timeout = 900 2023-10-06T01:20:36.336 INFO:teuthology.orchestra.run.smithi155.stdout: rados osd op timeout = 900 2023-10-06T01:20:36.337 INFO:teuthology.orchestra.run.smithi050.stdout:[global] 2023-10-06T01:20:36.337 INFO:teuthology.orchestra.run.smithi050.stdout: chdir = "" 2023-10-06T01:20:36.337 INFO:teuthology.orchestra.run.smithi050.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-10-06T01:20:36.337 INFO:teuthology.orchestra.run.smithi050.stdout: auth supported = cephx 2023-10-06T01:20:36.337 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-10-06T01:20:36.337 INFO:teuthology.orchestra.run.smithi050.stdout: filestore xattr use omap = true 2023-10-06T01:20:36.337 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-10-06T01:20:36.337 INFO:teuthology.orchestra.run.smithi050.stdout: mon clock drift allowed = 1.000 2023-10-06T01:20:36.337 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-10-06T01:20:36.337 INFO:teuthology.orchestra.run.smithi050.stdout: osd crush chooseleaf type = 0 2023-10-06T01:20:36.337 INFO:teuthology.orchestra.run.smithi050.stdout: auth debug = true 2023-10-06T01:20:36.337 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-10-06T01:20:36.338 INFO:teuthology.orchestra.run.smithi050.stdout: ms die on old message = true 2023-10-06T01:20:36.338 INFO:teuthology.orchestra.run.smithi050.stdout: ms die on bug = true 2023-10-06T01:20:36.338 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-10-06T01:20:36.338 INFO:teuthology.orchestra.run.smithi050.stdout: mon max pg per osd = 10000 # >= luminous 2023-10-06T01:20:36.338 INFO:teuthology.orchestra.run.smithi050.stdout: mon pg warn max object skew = 0 2023-10-06T01:20:36.338 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-10-06T01:20:36.338 INFO:teuthology.orchestra.run.smithi050.stdout: # disable pg_autoscaler by default for new pools 2023-10-06T01:20:36.338 INFO:teuthology.orchestra.run.smithi050.stdout: osd_pool_default_pg_autoscale_mode = off 2023-10-06T01:20:36.338 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-10-06T01:20:36.338 INFO:teuthology.orchestra.run.smithi050.stdout: osd pool default size = 2 2023-10-06T01:20:36.338 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-10-06T01:20:36.338 INFO:teuthology.orchestra.run.smithi050.stdout: mon osd allow primary affinity = true 2023-10-06T01:20:36.339 INFO:teuthology.orchestra.run.smithi050.stdout: mon osd allow pg remap = true 2023-10-06T01:20:36.339 INFO:teuthology.orchestra.run.smithi050.stdout: mon warn on legacy crush tunables = false 2023-10-06T01:20:36.339 INFO:teuthology.orchestra.run.smithi050.stdout: mon warn on crush straw calc version zero = false 2023-10-06T01:20:36.339 INFO:teuthology.orchestra.run.smithi050.stdout: mon warn on no sortbitwise = false 2023-10-06T01:20:36.339 INFO:teuthology.orchestra.run.smithi050.stdout: mon warn on osd down out interval zero = false 2023-10-06T01:20:36.339 INFO:teuthology.orchestra.run.smithi050.stdout: mon warn on too few osds = false 2023-10-06T01:20:36.339 INFO:teuthology.orchestra.run.smithi050.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-10-06T01:20:36.339 INFO:teuthology.orchestra.run.smithi050.stdout: mon_warn_on_pool_no_redundancy = false 2023-10-06T01:20:36.339 INFO:teuthology.orchestra.run.smithi050.stdout: mon_allow_pool_size_one = true 2023-10-06T01:20:36.339 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-10-06T01:20:36.339 INFO:teuthology.orchestra.run.smithi050.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-10-06T01:20:36.339 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-10-06T01:20:36.339 INFO:teuthology.orchestra.run.smithi050.stdout: osd default data pool replay window = 5 2023-10-06T01:20:36.340 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-10-06T01:20:36.340 INFO:teuthology.orchestra.run.smithi050.stdout: mon allow pool delete = true 2023-10-06T01:20:36.340 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-10-06T01:20:36.340 INFO:teuthology.orchestra.run.smithi050.stdout: mon cluster log file level = debug 2023-10-06T01:20:36.340 INFO:teuthology.orchestra.run.smithi050.stdout: debug asserts on shutdown = true 2023-10-06T01:20:36.340 INFO:teuthology.orchestra.run.smithi050.stdout: mon health detail to clog = false 2023-10-06T01:20:36.340 INFO:teuthology.orchestra.run.smithi050.stdout: mon host = "172.21.15.50,172.21.15.155,[v2:172.21.15.155:3301,v1:172.21.15.155:6790]" 2023-10-06T01:20:36.340 INFO:teuthology.orchestra.run.smithi050.stdout: ms die on skipped message = False 2023-10-06T01:20:36.340 INFO:teuthology.orchestra.run.smithi050.stdout: fsid = 0bfd9a6b-1587-4fe4-a89e-e43c00286b4e 2023-10-06T01:20:36.340 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-10-06T01:20:36.340 INFO:teuthology.orchestra.run.smithi050.stdout:[osd] 2023-10-06T01:20:36.340 INFO:teuthology.orchestra.run.smithi050.stdout: osd journal size = 100 2023-10-06T01:20:36.341 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-10-06T01:20:36.341 INFO:teuthology.orchestra.run.smithi050.stdout: osd scrub load threshold = 5.0 2023-10-06T01:20:36.341 INFO:teuthology.orchestra.run.smithi050.stdout: osd scrub max interval = 600 2023-10-06T01:20:36.341 INFO:teuthology.orchestra.run.smithi050.stdout: osd mclock profile = high_recovery_ops 2023-10-06T01:20:36.341 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-10-06T01:20:36.341 INFO:teuthology.orchestra.run.smithi050.stdout: osd recover clone overlap = true 2023-10-06T01:20:36.341 INFO:teuthology.orchestra.run.smithi050.stdout: osd recovery max chunk = 1048576 2023-10-06T01:20:36.341 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-10-06T01:20:36.341 INFO:teuthology.orchestra.run.smithi050.stdout: osd debug shutdown = true 2023-10-06T01:20:36.341 INFO:teuthology.orchestra.run.smithi050.stdout: osd debug op order = true 2023-10-06T01:20:36.341 INFO:teuthology.orchestra.run.smithi050.stdout: osd debug verify stray on activate = true 2023-10-06T01:20:36.341 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-10-06T01:20:36.341 INFO:teuthology.orchestra.run.smithi050.stdout: osd open classes on start = true 2023-10-06T01:20:36.342 INFO:teuthology.orchestra.run.smithi050.stdout: osd debug pg log writeout = true 2023-10-06T01:20:36.342 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-10-06T01:20:36.342 INFO:teuthology.orchestra.run.smithi050.stdout: osd deep scrub update digest min age = 30 2023-10-06T01:20:36.342 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-10-06T01:20:36.342 INFO:teuthology.orchestra.run.smithi050.stdout: osd map max advance = 10 2023-10-06T01:20:36.342 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-10-06T01:20:36.342 INFO:teuthology.orchestra.run.smithi050.stdout: journal zero on create = true 2023-10-06T01:20:36.342 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-10-06T01:20:36.342 INFO:teuthology.orchestra.run.smithi050.stdout: filestore ondisk finisher threads = 3 2023-10-06T01:20:36.342 INFO:teuthology.orchestra.run.smithi050.stdout: filestore apply finisher threads = 3 2023-10-06T01:20:36.342 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-10-06T01:20:36.342 INFO:teuthology.orchestra.run.smithi050.stdout: bdev debug aio = true 2023-10-06T01:20:36.343 INFO:teuthology.orchestra.run.smithi050.stdout: osd debug misdirected ops = true 2023-10-06T01:20:36.343 INFO:teuthology.orchestra.run.smithi050.stdout: bluestore block size = 96636764160 2023-10-06T01:20:36.343 INFO:teuthology.orchestra.run.smithi050.stdout: bluestore fsck on mount = True 2023-10-06T01:20:36.343 INFO:teuthology.orchestra.run.smithi050.stdout: debug bluefs = 20 2023-10-06T01:20:36.343 INFO:teuthology.orchestra.run.smithi050.stdout: debug bluestore = 20 2023-10-06T01:20:36.343 INFO:teuthology.orchestra.run.smithi050.stdout: debug ms = 1 2023-10-06T01:20:36.343 INFO:teuthology.orchestra.run.smithi050.stdout: debug osd = 20 2023-10-06T01:20:36.343 INFO:teuthology.orchestra.run.smithi050.stdout: debug rocksdb = 10 2023-10-06T01:20:36.343 INFO:teuthology.orchestra.run.smithi050.stdout: mon osd backfillfull_ratio = 0.85 2023-10-06T01:20:36.343 INFO:teuthology.orchestra.run.smithi050.stdout: mon osd full ratio = 0.9 2023-10-06T01:20:36.343 INFO:teuthology.orchestra.run.smithi050.stdout: mon osd nearfull ratio = 0.8 2023-10-06T01:20:36.343 INFO:teuthology.orchestra.run.smithi050.stdout: osd failsafe full ratio = 0.95 2023-10-06T01:20:36.343 INFO:teuthology.orchestra.run.smithi050.stdout: osd objectstore = bluestore 2023-10-06T01:20:36.344 INFO:teuthology.orchestra.run.smithi050.stdout: osd op complaint time = 180 2023-10-06T01:20:36.344 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-10-06T01:20:36.344 INFO:teuthology.orchestra.run.smithi050.stdout:[mgr] 2023-10-06T01:20:36.344 INFO:teuthology.orchestra.run.smithi050.stdout: debug ms = 1 2023-10-06T01:20:36.344 INFO:teuthology.orchestra.run.smithi050.stdout: debug mgr = 20 2023-10-06T01:20:36.344 INFO:teuthology.orchestra.run.smithi050.stdout: debug mon = 20 2023-10-06T01:20:36.344 INFO:teuthology.orchestra.run.smithi050.stdout: debug auth = 20 2023-10-06T01:20:36.344 INFO:teuthology.orchestra.run.smithi050.stdout: mon reweight min pgs per osd = 4 2023-10-06T01:20:36.344 INFO:teuthology.orchestra.run.smithi050.stdout: mon reweight min bytes per osd = 10 2023-10-06T01:20:36.344 INFO:teuthology.orchestra.run.smithi050.stdout: mgr/telemetry/nag = false 2023-10-06T01:20:36.344 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-10-06T01:20:36.344 INFO:teuthology.orchestra.run.smithi050.stdout:[mon] 2023-10-06T01:20:36.344 INFO:teuthology.orchestra.run.smithi050.stdout: debug ms = 1 2023-10-06T01:20:36.345 INFO:teuthology.orchestra.run.smithi050.stdout: debug mon = 20 2023-10-06T01:20:36.345 INFO:teuthology.orchestra.run.smithi050.stdout: debug paxos = 20 2023-10-06T01:20:36.345 INFO:teuthology.orchestra.run.smithi050.stdout: debug auth = 20 2023-10-06T01:20:36.345 INFO:teuthology.orchestra.run.smithi050.stdout: mon data avail warn = 5 2023-10-06T01:20:36.345 INFO:teuthology.orchestra.run.smithi050.stdout: mon mgr mkfs grace = 240 2023-10-06T01:20:36.345 INFO:teuthology.orchestra.run.smithi050.stdout: mon reweight min pgs per osd = 4 2023-10-06T01:20:36.345 INFO:teuthology.orchestra.run.smithi050.stdout: mon osd reporter subtree level = osd 2023-10-06T01:20:36.345 INFO:teuthology.orchestra.run.smithi050.stdout: mon osd prime pg temp = true 2023-10-06T01:20:36.345 INFO:teuthology.orchestra.run.smithi050.stdout: mon reweight min bytes per osd = 10 2023-10-06T01:20:36.345 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-10-06T01:20:36.345 INFO:teuthology.orchestra.run.smithi050.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-10-06T01:20:36.345 INFO:teuthology.orchestra.run.smithi050.stdout: auth mon ticket ttl = 660 # 11m 2023-10-06T01:20:36.346 INFO:teuthology.orchestra.run.smithi050.stdout: auth service ticket ttl = 240 # 4m 2023-10-06T01:20:36.346 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-10-06T01:20:36.346 INFO:teuthology.orchestra.run.smithi050.stdout: # don't complain about insecure global_id in the test suite 2023-10-06T01:20:36.346 INFO:teuthology.orchestra.run.smithi050.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-10-06T01:20:36.346 INFO:teuthology.orchestra.run.smithi050.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-10-06T01:20:36.346 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-10-06T01:20:36.346 INFO:teuthology.orchestra.run.smithi050.stdout: # 1m isn't quite enough 2023-10-06T01:20:36.346 INFO:teuthology.orchestra.run.smithi050.stdout: mon_down_mkfs_grace = 2m 2023-10-06T01:20:36.346 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-10-06T01:20:36.346 INFO:teuthology.orchestra.run.smithi050.stdout: mon_warn_on_filestore_osds = false 2023-10-06T01:20:36.346 INFO:teuthology.orchestra.run.smithi050.stdout: mon op complaint time = 120 2023-10-06T01:20:36.346 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-10-06T01:20:36.346 INFO:teuthology.orchestra.run.smithi050.stdout:[client] 2023-10-06T01:20:36.347 INFO:teuthology.orchestra.run.smithi050.stdout: rgw cache enabled = true 2023-10-06T01:20:36.347 INFO:teuthology.orchestra.run.smithi050.stdout: rgw enable ops log = true 2023-10-06T01:20:36.347 INFO:teuthology.orchestra.run.smithi050.stdout: rgw enable usage log = true 2023-10-06T01:20:36.347 INFO:teuthology.orchestra.run.smithi050.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-10-06T01:20:36.347 INFO:teuthology.orchestra.run.smithi050.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-10-06T01:20:36.347 INFO:teuthology.orchestra.run.smithi050.stdout: client mount timeout = 600 2023-10-06T01:20:36.347 INFO:teuthology.orchestra.run.smithi050.stdout: debug client = 20 2023-10-06T01:20:36.347 INFO:teuthology.orchestra.run.smithi050.stdout: debug ms = 1 2023-10-06T01:20:36.347 INFO:teuthology.orchestra.run.smithi050.stdout: pid file = "" 2023-10-06T01:20:36.347 INFO:teuthology.orchestra.run.smithi050.stdout: rados mon op timeout = 900 2023-10-06T01:20:36.347 INFO:teuthology.orchestra.run.smithi050.stdout: rados osd op timeout = 900 2023-10-06T01:20:36.347 INFO:teuthology.orchestra.run.smithi050.stdout:[mon.a] 2023-10-06T01:20:36.348 INFO:teuthology.orchestra.run.smithi050.stdout:[mon.b] 2023-10-06T01:20:36.348 INFO:teuthology.orchestra.run.smithi050.stdout:[mon.c] 2023-10-06T01:20:36.348 INFO:teuthology.orchestra.run.smithi050.stdout:[mds.a] 2023-10-06T01:20:36.348 INFO:teuthology.orchestra.run.smithi050.stdout:[mds.c] 2023-10-06T01:20:36.348 INFO:teuthology.orchestra.run.smithi050.stdout:[mds.b] 2023-10-06T01:20:36.348 INFO:teuthology.orchestra.run.smithi050.stdout:[mds.d] 2023-10-06T01:20:36.348 INFO:teuthology.orchestra.run.smithi050.stdout:[mds] 2023-10-06T01:20:36.348 INFO:teuthology.orchestra.run.smithi050.stdout: debug mds = 20 2023-10-06T01:20:36.348 INFO:teuthology.orchestra.run.smithi050.stdout: debug ms = 1 2023-10-06T01:20:36.348 INFO:teuthology.orchestra.run.smithi050.stdout: mds debug frag = True 2023-10-06T01:20:36.348 INFO:teuthology.orchestra.run.smithi050.stdout: mds debug scatterstat = True 2023-10-06T01:20:36.348 INFO:teuthology.orchestra.run.smithi050.stdout: mds op complaint time = 180 2023-10-06T01:20:36.348 INFO:teuthology.orchestra.run.smithi050.stdout: mds verify scatter = True 2023-10-06T01:20:36.349 INFO:teuthology.orchestra.run.smithi050.stdout: osd op complaint time = 180 2023-10-06T01:20:36.349 INFO:teuthology.orchestra.run.smithi050.stdout: rados mon op timeout = 900 2023-10-06T01:20:36.349 INFO:teuthology.orchestra.run.smithi050.stdout: rados osd op timeout = 900 2023-10-06T01:20:36.356 INFO:tasks.ceph:Creating admin key on mon.a... 2023-10-06T01:20:36.356 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2023-10-06T01:20:36.457 INFO:tasks.ceph:Copying monmap to all nodes... 2023-10-06T01:20:36.457 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2023-10-06T01:20:36.458 DEBUG:teuthology.orchestra.run.smithi050:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2023-10-06T01:20:36.494 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2023-10-06T01:20:36.494 DEBUG:teuthology.orchestra.run.smithi050:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2023-10-06T01:20:36.572 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi050.front.sepia.ceph.com 2023-10-06T01:20:36.572 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2023-10-06T01:20:36.572 DEBUG:teuthology.orchestra.run.smithi050:> sudo dd of=/etc/ceph/ceph.keyring 2023-10-06T01:20:36.572 DEBUG:teuthology.orchestra.run.smithi050:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-10-06T01:20:36.702 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2023-10-06T01:20:36.702 DEBUG:teuthology.orchestra.run.smithi050:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-10-06T01:20:36.777 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi155.front.sepia.ceph.com 2023-10-06T01:20:36.778 DEBUG:teuthology.orchestra.run.smithi155:> set -ex 2023-10-06T01:20:36.778 DEBUG:teuthology.orchestra.run.smithi155:> sudo dd of=/etc/ceph/ceph.keyring 2023-10-06T01:20:36.778 DEBUG:teuthology.orchestra.run.smithi155:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-10-06T01:20:36.866 DEBUG:teuthology.orchestra.run.smithi155:> set -ex 2023-10-06T01:20:36.867 DEBUG:teuthology.orchestra.run.smithi155:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-10-06T01:20:36.943 INFO:tasks.ceph:Setting up mon nodes... 2023-10-06T01:20:36.943 INFO:tasks.ceph:Setting up mgr nodes... 2023-10-06T01:20:36.943 DEBUG:teuthology.orchestra.run.smithi050:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2023-10-06T01:20:37.060 INFO:teuthology.orchestra.run.smithi050.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2023-10-06T01:20:37.066 DEBUG:teuthology.orchestra.run.smithi155:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2023-10-06T01:20:37.180 INFO:teuthology.orchestra.run.smithi155.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2023-10-06T01:20:37.186 INFO:tasks.ceph:Setting up mds nodes... 2023-10-06T01:20:37.186 DEBUG:teuthology.orchestra.run.smithi050:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2023-10-06T01:20:37.300 INFO:teuthology.orchestra.run.smithi050.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2023-10-06T01:20:37.305 DEBUG:teuthology.orchestra.run.smithi050:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2023-10-06T01:20:37.367 DEBUG:teuthology.orchestra.run.smithi050:> sudo mkdir -p /var/lib/ceph/mds/ceph-c && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.c /var/lib/ceph/mds/ceph-c/keyring 2023-10-06T01:20:37.482 INFO:teuthology.orchestra.run.smithi050.stdout:creating /var/lib/ceph/mds/ceph-c/keyring 2023-10-06T01:20:37.486 DEBUG:teuthology.orchestra.run.smithi050:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-c 2023-10-06T01:20:37.553 DEBUG:teuthology.orchestra.run.smithi155:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2023-10-06T01:20:37.664 INFO:teuthology.orchestra.run.smithi155.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2023-10-06T01:20:37.668 DEBUG:teuthology.orchestra.run.smithi155:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2023-10-06T01:20:37.730 DEBUG:teuthology.orchestra.run.smithi155:> sudo mkdir -p /var/lib/ceph/mds/ceph-d && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.d /var/lib/ceph/mds/ceph-d/keyring 2023-10-06T01:20:37.839 INFO:teuthology.orchestra.run.smithi155.stdout:creating /var/lib/ceph/mds/ceph-d/keyring 2023-10-06T01:20:37.843 DEBUG:teuthology.orchestra.run.smithi155:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-d 2023-10-06T01:20:37.904 INFO:tasks.ceph_client:Setting up client nodes... 2023-10-06T01:20:37.905 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2023-10-06T01:20:37.992 INFO:teuthology.orchestra.run.smithi050.stdout:creating /etc/ceph/ceph.client.0.keyring 2023-10-06T01:20:38.024 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.2 /etc/ceph/ceph.client.2.keyring && sudo chmod 0644 /etc/ceph/ceph.client.2.keyring 2023-10-06T01:20:38.108 INFO:teuthology.orchestra.run.smithi050.stdout:creating /etc/ceph/ceph.client.2.keyring 2023-10-06T01:20:38.140 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2023-10-06T01:20:38.223 INFO:teuthology.orchestra.run.smithi155.stdout:creating /etc/ceph/ceph.client.1.keyring 2023-10-06T01:20:38.280 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.3 /etc/ceph/ceph.client.3.keyring && sudo chmod 0644 /etc/ceph/ceph.client.3.keyring 2023-10-06T01:20:38.363 INFO:teuthology.orchestra.run.smithi155.stdout:creating /etc/ceph/ceph.client.3.keyring 2023-10-06T01:20:38.394 INFO:tasks.ceph:Running mkfs on osd nodes... 2023-10-06T01:20:38.394 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi050.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi155.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2023-10-06T01:20:38.394 DEBUG:teuthology.orchestra.run.smithi050:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2023-10-06T01:20:38.458 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-10-06T01:20:38.458 INFO:tasks.ceph:role: osd.0 2023-10-06T01:20:38.458 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi050.front.sepia.ceph.com 2023-10-06T01:20:38.458 DEBUG:teuthology.orchestra.run.smithi050:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-10-06T01:20:38.519 INFO:teuthology.orchestra.run.smithi050.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-10-06T01:20:38.520 INFO:teuthology.orchestra.run.smithi050.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-06T01:20:38.520 INFO:teuthology.orchestra.run.smithi050.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-06T01:20:38.520 INFO:teuthology.orchestra.run.smithi050.stdout: = reflink=1 2023-10-06T01:20:38.520 INFO:teuthology.orchestra.run.smithi050.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-06T01:20:38.520 INFO:teuthology.orchestra.run.smithi050.stdout: = sunit=0 swidth=0 blks 2023-10-06T01:20:38.520 INFO:teuthology.orchestra.run.smithi050.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-06T01:20:38.520 INFO:teuthology.orchestra.run.smithi050.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-10-06T01:20:38.520 INFO:teuthology.orchestra.run.smithi050.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-06T01:20:38.520 INFO:teuthology.orchestra.run.smithi050.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-06T01:20:38.542 INFO:teuthology.orchestra.run.smithi050.stdout:Discarding blocks...Done. 2023-10-06T01:20:38.547 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi050.front.sepia.ceph.com -o noatime 2023-10-06T01:20:38.547 DEBUG:teuthology.orchestra.run.smithi050:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2023-10-06T01:20:38.647 DEBUG:teuthology.orchestra.run.smithi050:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2023-10-06T01:20:38.719 DEBUG:teuthology.orchestra.run.smithi050:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2023-10-06T01:20:38.782 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-10-06T01:20:38.782 INFO:tasks.ceph:role: osd.1 2023-10-06T01:20:38.782 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi050.front.sepia.ceph.com 2023-10-06T01:20:38.782 DEBUG:teuthology.orchestra.run.smithi050:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2023-10-06T01:20:38.846 INFO:teuthology.orchestra.run.smithi050.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2023-10-06T01:20:38.846 INFO:teuthology.orchestra.run.smithi050.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-06T01:20:38.846 INFO:teuthology.orchestra.run.smithi050.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-06T01:20:38.846 INFO:teuthology.orchestra.run.smithi050.stdout: = reflink=1 2023-10-06T01:20:38.847 INFO:teuthology.orchestra.run.smithi050.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-06T01:20:38.847 INFO:teuthology.orchestra.run.smithi050.stdout: = sunit=0 swidth=0 blks 2023-10-06T01:20:38.847 INFO:teuthology.orchestra.run.smithi050.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-06T01:20:38.847 INFO:teuthology.orchestra.run.smithi050.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-10-06T01:20:38.847 INFO:teuthology.orchestra.run.smithi050.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-06T01:20:38.847 INFO:teuthology.orchestra.run.smithi050.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-06T01:20:38.869 INFO:teuthology.orchestra.run.smithi050.stdout:Discarding blocks...Done. 2023-10-06T01:20:38.874 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi050.front.sepia.ceph.com -o noatime 2023-10-06T01:20:38.874 DEBUG:teuthology.orchestra.run.smithi050:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2023-10-06T01:20:38.976 DEBUG:teuthology.orchestra.run.smithi050:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2023-10-06T01:20:39.048 DEBUG:teuthology.orchestra.run.smithi050:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2023-10-06T01:20:39.110 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-10-06T01:20:39.111 INFO:tasks.ceph:role: osd.2 2023-10-06T01:20:39.111 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi050.front.sepia.ceph.com 2023-10-06T01:20:39.111 DEBUG:teuthology.orchestra.run.smithi050:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2023-10-06T01:20:39.172 INFO:teuthology.orchestra.run.smithi050.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2023-10-06T01:20:39.172 INFO:teuthology.orchestra.run.smithi050.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-06T01:20:39.173 INFO:teuthology.orchestra.run.smithi050.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-06T01:20:39.173 INFO:teuthology.orchestra.run.smithi050.stdout: = reflink=1 2023-10-06T01:20:39.173 INFO:teuthology.orchestra.run.smithi050.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-06T01:20:39.173 INFO:teuthology.orchestra.run.smithi050.stdout: = sunit=0 swidth=0 blks 2023-10-06T01:20:39.173 INFO:teuthology.orchestra.run.smithi050.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-06T01:20:39.173 INFO:teuthology.orchestra.run.smithi050.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-10-06T01:20:39.173 INFO:teuthology.orchestra.run.smithi050.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-06T01:20:39.173 INFO:teuthology.orchestra.run.smithi050.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-06T01:20:39.196 INFO:teuthology.orchestra.run.smithi050.stdout:Discarding blocks...Done. 2023-10-06T01:20:39.200 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi050.front.sepia.ceph.com -o noatime 2023-10-06T01:20:39.200 DEBUG:teuthology.orchestra.run.smithi050:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2023-10-06T01:20:39.297 DEBUG:teuthology.orchestra.run.smithi050:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2023-10-06T01:20:39.365 DEBUG:teuthology.orchestra.run.smithi050:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2023-10-06T01:20:39.426 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-10-06T01:20:39.426 INFO:tasks.ceph:role: osd.3 2023-10-06T01:20:39.426 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi050.front.sepia.ceph.com 2023-10-06T01:20:39.426 DEBUG:teuthology.orchestra.run.smithi050:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2023-10-06T01:20:39.487 INFO:teuthology.orchestra.run.smithi050.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2023-10-06T01:20:39.487 INFO:teuthology.orchestra.run.smithi050.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-06T01:20:39.487 INFO:teuthology.orchestra.run.smithi050.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-06T01:20:39.487 INFO:teuthology.orchestra.run.smithi050.stdout: = reflink=1 2023-10-06T01:20:39.487 INFO:teuthology.orchestra.run.smithi050.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-06T01:20:39.487 INFO:teuthology.orchestra.run.smithi050.stdout: = sunit=0 swidth=0 blks 2023-10-06T01:20:39.488 INFO:teuthology.orchestra.run.smithi050.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-06T01:20:39.488 INFO:teuthology.orchestra.run.smithi050.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-10-06T01:20:39.488 INFO:teuthology.orchestra.run.smithi050.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-06T01:20:39.488 INFO:teuthology.orchestra.run.smithi050.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-06T01:20:39.510 INFO:teuthology.orchestra.run.smithi050.stdout:Discarding blocks...Done. 2023-10-06T01:20:39.513 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi050.front.sepia.ceph.com -o noatime 2023-10-06T01:20:39.514 DEBUG:teuthology.orchestra.run.smithi050:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2023-10-06T01:20:39.611 DEBUG:teuthology.orchestra.run.smithi050:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2023-10-06T01:20:39.678 DEBUG:teuthology.orchestra.run.smithi050:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-06T01:20:39.786 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:20:39.784+0000 7f176f99f540 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2023-10-06T01:20:39.787 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:20:39.784+0000 7f176f99f540 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2023-10-06T01:20:39.787 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:20:39.784+0000 7f176f99f540 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-10-06T01:20:39.787 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:20:39.784+0000 7f176f99f540 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-10-06T01:20:39.787 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:20:39.784+0000 7f176f99f540 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-10-06T01:20:39.788 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:20:39.786+0000 7f176f99f540 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2023-10-06T01:20:40.325 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:20:40.323+0000 7f176f99f540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-06T01:20:41.085 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:20:41.083+0000 7f176f99f540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-06T01:20:41.850 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:20:41.849+0000 7f176f99f540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-06T01:20:42.671 DEBUG:teuthology.orchestra.run.smithi050:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2023-10-06T01:20:42.739 DEBUG:teuthology.orchestra.run.smithi050:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-06T01:20:42.834 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:20:42.833+0000 7f4acb97a540 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2023-10-06T01:20:42.835 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:20:42.834+0000 7f4acb97a540 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2023-10-06T01:20:42.835 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:20:42.834+0000 7f4acb97a540 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-10-06T01:20:42.835 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:20:42.834+0000 7f4acb97a540 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-10-06T01:20:42.835 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:20:42.834+0000 7f4acb97a540 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-10-06T01:20:42.836 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:20:42.835+0000 7f4acb97a540 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2023-10-06T01:20:43.372 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:20:43.371+0000 7f4acb97a540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-06T01:20:44.134 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:20:44.133+0000 7f4acb97a540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-06T01:20:44.895 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:20:44.895+0000 7f4acb97a540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-06T01:20:45.711 DEBUG:teuthology.orchestra.run.smithi050:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2023-10-06T01:20:45.780 DEBUG:teuthology.orchestra.run.smithi050:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-06T01:20:45.875 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:20:45.874+0000 7f661a7d5540 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2023-10-06T01:20:45.875 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:20:45.874+0000 7f661a7d5540 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2023-10-06T01:20:45.876 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:20:45.874+0000 7f661a7d5540 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-10-06T01:20:45.876 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:20:45.874+0000 7f661a7d5540 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-10-06T01:20:45.876 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:20:45.874+0000 7f661a7d5540 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-10-06T01:20:45.876 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:20:45.876+0000 7f661a7d5540 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2023-10-06T01:20:46.421 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:20:46.420+0000 7f661a7d5540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-06T01:20:47.179 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:20:47.178+0000 7f661a7d5540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-06T01:20:47.943 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:20:47.942+0000 7f661a7d5540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-06T01:20:48.772 DEBUG:teuthology.orchestra.run.smithi050:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2023-10-06T01:20:48.841 DEBUG:teuthology.orchestra.run.smithi050:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-06T01:20:48.936 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:20:48.935+0000 7f28cf82a540 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2023-10-06T01:20:48.937 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:20:48.935+0000 7f28cf82a540 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2023-10-06T01:20:48.937 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:20:48.935+0000 7f28cf82a540 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-10-06T01:20:48.937 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:20:48.935+0000 7f28cf82a540 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-10-06T01:20:48.937 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:20:48.935+0000 7f28cf82a540 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-10-06T01:20:48.937 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:20:48.937+0000 7f28cf82a540 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2023-10-06T01:20:49.474 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:20:49.473+0000 7f28cf82a540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-06T01:20:50.235 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:20:50.234+0000 7f28cf82a540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-06T01:20:50.997 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:20:50.996+0000 7f28cf82a540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-06T01:20:51.809 DEBUG:teuthology.orchestra.run.smithi050:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2023-10-06T01:20:51.874 DEBUG:teuthology.orchestra.run.smithi155:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2023-10-06T01:20:51.943 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-10-06T01:20:51.943 INFO:tasks.ceph:role: osd.4 2023-10-06T01:20:51.943 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi155.front.sepia.ceph.com 2023-10-06T01:20:51.943 DEBUG:teuthology.orchestra.run.smithi155:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-10-06T01:20:52.013 INFO:teuthology.orchestra.run.smithi155.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-10-06T01:20:52.013 INFO:teuthology.orchestra.run.smithi155.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-06T01:20:52.013 INFO:teuthology.orchestra.run.smithi155.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-06T01:20:52.014 INFO:teuthology.orchestra.run.smithi155.stdout: = reflink=1 2023-10-06T01:20:52.014 INFO:teuthology.orchestra.run.smithi155.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-06T01:20:52.014 INFO:teuthology.orchestra.run.smithi155.stdout: = sunit=0 swidth=0 blks 2023-10-06T01:20:52.014 INFO:teuthology.orchestra.run.smithi155.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-06T01:20:52.014 INFO:teuthology.orchestra.run.smithi155.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-10-06T01:20:52.014 INFO:teuthology.orchestra.run.smithi155.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-06T01:20:52.014 INFO:teuthology.orchestra.run.smithi155.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-06T01:20:52.449 INFO:teuthology.orchestra.run.smithi155.stdout:Discarding blocks...Done. 2023-10-06T01:20:52.453 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi155.front.sepia.ceph.com -o noatime 2023-10-06T01:20:52.453 DEBUG:teuthology.orchestra.run.smithi155:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2023-10-06T01:20:52.654 DEBUG:teuthology.orchestra.run.smithi155:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2023-10-06T01:20:52.724 DEBUG:teuthology.orchestra.run.smithi155:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2023-10-06T01:20:52.785 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-10-06T01:20:52.785 INFO:tasks.ceph:role: osd.5 2023-10-06T01:20:52.786 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi155.front.sepia.ceph.com 2023-10-06T01:20:52.786 DEBUG:teuthology.orchestra.run.smithi155:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2023-10-06T01:20:52.854 INFO:teuthology.orchestra.run.smithi155.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2023-10-06T01:20:52.854 INFO:teuthology.orchestra.run.smithi155.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-06T01:20:52.854 INFO:teuthology.orchestra.run.smithi155.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-06T01:20:52.854 INFO:teuthology.orchestra.run.smithi155.stdout: = reflink=1 2023-10-06T01:20:52.854 INFO:teuthology.orchestra.run.smithi155.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-06T01:20:52.854 INFO:teuthology.orchestra.run.smithi155.stdout: = sunit=0 swidth=0 blks 2023-10-06T01:20:52.854 INFO:teuthology.orchestra.run.smithi155.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-06T01:20:52.854 INFO:teuthology.orchestra.run.smithi155.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-10-06T01:20:52.854 INFO:teuthology.orchestra.run.smithi155.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-06T01:20:52.855 INFO:teuthology.orchestra.run.smithi155.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-06T01:20:53.264 INFO:teuthology.orchestra.run.smithi155.stdout:Discarding blocks...Done. 2023-10-06T01:20:53.267 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi155.front.sepia.ceph.com -o noatime 2023-10-06T01:20:53.268 DEBUG:teuthology.orchestra.run.smithi155:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2023-10-06T01:20:53.407 DEBUG:teuthology.orchestra.run.smithi155:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2023-10-06T01:20:53.476 DEBUG:teuthology.orchestra.run.smithi155:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2023-10-06T01:20:53.536 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-10-06T01:20:53.536 INFO:tasks.ceph:role: osd.6 2023-10-06T01:20:53.536 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi155.front.sepia.ceph.com 2023-10-06T01:20:53.537 DEBUG:teuthology.orchestra.run.smithi155:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2023-10-06T01:20:53.604 INFO:teuthology.orchestra.run.smithi155.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2023-10-06T01:20:53.604 INFO:teuthology.orchestra.run.smithi155.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-06T01:20:53.605 INFO:teuthology.orchestra.run.smithi155.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-06T01:20:53.605 INFO:teuthology.orchestra.run.smithi155.stdout: = reflink=1 2023-10-06T01:20:53.605 INFO:teuthology.orchestra.run.smithi155.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-06T01:20:53.605 INFO:teuthology.orchestra.run.smithi155.stdout: = sunit=0 swidth=0 blks 2023-10-06T01:20:53.605 INFO:teuthology.orchestra.run.smithi155.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-06T01:20:53.605 INFO:teuthology.orchestra.run.smithi155.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-10-06T01:20:53.605 INFO:teuthology.orchestra.run.smithi155.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-06T01:20:53.605 INFO:teuthology.orchestra.run.smithi155.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-06T01:20:54.049 INFO:teuthology.orchestra.run.smithi155.stdout:Discarding blocks...Done. 2023-10-06T01:20:54.052 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi155.front.sepia.ceph.com -o noatime 2023-10-06T01:20:54.052 DEBUG:teuthology.orchestra.run.smithi155:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2023-10-06T01:20:54.243 DEBUG:teuthology.orchestra.run.smithi155:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2023-10-06T01:20:54.314 DEBUG:teuthology.orchestra.run.smithi155:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2023-10-06T01:20:54.375 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-10-06T01:20:54.375 INFO:tasks.ceph:role: osd.7 2023-10-06T01:20:54.375 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi155.front.sepia.ceph.com 2023-10-06T01:20:54.375 DEBUG:teuthology.orchestra.run.smithi155:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2023-10-06T01:20:54.443 INFO:teuthology.orchestra.run.smithi155.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2023-10-06T01:20:54.443 INFO:teuthology.orchestra.run.smithi155.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-06T01:20:54.443 INFO:teuthology.orchestra.run.smithi155.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-06T01:20:54.443 INFO:teuthology.orchestra.run.smithi155.stdout: = reflink=1 2023-10-06T01:20:54.443 INFO:teuthology.orchestra.run.smithi155.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-06T01:20:54.443 INFO:teuthology.orchestra.run.smithi155.stdout: = sunit=0 swidth=0 blks 2023-10-06T01:20:54.443 INFO:teuthology.orchestra.run.smithi155.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-06T01:20:54.443 INFO:teuthology.orchestra.run.smithi155.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-10-06T01:20:54.443 INFO:teuthology.orchestra.run.smithi155.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-06T01:20:54.444 INFO:teuthology.orchestra.run.smithi155.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-06T01:20:54.876 INFO:teuthology.orchestra.run.smithi155.stdout:Discarding blocks...Done. 2023-10-06T01:20:54.879 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi155.front.sepia.ceph.com -o noatime 2023-10-06T01:20:54.879 DEBUG:teuthology.orchestra.run.smithi155:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2023-10-06T01:20:55.032 DEBUG:teuthology.orchestra.run.smithi155:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2023-10-06T01:20:55.099 DEBUG:teuthology.orchestra.run.smithi155:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-06T01:20:55.214 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-06T01:20:55.213+0000 7f022ece8540 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2023-10-06T01:20:55.215 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-06T01:20:55.213+0000 7f022ece8540 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2023-10-06T01:20:55.215 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-06T01:20:55.213+0000 7f022ece8540 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-10-06T01:20:55.215 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-06T01:20:55.213+0000 7f022ece8540 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-10-06T01:20:55.215 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-06T01:20:55.213+0000 7f022ece8540 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-10-06T01:20:55.216 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-06T01:20:55.215+0000 7f022ece8540 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2023-10-06T01:20:55.754 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-06T01:20:55.753+0000 7f022ece8540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-06T01:20:56.515 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-06T01:20:56.514+0000 7f022ece8540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-06T01:20:57.283 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-06T01:20:57.282+0000 7f022ece8540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-06T01:20:58.096 DEBUG:teuthology.orchestra.run.smithi155:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2023-10-06T01:20:58.159 DEBUG:teuthology.orchestra.run.smithi155:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-06T01:20:58.308 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-06T01:20:58.307+0000 7f0879bf8540 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2023-10-06T01:20:58.309 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-06T01:20:58.307+0000 7f0879bf8540 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2023-10-06T01:20:58.309 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-06T01:20:58.307+0000 7f0879bf8540 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-10-06T01:20:58.309 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-06T01:20:58.307+0000 7f0879bf8540 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-10-06T01:20:58.309 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-06T01:20:58.307+0000 7f0879bf8540 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-10-06T01:20:58.310 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-06T01:20:58.309+0000 7f0879bf8540 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2023-10-06T01:20:58.848 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-06T01:20:58.847+0000 7f0879bf8540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-06T01:20:59.611 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-06T01:20:59.609+0000 7f0879bf8540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-06T01:21:00.372 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-06T01:21:00.371+0000 7f0879bf8540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-06T01:21:01.193 DEBUG:teuthology.orchestra.run.smithi155:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2023-10-06T01:21:01.256 DEBUG:teuthology.orchestra.run.smithi155:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-06T01:21:01.347 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-06T01:21:01.346+0000 7f1ee52ee540 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2023-10-06T01:21:01.348 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-06T01:21:01.346+0000 7f1ee52ee540 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2023-10-06T01:21:01.348 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-06T01:21:01.346+0000 7f1ee52ee540 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-10-06T01:21:01.348 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-06T01:21:01.346+0000 7f1ee52ee540 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-10-06T01:21:01.348 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-06T01:21:01.346+0000 7f1ee52ee540 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-10-06T01:21:01.349 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-06T01:21:01.348+0000 7f1ee52ee540 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2023-10-06T01:21:01.895 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-06T01:21:01.894+0000 7f1ee52ee540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-06T01:21:02.657 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-06T01:21:02.656+0000 7f1ee52ee540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-06T01:21:03.424 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-06T01:21:03.423+0000 7f1ee52ee540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-06T01:21:03.737 DEBUG:teuthology.orchestra.run.smithi050:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T01:21:03.743 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T01:21:04.236 DEBUG:teuthology.orchestra.run.smithi155:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2023-10-06T01:21:04.297 DEBUG:teuthology.orchestra.run.smithi155:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-06T01:21:04.389 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-06T01:21:04.387+0000 7f147484b540 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2023-10-06T01:21:04.389 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-06T01:21:04.388+0000 7f147484b540 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2023-10-06T01:21:04.390 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-06T01:21:04.388+0000 7f147484b540 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-10-06T01:21:04.390 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-06T01:21:04.388+0000 7f147484b540 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-10-06T01:21:04.390 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-06T01:21:04.388+0000 7f147484b540 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-10-06T01:21:04.390 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-06T01:21:04.389+0000 7f147484b540 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2023-10-06T01:21:04.926 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-06T01:21:04.925+0000 7f147484b540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-06T01:21:05.688 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-06T01:21:05.687+0000 7f147484b540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-06T01:21:06.453 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-06T01:21:06.451+0000 7f147484b540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-06T01:21:07.266 DEBUG:teuthology.orchestra.run.smithi155:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2023-10-06T01:21:07.330 INFO:tasks.ceph:Reading keys from all nodes... 2023-10-06T01:21:07.330 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2023-10-06T01:21:07.330 DEBUG:teuthology.orchestra.run.smithi050:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2023-10-06T01:21:07.399 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2023-10-06T01:21:07.399 DEBUG:teuthology.orchestra.run.smithi050:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2023-10-06T01:21:07.503 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2023-10-06T01:21:07.503 DEBUG:teuthology.orchestra.run.smithi050:> sudo dd if=/var/lib/ceph/mds/ceph-c/keyring of=/dev/stdout 2023-10-06T01:21:07.606 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2023-10-06T01:21:07.606 DEBUG:teuthology.orchestra.run.smithi050:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2023-10-06T01:21:07.707 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2023-10-06T01:21:07.708 DEBUG:teuthology.orchestra.run.smithi050:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2023-10-06T01:21:07.809 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2023-10-06T01:21:07.810 DEBUG:teuthology.orchestra.run.smithi050:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2023-10-06T01:21:07.911 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2023-10-06T01:21:07.911 DEBUG:teuthology.orchestra.run.smithi050:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2023-10-06T01:21:08.013 DEBUG:teuthology.orchestra.run.smithi155:> set -ex 2023-10-06T01:21:08.013 DEBUG:teuthology.orchestra.run.smithi155:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2023-10-06T01:21:08.080 DEBUG:teuthology.orchestra.run.smithi155:> set -ex 2023-10-06T01:21:08.080 DEBUG:teuthology.orchestra.run.smithi155:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2023-10-06T01:21:08.182 DEBUG:teuthology.orchestra.run.smithi155:> set -ex 2023-10-06T01:21:08.183 DEBUG:teuthology.orchestra.run.smithi155:> sudo dd if=/var/lib/ceph/mds/ceph-d/keyring of=/dev/stdout 2023-10-06T01:21:08.284 DEBUG:teuthology.orchestra.run.smithi155:> set -ex 2023-10-06T01:21:08.284 DEBUG:teuthology.orchestra.run.smithi155:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2023-10-06T01:21:08.384 DEBUG:teuthology.orchestra.run.smithi155:> set -ex 2023-10-06T01:21:08.384 DEBUG:teuthology.orchestra.run.smithi155:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2023-10-06T01:21:08.484 DEBUG:teuthology.orchestra.run.smithi155:> set -ex 2023-10-06T01:21:08.484 DEBUG:teuthology.orchestra.run.smithi155:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2023-10-06T01:21:08.584 DEBUG:teuthology.orchestra.run.smithi155:> set -ex 2023-10-06T01:21:08.584 DEBUG:teuthology.orchestra.run.smithi155:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2023-10-06T01:21:08.685 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2023-10-06T01:21:08.685 DEBUG:teuthology.orchestra.run.smithi050:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2023-10-06T01:21:08.724 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2023-10-06T01:21:08.725 DEBUG:teuthology.orchestra.run.smithi050:> dd if=/etc/ceph/ceph.client.2.keyring of=/dev/stdout 2023-10-06T01:21:08.802 DEBUG:teuthology.orchestra.run.smithi155:> set -ex 2023-10-06T01:21:08.803 DEBUG:teuthology.orchestra.run.smithi155:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2023-10-06T01:21:08.838 DEBUG:teuthology.orchestra.run.smithi155:> set -ex 2023-10-06T01:21:08.838 DEBUG:teuthology.orchestra.run.smithi155:> dd if=/etc/ceph/ceph.client.3.keyring of=/dev/stdout 2023-10-06T01:21:08.913 INFO:tasks.ceph:Adding keys to all mons... 2023-10-06T01:21:08.913 DEBUG:teuthology.orchestra.run.smithi050:> sudo tee -a /etc/ceph/ceph.keyring 2023-10-06T01:21:08.918 DEBUG:teuthology.orchestra.run.smithi155:> sudo tee -a /etc/ceph/ceph.keyring 2023-10-06T01:21:08.974 INFO:teuthology.orchestra.run.smithi050.stdout:[mgr.y] 2023-10-06T01:21:08.974 INFO:teuthology.orchestra.run.smithi050.stdout: key = AQDlYB9l8smaAxAAZxC8BlF22lsEF8C8fZrZGw== 2023-10-06T01:21:08.974 INFO:teuthology.orchestra.run.smithi050.stdout:[mds.a] 2023-10-06T01:21:08.975 INFO:teuthology.orchestra.run.smithi050.stdout: key = AQDlYB9lud7pERAAvt2kBCO8ciGTgwElI1oEvQ== 2023-10-06T01:21:08.975 INFO:teuthology.orchestra.run.smithi050.stdout:[mds.c] 2023-10-06T01:21:08.975 INFO:teuthology.orchestra.run.smithi050.stdout: key = AQDlYB9lsQO7HBAA2ctu0JyuieydQEsnAdxe4g== 2023-10-06T01:21:08.975 INFO:teuthology.orchestra.run.smithi050.stdout:[osd.0] 2023-10-06T01:21:08.975 INFO:teuthology.orchestra.run.smithi050.stdout: key = AQDnYB9lK/jfLhAAKoVEn64/qEG1jUKRSRf6Hw== 2023-10-06T01:21:08.975 INFO:teuthology.orchestra.run.smithi050.stdout:[osd.1] 2023-10-06T01:21:08.975 INFO:teuthology.orchestra.run.smithi050.stdout: key = AQDqYB9lpNe9MRAARwXOyWY1El1/QAebuns9Nw== 2023-10-06T01:21:08.975 INFO:teuthology.orchestra.run.smithi050.stdout:[osd.2] 2023-10-06T01:21:08.975 INFO:teuthology.orchestra.run.smithi050.stdout: key = AQDtYB9lW1ouNBAAFsxCFJ33SEJ2wD+LjheR1A== 2023-10-06T01:21:08.975 INFO:teuthology.orchestra.run.smithi050.stdout:[osd.3] 2023-10-06T01:21:08.975 INFO:teuthology.orchestra.run.smithi050.stdout: key = AQDwYB9lnAXNNxAA9hW5oDzBQRnW/EHS7qU6Eg== 2023-10-06T01:21:08.976 INFO:teuthology.orchestra.run.smithi050.stdout:[mgr.x] 2023-10-06T01:21:08.976 INFO:teuthology.orchestra.run.smithi050.stdout: key = AQDlYB9lOr69ChAAvDbezvRT4bWhgdQsKkDe2g== 2023-10-06T01:21:08.976 INFO:teuthology.orchestra.run.smithi050.stdout:[mds.b] 2023-10-06T01:21:08.976 INFO:teuthology.orchestra.run.smithi050.stdout: key = AQDlYB9l81CaJxAAmSJ2iq7sgKOm6aQkweRUmw== 2023-10-06T01:21:08.976 INFO:teuthology.orchestra.run.smithi050.stdout:[mds.d] 2023-10-06T01:21:08.976 INFO:teuthology.orchestra.run.smithi050.stdout: key = AQDlYB9lpaoGMhAA1smpLPyNHMFd8KB11WuEVw== 2023-10-06T01:21:08.976 INFO:teuthology.orchestra.run.smithi050.stdout:[osd.4] 2023-10-06T01:21:08.976 INFO:teuthology.orchestra.run.smithi050.stdout: key = AQD3YB9lTV3LDBAA37KXA7yKc0LBZzMK3u6Myw== 2023-10-06T01:21:08.976 INFO:teuthology.orchestra.run.smithi050.stdout:[osd.5] 2023-10-06T01:21:08.976 INFO:teuthology.orchestra.run.smithi050.stdout: key = AQD6YB9lITBlEhAAFaNVu44B1CEWcPazSF071g== 2023-10-06T01:21:08.976 INFO:teuthology.orchestra.run.smithi050.stdout:[osd.6] 2023-10-06T01:21:08.977 INFO:teuthology.orchestra.run.smithi050.stdout: key = AQD9YB9lFqG3FBAAnzOc0e//w1hE2Qg+S3Z4Ew== 2023-10-06T01:21:08.977 INFO:teuthology.orchestra.run.smithi050.stdout:[osd.7] 2023-10-06T01:21:08.977 INFO:teuthology.orchestra.run.smithi050.stdout: key = AQAAYR9lY5wzFxAAXt+cjEmGy77K89tTEamVrA== 2023-10-06T01:21:08.977 INFO:teuthology.orchestra.run.smithi050.stdout:[client.0] 2023-10-06T01:21:08.977 INFO:teuthology.orchestra.run.smithi050.stdout: key = AQDlYB9l+CUhOxAAIGNbzfc234/z9JKUyQ2WxA== 2023-10-06T01:21:08.977 INFO:teuthology.orchestra.run.smithi050.stdout:[client.2] 2023-10-06T01:21:08.977 INFO:teuthology.orchestra.run.smithi050.stdout: key = AQDmYB9laX1zBhAAqB5vZ65xv4Gw7nUDBK6z/w== 2023-10-06T01:21:08.977 INFO:teuthology.orchestra.run.smithi050.stdout:[client.1] 2023-10-06T01:21:08.977 INFO:teuthology.orchestra.run.smithi050.stdout: key = AQDmYB9l+5xRDRAALxAmTNAGNADrWoYVLH7/DA== 2023-10-06T01:21:08.977 INFO:teuthology.orchestra.run.smithi050.stdout:[client.3] 2023-10-06T01:21:08.977 INFO:teuthology.orchestra.run.smithi050.stdout: key = AQDmYB9lazulFRAAE410DH6LzPVx1hN7wkjoTA== 2023-10-06T01:21:09.011 INFO:teuthology.orchestra.run.smithi155.stdout:[mgr.y] 2023-10-06T01:21:09.011 INFO:teuthology.orchestra.run.smithi155.stdout: key = AQDlYB9l8smaAxAAZxC8BlF22lsEF8C8fZrZGw== 2023-10-06T01:21:09.011 INFO:teuthology.orchestra.run.smithi155.stdout:[mds.a] 2023-10-06T01:21:09.011 INFO:teuthology.orchestra.run.smithi155.stdout: key = AQDlYB9lud7pERAAvt2kBCO8ciGTgwElI1oEvQ== 2023-10-06T01:21:09.011 INFO:teuthology.orchestra.run.smithi155.stdout:[mds.c] 2023-10-06T01:21:09.011 INFO:teuthology.orchestra.run.smithi155.stdout: key = AQDlYB9lsQO7HBAA2ctu0JyuieydQEsnAdxe4g== 2023-10-06T01:21:09.011 INFO:teuthology.orchestra.run.smithi155.stdout:[osd.0] 2023-10-06T01:21:09.011 INFO:teuthology.orchestra.run.smithi155.stdout: key = AQDnYB9lK/jfLhAAKoVEn64/qEG1jUKRSRf6Hw== 2023-10-06T01:21:09.011 INFO:teuthology.orchestra.run.smithi155.stdout:[osd.1] 2023-10-06T01:21:09.012 INFO:teuthology.orchestra.run.smithi155.stdout: key = AQDqYB9lpNe9MRAARwXOyWY1El1/QAebuns9Nw== 2023-10-06T01:21:09.012 INFO:teuthology.orchestra.run.smithi155.stdout:[osd.2] 2023-10-06T01:21:09.012 INFO:teuthology.orchestra.run.smithi155.stdout: key = AQDtYB9lW1ouNBAAFsxCFJ33SEJ2wD+LjheR1A== 2023-10-06T01:21:09.012 INFO:teuthology.orchestra.run.smithi155.stdout:[osd.3] 2023-10-06T01:21:09.012 INFO:teuthology.orchestra.run.smithi155.stdout: key = AQDwYB9lnAXNNxAA9hW5oDzBQRnW/EHS7qU6Eg== 2023-10-06T01:21:09.012 INFO:teuthology.orchestra.run.smithi155.stdout:[mgr.x] 2023-10-06T01:21:09.012 INFO:teuthology.orchestra.run.smithi155.stdout: key = AQDlYB9lOr69ChAAvDbezvRT4bWhgdQsKkDe2g== 2023-10-06T01:21:09.012 INFO:teuthology.orchestra.run.smithi155.stdout:[mds.b] 2023-10-06T01:21:09.012 INFO:teuthology.orchestra.run.smithi155.stdout: key = AQDlYB9l81CaJxAAmSJ2iq7sgKOm6aQkweRUmw== 2023-10-06T01:21:09.012 INFO:teuthology.orchestra.run.smithi155.stdout:[mds.d] 2023-10-06T01:21:09.012 INFO:teuthology.orchestra.run.smithi155.stdout: key = AQDlYB9lpaoGMhAA1smpLPyNHMFd8KB11WuEVw== 2023-10-06T01:21:09.013 INFO:teuthology.orchestra.run.smithi155.stdout:[osd.4] 2023-10-06T01:21:09.013 INFO:teuthology.orchestra.run.smithi155.stdout: key = AQD3YB9lTV3LDBAA37KXA7yKc0LBZzMK3u6Myw== 2023-10-06T01:21:09.013 INFO:teuthology.orchestra.run.smithi155.stdout:[osd.5] 2023-10-06T01:21:09.013 INFO:teuthology.orchestra.run.smithi155.stdout: key = AQD6YB9lITBlEhAAFaNVu44B1CEWcPazSF071g== 2023-10-06T01:21:09.013 INFO:teuthology.orchestra.run.smithi155.stdout:[osd.6] 2023-10-06T01:21:09.013 INFO:teuthology.orchestra.run.smithi155.stdout: key = AQD9YB9lFqG3FBAAnzOc0e//w1hE2Qg+S3Z4Ew== 2023-10-06T01:21:09.013 INFO:teuthology.orchestra.run.smithi155.stdout:[osd.7] 2023-10-06T01:21:09.013 INFO:teuthology.orchestra.run.smithi155.stdout: key = AQAAYR9lY5wzFxAAXt+cjEmGy77K89tTEamVrA== 2023-10-06T01:21:09.013 INFO:teuthology.orchestra.run.smithi155.stdout:[client.0] 2023-10-06T01:21:09.013 INFO:teuthology.orchestra.run.smithi155.stdout: key = AQDlYB9l+CUhOxAAIGNbzfc234/z9JKUyQ2WxA== 2023-10-06T01:21:09.013 INFO:teuthology.orchestra.run.smithi155.stdout:[client.2] 2023-10-06T01:21:09.014 INFO:teuthology.orchestra.run.smithi155.stdout: key = AQDmYB9laX1zBhAAqB5vZ65xv4Gw7nUDBK6z/w== 2023-10-06T01:21:09.014 INFO:teuthology.orchestra.run.smithi155.stdout:[client.1] 2023-10-06T01:21:09.014 INFO:teuthology.orchestra.run.smithi155.stdout: key = AQDmYB9l+5xRDRAALxAmTNAGNADrWoYVLH7/DA== 2023-10-06T01:21:09.014 INFO:teuthology.orchestra.run.smithi155.stdout:[client.3] 2023-10-06T01:21:09.014 INFO:teuthology.orchestra.run.smithi155.stdout: key = AQDmYB9lazulFRAAE410DH6LzPVx1hN7wkjoTA== 2023-10-06T01:21:09.015 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-10-06T01:21:09.023 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-10-06T01:21:09.150 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-10-06T01:21:09.155 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-10-06T01:21:09.253 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-10-06T01:21:09.257 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-10-06T01:21:09.355 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-06T01:21:09.360 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-06T01:21:09.456 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-06T01:21:09.461 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-06T01:21:09.555 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-06T01:21:09.559 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-06T01:21:09.654 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-06T01:21:09.659 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-06T01:21:09.753 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-10-06T01:21:09.758 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-10-06T01:21:09.852 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-10-06T01:21:09.856 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-10-06T01:21:09.954 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-10-06T01:21:09.959 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-10-06T01:21:10.058 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-06T01:21:10.062 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-06T01:21:10.157 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-06T01:21:10.161 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-06T01:21:10.256 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-06T01:21:10.261 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-06T01:21:10.355 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-06T01:21:10.360 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-06T01:21:10.454 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-10-06T01:21:10.458 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-10-06T01:21:10.556 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-10-06T01:21:10.560 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-10-06T01:21:10.657 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-10-06T01:21:10.661 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-10-06T01:21:10.759 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-10-06T01:21:10.763 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-10-06T01:21:10.860 INFO:tasks.ceph:Running mkfs on mon nodes... 2023-10-06T01:21:10.861 DEBUG:teuthology.orchestra.run.smithi050:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2023-10-06T01:21:10.923 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-10-06T01:21:11.034 DEBUG:teuthology.orchestra.run.smithi050:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2023-10-06T01:21:11.096 DEBUG:teuthology.orchestra.run.smithi155:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2023-10-06T01:21:11.158 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-10-06T01:21:11.276 DEBUG:teuthology.orchestra.run.smithi155:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2023-10-06T01:21:11.336 DEBUG:teuthology.orchestra.run.smithi155:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2023-10-06T01:21:11.397 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-10-06T01:21:11.503 DEBUG:teuthology.orchestra.run.smithi155:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2023-10-06T01:21:11.564 DEBUG:teuthology.orchestra.run.smithi050:> rm -- /home/ubuntu/cephtest/ceph.monmap 2023-10-06T01:21:11.569 DEBUG:teuthology.orchestra.run.smithi155:> rm -- /home/ubuntu/cephtest/ceph.monmap 2023-10-06T01:21:11.604 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2023-10-06T01:21:11.604 INFO:tasks.ceph.mon.a:Restarting daemon 2023-10-06T01:21:11.604 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2023-10-06T01:21:11.646 INFO:tasks.ceph.mon.a:Started 2023-10-06T01:21:11.646 INFO:tasks.ceph.mon.b:Restarting daemon 2023-10-06T01:21:11.646 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2023-10-06T01:21:11.651 INFO:tasks.ceph.mon.b:Started 2023-10-06T01:21:11.651 INFO:tasks.ceph.mon.c:Restarting daemon 2023-10-06T01:21:11.651 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2023-10-06T01:21:11.655 INFO:tasks.ceph.mon.c:Started 2023-10-06T01:21:11.655 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2023-10-06T01:21:11.655 INFO:tasks.ceph.mgr.y:Restarting daemon 2023-10-06T01:21:11.655 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2023-10-06T01:21:11.660 INFO:tasks.ceph.mgr.y:Started 2023-10-06T01:21:11.660 INFO:tasks.ceph.mgr.x:Restarting daemon 2023-10-06T01:21:11.660 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2023-10-06T01:21:11.664 INFO:tasks.ceph.mgr.x:Started 2023-10-06T01:21:11.664 INFO:tasks.ceph:Setting crush tunables to default 2023-10-06T01:21:11.664 DEBUG:teuthology.orchestra.run.smithi050:> sudo ceph --cluster ceph osd crush tunables default 2023-10-06T01:21:11.853 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:11.852+0000 7f8455d9d700 1 Processor -- start 2023-10-06T01:21:11.853 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:11.852+0000 7f8455d9d700 1 -- start start 2023-10-06T01:21:11.854 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:11.853+0000 7f8455d9d700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f84500b2660 0x7f84500cccf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:21:11.854 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:11.853+0000 7f8455d9d700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f84500b2a30 0x7f84500cd230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:21:11.854 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:11.853+0000 7f8455d9d700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f84500cc9b0 con 0x7f84500ceae0 2023-10-06T01:21:11.854 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:11.853+0000 7f8455d9d700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f84500cbda0 con 0x7f84500b2a30 2023-10-06T01:21:11.855 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:11.853+0000 7f8455d9d700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84500cc080 con 0x7f84500b2660 2023-10-06T01:21:11.855 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:11.854+0000 7f844ffff700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f84500b2a30 0x7f84500cd230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:21:11.856 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:11.854+0000 7f8454d9b700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f84500b2660 0x7f84500cccf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:21:11.856 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:11.854+0000 7f8454d9b700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f84500b2660 0x7f84500cccf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3301/0 says I am v2:172.21.15.50:59550/0 (socket says 172.21.15.50:59550) 2023-10-06T01:21:11.856 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:11.854+0000 7f8454d9b700 1 -- 172.21.15.50:0/2617668273 learned_addr learned my addr 172.21.15.50:0/2617668273 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-06T01:21:11.856 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:11.854+0000 7f844ffff700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f84500b2a30 0x7f84500cd230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.50:44592/0 (socket says 172.21.15.50:44592) 2023-10-06T01:21:11.856 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:11.854+0000 7f8454d9b700 1 -- 172.21.15.50:0/2617668273 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f84500b2660 msgr2=0x7f84500cccf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-10-06T01:21:11.856 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:11.854+0000 7f8454d9b700 1 -- 172.21.15.50:0/2617668273 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f84500b2660 msgr2=0x7f84500cccf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-10-06T01:21:11.856 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:11.854+0000 7f8454d9b700 1 --2- 172.21.15.50:0/2617668273 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f84500b2660 0x7f84500cccf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2023-10-06T01:21:11.856 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:11.854+0000 7f844ffff700 1 -- 172.21.15.50:0/2617668273 >> v2:172.21.15.155:3300/0 conn(0x7f84500b2a30 msgr2=0x7f84500cd230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-10-06T01:21:11.856 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:11.854+0000 7f8454d9b700 1 --2- 172.21.15.50:0/2617668273 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f84500b2660 0x7f84500cccf0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-06T01:21:11.856 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:11.854+0000 7f844ffff700 1 -- 172.21.15.50:0/2617668273 >> v2:172.21.15.155:3300/0 conn(0x7f84500b2a30 msgr2=0x7f84500cd230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-10-06T01:21:11.856 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:11.854+0000 7f844ffff700 1 --2- 172.21.15.50:0/2617668273 >> v2:172.21.15.155:3300/0 conn(0x7f84500b2a30 0x7f84500cd230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2023-10-06T01:21:11.857 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:11.854+0000 7f844ffff700 1 --2- 172.21.15.50:0/2617668273 >> v2:172.21.15.155:3300/0 conn(0x7f84500b2a30 0x7f84500cd230 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-06T01:21:12.057 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:12.055+0000 7f8454d9b700 1 --2- 172.21.15.50:0/2617668273 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f84500b2660 0x7f84500cccf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:21:12.057 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:12.055+0000 7f844ffff700 1 --2- 172.21.15.50:0/2617668273 >> v2:172.21.15.155:3300/0 conn(0x7f84500b2a30 0x7f84500cd230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:21:12.057 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:12.055+0000 7f8454d9b700 1 -- 172.21.15.50:0/2617668273 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f84500b2660 msgr2=0x7f84500cccf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-10-06T01:21:12.057 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:12.055+0000 7f8454d9b700 1 -- 172.21.15.50:0/2617668273 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f84500b2660 msgr2=0x7f84500cccf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-10-06T01:21:12.057 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:12.055+0000 7f8454d9b700 1 --2- 172.21.15.50:0/2617668273 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f84500b2660 0x7f84500cccf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2023-10-06T01:21:12.057 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:12.055+0000 7f844ffff700 1 -- 172.21.15.50:0/2617668273 >> v2:172.21.15.155:3300/0 conn(0x7f84500b2a30 msgr2=0x7f84500cd230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-10-06T01:21:12.057 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:12.055+0000 7f844ffff700 1 -- 172.21.15.50:0/2617668273 >> v2:172.21.15.155:3300/0 conn(0x7f84500b2a30 msgr2=0x7f84500cd230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-10-06T01:21:12.058 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:12.055+0000 7f8454d9b700 1 --2- 172.21.15.50:0/2617668273 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f84500b2660 0x7f84500cccf0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-06T01:21:12.058 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:12.055+0000 7f844ffff700 1 --2- 172.21.15.50:0/2617668273 >> v2:172.21.15.155:3300/0 conn(0x7f84500b2a30 0x7f84500cd230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2023-10-06T01:21:12.058 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:12.055+0000 7f844ffff700 1 --2- 172.21.15.50:0/2617668273 >> v2:172.21.15.155:3300/0 conn(0x7f84500b2a30 0x7f84500cd230 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-06T01:21:12.458 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:12.457+0000 7f844ffff700 1 --2- 172.21.15.50:0/2617668273 >> v2:172.21.15.155:3300/0 conn(0x7f84500b2a30 0x7f84500cd230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:21:12.458 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:12.457+0000 7f8454d9b700 1 --2- 172.21.15.50:0/2617668273 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f84500b2660 0x7f84500cccf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:21:12.458 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:12.457+0000 7f8454d9b700 1 -- 172.21.15.50:0/2617668273 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f84500b2660 msgr2=0x7f84500cccf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-10-06T01:21:12.458 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:12.457+0000 7f8454d9b700 1 -- 172.21.15.50:0/2617668273 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f84500b2660 msgr2=0x7f84500cccf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-10-06T01:21:12.458 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:12.457+0000 7f844ffff700 1 -- 172.21.15.50:0/2617668273 >> v2:172.21.15.155:3300/0 conn(0x7f84500b2a30 msgr2=0x7f84500cd230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-10-06T01:21:12.458 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:12.457+0000 7f844ffff700 1 -- 172.21.15.50:0/2617668273 >> v2:172.21.15.155:3300/0 conn(0x7f84500b2a30 msgr2=0x7f84500cd230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-10-06T01:21:12.458 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:12.457+0000 7f8454d9b700 1 --2- 172.21.15.50:0/2617668273 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f84500b2660 0x7f84500cccf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2023-10-06T01:21:12.458 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:12.457+0000 7f844ffff700 1 --2- 172.21.15.50:0/2617668273 >> v2:172.21.15.155:3300/0 conn(0x7f84500b2a30 0x7f84500cd230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2023-10-06T01:21:12.458 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:12.457+0000 7f8454d9b700 1 --2- 172.21.15.50:0/2617668273 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f84500b2660 0x7f84500cccf0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-10-06T01:21:12.459 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:12.457+0000 7f844ffff700 1 --2- 172.21.15.50:0/2617668273 >> v2:172.21.15.155:3300/0 conn(0x7f84500b2a30 0x7f84500cd230 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-10-06T01:21:13.259 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:13.258+0000 7f844ffff700 1 --2- 172.21.15.50:0/2617668273 >> v2:172.21.15.155:3300/0 conn(0x7f84500b2a30 0x7f84500cd230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:21:13.260 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:13.258+0000 7f8454d9b700 1 --2- 172.21.15.50:0/2617668273 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f84500b2660 0x7f84500cccf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:21:13.260 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:13.258+0000 7f8454d9b700 1 -- 172.21.15.50:0/2617668273 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f84500b2660 msgr2=0x7f84500cccf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-10-06T01:21:13.260 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:13.258+0000 7f8454d9b700 1 -- 172.21.15.50:0/2617668273 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f84500b2660 msgr2=0x7f84500cccf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-10-06T01:21:13.260 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:13.258+0000 7f844ffff700 1 -- 172.21.15.50:0/2617668273 >> v2:172.21.15.155:3300/0 conn(0x7f84500b2a30 msgr2=0x7f84500cd230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-10-06T01:21:13.260 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:13.258+0000 7f844ffff700 1 -- 172.21.15.50:0/2617668273 >> v2:172.21.15.155:3300/0 conn(0x7f84500b2a30 msgr2=0x7f84500cd230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-10-06T01:21:13.260 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:13.258+0000 7f8454d9b700 1 --2- 172.21.15.50:0/2617668273 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f84500b2660 0x7f84500cccf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2023-10-06T01:21:13.260 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:13.258+0000 7f844ffff700 1 --2- 172.21.15.50:0/2617668273 >> v2:172.21.15.155:3300/0 conn(0x7f84500b2a30 0x7f84500cd230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2023-10-06T01:21:13.260 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:13.258+0000 7f8454d9b700 1 --2- 172.21.15.50:0/2617668273 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f84500b2660 0x7f84500cccf0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-10-06T01:21:13.260 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:13.258+0000 7f844ffff700 1 --2- 172.21.15.50:0/2617668273 >> v2:172.21.15.155:3300/0 conn(0x7f84500b2a30 0x7f84500cd230 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-10-06T01:21:14.855 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:14.854+0000 7f844e7fc700 1 -- 172.21.15.50:0/2617668273 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f84500b2660 msgr2=0x7f84500cccf0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-06T01:21:14.855 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:14.854+0000 7f844e7fc700 1 --2- 172.21.15.50:0/2617668273 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f84500b2660 0x7f84500cccf0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:21:14.856 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:14.854+0000 7f844e7fc700 1 -- 172.21.15.50:0/2617668273 >> v2:172.21.15.155:3300/0 conn(0x7f84500b2a30 msgr2=0x7f84500cd230 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-06T01:21:14.856 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:14.854+0000 7f844e7fc700 1 --2- 172.21.15.50:0/2617668273 >> v2:172.21.15.155:3300/0 conn(0x7f84500b2a30 0x7f84500cd230 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:21:14.856 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:14.854+0000 7f844e7fc700 1 -- 172.21.15.50:0/2617668273 >> v1:172.21.15.155:6789/0 conn(0x7f84500ceae0 legacy=0x7f84500cef80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:21:14.856 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:14.854+0000 7f844e7fc700 1 --2- 172.21.15.50:0/2617668273 >> v2:172.21.15.50:3300/0 conn(0x7f8434007390 0x7f8434009840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:21:14.856 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:14.854+0000 7f844e7fc700 1 -- 172.21.15.50:0/2617668273 --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f84500cc360 con 0x7f8434003710 2023-10-06T01:21:14.856 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:14.854+0000 7f844e7fc700 1 -- 172.21.15.50:0/2617668273 --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f84500cbda0 con 0x7f8434007390 2023-10-06T01:21:14.856 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:14.854+0000 7f844ffff700 1 --2- 172.21.15.50:0/2617668273 >> v2:172.21.15.50:3300/0 conn(0x7f8434007390 0x7f8434009840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:21:14.856 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:14.854+0000 7f844ffff700 1 -- 172.21.15.50:0/2617668273 >> v2:172.21.15.50:3300/0 conn(0x7f8434007390 msgr2=0x7f8434009840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-10-06T01:21:14.856 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:14.854+0000 7f844ffff700 1 -- 172.21.15.50:0/2617668273 >> v2:172.21.15.50:3300/0 conn(0x7f8434007390 msgr2=0x7f8434009840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-10-06T01:21:14.856 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:14.854+0000 7f844ffff700 1 --2- 172.21.15.50:0/2617668273 >> v2:172.21.15.50:3300/0 conn(0x7f8434007390 0x7f8434009840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2023-10-06T01:21:14.856 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:14.855+0000 7f844ffff700 1 --2- 172.21.15.50:0/2617668273 >> v2:172.21.15.50:3300/0 conn(0x7f8434007390 0x7f8434009840 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-06T01:21:15.058 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:15.056+0000 7f844ffff700 1 --2- 172.21.15.50:0/2617668273 >> v2:172.21.15.50:3300/0 conn(0x7f8434007390 0x7f8434009840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:21:15.058 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:15.056+0000 7f844ffff700 1 -- 172.21.15.50:0/2617668273 >> v2:172.21.15.50:3300/0 conn(0x7f8434007390 msgr2=0x7f8434009840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-10-06T01:21:15.058 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:15.056+0000 7f844ffff700 1 -- 172.21.15.50:0/2617668273 >> v2:172.21.15.50:3300/0 conn(0x7f8434007390 msgr2=0x7f8434009840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-10-06T01:21:15.058 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:15.056+0000 7f844ffff700 1 --2- 172.21.15.50:0/2617668273 >> v2:172.21.15.50:3300/0 conn(0x7f8434007390 0x7f8434009840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2023-10-06T01:21:15.058 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:15.056+0000 7f844ffff700 1 --2- 172.21.15.50:0/2617668273 >> v2:172.21.15.50:3300/0 conn(0x7f8434007390 0x7f8434009840 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-06T01:21:15.458 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:15.457+0000 7f844ffff700 1 --2- 172.21.15.50:0/2617668273 >> v2:172.21.15.50:3300/0 conn(0x7f8434007390 0x7f8434009840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:21:15.458 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:15.457+0000 7f844ffff700 1 -- 172.21.15.50:0/2617668273 >> v2:172.21.15.50:3300/0 conn(0x7f8434007390 msgr2=0x7f8434009840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-10-06T01:21:15.458 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:15.457+0000 7f844ffff700 1 -- 172.21.15.50:0/2617668273 >> v2:172.21.15.50:3300/0 conn(0x7f8434007390 msgr2=0x7f8434009840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-10-06T01:21:15.458 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:15.457+0000 7f844ffff700 1 --2- 172.21.15.50:0/2617668273 >> v2:172.21.15.50:3300/0 conn(0x7f8434007390 0x7f8434009840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2023-10-06T01:21:15.458 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:15.457+0000 7f844ffff700 1 --2- 172.21.15.50:0/2617668273 >> v2:172.21.15.50:3300/0 conn(0x7f8434007390 0x7f8434009840 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-10-06T01:21:16.259 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:16.258+0000 7f844ffff700 1 --2- 172.21.15.50:0/2617668273 >> v2:172.21.15.50:3300/0 conn(0x7f8434007390 0x7f8434009840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:21:16.259 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:16.258+0000 7f844ffff700 1 -- 172.21.15.50:0/2617668273 >> v2:172.21.15.50:3300/0 conn(0x7f8434007390 msgr2=0x7f8434009840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-10-06T01:21:16.259 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:16.258+0000 7f844ffff700 1 -- 172.21.15.50:0/2617668273 >> v2:172.21.15.50:3300/0 conn(0x7f8434007390 msgr2=0x7f8434009840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-10-06T01:21:16.259 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:16.258+0000 7f844ffff700 1 --2- 172.21.15.50:0/2617668273 >> v2:172.21.15.50:3300/0 conn(0x7f8434007390 0x7f8434009840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2023-10-06T01:21:16.259 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:16.258+0000 7f844ffff700 1 --2- 172.21.15.50:0/2617668273 >> v2:172.21.15.50:3300/0 conn(0x7f8434007390 0x7f8434009840 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-10-06T01:21:16.857 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:16.855+0000 7f844f7fe700 1 -- 172.21.15.50:0/2617668273 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3449027655 0 0) 0x7f84500cc360 con 0x7f8434003710 2023-10-06T01:21:16.857 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:16.855+0000 7f844f7fe700 1 -- 172.21.15.50:0/2617668273 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8440003570 con 0x7f8434003710 2023-10-06T01:21:16.857 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:16.855+0000 7f844f7fe700 1 -- 172.21.15.50:0/2617668273 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4238849074 0 0) 0x7f8440003570 con 0x7f8434003710 2023-10-06T01:21:16.858 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:16.855+0000 7f844f7fe700 1 -- 172.21.15.50:0/2617668273 >> v2:172.21.15.50:3300/0 conn(0x7f8434007390 msgr2=0x7f8434009840 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-06T01:21:16.858 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:16.855+0000 7f844f7fe700 1 --2- 172.21.15.50:0/2617668273 >> v2:172.21.15.50:3300/0 conn(0x7f8434007390 0x7f8434009840 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:21:16.858 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:16.855+0000 7f844f7fe700 1 -- 172.21.15.50:0/2617668273 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f843400af40 con 0x7f8434003710 2023-10-06T01:21:16.858 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:16.855+0000 7f844f7fe700 1 -- 172.21.15.50:0/2617668273 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 347519148 0 0) 0x7f844400c340 con 0x7f8434003710 2023-10-06T01:21:16.858 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:16.855+0000 7f844f7fe700 1 -- 172.21.15.50:0/2617668273 >> v1:172.21.15.50:6789/0 conn(0x7f8434003710 legacy=0x7f8434005b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:21:16.858 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:16.855+0000 7f845559c700 1 -- 172.21.15.50:0/2617668273 reap_dead start 2023-10-06T01:21:16.858 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:16.855+0000 7f844f7fe700 1 --2- 172.21.15.50:0/2617668273 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8440003ab0 0x7f8440003ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:21:16.858 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:16.855+0000 7f844f7fe700 1 --2- 172.21.15.50:0/2617668273 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f84500b2660 0x7f8440004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:21:16.858 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:16.855+0000 7f844f7fe700 1 --2- 172.21.15.50:0/2617668273 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8440004e70 0x7f84400052e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:21:16.858 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:16.855+0000 7f844f7fe700 1 -- 172.21.15.50:0/2617668273 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84500cbda0 con 0x7f8440003ab0 2023-10-06T01:21:16.858 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:16.855+0000 7f844f7fe700 1 -- 172.21.15.50:0/2617668273 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f844000bd00 con 0x7f8440004e70 2023-10-06T01:21:16.859 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:16.855+0000 7f844f7fe700 1 -- 172.21.15.50:0/2617668273 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f844000bec0 con 0x7f84500b2660 2023-10-06T01:21:16.860 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:16.856+0000 7f845559c700 1 --2- 172.21.15.50:0/2617668273 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8440004e70 0x7f84400052e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:21:16.860 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:16.856+0000 7f844ffff700 1 --2- 172.21.15.50:0/2617668273 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f84500b2660 0x7f8440004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:21:16.860 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:16.856+0000 7f8454d9b700 1 --2- 172.21.15.50:0/2617668273 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8440003ab0 0x7f8440003ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:21:16.860 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:16.857+0000 7f845559c700 1 -- 172.21.15.50:0/2617668273 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f84500b2660 msgr2=0x7f8440004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:21:16.860 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:16.857+0000 7f845559c700 1 --2- 172.21.15.50:0/2617668273 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f84500b2660 0x7f8440004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:21:16.860 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:16.857+0000 7f845559c700 1 -- 172.21.15.50:0/2617668273 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8440003ab0 msgr2=0x7f8440003ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:21:16.860 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:16.857+0000 7f845559c700 1 --2- 172.21.15.50:0/2617668273 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8440003ab0 0x7f8440003ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:21:16.860 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:16.857+0000 7f845559c700 1 -- 172.21.15.50:0/2617668273 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8440003570 con 0x7f8440004e70 2023-10-06T01:21:16.860 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:16.857+0000 7f844ffff700 1 --2- 172.21.15.50:0/2617668273 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f84500b2660 0x7f8440004810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T01:21:16.860 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:16.857+0000 7f845559c700 1 --2- 172.21.15.50:0/2617668273 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8440004e70 0x7f84400052e0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f84500893f0 tx=0x7f8448007f70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=19f76b369d627f30 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:21:16.861 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:16.858+0000 7f844f7fe700 1 -- 172.21.15.50:0/2617668273 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8448005b90 con 0x7f8440004e70 2023-10-06T01:21:16.861 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:16.858+0000 7f844f7fe700 1 -- 172.21.15.50:0/2617668273 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8448005d10 con 0x7f8440004e70 2023-10-06T01:21:16.861 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:16.858+0000 7f844f7fe700 1 -- 172.21.15.50:0/2617668273 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8448007320 con 0x7f8440004e70 2023-10-06T01:21:16.862 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:16.859+0000 7f8455d9d700 1 -- 172.21.15.50:0/2617668273 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8440004e70 msgr2=0x7f84400052e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:21:16.862 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:16.859+0000 7f8455d9d700 1 --2- 172.21.15.50:0/2617668273 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8440004e70 0x7f84400052e0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f84500893f0 tx=0x7f8448007f70 comp rx=0 tx=0).stop 2023-10-06T01:21:16.862 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:16.859+0000 7f8455d9d700 1 -- 172.21.15.50:0/2617668273 shutdown_connections 2023-10-06T01:21:16.862 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:16.859+0000 7f8455d9d700 1 --2- 172.21.15.50:0/2617668273 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8440004e70 0x7f84400052e0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:21:16.862 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:16.859+0000 7f8455d9d700 1 --2- 172.21.15.50:0/2617668273 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f84500b2660 0x7f8440004810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:21:16.862 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:16.859+0000 7f8455d9d700 1 --2- 172.21.15.50:0/2617668273 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8440003ab0 0x7f8440003ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:21:16.862 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:16.859+0000 7f8455d9d700 1 -- 172.21.15.50:0/2617668273 >> 172.21.15.50:0/2617668273 conn(0x7f8450099560 msgr2=0x7f845006f500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:21:16.862 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:16.859+0000 7f8455d9d700 1 -- 172.21.15.50:0/2617668273 shutdown_connections 2023-10-06T01:21:16.862 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:16.859+0000 7f8455d9d700 1 -- 172.21.15.50:0/2617668273 wait complete. 2023-10-06T01:21:16.863 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:16.860+0000 7f8455d9d700 1 Processor -- start 2023-10-06T01:21:16.863 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:16.861+0000 7f8455d9d700 1 -- start start 2023-10-06T01:21:16.864 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:16.862+0000 7f8455d9d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8440003ab0 0x7f84500b42c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:21:16.865 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:16.862+0000 7f8455d9d700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8440004e70 0x7f8450169720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:21:16.865 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:16.862+0000 7f8455d9d700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f84500b2660 0x7f8450169c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:21:16.865 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:16.862+0000 7f8455d9d700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84500b4d30 con 0x7f8440003ab0 2023-10-06T01:21:16.865 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:16.862+0000 7f8455d9d700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84500b5010 con 0x7f8440004e70 2023-10-06T01:21:16.865 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:16.863+0000 7f8455d9d700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84500b52f0 con 0x7f84500b2660 2023-10-06T01:21:16.865 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:16.863+0000 7f8454d9b700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8440003ab0 0x7f84500b42c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:21:16.865 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:16.863+0000 7f8454d9b700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8440003ab0 0x7f84500b42c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:59382/0 (socket says 172.21.15.50:59382) 2023-10-06T01:21:16.865 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:16.863+0000 7f8454d9b700 1 -- 172.21.15.50:0/1043250496 learned_addr learned my addr 172.21.15.50:0/1043250496 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-06T01:21:16.865 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:16.863+0000 7f844ffff700 1 --2- 172.21.15.50:0/1043250496 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8440004e70 0x7f8450169720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:21:16.865 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:16.863+0000 7f845559c700 1 --2- 172.21.15.50:0/1043250496 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f84500b2660 0x7f8450169c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:21:16.867 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:16.863+0000 7f8454d9b700 1 -- 172.21.15.50:0/1043250496 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f84500b2660 msgr2=0x7f8450169c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:21:16.867 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:16.863+0000 7f8454d9b700 1 --2- 172.21.15.50:0/1043250496 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f84500b2660 0x7f8450169c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:21:16.867 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:16.863+0000 7f8454d9b700 1 -- 172.21.15.50:0/1043250496 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8440004e70 msgr2=0x7f8450169720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:21:16.867 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:16.863+0000 7f8454d9b700 1 --2- 172.21.15.50:0/1043250496 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8440004e70 0x7f8450169720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:21:16.867 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:16.863+0000 7f8454d9b700 1 -- 172.21.15.50:0/1043250496 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84500b55d0 con 0x7f8440003ab0 2023-10-06T01:21:16.867 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:16.863+0000 7f845559c700 1 --2- 172.21.15.50:0/1043250496 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f84500b2660 0x7f8450169c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T01:21:16.867 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:16.864+0000 7f8454d9b700 1 --2- 172.21.15.50:0/1043250496 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8440003ab0 0x7f84500b42c0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f8444006dc0 tx=0x7f8444008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:21:16.868 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:16.864+0000 7f844cff9700 1 -- 172.21.15.50:0/1043250496 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8444016ee0 con 0x7f8440003ab0 2023-10-06T01:21:16.868 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:16.864+0000 7f844cff9700 1 -- 172.21.15.50:0/1043250496 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f844400c040 con 0x7f8440003ab0 2023-10-06T01:21:16.868 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:16.864+0000 7f8455d9d700 1 -- 172.21.15.50:0/1043250496 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f84500b58b0 con 0x7f8440003ab0 2023-10-06T01:21:16.868 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:16.864+0000 7f844cff9700 1 -- 172.21.15.50:0/1043250496 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8444018450 con 0x7f8440003ab0 2023-10-06T01:21:16.868 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:16.864+0000 7f8455d9d700 1 -- 172.21.15.50:0/1043250496 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f84500b4a40 con 0x7f8440003ab0 2023-10-06T01:21:16.868 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:16.864+0000 7f844cff9700 1 -- 172.21.15.50:0/1043250496 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7f8444018ac0 con 0x7f8440003ab0 2023-10-06T01:21:16.868 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:16.865+0000 7f844cff9700 1 -- 172.21.15.50:0/1043250496 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7f844402cc10 con 0x7f8440003ab0 2023-10-06T01:21:16.868 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:16.865+0000 7f8455d9d700 1 -- 172.21.15.50:0/1043250496 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f84500b5ad0 con 0x7f8440003ab0 2023-10-06T01:21:16.870 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:16.869+0000 7f844cff9700 1 -- 172.21.15.50:0/1043250496 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7f8444027070 con 0x7f8440003ab0 2023-10-06T01:21:16.954 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:16.952+0000 7f8455d9d700 1 -- 172.21.15.50:0/1043250496 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) v1 -- 0x7f845005f270 con 0x7f8440003ab0 2023-10-06T01:21:16.957 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:16.955+0000 7f844cff9700 1 -- 172.21.15.50:0/1043250496 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) v1 ==== 124+0+0 (secure 0 0 0) 0x7f844400f040 con 0x7f8440003ab0 2023-10-06T01:21:16.959 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:16.957+0000 7f8455d9d700 1 -- 172.21.15.50:0/1043250496 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8440003ab0 msgr2=0x7f84500b42c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:21:16.959 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:16.957+0000 7f8455d9d700 1 --2- 172.21.15.50:0/1043250496 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8440003ab0 0x7f84500b42c0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f8444006dc0 tx=0x7f8444008040 comp rx=0 tx=0).stop 2023-10-06T01:21:16.959 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:16.957+0000 7f8455d9d700 1 -- 172.21.15.50:0/1043250496 shutdown_connections 2023-10-06T01:21:16.959 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:16.957+0000 7f8455d9d700 1 --2- 172.21.15.50:0/1043250496 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f84500b2660 0x7f8450169c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:21:16.959 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:16.957+0000 7f8455d9d700 1 --2- 172.21.15.50:0/1043250496 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8440003ab0 0x7f84500b42c0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:21:16.959 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:16.957+0000 7f8455d9d700 1 --2- 172.21.15.50:0/1043250496 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8440004e70 0x7f8450169720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:21:16.959 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:16.957+0000 7f8455d9d700 1 -- 172.21.15.50:0/1043250496 >> 172.21.15.50:0/1043250496 conn(0x7f8450099560 msgr2=0x7f84500c51e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:21:16.959 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:16.957+0000 7f8455d9d700 1 -- 172.21.15.50:0/1043250496 shutdown_connections 2023-10-06T01:21:16.960 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:16.957+0000 7f8455d9d700 1 -- 172.21.15.50:0/1043250496 wait complete. 2023-10-06T01:21:16.960 INFO:teuthology.orchestra.run.smithi050.stderr:adjusted tunables profile to default 2023-10-06T01:21:16.976 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2023-10-06T01:21:16.977 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2023-10-06T01:21:16.977 DEBUG:teuthology.orchestra.run.smithi050:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2023-10-06T01:21:17.039 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2023-10-06T01:21:17.039 DEBUG:teuthology.orchestra.run.smithi050:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2023-10-06T01:21:17.142 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2023-10-06T01:21:17.142 DEBUG:teuthology.orchestra.run.smithi050:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2023-10-06T01:21:17.245 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2023-10-06T01:21:17.245 DEBUG:teuthology.orchestra.run.smithi050:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2023-10-06T01:21:17.347 DEBUG:teuthology.orchestra.run.smithi155:> set -ex 2023-10-06T01:21:17.347 DEBUG:teuthology.orchestra.run.smithi155:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2023-10-06T01:21:17.409 DEBUG:teuthology.orchestra.run.smithi155:> set -ex 2023-10-06T01:21:17.410 DEBUG:teuthology.orchestra.run.smithi155:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2023-10-06T01:21:17.510 DEBUG:teuthology.orchestra.run.smithi155:> set -ex 2023-10-06T01:21:17.510 DEBUG:teuthology.orchestra.run.smithi155:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2023-10-06T01:21:17.612 DEBUG:teuthology.orchestra.run.smithi155:> set -ex 2023-10-06T01:21:17.612 DEBUG:teuthology.orchestra.run.smithi155:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2023-10-06T01:21:17.713 DEBUG:teuthology.orchestra.run.smithi155:> sudo ceph --cluster ceph osd new 9060727a-3959-4de3-8363-c5c5d7826c9a 0 2023-10-06T01:21:17.934 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-06T01:21:17.932+0000 7fabedf9d700 1 Processor -- start 2023-10-06T01:21:17.934 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-06T01:21:17.932+0000 7fabedf9d700 1 -- start start 2023-10-06T01:21:17.936 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-06T01:21:17.933+0000 7fabedf9d700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fabe81539d0 0x7fabe815a3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:21:17.936 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-06T01:21:17.933+0000 7fabedf9d700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fabe80d0a00 0x7fabe80ce8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:21:17.936 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-06T01:21:17.934+0000 7fabedf9d700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fabe80cdc30 con 0x7fabe80ccab0 2023-10-06T01:21:17.936 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-06T01:21:17.934+0000 7fabedf9d700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fabe80cb500 con 0x7fabe80d0a00 2023-10-06T01:21:17.936 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-06T01:21:17.934+0000 7fabedf9d700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fabe815a8f0 con 0x7fabe81539d0 2023-10-06T01:21:17.936 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-06T01:21:17.934+0000 7fabecf9b700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fabe81539d0 0x7fabe815a3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:21:17.936 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-06T01:21:17.934+0000 7fabecf9b700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fabe81539d0 0x7fabe815a3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:46148/0 (socket says 172.21.15.155:46148) 2023-10-06T01:21:17.937 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-06T01:21:17.934+0000 7fabecf9b700 1 -- 172.21.15.155:0/569729730 learned_addr learned my addr 172.21.15.155:0/569729730 (peer_addr_for_me v2:172.21.15.155:0/0) 2023-10-06T01:21:17.937 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-06T01:21:17.934+0000 7fabed79c700 1 --2- 172.21.15.155:0/569729730 >> v2:172.21.15.50:3300/0 conn(0x7fabe80d0a00 0x7fabe80ce8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:21:17.937 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-06T01:21:17.934+0000 7fabecf9b700 1 -- 172.21.15.155:0/569729730 >> v2:172.21.15.50:3300/0 conn(0x7fabe80d0a00 msgr2=0x7fabe80ce8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:21:17.937 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-06T01:21:17.934+0000 7fabecf9b700 1 --2- 172.21.15.155:0/569729730 >> v2:172.21.15.50:3300/0 conn(0x7fabe80d0a00 0x7fabe80ce8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:21:17.937 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-06T01:21:17.934+0000 7fabecf9b700 1 -- 172.21.15.155:0/569729730 >> v1:172.21.15.50:6789/0 conn(0x7fabe80ccab0 legacy=0x7fabe80d02f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:21:17.937 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-06T01:21:17.934+0000 7fabecf9b700 1 -- 172.21.15.155:0/569729730 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fabe80cd020 con 0x7fabe81539d0 2023-10-06T01:21:17.937 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-06T01:21:17.935+0000 7fabecf9b700 1 --2- 172.21.15.155:0/569729730 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fabe81539d0 0x7fabe815a3b0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fabe80d02c0 tx=0x7fabdc009250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4a43876605cfa842 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:21:17.937 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-06T01:21:17.935+0000 7fabe77fe700 1 -- 172.21.15.155:0/569729730 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabdc009e70 con 0x7fabe81539d0 2023-10-06T01:21:17.937 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-06T01:21:17.935+0000 7fabe77fe700 1 -- 172.21.15.155:0/569729730 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fabdc00b860 con 0x7fabe81539d0 2023-10-06T01:21:17.937 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-06T01:21:17.935+0000 7fabe77fe700 1 -- 172.21.15.155:0/569729730 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabdc00bc00 con 0x7fabe81539d0 2023-10-06T01:21:17.938 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-06T01:21:17.935+0000 7fabedf9d700 1 -- 172.21.15.155:0/569729730 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fabe81539d0 msgr2=0x7fabe815a3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:21:17.938 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-06T01:21:17.935+0000 7fabedf9d700 1 --2- 172.21.15.155:0/569729730 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fabe81539d0 0x7fabe815a3b0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fabe80d02c0 tx=0x7fabdc009250 comp rx=0 tx=0).stop 2023-10-06T01:21:17.939 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-06T01:21:17.935+0000 7fabedf9d700 1 -- 172.21.15.155:0/569729730 shutdown_connections 2023-10-06T01:21:17.939 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-06T01:21:17.935+0000 7fabedf9d700 1 --2- 172.21.15.155:0/569729730 >> v2:172.21.15.50:3300/0 conn(0x7fabe80d0a00 0x7fabe80ce8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:21:17.939 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-06T01:21:17.935+0000 7fabedf9d700 1 --2- 172.21.15.155:0/569729730 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fabe81539d0 0x7fabe815a3b0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:21:17.939 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-06T01:21:17.936+0000 7fabedf9d700 1 -- 172.21.15.155:0/569729730 >> 172.21.15.155:0/569729730 conn(0x7fabe8068100 msgr2=0x7fabe80684d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:21:17.939 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-06T01:21:17.936+0000 7fabedf9d700 1 -- 172.21.15.155:0/569729730 shutdown_connections 2023-10-06T01:21:17.939 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-06T01:21:17.936+0000 7fabedf9d700 1 -- 172.21.15.155:0/569729730 wait complete. 2023-10-06T01:21:17.939 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-06T01:21:17.937+0000 7fabedf9d700 1 Processor -- start 2023-10-06T01:21:17.939 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-06T01:21:17.937+0000 7fabedf9d700 1 -- start start 2023-10-06T01:21:17.941 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-06T01:21:17.938+0000 7fabedf9d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fabe80ccab0 0x7fabe8150f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:21:17.941 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-06T01:21:17.938+0000 7fabedf9d700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fabe80d0a00 0x7fabe80b5c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:21:17.941 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-06T01:21:17.938+0000 7fabedf9d700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fabe81539d0 0x7fabe80b3a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:21:17.941 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-06T01:21:17.938+0000 7fabedf9d700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fabe8151440 con 0x7fabe80ccab0 2023-10-06T01:21:17.941 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-06T01:21:17.938+0000 7fabedf9d700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fabe80c7e20 con 0x7fabe80d0a00 2023-10-06T01:21:17.942 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-06T01:21:17.938+0000 7fabedf9d700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fabe80c83e0 con 0x7fabe81539d0 2023-10-06T01:21:17.942 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-06T01:21:17.938+0000 7fabe7fff700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fabe80d0a00 0x7fabe80b5c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:21:17.942 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-06T01:21:17.938+0000 7fabe7fff700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fabe80d0a00 0x7fabe80b5c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:46150/0 (socket says 172.21.15.155:46150) 2023-10-06T01:21:17.942 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-06T01:21:17.938+0000 7fabe7fff700 1 -- 172.21.15.155:0/4153068710 learned_addr learned my addr 172.21.15.155:0/4153068710 (peer_addr_for_me v2:172.21.15.155:0/0) 2023-10-06T01:21:17.942 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-06T01:21:17.938+0000 7fabed79c700 1 --2- 172.21.15.155:0/4153068710 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fabe81539d0 0x7fabe80b3a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:21:17.942 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-06T01:21:17.938+0000 7fabecf9b700 1 --2- 172.21.15.155:0/4153068710 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fabe80ccab0 0x7fabe8150f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:21:17.942 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-06T01:21:17.939+0000 7fabecf9b700 1 -- 172.21.15.155:0/4153068710 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fabe81539d0 msgr2=0x7fabe80b3a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:21:17.942 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-06T01:21:17.939+0000 7fabecf9b700 1 --2- 172.21.15.155:0/4153068710 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fabe81539d0 0x7fabe80b3a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:21:17.942 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-06T01:21:17.939+0000 7fabecf9b700 1 -- 172.21.15.155:0/4153068710 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fabe80d0a00 msgr2=0x7fabe80b5c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:21:17.942 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-06T01:21:17.939+0000 7fabecf9b700 1 --2- 172.21.15.155:0/4153068710 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fabe80d0a00 0x7fabe80b5c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:21:17.942 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-06T01:21:17.939+0000 7fabecf9b700 1 -- 172.21.15.155:0/4153068710 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fabdc0094f0 con 0x7fabe80ccab0 2023-10-06T01:21:17.942 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-06T01:21:17.939+0000 7fabe7fff700 1 --2- 172.21.15.155:0/4153068710 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fabe80d0a00 0x7fabe80b5c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T01:21:17.943 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-06T01:21:17.939+0000 7fabecf9b700 1 --2- 172.21.15.155:0/4153068710 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fabe80ccab0 0x7fabe8150f00 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fabe80d0290 tx=0x7fabdc017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:21:17.943 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-06T01:21:17.939+0000 7fabe4ff9700 1 -- 172.21.15.155:0/4153068710 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabdc00bbe0 con 0x7fabe80ccab0 2023-10-06T01:21:17.943 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-06T01:21:17.939+0000 7fabe4ff9700 1 -- 172.21.15.155:0/4153068710 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fabdc011420 con 0x7fabe80ccab0 2023-10-06T01:21:17.943 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-06T01:21:17.939+0000 7fabedf9d700 1 -- 172.21.15.155:0/4153068710 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fabe80b6160 con 0x7fabe80ccab0 2023-10-06T01:21:17.943 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-06T01:21:17.939+0000 7fabe4ff9700 1 -- 172.21.15.155:0/4153068710 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabdc0117a0 con 0x7fabe80ccab0 2023-10-06T01:21:17.943 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-06T01:21:17.939+0000 7fabedf9d700 1 -- 172.21.15.155:0/4153068710 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fabe80b20f0 con 0x7fabe80ccab0 2023-10-06T01:21:17.943 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-06T01:21:17.940+0000 7fabe4ff9700 1 -- 172.21.15.155:0/4153068710 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7fabdc02e450 con 0x7fabe80ccab0 2023-10-06T01:21:17.943 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-06T01:21:17.940+0000 7fabe4ff9700 1 -- 172.21.15.155:0/4153068710 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 721+0+0 (secure 0 0 0) 0x7fabdc025740 con 0x7fabe80ccab0 2023-10-06T01:21:17.943 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-06T01:21:17.941+0000 7fabedf9d700 1 -- 172.21.15.155:0/4153068710 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fabe805f270 con 0x7fabe80ccab0 2023-10-06T01:21:17.944 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-06T01:21:17.943+0000 7fabe4ff9700 1 -- 172.21.15.155:0/4153068710 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7fabdc015020 con 0x7fabe80ccab0 2023-10-06T01:21:18.051 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-06T01:21:18.050+0000 7fabedf9d700 1 -- 172.21.15.155:0/4153068710 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd new", "uuid": "9060727a-3959-4de3-8363-c5c5d7826c9a", "id": 0} v 0) v1 -- 0x7fabe80cd300 con 0x7fabe80ccab0 2023-10-06T01:21:18.054 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-06T01:21:18.053+0000 7fabe4ff9700 1 -- 172.21.15.155:0/4153068710 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "9060727a-3959-4de3-8363-c5c5d7826c9a", "id": 0}]=0 v3) v1 ==== 112+0+2 (secure 0 0 0) 0x7fabdc011e10 con 0x7fabe80ccab0 2023-10-06T01:21:18.055 INFO:teuthology.orchestra.run.smithi155.stdout:0 2023-10-06T01:21:18.056 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-06T01:21:18.054+0000 7fabedf9d700 1 -- 172.21.15.155:0/4153068710 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fabe80ccab0 msgr2=0x7fabe8150f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:21:18.056 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-06T01:21:18.054+0000 7fabedf9d700 1 --2- 172.21.15.155:0/4153068710 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fabe80ccab0 0x7fabe8150f00 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fabe80d0290 tx=0x7fabdc017000 comp rx=0 tx=0).stop 2023-10-06T01:21:18.056 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-06T01:21:18.054+0000 7fabedf9d700 1 -- 172.21.15.155:0/4153068710 shutdown_connections 2023-10-06T01:21:18.056 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-06T01:21:18.054+0000 7fabedf9d700 1 --2- 172.21.15.155:0/4153068710 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fabe81539d0 0x7fabe80b3a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:21:18.056 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-06T01:21:18.054+0000 7fabedf9d700 1 --2- 172.21.15.155:0/4153068710 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fabe80ccab0 0x7fabe8150f00 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:21:18.056 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-06T01:21:18.054+0000 7fabedf9d700 1 --2- 172.21.15.155:0/4153068710 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fabe80d0a00 0x7fabe80b5c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:21:18.056 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-06T01:21:18.054+0000 7fabedf9d700 1 -- 172.21.15.155:0/4153068710 >> 172.21.15.155:0/4153068710 conn(0x7fabe8068100 msgr2=0x7fabe8158130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:21:18.056 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-06T01:21:18.054+0000 7fabedf9d700 1 -- 172.21.15.155:0/4153068710 shutdown_connections 2023-10-06T01:21:18.057 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-06T01:21:18.054+0000 7fabedf9d700 1 -- 172.21.15.155:0/4153068710 wait complete. 2023-10-06T01:21:18.072 DEBUG:teuthology.orchestra.run.smithi155:> sudo ceph --cluster ceph osd new 5ad9ef12-b579-47ea-b690-90ba887e2cef 1 2023-10-06T01:21:18.250 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-06T01:21:18.249+0000 7f8b8d39d700 1 Processor -- start 2023-10-06T01:21:18.250 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-06T01:21:18.249+0000 7f8b8d39d700 1 -- start start 2023-10-06T01:21:18.252 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-06T01:21:18.250+0000 7f8b8d39d700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f8b880b2660 0x7f8b880cccf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:21:18.252 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-06T01:21:18.250+0000 7f8b8d39d700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8b880b2a30 0x7f8b880cd230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:21:18.252 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-06T01:21:18.250+0000 7f8b8d39d700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8b880cc9b0 con 0x7f8b880ceae0 2023-10-06T01:21:18.252 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-06T01:21:18.250+0000 7f8b8d39d700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8b880cbda0 con 0x7f8b880b2660 2023-10-06T01:21:18.253 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-06T01:21:18.250+0000 7f8b8d39d700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b880cc080 con 0x7f8b880b2a30 2023-10-06T01:21:18.253 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-06T01:21:18.250+0000 7f8b877fe700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8b880b2a30 0x7f8b880cd230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:21:18.253 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-06T01:21:18.250+0000 7f8b877fe700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8b880b2a30 0x7f8b880cd230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3301/0 says I am v2:172.21.15.155:57552/0 (socket says 172.21.15.155:57552) 2023-10-06T01:21:18.253 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-06T01:21:18.250+0000 7f8b877fe700 1 -- 172.21.15.155:0/4285730311 learned_addr learned my addr 172.21.15.155:0/4285730311 (peer_addr_for_me v2:172.21.15.155:0/0) 2023-10-06T01:21:18.253 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-06T01:21:18.250+0000 7f8b87fff700 1 --2- 172.21.15.155:0/4285730311 >> v2:172.21.15.50:3300/0 conn(0x7f8b880b2660 0x7f8b880cccf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:21:18.253 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-06T01:21:18.251+0000 7f8b877fe700 1 -- 172.21.15.155:0/4285730311 >> v2:172.21.15.50:3300/0 conn(0x7f8b880b2660 msgr2=0x7f8b880cccf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:21:18.253 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-06T01:21:18.251+0000 7f8b877fe700 1 --2- 172.21.15.155:0/4285730311 >> v2:172.21.15.50:3300/0 conn(0x7f8b880b2660 0x7f8b880cccf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:21:18.253 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-06T01:21:18.251+0000 7f8b877fe700 1 -- 172.21.15.155:0/4285730311 >> v1:172.21.15.50:6789/0 conn(0x7f8b880ceae0 legacy=0x7f8b880cef80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:21:18.253 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-06T01:21:18.251+0000 7f8b877fe700 1 -- 172.21.15.155:0/4285730311 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b880cc360 con 0x7f8b880b2a30 2023-10-06T01:21:18.253 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-06T01:21:18.251+0000 7f8b877fe700 1 --2- 172.21.15.155:0/4285730311 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8b880b2a30 0x7f8b880cd230 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f8b7c0099b0 tx=0x7f8b7c009250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=522204d2264e358c server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:21:18.255 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-06T01:21:18.251+0000 7f8b86ffd700 1 -- 172.21.15.155:0/4285730311 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b7c009ea0 con 0x7f8b880b2a30 2023-10-06T01:21:18.255 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-06T01:21:18.251+0000 7f8b86ffd700 1 -- 172.21.15.155:0/4285730311 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b7c00b860 con 0x7f8b880b2a30 2023-10-06T01:21:18.255 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-06T01:21:18.251+0000 7f8b86ffd700 1 -- 172.21.15.155:0/4285730311 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b7c00bc00 con 0x7f8b880b2a30 2023-10-06T01:21:18.255 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-06T01:21:18.252+0000 7f8b8d39d700 1 -- 172.21.15.155:0/4285730311 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8b880b2a30 msgr2=0x7f8b880cd230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:21:18.255 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-06T01:21:18.252+0000 7f8b8d39d700 1 --2- 172.21.15.155:0/4285730311 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8b880b2a30 0x7f8b880cd230 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f8b7c0099b0 tx=0x7f8b7c009250 comp rx=0 tx=0).stop 2023-10-06T01:21:18.255 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-06T01:21:18.252+0000 7f8b8d39d700 1 -- 172.21.15.155:0/4285730311 shutdown_connections 2023-10-06T01:21:18.255 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-06T01:21:18.252+0000 7f8b8d39d700 1 --2- 172.21.15.155:0/4285730311 >> v2:172.21.15.50:3300/0 conn(0x7f8b880b2660 0x7f8b880cccf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:21:18.256 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-06T01:21:18.252+0000 7f8b8d39d700 1 --2- 172.21.15.155:0/4285730311 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8b880b2a30 0x7f8b880cd230 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:21:18.256 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-06T01:21:18.252+0000 7f8b8d39d700 1 -- 172.21.15.155:0/4285730311 >> 172.21.15.155:0/4285730311 conn(0x7f8b88099560 msgr2=0x7f8b8806f500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:21:18.256 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-06T01:21:18.252+0000 7f8b8d39d700 1 -- 172.21.15.155:0/4285730311 shutdown_connections 2023-10-06T01:21:18.256 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-06T01:21:18.252+0000 7f8b8d39d700 1 -- 172.21.15.155:0/4285730311 wait complete. 2023-10-06T01:21:18.256 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-06T01:21:18.254+0000 7f8b8d39d700 1 Processor -- start 2023-10-06T01:21:18.256 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-06T01:21:18.254+0000 7f8b8d39d700 1 -- start start 2023-10-06T01:21:18.258 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-06T01:21:18.255+0000 7f8b8d39d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8b880b2660 0x7f8b880ccdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:21:18.258 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-06T01:21:18.255+0000 7f8b8d39d700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8b880b2a30 0x7f8b8809d700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:21:18.258 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-06T01:21:18.255+0000 7f8b8d39d700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8b880ceae0 0x7f8b8809dc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:21:18.258 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-06T01:21:18.255+0000 7f8b8d39d700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b8816e330 con 0x7f8b880b2660 2023-10-06T01:21:18.258 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-06T01:21:18.255+0000 7f8b8d39d700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b8816d760 con 0x7f8b880b2a30 2023-10-06T01:21:18.259 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-06T01:21:18.255+0000 7f8b8d39d700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b8816da00 con 0x7f8b880ceae0 2023-10-06T01:21:18.259 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-06T01:21:18.255+0000 7f8b877fe700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8b880b2a30 0x7f8b8809d700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:21:18.259 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-06T01:21:18.255+0000 7f8b8cb9c700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8b880ceae0 0x7f8b8809dc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:21:18.259 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-06T01:21:18.255+0000 7f8b877fe700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8b880b2a30 0x7f8b8809d700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:46158/0 (socket says 172.21.15.155:46158) 2023-10-06T01:21:18.259 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-06T01:21:18.255+0000 7f8b877fe700 1 -- 172.21.15.155:0/3139092097 learned_addr learned my addr 172.21.15.155:0/3139092097 (peer_addr_for_me v2:172.21.15.155:0/0) 2023-10-06T01:21:18.259 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-06T01:21:18.255+0000 7f8b87fff700 1 --2- 172.21.15.155:0/3139092097 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8b880b2660 0x7f8b880ccdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:21:18.259 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-06T01:21:18.255+0000 7f8b8cb9c700 1 -- 172.21.15.155:0/3139092097 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8b880b2a30 msgr2=0x7f8b8809d700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:21:18.259 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-06T01:21:18.255+0000 7f8b8cb9c700 1 --2- 172.21.15.155:0/3139092097 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8b880b2a30 0x7f8b8809d700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:21:18.259 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-06T01:21:18.255+0000 7f8b8cb9c700 1 -- 172.21.15.155:0/3139092097 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8b880b2660 msgr2=0x7f8b880ccdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:21:18.259 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-06T01:21:18.255+0000 7f8b8cb9c700 1 --2- 172.21.15.155:0/3139092097 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8b880b2660 0x7f8b880ccdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:21:18.259 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-06T01:21:18.255+0000 7f8b8cb9c700 1 -- 172.21.15.155:0/3139092097 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b7c0094f0 con 0x7f8b880ceae0 2023-10-06T01:21:18.259 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-06T01:21:18.256+0000 7f8b877fe700 1 --2- 172.21.15.155:0/3139092097 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8b880b2a30 0x7f8b8809d700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T01:21:18.260 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-06T01:21:18.256+0000 7f8b87fff700 1 --2- 172.21.15.155:0/3139092097 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8b880b2660 0x7f8b880ccdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T01:21:18.260 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-06T01:21:18.256+0000 7f8b8cb9c700 1 --2- 172.21.15.155:0/3139092097 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8b880ceae0 0x7f8b8809dc40 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f8b8000c830 tx=0x7f8b80001690 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:21:18.260 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-06T01:21:18.256+0000 7f8b6ffff700 1 -- 172.21.15.155:0/3139092097 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b80012630 con 0x7f8b880ceae0 2023-10-06T01:21:18.260 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-06T01:21:18.256+0000 7f8b6ffff700 1 -- 172.21.15.155:0/3139092097 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b80012790 con 0x7f8b880ceae0 2023-10-06T01:21:18.260 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-06T01:21:18.256+0000 7f8b8d39d700 1 -- 172.21.15.155:0/3139092097 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8b8816dce0 con 0x7f8b880ceae0 2023-10-06T01:21:18.260 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-06T01:21:18.256+0000 7f8b6ffff700 1 -- 172.21.15.155:0/3139092097 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b80012b50 con 0x7f8b880ceae0 2023-10-06T01:21:18.260 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-06T01:21:18.256+0000 7f8b8d39d700 1 -- 172.21.15.155:0/3139092097 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8b880cd2f0 con 0x7f8b880ceae0 2023-10-06T01:21:18.260 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-06T01:21:18.256+0000 7f8b6ffff700 1 -- 172.21.15.155:0/3139092097 <== mon.2 v2:172.21.15.155:3301/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7f8b8001b400 con 0x7f8b880ceae0 2023-10-06T01:21:18.260 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-06T01:21:18.256+0000 7f8b6ffff700 1 -- 172.21.15.155:0/3139092097 <== mon.2 v2:172.21.15.155:3301/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 836+0+0 (secure 0 0 0) 0x7f8b8001a760 con 0x7f8b880ceae0 2023-10-06T01:21:18.261 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-06T01:21:18.258+0000 7f8b8d39d700 1 -- 172.21.15.155:0/3139092097 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8b8816e4a0 con 0x7f8b880ceae0 2023-10-06T01:21:18.261 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-06T01:21:18.260+0000 7f8b6ffff700 1 -- 172.21.15.155:0/3139092097 <== mon.2 v2:172.21.15.155:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7f8b8001b840 con 0x7f8b880ceae0 2023-10-06T01:21:18.315 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-10-06T01:21:18.313+0000 7f137d083180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-10-06T01:21:18.324 INFO:tasks.ceph.mgr.x.smithi155.stderr:2023-10-06T01:21:18.323+0000 7f58741fa180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-10-06T01:21:18.348 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-06T01:21:18.346+0000 7f8b8d39d700 1 -- 172.21.15.155:0/3139092097 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_command({"prefix": "osd new", "uuid": "5ad9ef12-b579-47ea-b690-90ba887e2cef", "id": 1} v 0) v1 -- 0x7f8b8805f270 con 0x7f8b880ceae0 2023-10-06T01:21:18.351 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-06T01:21:18.350+0000 7f8b6ffff700 1 -- 172.21.15.155:0/3139092097 <== mon.2 v2:172.21.15.155:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "5ad9ef12-b579-47ea-b690-90ba887e2cef", "id": 1}]=0 v4) v1 ==== 112+0+2 (secure 0 0 0) 0x7f8b8001b9e0 con 0x7f8b880ceae0 2023-10-06T01:21:18.352 INFO:teuthology.orchestra.run.smithi155.stdout:1 2023-10-06T01:21:18.354 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-06T01:21:18.352+0000 7f8b8d39d700 1 -- 172.21.15.155:0/3139092097 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8b880ceae0 msgr2=0x7f8b8809dc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:21:18.354 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-06T01:21:18.352+0000 7f8b8d39d700 1 --2- 172.21.15.155:0/3139092097 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8b880ceae0 0x7f8b8809dc40 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f8b8000c830 tx=0x7f8b80001690 comp rx=0 tx=0).stop 2023-10-06T01:21:18.354 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-06T01:21:18.352+0000 7f8b8d39d700 1 -- 172.21.15.155:0/3139092097 shutdown_connections 2023-10-06T01:21:18.354 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-06T01:21:18.352+0000 7f8b8d39d700 1 --2- 172.21.15.155:0/3139092097 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8b880ceae0 0x7f8b8809dc40 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:21:18.354 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-06T01:21:18.352+0000 7f8b8d39d700 1 --2- 172.21.15.155:0/3139092097 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8b880b2660 0x7f8b880ccdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:21:18.354 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-06T01:21:18.352+0000 7f8b8d39d700 1 --2- 172.21.15.155:0/3139092097 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8b880b2a30 0x7f8b8809d700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:21:18.354 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-06T01:21:18.352+0000 7f8b8d39d700 1 -- 172.21.15.155:0/3139092097 >> 172.21.15.155:0/3139092097 conn(0x7f8b88099560 msgr2=0x7f8b880689e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:21:18.354 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-06T01:21:18.352+0000 7f8b8d39d700 1 -- 172.21.15.155:0/3139092097 shutdown_connections 2023-10-06T01:21:18.354 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-06T01:21:18.352+0000 7f8b8d39d700 1 -- 172.21.15.155:0/3139092097 wait complete. 2023-10-06T01:21:18.377 DEBUG:teuthology.orchestra.run.smithi155:> sudo ceph --cluster ceph osd new c7aee044-6f75-436f-90e1-ba42a57359bd 2 2023-10-06T01:21:18.488 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-10-06T01:21:18.486+0000 7f137d083180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-10-06T01:21:18.511 INFO:tasks.ceph.mgr.x.smithi155.stderr:2023-10-06T01:21:18.510+0000 7f58741fa180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-10-06T01:21:18.562 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-06T01:21:18.560+0000 7f6ffffff700 1 Processor -- start 2023-10-06T01:21:18.562 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-06T01:21:18.560+0000 7f6ffffff700 1 -- start start 2023-10-06T01:21:18.563 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-06T01:21:18.562+0000 7f6ffffff700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f70000cd400 0x7f70000ceae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:21:18.563 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-06T01:21:18.562+0000 7f6ffffff700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f70000b2a30 0x7f70000cf020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:21:18.563 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-06T01:21:18.562+0000 7f6ffffff700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f70000cc9b0 con 0x7f70000b2660 2023-10-06T01:21:18.563 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-06T01:21:18.562+0000 7f6ffffff700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f70000cf560 con 0x7f70000b2a30 2023-10-06T01:21:18.564 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-06T01:21:18.562+0000 7f6ffffff700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70000cbda0 con 0x7f70000cd400 2023-10-06T01:21:18.564 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-06T01:21:18.562+0000 7f6fff7fe700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f70000b2a30 0x7f70000cf020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:21:18.564 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-06T01:21:18.562+0000 7f6ffe7fc700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f70000cd400 0x7f70000ceae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:21:18.564 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-06T01:21:18.562+0000 7f6fff7fe700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f70000b2a30 0x7f70000cf020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:46172/0 (socket says 172.21.15.155:46172) 2023-10-06T01:21:18.564 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-06T01:21:18.562+0000 7f6fff7fe700 1 -- 172.21.15.155:0/2236607270 learned_addr learned my addr 172.21.15.155:0/2236607270 (peer_addr_for_me v2:172.21.15.155:0/0) 2023-10-06T01:21:18.564 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-06T01:21:18.562+0000 7f6ffeffd700 1 --1- >> v1:172.21.15.155:6789/0 conn(0x7f70000b2660 0x7f70000cccf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.155:6789/0 says I am v1:172.21.15.155:57284/0 (socket says 172.21.15.155:57284) 2023-10-06T01:21:18.565 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-06T01:21:18.562+0000 7f6ffdffb700 1 -- 172.21.15.155:0/2236607270 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3792212258 0 0) 0x7f70000cc9b0 con 0x7f70000b2660 2023-10-06T01:21:18.566 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-06T01:21:18.562+0000 7f6ffe7fc700 1 -- 172.21.15.155:0/2236607270 >> v2:172.21.15.155:3300/0 conn(0x7f70000b2a30 msgr2=0x7f70000cf020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:21:18.566 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-06T01:21:18.562+0000 7f6ffe7fc700 1 --2- 172.21.15.155:0/2236607270 >> v2:172.21.15.155:3300/0 conn(0x7f70000b2a30 0x7f70000cf020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:21:18.566 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-06T01:21:18.562+0000 7f6ffe7fc700 1 -- 172.21.15.155:0/2236607270 >> v1:172.21.15.155:6789/0 conn(0x7f70000b2660 legacy=0x7f70000cccf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:21:18.566 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-06T01:21:18.562+0000 7f6ffe7fc700 1 -- 172.21.15.155:0/2236607270 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70000cc080 con 0x7f70000cd400 2023-10-06T01:21:18.566 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-06T01:21:18.562+0000 7f6fff7fe700 1 --2- 172.21.15.155:0/2236607270 >> v2:172.21.15.155:3300/0 conn(0x7f70000b2a30 0x7f70000cf020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T01:21:18.566 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-06T01:21:18.563+0000 7f6ffe7fc700 1 --2- 172.21.15.155:0/2236607270 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f70000cd400 0x7f70000ceae0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f6ff40098e0 tx=0x7f6ff40091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1b90b86e0635f7b9 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:21:18.566 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-06T01:21:18.563+0000 7f6ffdffb700 1 -- 172.21.15.155:0/2236607270 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ff400b640 con 0x7f70000cd400 2023-10-06T01:21:18.566 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-06T01:21:18.563+0000 7f6ffdffb700 1 -- 172.21.15.155:0/2236607270 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ff400b7a0 con 0x7f70000cd400 2023-10-06T01:21:18.566 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-06T01:21:18.563+0000 7f6ffdffb700 1 -- 172.21.15.155:0/2236607270 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ff400bb40 con 0x7f70000cd400 2023-10-06T01:21:18.566 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-06T01:21:18.563+0000 7f6ffffff700 1 -- 172.21.15.155:0/2236607270 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f70000cd400 msgr2=0x7f70000ceae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:21:18.566 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-06T01:21:18.563+0000 7f6ffffff700 1 --2- 172.21.15.155:0/2236607270 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f70000cd400 0x7f70000ceae0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f6ff40098e0 tx=0x7f6ff40091a0 comp rx=0 tx=0).stop 2023-10-06T01:21:18.567 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-06T01:21:18.564+0000 7f6ffffff700 1 -- 172.21.15.155:0/2236607270 shutdown_connections 2023-10-06T01:21:18.567 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-06T01:21:18.564+0000 7f6ffffff700 1 --2- 172.21.15.155:0/2236607270 >> v2:172.21.15.155:3300/0 conn(0x7f70000b2a30 0x7f70000cf020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:21:18.567 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-06T01:21:18.564+0000 7f6ffffff700 1 --2- 172.21.15.155:0/2236607270 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f70000cd400 0x7f70000ceae0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:21:18.567 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-06T01:21:18.564+0000 7f6ffffff700 1 -- 172.21.15.155:0/2236607270 >> 172.21.15.155:0/2236607270 conn(0x7f7000099560 msgr2=0x7f700006f500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:21:18.567 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-06T01:21:18.564+0000 7f6ffffff700 1 -- 172.21.15.155:0/2236607270 shutdown_connections 2023-10-06T01:21:18.567 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-06T01:21:18.564+0000 7f6ffffff700 1 -- 172.21.15.155:0/2236607270 wait complete. 2023-10-06T01:21:18.569 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-06T01:21:18.565+0000 7f6ffffff700 1 Processor -- start 2023-10-06T01:21:18.569 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-06T01:21:18.565+0000 7f6ffffff700 1 -- start start 2023-10-06T01:21:18.569 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-06T01:21:18.566+0000 7f6ffffff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f70000b2660 0x7f7000147da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:21:18.569 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-06T01:21:18.566+0000 7f6ffffff700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f70000b2a30 0x7f700015f020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:21:18.569 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-06T01:21:18.566+0000 7f6ffffff700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f70000cd400 0x7f700015f560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:21:18.569 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-06T01:21:18.566+0000 7f6ffffff700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70000c8280 con 0x7f70000b2660 2023-10-06T01:21:18.570 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-06T01:21:18.566+0000 7f6ffffff700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70000b53a0 con 0x7f70000b2a30 2023-10-06T01:21:18.570 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-06T01:21:18.566+0000 7f6ffffff700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70000b4a70 con 0x7f70000cd400 2023-10-06T01:21:18.570 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-06T01:21:18.566+0000 7f6ffe7fc700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f70000b2a30 0x7f700015f020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:21:18.570 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-06T01:21:18.566+0000 7f6fff7fe700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f70000cd400 0x7f700015f560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:21:18.570 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-06T01:21:18.566+0000 7f6ffe7fc700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f70000b2a30 0x7f700015f020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:46176/0 (socket says 172.21.15.155:46176) 2023-10-06T01:21:18.570 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-06T01:21:18.566+0000 7f6ffe7fc700 1 -- 172.21.15.155:0/2724915251 learned_addr learned my addr 172.21.15.155:0/2724915251 (peer_addr_for_me v2:172.21.15.155:0/0) 2023-10-06T01:21:18.570 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-06T01:21:18.566+0000 7f6ffeffd700 1 --2- 172.21.15.155:0/2724915251 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f70000b2660 0x7f7000147da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:21:18.570 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-06T01:21:18.567+0000 7f6ffe7fc700 1 -- 172.21.15.155:0/2724915251 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f70000cd400 msgr2=0x7f700015f560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:21:18.570 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-06T01:21:18.567+0000 7f6ffe7fc700 1 --2- 172.21.15.155:0/2724915251 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f70000cd400 0x7f700015f560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:21:18.570 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-06T01:21:18.567+0000 7f6ffe7fc700 1 -- 172.21.15.155:0/2724915251 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f70000b2660 msgr2=0x7f7000147da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:21:18.570 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-06T01:21:18.567+0000 7f6ffe7fc700 1 --2- 172.21.15.155:0/2724915251 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f70000b2660 0x7f7000147da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:21:18.571 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-06T01:21:18.567+0000 7f6ffe7fc700 1 -- 172.21.15.155:0/2724915251 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ff8009ae0 con 0x7f70000b2a30 2023-10-06T01:21:18.571 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-06T01:21:18.567+0000 7f6ffeffd700 1 --2- 172.21.15.155:0/2724915251 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f70000b2660 0x7f7000147da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T01:21:18.571 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-06T01:21:18.567+0000 7f6ffe7fc700 1 --2- 172.21.15.155:0/2724915251 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f70000b2a30 0x7f700015f020 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f6ff40093f0 tx=0x7f6ff4017000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:21:18.571 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-06T01:21:18.567+0000 7f6fe6ffd700 1 -- 172.21.15.155:0/2724915251 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ff400bb20 con 0x7f70000b2a30 2023-10-06T01:21:18.571 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-06T01:21:18.567+0000 7f6fe6ffd700 1 -- 172.21.15.155:0/2724915251 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ff4011420 con 0x7f70000b2a30 2023-10-06T01:21:18.571 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-06T01:21:18.567+0000 7f6ffffff700 1 -- 172.21.15.155:0/2724915251 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6ff4009420 con 0x7f70000b2a30 2023-10-06T01:21:18.571 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-06T01:21:18.567+0000 7f6fe6ffd700 1 -- 172.21.15.155:0/2724915251 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ff4011820 con 0x7f70000b2a30 2023-10-06T01:21:18.571 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-06T01:21:18.567+0000 7f6ffffff700 1 -- 172.21.15.155:0/2724915251 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f70000b5030 con 0x7f70000b2a30 2023-10-06T01:21:18.571 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-06T01:21:18.568+0000 7f6fe6ffd700 1 -- 172.21.15.155:0/2724915251 <== mon.1 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7f6ff402e3f0 con 0x7f70000b2a30 2023-10-06T01:21:18.571 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-06T01:21:18.568+0000 7f6fe6ffd700 1 -- 172.21.15.155:0/2724915251 <== mon.1 v2:172.21.15.155:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 951+0+0 (secure 0 0 0) 0x7f6ff4006cb0 con 0x7f70000b2a30 2023-10-06T01:21:18.572 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-06T01:21:18.569+0000 7f6ffffff700 1 -- 172.21.15.155:0/2724915251 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f700005f270 con 0x7f70000b2a30 2023-10-06T01:21:18.572 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-06T01:21:18.571+0000 7f6fe6ffd700 1 -- 172.21.15.155:0/2724915251 <== mon.1 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7f6ff4033060 con 0x7f70000b2a30 2023-10-06T01:21:18.587 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-10-06T01:21:18.585+0000 7f137d083180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-10-06T01:21:18.632 INFO:tasks.ceph.mgr.x.smithi155.stderr:2023-10-06T01:21:18.631+0000 7f58741fa180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-10-06T01:21:18.682 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-06T01:21:18.680+0000 7f6ffffff700 1 -- 172.21.15.155:0/2724915251 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "osd new", "uuid": "c7aee044-6f75-436f-90e1-ba42a57359bd", "id": 2} v 0) v1 -- 0x7f70000b54e0 con 0x7f70000b2a30 2023-10-06T01:21:18.685 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-06T01:21:18.684+0000 7f6fe6ffd700 1 -- 172.21.15.155:0/2724915251 <== mon.1 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "c7aee044-6f75-436f-90e1-ba42a57359bd", "id": 2}]=0 v5) v1 ==== 112+0+2 (secure 0 0 0) 0x7f6ff4015020 con 0x7f70000b2a30 2023-10-06T01:21:18.685 INFO:teuthology.orchestra.run.smithi155.stdout:2 2023-10-06T01:21:18.687 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-06T01:21:18.685+0000 7f6ffffff700 1 -- 172.21.15.155:0/2724915251 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f70000b2a30 msgr2=0x7f700015f020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:21:18.687 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-06T01:21:18.685+0000 7f6ffffff700 1 --2- 172.21.15.155:0/2724915251 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f70000b2a30 0x7f700015f020 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f6ff40093f0 tx=0x7f6ff4017000 comp rx=0 tx=0).stop 2023-10-06T01:21:18.687 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-06T01:21:18.685+0000 7f6ffffff700 1 -- 172.21.15.155:0/2724915251 shutdown_connections 2023-10-06T01:21:18.687 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-06T01:21:18.685+0000 7f6ffffff700 1 --2- 172.21.15.155:0/2724915251 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f70000cd400 0x7f700015f560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:21:18.687 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-06T01:21:18.685+0000 7f6ffffff700 1 --2- 172.21.15.155:0/2724915251 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f70000b2660 0x7f7000147da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:21:18.687 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-06T01:21:18.685+0000 7f6ffffff700 1 --2- 172.21.15.155:0/2724915251 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f70000b2a30 0x7f700015f020 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:21:18.687 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-06T01:21:18.685+0000 7f6ffffff700 1 -- 172.21.15.155:0/2724915251 >> 172.21.15.155:0/2724915251 conn(0x7f7000099560 msgr2=0x7f70000c5390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:21:18.687 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-06T01:21:18.685+0000 7f6ffffff700 1 -- 172.21.15.155:0/2724915251 shutdown_connections 2023-10-06T01:21:18.688 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-06T01:21:18.685+0000 7f6ffffff700 1 -- 172.21.15.155:0/2724915251 wait complete. 2023-10-06T01:21:18.704 DEBUG:teuthology.orchestra.run.smithi155:> sudo ceph --cluster ceph osd new d9b901c8-e8b2-44af-9508-f453120a96c0 3 2023-10-06T01:21:18.818 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-10-06T01:21:18.816+0000 7f137d083180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-10-06T01:21:18.866 INFO:tasks.ceph.mgr.x.smithi155.stderr:2023-10-06T01:21:18.865+0000 7f58741fa180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-10-06T01:21:18.883 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-06T01:21:18.882+0000 7fb0b699d700 1 Processor -- start 2023-10-06T01:21:18.884 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-06T01:21:18.882+0000 7fb0b699d700 1 -- start start 2023-10-06T01:21:18.886 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-06T01:21:18.883+0000 7fb0b699d700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fb0b00ccab0 0x7fb0b00d02f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:21:18.886 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-06T01:21:18.884+0000 7fb0b699d700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fb0b00d0830 0x7fb0b00ce8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:21:18.886 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-06T01:21:18.884+0000 7fb0b699d700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb0b00cdc30 con 0x7fb0b01539d0 2023-10-06T01:21:18.886 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-06T01:21:18.884+0000 7fb0b699d700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb0b00cb500 con 0x7fb0b00ccab0 2023-10-06T01:21:18.887 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-06T01:21:18.884+0000 7fb0b699d700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb0b00d0c50 con 0x7fb0b00d0830 2023-10-06T01:21:18.887 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-06T01:21:18.884+0000 7fb0b599b700 1 --1- >> v1:172.21.15.155:6789/0 conn(0x7fb0b01539d0 0x7fb0b015a3b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.155:6789/0 says I am v1:172.21.15.155:57298/0 (socket says 172.21.15.155:57298) 2023-10-06T01:21:18.887 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-06T01:21:18.884+0000 7fb0b599b700 1 -- 172.21.15.155:0/86163504 learned_addr learned my addr 172.21.15.155:0/86163504 (peer_addr_for_me v1:172.21.15.155:0/0) 2023-10-06T01:21:18.887 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-06T01:21:18.884+0000 7fb0b619c700 1 --2- 172.21.15.155:0/86163504 >> v2:172.21.15.155:3300/0 conn(0x7fb0b00d0830 0x7fb0b00ce8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:21:18.887 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-06T01:21:18.884+0000 7fb0b519a700 1 --2- 172.21.15.155:0/86163504 >> v2:172.21.15.50:3300/0 conn(0x7fb0b00ccab0 0x7fb0b00d02f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:21:18.887 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-06T01:21:18.884+0000 7fb0b4999700 1 -- 172.21.15.155:0/86163504 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4038000 0 0) 0x7fb0b00cdc30 con 0x7fb0b01539d0 2023-10-06T01:21:18.887 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-06T01:21:18.884+0000 7fb0b4999700 1 -- 172.21.15.155:0/86163504 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb09c003570 con 0x7fb0b01539d0 2023-10-06T01:21:18.887 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-06T01:21:18.884+0000 7fb0b519a700 1 -- 172.21.15.155:0/86163504 >> v2:172.21.15.155:3300/0 conn(0x7fb0b00d0830 msgr2=0x7fb0b00ce8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:21:18.887 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-06T01:21:18.884+0000 7fb0b519a700 1 --2- 172.21.15.155:0/86163504 >> v2:172.21.15.155:3300/0 conn(0x7fb0b00d0830 0x7fb0b00ce8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:21:18.887 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-06T01:21:18.884+0000 7fb0b519a700 1 -- 172.21.15.155:0/86163504 >> v1:172.21.15.155:6789/0 conn(0x7fb0b01539d0 legacy=0x7fb0b015a3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:21:18.887 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-06T01:21:18.884+0000 7fb0b519a700 1 -- 172.21.15.155:0/86163504 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0b00cd020 con 0x7fb0b00ccab0 2023-10-06T01:21:18.887 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-06T01:21:18.884+0000 7fb0b619c700 1 --2- 172.21.15.155:0/86163504 >> v2:172.21.15.155:3300/0 conn(0x7fb0b00d0830 0x7fb0b00ce8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T01:21:18.888 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-06T01:21:18.885+0000 7fb0b519a700 1 --2- 172.21.15.155:0/86163504 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb0b00ccab0 0x7fb0b00d02f0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fb0b00cae90 tx=0x7fb0a00091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aadc15e602d5c2ef server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:21:18.888 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-06T01:21:18.885+0000 7fb0b4999700 1 -- 172.21.15.155:0/86163504 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0a0011630 con 0x7fb0b00ccab0 2023-10-06T01:21:18.888 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-06T01:21:18.885+0000 7fb0b4999700 1 -- 172.21.15.155:0/86163504 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb0a00117b0 con 0x7fb0b00ccab0 2023-10-06T01:21:18.888 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-06T01:21:18.885+0000 7fb0b4999700 1 -- 172.21.15.155:0/86163504 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0a0011b70 con 0x7fb0b00ccab0 2023-10-06T01:21:18.889 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-06T01:21:18.886+0000 7fb0b699d700 1 -- 172.21.15.155:0/86163504 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb0b00ccab0 msgr2=0x7fb0b00d02f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:21:18.889 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-06T01:21:18.886+0000 7fb0b699d700 1 --2- 172.21.15.155:0/86163504 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb0b00ccab0 0x7fb0b00d02f0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fb0b00cae90 tx=0x7fb0a00091a0 comp rx=0 tx=0).stop 2023-10-06T01:21:18.889 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-06T01:21:18.886+0000 7fb0b699d700 1 -- 172.21.15.155:0/86163504 shutdown_connections 2023-10-06T01:21:18.889 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-06T01:21:18.886+0000 7fb0b699d700 1 --2- 172.21.15.155:0/86163504 >> v2:172.21.15.155:3300/0 conn(0x7fb0b00d0830 0x7fb0b00ce8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:21:18.889 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-06T01:21:18.886+0000 7fb0b699d700 1 --2- 172.21.15.155:0/86163504 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb0b00ccab0 0x7fb0b00d02f0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:21:18.889 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-06T01:21:18.886+0000 7fb0b699d700 1 -- 172.21.15.155:0/86163504 >> 172.21.15.155:0/86163504 conn(0x7fb0b0068100 msgr2=0x7fb0b00684d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:21:18.889 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-06T01:21:18.886+0000 7fb0b699d700 1 -- 172.21.15.155:0/86163504 shutdown_connections 2023-10-06T01:21:18.889 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-06T01:21:18.886+0000 7fb0b699d700 1 -- 172.21.15.155:0/86163504 wait complete. 2023-10-06T01:21:18.890 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-06T01:21:18.887+0000 7fb0b699d700 1 Processor -- start 2023-10-06T01:21:18.890 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-06T01:21:18.887+0000 7fb0b699d700 1 -- start start 2023-10-06T01:21:18.892 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-06T01:21:18.888+0000 7fb0b699d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb0b00ccab0 0x7fb0b00b5d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:21:18.892 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-06T01:21:18.888+0000 7fb0b699d700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb0b00d0830 0x7fb0b0156dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:21:18.892 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-06T01:21:18.888+0000 7fb0b699d700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb0b01539d0 0x7fb0b00b3d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:21:18.892 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-06T01:21:18.888+0000 7fb0b699d700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0b00c77e0 con 0x7fb0b00ccab0 2023-10-06T01:21:18.892 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-06T01:21:18.888+0000 7fb0b699d700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0b00c8570 con 0x7fb0b01539d0 2023-10-06T01:21:18.892 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-06T01:21:18.888+0000 7fb0b699d700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0b00b38f0 con 0x7fb0b00d0830 2023-10-06T01:21:18.892 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-06T01:21:18.888+0000 7fb0b619c700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb0b01539d0 0x7fb0b00b3d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:21:18.892 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-06T01:21:18.888+0000 7fb0b619c700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb0b01539d0 0x7fb0b00b3d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:46190/0 (socket says 172.21.15.155:46190) 2023-10-06T01:21:18.892 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-06T01:21:18.888+0000 7fb0b519a700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb0b00d0830 0x7fb0b0156dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:21:18.893 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-06T01:21:18.888+0000 7fb0b619c700 1 -- 172.21.15.155:0/1989209640 learned_addr learned my addr 172.21.15.155:0/1989209640 (peer_addr_for_me v2:172.21.15.155:0/0) 2023-10-06T01:21:18.893 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-06T01:21:18.888+0000 7fb0b599b700 1 --2- 172.21.15.155:0/1989209640 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb0b00ccab0 0x7fb0b00b5d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:21:18.893 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-06T01:21:18.889+0000 7fb0b619c700 1 -- 172.21.15.155:0/1989209640 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb0b00d0830 msgr2=0x7fb0b0156dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:21:18.893 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-06T01:21:18.889+0000 7fb0b619c700 1 --2- 172.21.15.155:0/1989209640 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb0b00d0830 0x7fb0b0156dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:21:18.893 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-06T01:21:18.889+0000 7fb0b619c700 1 -- 172.21.15.155:0/1989209640 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb0b00ccab0 msgr2=0x7fb0b00b5d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:21:18.893 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-06T01:21:18.889+0000 7fb0b619c700 1 --2- 172.21.15.155:0/1989209640 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb0b00ccab0 0x7fb0b00b5d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:21:18.893 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-06T01:21:18.889+0000 7fb0b619c700 1 -- 172.21.15.155:0/1989209640 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0a8009a20 con 0x7fb0b01539d0 2023-10-06T01:21:18.893 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-06T01:21:18.889+0000 7fb0b519a700 1 --2- 172.21.15.155:0/1989209640 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb0b00d0830 0x7fb0b0156dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T01:21:18.893 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-06T01:21:18.889+0000 7fb0b599b700 1 --2- 172.21.15.155:0/1989209640 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb0b00ccab0 0x7fb0b00b5d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T01:21:18.893 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-06T01:21:18.889+0000 7fb0b619c700 1 --2- 172.21.15.155:0/1989209640 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb0b01539d0 0x7fb0b00b3d80 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fb0a8009f20 tx=0x7fb0a800b040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:21:18.893 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-06T01:21:18.889+0000 7fb0a5ffb700 1 -- 172.21.15.155:0/1989209640 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0a8009c80 con 0x7fb0b01539d0 2023-10-06T01:21:18.893 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-06T01:21:18.889+0000 7fb0a5ffb700 1 -- 172.21.15.155:0/1989209640 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb0a800f040 con 0x7fb0b01539d0 2023-10-06T01:21:18.894 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-06T01:21:18.889+0000 7fb0a5ffb700 1 -- 172.21.15.155:0/1989209640 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0a800cdc0 con 0x7fb0b01539d0 2023-10-06T01:21:18.894 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-06T01:21:18.890+0000 7fb0b699d700 1 -- 172.21.15.155:0/1989209640 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb0a0009420 con 0x7fb0b01539d0 2023-10-06T01:21:18.894 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-06T01:21:18.890+0000 7fb0b699d700 1 -- 172.21.15.155:0/1989209640 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb0b00b32a0 con 0x7fb0b01539d0 2023-10-06T01:21:18.894 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-06T01:21:18.890+0000 7fb0a5ffb700 1 -- 172.21.15.155:0/1989209640 <== mon.1 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7fb0a8003020 con 0x7fb0b01539d0 2023-10-06T01:21:18.894 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-06T01:21:18.890+0000 7fb0a5ffb700 1 -- 172.21.15.155:0/1989209640 <== mon.1 v2:172.21.15.155:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1066+0+0 (secure 0 0 0) 0x7fb0a80133e0 con 0x7fb0b01539d0 2023-10-06T01:21:18.894 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-06T01:21:18.891+0000 7fb0b699d700 1 -- 172.21.15.155:0/1989209640 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb0b00b3100 con 0x7fb0b01539d0 2023-10-06T01:21:18.894 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-06T01:21:18.893+0000 7fb0a5ffb700 1 -- 172.21.15.155:0/1989209640 <== mon.1 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7fb0b00b3100 con 0x7fb0b01539d0 2023-10-06T01:21:18.980 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-06T01:21:18.979+0000 7fb0b699d700 1 -- 172.21.15.155:0/1989209640 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "osd new", "uuid": "d9b901c8-e8b2-44af-9508-f453120a96c0", "id": 3} v 0) v1 -- 0x7fb0b005f270 con 0x7fb0b01539d0 2023-10-06T01:21:18.986 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-06T01:21:18.985+0000 7fb0a5ffb700 1 -- 172.21.15.155:0/1989209640 <== mon.1 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "d9b901c8-e8b2-44af-9508-f453120a96c0", "id": 3}]=0 v6) v1 ==== 112+0+2 (secure 0 0 0) 0x7fb0a8018030 con 0x7fb0b01539d0 2023-10-06T01:21:18.986 INFO:teuthology.orchestra.run.smithi155.stdout:3 2023-10-06T01:21:18.987 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-06T01:21:18.986+0000 7fb0b699d700 1 -- 172.21.15.155:0/1989209640 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb0b01539d0 msgr2=0x7fb0b00b3d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:21:18.988 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-06T01:21:18.986+0000 7fb0b699d700 1 --2- 172.21.15.155:0/1989209640 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb0b01539d0 0x7fb0b00b3d80 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fb0a8009f20 tx=0x7fb0a800b040 comp rx=0 tx=0).stop 2023-10-06T01:21:18.988 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-06T01:21:18.986+0000 7fb0b699d700 1 -- 172.21.15.155:0/1989209640 shutdown_connections 2023-10-06T01:21:18.988 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-06T01:21:18.986+0000 7fb0b699d700 1 --2- 172.21.15.155:0/1989209640 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb0b01539d0 0x7fb0b00b3d80 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:21:18.988 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-06T01:21:18.986+0000 7fb0b699d700 1 --2- 172.21.15.155:0/1989209640 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb0b00ccab0 0x7fb0b00b5d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:21:18.988 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-06T01:21:18.986+0000 7fb0b699d700 1 --2- 172.21.15.155:0/1989209640 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb0b00d0830 0x7fb0b0156dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:21:18.988 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-06T01:21:18.986+0000 7fb0b699d700 1 -- 172.21.15.155:0/1989209640 >> 172.21.15.155:0/1989209640 conn(0x7fb0b0068100 msgr2=0x7fb0b0158110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:21:18.988 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-06T01:21:18.986+0000 7fb0b699d700 1 -- 172.21.15.155:0/1989209640 shutdown_connections 2023-10-06T01:21:18.988 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-06T01:21:18.986+0000 7fb0b699d700 1 -- 172.21.15.155:0/1989209640 wait complete. 2023-10-06T01:21:19.004 DEBUG:teuthology.orchestra.run.smithi155:> sudo ceph --cluster ceph osd new 2b3c6b38-e3e9-4301-9445-60fd3fe8ce03 4 2023-10-06T01:21:19.043 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-10-06T01:21:19.041+0000 7f137d083180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-10-06T01:21:19.093 INFO:tasks.ceph.mgr.x.smithi155.stderr:2023-10-06T01:21:19.092+0000 7f58741fa180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-10-06T01:21:19.142 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-10-06T01:21:19.140+0000 7f137d083180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-10-06T01:21:19.183 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-06T01:21:19.181+0000 7f35a5b9d700 1 Processor -- start 2023-10-06T01:21:19.183 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-06T01:21:19.181+0000 7f35a5b9d700 1 -- start start 2023-10-06T01:21:19.186 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-06T01:21:19.182+0000 7f35a5b9d700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f35a01539d0 0x7f35a015a3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:21:19.186 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-06T01:21:19.183+0000 7f35a5b9d700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f35a00d0a00 0x7f35a00ce8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:21:19.186 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-06T01:21:19.183+0000 7f35a5b9d700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f35a00cdc30 con 0x7f35a00ccab0 2023-10-06T01:21:19.186 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-06T01:21:19.183+0000 7f35a5b9d700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f35a00cb500 con 0x7f35a00d0a00 2023-10-06T01:21:19.186 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-06T01:21:19.183+0000 7f35a5b9d700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35a015a8f0 con 0x7f35a01539d0 2023-10-06T01:21:19.187 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-06T01:21:19.183+0000 7f35a4b9b700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f35a01539d0 0x7f35a015a3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:21:19.187 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-06T01:21:19.183+0000 7f359ffff700 1 --1- >> v1:172.21.15.155:6789/0 conn(0x7f35a00ccab0 0x7f35a00d02f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.155:6789/0 says I am v1:172.21.15.155:33852/0 (socket says 172.21.15.155:33852) 2023-10-06T01:21:19.187 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-06T01:21:19.183+0000 7f359ffff700 1 -- 172.21.15.155:0/3481070724 learned_addr learned my addr 172.21.15.155:0/3481070724 (peer_addr_for_me v1:172.21.15.155:0/0) 2023-10-06T01:21:19.187 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-06T01:21:19.183+0000 7f35a539c700 1 --2- 172.21.15.155:0/3481070724 >> v2:172.21.15.50:3300/0 conn(0x7f35a00d0a00 0x7f35a00ce8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:21:19.187 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-06T01:21:19.183+0000 7f35a4b9b700 1 -- 172.21.15.155:0/3481070724 >> v2:172.21.15.50:3300/0 conn(0x7f35a00d0a00 msgr2=0x7f35a00ce8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:21:19.187 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-06T01:21:19.183+0000 7f35a4b9b700 1 --2- 172.21.15.155:0/3481070724 >> v2:172.21.15.50:3300/0 conn(0x7f35a00d0a00 0x7f35a00ce8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:21:19.187 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-06T01:21:19.183+0000 7f35a4b9b700 1 -- 172.21.15.155:0/3481070724 >> v1:172.21.15.155:6789/0 conn(0x7f35a00ccab0 legacy=0x7f35a00d02f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:21:19.187 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-06T01:21:19.183+0000 7f359f7fe700 1 -- 172.21.15.155:0/3481070724 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3058154116 0 0) 0x7f35a00cdc30 con 0x7f35a00ccab0 2023-10-06T01:21:19.187 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-06T01:21:19.183+0000 7f35a4b9b700 1 -- 172.21.15.155:0/3481070724 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35a00cd020 con 0x7f35a01539d0 2023-10-06T01:21:19.187 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-06T01:21:19.184+0000 7f35a4b9b700 1 --2- 172.21.15.155:0/3481070724 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f35a01539d0 0x7f35a015a3b0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f35940098e0 tx=0x7f35940091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8a0f7ef8d676367d server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:21:19.187 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-06T01:21:19.184+0000 7f359f7fe700 1 -- 172.21.15.155:0/3481070724 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f359400b640 con 0x7f35a01539d0 2023-10-06T01:21:19.187 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-06T01:21:19.184+0000 7f359f7fe700 1 -- 172.21.15.155:0/3481070724 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f359400b7a0 con 0x7f35a01539d0 2023-10-06T01:21:19.188 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-06T01:21:19.184+0000 7f359f7fe700 1 -- 172.21.15.155:0/3481070724 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f359400bb40 con 0x7f35a01539d0 2023-10-06T01:21:19.188 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-06T01:21:19.184+0000 7f35a5b9d700 1 -- 172.21.15.155:0/3481070724 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f35a01539d0 msgr2=0x7f35a015a3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:21:19.188 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-06T01:21:19.184+0000 7f35a5b9d700 1 --2- 172.21.15.155:0/3481070724 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f35a01539d0 0x7f35a015a3b0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f35940098e0 tx=0x7f35940091a0 comp rx=0 tx=0).stop 2023-10-06T01:21:19.188 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-06T01:21:19.185+0000 7f35a5b9d700 1 -- 172.21.15.155:0/3481070724 shutdown_connections 2023-10-06T01:21:19.188 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-06T01:21:19.185+0000 7f35a5b9d700 1 --2- 172.21.15.155:0/3481070724 >> v2:172.21.15.50:3300/0 conn(0x7f35a00d0a00 0x7f35a00ce8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:21:19.188 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-06T01:21:19.185+0000 7f35a5b9d700 1 --2- 172.21.15.155:0/3481070724 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f35a01539d0 0x7f35a015a3b0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:21:19.188 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-06T01:21:19.185+0000 7f35a5b9d700 1 -- 172.21.15.155:0/3481070724 >> 172.21.15.155:0/3481070724 conn(0x7f35a0068100 msgr2=0x7f35a00684d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:21:19.188 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-06T01:21:19.185+0000 7f35a5b9d700 1 -- 172.21.15.155:0/3481070724 shutdown_connections 2023-10-06T01:21:19.188 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-06T01:21:19.185+0000 7f35a5b9d700 1 -- 172.21.15.155:0/3481070724 wait complete. 2023-10-06T01:21:19.191 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-06T01:21:19.186+0000 7f35a5b9d700 1 Processor -- start 2023-10-06T01:21:19.191 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-06T01:21:19.186+0000 7f35a5b9d700 1 -- start start 2023-10-06T01:21:19.191 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-06T01:21:19.187+0000 7f35a5b9d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f35a00ccab0 0x7f35a00c89f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:21:19.191 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-06T01:21:19.187+0000 7f35a5b9d700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f35a00d0a00 0x7f35a016d0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:21:19.191 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-06T01:21:19.187+0000 7f35a5b9d700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f35a01539d0 0x7f35a016d5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:21:19.191 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-06T01:21:19.187+0000 7f35a5b9d700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35a00ca380 con 0x7f35a00ccab0 2023-10-06T01:21:19.191 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-06T01:21:19.187+0000 7f35a5b9d700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35a00c9ef0 con 0x7f35a00d0a00 2023-10-06T01:21:19.191 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-06T01:21:19.187+0000 7f35a5b9d700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35a00c92e0 con 0x7f35a01539d0 2023-10-06T01:21:19.192 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-06T01:21:19.187+0000 7f359ffff700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f35a00d0a00 0x7f35a016d0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:21:19.192 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-06T01:21:19.187+0000 7f359ffff700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f35a00d0a00 0x7f35a016d0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:48006/0 (socket says 172.21.15.155:48006) 2023-10-06T01:21:19.192 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-06T01:21:19.187+0000 7f359ffff700 1 -- 172.21.15.155:0/2033398600 learned_addr learned my addr 172.21.15.155:0/2033398600 (peer_addr_for_me v2:172.21.15.155:0/0) 2023-10-06T01:21:19.192 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-06T01:21:19.188+0000 7f35a539c700 1 --2- 172.21.15.155:0/2033398600 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f35a01539d0 0x7f35a016d5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:21:19.192 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-06T01:21:19.188+0000 7f35a4b9b700 1 --2- 172.21.15.155:0/2033398600 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f35a00ccab0 0x7f35a00c89f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:21:19.192 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-06T01:21:19.188+0000 7f359ffff700 1 -- 172.21.15.155:0/2033398600 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f35a01539d0 msgr2=0x7f35a016d5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:21:19.192 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-06T01:21:19.188+0000 7f359ffff700 1 --2- 172.21.15.155:0/2033398600 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f35a01539d0 0x7f35a016d5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:21:19.192 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-06T01:21:19.188+0000 7f359ffff700 1 -- 172.21.15.155:0/2033398600 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f35a00ccab0 msgr2=0x7f35a00c89f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:21:19.192 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-06T01:21:19.188+0000 7f359ffff700 1 --2- 172.21.15.155:0/2033398600 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f35a00ccab0 0x7f35a00c89f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:21:19.192 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-06T01:21:19.188+0000 7f359ffff700 1 -- 172.21.15.155:0/2033398600 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3594009420 con 0x7f35a00d0a00 2023-10-06T01:21:19.192 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-06T01:21:19.188+0000 7f35a539c700 1 --2- 172.21.15.155:0/2033398600 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f35a01539d0 0x7f35a016d5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T01:21:19.192 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-06T01:21:19.188+0000 7f359ffff700 1 --2- 172.21.15.155:0/2033398600 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f35a00d0a00 0x7f35a016d0b0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f358c00c5e0 tx=0x7f358c001070 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:21:19.193 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-06T01:21:19.188+0000 7f359cff9700 1 -- 172.21.15.155:0/2033398600 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f358c005b30 con 0x7f35a00d0a00 2023-10-06T01:21:19.193 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-06T01:21:19.188+0000 7f359cff9700 1 -- 172.21.15.155:0/2033398600 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f358c005c90 con 0x7f35a00d0a00 2023-10-06T01:21:19.193 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-06T01:21:19.188+0000 7f359cff9700 1 -- 172.21.15.155:0/2033398600 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f358c007300 con 0x7f35a00d0a00 2023-10-06T01:21:19.193 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-06T01:21:19.189+0000 7f35a5b9d700 1 -- 172.21.15.155:0/2033398600 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f35a00c95c0 con 0x7f35a00d0a00 2023-10-06T01:21:19.193 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-06T01:21:19.189+0000 7f35a5b9d700 1 -- 172.21.15.155:0/2033398600 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f35a00c9b80 con 0x7f35a00d0a00 2023-10-06T01:21:19.193 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-06T01:21:19.189+0000 7f359cff9700 1 -- 172.21.15.155:0/2033398600 <== mon.1 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7f358c01c6c0 con 0x7f35a00d0a00 2023-10-06T01:21:19.193 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-06T01:21:19.189+0000 7f359cff9700 1 -- 172.21.15.155:0/2033398600 <== mon.1 v2:172.21.15.155:3300/0 5 ==== osd_map(6..6 src has 1..6) v4 ==== 1181+0+0 (secure 0 0 0) 0x7f358c005e00 con 0x7f35a00d0a00 2023-10-06T01:21:19.193 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-06T01:21:19.190+0000 7f35a5b9d700 1 -- 172.21.15.155:0/2033398600 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f35a00ca060 con 0x7f35a00d0a00 2023-10-06T01:21:19.194 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-06T01:21:19.192+0000 7f359cff9700 1 -- 172.21.15.155:0/2033398600 <== mon.1 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7f358c017070 con 0x7f35a00d0a00 2023-10-06T01:21:19.194 INFO:tasks.ceph.mgr.x.smithi155.stderr:2023-10-06T01:21:19.192+0000 7f58741fa180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-10-06T01:21:19.279 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-06T01:21:19.278+0000 7f35a5b9d700 1 -- 172.21.15.155:0/2033398600 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "osd new", "uuid": "2b3c6b38-e3e9-4301-9445-60fd3fe8ce03", "id": 4} v 0) v1 -- 0x7f35a005f270 con 0x7f35a00d0a00 2023-10-06T01:21:19.286 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-06T01:21:19.285+0000 7f359cff9700 1 -- 172.21.15.155:0/2033398600 <== mon.1 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "2b3c6b38-e3e9-4301-9445-60fd3fe8ce03", "id": 4}]=0 v7) v1 ==== 112+0+2 (secure 0 0 0) 0x7f358c007750 con 0x7f35a00d0a00 2023-10-06T01:21:19.286 INFO:teuthology.orchestra.run.smithi155.stdout:4 2023-10-06T01:21:19.287 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-06T01:21:19.286+0000 7f35a5b9d700 1 -- 172.21.15.155:0/2033398600 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f35a00d0a00 msgr2=0x7f35a016d0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:21:19.287 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-06T01:21:19.286+0000 7f35a5b9d700 1 --2- 172.21.15.155:0/2033398600 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f35a00d0a00 0x7f35a016d0b0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f358c00c5e0 tx=0x7f358c001070 comp rx=0 tx=0).stop 2023-10-06T01:21:19.288 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-06T01:21:19.286+0000 7f35a5b9d700 1 -- 172.21.15.155:0/2033398600 shutdown_connections 2023-10-06T01:21:19.288 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-06T01:21:19.286+0000 7f35a5b9d700 1 --2- 172.21.15.155:0/2033398600 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f35a01539d0 0x7f35a016d5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:21:19.288 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-06T01:21:19.286+0000 7f35a5b9d700 1 --2- 172.21.15.155:0/2033398600 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f35a00ccab0 0x7f35a00c89f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:21:19.288 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-06T01:21:19.286+0000 7f35a5b9d700 1 --2- 172.21.15.155:0/2033398600 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f35a00d0a00 0x7f35a016d0b0 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:21:19.288 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-06T01:21:19.286+0000 7f35a5b9d700 1 -- 172.21.15.155:0/2033398600 >> 172.21.15.155:0/2033398600 conn(0x7f35a0068100 msgr2=0x7f35a0157620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:21:19.288 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-06T01:21:19.286+0000 7f35a5b9d700 1 -- 172.21.15.155:0/2033398600 shutdown_connections 2023-10-06T01:21:19.288 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-06T01:21:19.286+0000 7f35a5b9d700 1 -- 172.21.15.155:0/2033398600 wait complete. 2023-10-06T01:21:19.303 DEBUG:teuthology.orchestra.run.smithi155:> sudo ceph --cluster ceph osd new 417b5f8f-65f1-4c94-91a7-a6ce03fe1679 5 2023-10-06T01:21:19.309 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-10-06T01:21:19.307+0000 7f137d083180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-10-06T01:21:19.366 INFO:tasks.ceph.mgr.x.smithi155.stderr:2023-10-06T01:21:19.364+0000 7f58741fa180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-10-06T01:21:19.432 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-10-06T01:21:19.430+0000 7f137d083180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-10-06T01:21:19.482 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-06T01:21:19.480+0000 7f4ef2d9d700 1 Processor -- start 2023-10-06T01:21:19.482 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-06T01:21:19.480+0000 7f4ef2d9d700 1 -- start start 2023-10-06T01:21:19.483 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-06T01:21:19.481+0000 7f4ef2d9d700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f4eec1539d0 0x7f4eec15a3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:21:19.483 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-06T01:21:19.482+0000 7f4ef2d9d700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4eec0cdc30 con 0x7f4eec0ccab0 2023-10-06T01:21:19.483 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-06T01:21:19.482+0000 7f4ef2d9d700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4eec0cb500 con 0x7f4eec0d0a00 2023-10-06T01:21:19.484 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-06T01:21:19.482+0000 7f4ef2d9d700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4eec15a8f0 con 0x7f4eec1539d0 2023-10-06T01:21:19.484 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-06T01:21:19.482+0000 7f4ef1d9b700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f4eec1539d0 0x7f4eec15a3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:21:19.484 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-06T01:21:19.482+0000 7f4ef259c700 1 --1- >> v1:172.21.15.155:6789/0 conn(0x7f4eec0d0a00 0x7f4eec0ce8a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.155:6789/0 says I am v1:172.21.15.155:33854/0 (socket says 172.21.15.155:33854) 2023-10-06T01:21:19.484 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-06T01:21:19.482+0000 7f4ef259c700 1 -- 172.21.15.155:0/1661583431 learned_addr learned my addr 172.21.15.155:0/1661583431 (peer_addr_for_me v1:172.21.15.155:0/0) 2023-10-06T01:21:19.484 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-06T01:21:19.482+0000 7f4ef1d9b700 1 --2- 172.21.15.155:0/1661583431 >> v2:172.21.15.155:3300/0 conn(0x7f4eec1539d0 0x7f4eec15a3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:48020/0 (socket says 172.21.15.155:48020) 2023-10-06T01:21:19.486 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-06T01:21:19.482+0000 7f4ef1d9b700 1 -- 172.21.15.155:0/1661583431 >> v1:172.21.15.155:6789/0 conn(0x7f4eec0d0a00 legacy=0x7f4eec0ce8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:21:19.486 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-06T01:21:19.482+0000 7f4ef1d9b700 1 -- 172.21.15.155:0/1661583431 >> v1:172.21.15.50:6789/0 conn(0x7f4eec0ccab0 legacy=0x7f4eec0d02f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:21:19.486 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-06T01:21:19.482+0000 7f4ef1d9b700 1 -- 172.21.15.155:0/1661583431 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4eec0cd020 con 0x7f4eec1539d0 2023-10-06T01:21:19.486 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-06T01:21:19.483+0000 7f4ef1d9b700 1 --2- 172.21.15.155:0/1661583431 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4eec1539d0 0x7f4eec15a3b0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f4ee80098e0 tx=0x7f4ee80091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5d8f48335d5fe84 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:21:19.486 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-06T01:21:19.483+0000 7f4ef0d99700 1 -- 172.21.15.155:0/1661583431 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ee8009e80 con 0x7f4eec1539d0 2023-10-06T01:21:19.486 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-06T01:21:19.483+0000 7f4ef0d99700 1 -- 172.21.15.155:0/1661583431 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ee800b860 con 0x7f4eec1539d0 2023-10-06T01:21:19.487 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-06T01:21:19.483+0000 7f4ef0d99700 1 -- 172.21.15.155:0/1661583431 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ee800bbe0 con 0x7f4eec1539d0 2023-10-06T01:21:19.487 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-06T01:21:19.483+0000 7f4ef2d9d700 1 -- 172.21.15.155:0/1661583431 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4eec1539d0 msgr2=0x7f4eec15a3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:21:19.487 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-06T01:21:19.483+0000 7f4ef2d9d700 1 --2- 172.21.15.155:0/1661583431 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4eec1539d0 0x7f4eec15a3b0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f4ee80098e0 tx=0x7f4ee80091a0 comp rx=0 tx=0).stop 2023-10-06T01:21:19.487 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-06T01:21:19.483+0000 7f4ef2d9d700 1 -- 172.21.15.155:0/1661583431 shutdown_connections 2023-10-06T01:21:19.487 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-06T01:21:19.483+0000 7f4ef2d9d700 1 --2- 172.21.15.155:0/1661583431 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4eec1539d0 0x7f4eec15a3b0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:21:19.487 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-06T01:21:19.483+0000 7f4ef2d9d700 1 -- 172.21.15.155:0/1661583431 >> 172.21.15.155:0/1661583431 conn(0x7f4eec068100 msgr2=0x7f4eec0684d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:21:19.488 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-06T01:21:19.484+0000 7f4ef2d9d700 1 -- 172.21.15.155:0/1661583431 shutdown_connections 2023-10-06T01:21:19.488 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-06T01:21:19.484+0000 7f4ef2d9d700 1 -- 172.21.15.155:0/1661583431 wait complete. 2023-10-06T01:21:19.490 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-06T01:21:19.485+0000 7f4ef2d9d700 1 Processor -- start 2023-10-06T01:21:19.490 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-06T01:21:19.485+0000 7f4ef2d9d700 1 -- start start 2023-10-06T01:21:19.490 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-06T01:21:19.486+0000 7f4ef2d9d700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4eec0ccab0 0x7f4eec151790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:21:19.490 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-06T01:21:19.486+0000 7f4ef2d9d700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4eec0d0a00 0x7f4eec0b3a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:21:19.491 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-06T01:21:19.486+0000 7f4ef2d9d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4eec1539d0 0x7f4eec0b0fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:21:19.491 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-06T01:21:19.486+0000 7f4ef2d9d700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4eec1549b0 con 0x7f4eec1539d0 2023-10-06T01:21:19.491 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-06T01:21:19.486+0000 7f4ef2d9d700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4eec151cd0 con 0x7f4eec0d0a00 2023-10-06T01:21:19.491 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-06T01:21:19.486+0000 7f4ef2d9d700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4eec153da0 con 0x7f4eec0ccab0 2023-10-06T01:21:19.491 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-06T01:21:19.486+0000 7f4ef1d9b700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4eec0ccab0 0x7f4eec151790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:21:19.491 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-06T01:21:19.486+0000 7f4ef159a700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4eec0d0a00 0x7f4eec0b3a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:21:19.492 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-06T01:21:19.486+0000 7f4ef1d9b700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4eec0ccab0 0x7f4eec151790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3301/0 says I am v2:172.21.15.155:35950/0 (socket says 172.21.15.155:35950) 2023-10-06T01:21:19.492 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-06T01:21:19.486+0000 7f4ef1d9b700 1 -- 172.21.15.155:0/431755522 learned_addr learned my addr 172.21.15.155:0/431755522 (peer_addr_for_me v2:172.21.15.155:0/0) 2023-10-06T01:21:19.492 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-06T01:21:19.486+0000 7f4ef259c700 1 --2- 172.21.15.155:0/431755522 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4eec1539d0 0x7f4eec0b0fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:21:19.492 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-06T01:21:19.487+0000 7f4ef159a700 1 -- 172.21.15.155:0/431755522 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4eec0ccab0 msgr2=0x7f4eec151790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:21:19.492 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-06T01:21:19.487+0000 7f4ef159a700 1 --2- 172.21.15.155:0/431755522 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4eec0ccab0 0x7f4eec151790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:21:19.492 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-06T01:21:19.487+0000 7f4ef159a700 1 -- 172.21.15.155:0/431755522 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4eec1539d0 msgr2=0x7f4eec0b0fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:21:19.493 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-06T01:21:19.487+0000 7f4ef159a700 1 --2- 172.21.15.155:0/431755522 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4eec1539d0 0x7f4eec0b0fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:21:19.493 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-06T01:21:19.487+0000 7f4ef159a700 1 -- 172.21.15.155:0/431755522 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ee8009420 con 0x7f4eec0d0a00 2023-10-06T01:21:19.493 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-06T01:21:19.487+0000 7f4ef1d9b700 1 --2- 172.21.15.155:0/431755522 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4eec0ccab0 0x7f4eec151790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T01:21:19.493 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-06T01:21:19.487+0000 7f4ef159a700 1 --2- 172.21.15.155:0/431755522 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4eec0d0a00 0x7f4eec0b3a50 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f4edc00c490 tx=0x7f4edc007ec0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:21:19.493 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-06T01:21:19.487+0000 7f4ee1ffb700 1 -- 172.21.15.155:0/431755522 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4edc00ce40 con 0x7f4eec0d0a00 2023-10-06T01:21:19.493 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-06T01:21:19.487+0000 7f4ee1ffb700 1 -- 172.21.15.155:0/431755522 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4edc011590 con 0x7f4eec0d0a00 2023-10-06T01:21:19.493 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-06T01:21:19.487+0000 7f4ef2d9d700 1 -- 172.21.15.155:0/431755522 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4eec154080 con 0x7f4eec0d0a00 2023-10-06T01:21:19.494 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-06T01:21:19.487+0000 7f4ee1ffb700 1 -- 172.21.15.155:0/431755522 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4edc011950 con 0x7f4eec0d0a00 2023-10-06T01:21:19.494 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-06T01:21:19.487+0000 7f4ef2d9d700 1 -- 172.21.15.155:0/431755522 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4eec154640 con 0x7f4eec0d0a00 2023-10-06T01:21:19.494 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-06T01:21:19.488+0000 7f4ee1ffb700 1 -- 172.21.15.155:0/431755522 <== mon.1 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7f4edc01c440 con 0x7f4eec0d0a00 2023-10-06T01:21:19.494 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-06T01:21:19.488+0000 7f4ee1ffb700 1 -- 172.21.15.155:0/431755522 <== mon.1 v2:172.21.15.155:3300/0 5 ==== osd_map(7..7 src has 1..7) v4 ==== 1296+0+0 (secure 0 0 0) 0x7f4edc001020 con 0x7f4eec0d0a00 2023-10-06T01:21:19.494 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-06T01:21:19.488+0000 7f4ef2d9d700 1 -- 172.21.15.155:0/431755522 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4eec05f270 con 0x7f4eec0d0a00 2023-10-06T01:21:19.495 INFO:tasks.ceph.mgr.x.smithi155.stderr:2023-10-06T01:21:19.490+0000 7f58741fa180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-10-06T01:21:19.495 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-06T01:21:19.491+0000 7f4ee1ffb700 1 -- 172.21.15.155:0/431755522 <== mon.1 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7f4edc017070 con 0x7f4eec0d0a00 2023-10-06T01:21:19.577 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-06T01:21:19.576+0000 7f4ef2d9d700 1 -- 172.21.15.155:0/431755522 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "osd new", "uuid": "417b5f8f-65f1-4c94-91a7-a6ce03fe1679", "id": 5} v 0) v1 -- 0x7f4eec154af0 con 0x7f4eec0d0a00 2023-10-06T01:21:19.585 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-06T01:21:19.584+0000 7f4ee1ffb700 1 -- 172.21.15.155:0/431755522 <== mon.1 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "417b5f8f-65f1-4c94-91a7-a6ce03fe1679", "id": 5}]=0 v8) v1 ==== 112+0+2 (secure 0 0 0) 0x7f4edc01c6f0 con 0x7f4eec0d0a00 2023-10-06T01:21:19.586 INFO:teuthology.orchestra.run.smithi155.stdout:5 2023-10-06T01:21:19.587 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-06T01:21:19.585+0000 7f4ef2d9d700 1 -- 172.21.15.155:0/431755522 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4eec0d0a00 msgr2=0x7f4eec0b3a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:21:19.587 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-06T01:21:19.585+0000 7f4ef2d9d700 1 --2- 172.21.15.155:0/431755522 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4eec0d0a00 0x7f4eec0b3a50 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f4edc00c490 tx=0x7f4edc007ec0 comp rx=0 tx=0).stop 2023-10-06T01:21:19.587 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-06T01:21:19.585+0000 7f4ef2d9d700 1 -- 172.21.15.155:0/431755522 shutdown_connections 2023-10-06T01:21:19.587 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-06T01:21:19.585+0000 7f4ef2d9d700 1 --2- 172.21.15.155:0/431755522 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4eec1539d0 0x7f4eec0b0fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:21:19.587 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-06T01:21:19.585+0000 7f4ef2d9d700 1 --2- 172.21.15.155:0/431755522 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4eec0ccab0 0x7f4eec151790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:21:19.587 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-06T01:21:19.585+0000 7f4ef2d9d700 1 --2- 172.21.15.155:0/431755522 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4eec0d0a00 0x7f4eec0b3a50 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:21:19.588 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-06T01:21:19.585+0000 7f4ef2d9d700 1 -- 172.21.15.155:0/431755522 >> 172.21.15.155:0/431755522 conn(0x7f4eec068100 msgr2=0x7f4eec157590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:21:19.588 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-06T01:21:19.585+0000 7f4ef2d9d700 1 -- 172.21.15.155:0/431755522 shutdown_connections 2023-10-06T01:21:19.588 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-06T01:21:19.585+0000 7f4ef2d9d700 1 -- 172.21.15.155:0/431755522 wait complete. 2023-10-06T01:21:19.603 DEBUG:teuthology.orchestra.run.smithi155:> sudo ceph --cluster ceph osd new c150cff3-aee4-4714-9c08-d182b1ba9ffd 6 2023-10-06T01:21:19.780 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-06T01:21:19.778+0000 7fe4ab59d700 1 Processor -- start 2023-10-06T01:21:19.780 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-06T01:21:19.779+0000 7fe4ab59d700 1 -- start start 2023-10-06T01:21:19.782 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-06T01:21:19.780+0000 7fe4ab59d700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fe4a41539d0 0x7fe4a415a3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:21:19.783 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-06T01:21:19.780+0000 7fe4ab59d700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe4a40cdc30 con 0x7fe4a40d0a00 2023-10-06T01:21:19.783 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-06T01:21:19.780+0000 7fe4ab59d700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe4a40cb500 con 0x7fe4a40ccab0 2023-10-06T01:21:19.783 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-06T01:21:19.780+0000 7fe4ab59d700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe4a415a8f0 con 0x7fe4a41539d0 2023-10-06T01:21:19.783 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-06T01:21:19.780+0000 7fe4aa59b700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fe4a41539d0 0x7fe4a415a3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:21:19.783 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-06T01:21:19.780+0000 7fe4aa59b700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fe4a41539d0 0x7fe4a415a3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:48046/0 (socket says 172.21.15.155:48046) 2023-10-06T01:21:19.783 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-06T01:21:19.780+0000 7fe4aa59b700 1 -- 172.21.15.155:0/2537066462 learned_addr learned my addr 172.21.15.155:0/2537066462 (peer_addr_for_me v2:172.21.15.155:0/0) 2023-10-06T01:21:19.783 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-06T01:21:19.780+0000 7fe4a9d9a700 1 --1- 172.21.15.155:0/2537066462 >> v1:172.21.15.155:6789/0 conn(0x7fe4a40ccab0 0x7fe4a40d02f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.155:6789/0 says I am v1:172.21.15.155:33864/0 (socket says 172.21.15.155:33864) 2023-10-06T01:21:19.783 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-06T01:21:19.781+0000 7fe4aa59b700 1 -- 172.21.15.155:0/2537066462 >> v1:172.21.15.155:6789/0 conn(0x7fe4a40ccab0 legacy=0x7fe4a40d02f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:21:19.783 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-06T01:21:19.781+0000 7fe4aa59b700 1 -- 172.21.15.155:0/2537066462 >> v1:172.21.15.50:6789/0 conn(0x7fe4a40d0a00 legacy=0x7fe4a40ce8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:21:19.783 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-06T01:21:19.781+0000 7fe4aa59b700 1 -- 172.21.15.155:0/2537066462 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4a40cd020 con 0x7fe4a41539d0 2023-10-06T01:21:19.784 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-06T01:21:19.781+0000 7fe4aa59b700 1 --2- 172.21.15.155:0/2537066462 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe4a41539d0 0x7fe4a415a3b0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fe4a00099b0 tx=0x7fe4a0009250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2d71bcd0d6803954 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:21:19.784 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-06T01:21:19.781+0000 7fe4a9599700 1 -- 172.21.15.155:0/2537066462 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4a000b860 con 0x7fe4a41539d0 2023-10-06T01:21:19.784 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-06T01:21:19.781+0000 7fe4a9599700 1 -- 172.21.15.155:0/2537066462 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe4a000b9c0 con 0x7fe4a41539d0 2023-10-06T01:21:19.784 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-06T01:21:19.781+0000 7fe4a9599700 1 -- 172.21.15.155:0/2537066462 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4a000bd60 con 0x7fe4a41539d0 2023-10-06T01:21:19.785 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-06T01:21:19.782+0000 7fe4ab59d700 1 -- 172.21.15.155:0/2537066462 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe4a41539d0 msgr2=0x7fe4a415a3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:21:19.785 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-06T01:21:19.782+0000 7fe4ab59d700 1 --2- 172.21.15.155:0/2537066462 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe4a41539d0 0x7fe4a415a3b0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fe4a00099b0 tx=0x7fe4a0009250 comp rx=0 tx=0).stop 2023-10-06T01:21:19.785 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-06T01:21:19.782+0000 7fe4ab59d700 1 -- 172.21.15.155:0/2537066462 shutdown_connections 2023-10-06T01:21:19.785 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-06T01:21:19.782+0000 7fe4ab59d700 1 --2- 172.21.15.155:0/2537066462 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe4a41539d0 0x7fe4a415a3b0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:21:19.785 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-06T01:21:19.782+0000 7fe4ab59d700 1 -- 172.21.15.155:0/2537066462 >> 172.21.15.155:0/2537066462 conn(0x7fe4a4068100 msgr2=0x7fe4a40684d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:21:19.785 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-06T01:21:19.782+0000 7fe4ab59d700 1 -- 172.21.15.155:0/2537066462 shutdown_connections 2023-10-06T01:21:19.785 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-06T01:21:19.782+0000 7fe4ab59d700 1 -- 172.21.15.155:0/2537066462 wait complete. 2023-10-06T01:21:19.786 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-06T01:21:19.783+0000 7fe4ab59d700 1 Processor -- start 2023-10-06T01:21:19.786 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-06T01:21:19.784+0000 7fe4ab59d700 1 -- start start 2023-10-06T01:21:19.788 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-06T01:21:19.784+0000 7fe4ab59d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe4a40ccab0 0x7fe4a416aad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:21:19.788 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-06T01:21:19.784+0000 7fe4ab59d700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe4a40d0a00 0x7fe4a40b0000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:21:19.788 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-06T01:21:19.785+0000 7fe4ab59d700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe4a41539d0 0x7fe4a4148e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:21:19.788 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-06T01:21:19.785+0000 7fe4ab59d700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4a40c8d10 con 0x7fe4a40ccab0 2023-10-06T01:21:19.788 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-06T01:21:19.785+0000 7fe4ab59d700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4a40b0830 con 0x7fe4a41539d0 2023-10-06T01:21:19.788 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-06T01:21:19.785+0000 7fe4ab59d700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe4a40b0b10 con 0x7fe4a40d0a00 2023-10-06T01:21:19.789 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-06T01:21:19.785+0000 7fe4a9d9a700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe4a40d0a00 0x7fe4a40b0000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:21:19.789 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-06T01:21:19.785+0000 7fe4a9d9a700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe4a40d0a00 0x7fe4a40b0000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3301/0 says I am v2:172.21.15.155:35960/0 (socket says 172.21.15.155:35960) 2023-10-06T01:21:19.789 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-06T01:21:19.785+0000 7fe4a9d9a700 1 -- 172.21.15.155:0/4066624935 learned_addr learned my addr 172.21.15.155:0/4066624935 (peer_addr_for_me v2:172.21.15.155:0/0) 2023-10-06T01:21:19.789 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-06T01:21:19.785+0000 7fe4aad9c700 1 --2- 172.21.15.155:0/4066624935 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe4a41539d0 0x7fe4a4148e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:21:19.789 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-06T01:21:19.785+0000 7fe4aa59b700 1 --2- 172.21.15.155:0/4066624935 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe4a40ccab0 0x7fe4a416aad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:21:19.789 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-06T01:21:19.785+0000 7fe4a9d9a700 1 -- 172.21.15.155:0/4066624935 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe4a41539d0 msgr2=0x7fe4a4148e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:21:19.789 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-06T01:21:19.785+0000 7fe4a9d9a700 1 --2- 172.21.15.155:0/4066624935 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe4a41539d0 0x7fe4a4148e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:21:19.789 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-06T01:21:19.785+0000 7fe4a9d9a700 1 -- 172.21.15.155:0/4066624935 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe4a40ccab0 msgr2=0x7fe4a416aad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:21:19.789 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-06T01:21:19.785+0000 7fe4a9d9a700 1 --2- 172.21.15.155:0/4066624935 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe4a40ccab0 0x7fe4a416aad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:21:19.789 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-06T01:21:19.785+0000 7fe4a9d9a700 1 -- 172.21.15.155:0/4066624935 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4a00094f0 con 0x7fe4a40d0a00 2023-10-06T01:21:19.789 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-06T01:21:19.785+0000 7fe4a9d9a700 1 --2- 172.21.15.155:0/4066624935 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe4a40d0a00 0x7fe4a40b0000 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fe49400c560 tx=0x7fe494007f70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:21:19.790 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-06T01:21:19.786+0000 7fe49a7fc700 1 -- 172.21.15.155:0/4066624935 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe494005a70 con 0x7fe4a40d0a00 2023-10-06T01:21:19.790 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-06T01:21:19.786+0000 7fe49a7fc700 1 -- 172.21.15.155:0/4066624935 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe494005bd0 con 0x7fe4a40d0a00 2023-10-06T01:21:19.790 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-06T01:21:19.786+0000 7fe4ab59d700 1 -- 172.21.15.155:0/4066624935 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe4a40b0df0 con 0x7fe4a40d0a00 2023-10-06T01:21:19.790 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-06T01:21:19.786+0000 7fe49a7fc700 1 -- 172.21.15.155:0/4066624935 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4940070d0 con 0x7fe4a40d0a00 2023-10-06T01:21:19.790 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-06T01:21:19.786+0000 7fe4ab59d700 1 -- 172.21.15.155:0/4066624935 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe4a4149350 con 0x7fe4a40d0a00 2023-10-06T01:21:19.790 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-06T01:21:19.786+0000 7fe49a7fc700 1 -- 172.21.15.155:0/4066624935 <== mon.2 v2:172.21.15.155:3301/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7fe49401c440 con 0x7fe4a40d0a00 2023-10-06T01:21:19.790 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-06T01:21:19.786+0000 7fe49a7fc700 1 -- 172.21.15.155:0/4066624935 <== mon.2 v2:172.21.15.155:3301/0 5 ==== osd_map(8..8 src has 1..8) v4 ==== 1411+0+0 (secure 0 0 0) 0x7fe494007700 con 0x7fe4a40d0a00 2023-10-06T01:21:19.790 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-06T01:21:19.787+0000 7fe4ab59d700 1 -- 172.21.15.155:0/4066624935 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe4a40b0fe0 con 0x7fe4a40d0a00 2023-10-06T01:21:19.791 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-06T01:21:19.789+0000 7fe49a7fc700 1 -- 172.21.15.155:0/4066624935 <== mon.2 v2:172.21.15.155:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7fe494017070 con 0x7fe4a40d0a00 2023-10-06T01:21:19.877 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-06T01:21:19.875+0000 7fe4ab59d700 1 -- 172.21.15.155:0/4066624935 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_command({"prefix": "osd new", "uuid": "c150cff3-aee4-4714-9c08-d182b1ba9ffd", "id": 6} v 0) v1 -- 0x7fe4a40c8b00 con 0x7fe4a40d0a00 2023-10-06T01:21:19.885 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-06T01:21:19.884+0000 7fe49a7fc700 1 -- 172.21.15.155:0/4066624935 <== mon.2 v2:172.21.15.155:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "c150cff3-aee4-4714-9c08-d182b1ba9ffd", "id": 6}]=0 v9) v1 ==== 112+0+2 (secure 0 0 0) 0x7fe49401c6f0 con 0x7fe4a40d0a00 2023-10-06T01:21:19.885 INFO:teuthology.orchestra.run.smithi155.stdout:6 2023-10-06T01:21:19.886 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-06T01:21:19.885+0000 7fe4ab59d700 1 -- 172.21.15.155:0/4066624935 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe4a40d0a00 msgr2=0x7fe4a40b0000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:21:19.886 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-06T01:21:19.885+0000 7fe4ab59d700 1 --2- 172.21.15.155:0/4066624935 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe4a40d0a00 0x7fe4a40b0000 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fe49400c560 tx=0x7fe494007f70 comp rx=0 tx=0).stop 2023-10-06T01:21:19.887 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-06T01:21:19.885+0000 7fe4ab59d700 1 -- 172.21.15.155:0/4066624935 shutdown_connections 2023-10-06T01:21:19.887 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-06T01:21:19.885+0000 7fe4ab59d700 1 --2- 172.21.15.155:0/4066624935 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe4a41539d0 0x7fe4a4148e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:21:19.887 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-06T01:21:19.885+0000 7fe4ab59d700 1 --2- 172.21.15.155:0/4066624935 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe4a40ccab0 0x7fe4a416aad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:21:19.887 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-06T01:21:19.885+0000 7fe4ab59d700 1 --2- 172.21.15.155:0/4066624935 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe4a40d0a00 0x7fe4a40b0000 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:21:19.887 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-06T01:21:19.885+0000 7fe4ab59d700 1 -- 172.21.15.155:0/4066624935 >> 172.21.15.155:0/4066624935 conn(0x7fe4a4068100 msgr2=0x7fe4a4069ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:21:19.887 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-06T01:21:19.885+0000 7fe4ab59d700 1 -- 172.21.15.155:0/4066624935 shutdown_connections 2023-10-06T01:21:19.887 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-06T01:21:19.885+0000 7fe4ab59d700 1 -- 172.21.15.155:0/4066624935 wait complete. 2023-10-06T01:21:19.903 DEBUG:teuthology.orchestra.run.smithi155:> sudo ceph --cluster ceph osd new 71107f0e-04d1-4e72-a0ec-0faf6af003e7 7 2023-10-06T01:21:20.054 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-10-06T01:21:20.052+0000 7f137d083180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-10-06T01:21:20.081 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-06T01:21:20.080+0000 7f9b7899d700 1 Processor -- start 2023-10-06T01:21:20.081 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-06T01:21:20.080+0000 7f9b7899d700 1 -- start start 2023-10-06T01:21:20.082 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-06T01:21:20.081+0000 7f9b7899d700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f9b740b2660 0x7f9b740cccf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:21:20.082 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-06T01:21:20.081+0000 7f9b7899d700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f9b740cf1f0 0x7f9b740cd230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:21:20.083 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-06T01:21:20.081+0000 7f9b7899d700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9b740cc9b0 con 0x7f9b740b2a30 2023-10-06T01:21:20.083 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-06T01:21:20.081+0000 7f9b7899d700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9b740cbda0 con 0x7f9b740b2660 2023-10-06T01:21:20.083 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-06T01:21:20.081+0000 7f9b7899d700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9b740cc080 con 0x7f9b740cf1f0 2023-10-06T01:21:20.085 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-06T01:21:20.081+0000 7f9b73fff700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f9b740cf1f0 0x7f9b740cd230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:21:20.085 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-06T01:21:20.082+0000 7f9b737fe700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f9b740b2660 0x7f9b740cccf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:21:20.085 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-06T01:21:20.082+0000 7f9b737fe700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f9b740b2660 0x7f9b740cccf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.155:33056/0 (socket says 172.21.15.155:33056) 2023-10-06T01:21:20.085 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-06T01:21:20.082+0000 7f9b737fe700 1 -- 172.21.15.155:0/1322804278 learned_addr learned my addr 172.21.15.155:0/1322804278 (peer_addr_for_me v2:172.21.15.155:0/0) 2023-10-06T01:21:20.085 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-06T01:21:20.082+0000 7f9b727fc700 1 -- 172.21.15.155:0/1322804278 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 525944661 0 0) 0x7f9b740cc9b0 con 0x7f9b740b2a30 2023-10-06T01:21:20.085 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-06T01:21:20.082+0000 7f9b727fc700 1 -- 172.21.15.155:0/1322804278 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9b5c003570 con 0x7f9b740b2a30 2023-10-06T01:21:20.085 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-06T01:21:20.082+0000 7f9b737fe700 1 -- 172.21.15.155:0/1322804278 >> v2:172.21.15.155:3300/0 conn(0x7f9b740cf1f0 msgr2=0x7f9b740cd230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:21:20.085 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-06T01:21:20.082+0000 7f9b737fe700 1 --2- 172.21.15.155:0/1322804278 >> v2:172.21.15.155:3300/0 conn(0x7f9b740cf1f0 0x7f9b740cd230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:21:20.086 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-06T01:21:20.082+0000 7f9b737fe700 1 -- 172.21.15.155:0/1322804278 >> v1:172.21.15.50:6789/0 conn(0x7f9b740b2a30 legacy=0x7f9b740ceae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:21:20.086 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-06T01:21:20.082+0000 7f9b737fe700 1 -- 172.21.15.155:0/1322804278 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b740cc360 con 0x7f9b740b2660 2023-10-06T01:21:20.086 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-06T01:21:20.082+0000 7f9b737fe700 1 --2- 172.21.15.155:0/1322804278 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9b740b2660 0x7f9b740cccf0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f9b740894b0 tx=0x7f9b64009220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fa8c58ba3dfce88c server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:21:20.086 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-06T01:21:20.083+0000 7f9b727fc700 1 -- 172.21.15.155:0/1322804278 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b64005c10 con 0x7f9b740b2660 2023-10-06T01:21:20.086 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-06T01:21:20.083+0000 7f9b727fc700 1 -- 172.21.15.155:0/1322804278 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b64005d70 con 0x7f9b740b2660 2023-10-06T01:21:20.086 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-06T01:21:20.083+0000 7f9b727fc700 1 -- 172.21.15.155:0/1322804278 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b64006260 con 0x7f9b740b2660 2023-10-06T01:21:20.086 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-06T01:21:20.083+0000 7f9b7899d700 1 -- 172.21.15.155:0/1322804278 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9b740b2660 msgr2=0x7f9b740cccf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:21:20.086 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-06T01:21:20.083+0000 7f9b7899d700 1 --2- 172.21.15.155:0/1322804278 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9b740b2660 0x7f9b740cccf0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f9b740894b0 tx=0x7f9b64009220 comp rx=0 tx=0).stop 2023-10-06T01:21:20.086 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-06T01:21:20.083+0000 7f9b7899d700 1 -- 172.21.15.155:0/1322804278 shutdown_connections 2023-10-06T01:21:20.086 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-06T01:21:20.083+0000 7f9b7899d700 1 --2- 172.21.15.155:0/1322804278 >> v2:172.21.15.155:3300/0 conn(0x7f9b740cf1f0 0x7f9b740cd230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:21:20.087 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-06T01:21:20.083+0000 7f9b7899d700 1 --2- 172.21.15.155:0/1322804278 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9b740b2660 0x7f9b740cccf0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:21:20.087 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-06T01:21:20.083+0000 7f9b7899d700 1 -- 172.21.15.155:0/1322804278 >> 172.21.15.155:0/1322804278 conn(0x7f9b74099560 msgr2=0x7f9b7406f500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:21:20.087 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-06T01:21:20.083+0000 7f9b7899d700 1 -- 172.21.15.155:0/1322804278 shutdown_connections 2023-10-06T01:21:20.087 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-06T01:21:20.083+0000 7f9b7899d700 1 -- 172.21.15.155:0/1322804278 wait complete. 2023-10-06T01:21:20.089 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-06T01:21:20.085+0000 7f9b7899d700 1 Processor -- start 2023-10-06T01:21:20.089 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-06T01:21:20.085+0000 7f9b7899d700 1 -- start start 2023-10-06T01:21:20.089 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-06T01:21:20.086+0000 7f9b7899d700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9b740b2660 0x7f9b74154920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:21:20.089 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-06T01:21:20.086+0000 7f9b7899d700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9b740b2a30 0x7f9b740b30d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:21:20.089 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-06T01:21:20.086+0000 7f9b7899d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9b740cf1f0 0x7f9b740c9770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:21:20.090 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-06T01:21:20.086+0000 7f9b7899d700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b740c75f0 con 0x7f9b740cf1f0 2023-10-06T01:21:20.090 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-06T01:21:20.086+0000 7f9b7899d700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b74154e60 con 0x7f9b740b2a30 2023-10-06T01:21:20.090 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-06T01:21:20.086+0000 7f9b7899d700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b740b3a90 con 0x7f9b740b2660 2023-10-06T01:21:20.090 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-06T01:21:20.086+0000 7f9b72ffd700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9b740b2a30 0x7f9b740b30d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:21:20.090 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-06T01:21:20.086+0000 7f9b737fe700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9b740b2660 0x7f9b74154920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:21:20.090 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-06T01:21:20.086+0000 7f9b72ffd700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9b740b2a30 0x7f9b740b30d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:48068/0 (socket says 172.21.15.155:48068) 2023-10-06T01:21:20.090 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-06T01:21:20.086+0000 7f9b72ffd700 1 -- 172.21.15.155:0/360664856 learned_addr learned my addr 172.21.15.155:0/360664856 (peer_addr_for_me v2:172.21.15.155:0/0) 2023-10-06T01:21:20.090 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-06T01:21:20.086+0000 7f9b73fff700 1 --2- 172.21.15.155:0/360664856 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9b740cf1f0 0x7f9b740c9770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:21:20.090 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-06T01:21:20.087+0000 7f9b72ffd700 1 -- 172.21.15.155:0/360664856 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9b740b2660 msgr2=0x7f9b74154920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:21:20.090 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-06T01:21:20.087+0000 7f9b72ffd700 1 --2- 172.21.15.155:0/360664856 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9b740b2660 0x7f9b74154920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:21:20.091 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-06T01:21:20.087+0000 7f9b72ffd700 1 -- 172.21.15.155:0/360664856 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9b740cf1f0 msgr2=0x7f9b740c9770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:21:20.091 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-06T01:21:20.087+0000 7f9b72ffd700 1 --2- 172.21.15.155:0/360664856 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9b740cf1f0 0x7f9b740c9770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:21:20.091 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-06T01:21:20.087+0000 7f9b72ffd700 1 -- 172.21.15.155:0/360664856 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b64009480 con 0x7f9b740b2a30 2023-10-06T01:21:20.091 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-06T01:21:20.087+0000 7f9b72ffd700 1 --2- 172.21.15.155:0/360664856 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9b740b2a30 0x7f9b740b30d0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f9b6800c7c0 tx=0x7f9b68007de0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:21:20.091 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-06T01:21:20.087+0000 7f9b5b7fe700 1 -- 172.21.15.155:0/360664856 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b68010510 con 0x7f9b740b2a30 2023-10-06T01:21:20.091 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-06T01:21:20.087+0000 7f9b5b7fe700 1 -- 172.21.15.155:0/360664856 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b680106b0 con 0x7f9b740b2a30 2023-10-06T01:21:20.091 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-06T01:21:20.087+0000 7f9b7899d700 1 -- 172.21.15.155:0/360664856 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9b740b3d70 con 0x7f9b740b2a30 2023-10-06T01:21:20.091 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-06T01:21:20.087+0000 7f9b5b7fe700 1 -- 172.21.15.155:0/360664856 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b68010a70 con 0x7f9b740b2a30 2023-10-06T01:21:20.091 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-06T01:21:20.087+0000 7f9b7899d700 1 -- 172.21.15.155:0/360664856 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9b74155190 con 0x7f9b740b2a30 2023-10-06T01:21:20.091 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-06T01:21:20.088+0000 7f9b5b7fe700 1 -- 172.21.15.155:0/360664856 <== mon.1 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7f9b6801c6c0 con 0x7f9b740b2a30 2023-10-06T01:21:20.092 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-06T01:21:20.088+0000 7f9b5b7fe700 1 -- 172.21.15.155:0/360664856 <== mon.1 v2:172.21.15.155:3300/0 5 ==== osd_map(9..9 src has 1..9) v4 ==== 1526+0+0 (secure 0 0 0) 0x7f9b68010e20 con 0x7f9b740b2a30 2023-10-06T01:21:20.092 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-06T01:21:20.089+0000 7f9b7899d700 1 -- 172.21.15.155:0/360664856 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9b740b4290 con 0x7f9b740b2a30 2023-10-06T01:21:20.092 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-06T01:21:20.091+0000 7f9b5b7fe700 1 -- 172.21.15.155:0/360664856 <== mon.1 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7f9b740b4290 con 0x7f9b740b2a30 2023-10-06T01:21:20.121 INFO:tasks.ceph.mgr.x.smithi155.stderr:2023-10-06T01:21:20.120+0000 7f58741fa180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-10-06T01:21:20.154 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-10-06T01:21:20.152+0000 7f137d083180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-10-06T01:21:20.178 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-06T01:21:20.177+0000 7f9b7899d700 1 -- 172.21.15.155:0/360664856 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "osd new", "uuid": "71107f0e-04d1-4e72-a0ec-0faf6af003e7", "id": 7} v 0) v1 -- 0x7f9b740c73a0 con 0x7f9b740b2a30 2023-10-06T01:21:20.187 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-06T01:21:20.185+0000 7f9b5b7fe700 1 -- 172.21.15.155:0/360664856 <== mon.1 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "71107f0e-04d1-4e72-a0ec-0faf6af003e7", "id": 7}]=0 v10) v1 ==== 112+0+2 (secure 0 0 0) 0x7f9b68021060 con 0x7f9b740b2a30 2023-10-06T01:21:20.187 INFO:teuthology.orchestra.run.smithi155.stdout:7 2023-10-06T01:21:20.188 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-06T01:21:20.187+0000 7f9b7899d700 1 -- 172.21.15.155:0/360664856 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9b740b2a30 msgr2=0x7f9b740b30d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:21:20.188 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-06T01:21:20.187+0000 7f9b7899d700 1 --2- 172.21.15.155:0/360664856 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9b740b2a30 0x7f9b740b30d0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f9b6800c7c0 tx=0x7f9b68007de0 comp rx=0 tx=0).stop 2023-10-06T01:21:20.188 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-06T01:21:20.187+0000 7f9b7899d700 1 -- 172.21.15.155:0/360664856 shutdown_connections 2023-10-06T01:21:20.188 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-06T01:21:20.187+0000 7f9b7899d700 1 --2- 172.21.15.155:0/360664856 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9b740cf1f0 0x7f9b740c9770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:21:20.189 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-06T01:21:20.187+0000 7f9b7899d700 1 --2- 172.21.15.155:0/360664856 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9b740b2660 0x7f9b74154920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:21:20.189 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-06T01:21:20.187+0000 7f9b7899d700 1 --2- 172.21.15.155:0/360664856 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9b740b2a30 0x7f9b740b30d0 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:21:20.189 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-06T01:21:20.187+0000 7f9b7899d700 1 -- 172.21.15.155:0/360664856 >> 172.21.15.155:0/360664856 conn(0x7f9b74099560 msgr2=0x7f9b74068840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:21:20.189 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-06T01:21:20.187+0000 7f9b7899d700 1 -- 172.21.15.155:0/360664856 shutdown_connections 2023-10-06T01:21:20.189 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-06T01:21:20.187+0000 7f9b7899d700 1 -- 172.21.15.155:0/360664856 wait complete. 2023-10-06T01:21:20.205 INFO:tasks.ceph.osd.0:Restarting daemon 2023-10-06T01:21:20.205 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2023-10-06T01:21:20.209 INFO:tasks.ceph.osd.0:Started 2023-10-06T01:21:20.209 INFO:tasks.ceph.osd.1:Restarting daemon 2023-10-06T01:21:20.209 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2023-10-06T01:21:20.213 INFO:tasks.ceph.osd.1:Started 2023-10-06T01:21:20.214 INFO:tasks.ceph.osd.2:Restarting daemon 2023-10-06T01:21:20.214 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2023-10-06T01:21:20.218 INFO:tasks.ceph.osd.2:Started 2023-10-06T01:21:20.218 INFO:tasks.ceph.osd.3:Restarting daemon 2023-10-06T01:21:20.218 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2023-10-06T01:21:20.221 INFO:tasks.ceph.mgr.x.smithi155.stderr:2023-10-06T01:21:20.220+0000 7f58741fa180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-10-06T01:21:20.224 INFO:tasks.ceph.osd.3:Started 2023-10-06T01:21:20.224 INFO:tasks.ceph.osd.4:Restarting daemon 2023-10-06T01:21:20.224 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2023-10-06T01:21:20.228 INFO:tasks.ceph.osd.4:Started 2023-10-06T01:21:20.229 INFO:tasks.ceph.osd.5:Restarting daemon 2023-10-06T01:21:20.229 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2023-10-06T01:21:20.233 INFO:tasks.ceph.osd.5:Started 2023-10-06T01:21:20.233 INFO:tasks.ceph.osd.6:Restarting daemon 2023-10-06T01:21:20.233 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2023-10-06T01:21:20.238 INFO:tasks.ceph.osd.6:Started 2023-10-06T01:21:20.238 INFO:tasks.ceph.osd.7:Restarting daemon 2023-10-06T01:21:20.238 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2023-10-06T01:21:20.243 INFO:tasks.ceph.osd.7:Started 2023-10-06T01:21:20.244 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T01:21:20.272 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-10-06T01:21:20.270+0000 7f137d083180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-10-06T01:21:20.336 INFO:tasks.ceph.mgr.x.smithi155.stderr:2023-10-06T01:21:20.334+0000 7f58741fa180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-10-06T01:21:20.467 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:20.465+0000 7f8b9739d700 1 Processor -- start 2023-10-06T01:21:20.467 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:20.465+0000 7f8b9739d700 1 -- start start 2023-10-06T01:21:20.468 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:20.466+0000 7f8b9739d700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f8b90159480 0x7f8b900b30d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:21:20.468 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:20.466+0000 7f8b9739d700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8b900cb7e0 con 0x7f8b900b2140 2023-10-06T01:21:20.469 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:20.466+0000 7f8b9739d700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8b900b08a0 con 0x7f8b900b3610 2023-10-06T01:21:20.469 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:20.467+0000 7f8b9739d700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8b900cb190 con 0x7f8b90159480 2023-10-06T01:21:20.469 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:20.467+0000 7f8b96b9c700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f8b900b2140 0x7f8b900b2560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:47886/0 (socket says 172.21.15.50:47886) 2023-10-06T01:21:20.469 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:20.467+0000 7f8b96b9c700 1 -- 172.21.15.50:0/2262683520 learned_addr learned my addr 172.21.15.50:0/2262683520 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-10-06T01:21:20.469 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:20.467+0000 7f8b9639b700 1 --2- 172.21.15.50:0/2262683520 >> v2:172.21.15.155:3300/0 conn(0x7f8b90159480 0x7f8b900b30d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:21:20.471 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:20.467+0000 7f8b95399700 1 -- 172.21.15.50:0/2262683520 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3197695880 0 0) 0x7f8b900b08a0 con 0x7f8b900b3610 2023-10-06T01:21:20.471 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:20.467+0000 7f8b95399700 1 -- 172.21.15.50:0/2262683520 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8b7c003570 con 0x7f8b900b3610 2023-10-06T01:21:20.472 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:20.467+0000 7f8b9639b700 1 -- 172.21.15.50:0/2262683520 >> v1:172.21.15.155:6789/0 conn(0x7f8b900b3610 legacy=0x7f8b900cbc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:21:20.472 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:20.467+0000 7f8b95399700 1 -- 172.21.15.50:0/2262683520 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2556589160 0 0) 0x7f8b900cb7e0 con 0x7f8b900b2140 2023-10-06T01:21:20.472 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:20.467+0000 7f8b9639b700 1 -- 172.21.15.50:0/2262683520 >> v1:172.21.15.50:6789/0 conn(0x7f8b900b2140 legacy=0x7f8b900b2560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:21:20.472 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:20.467+0000 7f8b9639b700 1 -- 172.21.15.50:0/2262683520 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b900cb470 con 0x7f8b90159480 2023-10-06T01:21:20.472 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:20.468+0000 7f8b9639b700 1 --2- 172.21.15.50:0/2262683520 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8b90159480 0x7f8b900b30d0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f8b8c0098e0 tx=0x7f8b8c0091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9014e372d66ff794 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:21:20.472 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:20.468+0000 7f8b95399700 1 -- 172.21.15.50:0/2262683520 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b8c00b640 con 0x7f8b90159480 2023-10-06T01:21:20.473 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:20.468+0000 7f8b95399700 1 -- 172.21.15.50:0/2262683520 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b8c00b7a0 con 0x7f8b90159480 2023-10-06T01:21:20.473 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:20.468+0000 7f8b95399700 1 -- 172.21.15.50:0/2262683520 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b8c00bb40 con 0x7f8b90159480 2023-10-06T01:21:20.473 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:20.469+0000 7f8b9739d700 1 -- 172.21.15.50:0/2262683520 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8b90159480 msgr2=0x7f8b900b30d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:21:20.473 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:20.469+0000 7f8b9739d700 1 --2- 172.21.15.50:0/2262683520 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8b90159480 0x7f8b900b30d0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f8b8c0098e0 tx=0x7f8b8c0091a0 comp rx=0 tx=0).stop 2023-10-06T01:21:20.473 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:20.469+0000 7f8b9739d700 1 -- 172.21.15.50:0/2262683520 shutdown_connections 2023-10-06T01:21:20.473 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:20.469+0000 7f8b9739d700 1 --2- 172.21.15.50:0/2262683520 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8b90159480 0x7f8b900b30d0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:21:20.473 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:20.469+0000 7f8b9739d700 1 -- 172.21.15.50:0/2262683520 >> 172.21.15.50:0/2262683520 conn(0x7f8b9006ed20 msgr2=0x7f8b9006f120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:21:20.474 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:20.469+0000 7f8b9739d700 1 -- 172.21.15.50:0/2262683520 shutdown_connections 2023-10-06T01:21:20.474 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:20.469+0000 7f8b9739d700 1 -- 172.21.15.50:0/2262683520 wait complete. 2023-10-06T01:21:20.476 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:20.471+0000 7f8b9739d700 1 Processor -- start 2023-10-06T01:21:20.476 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:20.471+0000 7f8b9739d700 1 -- start start 2023-10-06T01:21:20.477 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:20.472+0000 7f8b9739d700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8b900b2140 0x7f8b900c6620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:21:20.477 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:20.472+0000 7f8b9739d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8b900b3610 0x7f8b900cfa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:21:20.477 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:20.472+0000 7f8b9739d700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8b90159480 0x7f8b900ce080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:21:20.477 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:20.472+0000 7f8b9739d700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b900cffa0 con 0x7f8b900b3610 2023-10-06T01:21:20.477 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:20.472+0000 7f8b9739d700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b900c3b00 con 0x7f8b900b2140 2023-10-06T01:21:20.477 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:20.472+0000 7f8b9739d700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b900d01b0 con 0x7f8b90159480 2023-10-06T01:21:20.477 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:20.472+0000 7f8b95b9a700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8b900b3610 0x7f8b900cfa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:21:20.478 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:20.472+0000 7f8b96b9c700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8b90159480 0x7f8b900ce080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:21:20.478 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:20.472+0000 7f8b95b9a700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8b900b3610 0x7f8b900cfa60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:59402/0 (socket says 172.21.15.50:59402) 2023-10-06T01:21:20.478 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:20.472+0000 7f8b95b9a700 1 -- 172.21.15.50:0/4006677624 learned_addr learned my addr 172.21.15.50:0/4006677624 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-06T01:21:20.478 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:20.472+0000 7f8b9639b700 1 --2- 172.21.15.50:0/4006677624 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8b900b2140 0x7f8b900c6620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:21:20.478 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:20.472+0000 7f8b95b9a700 1 -- 172.21.15.50:0/4006677624 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8b90159480 msgr2=0x7f8b900ce080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:21:20.478 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:20.472+0000 7f8b95b9a700 1 --2- 172.21.15.50:0/4006677624 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8b90159480 0x7f8b900ce080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:21:20.479 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:20.472+0000 7f8b95b9a700 1 -- 172.21.15.50:0/4006677624 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8b900b2140 msgr2=0x7f8b900c6620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:21:20.479 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:20.472+0000 7f8b95b9a700 1 --2- 172.21.15.50:0/4006677624 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8b900b2140 0x7f8b900c6620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:21:20.479 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:20.472+0000 7f8b95b9a700 1 -- 172.21.15.50:0/4006677624 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b8c009420 con 0x7f8b900b3610 2023-10-06T01:21:20.479 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:20.472+0000 7f8b96b9c700 1 --2- 172.21.15.50:0/4006677624 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8b90159480 0x7f8b900ce080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T01:21:20.479 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:20.473+0000 7f8b95b9a700 1 --2- 172.21.15.50:0/4006677624 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8b900b3610 0x7f8b900cfa60 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f8b8000ba70 tx=0x7f8b800096f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:21:20.479 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:20.473+0000 7f8b867fc700 1 -- 172.21.15.50:0/4006677624 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b8000d6d0 con 0x7f8b900b3610 2023-10-06T01:21:20.479 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:20.473+0000 7f8b867fc700 1 -- 172.21.15.50:0/4006677624 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b8000d850 con 0x7f8b900b3610 2023-10-06T01:21:20.479 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:20.473+0000 7f8b867fc700 1 -- 172.21.15.50:0/4006677624 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b8000dc50 con 0x7f8b900b3610 2023-10-06T01:21:20.480 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:20.473+0000 7f8b9739d700 1 -- 172.21.15.50:0/4006677624 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8b900d0490 con 0x7f8b900b3610 2023-10-06T01:21:20.480 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:20.473+0000 7f8b867fc700 1 -- 172.21.15.50:0/4006677624 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7f8b80015610 con 0x7f8b900b3610 2023-10-06T01:21:20.480 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:20.473+0000 7f8b9739d700 1 -- 172.21.15.50:0/4006677624 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8b9015e100 con 0x7f8b900b3610 2023-10-06T01:21:20.480 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:20.474+0000 7f8b867fc700 1 -- 172.21.15.50:0/4006677624 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1641+0+0 (secure 0 0 0) 0x7f8b8000de00 con 0x7f8b900b3610 2023-10-06T01:21:20.480 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:20.475+0000 7f8b9739d700 1 -- 172.21.15.50:0/4006677624 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8b900d09b0 con 0x7f8b900b3610 2023-10-06T01:21:20.481 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:20.477+0000 7f8b867fc700 1 -- 172.21.15.50:0/4006677624 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7f8b80015af0 con 0x7f8b900b3610 2023-10-06T01:21:20.552 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:20.551+0000 7f8b9739d700 1 -- 172.21.15.50:0/4006677624 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f8b9005f270 con 0x7f8b900b3610 2023-10-06T01:21:20.553 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:20.551+0000 7f8b867fc700 1 -- 172.21.15.50:0/4006677624 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7013 (secure 0 0 0) 0x7f8b800273f0 con 0x7f8b900b3610 2023-10-06T01:21:20.553 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-10-06T01:21:20.554 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":10,"fsid":"0bfd9a6b-1587-4fe4-a89e-e43c00286b4e","created":"2023-10-06T01:21:16.828801+0000","modified":"2023-10-06T01:21:20.179863+0000","last_up_change":"0.000000","last_in_change":"2023-10-06T01:21:20.179863+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[],"osds":[{"osd":0,"uuid":"9060727a-3959-4de3-8363-c5c5d7826c9a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"5ad9ef12-b579-47ea-b690-90ba887e2cef","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"c7aee044-6f75-436f-90e1-ba42a57359bd","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"d9b901c8-e8b2-44af-9508-f453120a96c0","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"2b3c6b38-e3e9-4301-9445-60fd3fe8ce03","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"417b5f8f-65f1-4c94-91a7-a6ce03fe1679","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"c150cff3-aee4-4714-9c08-d182b1ba9ffd","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"71107f0e-04d1-4e72-a0ec-0faf6af003e7","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T01:21:20.555 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:20.552+0000 7f8b9739d700 1 -- 172.21.15.50:0/4006677624 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8b900b3610 msgr2=0x7f8b900cfa60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:21:20.555 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:20.552+0000 7f8b9739d700 1 --2- 172.21.15.50:0/4006677624 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8b900b3610 0x7f8b900cfa60 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f8b8000ba70 tx=0x7f8b800096f0 comp rx=0 tx=0).stop 2023-10-06T01:21:20.555 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:20.552+0000 7f8b9739d700 1 -- 172.21.15.50:0/4006677624 shutdown_connections 2023-10-06T01:21:20.555 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:20.552+0000 7f8b9739d700 1 --2- 172.21.15.50:0/4006677624 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8b90159480 0x7f8b900ce080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:21:20.555 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:20.552+0000 7f8b9739d700 1 --2- 172.21.15.50:0/4006677624 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8b900b2140 0x7f8b900c6620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:21:20.555 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:20.552+0000 7f8b9739d700 1 --2- 172.21.15.50:0/4006677624 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8b900b3610 0x7f8b900cfa60 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:21:20.556 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:20.552+0000 7f8b9739d700 1 -- 172.21.15.50:0/4006677624 >> 172.21.15.50:0/4006677624 conn(0x7f8b9006ed20 msgr2=0x7f8b9006f0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:21:20.556 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:20.553+0000 7f8b9739d700 1 -- 172.21.15.50:0/4006677624 shutdown_connections 2023-10-06T01:21:20.556 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:20.553+0000 7f8b9739d700 1 -- 172.21.15.50:0/4006677624 wait complete. 2023-10-06T01:21:20.572 INFO:tasks.ceph.ceph_manager.ceph:[] 2023-10-06T01:21:20.572 INFO:tasks.ceph:Waiting for OSDs to come up 2023-10-06T01:21:20.895 INFO:tasks.ceph.osd.0.smithi050.stderr:2023-10-06T01:21:20.893+0000 7f6ad449b540 -1 Falling back to public interface 2023-10-06T01:21:20.908 INFO:tasks.ceph.osd.4.smithi155.stderr:2023-10-06T01:21:20.906+0000 7f555713e540 -1 Falling back to public interface 2023-10-06T01:21:20.916 INFO:tasks.ceph.osd.6.smithi155.stderr:2023-10-06T01:21:20.914+0000 7f3f7dd49540 -1 Falling back to public interface 2023-10-06T01:21:20.935 INFO:tasks.ceph.osd.1.smithi050.stderr:2023-10-06T01:21:20.934+0000 7fc150e88540 -1 Falling back to public interface 2023-10-06T01:21:20.945 INFO:tasks.ceph.osd.3.smithi050.stderr:2023-10-06T01:21:20.943+0000 7ff58fc09540 -1 Falling back to public interface 2023-10-06T01:21:20.945 INFO:tasks.ceph.osd.5.smithi155.stderr:2023-10-06T01:21:20.943+0000 7f2378e16540 -1 Falling back to public interface 2023-10-06T01:21:20.945 INFO:tasks.ceph.osd.7.smithi155.stderr:2023-10-06T01:21:20.944+0000 7f7e1b3ac540 -1 Falling back to public interface 2023-10-06T01:21:20.950 INFO:tasks.ceph.osd.2.smithi050.stderr:2023-10-06T01:21:20.948+0000 7fc417194540 -1 Falling back to public interface 2023-10-06T01:21:21.084 INFO:tasks.ceph.mgr.x.smithi155.stderr:2023-10-06T01:21:21.083+0000 7f58741fa180 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-10-06T01:21:21.140 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-10-06T01:21:21.139+0000 7f137d083180 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-10-06T01:21:21.257 INFO:tasks.ceph.mgr.x.smithi155.stderr:2023-10-06T01:21:21.255+0000 7f58741fa180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-10-06T01:21:21.320 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-10-06T01:21:21.319+0000 7f137d083180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-10-06T01:21:21.375 INFO:tasks.ceph.mgr.x.smithi155.stderr:2023-10-06T01:21:21.374+0000 7f58741fa180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-10-06T01:21:21.379 DEBUG:teuthology.orchestra.run.smithi050:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-10-06T01:21:21.437 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-10-06T01:21:21.435+0000 7f137d083180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-10-06T01:21:21.543 INFO:teuthology.misc.health.smithi050.stderr:2023-10-06T01:21:21.541+0000 7f108e79d700 1 Processor -- start 2023-10-06T01:21:21.543 INFO:teuthology.misc.health.smithi050.stderr:2023-10-06T01:21:21.541+0000 7f108e79d700 1 -- start start 2023-10-06T01:21:21.546 INFO:teuthology.misc.health.smithi050.stderr:2023-10-06T01:21:21.543+0000 7f108e79d700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f10880cd0a0 0x7f1088153be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:21:21.546 INFO:teuthology.misc.health.smithi050.stderr:2023-10-06T01:21:21.543+0000 7f108e79d700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f108815d170 0x7f108815a590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:21:21.546 INFO:teuthology.misc.health.smithi050.stderr:2023-10-06T01:21:21.543+0000 7f108e79d700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f108815d610 con 0x7f1088153810 2023-10-06T01:21:21.546 INFO:teuthology.misc.health.smithi050.stderr:2023-10-06T01:21:21.543+0000 7f108e79d700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f10880cbdc0 con 0x7f10880cd0a0 2023-10-06T01:21:21.546 INFO:teuthology.misc.health.smithi050.stderr:2023-10-06T01:21:21.543+0000 7f108e79d700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f108815aad0 con 0x7f108815d170 2023-10-06T01:21:21.546 INFO:teuthology.misc.health.smithi050.stderr:2023-10-06T01:21:21.543+0000 7f108cf9a700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f10880cd0a0 0x7f1088153be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:21:21.546 INFO:teuthology.misc.health.smithi050.stderr:2023-10-06T01:21:21.543+0000 7f108cf9a700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f10880cd0a0 0x7f1088153be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:59410/0 (socket says 172.21.15.50:59410) 2023-10-06T01:21:21.546 INFO:teuthology.misc.health.smithi050.stderr:2023-10-06T01:21:21.543+0000 7f108cf9a700 1 -- 172.21.15.50:0/2947072713 learned_addr learned my addr 172.21.15.50:0/2947072713 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-06T01:21:21.546 INFO:teuthology.misc.health.smithi050.stderr:2023-10-06T01:21:21.543+0000 7f108d79b700 1 --1- 172.21.15.50:0/2947072713 >> v1:172.21.15.50:6789/0 conn(0x7f1088153810 0x7f10880cc990 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:47902/0 (socket says 172.21.15.50:47902) 2023-10-06T01:21:21.547 INFO:teuthology.misc.health.smithi050.stderr:2023-10-06T01:21:21.543+0000 7f108df9c700 1 --2- 172.21.15.50:0/2947072713 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f108815d170 0x7f108815a590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:21:21.547 INFO:teuthology.misc.health.smithi050.stderr:2023-10-06T01:21:21.543+0000 7f108cf9a700 1 -- 172.21.15.50:0/2947072713 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f108815d170 msgr2=0x7f108815a590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:21:21.547 INFO:teuthology.misc.health.smithi050.stderr:2023-10-06T01:21:21.543+0000 7f108cf9a700 1 --2- 172.21.15.50:0/2947072713 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f108815d170 0x7f108815a590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:21:21.547 INFO:teuthology.misc.health.smithi050.stderr:2023-10-06T01:21:21.543+0000 7f108cf9a700 1 -- 172.21.15.50:0/2947072713 >> v1:172.21.15.50:6789/0 conn(0x7f1088153810 legacy=0x7f10880cc990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:21:21.547 INFO:teuthology.misc.health.smithi050.stderr:2023-10-06T01:21:21.543+0000 7f108cf9a700 1 -- 172.21.15.50:0/2947072713 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10880ce8f0 con 0x7f10880cd0a0 2023-10-06T01:21:21.547 INFO:teuthology.misc.health.smithi050.stderr:2023-10-06T01:21:21.543+0000 7f108df9c700 1 --2- 172.21.15.50:0/2947072713 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f108815d170 0x7f108815a590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T01:21:21.547 INFO:teuthology.misc.health.smithi050.stderr:2023-10-06T01:21:21.543+0000 7f107ffff700 1 -- 172.21.15.50:0/2947072713 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 221103009 0 0) 0x7f108815d610 con 0x7f1088153810 2023-10-06T01:21:21.547 INFO:teuthology.misc.health.smithi050.stderr:2023-10-06T01:21:21.544+0000 7f108cf9a700 1 --2- 172.21.15.50:0/2947072713 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f10880cd0a0 0x7f1088153be0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f10780099b0 tx=0x7f1078009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3e1351ddd47b8a8 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:21:21.547 INFO:teuthology.misc.health.smithi050.stderr:2023-10-06T01:21:21.544+0000 7f107ffff700 1 -- 172.21.15.50:0/2947072713 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f107800b860 con 0x7f10880cd0a0 2023-10-06T01:21:21.547 INFO:teuthology.misc.health.smithi050.stderr:2023-10-06T01:21:21.544+0000 7f107ffff700 1 -- 172.21.15.50:0/2947072713 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f107800b9c0 con 0x7f10880cd0a0 2023-10-06T01:21:21.547 INFO:teuthology.misc.health.smithi050.stderr:2023-10-06T01:21:21.544+0000 7f107ffff700 1 -- 172.21.15.50:0/2947072713 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f107800bd60 con 0x7f10880cd0a0 2023-10-06T01:21:21.548 INFO:teuthology.misc.health.smithi050.stderr:2023-10-06T01:21:21.545+0000 7f108e79d700 1 -- 172.21.15.50:0/2947072713 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f10880cd0a0 msgr2=0x7f1088153be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:21:21.548 INFO:teuthology.misc.health.smithi050.stderr:2023-10-06T01:21:21.545+0000 7f108e79d700 1 --2- 172.21.15.50:0/2947072713 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f10880cd0a0 0x7f1088153be0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f10780099b0 tx=0x7f1078009250 comp rx=0 tx=0).stop 2023-10-06T01:21:21.549 INFO:teuthology.misc.health.smithi050.stderr:2023-10-06T01:21:21.545+0000 7f108e79d700 1 -- 172.21.15.50:0/2947072713 shutdown_connections 2023-10-06T01:21:21.549 INFO:teuthology.misc.health.smithi050.stderr:2023-10-06T01:21:21.545+0000 7f108e79d700 1 --2- 172.21.15.50:0/2947072713 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f108815d170 0x7f108815a590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:21:21.549 INFO:teuthology.misc.health.smithi050.stderr:2023-10-06T01:21:21.545+0000 7f108e79d700 1 --2- 172.21.15.50:0/2947072713 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f10880cd0a0 0x7f1088153be0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:21:21.549 INFO:teuthology.misc.health.smithi050.stderr:2023-10-06T01:21:21.545+0000 7f108e79d700 1 -- 172.21.15.50:0/2947072713 >> 172.21.15.50:0/2947072713 conn(0x7f108806ed80 msgr2=0x7f108806f180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:21:21.549 INFO:teuthology.misc.health.smithi050.stderr:2023-10-06T01:21:21.545+0000 7f108e79d700 1 -- 172.21.15.50:0/2947072713 shutdown_connections 2023-10-06T01:21:21.549 INFO:teuthology.misc.health.smithi050.stderr:2023-10-06T01:21:21.545+0000 7f108e79d700 1 -- 172.21.15.50:0/2947072713 wait complete. 2023-10-06T01:21:21.549 INFO:teuthology.misc.health.smithi050.stderr:2023-10-06T01:21:21.546+0000 7f108e79d700 1 Processor -- start 2023-10-06T01:21:21.549 INFO:teuthology.misc.health.smithi050.stderr:2023-10-06T01:21:21.547+0000 7f108e79d700 1 -- start start 2023-10-06T01:21:21.551 INFO:teuthology.misc.health.smithi050.stderr:2023-10-06T01:21:21.547+0000 7f108e79d700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f10880cd0a0 0x7f1088151440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:21:21.551 INFO:teuthology.misc.health.smithi050.stderr:2023-10-06T01:21:21.547+0000 7f108e79d700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1088153810 0x7f1088154180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:21:21.552 INFO:teuthology.misc.health.smithi050.stderr:2023-10-06T01:21:21.547+0000 7f108e79d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f108815d170 0x7f10881546c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:21:21.552 INFO:teuthology.misc.health.smithi050.stderr:2023-10-06T01:21:21.547+0000 7f108e79d700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1088154c00 con 0x7f108815d170 2023-10-06T01:21:21.552 INFO:teuthology.misc.health.smithi050.stderr:2023-10-06T01:21:21.547+0000 7f108e79d700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1088150460 con 0x7f10880cd0a0 2023-10-06T01:21:21.552 INFO:teuthology.misc.health.smithi050.stderr:2023-10-06T01:21:21.548+0000 7f108e79d700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f108814f850 con 0x7f1088153810 2023-10-06T01:21:21.552 INFO:teuthology.misc.health.smithi050.stderr:2023-10-06T01:21:21.548+0000 7f108df9c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f108815d170 0x7f10881546c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:21:21.552 INFO:teuthology.misc.health.smithi050.stderr:2023-10-06T01:21:21.548+0000 7f108df9c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f108815d170 0x7f10881546c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:59424/0 (socket says 172.21.15.50:59424) 2023-10-06T01:21:21.552 INFO:teuthology.misc.health.smithi050.stderr:2023-10-06T01:21:21.548+0000 7f108df9c700 1 -- 172.21.15.50:0/3278986658 learned_addr learned my addr 172.21.15.50:0/3278986658 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-06T01:21:21.552 INFO:teuthology.misc.health.smithi050.stderr:2023-10-06T01:21:21.548+0000 7f108cf9a700 1 --2- 172.21.15.50:0/3278986658 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1088153810 0x7f1088154180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:21:21.552 INFO:teuthology.misc.health.smithi050.stderr:2023-10-06T01:21:21.548+0000 7f108d79b700 1 --2- 172.21.15.50:0/3278986658 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f10880cd0a0 0x7f1088151440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:21:21.552 INFO:teuthology.misc.health.smithi050.stderr:2023-10-06T01:21:21.548+0000 7f108df9c700 1 -- 172.21.15.50:0/3278986658 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1088153810 msgr2=0x7f1088154180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:21:21.552 INFO:teuthology.misc.health.smithi050.stderr:2023-10-06T01:21:21.548+0000 7f108df9c700 1 --2- 172.21.15.50:0/3278986658 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1088153810 0x7f1088154180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:21:21.552 INFO:teuthology.misc.health.smithi050.stderr:2023-10-06T01:21:21.548+0000 7f108df9c700 1 -- 172.21.15.50:0/3278986658 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f10880cd0a0 msgr2=0x7f1088151440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:21:21.553 INFO:teuthology.misc.health.smithi050.stderr:2023-10-06T01:21:21.548+0000 7f108df9c700 1 --2- 172.21.15.50:0/3278986658 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f10880cd0a0 0x7f1088151440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:21:21.553 INFO:teuthology.misc.health.smithi050.stderr:2023-10-06T01:21:21.548+0000 7f108df9c700 1 -- 172.21.15.50:0/3278986658 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10780094f0 con 0x7f108815d170 2023-10-06T01:21:21.553 INFO:teuthology.misc.health.smithi050.stderr:2023-10-06T01:21:21.548+0000 7f108df9c700 1 --2- 172.21.15.50:0/3278986658 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f108815d170 0x7f10881546c0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f108000d180 tx=0x7f1080009a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:21:21.553 INFO:teuthology.misc.health.smithi050.stderr:2023-10-06T01:21:21.549+0000 7f107d7fa700 1 -- 172.21.15.50:0/3278986658 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f108000dcc0 con 0x7f108815d170 2023-10-06T01:21:21.553 INFO:teuthology.misc.health.smithi050.stderr:2023-10-06T01:21:21.549+0000 7f107d7fa700 1 -- 172.21.15.50:0/3278986658 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f108000f040 con 0x7f108815d170 2023-10-06T01:21:21.553 INFO:teuthology.misc.health.smithi050.stderr:2023-10-06T01:21:21.549+0000 7f107d7fa700 1 -- 172.21.15.50:0/3278986658 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1080015690 con 0x7f108815d170 2023-10-06T01:21:21.553 INFO:teuthology.misc.health.smithi050.stderr:2023-10-06T01:21:21.549+0000 7f108e79d700 1 -- 172.21.15.50:0/3278986658 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f108814fb30 con 0x7f108815d170 2023-10-06T01:21:21.553 INFO:teuthology.misc.health.smithi050.stderr:2023-10-06T01:21:21.549+0000 7f108e79d700 1 -- 172.21.15.50:0/3278986658 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f10881500f0 con 0x7f108815d170 2023-10-06T01:21:21.553 INFO:teuthology.misc.health.smithi050.stderr:2023-10-06T01:21:21.549+0000 7f107d7fa700 1 -- 172.21.15.50:0/3278986658 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7f1080015ac0 con 0x7f108815d170 2023-10-06T01:21:21.553 INFO:teuthology.misc.health.smithi050.stderr:2023-10-06T01:21:21.549+0000 7f107d7fa700 1 -- 172.21.15.50:0/3278986658 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1641+0+0 (secure 0 0 0) 0x7f108000de40 con 0x7f108815d170 2023-10-06T01:21:21.554 INFO:teuthology.misc.health.smithi050.stderr:2023-10-06T01:21:21.550+0000 7f108e79d700 1 -- 172.21.15.50:0/3278986658 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1088071740 con 0x7f108815d170 2023-10-06T01:21:21.554 INFO:teuthology.misc.health.smithi050.stderr:2023-10-06T01:21:21.552+0000 7f107d7fa700 1 -- 172.21.15.50:0/3278986658 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7f108001a070 con 0x7f108815d170 2023-10-06T01:21:21.627 INFO:teuthology.misc.health.smithi050.stderr:2023-10-06T01:21:21.625+0000 7f108e79d700 1 -- 172.21.15.50:0/3278986658 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f10881519e0 con 0x7f108815d170 2023-10-06T01:21:21.628 INFO:teuthology.misc.health.smithi050.stderr:2023-10-06T01:21:21.626+0000 7f107d7fa700 1 -- 172.21.15.50:0/3278986658 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7013 (secure 0 0 0) 0x7f1080028470 con 0x7f108815d170 2023-10-06T01:21:21.628 INFO:teuthology.misc.health.smithi050.stdout: 2023-10-06T01:21:21.628 INFO:teuthology.misc.health.smithi050.stdout:{"epoch":10,"fsid":"0bfd9a6b-1587-4fe4-a89e-e43c00286b4e","created":"2023-10-06T01:21:16.828801+0000","modified":"2023-10-06T01:21:20.179863+0000","last_up_change":"0.000000","last_in_change":"2023-10-06T01:21:20.179863+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[],"osds":[{"osd":0,"uuid":"9060727a-3959-4de3-8363-c5c5d7826c9a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"5ad9ef12-b579-47ea-b690-90ba887e2cef","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"c7aee044-6f75-436f-90e1-ba42a57359bd","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"d9b901c8-e8b2-44af-9508-f453120a96c0","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"2b3c6b38-e3e9-4301-9445-60fd3fe8ce03","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"417b5f8f-65f1-4c94-91a7-a6ce03fe1679","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"c150cff3-aee4-4714-9c08-d182b1ba9ffd","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"71107f0e-04d1-4e72-a0ec-0faf6af003e7","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T01:21:21.629 INFO:teuthology.misc.health.smithi050.stderr:2023-10-06T01:21:21.627+0000 7f108e79d700 1 -- 172.21.15.50:0/3278986658 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f108815d170 msgr2=0x7f10881546c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:21:21.629 INFO:teuthology.misc.health.smithi050.stderr:2023-10-06T01:21:21.627+0000 7f108e79d700 1 --2- 172.21.15.50:0/3278986658 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f108815d170 0x7f10881546c0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f108000d180 tx=0x7f1080009a50 comp rx=0 tx=0).stop 2023-10-06T01:21:21.629 INFO:teuthology.misc.health.smithi050.stderr:2023-10-06T01:21:21.627+0000 7f108e79d700 1 -- 172.21.15.50:0/3278986658 shutdown_connections 2023-10-06T01:21:21.630 INFO:teuthology.misc.health.smithi050.stderr:2023-10-06T01:21:21.627+0000 7f108e79d700 1 --2- 172.21.15.50:0/3278986658 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f108815d170 0x7f10881546c0 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:21:21.630 INFO:teuthology.misc.health.smithi050.stderr:2023-10-06T01:21:21.627+0000 7f108e79d700 1 --2- 172.21.15.50:0/3278986658 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f10880cd0a0 0x7f1088151440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:21:21.630 INFO:teuthology.misc.health.smithi050.stderr:2023-10-06T01:21:21.627+0000 7f108e79d700 1 --2- 172.21.15.50:0/3278986658 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1088153810 0x7f1088154180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:21:21.630 INFO:teuthology.misc.health.smithi050.stderr:2023-10-06T01:21:21.627+0000 7f108e79d700 1 -- 172.21.15.50:0/3278986658 >> 172.21.15.50:0/3278986658 conn(0x7f108806ed80 msgr2=0x7f1088152980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:21:21.630 INFO:teuthology.misc.health.smithi050.stderr:2023-10-06T01:21:21.627+0000 7f108e79d700 1 -- 172.21.15.50:0/3278986658 shutdown_connections 2023-10-06T01:21:21.630 INFO:teuthology.misc.health.smithi050.stderr:2023-10-06T01:21:21.627+0000 7f108e79d700 1 -- 172.21.15.50:0/3278986658 wait complete. 2023-10-06T01:21:21.643 DEBUG:teuthology.misc:0 of 8 OSDs are up 2023-10-06T01:21:21.679 INFO:tasks.ceph.mgr.x.smithi155.stderr:2023-10-06T01:21:21.678+0000 7f58741fa180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-10-06T01:21:21.747 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-10-06T01:21:21.745+0000 7f137d083180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-10-06T01:21:21.776 INFO:tasks.ceph.mgr.x.smithi155.stderr:2023-10-06T01:21:21.776+0000 7f58741fa180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-10-06T01:21:21.849 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-10-06T01:21:21.847+0000 7f137d083180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-10-06T01:21:22.785 INFO:tasks.ceph.mgr.x.smithi155.stderr:2023-10-06T01:21:22.785+0000 7f58741fa180 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-10-06T01:21:22.881 INFO:tasks.ceph.mgr.x.smithi155.stderr:2023-10-06T01:21:22.880+0000 7f58741fa180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-10-06T01:21:22.890 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-10-06T01:21:22.888+0000 7f137d083180 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-10-06T01:21:22.975 INFO:tasks.ceph.mgr.x.smithi155.stderr:2023-10-06T01:21:22.975+0000 7f58741fa180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-10-06T01:21:22.986 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-10-06T01:21:22.986+0000 7f137d083180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-10-06T01:21:23.083 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-10-06T01:21:23.082+0000 7f137d083180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-10-06T01:21:23.140 INFO:tasks.ceph.mgr.x.smithi155.stderr:2023-10-06T01:21:23.139+0000 7f58741fa180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-10-06T01:21:23.247 INFO:tasks.ceph.mgr.x.smithi155.stderr:2023-10-06T01:21:23.246+0000 7f58741fa180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-10-06T01:21:23.253 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-10-06T01:21:23.253+0000 7f137d083180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-10-06T01:21:23.362 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-10-06T01:21:23.362+0000 7f137d083180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-10-06T01:21:23.444 INFO:tasks.ceph.mgr.x.smithi155.stderr:2023-10-06T01:21:23.444+0000 7f58741fa180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-10-06T01:21:23.545 INFO:tasks.ceph.mgr.x.smithi155.stderr:2023-10-06T01:21:23.544+0000 7f58741fa180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-10-06T01:21:23.585 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-10-06T01:21:23.584+0000 7f137d083180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-10-06T01:21:23.640 INFO:tasks.ceph.mgr.x.smithi155.stderr:2023-10-06T01:21:23.639+0000 7f58741fa180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-10-06T01:21:23.685 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-10-06T01:21:23.684+0000 7f137d083180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-10-06T01:21:23.747 INFO:tasks.ceph.mgr.x.smithi155.stderr:2023-10-06T01:21:23.746+0000 7f58741fa180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-10-06T01:21:23.836 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-10-06T01:21:23.835+0000 7f137d083180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-10-06T01:21:23.975 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-10-06T01:21:23.974+0000 7f137d083180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-10-06T01:21:24.429 INFO:tasks.ceph.osd.4.smithi155.stderr:2023-10-06T01:21:24.428+0000 7f555713e540 -1 osd.4 0 log_to_monitors true 2023-10-06T01:21:24.448 INFO:tasks.ceph.osd.0.smithi050.stderr:2023-10-06T01:21:24.447+0000 7f6ad449b540 -1 osd.0 0 log_to_monitors true 2023-10-06T01:21:24.500 INFO:tasks.ceph.osd.1.smithi050.stderr:2023-10-06T01:21:24.499+0000 7fc150e88540 -1 osd.1 0 log_to_monitors true 2023-10-06T01:21:24.533 INFO:tasks.ceph.osd.5.smithi155.stderr:2023-10-06T01:21:24.533+0000 7f2378e16540 -1 osd.5 0 log_to_monitors true 2023-10-06T01:21:24.541 INFO:tasks.ceph.osd.3.smithi050.stderr:2023-10-06T01:21:24.540+0000 7ff58fc09540 -1 osd.3 0 log_to_monitors true 2023-10-06T01:21:24.725 INFO:tasks.ceph.osd.6.smithi155.stderr:2023-10-06T01:21:24.725+0000 7f3f7dd49540 -1 osd.6 0 log_to_monitors true 2023-10-06T01:21:24.771 INFO:tasks.ceph.mgr.x.smithi155.stderr:2023-10-06T01:21:24.770+0000 7f582c5fa700 -1 mgr.server handle_report got status from non-daemon mon.b 2023-10-06T01:21:24.773 INFO:tasks.ceph.mgr.x.smithi155.stderr:2023-10-06T01:21:24.773+0000 7f582c5fa700 -1 mgr.server handle_report got status from non-daemon mon.c 2023-10-06T01:21:24.780 INFO:tasks.ceph.osd.7.smithi155.stderr:2023-10-06T01:21:24.779+0000 7f7e1b3ac540 -1 osd.7 0 log_to_monitors true 2023-10-06T01:21:24.808 INFO:tasks.ceph.osd.2.smithi050.stderr:2023-10-06T01:21:24.807+0000 7fc417194540 -1 osd.2 0 log_to_monitors true 2023-10-06T01:21:27.583 INFO:tasks.ceph.osd.3.smithi050.stderr:2023-10-06T01:21:27.579+0000 7ff5835f6700 -1 osd.3 0 waiting for initial osdmap 2023-10-06T01:21:27.589 INFO:tasks.ceph.osd.3.smithi050.stderr:2023-10-06T01:21:27.588+0000 7ff57c5e8700 -1 osd.3 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-06T01:21:27.624 INFO:tasks.ceph.osd.1.smithi050.stderr:2023-10-06T01:21:27.623+0000 7fc1449f6700 -1 osd.1 0 waiting for initial osdmap 2023-10-06T01:21:27.630 INFO:tasks.ceph.osd.1.smithi050.stderr:2023-10-06T01:21:27.629+0000 7fc13d9e8700 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-06T01:21:27.668 INFO:tasks.ceph.osd.0.smithi050.stderr:2023-10-06T01:21:27.665+0000 7f6ac7ff6700 -1 osd.0 0 waiting for initial osdmap 2023-10-06T01:21:27.675 INFO:tasks.ceph.osd.0.smithi050.stderr:2023-10-06T01:21:27.673+0000 7f6ac0fe8700 -1 osd.0 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-06T01:21:27.711 INFO:tasks.ceph.osd.2.smithi050.stderr:2023-10-06T01:21:27.710+0000 7fc40abf6700 -1 osd.2 0 waiting for initial osdmap 2023-10-06T01:21:27.717 INFO:tasks.ceph.osd.2.smithi050.stderr:2023-10-06T01:21:27.716+0000 7fc403be8700 -1 osd.2 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-06T01:21:28.209 INFO:tasks.ceph.osd.6.smithi155.stderr:2023-10-06T01:21:28.209+0000 7f3f72ff9700 -1 osd.6 0 waiting for initial osdmap 2023-10-06T01:21:28.222 INFO:tasks.ceph.osd.6.smithi155.stderr:2023-10-06T01:21:28.222+0000 7f3f6a7e8700 -1 osd.6 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-06T01:21:28.239 INFO:tasks.ceph.osd.4.smithi155.stderr:2023-10-06T01:21:28.238+0000 7f554c3f9700 -1 osd.4 0 waiting for initial osdmap 2023-10-06T01:21:28.248 INFO:tasks.ceph.osd.4.smithi155.stderr:2023-10-06T01:21:28.248+0000 7f5543be8700 -1 osd.4 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-06T01:21:28.267 INFO:tasks.ceph.osd.7.smithi155.stderr:2023-10-06T01:21:28.267+0000 7f7e0edf6700 -1 osd.7 0 waiting for initial osdmap 2023-10-06T01:21:28.274 INFO:tasks.ceph.osd.7.smithi155.stderr:2023-10-06T01:21:28.274+0000 7f7e07de8700 -1 osd.7 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-06T01:21:28.277 INFO:tasks.ceph.osd.5.smithi155.stderr:2023-10-06T01:21:28.277+0000 7f236c7f6700 -1 osd.5 0 waiting for initial osdmap 2023-10-06T01:21:28.282 INFO:tasks.ceph.osd.5.smithi155.stderr:2023-10-06T01:21:28.282+0000 7f23657e8700 -1 osd.5 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-06T01:21:28.448 DEBUG:teuthology.orchestra.run.smithi050:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-10-06T01:21:28.627 INFO:teuthology.misc.health.smithi050.stderr:2023-10-06T01:21:28.626+0000 7f85f3fff700 1 Processor -- start 2023-10-06T01:21:28.627 INFO:teuthology.misc.health.smithi050.stderr:2023-10-06T01:21:28.626+0000 7f85f3fff700 1 -- start start 2023-10-06T01:21:28.629 INFO:teuthology.misc.health.smithi050.stderr:2023-10-06T01:21:28.627+0000 7f85f3fff700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f85f40cd0a0 0x7f85f4153be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:21:28.629 INFO:teuthology.misc.health.smithi050.stderr:2023-10-06T01:21:28.627+0000 7f85f3fff700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f85f415d170 0x7f85f415a590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:21:28.629 INFO:teuthology.misc.health.smithi050.stderr:2023-10-06T01:21:28.627+0000 7f85f3fff700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f85f415d610 con 0x7f85f4153810 2023-10-06T01:21:28.630 INFO:teuthology.misc.health.smithi050.stderr:2023-10-06T01:21:28.627+0000 7f85f3fff700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f85f40cbdc0 con 0x7f85f40cd0a0 2023-10-06T01:21:28.630 INFO:teuthology.misc.health.smithi050.stderr:2023-10-06T01:21:28.627+0000 7f85f3fff700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85f415aad0 con 0x7f85f415d170 2023-10-06T01:21:28.630 INFO:teuthology.misc.health.smithi050.stderr:2023-10-06T01:21:28.628+0000 7f85f27fc700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f85f40cd0a0 0x7f85f4153be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:21:28.630 INFO:teuthology.misc.health.smithi050.stderr:2023-10-06T01:21:28.628+0000 7f85f27fc700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f85f40cd0a0 0x7f85f4153be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:40964/0 (socket says 172.21.15.50:40964) 2023-10-06T01:21:28.630 INFO:teuthology.misc.health.smithi050.stderr:2023-10-06T01:21:28.628+0000 7f85f27fc700 1 -- 172.21.15.50:0/1880848932 learned_addr learned my addr 172.21.15.50:0/1880848932 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-06T01:21:28.630 INFO:teuthology.misc.health.smithi050.stderr:2023-10-06T01:21:28.628+0000 7f85f2ffd700 1 --1- 172.21.15.50:0/1880848932 >> v1:172.21.15.50:6789/0 conn(0x7f85f4153810 0x7f85f40cc990 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:36042/0 (socket says 172.21.15.50:36042) 2023-10-06T01:21:28.630 INFO:teuthology.misc.health.smithi050.stderr:2023-10-06T01:21:28.628+0000 7f85f37fe700 1 --2- 172.21.15.50:0/1880848932 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f85f415d170 0x7f85f415a590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:21:28.630 INFO:teuthology.misc.health.smithi050.stderr:2023-10-06T01:21:28.628+0000 7f85f27fc700 1 -- 172.21.15.50:0/1880848932 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f85f415d170 msgr2=0x7f85f415a590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:21:28.630 INFO:teuthology.misc.health.smithi050.stderr:2023-10-06T01:21:28.628+0000 7f85f27fc700 1 --2- 172.21.15.50:0/1880848932 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f85f415d170 0x7f85f415a590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:21:28.630 INFO:teuthology.misc.health.smithi050.stderr:2023-10-06T01:21:28.628+0000 7f85f27fc700 1 -- 172.21.15.50:0/1880848932 >> v1:172.21.15.50:6789/0 conn(0x7f85f4153810 legacy=0x7f85f40cc990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:21:28.630 INFO:teuthology.misc.health.smithi050.stderr:2023-10-06T01:21:28.628+0000 7f85f27fc700 1 -- 172.21.15.50:0/1880848932 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85f40ce8f0 con 0x7f85f40cd0a0 2023-10-06T01:21:28.631 INFO:teuthology.misc.health.smithi050.stderr:2023-10-06T01:21:28.628+0000 7f85f1ffb700 1 -- 172.21.15.50:0/1880848932 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4232274265 0 0) 0x7f85f415d610 con 0x7f85f4153810 2023-10-06T01:21:28.631 INFO:teuthology.misc.health.smithi050.stderr:2023-10-06T01:21:28.628+0000 7f85f37fe700 1 --2- 172.21.15.50:0/1880848932 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f85f415d170 0x7f85f415a590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T01:21:28.631 INFO:teuthology.misc.health.smithi050.stderr:2023-10-06T01:21:28.628+0000 7f85f27fc700 1 --2- 172.21.15.50:0/1880848932 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f85f40cd0a0 0x7f85f4153be0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f85e80099b0 tx=0x7f85e8009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f10301ba34c4771e server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:21:28.631 INFO:teuthology.misc.health.smithi050.stderr:2023-10-06T01:21:28.629+0000 7f85f1ffb700 1 -- 172.21.15.50:0/1880848932 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85e800b860 con 0x7f85f40cd0a0 2023-10-06T01:21:28.631 INFO:teuthology.misc.health.smithi050.stderr:2023-10-06T01:21:28.629+0000 7f85f1ffb700 1 -- 172.21.15.50:0/1880848932 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f85e800b9c0 con 0x7f85f40cd0a0 2023-10-06T01:21:28.631 INFO:teuthology.misc.health.smithi050.stderr:2023-10-06T01:21:28.629+0000 7f85f1ffb700 1 -- 172.21.15.50:0/1880848932 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85e800bd60 con 0x7f85f40cd0a0 2023-10-06T01:21:28.632 INFO:teuthology.misc.health.smithi050.stderr:2023-10-06T01:21:28.629+0000 7f85f3fff700 1 -- 172.21.15.50:0/1880848932 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f85f40cd0a0 msgr2=0x7f85f4153be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:21:28.632 INFO:teuthology.misc.health.smithi050.stderr:2023-10-06T01:21:28.629+0000 7f85f3fff700 1 --2- 172.21.15.50:0/1880848932 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f85f40cd0a0 0x7f85f4153be0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f85e80099b0 tx=0x7f85e8009250 comp rx=0 tx=0).stop 2023-10-06T01:21:28.632 INFO:teuthology.misc.health.smithi050.stderr:2023-10-06T01:21:28.629+0000 7f85f3fff700 1 -- 172.21.15.50:0/1880848932 shutdown_connections 2023-10-06T01:21:28.632 INFO:teuthology.misc.health.smithi050.stderr:2023-10-06T01:21:28.629+0000 7f85f3fff700 1 --2- 172.21.15.50:0/1880848932 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f85f415d170 0x7f85f415a590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:21:28.632 INFO:teuthology.misc.health.smithi050.stderr:2023-10-06T01:21:28.629+0000 7f85f3fff700 1 --2- 172.21.15.50:0/1880848932 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f85f40cd0a0 0x7f85f4153be0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:21:28.632 INFO:teuthology.misc.health.smithi050.stderr:2023-10-06T01:21:28.629+0000 7f85f3fff700 1 -- 172.21.15.50:0/1880848932 >> 172.21.15.50:0/1880848932 conn(0x7f85f406ed80 msgr2=0x7f85f406f180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:21:28.633 INFO:teuthology.misc.health.smithi050.stderr:2023-10-06T01:21:28.629+0000 7f85f3fff700 1 -- 172.21.15.50:0/1880848932 shutdown_connections 2023-10-06T01:21:28.633 INFO:teuthology.misc.health.smithi050.stderr:2023-10-06T01:21:28.629+0000 7f85f3fff700 1 -- 172.21.15.50:0/1880848932 wait complete. 2023-10-06T01:21:28.633 INFO:teuthology.misc.health.smithi050.stderr:2023-10-06T01:21:28.631+0000 7f85f3fff700 1 Processor -- start 2023-10-06T01:21:28.633 INFO:teuthology.misc.health.smithi050.stderr:2023-10-06T01:21:28.631+0000 7f85f3fff700 1 -- start start 2023-10-06T01:21:28.635 INFO:teuthology.misc.health.smithi050.stderr:2023-10-06T01:21:28.632+0000 7f85f3fff700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f85f40cd0a0 0x7f85f4158db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:21:28.635 INFO:teuthology.misc.health.smithi050.stderr:2023-10-06T01:21:28.632+0000 7f85f3fff700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f85f4153810 0x7f85f41555e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:21:28.635 INFO:teuthology.misc.health.smithi050.stderr:2023-10-06T01:21:28.632+0000 7f85f3fff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f85f415d170 0x7f85f4142c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:21:28.635 INFO:teuthology.misc.health.smithi050.stderr:2023-10-06T01:21:28.632+0000 7f85f3fff700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85f41568f0 con 0x7f85f415d170 2023-10-06T01:21:28.635 INFO:teuthology.misc.health.smithi050.stderr:2023-10-06T01:21:28.632+0000 7f85f3fff700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85f4155ce0 con 0x7f85f40cd0a0 2023-10-06T01:21:28.635 INFO:teuthology.misc.health.smithi050.stderr:2023-10-06T01:21:28.632+0000 7f85f3fff700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85f4155fc0 con 0x7f85f4153810 2023-10-06T01:21:28.635 INFO:teuthology.misc.health.smithi050.stderr:2023-10-06T01:21:28.632+0000 7f85f37fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f85f415d170 0x7f85f4142c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:21:28.635 INFO:teuthology.misc.health.smithi050.stderr:2023-10-06T01:21:28.632+0000 7f85f37fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f85f415d170 0x7f85f4142c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:40976/0 (socket says 172.21.15.50:40976) 2023-10-06T01:21:28.636 INFO:teuthology.misc.health.smithi050.stderr:2023-10-06T01:21:28.632+0000 7f85f37fe700 1 -- 172.21.15.50:0/1997083154 learned_addr learned my addr 172.21.15.50:0/1997083154 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-06T01:21:28.636 INFO:teuthology.misc.health.smithi050.stderr:2023-10-06T01:21:28.632+0000 7f85f27fc700 1 --2- 172.21.15.50:0/1997083154 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f85f4153810 0x7f85f41555e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:21:28.636 INFO:teuthology.misc.health.smithi050.stderr:2023-10-06T01:21:28.632+0000 7f85f2ffd700 1 --2- 172.21.15.50:0/1997083154 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f85f40cd0a0 0x7f85f4158db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:21:28.636 INFO:teuthology.misc.health.smithi050.stderr:2023-10-06T01:21:28.633+0000 7f85f37fe700 1 -- 172.21.15.50:0/1997083154 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f85f4153810 msgr2=0x7f85f41555e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:21:28.636 INFO:teuthology.misc.health.smithi050.stderr:2023-10-06T01:21:28.633+0000 7f85f37fe700 1 --2- 172.21.15.50:0/1997083154 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f85f4153810 0x7f85f41555e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:21:28.636 INFO:teuthology.misc.health.smithi050.stderr:2023-10-06T01:21:28.633+0000 7f85f37fe700 1 -- 172.21.15.50:0/1997083154 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f85f40cd0a0 msgr2=0x7f85f4158db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:21:28.636 INFO:teuthology.misc.health.smithi050.stderr:2023-10-06T01:21:28.633+0000 7f85f37fe700 1 --2- 172.21.15.50:0/1997083154 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f85f40cd0a0 0x7f85f4158db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:21:28.636 INFO:teuthology.misc.health.smithi050.stderr:2023-10-06T01:21:28.633+0000 7f85f37fe700 1 -- 172.21.15.50:0/1997083154 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85e80094f0 con 0x7f85f415d170 2023-10-06T01:21:28.636 INFO:teuthology.misc.health.smithi050.stderr:2023-10-06T01:21:28.633+0000 7f85f37fe700 1 --2- 172.21.15.50:0/1997083154 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f85f415d170 0x7f85f4142c90 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f85ec00a380 tx=0x7f85ec007900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:21:28.636 INFO:teuthology.misc.health.smithi050.stderr:2023-10-06T01:21:28.633+0000 7f85daffd700 1 -- 172.21.15.50:0/1997083154 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85ec015440 con 0x7f85f415d170 2023-10-06T01:21:28.636 INFO:teuthology.misc.health.smithi050.stderr:2023-10-06T01:21:28.633+0000 7f85daffd700 1 -- 172.21.15.50:0/1997083154 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f85ec0155a0 con 0x7f85f415d170 2023-10-06T01:21:28.637 INFO:teuthology.misc.health.smithi050.stderr:2023-10-06T01:21:28.633+0000 7f85daffd700 1 -- 172.21.15.50:0/1997083154 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85ec015960 con 0x7f85f415d170 2023-10-06T01:21:28.637 INFO:teuthology.misc.health.smithi050.stderr:2023-10-06T01:21:28.633+0000 7f85f3fff700 1 -- 172.21.15.50:0/1997083154 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f85f41562a0 con 0x7f85f415d170 2023-10-06T01:21:28.637 INFO:teuthology.misc.health.smithi050.stderr:2023-10-06T01:21:28.633+0000 7f85f3fff700 1 -- 172.21.15.50:0/1997083154 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f85f41431d0 con 0x7f85f415d170 2023-10-06T01:21:28.637 INFO:teuthology.misc.health.smithi050.stderr:2023-10-06T01:21:28.634+0000 7f85f3fff700 1 -- 172.21.15.50:0/1997083154 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f85f4071740 con 0x7f85f415d170 2023-10-06T01:21:28.637 INFO:teuthology.misc.health.smithi050.stderr:2023-10-06T01:21:28.635+0000 7f85daffd700 1 -- 172.21.15.50:0/1997083154 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 4) v1 ==== 84684+0+0 (secure 0 0 0) 0x7f85ec00d440 con 0x7f85f415d170 2023-10-06T01:21:28.637 INFO:teuthology.misc.health.smithi050.stderr:2023-10-06T01:21:28.637+0000 7f85daffd700 1 --2- 172.21.15.50:0/1997083154 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f85e0066ea0 0x7f85e0069350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:21:28.638 INFO:teuthology.misc.health.smithi050.stderr:2023-10-06T01:21:28.637+0000 7f85daffd700 1 -- 172.21.15.50:0/1997083154 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(13..13 src has 1..13) v4 ==== 4467+0+0 (secure 0 0 0) 0x7f85ec084ae0 con 0x7f85f415d170 2023-10-06T01:21:28.638 INFO:teuthology.misc.health.smithi050.stderr:2023-10-06T01:21:28.637+0000 7f85f2ffd700 1 --2- 172.21.15.50:0/1997083154 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f85e0066ea0 0x7f85e0069350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:21:28.638 INFO:teuthology.misc.health.smithi050.stderr:2023-10-06T01:21:28.638+0000 7f85f2ffd700 1 --2- 172.21.15.50:0/1997083154 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f85e0066ea0 0x7f85e0069350 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f85e4007fd0 tx=0x7f85e4007d50 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:21:28.642 INFO:teuthology.misc.health.smithi050.stderr:2023-10-06T01:21:28.642+0000 7f85daffd700 1 -- 172.21.15.50:0/1997083154 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f85ec052260 con 0x7f85f415d170 2023-10-06T01:21:28.848 INFO:teuthology.misc.health.smithi050.stderr:2023-10-06T01:21:28.847+0000 7f85f3fff700 1 -- 172.21.15.50:0/1997083154 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f85f4064ad0 con 0x7f85f415d170 2023-10-06T01:21:28.848 INFO:teuthology.misc.health.smithi050.stderr:2023-10-06T01:21:28.848+0000 7f85daffd700 1 -- 172.21.15.50:0/1997083154 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v13) v1 ==== 74+0+10396 (secure 0 0 0) 0x7f85ec01a090 con 0x7f85f415d170 2023-10-06T01:21:28.848 INFO:teuthology.misc.health.smithi050.stdout: 2023-10-06T01:21:28.849 INFO:teuthology.misc.health.smithi050.stdout:{"epoch":13,"fsid":"0bfd9a6b-1587-4fe4-a89e-e43c00286b4e","created":"2023-10-06T01:21:16.828801+0000","modified":"2023-10-06T01:21:28.584523+0000","last_up_change":"2023-10-06T01:21:28.584523+0000","last_in_change":"2023-10-06T01:21:20.179863+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[],"osds":[{"osd":0,"uuid":"9060727a-3959-4de3-8363-c5c5d7826c9a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":87837},{"type":"v1","addr":"172.21.15.50:6801","nonce":87837}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":87837},{"type":"v1","addr":"172.21.15.50:6803","nonce":87837}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":87837},{"type":"v1","addr":"172.21.15.50:6807","nonce":87837}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":87837},{"type":"v1","addr":"172.21.15.50:6805","nonce":87837}]},"public_addr":"172.21.15.50:6801/87837","cluster_addr":"172.21.15.50:6803/87837","heartbeat_back_addr":"172.21.15.50:6807/87837","heartbeat_front_addr":"172.21.15.50:6805/87837","state":["exists","up"]},{"osd":1,"uuid":"5ad9ef12-b579-47ea-b690-90ba887e2cef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":87853},{"type":"v1","addr":"172.21.15.50:6809","nonce":87853}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":87853},{"type":"v1","addr":"172.21.15.50:6811","nonce":87853}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":87853},{"type":"v1","addr":"172.21.15.50:6815","nonce":87853}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":87853},{"type":"v1","addr":"172.21.15.50:6813","nonce":87853}]},"public_addr":"172.21.15.50:6809/87853","cluster_addr":"172.21.15.50:6811/87853","heartbeat_back_addr":"172.21.15.50:6815/87853","heartbeat_front_addr":"172.21.15.50:6813/87853","state":["exists","up"]},{"osd":2,"uuid":"c7aee044-6f75-436f-90e1-ba42a57359bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6821","nonce":87855},{"type":"v1","addr":"172.21.15.50:6822","nonce":87855}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6824","nonce":87855},{"type":"v1","addr":"172.21.15.50:6826","nonce":87855}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":87855},{"type":"v1","addr":"172.21.15.50:6831","nonce":87855}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":87855},{"type":"v1","addr":"172.21.15.50:6829","nonce":87855}]},"public_addr":"172.21.15.50:6822/87855","cluster_addr":"172.21.15.50:6826/87855","heartbeat_back_addr":"172.21.15.50:6831/87855","heartbeat_front_addr":"172.21.15.50:6829/87855","state":["exists","up"]},{"osd":3,"uuid":"d9b901c8-e8b2-44af-9508-f453120a96c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":87856},{"type":"v1","addr":"172.21.15.50:6817","nonce":87856}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":87856},{"type":"v1","addr":"172.21.15.50:6819","nonce":87856}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6825","nonce":87856},{"type":"v1","addr":"172.21.15.50:6827","nonce":87856}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6820","nonce":87856},{"type":"v1","addr":"172.21.15.50:6823","nonce":87856}]},"public_addr":"172.21.15.50:6817/87856","cluster_addr":"172.21.15.50:6819/87856","heartbeat_back_addr":"172.21.15.50:6827/87856","heartbeat_front_addr":"172.21.15.50:6823/87856","state":["exists","up"]},{"osd":4,"uuid":"2b3c6b38-e3e9-4301-9445-60fd3fe8ce03","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":85805},{"type":"v1","addr":"172.21.15.155:6801","nonce":85805}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":85805},{"type":"v1","addr":"172.21.15.155:6803","nonce":85805}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6806","nonce":85805},{"type":"v1","addr":"172.21.15.155:6807","nonce":85805}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6804","nonce":85805},{"type":"v1","addr":"172.21.15.155:6805","nonce":85805}]},"public_addr":"172.21.15.155:6801/85805","cluster_addr":"172.21.15.155:6803/85805","heartbeat_back_addr":"172.21.15.155:6807/85805","heartbeat_front_addr":"172.21.15.155:6805/85805","state":["exists","up"]},{"osd":5,"uuid":"417b5f8f-65f1-4c94-91a7-a6ce03fe1679","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6816","nonce":85807},{"type":"v1","addr":"172.21.15.155:6818","nonce":85807}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6820","nonce":85807},{"type":"v1","addr":"172.21.15.155:6822","nonce":85807}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6828","nonce":85807},{"type":"v1","addr":"172.21.15.155:6830","nonce":85807}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6824","nonce":85807},{"type":"v1","addr":"172.21.15.155:6826","nonce":85807}]},"public_addr":"172.21.15.155:6818/85807","cluster_addr":"172.21.15.155:6822/85807","heartbeat_back_addr":"172.21.15.155:6830/85807","heartbeat_front_addr":"172.21.15.155:6826/85807","state":["exists","up"]},{"osd":6,"uuid":"c150cff3-aee4-4714-9c08-d182b1ba9ffd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6808","nonce":85806},{"type":"v1","addr":"172.21.15.155:6809","nonce":85806}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6810","nonce":85806},{"type":"v1","addr":"172.21.15.155:6811","nonce":85806}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6814","nonce":85806},{"type":"v1","addr":"172.21.15.155:6815","nonce":85806}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6812","nonce":85806},{"type":"v1","addr":"172.21.15.155:6813","nonce":85806}]},"public_addr":"172.21.15.155:6809/85806","cluster_addr":"172.21.15.155:6811/85806","heartbeat_back_addr":"172.21.15.155:6815/85806","heartbeat_front_addr":"172.21.15.155:6813/85806","state":["exists","up"]},{"osd":7,"uuid":"71107f0e-04d1-4e72-a0ec-0faf6af003e7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6817","nonce":85832},{"type":"v1","addr":"172.21.15.155:6819","nonce":85832}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6821","nonce":85832},{"type":"v1","addr":"172.21.15.155:6823","nonce":85832}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6829","nonce":85832},{"type":"v1","addr":"172.21.15.155:6831","nonce":85832}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6825","nonce":85832},{"type":"v1","addr":"172.21.15.155:6827","nonce":85832}]},"public_addr":"172.21.15.155:6819/85832","cluster_addr":"172.21.15.155:6823/85832","heartbeat_back_addr":"172.21.15.155:6831/85832","heartbeat_front_addr":"172.21.15.155:6827/85832","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T01:21:28.851 INFO:teuthology.misc.health.smithi050.stderr:2023-10-06T01:21:28.850+0000 7f85f3fff700 1 -- 172.21.15.50:0/1997083154 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f85e0066ea0 msgr2=0x7f85e0069350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:21:28.851 INFO:teuthology.misc.health.smithi050.stderr:2023-10-06T01:21:28.850+0000 7f85f3fff700 1 --2- 172.21.15.50:0/1997083154 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f85e0066ea0 0x7f85e0069350 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f85e4007fd0 tx=0x7f85e4007d50 comp rx=0 tx=0).stop 2023-10-06T01:21:28.852 INFO:teuthology.misc.health.smithi050.stderr:2023-10-06T01:21:28.850+0000 7f85f3fff700 1 -- 172.21.15.50:0/1997083154 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f85f415d170 msgr2=0x7f85f4142c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:21:28.852 INFO:teuthology.misc.health.smithi050.stderr:2023-10-06T01:21:28.850+0000 7f85f3fff700 1 --2- 172.21.15.50:0/1997083154 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f85f415d170 0x7f85f4142c90 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f85ec00a380 tx=0x7f85ec007900 comp rx=0 tx=0).stop 2023-10-06T01:21:28.852 INFO:teuthology.misc.health.smithi050.stderr:2023-10-06T01:21:28.850+0000 7f85f3fff700 1 -- 172.21.15.50:0/1997083154 shutdown_connections 2023-10-06T01:21:28.852 INFO:teuthology.misc.health.smithi050.stderr:2023-10-06T01:21:28.850+0000 7f85f3fff700 1 --2- 172.21.15.50:0/1997083154 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f85f415d170 0x7f85f4142c90 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:21:28.852 INFO:teuthology.misc.health.smithi050.stderr:2023-10-06T01:21:28.850+0000 7f85f3fff700 1 --2- 172.21.15.50:0/1997083154 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f85e0066ea0 0x7f85e0069350 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:21:28.852 INFO:teuthology.misc.health.smithi050.stderr:2023-10-06T01:21:28.850+0000 7f85f3fff700 1 --2- 172.21.15.50:0/1997083154 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f85f40cd0a0 0x7f85f4158db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:21:28.852 INFO:teuthology.misc.health.smithi050.stderr:2023-10-06T01:21:28.850+0000 7f85f3fff700 1 --2- 172.21.15.50:0/1997083154 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f85f4153810 0x7f85f41555e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:21:28.852 INFO:teuthology.misc.health.smithi050.stderr:2023-10-06T01:21:28.850+0000 7f85f3fff700 1 -- 172.21.15.50:0/1997083154 >> 172.21.15.50:0/1997083154 conn(0x7f85f406ed80 msgr2=0x7f85f4152060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:21:28.852 INFO:teuthology.misc.health.smithi050.stderr:2023-10-06T01:21:28.850+0000 7f85f3fff700 1 -- 172.21.15.50:0/1997083154 shutdown_connections 2023-10-06T01:21:28.852 INFO:teuthology.misc.health.smithi050.stderr:2023-10-06T01:21:28.850+0000 7f85f3fff700 1 -- 172.21.15.50:0/1997083154 wait complete. 2023-10-06T01:21:28.866 DEBUG:teuthology.misc:8 of 8 OSDs are up 2023-10-06T01:21:28.866 INFO:tasks.ceph:Creating RBD pool 2023-10-06T01:21:28.866 DEBUG:teuthology.orchestra.run.smithi050:> sudo ceph --cluster ceph osd pool create rbd 8 2023-10-06T01:21:29.046 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:29.045+0000 7f0aebfff700 1 Processor -- start 2023-10-06T01:21:29.047 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:29.046+0000 7f0aebfff700 1 -- start start 2023-10-06T01:21:29.049 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:29.047+0000 7f0aebfff700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f0aec06e1a0 0x7f0aec06e5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:21:29.049 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:29.047+0000 7f0aebfff700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0aec0acb10 con 0x7f0aec156130 2023-10-06T01:21:29.049 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:29.047+0000 7f0aebfff700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0aec06eb00 con 0x7f0aec159ca0 2023-10-06T01:21:29.049 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:29.047+0000 7f0aebfff700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0aec15a120 con 0x7f0aec06e1a0 2023-10-06T01:21:29.049 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:29.047+0000 7f0aeaffd700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f0aec156130 0x7f0aec0ae0f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:36046/0 (socket says 172.21.15.50:36046) 2023-10-06T01:21:29.049 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:29.047+0000 7f0aeaffd700 1 -- 172.21.15.50:0/3260401872 learned_addr learned my addr 172.21.15.50:0/3260401872 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-10-06T01:21:29.050 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:29.047+0000 7f0aeb7fe700 1 --2- 172.21.15.50:0/3260401872 >> v2:172.21.15.155:3300/0 conn(0x7f0aec06e1a0 0x7f0aec06e5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:21:29.050 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:29.047+0000 7f0ae9ffb700 1 -- 172.21.15.50:0/3260401872 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4026369512 0 0) 0x7f0aec0acb10 con 0x7f0aec156130 2023-10-06T01:21:29.050 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:29.048+0000 7f0ae9ffb700 1 -- 172.21.15.50:0/3260401872 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0ad4003570 con 0x7f0aec156130 2023-10-06T01:21:29.050 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:29.048+0000 7f0aeb7fe700 1 -- 172.21.15.50:0/3260401872 >> v1:172.21.15.155:6789/0 conn(0x7f0aec159ca0 legacy=0x7f0aec0c8a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:21:29.050 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:29.048+0000 7f0aeb7fe700 1 -- 172.21.15.50:0/3260401872 >> v1:172.21.15.50:6789/0 conn(0x7f0aec156130 legacy=0x7f0aec0ae0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:21:29.050 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:29.048+0000 7f0aeb7fe700 1 -- 172.21.15.50:0/3260401872 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0aec156500 con 0x7f0aec06e1a0 2023-10-06T01:21:29.050 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:29.048+0000 7f0aeb7fe700 1 --2- 172.21.15.50:0/3260401872 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0aec06e1a0 0x7f0aec06e5c0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f0ae4009e60 tx=0x7f0ae4009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b1922df121c7e7f server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:21:29.051 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:29.048+0000 7f0ae9ffb700 1 -- 172.21.15.50:0/3260401872 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ae400bbf0 con 0x7f0aec06e1a0 2023-10-06T01:21:29.052 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:29.048+0000 7f0ae9ffb700 1 -- 172.21.15.50:0/3260401872 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ae400bd50 con 0x7f0aec06e1a0 2023-10-06T01:21:29.052 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:29.048+0000 7f0ae9ffb700 1 -- 172.21.15.50:0/3260401872 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ae4011670 con 0x7f0aec06e1a0 2023-10-06T01:21:29.052 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:29.049+0000 7f0aebfff700 1 -- 172.21.15.50:0/3260401872 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0aec06e1a0 msgr2=0x7f0aec06e5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:21:29.052 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:29.049+0000 7f0aebfff700 1 --2- 172.21.15.50:0/3260401872 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0aec06e1a0 0x7f0aec06e5c0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f0ae4009e60 tx=0x7f0ae4009780 comp rx=0 tx=0).stop 2023-10-06T01:21:29.052 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:29.049+0000 7f0aebfff700 1 -- 172.21.15.50:0/3260401872 shutdown_connections 2023-10-06T01:21:29.052 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:29.049+0000 7f0aebfff700 1 --2- 172.21.15.50:0/3260401872 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0aec06e1a0 0x7f0aec06e5c0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:21:29.052 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:29.049+0000 7f0aebfff700 1 -- 172.21.15.50:0/3260401872 >> 172.21.15.50:0/3260401872 conn(0x7f0aec0cbf10 msgr2=0x7f0aec0cc310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:21:29.052 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:29.049+0000 7f0aebfff700 1 -- 172.21.15.50:0/3260401872 shutdown_connections 2023-10-06T01:21:29.052 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:29.049+0000 7f0aebfff700 1 -- 172.21.15.50:0/3260401872 wait complete. 2023-10-06T01:21:29.053 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:29.051+0000 7f0aebfff700 1 Processor -- start 2023-10-06T01:21:29.053 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:29.051+0000 7f0aebfff700 1 -- start start 2023-10-06T01:21:29.055 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:29.052+0000 7f0aebfff700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0aec06e1a0 0x7f0aec0cb390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:21:29.055 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:29.052+0000 7f0aebfff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0aec156130 0x7f0aec15e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:21:29.055 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:29.052+0000 7f0aebfff700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0aec159ca0 0x7f0aec0c6090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:21:29.055 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:29.052+0000 7f0aebfff700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0aec150a80 con 0x7f0aec156130 2023-10-06T01:21:29.055 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:29.052+0000 7f0aebfff700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0aec14fe70 con 0x7f0aec06e1a0 2023-10-06T01:21:29.055 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:29.052+0000 7f0aebfff700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0aec150150 con 0x7f0aec159ca0 2023-10-06T01:21:29.055 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:29.052+0000 7f0aeaffd700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0aec06e1a0 0x7f0aec0cb390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:21:29.055 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:29.052+0000 7f0aea7fc700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0aec156130 0x7f0aec15e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:21:29.055 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:29.052+0000 7f0aeaffd700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0aec06e1a0 0x7f0aec0cb390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.50:46226/0 (socket says 172.21.15.50:46226) 2023-10-06T01:21:29.055 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:29.052+0000 7f0aeaffd700 1 -- 172.21.15.50:0/726848816 learned_addr learned my addr 172.21.15.50:0/726848816 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-06T01:21:29.055 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:29.052+0000 7f0aeb7fe700 1 --2- 172.21.15.50:0/726848816 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0aec159ca0 0x7f0aec0c6090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:21:29.056 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:29.052+0000 7f0aea7fc700 1 -- 172.21.15.50:0/726848816 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0aec159ca0 msgr2=0x7f0aec0c6090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:21:29.056 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:29.052+0000 7f0aea7fc700 1 --2- 172.21.15.50:0/726848816 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0aec159ca0 0x7f0aec0c6090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:21:29.056 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:29.052+0000 7f0aea7fc700 1 -- 172.21.15.50:0/726848816 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0aec06e1a0 msgr2=0x7f0aec0cb390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:21:29.056 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:29.052+0000 7f0aea7fc700 1 --2- 172.21.15.50:0/726848816 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0aec06e1a0 0x7f0aec0cb390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:21:29.056 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:29.052+0000 7f0aea7fc700 1 -- 172.21.15.50:0/726848816 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ae4009a20 con 0x7f0aec156130 2023-10-06T01:21:29.056 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:29.053+0000 7f0aea7fc700 1 --2- 172.21.15.50:0/726848816 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0aec156130 0x7f0aec15e340 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f0ae000c4c0 tx=0x7f0ae0007ea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:21:29.056 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:29.053+0000 7f0ad2ffd700 1 -- 172.21.15.50:0/726848816 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ae000ce70 con 0x7f0aec156130 2023-10-06T01:21:29.056 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:29.053+0000 7f0aebfff700 1 -- 172.21.15.50:0/726848816 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0aec150430 con 0x7f0aec156130 2023-10-06T01:21:29.056 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:29.053+0000 7f0ad2ffd700 1 -- 172.21.15.50:0/726848816 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ae0011590 con 0x7f0aec156130 2023-10-06T01:21:29.056 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:29.053+0000 7f0ad2ffd700 1 -- 172.21.15.50:0/726848816 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ae0011950 con 0x7f0aec156130 2023-10-06T01:21:29.056 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:29.053+0000 7f0aebfff700 1 -- 172.21.15.50:0/726848816 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0aec0cb8d0 con 0x7f0aec156130 2023-10-06T01:21:29.056 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:29.054+0000 7f0aebfff700 1 -- 172.21.15.50:0/726848816 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0aec150bf0 con 0x7f0aec156130 2023-10-06T01:21:29.057 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:29.055+0000 7f0ad2ffd700 1 -- 172.21.15.50:0/726848816 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 4) v1 ==== 84684+0+0 (secure 0 0 0) 0x7f0ae0011cc0 con 0x7f0aec156130 2023-10-06T01:21:29.057 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:29.056+0000 7f0ad2ffd700 1 --2- 172.21.15.50:0/726848816 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f0ad8066ea0 0x7f0ad8069350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:21:29.057 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:29.056+0000 7f0ad2ffd700 1 -- 172.21.15.50:0/726848816 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(13..13 src has 1..13) v4 ==== 4467+0+0 (secure 0 0 0) 0x7f0ae0083260 con 0x7f0aec156130 2023-10-06T01:21:29.058 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:29.056+0000 7f0aeaffd700 1 --2- 172.21.15.50:0/726848816 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f0ad8066ea0 0x7f0ad8069350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:21:29.058 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:29.057+0000 7f0aeaffd700 1 --2- 172.21.15.50:0/726848816 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f0ad8066ea0 0x7f0ad8069350 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f0adc001ad0 tx=0x7f0adc009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:21:29.061 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:29.060+0000 7f0ad2ffd700 1 -- 172.21.15.50:0/726848816 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f0ae00509e0 con 0x7f0aec156130 2023-10-06T01:21:29.265 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:29.264+0000 7f0aebfff700 1 -- 172.21.15.50:0/726848816 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "rbd", "pg_num": 8} v 0) v1 -- 0x7f0aec05f270 con 0x7f0aec156130 2023-10-06T01:21:29.591 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:29.590+0000 7f0ad2ffd700 1 -- 172.21.15.50:0/726848816 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "rbd", "pg_num": 8}]=0 pool 'rbd' created v14) v1 ==== 109+0+0 (secure 0 0 0) 0x7f0ae0017020 con 0x7f0aec156130 2023-10-06T01:21:29.595 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:29.594+0000 7f0aebfff700 1 -- 172.21.15.50:0/726848816 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f0ad8066ea0 msgr2=0x7f0ad8069350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:21:29.595 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:29.594+0000 7f0aebfff700 1 --2- 172.21.15.50:0/726848816 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f0ad8066ea0 0x7f0ad8069350 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f0adc001ad0 tx=0x7f0adc009040 comp rx=0 tx=0).stop 2023-10-06T01:21:29.595 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:29.594+0000 7f0aebfff700 1 -- 172.21.15.50:0/726848816 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0aec156130 msgr2=0x7f0aec15e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:21:29.595 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:29.594+0000 7f0aebfff700 1 --2- 172.21.15.50:0/726848816 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0aec156130 0x7f0aec15e340 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f0ae000c4c0 tx=0x7f0ae0007ea0 comp rx=0 tx=0).stop 2023-10-06T01:21:29.595 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:29.594+0000 7f0aebfff700 1 -- 172.21.15.50:0/726848816 shutdown_connections 2023-10-06T01:21:29.595 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:29.594+0000 7f0aebfff700 1 --2- 172.21.15.50:0/726848816 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0aec159ca0 0x7f0aec0c6090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:21:29.595 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:29.594+0000 7f0aebfff700 1 --2- 172.21.15.50:0/726848816 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f0ad8066ea0 0x7f0ad8069350 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:21:29.596 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:29.594+0000 7f0aebfff700 1 --2- 172.21.15.50:0/726848816 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0aec06e1a0 0x7f0aec0cb390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:21:29.596 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:29.594+0000 7f0aebfff700 1 --2- 172.21.15.50:0/726848816 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0aec156130 0x7f0aec15e340 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:21:29.596 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:29.594+0000 7f0aebfff700 1 -- 172.21.15.50:0/726848816 >> 172.21.15.50:0/726848816 conn(0x7f0aec0cbf10 msgr2=0x7f0aec0b0240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:21:29.596 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:29.594+0000 7f0aebfff700 1 -- 172.21.15.50:0/726848816 shutdown_connections 2023-10-06T01:21:29.596 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:29.594+0000 7f0aebfff700 1 -- 172.21.15.50:0/726848816 wait complete. 2023-10-06T01:21:29.596 INFO:teuthology.orchestra.run.smithi050.stderr:pool 'rbd' created 2023-10-06T01:21:29.613 DEBUG:teuthology.orchestra.run.smithi050:> sudo ceph --cluster ceph osd pool application enable rbd rbd --yes-i-really-mean-it 2023-10-06T01:21:29.799 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:29.798+0000 7fc676d9d700 1 Processor -- start 2023-10-06T01:21:29.799 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:29.798+0000 7fc676d9d700 1 -- start start 2023-10-06T01:21:29.800 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:29.799+0000 7fc676d9d700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fc67006ab10 0x7fc67006e0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:21:29.800 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:29.799+0000 7fc676d9d700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fc67013fb70 0x7fc67006e630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:21:29.800 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:29.799+0000 7fc676d9d700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc67006ee60 con 0x7fc67013f7a0 2023-10-06T01:21:29.800 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:29.799+0000 7fc676d9d700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc6700c24a0 con 0x7fc67006ab10 2023-10-06T01:21:29.800 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:29.799+0000 7fc676d9d700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc67006f140 con 0x7fc67013fb70 2023-10-06T01:21:29.802 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:29.800+0000 7fc67659c700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fc67013fb70 0x7fc67006e630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:21:29.802 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:29.800+0000 7fc67659c700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fc67013fb70 0x7fc67006e630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.50:46236/0 (socket says 172.21.15.50:46236) 2023-10-06T01:21:29.802 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:29.800+0000 7fc67659c700 1 -- 172.21.15.50:0/3235180973 learned_addr learned my addr 172.21.15.50:0/3235180973 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-06T01:21:29.802 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:29.800+0000 7fc67559a700 1 --2- 172.21.15.50:0/3235180973 >> v2:172.21.15.50:3300/0 conn(0x7fc67006ab10 0x7fc67006e0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:21:29.802 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:29.800+0000 7fc67659c700 1 -- 172.21.15.50:0/3235180973 >> v2:172.21.15.50:3300/0 conn(0x7fc67006ab10 msgr2=0x7fc67006e0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:21:29.802 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:29.800+0000 7fc67659c700 1 --2- 172.21.15.50:0/3235180973 >> v2:172.21.15.50:3300/0 conn(0x7fc67006ab10 0x7fc67006e0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:21:29.802 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:29.800+0000 7fc67659c700 1 -- 172.21.15.50:0/3235180973 >> v1:172.21.15.50:6789/0 conn(0x7fc67013f7a0 legacy=0x7fc67006a400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:21:29.802 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:29.800+0000 7fc67659c700 1 -- 172.21.15.50:0/3235180973 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc67006f420 con 0x7fc67013fb70 2023-10-06T01:21:29.802 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:29.801+0000 7fc67659c700 1 --2- 172.21.15.50:0/3235180973 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc67013fb70 0x7fc67006e630 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fc67006dac0 tx=0x7fc668009840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6cf6795a9f5a1bac server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:21:29.803 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:29.801+0000 7fc674d99700 1 -- 172.21.15.50:0/3235180973 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc66800e070 con 0x7fc67013fb70 2023-10-06T01:21:29.803 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:29.801+0000 7fc674d99700 1 -- 172.21.15.50:0/3235180973 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc66800ba50 con 0x7fc67013fb70 2023-10-06T01:21:29.803 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:29.801+0000 7fc674d99700 1 -- 172.21.15.50:0/3235180973 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6680092e0 con 0x7fc67013fb70 2023-10-06T01:21:29.804 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:29.801+0000 7fc676d9d700 1 -- 172.21.15.50:0/3235180973 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc67013fb70 msgr2=0x7fc67006e630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:21:29.804 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:29.801+0000 7fc676d9d700 1 --2- 172.21.15.50:0/3235180973 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc67013fb70 0x7fc67006e630 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fc67006dac0 tx=0x7fc668009840 comp rx=0 tx=0).stop 2023-10-06T01:21:29.804 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:29.802+0000 7fc676d9d700 1 -- 172.21.15.50:0/3235180973 shutdown_connections 2023-10-06T01:21:29.804 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:29.802+0000 7fc676d9d700 1 --2- 172.21.15.50:0/3235180973 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc67013fb70 0x7fc67006e630 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:21:29.804 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:29.802+0000 7fc676d9d700 1 --2- 172.21.15.50:0/3235180973 >> v2:172.21.15.50:3300/0 conn(0x7fc67006ab10 0x7fc67006e0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:21:29.804 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:29.802+0000 7fc676d9d700 1 -- 172.21.15.50:0/3235180973 >> 172.21.15.50:0/3235180973 conn(0x7fc6700680c0 msgr2=0x7fc6700cbef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:21:29.804 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:29.802+0000 7fc676d9d700 1 -- 172.21.15.50:0/3235180973 shutdown_connections 2023-10-06T01:21:29.804 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:29.802+0000 7fc676d9d700 1 -- 172.21.15.50:0/3235180973 wait complete. 2023-10-06T01:21:29.805 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:29.804+0000 7fc676d9d700 1 Processor -- start 2023-10-06T01:21:29.805 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:29.804+0000 7fc676d9d700 1 -- start start 2023-10-06T01:21:29.806 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:29.805+0000 7fc676d9d700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc67006ab10 0x7fc670154ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:21:29.806 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:29.806+0000 7fc676d9d700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc67013f7a0 0x7fc6701388c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:21:29.808 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:29.806+0000 7fc676d9d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc67013fb70 0x7fc670069ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:21:29.808 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:29.806+0000 7fc676d9d700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc67016abb0 con 0x7fc67013fb70 2023-10-06T01:21:29.808 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:29.806+0000 7fc676d9d700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc67016ae90 con 0x7fc67006ab10 2023-10-06T01:21:29.808 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:29.806+0000 7fc676d9d700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc67016b170 con 0x7fc67013f7a0 2023-10-06T01:21:29.808 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:29.806+0000 7fc675d9b700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc67006ab10 0x7fc670154ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:21:29.808 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:29.806+0000 7fc675d9b700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc67006ab10 0x7fc670154ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.50:46238/0 (socket says 172.21.15.50:46238) 2023-10-06T01:21:29.809 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:29.806+0000 7fc675d9b700 1 -- 172.21.15.50:0/324801638 learned_addr learned my addr 172.21.15.50:0/324801638 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-06T01:21:29.809 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:29.806+0000 7fc67559a700 1 --2- 172.21.15.50:0/324801638 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc67013f7a0 0x7fc6701388c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:21:29.809 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:29.806+0000 7fc67659c700 1 --2- 172.21.15.50:0/324801638 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc67013fb70 0x7fc670069ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:21:29.809 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:29.806+0000 7fc675d9b700 1 -- 172.21.15.50:0/324801638 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc67013f7a0 msgr2=0x7fc6701388c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:21:29.809 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:29.806+0000 7fc675d9b700 1 --2- 172.21.15.50:0/324801638 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc67013f7a0 0x7fc6701388c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:21:29.809 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:29.806+0000 7fc675d9b700 1 -- 172.21.15.50:0/324801638 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc67013fb70 msgr2=0x7fc670069ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:21:29.809 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:29.806+0000 7fc675d9b700 1 --2- 172.21.15.50:0/324801638 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc67013fb70 0x7fc670069ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:21:29.809 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:29.806+0000 7fc675d9b700 1 -- 172.21.15.50:0/324801638 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc668009ae0 con 0x7fc67006ab10 2023-10-06T01:21:29.809 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:29.807+0000 7fc675d9b700 1 --2- 172.21.15.50:0/324801638 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc67006ab10 0x7fc670154ab0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fc66c001cb0 tx=0x7fc66c012900 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:21:29.809 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:29.807+0000 7fc665ffb700 1 -- 172.21.15.50:0/324801638 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc66c017070 con 0x7fc67006ab10 2023-10-06T01:21:29.809 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:29.807+0000 7fc665ffb700 1 -- 172.21.15.50:0/324801638 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc66c014b20 con 0x7fc67006ab10 2023-10-06T01:21:29.810 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:29.807+0000 7fc665ffb700 1 -- 172.21.15.50:0/324801638 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc66c0120d0 con 0x7fc67006ab10 2023-10-06T01:21:29.810 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:29.807+0000 7fc676d9d700 1 -- 172.21.15.50:0/324801638 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc67016b450 con 0x7fc67006ab10 2023-10-06T01:21:29.810 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:29.807+0000 7fc676d9d700 1 -- 172.21.15.50:0/324801638 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc670154ff0 con 0x7fc67006ab10 2023-10-06T01:21:29.810 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:29.808+0000 7fc676d9d700 1 -- 172.21.15.50:0/324801638 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc67016b2b0 con 0x7fc67006ab10 2023-10-06T01:21:29.810 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:29.809+0000 7fc665ffb700 1 -- 172.21.15.50:0/324801638 <== mon.1 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 4) v1 ==== 84684+0+0 (secure 0 0 0) 0x7fc66c0124c0 con 0x7fc67006ab10 2023-10-06T01:21:29.813 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:29.811+0000 7fc665ffb700 1 --2- 172.21.15.50:0/324801638 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7fc654066ea0 0x7fc654069350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:21:29.813 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:29.811+0000 7fc665ffb700 1 -- 172.21.15.50:0/324801638 <== mon.1 v2:172.21.15.155:3300/0 5 ==== osd_map(14..14 src has 1..14) v4 ==== 4809+0+0 (secure 0 0 0) 0x7fc66c08c490 con 0x7fc67006ab10 2023-10-06T01:21:29.814 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:29.811+0000 7fc67559a700 1 --2- 172.21.15.50:0/324801638 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7fc654066ea0 0x7fc654069350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:21:29.814 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:29.812+0000 7fc67559a700 1 --2- 172.21.15.50:0/324801638 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7fc654066ea0 0x7fc654069350 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fc67016a970 tx=0x7fc660008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:21:29.816 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:29.815+0000 7fc665ffb700 1 -- 172.21.15.50:0/324801638 <== mon.1 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fc67016b2b0 con 0x7fc67006ab10 2023-10-06T01:21:30.023 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:30.022+0000 7fc676d9d700 1 -- 172.21.15.50:0/324801638 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "osd pool application enable", "pool": "rbd", "app": "rbd", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fc67016b2b0 con 0x7fc67006ab10 2023-10-06T01:21:30.598 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:30.597+0000 7fc665ffb700 1 -- 172.21.15.50:0/324801638 <== mon.1 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool application enable", "pool": "rbd", "app": "rbd", "yes_i_really_mean_it": true}]=0 enabled application 'rbd' on pool 'rbd' v15) v1 ==== 173+0+0 (secure 0 0 0) 0x7fc67016b2b0 con 0x7fc67006ab10 2023-10-06T01:21:30.602 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:30.602+0000 7fc676d9d700 1 -- 172.21.15.50:0/324801638 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7fc654066ea0 msgr2=0x7fc654069350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:21:30.602 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:30.602+0000 7fc676d9d700 1 --2- 172.21.15.50:0/324801638 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7fc654066ea0 0x7fc654069350 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fc67016a970 tx=0x7fc660008040 comp rx=0 tx=0).stop 2023-10-06T01:21:30.603 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:30.602+0000 7fc676d9d700 1 -- 172.21.15.50:0/324801638 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc67006ab10 msgr2=0x7fc670154ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:21:30.603 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:30.602+0000 7fc676d9d700 1 --2- 172.21.15.50:0/324801638 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc67006ab10 0x7fc670154ab0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fc66c001cb0 tx=0x7fc66c012900 comp rx=0 tx=0).stop 2023-10-06T01:21:30.604 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:30.602+0000 7fc676d9d700 1 -- 172.21.15.50:0/324801638 shutdown_connections 2023-10-06T01:21:30.604 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:30.602+0000 7fc676d9d700 1 --2- 172.21.15.50:0/324801638 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc67013fb70 0x7fc670069ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:21:30.604 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:30.602+0000 7fc676d9d700 1 --2- 172.21.15.50:0/324801638 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7fc654066ea0 0x7fc654069350 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:21:30.604 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:30.602+0000 7fc676d9d700 1 --2- 172.21.15.50:0/324801638 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc67006ab10 0x7fc670154ab0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:21:30.604 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:30.602+0000 7fc676d9d700 1 --2- 172.21.15.50:0/324801638 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc67013f7a0 0x7fc6701388c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:21:30.604 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:30.602+0000 7fc676d9d700 1 -- 172.21.15.50:0/324801638 >> 172.21.15.50:0/324801638 conn(0x7fc6700680c0 msgr2=0x7fc6700c7440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:21:30.604 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:30.602+0000 7fc676d9d700 1 -- 172.21.15.50:0/324801638 shutdown_connections 2023-10-06T01:21:30.604 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:30.602+0000 7fc676d9d700 1 -- 172.21.15.50:0/324801638 wait complete. 2023-10-06T01:21:30.605 INFO:teuthology.orchestra.run.smithi050.stderr:enabled application 'rbd' on pool 'rbd' 2023-10-06T01:21:30.623 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2023-10-06T01:21:30.623 INFO:tasks.ceph.mds.a:Restarting daemon 2023-10-06T01:21:30.624 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-10-06T01:21:30.628 INFO:tasks.ceph.mds.a:Started 2023-10-06T01:21:30.628 INFO:tasks.ceph.mds.c:Restarting daemon 2023-10-06T01:21:30.628 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-10-06T01:21:30.632 INFO:tasks.ceph.mds.c:Started 2023-10-06T01:21:30.632 INFO:tasks.ceph.mds.b:Restarting daemon 2023-10-06T01:21:30.632 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-10-06T01:21:30.637 INFO:tasks.ceph.mds.b:Started 2023-10-06T01:21:30.637 INFO:tasks.ceph.mds.d:Restarting daemon 2023-10-06T01:21:30.638 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-10-06T01:21:30.642 INFO:tasks.ceph.mds.d:Started 2023-10-06T01:21:30.643 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2023-10-06T01:21:30.643 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T01:21:30.770 INFO:tasks.ceph.mds.a.smithi050.stdout:starting mds.a at 2023-10-06T01:21:30.771 INFO:tasks.ceph.mds.c.smithi050.stdout:starting mds.c at 2023-10-06T01:21:30.777 INFO:tasks.ceph.mds.b.smithi155.stdout:starting mds.b at 2023-10-06T01:21:30.778 INFO:tasks.ceph.mds.d.smithi155.stdout:starting mds.d at 2023-10-06T01:21:30.844 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:30.843+0000 7f8b0efff700 1 Processor -- start 2023-10-06T01:21:30.844 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:30.843+0000 7f8b0efff700 1 -- start start 2023-10-06T01:21:30.845 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:30.844+0000 7f8b0efff700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f8b081595a0 0x7f8b080aa570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:21:30.845 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:30.844+0000 7f8b0efff700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8b080b49e0 0x7f8b080aaab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:21:30.845 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:30.844+0000 7f8b0efff700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8b080b0ca0 con 0x7f8b080b07a0 2023-10-06T01:21:30.845 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:30.844+0000 7f8b0efff700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8b080b0f80 con 0x7f8b081595a0 2023-10-06T01:21:30.845 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:30.844+0000 7f8b0efff700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b080b1260 con 0x7f8b080b49e0 2023-10-06T01:21:30.847 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:30.844+0000 7f8b07fff700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8b080b49e0 0x7f8b080aaab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:21:30.847 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:30.844+0000 7f8b0cd9b700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f8b081595a0 0x7f8b080aa570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:21:30.847 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:30.844+0000 7f8b0d59c700 1 --1- >> v1:172.21.15.155:6789/0 conn(0x7f8b080b07a0 0x7f8b080b38d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.155:6789/0 says I am v1:172.21.15.50:34222/0 (socket says 172.21.15.50:34222) 2023-10-06T01:21:30.847 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:30.844+0000 7f8b0d59c700 1 -- 172.21.15.50:0/2438909204 learned_addr learned my addr 172.21.15.50:0/2438909204 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-10-06T01:21:30.847 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:30.845+0000 7f8b0cd9b700 1 -- 172.21.15.50:0/2438909204 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8b080b49e0 msgr2=0x7f8b080aaab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:21:30.847 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:30.845+0000 7f8b0cd9b700 1 --2- 172.21.15.50:0/2438909204 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8b080b49e0 0x7f8b080aaab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:21:30.847 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:30.845+0000 7f8b077fe700 1 -- 172.21.15.50:0/2438909204 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2494860910 0 0) 0x7f8b080b0ca0 con 0x7f8b080b07a0 2023-10-06T01:21:30.847 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:30.845+0000 7f8b0cd9b700 1 -- 172.21.15.50:0/2438909204 >> v1:172.21.15.155:6789/0 conn(0x7f8b080b07a0 legacy=0x7f8b080b38d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:21:30.847 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:30.845+0000 7f8b0cd9b700 1 -- 172.21.15.50:0/2438909204 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b080b1540 con 0x7f8b081595a0 2023-10-06T01:21:30.847 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:30.845+0000 7f8b0cd9b700 1 --2- 172.21.15.50:0/2438909204 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8b081595a0 0x7f8b080aa570 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f8afc0098d0 tx=0x7f8afc009120 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8a07e838f220a49b server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:21:30.848 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:30.845+0000 7f8b077fe700 1 -- 172.21.15.50:0/2438909204 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8afc005c10 con 0x7f8b081595a0 2023-10-06T01:21:30.848 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:30.845+0000 7f8b077fe700 1 -- 172.21.15.50:0/2438909204 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8afc005d70 con 0x7f8b081595a0 2023-10-06T01:21:30.848 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:30.845+0000 7f8b077fe700 1 -- 172.21.15.50:0/2438909204 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8afc006280 con 0x7f8b081595a0 2023-10-06T01:21:30.848 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:30.846+0000 7f8b0efff700 1 -- 172.21.15.50:0/2438909204 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8b081595a0 msgr2=0x7f8b080aa570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:21:30.848 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:30.846+0000 7f8b0efff700 1 --2- 172.21.15.50:0/2438909204 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8b081595a0 0x7f8b080aa570 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f8afc0098d0 tx=0x7f8afc009120 comp rx=0 tx=0).stop 2023-10-06T01:21:30.848 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:30.846+0000 7f8b0efff700 1 -- 172.21.15.50:0/2438909204 shutdown_connections 2023-10-06T01:21:30.848 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:30.846+0000 7f8b0efff700 1 --2- 172.21.15.50:0/2438909204 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8b081595a0 0x7f8b080aa570 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:21:30.848 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:30.846+0000 7f8b0efff700 1 --2- 172.21.15.50:0/2438909204 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8b080b49e0 0x7f8b080aaab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:21:30.848 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:30.846+0000 7f8b0efff700 1 -- 172.21.15.50:0/2438909204 >> 172.21.15.50:0/2438909204 conn(0x7f8b08099830 msgr2=0x7f8b0806f500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:21:30.848 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:30.846+0000 7f8b0efff700 1 -- 172.21.15.50:0/2438909204 shutdown_connections 2023-10-06T01:21:30.849 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:30.846+0000 7f8b0efff700 1 -- 172.21.15.50:0/2438909204 wait complete. 2023-10-06T01:21:30.851 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:30.847+0000 7f8b0efff700 1 Processor -- start 2023-10-06T01:21:30.851 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:30.847+0000 7f8b0efff700 1 -- start start 2023-10-06T01:21:30.851 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:30.848+0000 7f8b0efff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8b080b07a0 0x7f8b0809af80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:21:30.851 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:30.848+0000 7f8b0efff700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8b080b49e0 0x7f8b0814a8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:21:30.851 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:30.848+0000 7f8b0efff700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8b081595a0 0x7f8b0809b5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:21:30.851 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:30.848+0000 7f8b0efff700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b0809c130 con 0x7f8b080b07a0 2023-10-06T01:21:30.851 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:30.848+0000 7f8b0efff700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b0809d9d0 con 0x7f8b081595a0 2023-10-06T01:21:30.851 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:30.848+0000 7f8b0efff700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b0814ae30 con 0x7f8b080b49e0 2023-10-06T01:21:30.851 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:30.849+0000 7f8b0cd9b700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8b080b07a0 0x7f8b0809af80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:21:30.851 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:30.849+0000 7f8b0cd9b700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8b080b07a0 0x7f8b0809af80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:41022/0 (socket says 172.21.15.50:41022) 2023-10-06T01:21:30.851 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:30.849+0000 7f8b0cd9b700 1 -- 172.21.15.50:0/3395587150 learned_addr learned my addr 172.21.15.50:0/3395587150 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-06T01:21:30.852 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:30.849+0000 7f8b0d59c700 1 --2- 172.21.15.50:0/3395587150 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8b081595a0 0x7f8b0809b5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:21:30.852 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:30.849+0000 7f8b07fff700 1 --2- 172.21.15.50:0/3395587150 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8b080b49e0 0x7f8b0814a8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:21:30.852 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:30.849+0000 7f8b0cd9b700 1 -- 172.21.15.50:0/3395587150 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8b080b49e0 msgr2=0x7f8b0814a8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:21:30.852 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:30.849+0000 7f8b0cd9b700 1 --2- 172.21.15.50:0/3395587150 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8b080b49e0 0x7f8b0814a8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:21:30.852 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:30.849+0000 7f8b0cd9b700 1 -- 172.21.15.50:0/3395587150 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8b081595a0 msgr2=0x7f8b0809b5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:21:30.852 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:30.849+0000 7f8b0cd9b700 1 --2- 172.21.15.50:0/3395587150 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8b081595a0 0x7f8b0809b5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:21:30.852 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:30.849+0000 7f8b0cd9b700 1 -- 172.21.15.50:0/3395587150 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8afc0093c0 con 0x7f8b080b07a0 2023-10-06T01:21:30.852 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:30.849+0000 7f8b0cd9b700 1 --2- 172.21.15.50:0/3395587150 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8b080b07a0 0x7f8b0809af80 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f8afc009f70 tx=0x7f8afc016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:21:30.852 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:30.850+0000 7f8b04ff9700 1 -- 172.21.15.50:0/3395587150 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8afc01d880 con 0x7f8b080b07a0 2023-10-06T01:21:30.852 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:30.850+0000 7f8b04ff9700 1 -- 172.21.15.50:0/3395587150 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8afc01da00 con 0x7f8b080b07a0 2023-10-06T01:21:30.852 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:30.850+0000 7f8b0efff700 1 -- 172.21.15.50:0/3395587150 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8b0809a1c0 con 0x7f8b080b07a0 2023-10-06T01:21:30.853 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:30.850+0000 7f8b04ff9700 1 -- 172.21.15.50:0/3395587150 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8afc01ddc0 con 0x7f8b080b07a0 2023-10-06T01:21:30.853 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:30.850+0000 7f8b0efff700 1 -- 172.21.15.50:0/3395587150 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8b0809a780 con 0x7f8b080b07a0 2023-10-06T01:21:30.853 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:30.851+0000 7f8b0efff700 1 -- 172.21.15.50:0/3395587150 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8b08064ad0 con 0x7f8b080b07a0 2023-10-06T01:21:30.853 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:30.852+0000 7f8b04ff9700 1 -- 172.21.15.50:0/3395587150 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 4) v1 ==== 84684+0+0 (secure 0 0 0) 0x7f8afc01b690 con 0x7f8b080b07a0 2023-10-06T01:21:30.853 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:30.852+0000 7f8b04ff9700 1 --2- 172.21.15.50:0/3395587150 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f8aec066ea0 0x7f8aec069350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:21:30.853 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:30.853+0000 7f8b04ff9700 1 -- 172.21.15.50:0/3395587150 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(15..15 src has 1..15) v4 ==== 5195+0+0 (secure 0 0 0) 0x7f8afc086290 con 0x7f8b080b07a0 2023-10-06T01:21:30.854 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:30.853+0000 7f8b07fff700 1 --2- 172.21.15.50:0/3395587150 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f8aec066ea0 0x7f8aec069350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:21:30.854 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:30.854+0000 7f8b07fff700 1 --2- 172.21.15.50:0/3395587150 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f8aec066ea0 0x7f8aec069350 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f8b081586a0 tx=0x7f8af4008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:21:30.858 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:30.857+0000 7f8b04ff9700 1 -- 172.21.15.50:0/3395587150 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f8afc053740 con 0x7f8b080b07a0 2023-10-06T01:21:31.063 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:31.062+0000 7f8b0efff700 1 -- 172.21.15.50:0/3395587150 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f8b080b1820 con 0x7f8b080b07a0 2023-10-06T01:21:31.064 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:31.063+0000 7f8b04ff9700 1 -- 172.21.15.50:0/3395587150 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v15) v1 ==== 74+0+13666 (secure 0 0 0) 0x7f8afc056d60 con 0x7f8b080b07a0 2023-10-06T01:21:31.064 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-10-06T01:21:31.064 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":15,"fsid":"0bfd9a6b-1587-4fe4-a89e-e43c00286b4e","created":"2023-10-06T01:21:16.828801+0000","modified":"2023-10-06T01:21:30.589171+0000","last_up_change":"2023-10-06T01:21:28.584523+0000","last_in_change":"2023-10-06T01:21:20.179863+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-10-06T01:21:29.304225+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":".mgr","create_time":"2023-10-06T01:21:29.835490+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{}}],"osds":[{"osd":0,"uuid":"9060727a-3959-4de3-8363-c5c5d7826c9a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":87837},{"type":"v1","addr":"172.21.15.50:6801","nonce":87837}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":87837},{"type":"v1","addr":"172.21.15.50:6803","nonce":87837}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":87837},{"type":"v1","addr":"172.21.15.50:6807","nonce":87837}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":87837},{"type":"v1","addr":"172.21.15.50:6805","nonce":87837}]},"public_addr":"172.21.15.50:6801/87837","cluster_addr":"172.21.15.50:6803/87837","heartbeat_back_addr":"172.21.15.50:6807/87837","heartbeat_front_addr":"172.21.15.50:6805/87837","state":["exists","up"]},{"osd":1,"uuid":"5ad9ef12-b579-47ea-b690-90ba887e2cef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":87853},{"type":"v1","addr":"172.21.15.50:6809","nonce":87853}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":87853},{"type":"v1","addr":"172.21.15.50:6811","nonce":87853}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":87853},{"type":"v1","addr":"172.21.15.50:6815","nonce":87853}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":87853},{"type":"v1","addr":"172.21.15.50:6813","nonce":87853}]},"public_addr":"172.21.15.50:6809/87853","cluster_addr":"172.21.15.50:6811/87853","heartbeat_back_addr":"172.21.15.50:6815/87853","heartbeat_front_addr":"172.21.15.50:6813/87853","state":["exists","up"]},{"osd":2,"uuid":"c7aee044-6f75-436f-90e1-ba42a57359bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6821","nonce":87855},{"type":"v1","addr":"172.21.15.50:6822","nonce":87855}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6824","nonce":87855},{"type":"v1","addr":"172.21.15.50:6826","nonce":87855}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":87855},{"type":"v1","addr":"172.21.15.50:6831","nonce":87855}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":87855},{"type":"v1","addr":"172.21.15.50:6829","nonce":87855}]},"public_addr":"172.21.15.50:6822/87855","cluster_addr":"172.21.15.50:6826/87855","heartbeat_back_addr":"172.21.15.50:6831/87855","heartbeat_front_addr":"172.21.15.50:6829/87855","state":["exists","up"]},{"osd":3,"uuid":"d9b901c8-e8b2-44af-9508-f453120a96c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":87856},{"type":"v1","addr":"172.21.15.50:6817","nonce":87856}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":87856},{"type":"v1","addr":"172.21.15.50:6819","nonce":87856}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6825","nonce":87856},{"type":"v1","addr":"172.21.15.50:6827","nonce":87856}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6820","nonce":87856},{"type":"v1","addr":"172.21.15.50:6823","nonce":87856}]},"public_addr":"172.21.15.50:6817/87856","cluster_addr":"172.21.15.50:6819/87856","heartbeat_back_addr":"172.21.15.50:6827/87856","heartbeat_front_addr":"172.21.15.50:6823/87856","state":["exists","up"]},{"osd":4,"uuid":"2b3c6b38-e3e9-4301-9445-60fd3fe8ce03","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":85805},{"type":"v1","addr":"172.21.15.155:6801","nonce":85805}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":85805},{"type":"v1","addr":"172.21.15.155:6803","nonce":85805}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6806","nonce":85805},{"type":"v1","addr":"172.21.15.155:6807","nonce":85805}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6804","nonce":85805},{"type":"v1","addr":"172.21.15.155:6805","nonce":85805}]},"public_addr":"172.21.15.155:6801/85805","cluster_addr":"172.21.15.155:6803/85805","heartbeat_back_addr":"172.21.15.155:6807/85805","heartbeat_front_addr":"172.21.15.155:6805/85805","state":["exists","up"]},{"osd":5,"uuid":"417b5f8f-65f1-4c94-91a7-a6ce03fe1679","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6816","nonce":85807},{"type":"v1","addr":"172.21.15.155:6818","nonce":85807}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6820","nonce":85807},{"type":"v1","addr":"172.21.15.155:6822","nonce":85807}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6828","nonce":85807},{"type":"v1","addr":"172.21.15.155:6830","nonce":85807}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6824","nonce":85807},{"type":"v1","addr":"172.21.15.155:6826","nonce":85807}]},"public_addr":"172.21.15.155:6818/85807","cluster_addr":"172.21.15.155:6822/85807","heartbeat_back_addr":"172.21.15.155:6830/85807","heartbeat_front_addr":"172.21.15.155:6826/85807","state":["exists","up"]},{"osd":6,"uuid":"c150cff3-aee4-4714-9c08-d182b1ba9ffd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6808","nonce":85806},{"type":"v1","addr":"172.21.15.155:6809","nonce":85806}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6810","nonce":85806},{"type":"v1","addr":"172.21.15.155:6811","nonce":85806}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6814","nonce":85806},{"type":"v1","addr":"172.21.15.155:6815","nonce":85806}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6812","nonce":85806},{"type":"v1","addr":"172.21.15.155:6813","nonce":85806}]},"public_addr":"172.21.15.155:6809/85806","cluster_addr":"172.21.15.155:6811/85806","heartbeat_back_addr":"172.21.15.155:6815/85806","heartbeat_front_addr":"172.21.15.155:6813/85806","state":["exists","up"]},{"osd":7,"uuid":"71107f0e-04d1-4e72-a0ec-0faf6af003e7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6817","nonce":85832},{"type":"v1","addr":"172.21.15.155:6819","nonce":85832}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6821","nonce":85832},{"type":"v1","addr":"172.21.15.155:6823","nonce":85832}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6829","nonce":85832},{"type":"v1","addr":"172.21.15.155:6831","nonce":85832}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6825","nonce":85832},{"type":"v1","addr":"172.21.15.155:6827","nonce":85832}]},"public_addr":"172.21.15.155:6819/85832","cluster_addr":"172.21.15.155:6823/85832","heartbeat_back_addr":"172.21.15.155:6831/85832","heartbeat_front_addr":"172.21.15.155:6827/85832","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:21:25.423389+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:21:25.472661+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:21:25.817562+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:21:25.551257+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:21:25.407818+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:21:25.557976+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:21:25.747299+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:21:25.827576+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T01:21:31.066 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:31.065+0000 7f8b0efff700 1 -- 172.21.15.50:0/3395587150 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f8aec066ea0 msgr2=0x7f8aec069350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:21:31.067 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:31.065+0000 7f8b0efff700 1 --2- 172.21.15.50:0/3395587150 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f8aec066ea0 0x7f8aec069350 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f8b081586a0 tx=0x7f8af4008040 comp rx=0 tx=0).stop 2023-10-06T01:21:31.067 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:31.065+0000 7f8b0efff700 1 -- 172.21.15.50:0/3395587150 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8b080b07a0 msgr2=0x7f8b0809af80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:21:31.067 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:31.065+0000 7f8b0efff700 1 --2- 172.21.15.50:0/3395587150 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8b080b07a0 0x7f8b0809af80 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f8afc009f70 tx=0x7f8afc016000 comp rx=0 tx=0).stop 2023-10-06T01:21:31.067 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:31.065+0000 7f8b0efff700 1 -- 172.21.15.50:0/3395587150 shutdown_connections 2023-10-06T01:21:31.067 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:31.065+0000 7f8b0efff700 1 --2- 172.21.15.50:0/3395587150 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f8aec066ea0 0x7f8aec069350 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:21:31.067 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:31.065+0000 7f8b0efff700 1 --2- 172.21.15.50:0/3395587150 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8b081595a0 0x7f8b0809b5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:21:31.067 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:31.065+0000 7f8b0efff700 1 --2- 172.21.15.50:0/3395587150 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8b080b07a0 0x7f8b0809af80 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:21:31.067 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:31.065+0000 7f8b0efff700 1 --2- 172.21.15.50:0/3395587150 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8b080b49e0 0x7f8b0814a8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:21:31.067 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:31.065+0000 7f8b0efff700 1 -- 172.21.15.50:0/3395587150 >> 172.21.15.50:0/3395587150 conn(0x7f8b08099830 msgr2=0x7f8b08158820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:21:31.067 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:31.065+0000 7f8b0efff700 1 -- 172.21.15.50:0/3395587150 shutdown_connections 2023-10-06T01:21:31.067 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:31.065+0000 7f8b0efff700 1 -- 172.21.15.50:0/3395587150 wait complete. 2023-10-06T01:21:31.083 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-10-06T01:21:29.304225+0000', 'flags': 32769, 'flags_names': 'hashpspool,creating', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-10-06T01:21:29.835490+0000', 'flags': 32769, 'flags_names': 'hashpspool,creating', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {}}] 2023-10-06T01:21:31.084 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-10-06T01:21:31.273 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:31.272+0000 7f8498f9d700 1 Processor -- start 2023-10-06T01:21:31.274 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:31.273+0000 7f8498f9d700 1 -- start start 2023-10-06T01:21:31.275 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:31.274+0000 7f8498f9d700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f84940afde0 0x7f8494164090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:21:31.275 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:31.274+0000 7f8498f9d700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f84940b0310 con 0x7f84941593c0 2023-10-06T01:21:31.275 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:31.274+0000 7f8498f9d700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f84940c9040 con 0x7f8494067d00 2023-10-06T01:21:31.275 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:31.274+0000 7f8498f9d700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84940cdea0 con 0x7f84940afde0 2023-10-06T01:21:31.275 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:31.274+0000 7f84937fe700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f84941593c0 0x7f84940675f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:36088/0 (socket says 172.21.15.50:36088) 2023-10-06T01:21:31.275 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:31.274+0000 7f84937fe700 1 -- 172.21.15.50:0/1178270715 learned_addr learned my addr 172.21.15.50:0/1178270715 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-10-06T01:21:31.275 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:31.274+0000 7f8493fff700 1 --2- 172.21.15.50:0/1178270715 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f84940afde0 0x7f8494164090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:21:31.277 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:31.274+0000 7f84927fc700 1 -- 172.21.15.50:0/1178270715 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1677569035 0 0) 0x7f84940b0310 con 0x7f84941593c0 2023-10-06T01:21:31.277 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:31.274+0000 7f84927fc700 1 -- 172.21.15.50:0/1178270715 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f847c003570 con 0x7f84941593c0 2023-10-06T01:21:31.277 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:31.274+0000 7f84927fc700 1 -- 172.21.15.50:0/1178270715 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 271807423 0 0) 0x7f84940c9040 con 0x7f8494067d00 2023-10-06T01:21:31.277 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:31.274+0000 7f84927fc700 1 -- 172.21.15.50:0/1178270715 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f84940b0310 con 0x7f8494067d00 2023-10-06T01:21:31.277 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:31.275+0000 7f8493fff700 1 -- 172.21.15.50:0/1178270715 >> v1:172.21.15.155:6789/0 conn(0x7f8494067d00 legacy=0x7f84940b1960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:21:31.277 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:31.275+0000 7f8493fff700 1 -- 172.21.15.50:0/1178270715 >> v1:172.21.15.50:6789/0 conn(0x7f84941593c0 legacy=0x7f84940675f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:21:31.277 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:31.275+0000 7f84927fc700 1 -- 172.21.15.50:0/1178270715 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2322033818 0 0) 0x7f847c003570 con 0x7f84941593c0 2023-10-06T01:21:31.277 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:31.275+0000 7f8493fff700 1 -- 172.21.15.50:0/1178270715 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84940c9320 con 0x7f84940afde0 2023-10-06T01:21:31.278 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:31.275+0000 7f8493fff700 1 --2- 172.21.15.50:0/1178270715 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f84940afde0 0x7f8494164090 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f848c009e90 tx=0x7f848c009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d527323e2c0decb3 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:21:31.278 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:31.275+0000 7f84927fc700 1 -- 172.21.15.50:0/1178270715 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f848c00e070 con 0x7f84940afde0 2023-10-06T01:21:31.278 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:31.275+0000 7f84927fc700 1 -- 172.21.15.50:0/1178270715 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f848c00b870 con 0x7f84940afde0 2023-10-06T01:21:31.278 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:31.275+0000 7f84927fc700 1 -- 172.21.15.50:0/1178270715 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8484001470 con 0x7f84940afde0 2023-10-06T01:21:31.278 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:31.276+0000 7f8498f9d700 1 -- 172.21.15.50:0/1178270715 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f84940afde0 msgr2=0x7f8494164090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:21:31.278 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:31.276+0000 7f8498f9d700 1 --2- 172.21.15.50:0/1178270715 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f84940afde0 0x7f8494164090 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f848c009e90 tx=0x7f848c009780 comp rx=0 tx=0).stop 2023-10-06T01:21:31.278 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:31.276+0000 7f8498f9d700 1 -- 172.21.15.50:0/1178270715 shutdown_connections 2023-10-06T01:21:31.278 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:31.276+0000 7f8498f9d700 1 --2- 172.21.15.50:0/1178270715 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f84940afde0 0x7f8494164090 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:21:31.279 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:31.276+0000 7f8498f9d700 1 -- 172.21.15.50:0/1178270715 >> 172.21.15.50:0/1178270715 conn(0x7f84940691d0 msgr2=0x7f84940cd020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:21:31.279 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:31.276+0000 7f8498f9d700 1 -- 172.21.15.50:0/1178270715 shutdown_connections 2023-10-06T01:21:31.279 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:31.276+0000 7f8498f9d700 1 -- 172.21.15.50:0/1178270715 wait complete. 2023-10-06T01:21:31.280 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:31.277+0000 7f8498f9d700 1 Processor -- start 2023-10-06T01:21:31.281 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:31.277+0000 7f8498f9d700 1 -- start start 2023-10-06T01:21:31.281 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:31.278+0000 7f8498f9d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8494067d00 0x7f849414c490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:21:31.281 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:31.278+0000 7f8498f9d700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f84940afde0 0x7f849409a930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:21:31.281 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:31.278+0000 7f8498f9d700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f84941593c0 0x7f84940985e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:21:31.282 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:31.278+0000 7f8498f9d700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8494097b80 con 0x7f8494067d00 2023-10-06T01:21:31.282 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:31.278+0000 7f8498f9d700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8494156c10 con 0x7f84940afde0 2023-10-06T01:21:31.282 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:31.278+0000 7f8498f9d700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f849414c9d0 con 0x7f84941593c0 2023-10-06T01:21:31.282 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:31.278+0000 7f84937fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8494067d00 0x7f849414c490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:21:31.282 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:31.279+0000 7f84937fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8494067d00 0x7f849414c490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:41036/0 (socket says 172.21.15.50:41036) 2023-10-06T01:21:31.282 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:31.279+0000 7f84937fe700 1 -- 172.21.15.50:0/142705407 learned_addr learned my addr 172.21.15.50:0/142705407 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-06T01:21:31.282 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:31.279+0000 7f8493fff700 1 --2- 172.21.15.50:0/142705407 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f84941593c0 0x7f84940985e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:21:31.282 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:31.279+0000 7f8492ffd700 1 --2- 172.21.15.50:0/142705407 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f84940afde0 0x7f849409a930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:21:31.282 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:31.279+0000 7f84937fe700 1 -- 172.21.15.50:0/142705407 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f84941593c0 msgr2=0x7f84940985e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:21:31.282 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:31.279+0000 7f84937fe700 1 --2- 172.21.15.50:0/142705407 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f84941593c0 0x7f84940985e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:21:31.282 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:31.279+0000 7f84937fe700 1 -- 172.21.15.50:0/142705407 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f84940afde0 msgr2=0x7f849409a930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:21:31.282 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:31.279+0000 7f84937fe700 1 --2- 172.21.15.50:0/142705407 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f84940afde0 0x7f849409a930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:21:31.283 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:31.279+0000 7f84937fe700 1 -- 172.21.15.50:0/142705407 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f848c009a20 con 0x7f8494067d00 2023-10-06T01:21:31.283 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:31.279+0000 7f8492ffd700 1 --2- 172.21.15.50:0/142705407 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f84940afde0 0x7f849409a930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T01:21:31.283 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:31.279+0000 7f84937fe700 1 --2- 172.21.15.50:0/142705407 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8494067d00 0x7f849414c490 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f848400c7f0 tx=0x7f8484001a10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:21:31.283 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:31.279+0000 7f847b7fe700 1 -- 172.21.15.50:0/142705407 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8484007360 con 0x7f8494067d00 2023-10-06T01:21:31.283 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:31.279+0000 7f847b7fe700 1 -- 172.21.15.50:0/142705407 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84840074e0 con 0x7f8494067d00 2023-10-06T01:21:31.283 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:31.279+0000 7f847b7fe700 1 -- 172.21.15.50:0/142705407 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8484004830 con 0x7f8494067d00 2023-10-06T01:21:31.283 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:31.279+0000 7f8498f9d700 1 -- 172.21.15.50:0/142705407 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8494096f70 con 0x7f8494067d00 2023-10-06T01:21:31.283 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:31.280+0000 7f8498f9d700 1 -- 172.21.15.50:0/142705407 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8494097530 con 0x7f8494067d00 2023-10-06T01:21:31.284 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:31.281+0000 7f8498f9d700 1 -- 172.21.15.50:0/142705407 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f849405f270 con 0x7f8494067d00 2023-10-06T01:21:31.284 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:31.282+0000 7f847b7fe700 1 -- 172.21.15.50:0/142705407 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 4) v1 ==== 84684+0+0 (secure 0 0 0) 0x7f8484004c00 con 0x7f8494067d00 2023-10-06T01:21:31.284 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:31.283+0000 7f847b7fe700 1 --2- 172.21.15.50:0/142705407 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f8480066ea0 0x7f8480069350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:21:31.285 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:31.283+0000 7f847b7fe700 1 -- 172.21.15.50:0/142705407 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(15..15 src has 1..15) v4 ==== 5195+0+0 (secure 0 0 0) 0x7f84840839f0 con 0x7f8494067d00 2023-10-06T01:21:31.285 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:31.283+0000 7f8492ffd700 1 --2- 172.21.15.50:0/142705407 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f8480066ea0 0x7f8480069350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:21:31.285 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:31.284+0000 7f8492ffd700 1 --2- 172.21.15.50:0/142705407 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f8480066ea0 0x7f8480069350 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f849406a5f0 tx=0x7f8488009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:21:31.287 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:31.287+0000 7f847b7fe700 1 -- 172.21.15.50:0/142705407 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f8484050f20 con 0x7f8494067d00 2023-10-06T01:21:31.498 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:31.497+0000 7f8498f9d700 1 -- 172.21.15.50:0/142705407 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f84940c9600 con 0x7f8494067d00 2023-10-06T01:21:31.498 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:31.498+0000 7f847b7fe700 1 -- 172.21.15.50:0/142705407 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v15) v1 ==== 92+0+10 (secure 0 0 0) 0x7f8484018020 con 0x7f8494067d00 2023-10-06T01:21:31.499 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 8 2023-10-06T01:21:31.501 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:31.500+0000 7f8498f9d700 1 -- 172.21.15.50:0/142705407 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f8480066ea0 msgr2=0x7f8480069350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:21:31.501 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:31.500+0000 7f8498f9d700 1 --2- 172.21.15.50:0/142705407 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f8480066ea0 0x7f8480069350 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f849406a5f0 tx=0x7f8488009040 comp rx=0 tx=0).stop 2023-10-06T01:21:31.501 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:31.500+0000 7f8498f9d700 1 -- 172.21.15.50:0/142705407 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8494067d00 msgr2=0x7f849414c490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:21:31.501 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:31.500+0000 7f8498f9d700 1 --2- 172.21.15.50:0/142705407 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8494067d00 0x7f849414c490 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f848400c7f0 tx=0x7f8484001a10 comp rx=0 tx=0).stop 2023-10-06T01:21:31.501 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:31.500+0000 7f8498f9d700 1 -- 172.21.15.50:0/142705407 shutdown_connections 2023-10-06T01:21:31.501 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:31.500+0000 7f8498f9d700 1 --2- 172.21.15.50:0/142705407 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f84941593c0 0x7f84940985e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:21:31.501 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:31.500+0000 7f8498f9d700 1 --2- 172.21.15.50:0/142705407 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8494067d00 0x7f849414c490 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:21:31.502 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:31.500+0000 7f8498f9d700 1 --2- 172.21.15.50:0/142705407 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f8480066ea0 0x7f8480069350 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:21:31.502 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:31.500+0000 7f8498f9d700 1 --2- 172.21.15.50:0/142705407 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f84940afde0 0x7f849409a930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:21:31.502 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:31.500+0000 7f8498f9d700 1 -- 172.21.15.50:0/142705407 >> 172.21.15.50:0/142705407 conn(0x7f84940691d0 msgr2=0x7f8494157390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:21:31.502 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:31.500+0000 7f8498f9d700 1 -- 172.21.15.50:0/142705407 shutdown_connections 2023-10-06T01:21:31.502 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:31.500+0000 7f8498f9d700 1 -- 172.21.15.50:0/142705407 wait complete. 2023-10-06T01:21:31.518 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-06T01:21:31.726 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:31.725+0000 7f13bad9d700 1 Processor -- start 2023-10-06T01:21:31.726 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:31.725+0000 7f13bad9d700 1 -- start start 2023-10-06T01:21:31.727 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:31.726+0000 7f13bad9d700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f13b40b2660 0x7f13b40cccf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:21:31.727 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:31.726+0000 7f13bad9d700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f13b40cc9b0 con 0x7f13b40cf1f0 2023-10-06T01:21:31.727 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:31.726+0000 7f13bad9d700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f13b40cbda0 con 0x7f13b40b2a30 2023-10-06T01:21:31.727 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:31.726+0000 7f13bad9d700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f13b40cc080 con 0x7f13b40b2660 2023-10-06T01:21:31.728 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:31.726+0000 7f13ba59c700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f13b40cf1f0 0x7f13b40c5390 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:36098/0 (socket says 172.21.15.50:36098) 2023-10-06T01:21:31.728 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:31.726+0000 7f13ba59c700 1 -- 172.21.15.50:0/346977811 learned_addr learned my addr 172.21.15.50:0/346977811 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-10-06T01:21:31.728 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:31.726+0000 7f13b9d9b700 1 --2- 172.21.15.50:0/346977811 >> v2:172.21.15.155:3300/0 conn(0x7f13b40b2660 0x7f13b40cccf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:21:31.728 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:31.727+0000 7f13b8d99700 1 -- 172.21.15.50:0/346977811 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3673280347 0 0) 0x7f13b40cc9b0 con 0x7f13b40cf1f0 2023-10-06T01:21:31.729 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:31.727+0000 7f13b8d99700 1 -- 172.21.15.50:0/346977811 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f13a0003570 con 0x7f13b40cf1f0 2023-10-06T01:21:31.729 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:31.727+0000 7f13b8d99700 1 -- 172.21.15.50:0/346977811 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2260901395 0 0) 0x7f13b40cbda0 con 0x7f13b40b2a30 2023-10-06T01:21:31.729 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:31.727+0000 7f13b9d9b700 1 -- 172.21.15.50:0/346977811 >> v1:172.21.15.155:6789/0 conn(0x7f13b40b2a30 legacy=0x7f13b40ceae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:21:31.729 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:31.727+0000 7f13b9d9b700 1 -- 172.21.15.50:0/346977811 >> v1:172.21.15.50:6789/0 conn(0x7f13b40cf1f0 legacy=0x7f13b40c5390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:21:31.729 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:31.727+0000 7f13b9d9b700 1 -- 172.21.15.50:0/346977811 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13b40cc360 con 0x7f13b40b2660 2023-10-06T01:21:31.729 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:31.727+0000 7f13b9d9b700 1 --2- 172.21.15.50:0/346977811 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f13b40b2660 0x7f13b40cccf0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f13b00098d0 tx=0x7f13b0009120 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7aeba39e9cd96f4b server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:21:31.729 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:31.727+0000 7f13b8d99700 1 -- 172.21.15.50:0/346977811 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13b0005c10 con 0x7f13b40b2660 2023-10-06T01:21:31.729 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:31.727+0000 7f13b8d99700 1 -- 172.21.15.50:0/346977811 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f13b0005d70 con 0x7f13b40b2660 2023-10-06T01:21:31.729 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:31.727+0000 7f13b8d99700 1 -- 172.21.15.50:0/346977811 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13b0006280 con 0x7f13b40b2660 2023-10-06T01:21:31.730 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:31.728+0000 7f13bad9d700 1 -- 172.21.15.50:0/346977811 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f13b40b2660 msgr2=0x7f13b40cccf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:21:31.730 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:31.728+0000 7f13bad9d700 1 --2- 172.21.15.50:0/346977811 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f13b40b2660 0x7f13b40cccf0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f13b00098d0 tx=0x7f13b0009120 comp rx=0 tx=0).stop 2023-10-06T01:21:31.730 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:31.728+0000 7f13bad9d700 1 -- 172.21.15.50:0/346977811 shutdown_connections 2023-10-06T01:21:31.730 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:31.728+0000 7f13bad9d700 1 --2- 172.21.15.50:0/346977811 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f13b40b2660 0x7f13b40cccf0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:21:31.731 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:31.728+0000 7f13bad9d700 1 -- 172.21.15.50:0/346977811 >> 172.21.15.50:0/346977811 conn(0x7f13b4099560 msgr2=0x7f13b406f500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:21:31.731 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:31.728+0000 7f13bad9d700 1 -- 172.21.15.50:0/346977811 shutdown_connections 2023-10-06T01:21:31.731 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:31.728+0000 7f13bad9d700 1 -- 172.21.15.50:0/346977811 wait complete. 2023-10-06T01:21:31.731 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:31.729+0000 7f13bad9d700 1 Processor -- start 2023-10-06T01:21:31.731 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:31.730+0000 7f13bad9d700 1 -- start start 2023-10-06T01:21:31.733 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:31.730+0000 7f13bad9d700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f13b40b2660 0x7f13b41691b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:21:31.733 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:31.730+0000 7f13bad9d700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f13b40b2a30 0x7f13b416d170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:21:31.733 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:31.730+0000 7f13bad9d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f13b40cf1f0 0x7f13b41527c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:21:31.733 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:31.730+0000 7f13bad9d700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13b41697e0 con 0x7f13b40cf1f0 2023-10-06T01:21:31.733 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:31.730+0000 7f13bad9d700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13b4169ac0 con 0x7f13b40b2660 2023-10-06T01:21:31.733 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:31.730+0000 7f13bad9d700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f13b4169da0 con 0x7f13b40b2a30 2023-10-06T01:21:31.733 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:31.731+0000 7f13ba59c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f13b40cf1f0 0x7f13b41527c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:21:31.733 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:31.731+0000 7f13ba59c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f13b40cf1f0 0x7f13b41527c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:41050/0 (socket says 172.21.15.50:41050) 2023-10-06T01:21:31.733 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:31.731+0000 7f13ba59c700 1 -- 172.21.15.50:0/732512078 learned_addr learned my addr 172.21.15.50:0/732512078 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-06T01:21:31.733 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:31.731+0000 7f13b9d9b700 1 --2- 172.21.15.50:0/732512078 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f13b40b2660 0x7f13b41691b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:21:31.734 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:31.731+0000 7f13b959a700 1 --2- 172.21.15.50:0/732512078 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f13b40b2a30 0x7f13b416d170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:21:31.734 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:31.731+0000 7f13ba59c700 1 -- 172.21.15.50:0/732512078 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f13b40b2a30 msgr2=0x7f13b416d170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:21:31.734 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:31.731+0000 7f13ba59c700 1 --2- 172.21.15.50:0/732512078 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f13b40b2a30 0x7f13b416d170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:21:31.734 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:31.731+0000 7f13ba59c700 1 -- 172.21.15.50:0/732512078 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f13b40b2660 msgr2=0x7f13b41691b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:21:31.734 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:31.731+0000 7f13ba59c700 1 --2- 172.21.15.50:0/732512078 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f13b40b2660 0x7f13b41691b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:21:31.734 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:31.731+0000 7f13ba59c700 1 -- 172.21.15.50:0/732512078 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13b00093c0 con 0x7f13b40cf1f0 2023-10-06T01:21:31.734 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:31.731+0000 7f13b959a700 1 --2- 172.21.15.50:0/732512078 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f13b40b2a30 0x7f13b416d170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T01:21:31.734 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:31.731+0000 7f13ba59c700 1 --2- 172.21.15.50:0/732512078 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f13b40cf1f0 0x7f13b41527c0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f13ac001460 tx=0x7f13ac001ae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:21:31.734 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:31.732+0000 7f13a9ffb700 1 -- 172.21.15.50:0/732512078 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13ac00a940 con 0x7f13b40cf1f0 2023-10-06T01:21:31.734 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:31.732+0000 7f13a9ffb700 1 -- 172.21.15.50:0/732512078 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f13ac00aaa0 con 0x7f13b40cf1f0 2023-10-06T01:21:31.734 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:31.732+0000 7f13bad9d700 1 -- 172.21.15.50:0/732512078 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f13b416a080 con 0x7f13b40cf1f0 2023-10-06T01:21:31.734 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:31.732+0000 7f13a9ffb700 1 -- 172.21.15.50:0/732512078 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13ac00ae20 con 0x7f13b40cf1f0 2023-10-06T01:21:31.735 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:31.732+0000 7f13bad9d700 1 -- 172.21.15.50:0/732512078 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f13b416d6b0 con 0x7f13b40cf1f0 2023-10-06T01:21:31.735 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:31.733+0000 7f13bad9d700 1 -- 172.21.15.50:0/732512078 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f13b40b3310 con 0x7f13b40cf1f0 2023-10-06T01:21:31.736 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:31.734+0000 7f13a9ffb700 1 -- 172.21.15.50:0/732512078 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 4) v1 ==== 84684+0+0 (secure 0 0 0) 0x7f13ac007300 con 0x7f13b40cf1f0 2023-10-06T01:21:31.736 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:31.734+0000 7f13a9ffb700 1 --2- 172.21.15.50:0/732512078 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f1398066ea0 0x7f1398069350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:21:31.736 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:31.734+0000 7f13a9ffb700 1 -- 172.21.15.50:0/732512078 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 5206+0+0 (secure 0 0 0) 0x7f13ac084790 con 0x7f13b40cf1f0 2023-10-06T01:21:31.736 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:31.735+0000 7f13b9d9b700 1 --2- 172.21.15.50:0/732512078 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f1398066ea0 0x7f1398069350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:21:31.736 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:31.736+0000 7f13b9d9b700 1 --2- 172.21.15.50:0/732512078 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f1398066ea0 0x7f1398069350 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f13b0009390 tx=0x7f13b0016000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:21:31.743 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:31.742+0000 7f13a9ffb700 1 -- 172.21.15.50:0/732512078 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f13b40b3310 con 0x7f13b40cf1f0 2023-10-06T01:21:31.954 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:31.953+0000 7f13bad9d700 1 -- 172.21.15.50:0/732512078 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f13b40b3310 con 0x7f13b40cf1f0 2023-10-06T01:21:31.954 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:31.953+0000 7f13a9ffb700 1 -- 172.21.15.50:0/732512078 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v16) v1 ==== 93+0+10 (secure 0 0 0) 0x7f13b40b3310 con 0x7f13b40cf1f0 2023-10-06T01:21:31.954 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 1 2023-10-06T01:21:31.957 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:31.956+0000 7f13bad9d700 1 -- 172.21.15.50:0/732512078 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f1398066ea0 msgr2=0x7f1398069350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:21:31.957 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:31.956+0000 7f13bad9d700 1 --2- 172.21.15.50:0/732512078 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f1398066ea0 0x7f1398069350 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f13b0009390 tx=0x7f13b0016000 comp rx=0 tx=0).stop 2023-10-06T01:21:31.957 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:31.956+0000 7f13bad9d700 1 -- 172.21.15.50:0/732512078 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f13b40cf1f0 msgr2=0x7f13b41527c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:21:31.957 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:31.956+0000 7f13bad9d700 1 --2- 172.21.15.50:0/732512078 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f13b40cf1f0 0x7f13b41527c0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f13ac001460 tx=0x7f13ac001ae0 comp rx=0 tx=0).stop 2023-10-06T01:21:31.958 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:31.956+0000 7f13bad9d700 1 -- 172.21.15.50:0/732512078 shutdown_connections 2023-10-06T01:21:31.958 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:31.956+0000 7f13bad9d700 1 --2- 172.21.15.50:0/732512078 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f13b40cf1f0 0x7f13b41527c0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:21:31.958 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:31.956+0000 7f13bad9d700 1 --2- 172.21.15.50:0/732512078 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f1398066ea0 0x7f1398069350 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:21:31.958 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:31.956+0000 7f13bad9d700 1 --2- 172.21.15.50:0/732512078 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f13b40b2660 0x7f13b41691b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:21:31.958 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:31.956+0000 7f13bad9d700 1 --2- 172.21.15.50:0/732512078 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f13b40b2a30 0x7f13b416d170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:21:31.958 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:31.956+0000 7f13bad9d700 1 -- 172.21.15.50:0/732512078 >> 172.21.15.50:0/732512078 conn(0x7f13b4099560 msgr2=0x7f13b40683f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:21:31.958 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:31.956+0000 7f13bad9d700 1 -- 172.21.15.50:0/732512078 shutdown_connections 2023-10-06T01:21:31.958 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:31.956+0000 7f13bad9d700 1 -- 172.21.15.50:0/732512078 wait complete. 2023-10-06T01:21:31.975 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T01:21:32.168 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:32.167+0000 7f50015ff700 1 Processor -- start 2023-10-06T01:21:32.169 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:32.168+0000 7f50015ff700 1 -- start start 2023-10-06T01:21:32.170 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:32.169+0000 7f50015ff700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4ffc1595a0 0x7f4ffc0aa570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:21:32.171 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:32.169+0000 7f50015ff700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f4ffc0b49e0 0x7f4ffc0aaab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:21:32.171 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:32.169+0000 7f50015ff700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4ffc0b0ca0 con 0x7f4ffc0b07a0 2023-10-06T01:21:32.171 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:32.169+0000 7f50015ff700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4ffc0b0f80 con 0x7f4ffc0b49e0 2023-10-06T01:21:32.171 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:32.169+0000 7f50015ff700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ffc0b1260 con 0x7f4ffc1595a0 2023-10-06T01:21:32.171 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:32.169+0000 7f4ffa7fc700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f4ffc0b49e0 0x7f4ffc0aaab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:21:32.171 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:32.170+0000 7f4ffa7fc700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f4ffc0b49e0 0x7f4ffc0aaab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:41060/0 (socket says 172.21.15.50:41060) 2023-10-06T01:21:32.171 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:32.170+0000 7f4ffa7fc700 1 -- 172.21.15.50:0/1094871346 learned_addr learned my addr 172.21.15.50:0/1094871346 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-06T01:21:32.171 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:32.170+0000 7f4ffb7fe700 1 --1- 172.21.15.50:0/1094871346 >> v1:172.21.15.50:6789/0 conn(0x7f4ffc0b07a0 0x7f4ffc0b38d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:36106/0 (socket says 172.21.15.50:36106) 2023-10-06T01:21:32.171 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:32.170+0000 7f4ffaffd700 1 --2- 172.21.15.50:0/1094871346 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4ffc1595a0 0x7f4ffc0aa570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:21:32.173 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:32.170+0000 7f4ff9ffb700 1 -- 172.21.15.50:0/1094871346 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 748191129 0 0) 0x7f4ffc0b0ca0 con 0x7f4ffc0b07a0 2023-10-06T01:21:32.173 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:32.170+0000 7f4ffa7fc700 1 -- 172.21.15.50:0/1094871346 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4ffc1595a0 msgr2=0x7f4ffc0aa570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:21:32.173 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:32.170+0000 7f4ffa7fc700 1 --2- 172.21.15.50:0/1094871346 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4ffc1595a0 0x7f4ffc0aa570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:21:32.173 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:32.170+0000 7f4ffa7fc700 1 -- 172.21.15.50:0/1094871346 >> v1:172.21.15.50:6789/0 conn(0x7f4ffc0b07a0 legacy=0x7f4ffc0b38d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:21:32.173 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:32.170+0000 7f4ffa7fc700 1 -- 172.21.15.50:0/1094871346 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ffc0b1540 con 0x7f4ffc0b49e0 2023-10-06T01:21:32.173 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:32.170+0000 7f4ffa7fc700 1 --2- 172.21.15.50:0/1094871346 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4ffc0b49e0 0x7f4ffc0aaab0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f4ff00099b0 tx=0x7f4ff0009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=27445d64d58e1820 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:21:32.173 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:32.171+0000 7f4ff9ffb700 1 -- 172.21.15.50:0/1094871346 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ff0009ea0 con 0x7f4ffc0b49e0 2023-10-06T01:21:32.173 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:32.171+0000 7f4ff9ffb700 1 -- 172.21.15.50:0/1094871346 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ff000b860 con 0x7f4ffc0b49e0 2023-10-06T01:21:32.173 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:32.171+0000 7f4ff9ffb700 1 -- 172.21.15.50:0/1094871346 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ff000bc00 con 0x7f4ffc0b49e0 2023-10-06T01:21:32.173 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:32.171+0000 7f50015ff700 1 -- 172.21.15.50:0/1094871346 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4ffc0b49e0 msgr2=0x7f4ffc0aaab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:21:32.173 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:32.171+0000 7f50015ff700 1 --2- 172.21.15.50:0/1094871346 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4ffc0b49e0 0x7f4ffc0aaab0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f4ff00099b0 tx=0x7f4ff0009250 comp rx=0 tx=0).stop 2023-10-06T01:21:32.174 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:32.172+0000 7f50015ff700 1 -- 172.21.15.50:0/1094871346 shutdown_connections 2023-10-06T01:21:32.174 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:32.172+0000 7f50015ff700 1 --2- 172.21.15.50:0/1094871346 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4ffc1595a0 0x7f4ffc0aa570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:21:32.174 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:32.172+0000 7f50015ff700 1 --2- 172.21.15.50:0/1094871346 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4ffc0b49e0 0x7f4ffc0aaab0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:21:32.174 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:32.172+0000 7f50015ff700 1 -- 172.21.15.50:0/1094871346 >> 172.21.15.50:0/1094871346 conn(0x7f4ffc099830 msgr2=0x7f4ffc06f500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:21:32.174 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:32.172+0000 7f50015ff700 1 -- 172.21.15.50:0/1094871346 shutdown_connections 2023-10-06T01:21:32.174 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:32.172+0000 7f50015ff700 1 -- 172.21.15.50:0/1094871346 wait complete. 2023-10-06T01:21:32.176 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:32.173+0000 7f50015ff700 1 Processor -- start 2023-10-06T01:21:32.176 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:32.173+0000 7f50015ff700 1 -- start start 2023-10-06T01:21:32.176 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:32.174+0000 7f50015ff700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4ffc0b07a0 0x7f4ffc09b5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:21:32.176 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:32.174+0000 7f50015ff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4ffc0b49e0 0x7f4ffc099f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:21:32.176 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:32.174+0000 7f50015ff700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4ffc1595a0 0x7f4ffc09cf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:21:32.176 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:32.174+0000 7f50015ff700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ffc09bb10 con 0x7f4ffc0b49e0 2023-10-06T01:21:32.176 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:32.174+0000 7f50015ff700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ffc155c90 con 0x7f4ffc1595a0 2023-10-06T01:21:32.176 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:32.174+0000 7f50015ff700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ffc169f70 con 0x7f4ffc0b07a0 2023-10-06T01:21:32.176 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:32.174+0000 7f4ffa7fc700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4ffc0b49e0 0x7f4ffc099f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:21:32.176 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:32.174+0000 7f4ffa7fc700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4ffc0b49e0 0x7f4ffc099f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:41072/0 (socket says 172.21.15.50:41072) 2023-10-06T01:21:32.177 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:32.174+0000 7f4ffa7fc700 1 -- 172.21.15.50:0/1241170808 learned_addr learned my addr 172.21.15.50:0/1241170808 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-06T01:21:32.177 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:32.175+0000 7f4ffaffd700 1 --2- 172.21.15.50:0/1241170808 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4ffc0b07a0 0x7f4ffc09b5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:21:32.177 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:32.175+0000 7f4ffb7fe700 1 --2- 172.21.15.50:0/1241170808 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4ffc1595a0 0x7f4ffc09cf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:21:32.177 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:32.175+0000 7f4ffa7fc700 1 -- 172.21.15.50:0/1241170808 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4ffc0b07a0 msgr2=0x7f4ffc09b5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:21:32.177 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:32.175+0000 7f4ffa7fc700 1 --2- 172.21.15.50:0/1241170808 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4ffc0b07a0 0x7f4ffc09b5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:21:32.177 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:32.175+0000 7f4ffa7fc700 1 -- 172.21.15.50:0/1241170808 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4ffc1595a0 msgr2=0x7f4ffc09cf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:21:32.177 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:32.175+0000 7f4ffa7fc700 1 --2- 172.21.15.50:0/1241170808 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4ffc1595a0 0x7f4ffc09cf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:21:32.177 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:32.175+0000 7f4ffa7fc700 1 -- 172.21.15.50:0/1241170808 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ff00094f0 con 0x7f4ffc0b49e0 2023-10-06T01:21:32.177 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:32.175+0000 7f4ffa7fc700 1 --2- 172.21.15.50:0/1241170808 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4ffc0b49e0 0x7f4ffc099f90 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f4ffc067c60 tx=0x7f4ff0017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:21:32.178 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:32.175+0000 7f4fe2ffd700 1 -- 172.21.15.50:0/1241170808 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ff0000d10 con 0x7f4ffc0b49e0 2023-10-06T01:21:32.178 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:32.175+0000 7f4fe2ffd700 1 -- 172.21.15.50:0/1241170808 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ff000bbe0 con 0x7f4ffc0b49e0 2023-10-06T01:21:32.178 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:32.175+0000 7f4fe2ffd700 1 -- 172.21.15.50:0/1241170808 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ff0011690 con 0x7f4ffc0b49e0 2023-10-06T01:21:32.178 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:32.175+0000 7f50015ff700 1 -- 172.21.15.50:0/1241170808 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4ffc16a250 con 0x7f4ffc0b49e0 2023-10-06T01:21:32.178 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:32.176+0000 7f50015ff700 1 -- 172.21.15.50:0/1241170808 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4ffc16a810 con 0x7f4ffc0b49e0 2023-10-06T01:21:32.179 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:32.177+0000 7f50015ff700 1 -- 172.21.15.50:0/1241170808 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4ffc064ad0 con 0x7f4ffc0b49e0 2023-10-06T01:21:32.179 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:32.178+0000 7f4fe2ffd700 1 -- 172.21.15.50:0/1241170808 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 4) v1 ==== 84684+0+0 (secure 0 0 0) 0x7f4ff0011ac0 con 0x7f4ffc0b49e0 2023-10-06T01:21:32.180 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:32.179+0000 7f4fe2ffd700 1 --2- 172.21.15.50:0/1241170808 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f4fe8066ea0 0x7f4fe8069350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:21:32.180 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:32.179+0000 7f4fe2ffd700 1 -- 172.21.15.50:0/1241170808 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 5206+0+0 (secure 0 0 0) 0x7f4ff0085c50 con 0x7f4ffc0b49e0 2023-10-06T01:21:32.180 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:32.179+0000 7f4ffaffd700 1 --2- 172.21.15.50:0/1241170808 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f4fe8066ea0 0x7f4fe8069350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:21:32.181 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:32.180+0000 7f4ffaffd700 1 --2- 172.21.15.50:0/1241170808 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f4fe8066ea0 0x7f4fe8069350 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f4ffc15d270 tx=0x7f4fec009120 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:21:32.184 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:32.183+0000 7f4fe2ffd700 1 -- 172.21.15.50:0/1241170808 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4ff00530f0 con 0x7f4ffc0b49e0 2023-10-06T01:21:32.438 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:32.437+0000 7f50015ff700 1 -- 172.21.15.50:0/1241170808 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f4ffc0b1820 con 0x7f4ffc0b49e0 2023-10-06T01:21:32.439 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:32.438+0000 7f4fe2ffd700 1 -- 172.21.15.50:0/1241170808 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) v1 ==== 93+0+3524 (secure 0 0 0) 0x7f4ff0015090 con 0x7f4ffc0b49e0 2023-10-06T01:21:32.439 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-10-06T01:21:32.439 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4214,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6835/33654067","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6833","nonce":33654067},{"type":"v1","addr":"172.21.15.50:6835","nonce":33654067}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4279,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6836/2571345069","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":2571345069},{"type":"v1","addr":"172.21.15.155:6836","nonce":2571345069}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4290,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6834/4140731341","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6832","nonce":4140731341},{"type":"v1","addr":"172.21.15.50:6834","nonce":4140731341}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4302,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6837/3434423585","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6835","nonce":3434423585},{"type":"v1","addr":"172.21.15.155:6837","nonce":3434423585}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[]} 2023-10-06T01:21:32.442 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:32.440+0000 7f50015ff700 1 -- 172.21.15.50:0/1241170808 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f4fe8066ea0 msgr2=0x7f4fe8069350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:21:32.442 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:32.440+0000 7f50015ff700 1 --2- 172.21.15.50:0/1241170808 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f4fe8066ea0 0x7f4fe8069350 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f4ffc15d270 tx=0x7f4fec009120 comp rx=0 tx=0).stop 2023-10-06T01:21:32.442 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:32.440+0000 7f50015ff700 1 -- 172.21.15.50:0/1241170808 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4ffc0b49e0 msgr2=0x7f4ffc099f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:21:32.442 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:32.440+0000 7f50015ff700 1 --2- 172.21.15.50:0/1241170808 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4ffc0b49e0 0x7f4ffc099f90 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f4ffc067c60 tx=0x7f4ff0017000 comp rx=0 tx=0).stop 2023-10-06T01:21:32.442 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:32.441+0000 7f50015ff700 1 -- 172.21.15.50:0/1241170808 shutdown_connections 2023-10-06T01:21:32.442 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:32.441+0000 7f50015ff700 1 --2- 172.21.15.50:0/1241170808 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f4fe8066ea0 0x7f4fe8069350 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:21:32.442 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:32.441+0000 7f50015ff700 1 --2- 172.21.15.50:0/1241170808 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4ffc1595a0 0x7f4ffc09cf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:21:32.442 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:32.441+0000 7f50015ff700 1 --2- 172.21.15.50:0/1241170808 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4ffc0b07a0 0x7f4ffc09b5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:21:32.442 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:32.441+0000 7f50015ff700 1 --2- 172.21.15.50:0/1241170808 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4ffc0b49e0 0x7f4ffc099f90 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:21:32.443 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:32.441+0000 7f50015ff700 1 -- 172.21.15.50:0/1241170808 >> 172.21.15.50:0/1241170808 conn(0x7f4ffc099830 msgr2=0x7f4ffc0b3740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:21:32.443 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:32.441+0000 7f50015ff700 1 -- 172.21.15.50:0/1241170808 shutdown_connections 2023-10-06T01:21:32.443 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:32.441+0000 7f50015ff700 1 -- 172.21.15.50:0/1241170808 wait complete. 2023-10-06T01:21:32.443 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 3 2023-10-06T01:21:32.459 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T01:21:32.654 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:32.653+0000 7f8a7a79d700 1 Processor -- start 2023-10-06T01:21:32.655 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:32.654+0000 7f8a7a79d700 1 -- start start 2023-10-06T01:21:32.656 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:32.655+0000 7f8a7a79d700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f8a7406a5d0 0x7f8a74153730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:21:32.656 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:32.655+0000 7f8a7a79d700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8a7406a9a0 0x7f8a74153c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:21:32.656 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:32.655+0000 7f8a7a79d700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8a740c9d00 con 0x7f8a7406df90 2023-10-06T01:21:32.656 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:32.655+0000 7f8a7a79d700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8a7406f5a0 con 0x7f8a7406a5d0 2023-10-06T01:21:32.656 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:32.655+0000 7f8a7a79d700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a7406eb00 con 0x7f8a7406a9a0 2023-10-06T01:21:32.656 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:32.655+0000 7f8a7979b700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f8a7406a5d0 0x7f8a74153730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:21:32.657 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:32.655+0000 7f8a78f9a700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8a7406a9a0 0x7f8a74153c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:21:32.657 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:32.655+0000 7f8a78f9a700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8a7406a9a0 0x7f8a74153c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3301/0 says I am v2:172.21.15.50:46576/0 (socket says 172.21.15.50:46576) 2023-10-06T01:21:32.657 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:32.655+0000 7f8a78f9a700 1 -- 172.21.15.50:0/3725401548 learned_addr learned my addr 172.21.15.50:0/3725401548 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-06T01:21:32.657 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:32.655+0000 7f8a79f9c700 1 --1- 172.21.15.50:0/3725401548 >> v1:172.21.15.155:6789/0 conn(0x7f8a7406df90 0x7f8a7406e3f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.155:6789/0 says I am v1:172.21.15.50:34244/0 (socket says 172.21.15.50:34244) 2023-10-06T01:21:32.658 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:32.656+0000 7f8a6bfff700 1 -- 172.21.15.50:0/3725401548 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 120943622 0 0) 0x7f8a740c9d00 con 0x7f8a7406df90 2023-10-06T01:21:32.658 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:32.656+0000 7f8a6bfff700 1 -- 172.21.15.50:0/3725401548 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8a60003570 con 0x7f8a7406df90 2023-10-06T01:21:32.658 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:32.656+0000 7f8a78f9a700 1 -- 172.21.15.50:0/3725401548 >> v2:172.21.15.155:3300/0 conn(0x7f8a7406a5d0 msgr2=0x7f8a74153730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:21:32.659 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:32.656+0000 7f8a78f9a700 1 --2- 172.21.15.50:0/3725401548 >> v2:172.21.15.155:3300/0 conn(0x7f8a7406a5d0 0x7f8a74153730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:21:32.659 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:32.656+0000 7f8a78f9a700 1 -- 172.21.15.50:0/3725401548 >> v1:172.21.15.155:6789/0 conn(0x7f8a7406df90 legacy=0x7f8a7406e3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:21:32.659 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:32.656+0000 7f8a78f9a700 1 -- 172.21.15.50:0/3725401548 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a740c6750 con 0x7f8a7406a9a0 2023-10-06T01:21:32.659 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:32.656+0000 7f8a7979b700 1 --2- 172.21.15.50:0/3725401548 >> v2:172.21.15.155:3300/0 conn(0x7f8a7406a5d0 0x7f8a74153730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T01:21:32.659 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:32.656+0000 7f8a78f9a700 1 --2- 172.21.15.50:0/3725401548 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8a7406a9a0 0x7f8a74153c70 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f8a640099b0 tx=0x7f8a64009250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f548a07e1122ac28 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:21:32.659 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:32.656+0000 7f8a6bfff700 1 -- 172.21.15.50:0/3725401548 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a6400b680 con 0x7f8a7406a9a0 2023-10-06T01:21:32.659 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:32.656+0000 7f8a6bfff700 1 -- 172.21.15.50:0/3725401548 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a6400b7e0 con 0x7f8a7406a9a0 2023-10-06T01:21:32.659 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:32.656+0000 7f8a6bfff700 1 -- 172.21.15.50:0/3725401548 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a6400bb80 con 0x7f8a7406a9a0 2023-10-06T01:21:32.659 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:32.657+0000 7f8a7a79d700 1 -- 172.21.15.50:0/3725401548 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8a7406a9a0 msgr2=0x7f8a74153c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:21:32.659 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:32.657+0000 7f8a7a79d700 1 --2- 172.21.15.50:0/3725401548 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8a7406a9a0 0x7f8a74153c70 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f8a640099b0 tx=0x7f8a64009250 comp rx=0 tx=0).stop 2023-10-06T01:21:32.659 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:32.657+0000 7f8a7a79d700 1 -- 172.21.15.50:0/3725401548 shutdown_connections 2023-10-06T01:21:32.659 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:32.657+0000 7f8a7a79d700 1 --2- 172.21.15.50:0/3725401548 >> v2:172.21.15.155:3300/0 conn(0x7f8a7406a5d0 0x7f8a74153730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:21:32.660 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:32.657+0000 7f8a7a79d700 1 --2- 172.21.15.50:0/3725401548 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8a7406a9a0 0x7f8a74153c70 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:21:32.660 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:32.657+0000 7f8a7a79d700 1 -- 172.21.15.50:0/3725401548 >> 172.21.15.50:0/3725401548 conn(0x7f8a740680c0 msgr2=0x7f8a740cbf00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:21:32.660 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:32.657+0000 7f8a7a79d700 1 -- 172.21.15.50:0/3725401548 shutdown_connections 2023-10-06T01:21:32.660 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:32.657+0000 7f8a7a79d700 1 -- 172.21.15.50:0/3725401548 wait complete. 2023-10-06T01:21:32.661 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:32.658+0000 7f8a7a79d700 1 Processor -- start 2023-10-06T01:21:32.661 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:32.658+0000 7f8a7a79d700 1 -- start start 2023-10-06T01:21:32.662 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:32.659+0000 7f8a7a79d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8a7406a5d0 0x7f8a7416abf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:21:32.662 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:32.659+0000 7f8a7a79d700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8a7406a9a0 0x7f8a7416c930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:21:32.662 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:32.659+0000 7f8a7a79d700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8a7406df90 0x7f8a74149c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:21:32.662 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:32.659+0000 7f8a7a79d700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a7416ce70 con 0x7f8a7406a5d0 2023-10-06T01:21:32.662 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:32.659+0000 7f8a7a79d700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a74157370 con 0x7f8a7406a9a0 2023-10-06T01:21:32.662 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:32.659+0000 7f8a7a79d700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a740b0790 con 0x7f8a7406df90 2023-10-06T01:21:32.662 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:32.659+0000 7f8a7979b700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8a7406a5d0 0x7f8a7416abf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:21:32.662 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:32.659+0000 7f8a7979b700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8a7406a5d0 0x7f8a7416abf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:41088/0 (socket says 172.21.15.50:41088) 2023-10-06T01:21:32.662 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:32.660+0000 7f8a7979b700 1 -- 172.21.15.50:0/1440439692 learned_addr learned my addr 172.21.15.50:0/1440439692 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-06T01:21:32.662 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:32.660+0000 7f8a7979b700 1 -- 172.21.15.50:0/1440439692 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8a7406df90 msgr2=0x7f8a74149c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:21:32.662 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:32.660+0000 7f8a7979b700 1 --2- 172.21.15.50:0/1440439692 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8a7406df90 0x7f8a74149c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:21:32.663 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:32.660+0000 7f8a7979b700 1 -- 172.21.15.50:0/1440439692 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8a7406a9a0 msgr2=0x7f8a7416c930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:21:32.663 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:32.660+0000 7f8a7979b700 1 --2- 172.21.15.50:0/1440439692 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8a7406a9a0 0x7f8a7416c930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:21:32.663 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:32.660+0000 7f8a7979b700 1 -- 172.21.15.50:0/1440439692 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a70009420 con 0x7f8a7406a5d0 2023-10-06T01:21:32.663 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:32.660+0000 7f8a7979b700 1 --2- 172.21.15.50:0/1440439692 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8a7406a5d0 0x7f8a7416abf0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f8a7000ecb0 tx=0x7f8a700091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:21:32.663 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:32.660+0000 7f8a697fa700 1 -- 172.21.15.50:0/1440439692 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a7000ee60 con 0x7f8a7406a5d0 2023-10-06T01:21:32.663 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:32.660+0000 7f8a697fa700 1 -- 172.21.15.50:0/1440439692 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a7000cbe0 con 0x7f8a7406a5d0 2023-10-06T01:21:32.663 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:32.660+0000 7f8a7a79d700 1 -- 172.21.15.50:0/1440439692 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8a640094f0 con 0x7f8a7406a5d0 2023-10-06T01:21:32.663 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:32.661+0000 7f8a697fa700 1 -- 172.21.15.50:0/1440439692 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a70013470 con 0x7f8a7406a5d0 2023-10-06T01:21:32.663 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:32.661+0000 7f8a7a79d700 1 -- 172.21.15.50:0/1440439692 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8a740afbd0 con 0x7f8a7406a5d0 2023-10-06T01:21:32.664 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:32.661+0000 7f8a7a79d700 1 -- 172.21.15.50:0/1440439692 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8a740b0a70 con 0x7f8a7406a5d0 2023-10-06T01:21:32.664 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:32.662+0000 7f8a697fa700 1 -- 172.21.15.50:0/1440439692 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f8a70013820 con 0x7f8a7406a5d0 2023-10-06T01:21:32.664 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:32.663+0000 7f8a697fa700 1 --2- 172.21.15.50:0/1440439692 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f8a58066f30 0x7f8a580693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:21:32.664 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:32.663+0000 7f8a697fa700 1 -- 172.21.15.50:0/1440439692 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 5206+0+0 (secure 0 0 0) 0x7f8a70084730 con 0x7f8a7406a5d0 2023-10-06T01:21:32.664 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:32.664+0000 7f8a78f9a700 1 --2- 172.21.15.50:0/1440439692 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f8a58066f30 0x7f8a580693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:21:32.665 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:32.664+0000 7f8a78f9a700 1 --2- 172.21.15.50:0/1440439692 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f8a58066f30 0x7f8a580693e0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f8a7414a870 tx=0x7f8a64017000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:21:32.668 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:32.668+0000 7f8a697fa700 1 -- 172.21.15.50:0/1440439692 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f8a70051b90 con 0x7f8a7406a5d0 2023-10-06T01:21:32.874 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:32.873+0000 7f8a7a79d700 1 -- 172.21.15.50:0/1440439692 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f8a7405f270 con 0x7f8a7406a5d0 2023-10-06T01:21:32.875 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:32.874+0000 7f8a697fa700 1 -- 172.21.15.50:0/1440439692 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v17) v1 ==== 74+0+13648 (secure 0 0 0) 0x7f8a700551b0 con 0x7f8a7406a5d0 2023-10-06T01:21:32.875 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-10-06T01:21:32.876 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":17,"fsid":"0bfd9a6b-1587-4fe4-a89e-e43c00286b4e","created":"2023-10-06T01:21:16.828801+0000","modified":"2023-10-06T01:21:32.596241+0000","last_up_change":"2023-10-06T01:21:28.584523+0000","last_in_change":"2023-10-06T01:21:20.179863+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-10-06T01:21:29.304225+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":".mgr","create_time":"2023-10-06T01:21:29.835490+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"9060727a-3959-4de3-8363-c5c5d7826c9a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":87837},{"type":"v1","addr":"172.21.15.50:6801","nonce":87837}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":87837},{"type":"v1","addr":"172.21.15.50:6803","nonce":87837}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":87837},{"type":"v1","addr":"172.21.15.50:6807","nonce":87837}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":87837},{"type":"v1","addr":"172.21.15.50:6805","nonce":87837}]},"public_addr":"172.21.15.50:6801/87837","cluster_addr":"172.21.15.50:6803/87837","heartbeat_back_addr":"172.21.15.50:6807/87837","heartbeat_front_addr":"172.21.15.50:6805/87837","state":["exists","up"]},{"osd":1,"uuid":"5ad9ef12-b579-47ea-b690-90ba887e2cef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":87853},{"type":"v1","addr":"172.21.15.50:6809","nonce":87853}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":87853},{"type":"v1","addr":"172.21.15.50:6811","nonce":87853}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":87853},{"type":"v1","addr":"172.21.15.50:6815","nonce":87853}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":87853},{"type":"v1","addr":"172.21.15.50:6813","nonce":87853}]},"public_addr":"172.21.15.50:6809/87853","cluster_addr":"172.21.15.50:6811/87853","heartbeat_back_addr":"172.21.15.50:6815/87853","heartbeat_front_addr":"172.21.15.50:6813/87853","state":["exists","up"]},{"osd":2,"uuid":"c7aee044-6f75-436f-90e1-ba42a57359bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6821","nonce":87855},{"type":"v1","addr":"172.21.15.50:6822","nonce":87855}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6824","nonce":87855},{"type":"v1","addr":"172.21.15.50:6826","nonce":87855}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":87855},{"type":"v1","addr":"172.21.15.50:6831","nonce":87855}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":87855},{"type":"v1","addr":"172.21.15.50:6829","nonce":87855}]},"public_addr":"172.21.15.50:6822/87855","cluster_addr":"172.21.15.50:6826/87855","heartbeat_back_addr":"172.21.15.50:6831/87855","heartbeat_front_addr":"172.21.15.50:6829/87855","state":["exists","up"]},{"osd":3,"uuid":"d9b901c8-e8b2-44af-9508-f453120a96c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":87856},{"type":"v1","addr":"172.21.15.50:6817","nonce":87856}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":87856},{"type":"v1","addr":"172.21.15.50:6819","nonce":87856}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6825","nonce":87856},{"type":"v1","addr":"172.21.15.50:6827","nonce":87856}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6820","nonce":87856},{"type":"v1","addr":"172.21.15.50:6823","nonce":87856}]},"public_addr":"172.21.15.50:6817/87856","cluster_addr":"172.21.15.50:6819/87856","heartbeat_back_addr":"172.21.15.50:6827/87856","heartbeat_front_addr":"172.21.15.50:6823/87856","state":["exists","up"]},{"osd":4,"uuid":"2b3c6b38-e3e9-4301-9445-60fd3fe8ce03","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":85805},{"type":"v1","addr":"172.21.15.155:6801","nonce":85805}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":85805},{"type":"v1","addr":"172.21.15.155:6803","nonce":85805}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6806","nonce":85805},{"type":"v1","addr":"172.21.15.155:6807","nonce":85805}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6804","nonce":85805},{"type":"v1","addr":"172.21.15.155:6805","nonce":85805}]},"public_addr":"172.21.15.155:6801/85805","cluster_addr":"172.21.15.155:6803/85805","heartbeat_back_addr":"172.21.15.155:6807/85805","heartbeat_front_addr":"172.21.15.155:6805/85805","state":["exists","up"]},{"osd":5,"uuid":"417b5f8f-65f1-4c94-91a7-a6ce03fe1679","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6816","nonce":85807},{"type":"v1","addr":"172.21.15.155:6818","nonce":85807}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6820","nonce":85807},{"type":"v1","addr":"172.21.15.155:6822","nonce":85807}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6828","nonce":85807},{"type":"v1","addr":"172.21.15.155:6830","nonce":85807}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6824","nonce":85807},{"type":"v1","addr":"172.21.15.155:6826","nonce":85807}]},"public_addr":"172.21.15.155:6818/85807","cluster_addr":"172.21.15.155:6822/85807","heartbeat_back_addr":"172.21.15.155:6830/85807","heartbeat_front_addr":"172.21.15.155:6826/85807","state":["exists","up"]},{"osd":6,"uuid":"c150cff3-aee4-4714-9c08-d182b1ba9ffd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6808","nonce":85806},{"type":"v1","addr":"172.21.15.155:6809","nonce":85806}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6810","nonce":85806},{"type":"v1","addr":"172.21.15.155:6811","nonce":85806}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6814","nonce":85806},{"type":"v1","addr":"172.21.15.155:6815","nonce":85806}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6812","nonce":85806},{"type":"v1","addr":"172.21.15.155:6813","nonce":85806}]},"public_addr":"172.21.15.155:6809/85806","cluster_addr":"172.21.15.155:6811/85806","heartbeat_back_addr":"172.21.15.155:6815/85806","heartbeat_front_addr":"172.21.15.155:6813/85806","state":["exists","up"]},{"osd":7,"uuid":"71107f0e-04d1-4e72-a0ec-0faf6af003e7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6817","nonce":85832},{"type":"v1","addr":"172.21.15.155:6819","nonce":85832}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6821","nonce":85832},{"type":"v1","addr":"172.21.15.155:6823","nonce":85832}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6829","nonce":85832},{"type":"v1","addr":"172.21.15.155:6831","nonce":85832}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6825","nonce":85832},{"type":"v1","addr":"172.21.15.155:6827","nonce":85832}]},"public_addr":"172.21.15.155:6819/85832","cluster_addr":"172.21.15.155:6823/85832","heartbeat_back_addr":"172.21.15.155:6831/85832","heartbeat_front_addr":"172.21.15.155:6827/85832","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:21:25.423389+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:21:25.472661+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:21:25.817562+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:21:25.551257+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:21:25.407818+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:21:25.557976+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:21:25.747299+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:21:25.827576+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T01:21:32.878 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:32.877+0000 7f8a7a79d700 1 -- 172.21.15.50:0/1440439692 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f8a58066f30 msgr2=0x7f8a580693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:21:32.878 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:32.877+0000 7f8a7a79d700 1 --2- 172.21.15.50:0/1440439692 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f8a58066f30 0x7f8a580693e0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f8a7414a870 tx=0x7f8a64017000 comp rx=0 tx=0).stop 2023-10-06T01:21:32.878 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:32.877+0000 7f8a7a79d700 1 -- 172.21.15.50:0/1440439692 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8a7406a5d0 msgr2=0x7f8a7416abf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:21:32.878 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:32.877+0000 7f8a7a79d700 1 --2- 172.21.15.50:0/1440439692 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8a7406a5d0 0x7f8a7416abf0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f8a7000ecb0 tx=0x7f8a700091a0 comp rx=0 tx=0).stop 2023-10-06T01:21:32.878 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:32.877+0000 7f8a7a79d700 1 -- 172.21.15.50:0/1440439692 shutdown_connections 2023-10-06T01:21:32.878 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:32.877+0000 7f8a7a79d700 1 --2- 172.21.15.50:0/1440439692 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8a7406df90 0x7f8a74149c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:21:32.878 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:32.877+0000 7f8a7a79d700 1 --2- 172.21.15.50:0/1440439692 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8a7406a5d0 0x7f8a7416abf0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:21:32.879 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:32.877+0000 7f8a7a79d700 1 --2- 172.21.15.50:0/1440439692 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f8a58066f30 0x7f8a580693e0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:21:32.879 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:32.877+0000 7f8a7a79d700 1 --2- 172.21.15.50:0/1440439692 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8a7406a9a0 0x7f8a7416c930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:21:32.879 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:32.877+0000 7f8a7a79d700 1 -- 172.21.15.50:0/1440439692 >> 172.21.15.50:0/1440439692 conn(0x7f8a740680c0 msgr2=0x7f8a741542c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:21:32.879 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:32.877+0000 7f8a7a79d700 1 -- 172.21.15.50:0/1440439692 shutdown_connections 2023-10-06T01:21:32.879 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:32.877+0000 7f8a7a79d700 1 -- 172.21.15.50:0/1440439692 wait complete. 2023-10-06T01:21:32.895 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-10-06T01:21:29.304225+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-10-06T01:21:29.835490+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}] 2023-10-06T01:21:32.895 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-10-06T01:21:33.084 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:33.083+0000 7f6cd199d700 1 Processor -- start 2023-10-06T01:21:33.085 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:33.084+0000 7f6cd199d700 1 -- start start 2023-10-06T01:21:33.086 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:33.085+0000 7f6cd199d700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6ccc0b2660 0x7f6ccc0cccf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:21:33.086 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:33.085+0000 7f6cd199d700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f6ccc0cf1f0 0x7f6ccc0cd230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:21:33.089 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:33.085+0000 7f6cd199d700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6ccc0cc9b0 con 0x7f6ccc0b2a30 2023-10-06T01:21:33.089 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:33.085+0000 7f6cd199d700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6ccc0cbda0 con 0x7f6ccc0cf1f0 2023-10-06T01:21:33.089 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:33.085+0000 7f6cd199d700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ccc0cc080 con 0x7f6ccc0b2660 2023-10-06T01:21:33.089 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:33.085+0000 7f6cd119c700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f6ccc0cf1f0 0x7f6ccc0cd230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:21:33.089 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:33.085+0000 7f6cd119c700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f6ccc0cf1f0 0x7f6ccc0cd230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:41098/0 (socket says 172.21.15.50:41098) 2023-10-06T01:21:33.090 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:33.085+0000 7f6cd119c700 1 -- 172.21.15.50:0/127572315 learned_addr learned my addr 172.21.15.50:0/127572315 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-06T01:21:33.090 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:33.085+0000 7f6cd099b700 1 --2- 172.21.15.50:0/127572315 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6ccc0b2660 0x7f6ccc0cccf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:21:33.090 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:33.086+0000 7f6cd119c700 1 -- 172.21.15.50:0/127572315 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6ccc0b2660 msgr2=0x7f6ccc0cccf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:21:33.090 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:33.086+0000 7f6cd119c700 1 --2- 172.21.15.50:0/127572315 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6ccc0b2660 0x7f6ccc0cccf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:21:33.090 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:33.086+0000 7f6cd119c700 1 -- 172.21.15.50:0/127572315 >> v1:172.21.15.155:6789/0 conn(0x7f6ccc0b2a30 legacy=0x7f6ccc0ceae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:21:33.090 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:33.086+0000 7f6cd119c700 1 -- 172.21.15.50:0/127572315 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ccc0cc360 con 0x7f6ccc0cf1f0 2023-10-06T01:21:33.093 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:33.086+0000 7f6cd119c700 1 --2- 172.21.15.50:0/127572315 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6ccc0cf1f0 0x7f6ccc0cd230 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f6cc4009f20 tx=0x7f6cc4009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=520ba2b2ab9fb9da server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:21:33.093 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:33.086+0000 7f6ccb7fe700 1 -- 172.21.15.50:0/127572315 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cc400e070 con 0x7f6ccc0cf1f0 2023-10-06T01:21:33.093 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:33.086+0000 7f6ccb7fe700 1 -- 172.21.15.50:0/127572315 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6cc400b9d0 con 0x7f6ccc0cf1f0 2023-10-06T01:21:33.093 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:33.086+0000 7f6ccb7fe700 1 -- 172.21.15.50:0/127572315 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cc40092e0 con 0x7f6ccc0cf1f0 2023-10-06T01:21:33.093 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:33.087+0000 7f6cd199d700 1 -- 172.21.15.50:0/127572315 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6ccc0cf1f0 msgr2=0x7f6ccc0cd230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:21:33.093 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:33.087+0000 7f6cd199d700 1 --2- 172.21.15.50:0/127572315 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6ccc0cf1f0 0x7f6ccc0cd230 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f6cc4009f20 tx=0x7f6cc4009840 comp rx=0 tx=0).stop 2023-10-06T01:21:33.093 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:33.087+0000 7f6cd199d700 1 -- 172.21.15.50:0/127572315 shutdown_connections 2023-10-06T01:21:33.093 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:33.087+0000 7f6cd199d700 1 --2- 172.21.15.50:0/127572315 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6ccc0cf1f0 0x7f6ccc0cd230 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:21:33.094 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:33.087+0000 7f6cd199d700 1 --2- 172.21.15.50:0/127572315 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6ccc0b2660 0x7f6ccc0cccf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:21:33.094 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:33.087+0000 7f6cd199d700 1 -- 172.21.15.50:0/127572315 >> 172.21.15.50:0/127572315 conn(0x7f6ccc099560 msgr2=0x7f6ccc06f500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:21:33.094 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:33.087+0000 7f6cd199d700 1 -- 172.21.15.50:0/127572315 shutdown_connections 2023-10-06T01:21:33.094 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:33.087+0000 7f6cd199d700 1 -- 172.21.15.50:0/127572315 wait complete. 2023-10-06T01:21:33.094 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:33.088+0000 7f6cd199d700 1 Processor -- start 2023-10-06T01:21:33.094 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:33.089+0000 7f6cd199d700 1 -- start start 2023-10-06T01:21:33.094 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:33.089+0000 7f6cd199d700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6ccc0b2660 0x7f6ccc14ced0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:21:33.094 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:33.089+0000 7f6cd199d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6ccc0b2a30 0x7f6ccc0cde40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:21:33.094 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:33.089+0000 7f6cd199d700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6ccc0cf1f0 0x7f6ccc0ce380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:21:33.094 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:33.090+0000 7f6cd199d700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ccc14d410 con 0x7f6ccc0b2a30 2023-10-06T01:21:33.094 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:33.090+0000 7f6cd199d700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ccc0c7580 con 0x7f6ccc0cf1f0 2023-10-06T01:21:33.094 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:33.090+0000 7f6cd199d700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ccc1504e0 con 0x7f6ccc0b2660 2023-10-06T01:21:33.095 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:33.090+0000 7f6ccbfff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6ccc0b2a30 0x7f6ccc0cde40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:21:33.095 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:33.090+0000 7f6ccbfff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6ccc0b2a30 0x7f6ccc0cde40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:41112/0 (socket says 172.21.15.50:41112) 2023-10-06T01:21:33.095 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:33.090+0000 7f6ccbfff700 1 -- 172.21.15.50:0/908677531 learned_addr learned my addr 172.21.15.50:0/908677531 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-06T01:21:33.095 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:33.090+0000 7f6cd099b700 1 --2- 172.21.15.50:0/908677531 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6ccc0b2660 0x7f6ccc14ced0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:21:33.095 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:33.090+0000 7f6cd119c700 1 --2- 172.21.15.50:0/908677531 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6ccc0cf1f0 0x7f6ccc0ce380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:21:33.095 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:33.090+0000 7f6ccbfff700 1 -- 172.21.15.50:0/908677531 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6ccc0b2660 msgr2=0x7f6ccc14ced0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:21:33.095 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:33.090+0000 7f6ccbfff700 1 --2- 172.21.15.50:0/908677531 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6ccc0b2660 0x7f6ccc14ced0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:21:33.095 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:33.090+0000 7f6ccbfff700 1 -- 172.21.15.50:0/908677531 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6ccc0cf1f0 msgr2=0x7f6ccc0ce380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:21:33.095 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:33.090+0000 7f6ccbfff700 1 --2- 172.21.15.50:0/908677531 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6ccc0cf1f0 0x7f6ccc0ce380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:21:33.095 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:33.090+0000 7f6ccbfff700 1 -- 172.21.15.50:0/908677531 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6cc4009ae0 con 0x7f6ccc0b2a30 2023-10-06T01:21:33.095 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:33.090+0000 7f6ccbfff700 1 --2- 172.21.15.50:0/908677531 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6ccc0b2a30 0x7f6ccc0cde40 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f6cb800c590 tx=0x7f6cb800c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:21:33.095 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:33.091+0000 7f6cc8ff9700 1 -- 172.21.15.50:0/908677531 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cb8011590 con 0x7f6ccc0b2a30 2023-10-06T01:21:33.096 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:33.091+0000 7f6cc8ff9700 1 -- 172.21.15.50:0/908677531 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6cb8011710 con 0x7f6ccc0b2a30 2023-10-06T01:21:33.096 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:33.091+0000 7f6cc8ff9700 1 -- 172.21.15.50:0/908677531 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cb8011ad0 con 0x7f6ccc0b2a30 2023-10-06T01:21:33.096 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:33.091+0000 7f6cd199d700 1 -- 172.21.15.50:0/908677531 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6ccc14fc40 con 0x7f6ccc0b2a30 2023-10-06T01:21:33.096 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:33.091+0000 7f6cd199d700 1 -- 172.21.15.50:0/908677531 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6ccc150200 con 0x7f6ccc0b2a30 2023-10-06T01:21:33.096 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:33.092+0000 7f6cd199d700 1 -- 172.21.15.50:0/908677531 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6ccc0c76f0 con 0x7f6ccc0b2a30 2023-10-06T01:21:33.097 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:33.093+0000 7f6cc8ff9700 1 -- 172.21.15.50:0/908677531 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f6cb801b3b0 con 0x7f6ccc0b2a30 2023-10-06T01:21:33.097 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:33.093+0000 7f6cc8ff9700 1 --2- 172.21.15.50:0/908677531 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f6cb0066f30 0x7f6cb00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:21:33.097 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:33.094+0000 7f6cc8ff9700 1 -- 172.21.15.50:0/908677531 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 5206+0+0 (secure 0 0 0) 0x7f6cb80837f0 con 0x7f6ccc0b2a30 2023-10-06T01:21:33.097 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:33.094+0000 7f6cd099b700 1 --2- 172.21.15.50:0/908677531 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f6cb0066f30 0x7f6cb00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:21:33.097 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:33.094+0000 7f6cd099b700 1 --2- 172.21.15.50:0/908677531 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f6cb0066f30 0x7f6cb00693e0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f6cc0009d00 tx=0x7f6cc0009120 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:21:33.098 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:33.098+0000 7f6cc8ff9700 1 -- 172.21.15.50:0/908677531 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f6cb8050bb0 con 0x7f6ccc0b2a30 2023-10-06T01:21:33.307 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:33.306+0000 7f6cd199d700 1 -- 172.21.15.50:0/908677531 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f6ccc05f270 con 0x7f6ccc0b2a30 2023-10-06T01:21:33.308 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:33.307+0000 7f6cc8ff9700 1 -- 172.21.15.50:0/908677531 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v17) v1 ==== 92+0+10 (secure 0 0 0) 0x7f6cb80170a0 con 0x7f6ccc0b2a30 2023-10-06T01:21:33.308 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 8 2023-10-06T01:21:33.311 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:33.309+0000 7f6cd199d700 1 -- 172.21.15.50:0/908677531 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f6cb0066f30 msgr2=0x7f6cb00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:21:33.365 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:33.309+0000 7f6cd199d700 1 --2- 172.21.15.50:0/908677531 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f6cb0066f30 0x7f6cb00693e0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f6cc0009d00 tx=0x7f6cc0009120 comp rx=0 tx=0).stop 2023-10-06T01:21:33.365 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:33.309+0000 7f6cd199d700 1 -- 172.21.15.50:0/908677531 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6ccc0b2a30 msgr2=0x7f6ccc0cde40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:21:33.365 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:33.309+0000 7f6cd199d700 1 --2- 172.21.15.50:0/908677531 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6ccc0b2a30 0x7f6ccc0cde40 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f6cb800c590 tx=0x7f6cb800c8a0 comp rx=0 tx=0).stop 2023-10-06T01:21:33.365 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:33.309+0000 7f6cd199d700 1 -- 172.21.15.50:0/908677531 shutdown_connections 2023-10-06T01:21:33.365 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:33.309+0000 7f6cd199d700 1 --2- 172.21.15.50:0/908677531 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f6cb0066f30 0x7f6cb00693e0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:21:33.365 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:33.309+0000 7f6cd199d700 1 --2- 172.21.15.50:0/908677531 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6ccc0cf1f0 0x7f6ccc0ce380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:21:33.365 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:33.309+0000 7f6cd199d700 1 --2- 172.21.15.50:0/908677531 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6ccc0b2660 0x7f6ccc14ced0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:21:33.366 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:33.309+0000 7f6cd199d700 1 --2- 172.21.15.50:0/908677531 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6ccc0b2a30 0x7f6ccc0cde40 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:21:33.366 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:33.309+0000 7f6cd199d700 1 -- 172.21.15.50:0/908677531 >> 172.21.15.50:0/908677531 conn(0x7f6ccc099560 msgr2=0x7f6ccc068b30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:21:33.366 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:33.310+0000 7f6cd199d700 1 -- 172.21.15.50:0/908677531 shutdown_connections 2023-10-06T01:21:33.366 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:33.310+0000 7f6cd199d700 1 -- 172.21.15.50:0/908677531 wait complete. 2023-10-06T01:21:33.367 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-06T01:21:33.557 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:33.556+0000 7f408a99d700 1 Processor -- start 2023-10-06T01:21:33.558 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:33.556+0000 7f408a99d700 1 -- start start 2023-10-06T01:21:33.559 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:33.558+0000 7f408a99d700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f4084156130 0x7f4084159ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:21:33.559 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:33.558+0000 7f408a99d700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f40840acb10 con 0x7f408406e1a0 2023-10-06T01:21:33.559 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:33.558+0000 7f408a99d700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4084156500 con 0x7f40840ae0f0 2023-10-06T01:21:33.559 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:33.558+0000 7f408a99d700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f408415a310 con 0x7f4084156130 2023-10-06T01:21:33.559 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:33.558+0000 7f408999b700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f4084156130 0x7f4084159ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:21:33.559 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:33.558+0000 7f408999b700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f4084156130 0x7f4084159ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:41124/0 (socket says 172.21.15.50:41124) 2023-10-06T01:21:33.559 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:33.558+0000 7f408a19c700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f408406e1a0 0x7f408406e5c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:36108/0 (socket says 172.21.15.50:36108) 2023-10-06T01:21:33.559 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:33.558+0000 7f408999b700 1 -- 172.21.15.50:0/2314252006 learned_addr learned my addr 172.21.15.50:0/2314252006 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-06T01:21:33.561 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:33.558+0000 7f408999b700 1 -- 172.21.15.50:0/2314252006 >> v1:172.21.15.155:6789/0 conn(0x7f40840ae0f0 legacy=0x7f40840c8a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:21:33.561 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:33.558+0000 7f408999b700 1 -- 172.21.15.50:0/2314252006 >> v1:172.21.15.50:6789/0 conn(0x7f408406e1a0 legacy=0x7f408406e5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:21:33.561 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:33.559+0000 7f408999b700 1 -- 172.21.15.50:0/2314252006 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f408415a5f0 con 0x7f4084156130 2023-10-06T01:21:33.561 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:33.558+0000 7f4088999700 1 -- 172.21.15.50:0/2314252006 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3640511320 0 0) 0x7f40840acb10 con 0x7f408406e1a0 2023-10-06T01:21:33.561 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:33.559+0000 7f408999b700 1 --2- 172.21.15.50:0/2314252006 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4084156130 0x7f4084159ca0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f40800099b0 tx=0x7f4080009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aefffecd15654ef4 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:21:33.561 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:33.559+0000 7f4088999700 1 -- 172.21.15.50:0/2314252006 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f408000b860 con 0x7f4084156130 2023-10-06T01:21:33.561 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:33.559+0000 7f4088999700 1 -- 172.21.15.50:0/2314252006 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f408000b9c0 con 0x7f4084156130 2023-10-06T01:21:33.562 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:33.559+0000 7f4088999700 1 -- 172.21.15.50:0/2314252006 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f408000bd60 con 0x7f4084156130 2023-10-06T01:21:33.562 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:33.559+0000 7f408a99d700 1 -- 172.21.15.50:0/2314252006 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4084156130 msgr2=0x7f4084159ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:21:33.562 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:33.559+0000 7f408a99d700 1 --2- 172.21.15.50:0/2314252006 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4084156130 0x7f4084159ca0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f40800099b0 tx=0x7f4080009250 comp rx=0 tx=0).stop 2023-10-06T01:21:33.562 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:33.560+0000 7f408a99d700 1 -- 172.21.15.50:0/2314252006 shutdown_connections 2023-10-06T01:21:33.562 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:33.560+0000 7f408a99d700 1 --2- 172.21.15.50:0/2314252006 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4084156130 0x7f4084159ca0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:21:33.562 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:33.560+0000 7f408a99d700 1 -- 172.21.15.50:0/2314252006 >> 172.21.15.50:0/2314252006 conn(0x7f40840cbf10 msgr2=0x7f40840cc310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:21:33.562 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:33.560+0000 7f408a99d700 1 -- 172.21.15.50:0/2314252006 shutdown_connections 2023-10-06T01:21:33.562 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:33.560+0000 7f408a99d700 1 -- 172.21.15.50:0/2314252006 wait complete. 2023-10-06T01:21:33.564 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:33.561+0000 7f408a99d700 1 Processor -- start 2023-10-06T01:21:33.564 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:33.561+0000 7f408a99d700 1 -- start start 2023-10-06T01:21:33.564 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:33.562+0000 7f408a99d700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f408406e1a0 0x7f4084157f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:21:33.565 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:33.562+0000 7f408a99d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f40840ae0f0 0x7f40840afc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:21:33.565 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:33.562+0000 7f408a99d700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4084156130 0x7f40840b01c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:21:33.565 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:33.562+0000 7f408a99d700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f408416b730 con 0x7f40840ae0f0 2023-10-06T01:21:33.565 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:33.562+0000 7f408a99d700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f408416bbc0 con 0x7f408406e1a0 2023-10-06T01:21:33.565 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:33.562+0000 7f408a99d700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4084156710 con 0x7f4084156130 2023-10-06T01:21:33.565 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:33.562+0000 7f408919a700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f40840ae0f0 0x7f40840afc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:21:33.565 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:33.563+0000 7f408999b700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f408406e1a0 0x7f4084157f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:21:33.565 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:33.563+0000 7f408919a700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f40840ae0f0 0x7f40840afc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:41132/0 (socket says 172.21.15.50:41132) 2023-10-06T01:21:33.565 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:33.563+0000 7f408919a700 1 -- 172.21.15.50:0/2936288770 learned_addr learned my addr 172.21.15.50:0/2936288770 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-06T01:21:33.565 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:33.563+0000 7f408a19c700 1 --2- 172.21.15.50:0/2936288770 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4084156130 0x7f40840b01c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:21:33.565 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:33.563+0000 7f408919a700 1 -- 172.21.15.50:0/2936288770 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4084156130 msgr2=0x7f40840b01c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:21:33.566 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:33.563+0000 7f408919a700 1 --2- 172.21.15.50:0/2936288770 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4084156130 0x7f40840b01c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:21:33.566 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:33.563+0000 7f408919a700 1 -- 172.21.15.50:0/2936288770 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f408406e1a0 msgr2=0x7f4084157f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:21:33.566 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:33.563+0000 7f408919a700 1 --2- 172.21.15.50:0/2936288770 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f408406e1a0 0x7f4084157f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:21:33.566 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:33.563+0000 7f408919a700 1 -- 172.21.15.50:0/2936288770 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40800094f0 con 0x7f40840ae0f0 2023-10-06T01:21:33.566 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:33.563+0000 7f408919a700 1 --2- 172.21.15.50:0/2936288770 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f40840ae0f0 0x7f40840afc80 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f407400c590 tx=0x7f407400c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:21:33.566 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:33.563+0000 7f4079ffb700 1 -- 172.21.15.50:0/2936288770 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4074011590 con 0x7f40840ae0f0 2023-10-06T01:21:33.566 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:33.563+0000 7f4079ffb700 1 -- 172.21.15.50:0/2936288770 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4074011710 con 0x7f40840ae0f0 2023-10-06T01:21:33.566 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:33.563+0000 7f4079ffb700 1 -- 172.21.15.50:0/2936288770 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4074011ad0 con 0x7f40840ae0f0 2023-10-06T01:21:33.566 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:33.563+0000 7f408a99d700 1 -- 172.21.15.50:0/2936288770 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4084165040 con 0x7f40840ae0f0 2023-10-06T01:21:33.566 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:33.564+0000 7f408a99d700 1 -- 172.21.15.50:0/2936288770 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f408416b0e0 con 0x7f40840ae0f0 2023-10-06T01:21:33.567 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:33.565+0000 7f408a99d700 1 -- 172.21.15.50:0/2936288770 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f408416b8e0 con 0x7f40840ae0f0 2023-10-06T01:21:33.567 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:33.566+0000 7f4079ffb700 1 -- 172.21.15.50:0/2936288770 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f407401b3b0 con 0x7f40840ae0f0 2023-10-06T01:21:33.567 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:33.566+0000 7f4079ffb700 1 --2- 172.21.15.50:0/2936288770 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f4068066f30 0x7f40680693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:21:33.568 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:33.567+0000 7f4079ffb700 1 -- 172.21.15.50:0/2936288770 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 5206+0+0 (secure 0 0 0) 0x7f40740837f0 con 0x7f40840ae0f0 2023-10-06T01:21:33.568 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:33.567+0000 7f408999b700 1 --2- 172.21.15.50:0/2936288770 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f4068066f30 0x7f40680693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:21:33.568 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:33.568+0000 7f408999b700 1 --2- 172.21.15.50:0/2936288770 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f4068066f30 0x7f40680693e0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f40800099b0 tx=0x7f4080017000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:21:33.572 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:33.571+0000 7f4079ffb700 1 -- 172.21.15.50:0/2936288770 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f408416b8e0 con 0x7f40840ae0f0 2023-10-06T01:21:33.774 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:33.773+0000 7f408a99d700 1 -- 172.21.15.50:0/2936288770 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f408405f270 con 0x7f40840ae0f0 2023-10-06T01:21:33.774 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:33.773+0000 7f4079ffb700 1 -- 172.21.15.50:0/2936288770 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v17) v1 ==== 93+0+10 (secure 0 0 0) 0x7f4074017020 con 0x7f40840ae0f0 2023-10-06T01:21:33.774 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 1 2023-10-06T01:21:33.777 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:33.775+0000 7f408a99d700 1 -- 172.21.15.50:0/2936288770 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f4068066f30 msgr2=0x7f40680693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:21:33.777 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:33.775+0000 7f408a99d700 1 --2- 172.21.15.50:0/2936288770 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f4068066f30 0x7f40680693e0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f40800099b0 tx=0x7f4080017000 comp rx=0 tx=0).stop 2023-10-06T01:21:33.777 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:33.775+0000 7f408a99d700 1 -- 172.21.15.50:0/2936288770 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f40840ae0f0 msgr2=0x7f40840afc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:21:33.777 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:33.775+0000 7f408a99d700 1 --2- 172.21.15.50:0/2936288770 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f40840ae0f0 0x7f40840afc80 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f407400c590 tx=0x7f407400c8a0 comp rx=0 tx=0).stop 2023-10-06T01:21:33.777 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:33.775+0000 7f408a99d700 1 -- 172.21.15.50:0/2936288770 shutdown_connections 2023-10-06T01:21:33.777 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:33.775+0000 7f408a99d700 1 --2- 172.21.15.50:0/2936288770 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4084156130 0x7f40840b01c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:21:33.777 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:33.775+0000 7f408a99d700 1 --2- 172.21.15.50:0/2936288770 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f4068066f30 0x7f40680693e0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:21:33.777 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:33.775+0000 7f408a99d700 1 --2- 172.21.15.50:0/2936288770 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f408406e1a0 0x7f4084157f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:21:33.777 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:33.775+0000 7f408a99d700 1 --2- 172.21.15.50:0/2936288770 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f40840ae0f0 0x7f40840afc80 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:21:33.777 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:33.776+0000 7f408a99d700 1 -- 172.21.15.50:0/2936288770 >> 172.21.15.50:0/2936288770 conn(0x7f40840cbf10 msgr2=0x7f408414b590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:21:33.778 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:33.776+0000 7f408a99d700 1 -- 172.21.15.50:0/2936288770 shutdown_connections 2023-10-06T01:21:33.778 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:33.776+0000 7f408a99d700 1 -- 172.21.15.50:0/2936288770 wait complete. 2023-10-06T01:21:33.794 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-10-06T01:21:33.894 DEBUG:teuthology.orchestra.run.smithi050:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T01:21:33.898 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T01:21:33.983 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:33.982+0000 7f76ba59d700 1 Processor -- start 2023-10-06T01:21:33.983 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:33.982+0000 7f76ba59d700 1 -- start start 2023-10-06T01:21:33.984 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:33.983+0000 7f76ba59d700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f76b4159480 0x7f76b40b30d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:21:33.985 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:33.983+0000 7f76ba59d700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f76b40b3610 0x7f76b40cbc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:21:33.985 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:33.983+0000 7f76ba59d700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f76b40cc1b0 0x7f76b40b2140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:21:33.985 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:33.983+0000 7f76ba59d700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f76b40cb7e0 con 0x7f76b4159480 2023-10-06T01:21:33.985 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:33.983+0000 7f76ba59d700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f76b40b08a0 con 0x7f76b40cc1b0 2023-10-06T01:21:33.985 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:33.983+0000 7f76ba59d700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76b40cb190 con 0x7f76b40b3610 2023-10-06T01:21:33.985 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:33.984+0000 7f76b959b700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f76b4159480 0x7f76b40b30d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:21:33.985 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:33.984+0000 7f76b959b700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f76b4159480 0x7f76b40b30d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:41144/0 (socket says 172.21.15.50:41144) 2023-10-06T01:21:33.985 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:33.984+0000 7f76b959b700 1 -- 172.21.15.50:0/2593862296 learned_addr learned my addr 172.21.15.50:0/2593862296 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-06T01:21:33.985 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:33.984+0000 7f76b9d9c700 1 --2- 172.21.15.50:0/2593862296 >> v2:172.21.15.155:3300/0 conn(0x7f76b40cc1b0 0x7f76b40b2140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:21:33.985 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:33.984+0000 7f76b8d9a700 1 --2- 172.21.15.50:0/2593862296 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f76b40b3610 0x7f76b40cbc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:21:33.987 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:33.984+0000 7f76b959b700 1 -- 172.21.15.50:0/2593862296 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f76b40b3610 msgr2=0x7f76b40cbc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:21:33.987 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:33.984+0000 7f76b959b700 1 --2- 172.21.15.50:0/2593862296 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f76b40b3610 0x7f76b40cbc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:21:33.987 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:33.984+0000 7f76b959b700 1 -- 172.21.15.50:0/2593862296 >> v2:172.21.15.155:3300/0 conn(0x7f76b40cc1b0 msgr2=0x7f76b40b2140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:21:33.987 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:33.984+0000 7f76b959b700 1 --2- 172.21.15.50:0/2593862296 >> v2:172.21.15.155:3300/0 conn(0x7f76b40cc1b0 0x7f76b40b2140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:21:33.987 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:33.984+0000 7f76b959b700 1 -- 172.21.15.50:0/2593862296 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76b40cb470 con 0x7f76b4159480 2023-10-06T01:21:33.987 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:33.984+0000 7f76b959b700 1 --2- 172.21.15.50:0/2593862296 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f76b4159480 0x7f76b40b30d0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f76b415cf30 tx=0x7f76b0009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=67158b8752a21c01 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:21:33.988 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:33.985+0000 7f76abfff700 1 -- 172.21.15.50:0/2593862296 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76b000b640 con 0x7f76b4159480 2023-10-06T01:21:33.988 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:33.985+0000 7f76abfff700 1 -- 172.21.15.50:0/2593862296 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f76b000b7a0 con 0x7f76b4159480 2023-10-06T01:21:33.988 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:33.985+0000 7f76abfff700 1 -- 172.21.15.50:0/2593862296 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76b000bb60 con 0x7f76b4159480 2023-10-06T01:21:33.988 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:33.985+0000 7f76ba59d700 1 -- 172.21.15.50:0/2593862296 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f76b4159480 msgr2=0x7f76b40b30d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:21:33.988 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:33.985+0000 7f76ba59d700 1 --2- 172.21.15.50:0/2593862296 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f76b4159480 0x7f76b40b30d0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f76b415cf30 tx=0x7f76b0009250 comp rx=0 tx=0).stop 2023-10-06T01:21:33.988 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:33.985+0000 7f76ba59d700 1 -- 172.21.15.50:0/2593862296 shutdown_connections 2023-10-06T01:21:33.988 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:33.985+0000 7f76ba59d700 1 --2- 172.21.15.50:0/2593862296 >> v2:172.21.15.155:3300/0 conn(0x7f76b40cc1b0 0x7f76b40b2140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:21:33.988 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:33.985+0000 7f76ba59d700 1 --2- 172.21.15.50:0/2593862296 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f76b4159480 0x7f76b40b30d0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:21:33.988 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:33.985+0000 7f76ba59d700 1 --2- 172.21.15.50:0/2593862296 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f76b40b3610 0x7f76b40cbc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:21:33.988 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:33.985+0000 7f76ba59d700 1 -- 172.21.15.50:0/2593862296 >> 172.21.15.50:0/2593862296 conn(0x7f76b406ed20 msgr2=0x7f76b406f120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:21:33.988 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:33.985+0000 7f76ba59d700 1 -- 172.21.15.50:0/2593862296 shutdown_connections 2023-10-06T01:21:33.989 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:33.985+0000 7f76ba59d700 1 -- 172.21.15.50:0/2593862296 wait complete. 2023-10-06T01:21:33.991 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:33.987+0000 7f76ba59d700 1 Processor -- start 2023-10-06T01:21:33.991 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:33.987+0000 7f76ba59d700 1 -- start start 2023-10-06T01:21:33.991 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:33.988+0000 7f76ba59d700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f76b40b3610 0x7f76b41547e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:21:33.991 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:33.988+0000 7f76ba59d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f76b40cc1b0 0x7f76b40c6260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:21:33.991 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:33.988+0000 7f76ba59d700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f76b4159480 0x7f76b40c7310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:21:33.991 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:33.988+0000 7f76ba59d700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76b40c9e30 con 0x7f76b40cc1b0 2023-10-06T01:21:33.991 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:33.988+0000 7f76ba59d700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76b4154d20 con 0x7f76b40b3610 2023-10-06T01:21:33.991 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:33.988+0000 7f76ba59d700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76b40c9220 con 0x7f76b4159480 2023-10-06T01:21:33.992 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:33.988+0000 7f76b8d9a700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f76b40cc1b0 0x7f76b40c6260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:21:33.992 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:33.988+0000 7f76b8d9a700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f76b40cc1b0 0x7f76b40c6260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:41154/0 (socket says 172.21.15.50:41154) 2023-10-06T01:21:33.992 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:33.988+0000 7f76b8d9a700 1 -- 172.21.15.50:0/2835009425 learned_addr learned my addr 172.21.15.50:0/2835009425 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-06T01:21:33.992 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:33.988+0000 7f76b959b700 1 --2- 172.21.15.50:0/2835009425 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f76b40b3610 0x7f76b41547e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:21:33.992 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:33.988+0000 7f76b9d9c700 1 --2- 172.21.15.50:0/2835009425 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f76b4159480 0x7f76b40c7310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:21:33.992 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:33.988+0000 7f76b8d9a700 1 -- 172.21.15.50:0/2835009425 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f76b4159480 msgr2=0x7f76b40c7310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:21:33.992 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:33.988+0000 7f76b8d9a700 1 --2- 172.21.15.50:0/2835009425 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f76b4159480 0x7f76b40c7310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:21:33.992 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:33.988+0000 7f76b8d9a700 1 -- 172.21.15.50:0/2835009425 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f76b40b3610 msgr2=0x7f76b41547e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:21:33.992 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:33.989+0000 7f76b8d9a700 1 --2- 172.21.15.50:0/2835009425 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f76b40b3610 0x7f76b41547e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:21:33.992 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:33.989+0000 7f76b8d9a700 1 -- 172.21.15.50:0/2835009425 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76b00094f0 con 0x7f76b40cc1b0 2023-10-06T01:21:33.992 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:33.989+0000 7f76b8d9a700 1 --2- 172.21.15.50:0/2835009425 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f76b40cc1b0 0x7f76b40c6260 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f76a400ec80 tx=0x7f76a40091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:21:33.993 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:33.989+0000 7f76a97fa700 1 -- 172.21.15.50:0/2835009425 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76a400c9d0 con 0x7f76b40cc1b0 2023-10-06T01:21:33.993 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:33.989+0000 7f76a97fa700 1 -- 172.21.15.50:0/2835009425 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f76a400cb50 con 0x7f76b40cc1b0 2023-10-06T01:21:33.993 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:33.989+0000 7f76a97fa700 1 -- 172.21.15.50:0/2835009425 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76a4013470 con 0x7f76b40cc1b0 2023-10-06T01:21:33.993 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:33.989+0000 7f76ba59d700 1 -- 172.21.15.50:0/2835009425 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f76b40c9500 con 0x7f76b40cc1b0 2023-10-06T01:21:33.993 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:33.989+0000 7f76ba59d700 1 -- 172.21.15.50:0/2835009425 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f76b40c9ac0 con 0x7f76b40cc1b0 2023-10-06T01:21:33.993 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:33.990+0000 7f76ba59d700 1 -- 172.21.15.50:0/2835009425 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f76b40c3c40 con 0x7f76b40cc1b0 2023-10-06T01:21:33.994 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:33.991+0000 7f76a97fa700 1 -- 172.21.15.50:0/2835009425 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f76a4013860 con 0x7f76b40cc1b0 2023-10-06T01:21:33.994 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:33.992+0000 7f76a97fa700 1 --2- 172.21.15.50:0/2835009425 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f7698067000 0x7f76980694b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:21:33.994 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:33.992+0000 7f76a97fa700 1 -- 172.21.15.50:0/2835009425 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 5206+0+0 (secure 0 0 0) 0x7f76a4084720 con 0x7f76b40cc1b0 2023-10-06T01:21:33.994 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:33.992+0000 7f76b959b700 1 --2- 172.21.15.50:0/2835009425 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f7698067000 0x7f76980694b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:21:33.994 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:33.993+0000 7f76b959b700 1 --2- 172.21.15.50:0/2835009425 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f7698067000 0x7f76980694b0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f76b415cf30 tx=0x7f76b0017000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:21:33.997 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:33.996+0000 7f76a97fa700 1 -- 172.21.15.50:0/2835009425 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f76b40c3c40 con 0x7f76b40cc1b0 2023-10-06T01:21:34.203 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:34.202+0000 7f76ba59d700 1 -- 172.21.15.50:0/2835009425 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f76b40c3c40 con 0x7f76b40cc1b0 2023-10-06T01:21:34.204 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:34.203+0000 7f76a97fa700 1 -- 172.21.15.50:0/2835009425 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v17) v1 ==== 84+0+126 (secure 0 0 0) 0x7f76b40c3c40 con 0x7f76b40cc1b0 2023-10-06T01:21:34.204 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-10-06T01:21:34.204 INFO:teuthology.orchestra.run.smithi050.stdout:[ 2023-10-06T01:21:34.204 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-10-06T01:21:34.204 INFO:teuthology.orchestra.run.smithi050.stdout: "poolnum": 1, 2023-10-06T01:21:34.204 INFO:teuthology.orchestra.run.smithi050.stdout: "poolname": "rbd" 2023-10-06T01:21:34.205 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-06T01:21:34.205 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-10-06T01:21:34.205 INFO:teuthology.orchestra.run.smithi050.stdout: "poolnum": 2, 2023-10-06T01:21:34.205 INFO:teuthology.orchestra.run.smithi050.stdout: "poolname": ".mgr" 2023-10-06T01:21:34.205 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-10-06T01:21:34.205 INFO:teuthology.orchestra.run.smithi050.stdout:] 2023-10-06T01:21:34.206 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:34.205+0000 7f76ba59d700 1 -- 172.21.15.50:0/2835009425 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f7698067000 msgr2=0x7f76980694b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:21:34.207 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:34.205+0000 7f76ba59d700 1 --2- 172.21.15.50:0/2835009425 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f7698067000 0x7f76980694b0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f76b415cf30 tx=0x7f76b0017000 comp rx=0 tx=0).stop 2023-10-06T01:21:34.207 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:34.205+0000 7f76ba59d700 1 -- 172.21.15.50:0/2835009425 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f76b40cc1b0 msgr2=0x7f76b40c6260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:21:34.207 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:34.205+0000 7f76ba59d700 1 --2- 172.21.15.50:0/2835009425 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f76b40cc1b0 0x7f76b40c6260 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f76a400ec80 tx=0x7f76a40091a0 comp rx=0 tx=0).stop 2023-10-06T01:21:34.207 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:34.205+0000 7f76ba59d700 1 -- 172.21.15.50:0/2835009425 shutdown_connections 2023-10-06T01:21:34.207 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:34.205+0000 7f76ba59d700 1 --2- 172.21.15.50:0/2835009425 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f76b4159480 0x7f76b40c7310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:21:34.207 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:34.205+0000 7f76ba59d700 1 --2- 172.21.15.50:0/2835009425 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f7698067000 0x7f76980694b0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:21:34.207 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:34.205+0000 7f76ba59d700 1 --2- 172.21.15.50:0/2835009425 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f76b40b3610 0x7f76b41547e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:21:34.207 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:34.205+0000 7f76ba59d700 1 --2- 172.21.15.50:0/2835009425 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f76b40cc1b0 0x7f76b40c6260 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:21:34.207 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:34.205+0000 7f76ba59d700 1 -- 172.21.15.50:0/2835009425 >> 172.21.15.50:0/2835009425 conn(0x7f76b406ed20 msgr2=0x7f76b40b2140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:21:34.207 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:34.205+0000 7f76ba59d700 1 -- 172.21.15.50:0/2835009425 shutdown_connections 2023-10-06T01:21:34.207 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:34.205+0000 7f76ba59d700 1 -- 172.21.15.50:0/2835009425 wait complete. 2023-10-06T01:21:34.223 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-10-06T01:21:34.223 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-10-06T01:21:34.414 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:34.414+0000 7f3ad179d700 1 Processor -- start 2023-10-06T01:21:34.415 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:34.414+0000 7f3ad179d700 1 -- start start 2023-10-06T01:21:34.416 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:34.415+0000 7f3ad179d700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f3acc155bf0 0x7f3acc06e1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:21:34.417 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:34.415+0000 7f3ad179d700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f3acc06e730 0x7f3acc0692f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:21:34.417 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:34.415+0000 7f3ad179d700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3acc0c12a0 con 0x7f3acc155820 2023-10-06T01:21:34.417 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:34.415+0000 7f3ad179d700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3acc0c2100 con 0x7f3acc06e730 2023-10-06T01:21:34.417 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:34.415+0000 7f3ad179d700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3acc0c14f0 con 0x7f3acc155bf0 2023-10-06T01:21:34.417 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:34.415+0000 7f3ad0f9c700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f3acc06e730 0x7f3acc0692f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:21:34.417 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:34.415+0000 7f3ad0f9c700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f3acc06e730 0x7f3acc0692f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:41158/0 (socket says 172.21.15.50:41158) 2023-10-06T01:21:34.417 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:34.415+0000 7f3ad0f9c700 1 -- 172.21.15.50:0/2910694710 learned_addr learned my addr 172.21.15.50:0/2910694710 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-06T01:21:34.417 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:34.415+0000 7f3acb7fe700 1 --2- 172.21.15.50:0/2910694710 >> v2:172.21.15.155:3300/0 conn(0x7f3acc155bf0 0x7f3acc06e1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:21:34.417 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:34.416+0000 7f3ad0f9c700 1 -- 172.21.15.50:0/2910694710 >> v2:172.21.15.155:3300/0 conn(0x7f3acc155bf0 msgr2=0x7f3acc06e1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:21:34.417 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:34.416+0000 7f3ad0f9c700 1 --2- 172.21.15.50:0/2910694710 >> v2:172.21.15.155:3300/0 conn(0x7f3acc155bf0 0x7f3acc06e1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:21:34.417 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:34.416+0000 7f3ad0f9c700 1 -- 172.21.15.50:0/2910694710 >> v1:172.21.15.155:6789/0 conn(0x7f3acc155820 legacy=0x7f3acc0c2590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:21:34.418 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:34.416+0000 7f3ad0f9c700 1 -- 172.21.15.50:0/2910694710 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3acc0c17d0 con 0x7f3acc06e730 2023-10-06T01:21:34.418 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:34.416+0000 7f3acb7fe700 1 --2- 172.21.15.50:0/2910694710 >> v2:172.21.15.155:3300/0 conn(0x7f3acc155bf0 0x7f3acc06e1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T01:21:34.418 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:34.416+0000 7f3ad0f9c700 1 --2- 172.21.15.50:0/2910694710 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3acc06e730 0x7f3acc0692f0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f3acc0aea30 tx=0x7f3ac4009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=611202f346b8df0e server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:21:34.419 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:34.416+0000 7f3acaffd700 1 -- 172.21.15.50:0/2910694710 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ac400e070 con 0x7f3acc06e730 2023-10-06T01:21:34.419 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:34.416+0000 7f3acaffd700 1 -- 172.21.15.50:0/2910694710 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ac400ba50 con 0x7f3acc06e730 2023-10-06T01:21:34.419 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:34.416+0000 7f3acaffd700 1 -- 172.21.15.50:0/2910694710 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ac40092e0 con 0x7f3acc06e730 2023-10-06T01:21:34.419 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:34.417+0000 7f3ad179d700 1 -- 172.21.15.50:0/2910694710 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3acc06e730 msgr2=0x7f3acc0692f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:21:34.419 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:34.417+0000 7f3ad179d700 1 --2- 172.21.15.50:0/2910694710 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3acc06e730 0x7f3acc0692f0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f3acc0aea30 tx=0x7f3ac4009840 comp rx=0 tx=0).stop 2023-10-06T01:21:34.419 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:34.417+0000 7f3ad179d700 1 -- 172.21.15.50:0/2910694710 shutdown_connections 2023-10-06T01:21:34.420 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:34.417+0000 7f3ad179d700 1 --2- 172.21.15.50:0/2910694710 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3acc06e730 0x7f3acc0692f0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:21:34.420 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:34.417+0000 7f3ad179d700 1 --2- 172.21.15.50:0/2910694710 >> v2:172.21.15.155:3300/0 conn(0x7f3acc155bf0 0x7f3acc06e1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:21:34.420 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:34.417+0000 7f3ad179d700 1 -- 172.21.15.50:0/2910694710 >> 172.21.15.50:0/2910694710 conn(0x7f3acc0680c0 msgr2=0x7f3acc0cbef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:21:34.420 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:34.417+0000 7f3ad179d700 1 -- 172.21.15.50:0/2910694710 shutdown_connections 2023-10-06T01:21:34.420 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:34.417+0000 7f3ad179d700 1 -- 172.21.15.50:0/2910694710 wait complete. 2023-10-06T01:21:34.420 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:34.418+0000 7f3ad179d700 1 Processor -- start 2023-10-06T01:21:34.420 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:34.418+0000 7f3ad179d700 1 -- start start 2023-10-06T01:21:34.422 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:34.419+0000 7f3ad179d700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3acc06e730 0x7f3acc142a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:21:34.422 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:34.419+0000 7f3ad179d700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3acc155820 0x7f3acc16bd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:21:34.422 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:34.419+0000 7f3ad179d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3acc155bf0 0x7f3acc16c240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:21:34.422 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:34.419+0000 7f3ad179d700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3acc16c780 con 0x7f3acc155bf0 2023-10-06T01:21:34.422 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:34.419+0000 7f3ad179d700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3acc0c4b30 con 0x7f3acc06e730 2023-10-06T01:21:34.422 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:34.419+0000 7f3ad179d700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3acc152330 con 0x7f3acc155820 2023-10-06T01:21:34.422 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:34.420+0000 7f3ad0f9c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3acc155bf0 0x7f3acc16c240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:21:34.423 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:34.420+0000 7f3acbfff700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3acc06e730 0x7f3acc142a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:21:34.423 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:34.420+0000 7f3acb7fe700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3acc155820 0x7f3acc16bd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:21:34.423 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:34.420+0000 7f3ad0f9c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3acc155bf0 0x7f3acc16c240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:41174/0 (socket says 172.21.15.50:41174) 2023-10-06T01:21:34.423 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:34.420+0000 7f3ad0f9c700 1 -- 172.21.15.50:0/3971277651 learned_addr learned my addr 172.21.15.50:0/3971277651 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-06T01:21:34.423 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:34.420+0000 7f3acbfff700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3acc06e730 0x7f3acc142a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.50:46368/0 (socket says 172.21.15.50:46368) 2023-10-06T01:21:34.423 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:34.420+0000 7f3acb7fe700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3acc155820 0x7f3acc16bd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3301/0 says I am v2:172.21.15.50:46634/0 (socket says 172.21.15.50:46634) 2023-10-06T01:21:34.423 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:34.420+0000 7f3ad0f9c700 1 -- 172.21.15.50:0/3971277651 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3acc155820 msgr2=0x7f3acc16bd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:21:34.423 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:34.420+0000 7f3ad0f9c700 1 --2- 172.21.15.50:0/3971277651 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3acc155820 0x7f3acc16bd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:21:34.423 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:34.420+0000 7f3ad0f9c700 1 -- 172.21.15.50:0/3971277651 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3acc06e730 msgr2=0x7f3acc142a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:21:34.423 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:34.420+0000 7f3ad0f9c700 1 --2- 172.21.15.50:0/3971277651 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3acc06e730 0x7f3acc142a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:21:34.423 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:34.420+0000 7f3ad0f9c700 1 -- 172.21.15.50:0/3971277651 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ac4009ae0 con 0x7f3acc155bf0 2023-10-06T01:21:34.424 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:34.420+0000 7f3ad0f9c700 1 --2- 172.21.15.50:0/3971277651 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3acc155bf0 0x7f3acc16c240 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f3acc068b40 tx=0x7f3ac4018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:21:34.424 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:34.421+0000 7f3ab3fff700 1 -- 172.21.15.50:0/3971277651 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ac400be60 con 0x7f3acc155bf0 2023-10-06T01:21:34.424 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:34.421+0000 7f3ab3fff700 1 -- 172.21.15.50:0/3971277651 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ac4008ce0 con 0x7f3acc155bf0 2023-10-06T01:21:34.424 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:34.421+0000 7f3ab3fff700 1 -- 172.21.15.50:0/3971277651 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ac40266b0 con 0x7f3acc155bf0 2023-10-06T01:21:34.424 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:34.421+0000 7f3ad179d700 1 -- 172.21.15.50:0/3971277651 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3acc152610 con 0x7f3acc155bf0 2023-10-06T01:21:34.424 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:34.421+0000 7f3ad179d700 1 -- 172.21.15.50:0/3971277651 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3acc0c47c0 con 0x7f3acc155bf0 2023-10-06T01:21:34.425 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:34.422+0000 7f3ad179d700 1 -- 172.21.15.50:0/3971277651 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3acc0c45f0 con 0x7f3acc155bf0 2023-10-06T01:21:34.425 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:34.423+0000 7f3ab3fff700 1 -- 172.21.15.50:0/3971277651 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f3ac4003040 con 0x7f3acc155bf0 2023-10-06T01:21:34.425 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:34.423+0000 7f3ab3fff700 1 --2- 172.21.15.50:0/3971277651 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f3ab8066f30 0x7f3ab80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:21:34.425 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:34.424+0000 7f3ab3fff700 1 -- 172.21.15.50:0/3971277651 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 5206+0+0 (secure 0 0 0) 0x7f3ac40860f0 con 0x7f3acc155bf0 2023-10-06T01:21:34.425 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:34.424+0000 7f3acbfff700 1 --2- 172.21.15.50:0/3971277651 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f3ab8066f30 0x7f3ab80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:21:34.425 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:34.425+0000 7f3acbfff700 1 --2- 172.21.15.50:0/3971277651 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f3ab8066f30 0x7f3ab80693e0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f3abc003a80 tx=0x7f3abc007ec0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:21:34.428 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:34.428+0000 7f3ab3fff700 1 -- 172.21.15.50:0/3971277651 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f3ac4053550 con 0x7f3acc155bf0 2023-10-06T01:21:34.636 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:34.635+0000 7f3ad179d700 1 -- 172.21.15.50:0/3971277651 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f3acc05f270 con 0x7f3acc155bf0 2023-10-06T01:21:35.270 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:35.269+0000 7f3ab3fff700 1 -- 172.21.15.50:0/3971277651 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v18) v1 ==== 138+0+0 (secure 0 0 0) 0x7f3ac4056b70 con 0x7f3acc155bf0 2023-10-06T01:21:35.279 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:35.278+0000 7f3ad179d700 1 -- 172.21.15.50:0/3971277651 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f3ab8066f30 msgr2=0x7f3ab80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:21:35.279 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:35.278+0000 7f3ad179d700 1 --2- 172.21.15.50:0/3971277651 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f3ab8066f30 0x7f3ab80693e0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f3abc003a80 tx=0x7f3abc007ec0 comp rx=0 tx=0).stop 2023-10-06T01:21:35.279 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:35.278+0000 7f3ad179d700 1 -- 172.21.15.50:0/3971277651 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3acc155bf0 msgr2=0x7f3acc16c240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:21:35.279 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:35.278+0000 7f3ad179d700 1 --2- 172.21.15.50:0/3971277651 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3acc155bf0 0x7f3acc16c240 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f3acc068b40 tx=0x7f3ac4018000 comp rx=0 tx=0).stop 2023-10-06T01:21:35.280 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:35.279+0000 7f3ad179d700 1 -- 172.21.15.50:0/3971277651 shutdown_connections 2023-10-06T01:21:35.280 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:35.279+0000 7f3ad179d700 1 --2- 172.21.15.50:0/3971277651 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3acc155bf0 0x7f3acc16c240 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:21:35.280 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:35.279+0000 7f3ad179d700 1 --2- 172.21.15.50:0/3971277651 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f3ab8066f30 0x7f3ab80693e0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:21:35.280 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:35.279+0000 7f3ad179d700 1 --2- 172.21.15.50:0/3971277651 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3acc06e730 0x7f3acc142a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:21:35.280 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:35.279+0000 7f3ad179d700 1 --2- 172.21.15.50:0/3971277651 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3acc155820 0x7f3acc16bd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:21:35.280 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:35.279+0000 7f3ad179d700 1 -- 172.21.15.50:0/3971277651 >> 172.21.15.50:0/3971277651 conn(0x7f3acc0680c0 msgr2=0x7f3acc14b470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:21:35.280 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:35.279+0000 7f3ad179d700 1 -- 172.21.15.50:0/3971277651 shutdown_connections 2023-10-06T01:21:35.280 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:35.279+0000 7f3ad179d700 1 -- 172.21.15.50:0/3971277651 wait complete. 2023-10-06T01:21:35.281 INFO:teuthology.orchestra.run.smithi050.stderr:pool 'cephfs_metadata' created 2023-10-06T01:21:35.300 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.05 2023-10-06T01:21:35.498 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:35.497+0000 7fda79d9d700 1 Processor -- start 2023-10-06T01:21:35.498 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:35.497+0000 7fda79d9d700 1 -- start start 2023-10-06T01:21:35.499 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:35.498+0000 7fda79d9d700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fda740cd400 0x7fda740ceae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:21:35.499 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:35.498+0000 7fda79d9d700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fda740cc9b0 con 0x7fda740b2a30 2023-10-06T01:21:35.499 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:35.498+0000 7fda79d9d700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fda740cbda0 con 0x7fda740b2660 2023-10-06T01:21:35.499 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:35.498+0000 7fda79d9d700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda740cc080 con 0x7fda740cd400 2023-10-06T01:21:35.499 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:35.498+0000 7fda7959c700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fda740b2a30 0x7fda740c5390 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:39010/0 (socket says 172.21.15.50:39010) 2023-10-06T01:21:35.499 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:35.498+0000 7fda7959c700 1 -- 172.21.15.50:0/2321156735 learned_addr learned my addr 172.21.15.50:0/2321156735 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-10-06T01:21:35.501 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:35.499+0000 7fda73fff700 1 --2- 172.21.15.50:0/2321156735 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fda740cd400 0x7fda740ceae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:21:35.501 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:35.499+0000 7fda737fe700 1 -- 172.21.15.50:0/2321156735 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2063275339 0 0) 0x7fda740cc9b0 con 0x7fda740b2a30 2023-10-06T01:21:35.502 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:35.499+0000 7fda737fe700 1 -- 172.21.15.50:0/2321156735 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fda64003570 con 0x7fda740b2a30 2023-10-06T01:21:35.502 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:35.499+0000 7fda737fe700 1 -- 172.21.15.50:0/2321156735 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3187852907 0 0) 0x7fda740cbda0 con 0x7fda740b2660 2023-10-06T01:21:35.502 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:35.499+0000 7fda737fe700 1 -- 172.21.15.50:0/2321156735 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fda740cc9b0 con 0x7fda740b2660 2023-10-06T01:21:35.502 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:35.499+0000 7fda73fff700 1 -- 172.21.15.50:0/2321156735 >> v1:172.21.15.155:6789/0 conn(0x7fda740b2660 legacy=0x7fda740cccf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:21:35.502 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:35.499+0000 7fda73fff700 1 -- 172.21.15.50:0/2321156735 >> v1:172.21.15.50:6789/0 conn(0x7fda740b2a30 legacy=0x7fda740c5390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:21:35.502 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:35.499+0000 7fda73fff700 1 -- 172.21.15.50:0/2321156735 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda740cc360 con 0x7fda740cd400 2023-10-06T01:21:35.502 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:35.500+0000 7fda73fff700 1 --2- 172.21.15.50:0/2321156735 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fda740cd400 0x7fda740ceae0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fda60009910 tx=0x7fda600091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5a1a95c7a65606d6 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:21:35.502 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:35.500+0000 7fda737fe700 1 -- 172.21.15.50:0/2321156735 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda60011630 con 0x7fda740cd400 2023-10-06T01:21:35.502 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:35.500+0000 7fda737fe700 1 -- 172.21.15.50:0/2321156735 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda60011790 con 0x7fda740cd400 2023-10-06T01:21:35.502 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:35.500+0000 7fda737fe700 1 -- 172.21.15.50:0/2321156735 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda60011b30 con 0x7fda740cd400 2023-10-06T01:21:35.502 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:35.500+0000 7fda79d9d700 1 -- 172.21.15.50:0/2321156735 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fda740cd400 msgr2=0x7fda740ceae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:21:35.503 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:35.500+0000 7fda79d9d700 1 --2- 172.21.15.50:0/2321156735 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fda740cd400 0x7fda740ceae0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fda60009910 tx=0x7fda600091a0 comp rx=0 tx=0).stop 2023-10-06T01:21:35.503 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:35.500+0000 7fda79d9d700 1 -- 172.21.15.50:0/2321156735 shutdown_connections 2023-10-06T01:21:35.503 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:35.501+0000 7fda79d9d700 1 --2- 172.21.15.50:0/2321156735 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fda740cd400 0x7fda740ceae0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:21:35.503 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:35.501+0000 7fda79d9d700 1 -- 172.21.15.50:0/2321156735 >> 172.21.15.50:0/2321156735 conn(0x7fda74099560 msgr2=0x7fda7406f500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:21:35.503 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:35.501+0000 7fda79d9d700 1 -- 172.21.15.50:0/2321156735 shutdown_connections 2023-10-06T01:21:35.503 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:35.501+0000 7fda79d9d700 1 -- 172.21.15.50:0/2321156735 wait complete. 2023-10-06T01:21:35.505 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:35.502+0000 7fda79d9d700 1 Processor -- start 2023-10-06T01:21:35.506 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:35.502+0000 7fda79d9d700 1 -- start start 2023-10-06T01:21:35.506 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:35.503+0000 7fda79d9d700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fda740b2660 0x7fda741696b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:21:35.506 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:35.503+0000 7fda79d9d700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fda740b2a30 0x7fda74150e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:21:35.506 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:35.503+0000 7fda79d9d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fda740cd400 0x7fda740b5360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:21:35.506 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:35.503+0000 7fda79d9d700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda7416a8a0 con 0x7fda740cd400 2023-10-06T01:21:35.506 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:35.503+0000 7fda79d9d700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda74169c90 con 0x7fda740b2660 2023-10-06T01:21:35.506 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:35.503+0000 7fda79d9d700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda74169f70 con 0x7fda740b2a30 2023-10-06T01:21:35.506 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:35.503+0000 7fda7959c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fda740cd400 0x7fda740b5360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:21:35.506 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:35.503+0000 7fda7959c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fda740cd400 0x7fda740b5360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:42084/0 (socket says 172.21.15.50:42084) 2023-10-06T01:21:35.506 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:35.503+0000 7fda7959c700 1 -- 172.21.15.50:0/78107962 learned_addr learned my addr 172.21.15.50:0/78107962 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-06T01:21:35.506 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:35.503+0000 7fda73fff700 1 --2- 172.21.15.50:0/78107962 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fda740b2a30 0x7fda74150e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:21:35.507 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:35.503+0000 7fda78d9b700 1 --2- 172.21.15.50:0/78107962 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fda740b2660 0x7fda741696b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:21:35.507 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:35.504+0000 7fda7959c700 1 -- 172.21.15.50:0/78107962 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fda740b2a30 msgr2=0x7fda74150e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:21:35.507 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:35.504+0000 7fda7959c700 1 --2- 172.21.15.50:0/78107962 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fda740b2a30 0x7fda74150e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:21:35.507 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:35.504+0000 7fda7959c700 1 -- 172.21.15.50:0/78107962 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fda740b2660 msgr2=0x7fda741696b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:21:35.507 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:35.504+0000 7fda7959c700 1 --2- 172.21.15.50:0/78107962 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fda740b2660 0x7fda741696b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:21:35.507 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:35.504+0000 7fda7959c700 1 -- 172.21.15.50:0/78107962 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda60009420 con 0x7fda740cd400 2023-10-06T01:21:35.507 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:35.504+0000 7fda73fff700 1 --2- 172.21.15.50:0/78107962 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fda740b2a30 0x7fda74150e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T01:21:35.507 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:35.504+0000 7fda7959c700 1 --2- 172.21.15.50:0/78107962 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fda740cd400 0x7fda740b5360 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fda6c001460 tx=0x7fda6c001ac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:21:35.507 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:35.504+0000 7fda70ff9700 1 -- 172.21.15.50:0/78107962 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda6c00ce80 con 0x7fda740cd400 2023-10-06T01:21:35.507 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:35.504+0000 7fda70ff9700 1 -- 172.21.15.50:0/78107962 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda6c00ab70 con 0x7fda740cd400 2023-10-06T01:21:35.507 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:35.504+0000 7fda70ff9700 1 -- 172.21.15.50:0/78107962 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda6c0070f0 con 0x7fda740cd400 2023-10-06T01:21:35.507 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:35.504+0000 7fda79d9d700 1 -- 172.21.15.50:0/78107962 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fda7416a250 con 0x7fda740cd400 2023-10-06T01:21:35.508 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:35.504+0000 7fda79d9d700 1 -- 172.21.15.50:0/78107962 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fda7415c8b0 con 0x7fda740cd400 2023-10-06T01:21:35.508 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:35.505+0000 7fda79d9d700 1 -- 172.21.15.50:0/78107962 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fda7415a830 con 0x7fda740cd400 2023-10-06T01:21:35.508 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:35.507+0000 7fda70ff9700 1 -- 172.21.15.50:0/78107962 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fda6c0074a0 con 0x7fda740cd400 2023-10-06T01:21:35.508 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:35.507+0000 7fda70ff9700 1 --2- 172.21.15.50:0/78107962 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7fda58066f30 0x7fda580693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:21:35.509 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:35.507+0000 7fda70ff9700 1 -- 172.21.15.50:0/78107962 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 5576+0+0 (secure 0 0 0) 0x7fda6c0854c0 con 0x7fda740cd400 2023-10-06T01:21:35.509 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:35.508+0000 7fda78d9b700 1 --2- 172.21.15.50:0/78107962 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7fda58066f30 0x7fda580693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:21:35.509 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:35.509+0000 7fda78d9b700 1 --2- 172.21.15.50:0/78107962 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7fda58066f30 0x7fda580693e0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fda68003820 tx=0x7fda68009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:21:35.512 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:35.511+0000 7fda70ff9700 1 -- 172.21.15.50:0/78107962 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fda6c052810 con 0x7fda740cd400 2023-10-06T01:21:35.715 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:35.714+0000 7fda79d9d700 1 -- 172.21.15.50:0/78107962 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05} v 0) v1 -- 0x7fda7405f270 con 0x7fda740cd400 2023-10-06T01:21:36.278 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:36.276+0000 7fda70ff9700 1 -- 172.21.15.50:0/78107962 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]=0 pool 'cephfs_data' created v19) v1 ==== 171+0+0 (secure 0 0 0) 0x7fda6c055e30 con 0x7fda740cd400 2023-10-06T01:21:36.294 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:36.286+0000 7fda79d9d700 1 -- 172.21.15.50:0/78107962 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7fda58066f30 msgr2=0x7fda580693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:21:36.295 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:36.286+0000 7fda79d9d700 1 --2- 172.21.15.50:0/78107962 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7fda58066f30 0x7fda580693e0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fda68003820 tx=0x7fda68009040 comp rx=0 tx=0).stop 2023-10-06T01:21:36.295 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:36.286+0000 7fda79d9d700 1 -- 172.21.15.50:0/78107962 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fda740cd400 msgr2=0x7fda740b5360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:21:36.295 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:36.286+0000 7fda79d9d700 1 --2- 172.21.15.50:0/78107962 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fda740cd400 0x7fda740b5360 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fda6c001460 tx=0x7fda6c001ac0 comp rx=0 tx=0).stop 2023-10-06T01:21:36.295 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:36.286+0000 7fda79d9d700 1 -- 172.21.15.50:0/78107962 shutdown_connections 2023-10-06T01:21:36.295 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:36.286+0000 7fda79d9d700 1 --2- 172.21.15.50:0/78107962 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fda740cd400 0x7fda740b5360 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:21:36.295 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:36.286+0000 7fda79d9d700 1 --2- 172.21.15.50:0/78107962 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7fda58066f30 0x7fda580693e0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:21:36.295 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:36.286+0000 7fda79d9d700 1 --2- 172.21.15.50:0/78107962 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fda740b2660 0x7fda741696b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:21:36.295 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:36.286+0000 7fda79d9d700 1 --2- 172.21.15.50:0/78107962 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fda740b2a30 0x7fda74150e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:21:36.295 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:36.286+0000 7fda79d9d700 1 -- 172.21.15.50:0/78107962 >> 172.21.15.50:0/78107962 conn(0x7fda74099560 msgr2=0x7fda74068dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:21:36.295 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:36.288+0000 7fda79d9d700 1 -- 172.21.15.50:0/78107962 shutdown_connections 2023-10-06T01:21:36.295 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:36.288+0000 7fda79d9d700 1 -- 172.21.15.50:0/78107962 wait complete. 2023-10-06T01:21:36.299 INFO:teuthology.orchestra.run.smithi050.stderr:pool 'cephfs_data' created 2023-10-06T01:21:36.324 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-10-06T01:21:36.515 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:36.514+0000 7ff12299d700 1 Processor -- start 2023-10-06T01:21:36.516 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:36.515+0000 7ff12299d700 1 -- start start 2023-10-06T01:21:36.517 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:36.516+0000 7ff12299d700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff11c13c470 0x7ff11c0ca990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:21:36.517 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:36.516+0000 7ff12299d700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7ff11c15a250 0x7ff11c0c8730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:21:36.517 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:36.516+0000 7ff12299d700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff11c0cb340 con 0x7ff11c0caed0 2023-10-06T01:21:36.517 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:36.516+0000 7ff12299d700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff11c15a6d0 con 0x7ff11c15a250 2023-10-06T01:21:36.517 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:36.516+0000 7ff12299d700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff11c06d470 con 0x7ff11c13c470 2023-10-06T01:21:36.517 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:36.516+0000 7ff12219c700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7ff11c15a250 0x7ff11c0c8730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:21:36.518 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:36.516+0000 7ff12219c700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7ff11c15a250 0x7ff11c0c8730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:42088/0 (socket says 172.21.15.50:42088) 2023-10-06T01:21:36.518 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:36.516+0000 7ff12219c700 1 -- 172.21.15.50:0/2468197390 learned_addr learned my addr 172.21.15.50:0/2468197390 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-06T01:21:36.518 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:36.516+0000 7ff12199b700 1 --2- 172.21.15.50:0/2468197390 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff11c13c470 0x7ff11c0ca990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:21:36.519 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:36.517+0000 7ff12219c700 1 -- 172.21.15.50:0/2468197390 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff11c13c470 msgr2=0x7ff11c0ca990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:21:36.519 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:36.517+0000 7ff12219c700 1 --2- 172.21.15.50:0/2468197390 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff11c13c470 0x7ff11c0ca990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:21:36.519 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:36.517+0000 7ff12219c700 1 -- 172.21.15.50:0/2468197390 >> v1:172.21.15.155:6789/0 conn(0x7ff11c0caed0 legacy=0x7ff11c159b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:21:36.520 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:36.517+0000 7ff12219c700 1 -- 172.21.15.50:0/2468197390 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff11c06cb80 con 0x7ff11c15a250 2023-10-06T01:21:36.520 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:36.517+0000 7ff12219c700 1 --2- 172.21.15.50:0/2468197390 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff11c15a250 0x7ff11c0c8730 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7ff114009f20 tx=0x7ff114009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=135c837ff008d883 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:21:36.520 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:36.517+0000 7ff120999700 1 -- 172.21.15.50:0/2468197390 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff11400e070 con 0x7ff11c15a250 2023-10-06T01:21:36.520 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:36.517+0000 7ff120999700 1 -- 172.21.15.50:0/2468197390 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff11400b9d0 con 0x7ff11c15a250 2023-10-06T01:21:36.520 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:36.517+0000 7ff120999700 1 -- 172.21.15.50:0/2468197390 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1140092e0 con 0x7ff11c15a250 2023-10-06T01:21:36.520 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:36.518+0000 7ff12299d700 1 -- 172.21.15.50:0/2468197390 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff11c15a250 msgr2=0x7ff11c0c8730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:21:36.520 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:36.518+0000 7ff12299d700 1 --2- 172.21.15.50:0/2468197390 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff11c15a250 0x7ff11c0c8730 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7ff114009f20 tx=0x7ff114009840 comp rx=0 tx=0).stop 2023-10-06T01:21:36.520 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:36.518+0000 7ff12299d700 1 -- 172.21.15.50:0/2468197390 shutdown_connections 2023-10-06T01:21:36.520 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:36.518+0000 7ff12299d700 1 --2- 172.21.15.50:0/2468197390 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff11c15a250 0x7ff11c0c8730 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:21:36.520 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:36.518+0000 7ff12299d700 1 --2- 172.21.15.50:0/2468197390 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff11c13c470 0x7ff11c0ca990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:21:36.520 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:36.518+0000 7ff12299d700 1 -- 172.21.15.50:0/2468197390 >> 172.21.15.50:0/2468197390 conn(0x7ff11c06b370 msgr2=0x7ff11c06b770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:21:36.520 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:36.518+0000 7ff12299d700 1 -- 172.21.15.50:0/2468197390 shutdown_connections 2023-10-06T01:21:36.521 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:36.518+0000 7ff12299d700 1 -- 172.21.15.50:0/2468197390 wait complete. 2023-10-06T01:21:36.522 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:36.519+0000 7ff12299d700 1 Processor -- start 2023-10-06T01:21:36.523 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:36.519+0000 7ff12299d700 1 -- start start 2023-10-06T01:21:36.523 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:36.520+0000 7ff12299d700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff11c0caed0 0x7ff11c0b2060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:21:36.523 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:36.520+0000 7ff12299d700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff11c13c470 0x7ff11c155e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:21:36.523 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:36.520+0000 7ff12299d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff11c15a250 0x7ff11c156390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:21:36.523 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:36.520+0000 7ff12299d700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff11c1568d0 con 0x7ff11c15a250 2023-10-06T01:21:36.523 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:36.520+0000 7ff12299d700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff11c0b1bd0 con 0x7ff11c0caed0 2023-10-06T01:21:36.523 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:36.520+0000 7ff12299d700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff11c0b0fc0 con 0x7ff11c13c470 2023-10-06T01:21:36.523 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:36.521+0000 7ff12219c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff11c15a250 0x7ff11c156390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:21:36.523 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:36.521+0000 7ff12219c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff11c15a250 0x7ff11c156390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:42102/0 (socket says 172.21.15.50:42102) 2023-10-06T01:21:36.523 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:36.521+0000 7ff12219c700 1 -- 172.21.15.50:0/1718484156 learned_addr learned my addr 172.21.15.50:0/1718484156 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-06T01:21:36.523 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:36.521+0000 7ff12219c700 1 -- 172.21.15.50:0/1718484156 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff11c13c470 msgr2=0x7ff11c155e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:21:36.524 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:36.521+0000 7ff12199b700 1 --2- 172.21.15.50:0/1718484156 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff11c0caed0 0x7ff11c0b2060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:21:36.524 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:36.521+0000 7ff12119a700 1 --2- 172.21.15.50:0/1718484156 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff11c13c470 0x7ff11c155e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:21:36.524 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:36.521+0000 7ff12219c700 1 --2- 172.21.15.50:0/1718484156 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff11c13c470 0x7ff11c155e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:21:36.524 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:36.521+0000 7ff12219c700 1 -- 172.21.15.50:0/1718484156 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff11c0caed0 msgr2=0x7ff11c0b2060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:21:36.524 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:36.521+0000 7ff12219c700 1 --2- 172.21.15.50:0/1718484156 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff11c0caed0 0x7ff11c0b2060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:21:36.524 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:36.521+0000 7ff12219c700 1 -- 172.21.15.50:0/1718484156 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff114009ae0 con 0x7ff11c15a250 2023-10-06T01:21:36.524 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:36.521+0000 7ff12219c700 1 --2- 172.21.15.50:0/1718484156 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff11c15a250 0x7ff11c156390 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7ff11c071320 tx=0x7ff114018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:21:36.524 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:36.522+0000 7ff111ffb700 1 -- 172.21.15.50:0/1718484156 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff114008c70 con 0x7ff11c15a250 2023-10-06T01:21:36.524 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:36.522+0000 7ff111ffb700 1 -- 172.21.15.50:0/1718484156 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff114008e10 con 0x7ff11c15a250 2023-10-06T01:21:36.524 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:36.522+0000 7ff111ffb700 1 -- 172.21.15.50:0/1718484156 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1140256b0 con 0x7ff11c15a250 2023-10-06T01:21:36.524 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:36.522+0000 7ff12299d700 1 -- 172.21.15.50:0/1718484156 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff11c0b12a0 con 0x7ff11c15a250 2023-10-06T01:21:36.524 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:36.522+0000 7ff12299d700 1 -- 172.21.15.50:0/1718484156 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff11c0b1860 con 0x7ff11c15a250 2023-10-06T01:21:36.525 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:36.523+0000 7ff12299d700 1 -- 172.21.15.50:0/1718484156 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff11c0b1d60 con 0x7ff11c15a250 2023-10-06T01:21:36.525 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:36.524+0000 7ff111ffb700 1 -- 172.21.15.50:0/1718484156 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7ff114003040 con 0x7ff11c15a250 2023-10-06T01:21:36.525 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:36.524+0000 7ff111ffb700 1 --2- 172.21.15.50:0/1718484156 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7ff100066f30 0x7ff1000693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:21:36.525 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:36.525+0000 7ff111ffb700 1 -- 172.21.15.50:0/1718484156 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5958+0+0 (secure 0 0 0) 0x7ff114086370 con 0x7ff11c15a250 2023-10-06T01:21:36.526 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:36.525+0000 7ff12199b700 1 --2- 172.21.15.50:0/1718484156 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7ff100066f30 0x7ff1000693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:21:36.526 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:36.526+0000 7ff12199b700 1 --2- 172.21.15.50:0/1718484156 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7ff100066f30 0x7ff1000693e0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7ff1180093f0 tx=0x7ff118008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:21:36.530 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:36.529+0000 7ff111ffb700 1 -- 172.21.15.50:0/1718484156 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff114053440 con 0x7ff11c15a250 2023-10-06T01:21:36.779 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:36.778+0000 7ff12299d700 1 -- 172.21.15.50:0/1718484156 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7ff11c05f270 con 0x7ff11c15a250 2023-10-06T01:21:37.278 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:37.277+0000 7ff111ffb700 1 -- 172.21.15.50:0/1718484156 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 3 and data pool 4 v4) v1 ==== 172+0+0 (secure 0 0 0) 0x7ff114056a60 con 0x7ff11c15a250 2023-10-06T01:21:37.282 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:37.281+0000 7ff12299d700 1 -- 172.21.15.50:0/1718484156 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7ff100066f30 msgr2=0x7ff1000693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:21:37.282 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:37.281+0000 7ff12299d700 1 --2- 172.21.15.50:0/1718484156 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7ff100066f30 0x7ff1000693e0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7ff1180093f0 tx=0x7ff118008040 comp rx=0 tx=0).stop 2023-10-06T01:21:37.282 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:37.281+0000 7ff12299d700 1 -- 172.21.15.50:0/1718484156 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff11c15a250 msgr2=0x7ff11c156390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:21:37.282 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:37.281+0000 7ff12299d700 1 --2- 172.21.15.50:0/1718484156 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff11c15a250 0x7ff11c156390 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7ff11c071320 tx=0x7ff114018000 comp rx=0 tx=0).stop 2023-10-06T01:21:37.282 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:37.281+0000 7ff12299d700 1 -- 172.21.15.50:0/1718484156 shutdown_connections 2023-10-06T01:21:37.282 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:37.281+0000 7ff12299d700 1 --2- 172.21.15.50:0/1718484156 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff11c15a250 0x7ff11c156390 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:21:37.282 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:37.281+0000 7ff12299d700 1 --2- 172.21.15.50:0/1718484156 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7ff100066f30 0x7ff1000693e0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:21:37.283 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:37.281+0000 7ff12299d700 1 --2- 172.21.15.50:0/1718484156 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff11c0caed0 0x7ff11c0b2060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:21:37.283 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:37.281+0000 7ff12299d700 1 --2- 172.21.15.50:0/1718484156 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff11c13c470 0x7ff11c155e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:21:37.283 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:37.281+0000 7ff12299d700 1 -- 172.21.15.50:0/1718484156 >> 172.21.15.50:0/1718484156 conn(0x7ff11c06b370 msgr2=0x7ff11c0c93a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:21:37.283 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:37.281+0000 7ff12299d700 1 -- 172.21.15.50:0/1718484156 shutdown_connections 2023-10-06T01:21:37.283 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:37.281+0000 7ff12299d700 1 -- 172.21.15.50:0/1718484156 wait complete. 2023-10-06T01:21:37.283 INFO:teuthology.orchestra.run.smithi050.stderr:new fs with metadata pool 3 and data pool 4 2023-10-06T01:21:37.305 DEBUG:tasks.cephfs.filesystem:EC profile is ['m=2', 'k=2', 'crush-failure-domain=osd'] 2023-10-06T01:21:37.305 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd erasure-code-profile set cephfs_data_ec m=2 k=2 crush-failure-domain=osd 2023-10-06T01:21:37.500 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:37.499+0000 7f9a2099d700 1 Processor -- start 2023-10-06T01:21:37.501 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:37.499+0000 7f9a2099d700 1 -- start start 2023-10-06T01:21:37.503 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:37.501+0000 7f9a2099d700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9a1c0b0600 0x7f9a1c068700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:21:37.503 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:37.501+0000 7f9a2099d700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f9a1c0c35c0 0x7f9a1c0c3a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:21:37.504 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:37.501+0000 7f9a2099d700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9a1c159a30 con 0x7f9a1c0cc620 2023-10-06T01:21:37.504 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:37.501+0000 7f9a2099d700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9a1c0c3f80 con 0x7f9a1c0c35c0 2023-10-06T01:21:37.504 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:37.501+0000 7f9a2099d700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a1c0c93f0 con 0x7f9a1c0b0600 2023-10-06T01:21:37.504 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:37.501+0000 7f9a1bfff700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f9a1c0c35c0 0x7f9a1c0c3a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:21:37.504 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:37.501+0000 7f9a1bfff700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f9a1c0c35c0 0x7f9a1c0c3a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:42106/0 (socket says 172.21.15.50:42106) 2023-10-06T01:21:37.504 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:37.501+0000 7f9a1bfff700 1 -- 172.21.15.50:0/332166713 learned_addr learned my addr 172.21.15.50:0/332166713 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-06T01:21:37.504 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:37.501+0000 7f9a1affd700 1 --1- 172.21.15.50:0/332166713 >> v1:172.21.15.50:6789/0 conn(0x7f9a1c0cc620 0x7f9a1c0cd470 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:39012/0 (socket says 172.21.15.50:39012) 2023-10-06T01:21:37.504 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:37.501+0000 7f9a1b7fe700 1 --2- 172.21.15.50:0/332166713 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9a1c0b0600 0x7f9a1c068700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:21:37.504 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:37.501+0000 7f9a1bfff700 1 -- 172.21.15.50:0/332166713 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9a1c0b0600 msgr2=0x7f9a1c068700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:21:37.504 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:37.501+0000 7f9a1bfff700 1 --2- 172.21.15.50:0/332166713 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9a1c0b0600 0x7f9a1c068700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:21:37.504 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:37.501+0000 7f9a1bfff700 1 -- 172.21.15.50:0/332166713 >> v1:172.21.15.50:6789/0 conn(0x7f9a1c0cc620 legacy=0x7f9a1c0cd470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:21:37.505 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:37.501+0000 7f9a1bfff700 1 -- 172.21.15.50:0/332166713 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a1c0cdb80 con 0x7f9a1c0c35c0 2023-10-06T01:21:37.505 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:37.501+0000 7f9a1a7fc700 1 -- 172.21.15.50:0/332166713 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2400679358 0 0) 0x7f9a1c159a30 con 0x7f9a1c0cc620 2023-10-06T01:21:37.505 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:37.502+0000 7f9a1bfff700 1 --2- 172.21.15.50:0/332166713 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9a1c0c35c0 0x7f9a1c0c3a40 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f9a14009f20 tx=0x7f9a14009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c437e26751058088 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:21:37.505 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:37.502+0000 7f9a1a7fc700 1 -- 172.21.15.50:0/332166713 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a1400e070 con 0x7f9a1c0c35c0 2023-10-06T01:21:37.505 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:37.502+0000 7f9a1a7fc700 1 -- 172.21.15.50:0/332166713 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a1400ba80 con 0x7f9a1c0c35c0 2023-10-06T01:21:37.505 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:37.502+0000 7f9a1a7fc700 1 -- 172.21.15.50:0/332166713 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a140092e0 con 0x7f9a1c0c35c0 2023-10-06T01:21:37.505 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:37.502+0000 7f9a2099d700 1 -- 172.21.15.50:0/332166713 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9a1c0c35c0 msgr2=0x7f9a1c0c3a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:21:37.505 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:37.502+0000 7f9a2099d700 1 --2- 172.21.15.50:0/332166713 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9a1c0c35c0 0x7f9a1c0c3a40 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f9a14009f20 tx=0x7f9a14009840 comp rx=0 tx=0).stop 2023-10-06T01:21:37.505 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:37.503+0000 7f9a2099d700 1 -- 172.21.15.50:0/332166713 shutdown_connections 2023-10-06T01:21:37.505 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:37.503+0000 7f9a2099d700 1 --2- 172.21.15.50:0/332166713 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9a1c0c35c0 0x7f9a1c0c3a40 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:21:37.505 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:37.503+0000 7f9a2099d700 1 --2- 172.21.15.50:0/332166713 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9a1c0b0600 0x7f9a1c068700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:21:37.505 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:37.503+0000 7f9a2099d700 1 -- 172.21.15.50:0/332166713 >> 172.21.15.50:0/332166713 conn(0x7f9a1c097380 msgr2=0x7f9a1c067dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:21:37.506 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:37.503+0000 7f9a2099d700 1 -- 172.21.15.50:0/332166713 shutdown_connections 2023-10-06T01:21:37.506 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:37.503+0000 7f9a2099d700 1 -- 172.21.15.50:0/332166713 wait complete. 2023-10-06T01:21:37.508 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:37.504+0000 7f9a2099d700 1 Processor -- start 2023-10-06T01:21:37.508 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:37.504+0000 7f9a2099d700 1 -- start start 2023-10-06T01:21:37.508 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:37.505+0000 7f9a2099d700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9a1c0b0600 0x7f9a1c1572b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:21:37.508 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:37.505+0000 7f9a2099d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9a1c0c35c0 0x7f9a1c0c7a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:21:37.508 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:37.505+0000 7f9a2099d700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9a1c0cc620 0x7f9a1c15b610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:21:37.508 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:37.505+0000 7f9a2099d700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a1c15dfe0 con 0x7f9a1c0c35c0 2023-10-06T01:21:37.508 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:37.505+0000 7f9a2099d700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a1c1577f0 con 0x7f9a1c0cc620 2023-10-06T01:21:37.508 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:37.505+0000 7f9a2099d700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a1c15d3d0 con 0x7f9a1c0b0600 2023-10-06T01:21:37.508 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:37.505+0000 7f9a1affd700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9a1c0c35c0 0x7f9a1c0c7a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:21:37.508 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:37.505+0000 7f9a1affd700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9a1c0c35c0 0x7f9a1c0c7a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:42122/0 (socket says 172.21.15.50:42122) 2023-10-06T01:21:37.508 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:37.505+0000 7f9a1affd700 1 -- 172.21.15.50:0/3099301682 learned_addr learned my addr 172.21.15.50:0/3099301682 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-06T01:21:37.509 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:37.506+0000 7f9a1bfff700 1 --2- 172.21.15.50:0/3099301682 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9a1c0cc620 0x7f9a1c15b610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:21:37.509 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:37.506+0000 7f9a1b7fe700 1 --2- 172.21.15.50:0/3099301682 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9a1c0b0600 0x7f9a1c1572b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:21:37.509 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:37.506+0000 7f9a1affd700 1 -- 172.21.15.50:0/3099301682 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9a1c0b0600 msgr2=0x7f9a1c1572b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:21:37.509 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:37.506+0000 7f9a1affd700 1 --2- 172.21.15.50:0/3099301682 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9a1c0b0600 0x7f9a1c1572b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:21:37.509 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:37.506+0000 7f9a1affd700 1 -- 172.21.15.50:0/3099301682 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9a1c0cc620 msgr2=0x7f9a1c15b610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:21:37.509 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:37.506+0000 7f9a1affd700 1 --2- 172.21.15.50:0/3099301682 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9a1c0cc620 0x7f9a1c15b610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:21:37.509 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:37.506+0000 7f9a1affd700 1 -- 172.21.15.50:0/3099301682 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a14009ae0 con 0x7f9a1c0c35c0 2023-10-06T01:21:37.509 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:37.506+0000 7f9a1affd700 1 --2- 172.21.15.50:0/3099301682 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9a1c0c35c0 0x7f9a1c0c7a10 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f9a100011e0 tx=0x7f9a10007e10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:21:37.509 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:37.506+0000 7f9a037fe700 1 -- 172.21.15.50:0/3099301682 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a10007300 con 0x7f9a1c0c35c0 2023-10-06T01:21:37.509 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:37.506+0000 7f9a037fe700 1 -- 172.21.15.50:0/3099301682 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a10007460 con 0x7f9a1c0c35c0 2023-10-06T01:21:37.509 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:37.506+0000 7f9a2099d700 1 -- 172.21.15.50:0/3099301682 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9a1c15d6b0 con 0x7f9a1c0c35c0 2023-10-06T01:21:37.509 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:37.506+0000 7f9a037fe700 1 -- 172.21.15.50:0/3099301682 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a10004830 con 0x7f9a1c0c35c0 2023-10-06T01:21:37.510 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:37.506+0000 7f9a2099d700 1 -- 172.21.15.50:0/3099301682 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9a1c15dc70 con 0x7f9a1c0c35c0 2023-10-06T01:21:37.510 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:37.507+0000 7f9a2099d700 1 -- 172.21.15.50:0/3099301682 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9a1c05f270 con 0x7f9a1c0c35c0 2023-10-06T01:21:37.511 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:37.508+0000 7f9a037fe700 1 -- 172.21.15.50:0/3099301682 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f9a10004be0 con 0x7f9a1c0c35c0 2023-10-06T01:21:37.511 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:37.509+0000 7f9a037fe700 1 --2- 172.21.15.50:0/3099301682 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f9a08066f60 0x7f9a08069410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:21:37.511 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:37.509+0000 7f9a037fe700 1 -- 172.21.15.50:0/3099301682 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f9a10083c30 con 0x7f9a1c0c35c0 2023-10-06T01:21:37.511 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:37.509+0000 7f9a1b7fe700 1 --2- 172.21.15.50:0/3099301682 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f9a08066f60 0x7f9a08069410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:21:37.511 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:37.510+0000 7f9a1b7fe700 1 --2- 172.21.15.50:0/3099301682 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f9a08066f60 0x7f9a08069410 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f9a0c006520 tx=0x7f9a0c008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:21:37.514 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:37.513+0000 7f9a037fe700 1 -- 172.21.15.50:0/3099301682 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f9a10050d20 con 0x7f9a1c0c35c0 2023-10-06T01:21:37.728 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:37.728+0000 7f9a2099d700 1 -- 172.21.15.50:0/3099301682 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]} v 0) v1 -- 0x7f9a1c0c3080 con 0x7f9a1c0c35c0 2023-10-06T01:21:37.810 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:37.809+0000 7f9a037fe700 1 -- 172.21.15.50:0/3099301682 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]=0 v21) v1 ==== 157+0+0 (secure 0 0 0) 0x7f9a10018020 con 0x7f9a1c0c35c0 2023-10-06T01:21:37.813 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:37.812+0000 7f9a2099d700 1 -- 172.21.15.50:0/3099301682 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f9a08066f60 msgr2=0x7f9a08069410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:21:37.813 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:37.812+0000 7f9a2099d700 1 --2- 172.21.15.50:0/3099301682 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f9a08066f60 0x7f9a08069410 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f9a0c006520 tx=0x7f9a0c008040 comp rx=0 tx=0).stop 2023-10-06T01:21:37.813 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:37.812+0000 7f9a2099d700 1 -- 172.21.15.50:0/3099301682 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9a1c0c35c0 msgr2=0x7f9a1c0c7a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:21:37.813 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:37.812+0000 7f9a2099d700 1 --2- 172.21.15.50:0/3099301682 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9a1c0c35c0 0x7f9a1c0c7a10 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f9a100011e0 tx=0x7f9a10007e10 comp rx=0 tx=0).stop 2023-10-06T01:21:37.813 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:37.812+0000 7f9a2099d700 1 -- 172.21.15.50:0/3099301682 shutdown_connections 2023-10-06T01:21:37.813 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:37.812+0000 7f9a2099d700 1 --2- 172.21.15.50:0/3099301682 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f9a08066f60 0x7f9a08069410 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:21:37.814 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:37.812+0000 7f9a2099d700 1 --2- 172.21.15.50:0/3099301682 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9a1c0cc620 0x7f9a1c15b610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:21:37.814 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:37.812+0000 7f9a2099d700 1 --2- 172.21.15.50:0/3099301682 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9a1c0b0600 0x7f9a1c1572b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:21:37.814 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:37.812+0000 7f9a2099d700 1 --2- 172.21.15.50:0/3099301682 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9a1c0c35c0 0x7f9a1c0c7a10 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:21:37.814 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:37.812+0000 7f9a2099d700 1 -- 172.21.15.50:0/3099301682 >> 172.21.15.50:0/3099301682 conn(0x7f9a1c097380 msgr2=0x7f9a1c0ce9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:21:37.814 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:37.812+0000 7f9a2099d700 1 -- 172.21.15.50:0/3099301682 shutdown_connections 2023-10-06T01:21:37.814 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:37.812+0000 7f9a2099d700 1 -- 172.21.15.50:0/3099301682 wait complete. 2023-10-06T01:21:37.830 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data_ec erasure cephfs_data_ec --pg_num_min 64 --target_size_ratio 0.9 2023-10-06T01:21:38.027 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:38.026+0000 7f247df9d700 1 Processor -- start 2023-10-06T01:21:38.027 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:38.026+0000 7f247df9d700 1 -- start start 2023-10-06T01:21:38.029 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:38.027+0000 7f247df9d700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f24780b2660 0x7f24780cccf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:21:38.029 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:38.027+0000 7f247df9d700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f24780cf1f0 0x7f24780cd230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:21:38.029 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:38.027+0000 7f247df9d700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f24780cc9b0 con 0x7f24780b2a30 2023-10-06T01:21:38.029 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:38.027+0000 7f247df9d700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f24780cbda0 con 0x7f24780cf1f0 2023-10-06T01:21:38.029 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:38.027+0000 7f247df9d700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f24780cc080 con 0x7f24780b2660 2023-10-06T01:21:38.030 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:38.028+0000 7f247d79c700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f24780cf1f0 0x7f24780cd230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:21:38.030 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:38.028+0000 7f247d79c700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f24780cf1f0 0x7f24780cd230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:42128/0 (socket says 172.21.15.50:42128) 2023-10-06T01:21:38.030 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:38.028+0000 7f247d79c700 1 -- 172.21.15.50:0/3733267889 learned_addr learned my addr 172.21.15.50:0/3733267889 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-06T01:21:38.030 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:38.028+0000 7f247cf9b700 1 --2- 172.21.15.50:0/3733267889 >> v2:172.21.15.155:3300/0 conn(0x7f24780b2660 0x7f24780cccf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:21:38.030 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:38.028+0000 7f247d79c700 1 -- 172.21.15.50:0/3733267889 >> v2:172.21.15.155:3300/0 conn(0x7f24780b2660 msgr2=0x7f24780cccf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:21:38.030 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:38.028+0000 7f247d79c700 1 --2- 172.21.15.50:0/3733267889 >> v2:172.21.15.155:3300/0 conn(0x7f24780b2660 0x7f24780cccf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:21:38.030 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:38.028+0000 7f247d79c700 1 -- 172.21.15.50:0/3733267889 >> v1:172.21.15.155:6789/0 conn(0x7f24780b2a30 legacy=0x7f24780ceae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:21:38.030 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:38.028+0000 7f247d79c700 1 -- 172.21.15.50:0/3733267889 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24780cc360 con 0x7f24780cf1f0 2023-10-06T01:21:38.030 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:38.028+0000 7f247cf9b700 1 --2- 172.21.15.50:0/3733267889 >> v2:172.21.15.155:3300/0 conn(0x7f24780b2660 0x7f24780cccf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T01:21:38.030 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:38.028+0000 7f247d79c700 1 --2- 172.21.15.50:0/3733267889 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f24780cf1f0 0x7f24780cd230 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f2478089500 tx=0x7f2470009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f264d56faa63157 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:21:38.030 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:38.028+0000 7f24777fe700 1 -- 172.21.15.50:0/3733267889 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f247000e070 con 0x7f24780cf1f0 2023-10-06T01:21:38.031 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:38.029+0000 7f24777fe700 1 -- 172.21.15.50:0/3733267889 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f247000ba10 con 0x7f24780cf1f0 2023-10-06T01:21:38.031 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:38.029+0000 7f24777fe700 1 -- 172.21.15.50:0/3733267889 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24700092e0 con 0x7f24780cf1f0 2023-10-06T01:21:38.032 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:38.029+0000 7f247df9d700 1 -- 172.21.15.50:0/3733267889 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f24780cf1f0 msgr2=0x7f24780cd230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:21:38.032 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:38.029+0000 7f247df9d700 1 --2- 172.21.15.50:0/3733267889 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f24780cf1f0 0x7f24780cd230 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f2478089500 tx=0x7f2470009840 comp rx=0 tx=0).stop 2023-10-06T01:21:38.032 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:38.029+0000 7f247df9d700 1 -- 172.21.15.50:0/3733267889 shutdown_connections 2023-10-06T01:21:38.032 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:38.029+0000 7f247df9d700 1 --2- 172.21.15.50:0/3733267889 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f24780cf1f0 0x7f24780cd230 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:21:38.032 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:38.029+0000 7f247df9d700 1 --2- 172.21.15.50:0/3733267889 >> v2:172.21.15.155:3300/0 conn(0x7f24780b2660 0x7f24780cccf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:21:38.032 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:38.029+0000 7f247df9d700 1 -- 172.21.15.50:0/3733267889 >> 172.21.15.50:0/3733267889 conn(0x7f2478099560 msgr2=0x7f247806f500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:21:38.032 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:38.029+0000 7f247df9d700 1 -- 172.21.15.50:0/3733267889 shutdown_connections 2023-10-06T01:21:38.032 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:38.029+0000 7f247df9d700 1 -- 172.21.15.50:0/3733267889 wait complete. 2023-10-06T01:21:38.032 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:38.031+0000 7f247df9d700 1 Processor -- start 2023-10-06T01:21:38.032 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:38.031+0000 7f247df9d700 1 -- start start 2023-10-06T01:21:38.034 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:38.032+0000 7f247df9d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f24780b2660 0x7f247816cc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:21:38.034 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:38.032+0000 7f247df9d700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f24780b2a30 0x7f24780c90a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:21:38.034 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:38.032+0000 7f247df9d700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f24780cf1f0 0x7f247813e430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:21:38.034 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:38.032+0000 7f247df9d700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24780ca370 con 0x7f24780b2660 2023-10-06T01:21:38.035 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:38.032+0000 7f247df9d700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24780c8cc0 con 0x7f24780b2a30 2023-10-06T01:21:38.035 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:38.032+0000 7f247df9d700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f24780b51e0 con 0x7f24780cf1f0 2023-10-06T01:21:38.035 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:38.032+0000 7f247cf9b700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f24780b2660 0x7f247816cc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:21:38.035 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:38.032+0000 7f247cf9b700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f24780b2660 0x7f247816cc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:42144/0 (socket says 172.21.15.50:42144) 2023-10-06T01:21:38.035 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:38.032+0000 7f247cf9b700 1 -- 172.21.15.50:0/1710595282 learned_addr learned my addr 172.21.15.50:0/1710595282 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-06T01:21:38.035 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:38.032+0000 7f247d79c700 1 --2- 172.21.15.50:0/1710595282 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f24780cf1f0 0x7f247813e430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:21:38.035 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:38.032+0000 7f2477fff700 1 --2- 172.21.15.50:0/1710595282 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f24780b2a30 0x7f24780c90a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:21:38.035 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:38.032+0000 7f247cf9b700 1 -- 172.21.15.50:0/1710595282 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f24780cf1f0 msgr2=0x7f247813e430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:21:38.035 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:38.032+0000 7f247cf9b700 1 --2- 172.21.15.50:0/1710595282 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f24780cf1f0 0x7f247813e430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:21:38.035 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:38.032+0000 7f247cf9b700 1 -- 172.21.15.50:0/1710595282 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f24780b2a30 msgr2=0x7f24780c90a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:21:38.035 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:38.032+0000 7f247cf9b700 1 --2- 172.21.15.50:0/1710595282 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f24780b2a30 0x7f24780c90a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:21:38.036 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:38.032+0000 7f247cf9b700 1 -- 172.21.15.50:0/1710595282 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2470009ae0 con 0x7f24780b2660 2023-10-06T01:21:38.036 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:38.033+0000 7f247cf9b700 1 --2- 172.21.15.50:0/1710595282 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f24780b2660 0x7f247816cc20 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f246c00c880 tx=0x7f246c008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:21:38.036 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:38.033+0000 7f2474ff9700 1 -- 172.21.15.50:0/1710595282 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f246c005a00 con 0x7f24780b2660 2023-10-06T01:21:38.036 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:38.033+0000 7f2474ff9700 1 -- 172.21.15.50:0/1710595282 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f246c005b60 con 0x7f24780b2660 2023-10-06T01:21:38.036 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:38.033+0000 7f2474ff9700 1 -- 172.21.15.50:0/1710595282 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f246c011600 con 0x7f24780b2660 2023-10-06T01:21:38.036 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:38.033+0000 7f247df9d700 1 -- 172.21.15.50:0/1710595282 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f24780c7dd0 con 0x7f24780b2660 2023-10-06T01:21:38.036 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:38.033+0000 7f247df9d700 1 -- 172.21.15.50:0/1710595282 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f24780c8390 con 0x7f24780b2660 2023-10-06T01:21:38.037 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:38.034+0000 7f247df9d700 1 -- 172.21.15.50:0/1710595282 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f247805f270 con 0x7f24780b2660 2023-10-06T01:21:38.037 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:38.035+0000 7f2474ff9700 1 -- 172.21.15.50:0/1710595282 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f246c0119f0 con 0x7f24780b2660 2023-10-06T01:21:38.037 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:38.036+0000 7f2474ff9700 1 --2- 172.21.15.50:0/1710595282 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f245c066f30 0x7f245c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:21:38.037 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:38.036+0000 7f2474ff9700 1 -- 172.21.15.50:0/1710595282 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6284+0+0 (secure 0 0 0) 0x7f246c084650 con 0x7f24780b2660 2023-10-06T01:21:38.037 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:38.036+0000 7f2477fff700 1 --2- 172.21.15.50:0/1710595282 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f245c066f30 0x7f245c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:21:38.038 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:38.037+0000 7f2477fff700 1 --2- 172.21.15.50:0/1710595282 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f245c066f30 0x7f245c0693e0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f2478069390 tx=0x7f2464009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:21:38.041 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:38.040+0000 7f2474ff9700 1 -- 172.21.15.50:0/1710595282 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f246c0515e0 con 0x7f24780b2660 2023-10-06T01:21:38.242 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:38.242+0000 7f247df9d700 1 -- 172.21.15.50:0/1710595282 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f2478068280 con 0x7f24780b2660 2023-10-06T01:21:39.815 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:39.814+0000 7f2474ff9700 1 -- 172.21.15.50:0/1710595282 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data_ec' created v23) v1 ==== 228+0+0 (secure 0 0 0) 0x7f246c054c00 con 0x7f24780b2660 2023-10-06T01:21:39.825 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:39.823+0000 7f247df9d700 1 -- 172.21.15.50:0/1710595282 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f245c066f30 msgr2=0x7f245c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:21:39.825 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:39.823+0000 7f247df9d700 1 --2- 172.21.15.50:0/1710595282 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f245c066f30 0x7f245c0693e0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f2478069390 tx=0x7f2464009040 comp rx=0 tx=0).stop 2023-10-06T01:21:39.825 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:39.823+0000 7f247df9d700 1 -- 172.21.15.50:0/1710595282 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f24780b2660 msgr2=0x7f247816cc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:21:39.825 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:39.823+0000 7f247df9d700 1 --2- 172.21.15.50:0/1710595282 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f24780b2660 0x7f247816cc20 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f246c00c880 tx=0x7f246c008040 comp rx=0 tx=0).stop 2023-10-06T01:21:39.827 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:39.827+0000 7f247df9d700 1 -- 172.21.15.50:0/1710595282 shutdown_connections 2023-10-06T01:21:39.828 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:39.827+0000 7f247df9d700 1 --2- 172.21.15.50:0/1710595282 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f24780cf1f0 0x7f247813e430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:21:39.828 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:39.827+0000 7f247df9d700 1 --2- 172.21.15.50:0/1710595282 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f24780b2660 0x7f247816cc20 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:21:39.828 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:39.827+0000 7f247df9d700 1 --2- 172.21.15.50:0/1710595282 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f245c066f30 0x7f245c0693e0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:21:39.828 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:39.827+0000 7f247df9d700 1 --2- 172.21.15.50:0/1710595282 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f24780b2a30 0x7f24780c90a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:21:39.828 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:39.827+0000 7f247df9d700 1 -- 172.21.15.50:0/1710595282 >> 172.21.15.50:0/1710595282 conn(0x7f2478099560 msgr2=0x7f24780cde40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:21:39.829 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:39.828+0000 7f247df9d700 1 -- 172.21.15.50:0/1710595282 shutdown_connections 2023-10-06T01:21:39.829 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:39.829+0000 7f247df9d700 1 -- 172.21.15.50:0/1710595282 wait complete. 2023-10-06T01:21:39.832 INFO:teuthology.orchestra.run.smithi050.stderr:pool 'cephfs_data_ec' created 2023-10-06T01:21:39.852 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool set cephfs_data_ec allow_ec_overwrites true 2023-10-06T01:21:40.047 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:40.046+0000 7fa3f9b9d700 1 Processor -- start 2023-10-06T01:21:40.048 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:40.047+0000 7fa3f9b9d700 1 -- start start 2023-10-06T01:21:40.049 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:40.048+0000 7fa3f9b9d700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa3f4159330 0x7fa3f406ad30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:21:40.049 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:40.048+0000 7fa3f9b9d700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fa3f415d990 0x7fa3f406b270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:21:40.049 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:40.048+0000 7fa3f9b9d700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa3f40675f0 con 0x7fa3f40c8b90 2023-10-06T01:21:40.049 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:40.048+0000 7fa3f9b9d700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa3f40c6f30 con 0x7fa3f415d990 2023-10-06T01:21:40.049 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:40.048+0000 7fa3f9b9d700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3f40c7210 con 0x7fa3f4159330 2023-10-06T01:21:40.050 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:40.048+0000 7fa3f3fff700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fa3f415d990 0x7fa3f406b270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:21:40.050 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:40.048+0000 7fa3f8b9b700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa3f4159330 0x7fa3f406ad30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:21:40.050 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:40.048+0000 7fa3f3fff700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fa3f415d990 0x7fa3f406b270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.50:34238/0 (socket says 172.21.15.50:34238) 2023-10-06T01:21:40.050 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:40.048+0000 7fa3f8b9b700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa3f4159330 0x7fa3f406ad30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3301/0 says I am v2:172.21.15.50:32946/0 (socket says 172.21.15.50:32946) 2023-10-06T01:21:40.050 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:40.048+0000 7fa3f3fff700 1 -- 172.21.15.50:0/3121169171 learned_addr learned my addr 172.21.15.50:0/3121169171 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-06T01:21:40.050 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:40.048+0000 7fa3f939c700 1 --1- 172.21.15.50:0/3121169171 >> v1:172.21.15.155:6789/0 conn(0x7fa3f40c8b90 0x7fa3f4069b10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.155:6789/0 says I am v1:172.21.15.50:47170/0 (socket says 172.21.15.50:47170) 2023-10-06T01:21:40.051 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:40.049+0000 7fa3f8b9b700 1 -- 172.21.15.50:0/3121169171 >> v2:172.21.15.155:3300/0 conn(0x7fa3f415d990 msgr2=0x7fa3f406b270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:21:40.052 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:40.049+0000 7fa3f8b9b700 1 --2- 172.21.15.50:0/3121169171 >> v2:172.21.15.155:3300/0 conn(0x7fa3f415d990 0x7fa3f406b270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:21:40.052 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:40.049+0000 7fa3f8b9b700 1 -- 172.21.15.50:0/3121169171 >> v1:172.21.15.155:6789/0 conn(0x7fa3f40c8b90 legacy=0x7fa3f4069b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:21:40.052 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:40.049+0000 7fa3f8b9b700 1 -- 172.21.15.50:0/3121169171 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3f40c74f0 con 0x7fa3f4159330 2023-10-06T01:21:40.052 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:40.049+0000 7fa3f3fff700 1 --2- 172.21.15.50:0/3121169171 >> v2:172.21.15.155:3300/0 conn(0x7fa3f415d990 0x7fa3f406b270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T01:21:40.052 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:40.049+0000 7fa3f8b9b700 1 --2- 172.21.15.50:0/3121169171 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa3f4159330 0x7fa3f406ad30 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fa3e80098e0 tx=0x7fa3e80091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1c5a1ac24dbda275 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:21:40.052 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:40.049+0000 7fa3f37fe700 1 -- 172.21.15.50:0/3121169171 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3e800b640 con 0x7fa3f4159330 2023-10-06T01:21:40.052 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:40.049+0000 7fa3f37fe700 1 -- 172.21.15.50:0/3121169171 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa3e800b7a0 con 0x7fa3f4159330 2023-10-06T01:21:40.052 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:40.049+0000 7fa3f37fe700 1 -- 172.21.15.50:0/3121169171 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3e800bb40 con 0x7fa3f4159330 2023-10-06T01:21:40.052 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:40.050+0000 7fa3f9b9d700 1 -- 172.21.15.50:0/3121169171 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa3f4159330 msgr2=0x7fa3f406ad30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:21:40.052 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:40.050+0000 7fa3f9b9d700 1 --2- 172.21.15.50:0/3121169171 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa3f4159330 0x7fa3f406ad30 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fa3e80098e0 tx=0x7fa3e80091a0 comp rx=0 tx=0).stop 2023-10-06T01:21:40.052 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:40.050+0000 7fa3f9b9d700 1 -- 172.21.15.50:0/3121169171 shutdown_connections 2023-10-06T01:21:40.053 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:40.050+0000 7fa3f9b9d700 1 --2- 172.21.15.50:0/3121169171 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa3f4159330 0x7fa3f406ad30 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:21:40.053 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:40.050+0000 7fa3f9b9d700 1 --2- 172.21.15.50:0/3121169171 >> v2:172.21.15.155:3300/0 conn(0x7fa3f415d990 0x7fa3f406b270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:21:40.053 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:40.050+0000 7fa3f9b9d700 1 -- 172.21.15.50:0/3121169171 >> 172.21.15.50:0/3121169171 conn(0x7fa3f40cd220 msgr2=0x7fa3f40c91c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:21:40.053 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:40.050+0000 7fa3f9b9d700 1 -- 172.21.15.50:0/3121169171 shutdown_connections 2023-10-06T01:21:40.053 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:40.050+0000 7fa3f9b9d700 1 -- 172.21.15.50:0/3121169171 wait complete. 2023-10-06T01:21:40.055 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:40.051+0000 7fa3f9b9d700 1 Processor -- start 2023-10-06T01:21:40.055 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:40.052+0000 7fa3f9b9d700 1 -- start start 2023-10-06T01:21:40.055 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:40.052+0000 7fa3f9b9d700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa3f40c8b90 0x7fa3f40c4150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:21:40.055 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:40.052+0000 7fa3f9b9d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa3f4159330 0x7fa3f40c2970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:21:40.055 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:40.052+0000 7fa3f9b9d700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa3f415d990 0x7fa3f40c5be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:21:40.055 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:40.052+0000 7fa3f9b9d700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3f415b390 con 0x7fa3f4159330 2023-10-06T01:21:40.055 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:40.052+0000 7fa3f9b9d700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3f40c4690 con 0x7fa3f40c8b90 2023-10-06T01:21:40.055 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:40.052+0000 7fa3f9b9d700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3f415b5e0 con 0x7fa3f415d990 2023-10-06T01:21:40.056 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:40.053+0000 7fa3f3fff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa3f4159330 0x7fa3f40c2970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:21:40.056 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:40.053+0000 7fa3f3fff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa3f4159330 0x7fa3f40c2970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:42160/0 (socket says 172.21.15.50:42160) 2023-10-06T01:21:40.056 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:40.053+0000 7fa3f3fff700 1 -- 172.21.15.50:0/1218587698 learned_addr learned my addr 172.21.15.50:0/1218587698 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-06T01:21:40.056 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:40.053+0000 7fa3f8b9b700 1 --2- 172.21.15.50:0/1218587698 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa3f40c8b90 0x7fa3f40c4150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:21:40.056 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:40.053+0000 7fa3f939c700 1 --2- 172.21.15.50:0/1218587698 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa3f415d990 0x7fa3f40c5be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:21:40.056 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:40.053+0000 7fa3f3fff700 1 -- 172.21.15.50:0/1218587698 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa3f415d990 msgr2=0x7fa3f40c5be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:21:40.056 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:40.053+0000 7fa3f3fff700 1 --2- 172.21.15.50:0/1218587698 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa3f415d990 0x7fa3f40c5be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:21:40.056 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:40.053+0000 7fa3f3fff700 1 -- 172.21.15.50:0/1218587698 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa3f40c8b90 msgr2=0x7fa3f40c4150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:21:40.056 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:40.053+0000 7fa3f3fff700 1 --2- 172.21.15.50:0/1218587698 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa3f40c8b90 0x7fa3f40c4150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:21:40.056 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:40.053+0000 7fa3f3fff700 1 -- 172.21.15.50:0/1218587698 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3e00094f0 con 0x7fa3f4159330 2023-10-06T01:21:40.056 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:40.053+0000 7fa3f8b9b700 1 --2- 172.21.15.50:0/1218587698 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa3f40c8b90 0x7fa3f40c4150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T01:21:40.057 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:40.053+0000 7fa3f3fff700 1 --2- 172.21.15.50:0/1218587698 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa3f4159330 0x7fa3f40c2970 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fa3e000ec50 tx=0x7fa3e0009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:21:40.057 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:40.054+0000 7fa3f0ff9700 1 -- 172.21.15.50:0/1218587698 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3e000c9d0 con 0x7fa3f4159330 2023-10-06T01:21:40.057 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:40.054+0000 7fa3f0ff9700 1 -- 172.21.15.50:0/1218587698 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa3e000cb30 con 0x7fa3f4159330 2023-10-06T01:21:40.057 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:40.054+0000 7fa3f9b9d700 1 -- 172.21.15.50:0/1218587698 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa3e8009420 con 0x7fa3f4159330 2023-10-06T01:21:40.057 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:40.054+0000 7fa3f0ff9700 1 -- 172.21.15.50:0/1218587698 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3e0013470 con 0x7fa3f4159330 2023-10-06T01:21:40.057 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:40.054+0000 7fa3f9b9d700 1 -- 172.21.15.50:0/1218587698 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa3f415be80 con 0x7fa3f4159330 2023-10-06T01:21:40.058 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:40.055+0000 7fa3f9b9d700 1 -- 172.21.15.50:0/1218587698 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa3f405f270 con 0x7fa3f4159330 2023-10-06T01:21:40.058 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:40.056+0000 7fa3f0ff9700 1 -- 172.21.15.50:0/1218587698 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fa3e0013860 con 0x7fa3f4159330 2023-10-06T01:21:40.058 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:40.057+0000 7fa3f0ff9700 1 --2- 172.21.15.50:0/1218587698 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7fa3d8066f30 0x7fa3d80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:21:40.058 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:40.057+0000 7fa3f0ff9700 1 -- 172.21.15.50:0/1218587698 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6777+0+0 (secure 0 0 0) 0x7fa3e0084d80 con 0x7fa3f4159330 2023-10-06T01:21:40.058 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:40.057+0000 7fa3f8b9b700 1 --2- 172.21.15.50:0/1218587698 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7fa3d8066f30 0x7fa3d80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:21:40.058 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:40.058+0000 7fa3f8b9b700 1 --2- 172.21.15.50:0/1218587698 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7fa3d8066f30 0x7fa3d80693e0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fa3e80093f0 tx=0x7fa3e8017000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:21:40.062 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:40.061+0000 7fa3f0ff9700 1 -- 172.21.15.50:0/1218587698 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fa3e0051b20 con 0x7fa3f4159330 2023-10-06T01:21:40.264 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:40.263+0000 7fa3f9b9d700 1 -- 172.21.15.50:0/1218587698 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"} v 0) v1 -- 0x7fa3f4159700 con 0x7fa3f4159330 2023-10-06T01:21:40.818 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:40.817+0000 7fa3f0ff9700 1 -- 172.21.15.50:0/1218587698 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]=0 set pool 5 allow_ec_overwrites to true v24) v1 ==== 169+0+0 (secure 0 0 0) 0x7fa3e0055140 con 0x7fa3f4159330 2023-10-06T01:21:40.833 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:40.831+0000 7fa3f9b9d700 1 -- 172.21.15.50:0/1218587698 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7fa3d8066f30 msgr2=0x7fa3d80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:21:40.833 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:40.831+0000 7fa3f9b9d700 1 --2- 172.21.15.50:0/1218587698 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7fa3d8066f30 0x7fa3d80693e0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fa3e80093f0 tx=0x7fa3e8017000 comp rx=0 tx=0).stop 2023-10-06T01:21:40.833 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:40.831+0000 7fa3f9b9d700 1 -- 172.21.15.50:0/1218587698 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa3f4159330 msgr2=0x7fa3f40c2970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:21:40.833 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:40.831+0000 7fa3f9b9d700 1 --2- 172.21.15.50:0/1218587698 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa3f4159330 0x7fa3f40c2970 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fa3e000ec50 tx=0x7fa3e0009250 comp rx=0 tx=0).stop 2023-10-06T01:21:40.837 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:40.836+0000 7fa3f9b9d700 1 -- 172.21.15.50:0/1218587698 shutdown_connections 2023-10-06T01:21:40.837 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:40.836+0000 7fa3f9b9d700 1 --2- 172.21.15.50:0/1218587698 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa3f415d990 0x7fa3f40c5be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:21:40.837 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:40.836+0000 7fa3f9b9d700 1 --2- 172.21.15.50:0/1218587698 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7fa3d8066f30 0x7fa3d80693e0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:21:40.837 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:40.836+0000 7fa3f9b9d700 1 --2- 172.21.15.50:0/1218587698 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa3f40c8b90 0x7fa3f40c4150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:21:40.837 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:40.836+0000 7fa3f9b9d700 1 --2- 172.21.15.50:0/1218587698 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa3f4159330 0x7fa3f40c2970 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:21:40.837 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:40.836+0000 7fa3f9b9d700 1 -- 172.21.15.50:0/1218587698 >> 172.21.15.50:0/1218587698 conn(0x7fa3f40cd220 msgr2=0x7fa3f4154f60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:21:40.844 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:40.843+0000 7fa3f9b9d700 1 -- 172.21.15.50:0/1218587698 shutdown_connections 2023-10-06T01:21:40.844 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:40.843+0000 7fa3f9b9d700 1 -- 172.21.15.50:0/1218587698 wait complete. 2023-10-06T01:21:40.849 INFO:teuthology.orchestra.run.smithi050.stderr:set pool 5 allow_ec_overwrites to true 2023-10-06T01:21:40.874 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs add_data_pool cephfs cephfs_data_ec 2023-10-06T01:21:41.063 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:41.062+0000 7fef5c9fe700 1 Processor -- start 2023-10-06T01:21:41.064 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:41.062+0000 7fef5c9fe700 1 -- start start 2023-10-06T01:21:41.065 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:41.064+0000 7fef5c9fe700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fef5806e1a0 0x7fef5806e600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:21:41.065 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:41.064+0000 7fef5c9fe700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fef5806eb40 con 0x7fef58156130 2023-10-06T01:21:41.065 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:41.064+0000 7fef5c9fe700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fef580acb10 con 0x7fef58159ca0 2023-10-06T01:21:41.065 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:41.064+0000 7fef5c9fe700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef5815a120 con 0x7fef5806e1a0 2023-10-06T01:21:41.065 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:41.064+0000 7fef56d9d700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fef58156130 0x7fef580ae0f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:39028/0 (socket says 172.21.15.50:39028) 2023-10-06T01:21:41.065 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:41.064+0000 7fef56d9d700 1 -- 172.21.15.50:0/3697343570 learned_addr learned my addr 172.21.15.50:0/3697343570 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-10-06T01:21:41.065 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:41.064+0000 7fef5759e700 1 --2- 172.21.15.50:0/3697343570 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fef5806e1a0 0x7fef5806e600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:21:41.067 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:41.064+0000 7fef55d9b700 1 -- 172.21.15.50:0/3697343570 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2719042966 0 0) 0x7fef48001110 con 0x7fef58156130 2023-10-06T01:21:41.067 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:41.064+0000 7fef55d9b700 1 -- 172.21.15.50:0/3697343570 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fef40003570 con 0x7fef58156130 2023-10-06T01:21:41.067 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:41.065+0000 7fef55d9b700 1 -- 172.21.15.50:0/3697343570 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1987666915 0 0) 0x7fef580acb10 con 0x7fef58159ca0 2023-10-06T01:21:41.067 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:41.065+0000 7fef55d9b700 1 -- 172.21.15.50:0/3697343570 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fef48001110 con 0x7fef58159ca0 2023-10-06T01:21:41.067 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:41.065+0000 7fef5759e700 1 -- 172.21.15.50:0/3697343570 >> v1:172.21.15.155:6789/0 conn(0x7fef58159ca0 legacy=0x7fef580c8a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:21:41.068 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:41.065+0000 7fef5759e700 1 -- 172.21.15.50:0/3697343570 >> v1:172.21.15.50:6789/0 conn(0x7fef58156130 legacy=0x7fef580ae0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:21:41.068 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:41.065+0000 7fef5759e700 1 -- 172.21.15.50:0/3697343570 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef58156500 con 0x7fef5806e1a0 2023-10-06T01:21:41.068 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:41.065+0000 7fef5759e700 1 --2- 172.21.15.50:0/3697343570 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fef5806e1a0 0x7fef5806e600 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fef50009e90 tx=0x7fef50009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=da7c6252ce485598 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:21:41.068 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:41.065+0000 7fef55d9b700 1 -- 172.21.15.50:0/3697343570 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef5000e070 con 0x7fef5806e1a0 2023-10-06T01:21:41.068 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:41.065+0000 7fef55d9b700 1 -- 172.21.15.50:0/3697343570 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef5000bc10 con 0x7fef5806e1a0 2023-10-06T01:21:41.068 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:41.065+0000 7fef55d9b700 1 -- 172.21.15.50:0/3697343570 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef50012430 con 0x7fef5806e1a0 2023-10-06T01:21:41.068 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:41.066+0000 7fef5c9fe700 1 -- 172.21.15.50:0/3697343570 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fef5806e1a0 msgr2=0x7fef5806e600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:21:41.068 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:41.066+0000 7fef5c9fe700 1 --2- 172.21.15.50:0/3697343570 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fef5806e1a0 0x7fef5806e600 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fef50009e90 tx=0x7fef50009780 comp rx=0 tx=0).stop 2023-10-06T01:21:41.068 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:41.066+0000 7fef5c9fe700 1 -- 172.21.15.50:0/3697343570 shutdown_connections 2023-10-06T01:21:41.068 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:41.066+0000 7fef5c9fe700 1 --2- 172.21.15.50:0/3697343570 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fef5806e1a0 0x7fef5806e600 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:21:41.068 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:41.066+0000 7fef5c9fe700 1 -- 172.21.15.50:0/3697343570 >> 172.21.15.50:0/3697343570 conn(0x7fef580cbf10 msgr2=0x7fef580cc310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:21:41.068 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:41.066+0000 7fef5c9fe700 1 -- 172.21.15.50:0/3697343570 shutdown_connections 2023-10-06T01:21:41.069 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:41.066+0000 7fef5c9fe700 1 -- 172.21.15.50:0/3697343570 wait complete. 2023-10-06T01:21:41.071 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:41.067+0000 7fef5c9fe700 1 Processor -- start 2023-10-06T01:21:41.071 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:41.068+0000 7fef5c9fe700 1 -- start start 2023-10-06T01:21:41.071 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:41.068+0000 7fef5c9fe700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fef5806e1a0 0x7fef580ca790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:21:41.071 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:41.068+0000 7fef5c9fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fef58156130 0x7fef58166730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:21:41.071 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:41.068+0000 7fef5c9fe700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fef58159ca0 0x7fef580c89d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:21:41.071 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:41.069+0000 7fef5c9fe700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef580c9ac0 con 0x7fef58156130 2023-10-06T01:21:41.071 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:41.069+0000 7fef5c9fe700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef58166c70 con 0x7fef5806e1a0 2023-10-06T01:21:41.071 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:41.069+0000 7fef5c9fe700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef58156940 con 0x7fef58159ca0 2023-10-06T01:21:41.071 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:41.069+0000 7fef5659c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fef58156130 0x7fef58166730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:21:41.072 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:41.069+0000 7fef5659c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fef58156130 0x7fef58166730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:42162/0 (socket says 172.21.15.50:42162) 2023-10-06T01:21:41.072 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:41.069+0000 7fef5659c700 1 -- 172.21.15.50:0/303878728 learned_addr learned my addr 172.21.15.50:0/303878728 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-06T01:21:41.072 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:41.069+0000 7fef56d9d700 1 --2- 172.21.15.50:0/303878728 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fef5806e1a0 0x7fef580ca790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:21:41.072 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:41.069+0000 7fef5759e700 1 --2- 172.21.15.50:0/303878728 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fef58159ca0 0x7fef580c89d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:21:41.072 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:41.069+0000 7fef5659c700 1 -- 172.21.15.50:0/303878728 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fef58159ca0 msgr2=0x7fef580c89d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:21:41.072 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:41.069+0000 7fef5659c700 1 --2- 172.21.15.50:0/303878728 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fef58159ca0 0x7fef580c89d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:21:41.072 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:41.069+0000 7fef5659c700 1 -- 172.21.15.50:0/303878728 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fef5806e1a0 msgr2=0x7fef580ca790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:21:41.072 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:41.069+0000 7fef5659c700 1 --2- 172.21.15.50:0/303878728 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fef5806e1a0 0x7fef580ca790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:21:41.072 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:41.069+0000 7fef5659c700 1 -- 172.21.15.50:0/303878728 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef50009a20 con 0x7fef58156130 2023-10-06T01:21:41.072 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:41.069+0000 7fef5659c700 1 --2- 172.21.15.50:0/303878728 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fef58156130 0x7fef58166730 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fef4c00c590 tx=0x7fef4c007d90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:21:41.072 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:41.070+0000 7fef3effd700 1 -- 172.21.15.50:0/303878728 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef4c0105c0 con 0x7fef58156130 2023-10-06T01:21:41.073 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:41.070+0000 7fef3effd700 1 -- 172.21.15.50:0/303878728 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef4c010740 con 0x7fef58156130 2023-10-06T01:21:41.073 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:41.070+0000 7fef5c9fe700 1 -- 172.21.15.50:0/303878728 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fef580c9220 con 0x7fef58156130 2023-10-06T01:21:41.073 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:41.070+0000 7fef3effd700 1 -- 172.21.15.50:0/303878728 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef4c010b00 con 0x7fef58156130 2023-10-06T01:21:41.073 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:41.070+0000 7fef5c9fe700 1 -- 172.21.15.50:0/303878728 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fef580c97e0 con 0x7fef58156130 2023-10-06T01:21:41.074 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:41.071+0000 7fef5c9fe700 1 -- 172.21.15.50:0/303878728 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fef58156af0 con 0x7fef58156130 2023-10-06T01:21:41.074 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:41.072+0000 7fef3effd700 1 -- 172.21.15.50:0/303878728 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fef4c002030 con 0x7fef58156130 2023-10-06T01:21:41.074 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:41.073+0000 7fef3effd700 1 --2- 172.21.15.50:0/303878728 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7fef44066f30 0x7fef440693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:21:41.074 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:41.073+0000 7fef3effd700 1 -- 172.21.15.50:0/303878728 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6777+0+0 (secure 0 0 0) 0x7fef4c083ff0 con 0x7fef58156130 2023-10-06T01:21:41.074 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:41.073+0000 7fef56d9d700 1 --2- 172.21.15.50:0/303878728 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7fef44066f30 0x7fef440693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:21:41.074 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:41.074+0000 7fef56d9d700 1 --2- 172.21.15.50:0/303878728 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7fef44066f30 0x7fef440693e0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fef480058d0 tx=0x7fef48009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:21:41.077 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:41.077+0000 7fef3effd700 1 -- 172.21.15.50:0/303878728 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fef58156af0 con 0x7fef58156130 2023-10-06T01:21:41.329 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:41.328+0000 7fef5c9fe700 1 -- 172.21.15.50:0/303878728 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"} v 0) v1 -- 0x7fef58156ab0 con 0x7fef58156130 2023-10-06T01:21:41.787 INFO:tasks.ceph.mds.d.smithi155.stderr:2023-10-06T01:21:41.786+0000 7fd236bf1700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-06T01:21:41.840 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:41.839+0000 7fef3effd700 1 -- 172.21.15.50:0/303878728 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]=0 added data pool 5 to fsmap v7) v1 ==== 137+0+0 (secure 0 0 0) 0x7fef4c017070 con 0x7fef58156130 2023-10-06T01:21:41.842 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:41.841+0000 7fef5c9fe700 1 -- 172.21.15.50:0/303878728 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7fef44066f30 msgr2=0x7fef440693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:21:41.843 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:41.841+0000 7fef5c9fe700 1 --2- 172.21.15.50:0/303878728 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7fef44066f30 0x7fef440693e0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fef480058d0 tx=0x7fef48009040 comp rx=0 tx=0).stop 2023-10-06T01:21:41.843 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:41.841+0000 7fef5c9fe700 1 -- 172.21.15.50:0/303878728 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fef58156130 msgr2=0x7fef58166730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:21:41.843 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:41.841+0000 7fef5c9fe700 1 --2- 172.21.15.50:0/303878728 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fef58156130 0x7fef58166730 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fef4c00c590 tx=0x7fef4c007d90 comp rx=0 tx=0).stop 2023-10-06T01:21:41.843 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:41.842+0000 7fef5c9fe700 1 -- 172.21.15.50:0/303878728 shutdown_connections 2023-10-06T01:21:41.843 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:41.842+0000 7fef5c9fe700 1 --2- 172.21.15.50:0/303878728 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fef58159ca0 0x7fef580c89d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:21:41.843 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:41.842+0000 7fef5c9fe700 1 --2- 172.21.15.50:0/303878728 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7fef44066f30 0x7fef440693e0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:21:41.843 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:41.842+0000 7fef5c9fe700 1 --2- 172.21.15.50:0/303878728 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fef5806e1a0 0x7fef580ca790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:21:41.843 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:41.842+0000 7fef5c9fe700 1 --2- 172.21.15.50:0/303878728 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fef58156130 0x7fef58166730 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:21:41.843 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:41.842+0000 7fef5c9fe700 1 -- 172.21.15.50:0/303878728 >> 172.21.15.50:0/303878728 conn(0x7fef580cbf10 msgr2=0x7fef580ae0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:21:41.843 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:41.842+0000 7fef5c9fe700 1 -- 172.21.15.50:0/303878728 shutdown_connections 2023-10-06T01:21:41.844 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:41.842+0000 7fef5c9fe700 1 -- 172.21.15.50:0/303878728 wait complete. 2023-10-06T01:21:41.844 INFO:teuthology.orchestra.run.smithi050.stderr:added data pool 5 to fsmap 2023-10-06T01:21:41.862 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T01:21:42.054 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:42.053+0000 7f14801ff700 1 Processor -- start 2023-10-06T01:21:42.055 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:42.054+0000 7f14801ff700 1 -- start start 2023-10-06T01:21:42.056 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:42.055+0000 7f14801ff700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f1478159b10 0x7f1478159f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:21:42.056 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:42.055+0000 7f14801ff700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1478068d50 con 0x7f14780ca6b0 2023-10-06T01:21:42.056 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:42.055+0000 7f14801ff700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f147815a6b0 con 0x7f14780cb630 2023-10-06T01:21:42.056 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:42.055+0000 7f14801ff700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f147815a4d0 con 0x7f1478159b10 2023-10-06T01:21:42.056 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:42.055+0000 7f147d79a700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f1478159b10 0x7f1478159f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:21:42.056 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:42.055+0000 7f147d79a700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f1478159b10 0x7f1478159f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:42174/0 (socket says 172.21.15.50:42174) 2023-10-06T01:21:42.056 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:42.055+0000 7f147d79a700 1 -- 172.21.15.50:0/67035476 learned_addr learned my addr 172.21.15.50:0/67035476 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-06T01:21:42.056 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:42.055+0000 7f147e79c700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f14780ca6b0 0x7f14780ce1d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:39034/0 (socket says 172.21.15.50:39034) 2023-10-06T01:21:42.058 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:42.055+0000 7f147d79a700 1 -- 172.21.15.50:0/67035476 >> v1:172.21.15.155:6789/0 conn(0x7f14780cb630 legacy=0x7f14780691e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:21:42.058 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:42.055+0000 7f147d79a700 1 -- 172.21.15.50:0/67035476 >> v1:172.21.15.50:6789/0 conn(0x7f14780ca6b0 legacy=0x7f14780ce1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:21:42.058 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:42.055+0000 7f147d79a700 1 -- 172.21.15.50:0/67035476 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f147815a990 con 0x7f1478159b10 2023-10-06T01:21:42.058 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:42.055+0000 7f147cf99700 1 -- 172.21.15.50:0/67035476 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 286769233 0 0) 0x7f1478068d50 con 0x7f14780ca6b0 2023-10-06T01:21:42.058 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:42.056+0000 7f147d79a700 1 --2- 172.21.15.50:0/67035476 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1478159b10 0x7f1478159f90 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f14680099b0 tx=0x7f1468009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=45df6513034d3ec3 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:21:42.058 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:42.056+0000 7f147cf99700 1 -- 172.21.15.50:0/67035476 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f146800b860 con 0x7f1478159b10 2023-10-06T01:21:42.058 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:42.056+0000 7f147cf99700 1 -- 172.21.15.50:0/67035476 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f146800b9c0 con 0x7f1478159b10 2023-10-06T01:21:42.058 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:42.056+0000 7f147cf99700 1 -- 172.21.15.50:0/67035476 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f146800bd60 con 0x7f1478159b10 2023-10-06T01:21:42.059 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:42.056+0000 7f14801ff700 1 -- 172.21.15.50:0/67035476 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1478159b10 msgr2=0x7f1478159f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:21:42.059 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:42.056+0000 7f14801ff700 1 --2- 172.21.15.50:0/67035476 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1478159b10 0x7f1478159f90 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f14680099b0 tx=0x7f1468009250 comp rx=0 tx=0).stop 2023-10-06T01:21:42.059 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:42.057+0000 7f14801ff700 1 -- 172.21.15.50:0/67035476 shutdown_connections 2023-10-06T01:21:42.059 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:42.057+0000 7f14801ff700 1 --2- 172.21.15.50:0/67035476 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1478159b10 0x7f1478159f90 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:21:42.059 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:42.057+0000 7f14801ff700 1 -- 172.21.15.50:0/67035476 >> 172.21.15.50:0/67035476 conn(0x7f1478070810 msgr2=0x7f1478070c10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:21:42.059 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:42.057+0000 7f14801ff700 1 -- 172.21.15.50:0/67035476 shutdown_connections 2023-10-06T01:21:42.059 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:42.057+0000 7f14801ff700 1 -- 172.21.15.50:0/67035476 wait complete. 2023-10-06T01:21:42.061 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:42.058+0000 7f14801ff700 1 Processor -- start 2023-10-06T01:21:42.061 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:42.058+0000 7f14801ff700 1 -- start start 2023-10-06T01:21:42.061 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:42.059+0000 7f14801ff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f14780ca6b0 0x7f14780c4630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:21:42.062 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:42.059+0000 7f14801ff700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f14780cb630 0x7f14780c5b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:21:42.062 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:42.059+0000 7f14801ff700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1478159b10 0x7f14780c64b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:21:42.062 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:42.059+0000 7f14801ff700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14780c7030 con 0x7f14780ca6b0 2023-10-06T01:21:42.062 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:42.059+0000 7f14801ff700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14780c41a0 con 0x7f1478159b10 2023-10-06T01:21:42.062 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:42.059+0000 7f14801ff700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14780c3870 con 0x7f14780cb630 2023-10-06T01:21:42.062 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:42.059+0000 7f147df9b700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f14780ca6b0 0x7f14780c4630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:21:42.062 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:42.059+0000 7f147df9b700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f14780ca6b0 0x7f14780c4630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:42186/0 (socket says 172.21.15.50:42186) 2023-10-06T01:21:42.062 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:42.059+0000 7f147df9b700 1 -- 172.21.15.50:0/3475934708 learned_addr learned my addr 172.21.15.50:0/3475934708 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-06T01:21:42.062 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:42.060+0000 7f147e79c700 1 --2- 172.21.15.50:0/3475934708 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1478159b10 0x7f14780c64b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:21:42.062 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:42.060+0000 7f147d79a700 1 --2- 172.21.15.50:0/3475934708 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f14780cb630 0x7f14780c5b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:21:42.062 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:42.060+0000 7f147df9b700 1 -- 172.21.15.50:0/3475934708 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f14780cb630 msgr2=0x7f14780c5b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:21:42.063 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:42.060+0000 7f147df9b700 1 --2- 172.21.15.50:0/3475934708 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f14780cb630 0x7f14780c5b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:21:42.063 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:42.060+0000 7f147df9b700 1 -- 172.21.15.50:0/3475934708 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1478159b10 msgr2=0x7f14780c64b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:21:42.063 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:42.060+0000 7f147df9b700 1 --2- 172.21.15.50:0/3475934708 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1478159b10 0x7f14780c64b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:21:42.063 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:42.060+0000 7f147df9b700 1 -- 172.21.15.50:0/3475934708 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14680094f0 con 0x7f14780ca6b0 2023-10-06T01:21:42.063 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:42.060+0000 7f147df9b700 1 --2- 172.21.15.50:0/3475934708 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f14780ca6b0 0x7f14780c4630 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f147400c590 tx=0x7f147400c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:21:42.063 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:42.060+0000 7f146dffb700 1 -- 172.21.15.50:0/3475934708 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1474011590 con 0x7f14780ca6b0 2023-10-06T01:21:42.063 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:42.060+0000 7f146dffb700 1 -- 172.21.15.50:0/3475934708 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f14740116f0 con 0x7f14780ca6b0 2023-10-06T01:21:42.063 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:42.060+0000 7f146dffb700 1 -- 172.21.15.50:0/3475934708 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1474011ab0 con 0x7f14780ca6b0 2023-10-06T01:21:42.063 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:42.060+0000 7f14801ff700 1 -- 172.21.15.50:0/3475934708 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f14780c3b50 con 0x7f14780ca6b0 2023-10-06T01:21:42.063 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:42.060+0000 7f14801ff700 1 -- 172.21.15.50:0/3475934708 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f14780c4b70 con 0x7f14780ca6b0 2023-10-06T01:21:42.064 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:42.061+0000 7f14801ff700 1 -- 172.21.15.50:0/3475934708 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f14780c4480 con 0x7f14780ca6b0 2023-10-06T01:21:42.064 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:42.062+0000 7f146dffb700 1 -- 172.21.15.50:0/3475934708 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f147401b3b0 con 0x7f14780ca6b0 2023-10-06T01:21:42.064 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:42.063+0000 7f146dffb700 1 --2- 172.21.15.50:0/3475934708 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f145c066f30 0x7f145c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:21:42.064 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:42.063+0000 7f146dffb700 1 -- 172.21.15.50:0/3475934708 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f1474083f60 con 0x7f14780ca6b0 2023-10-06T01:21:42.065 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:42.063+0000 7f147d79a700 1 --2- 172.21.15.50:0/3475934708 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f145c066f30 0x7f145c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:21:42.065 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:42.064+0000 7f147d79a700 1 --2- 172.21.15.50:0/3475934708 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f145c066f30 0x7f145c0693e0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f14680099b0 tx=0x7f1468017000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:21:42.068 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:42.067+0000 7f146dffb700 1 -- 172.21.15.50:0/3475934708 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f1474050ce0 con 0x7f14780ca6b0 2023-10-06T01:21:42.316 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:42.315+0000 7f14801ff700 1 -- 172.21.15.50:0/3475934708 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f1478064ad0 con 0x7f14780ca6b0 2023-10-06T01:21:42.317 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:42.316+0000 7f146dffb700 1 -- 172.21.15.50:0/3475934708 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+4593 (secure 0 0 0) 0x7f1474017020 con 0x7f14780ca6b0 2023-10-06T01:21:42.317 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-10-06T01:21:42.317 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4214,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6835/33654067","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6833","nonce":33654067},{"type":"v1","addr":"172.21.15.50:6835","nonce":33654067}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4279,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6836/2571345069","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":2571345069},{"type":"v1","addr":"172.21.15.155:6836","nonce":2571345069}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4290,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6834/4140731341","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6832","nonce":4140731341},{"type":"v1","addr":"172.21.15.50:6834","nonce":4140731341}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T01:21:36.779774+0000","modified":"2023-10-06T01:21:41.833429+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4302},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4302":{"gid":4302,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.155:6837/3434423585","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6835","nonce":3434423585},{"type":"v1","addr":"172.21.15.155:6837","nonce":3434423585}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":1},"id":1}]} 2023-10-06T01:21:42.320 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:42.318+0000 7f14801ff700 1 -- 172.21.15.50:0/3475934708 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f145c066f30 msgr2=0x7f145c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:21:42.320 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:42.318+0000 7f14801ff700 1 --2- 172.21.15.50:0/3475934708 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f145c066f30 0x7f145c0693e0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f14680099b0 tx=0x7f1468017000 comp rx=0 tx=0).stop 2023-10-06T01:21:42.320 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:42.318+0000 7f14801ff700 1 -- 172.21.15.50:0/3475934708 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f14780ca6b0 msgr2=0x7f14780c4630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:21:42.320 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:42.318+0000 7f14801ff700 1 --2- 172.21.15.50:0/3475934708 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f14780ca6b0 0x7f14780c4630 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f147400c590 tx=0x7f147400c950 comp rx=0 tx=0).stop 2023-10-06T01:21:42.320 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:42.318+0000 7f14801ff700 1 -- 172.21.15.50:0/3475934708 shutdown_connections 2023-10-06T01:21:42.320 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:42.318+0000 7f14801ff700 1 --2- 172.21.15.50:0/3475934708 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f145c066f30 0x7f145c0693e0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:21:42.320 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:42.318+0000 7f14801ff700 1 --2- 172.21.15.50:0/3475934708 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1478159b10 0x7f14780c64b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:21:42.320 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:42.318+0000 7f14801ff700 1 --2- 172.21.15.50:0/3475934708 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f14780ca6b0 0x7f14780c4630 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:21:42.320 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:42.318+0000 7f14801ff700 1 --2- 172.21.15.50:0/3475934708 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f14780cb630 0x7f14780c5b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:21:42.320 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:42.318+0000 7f14801ff700 1 -- 172.21.15.50:0/3475934708 >> 172.21.15.50:0/3475934708 conn(0x7f1478070810 msgr2=0x7f1478069fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:21:42.321 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:42.319+0000 7f14801ff700 1 -- 172.21.15.50:0/3475934708 shutdown_connections 2023-10-06T01:21:42.321 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:42.319+0000 7f14801ff700 1 -- 172.21.15.50:0/3475934708 wait complete. 2023-10-06T01:21:42.321 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 7 2023-10-06T01:21:42.337 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T01:21:42.523 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:42.521+0000 7f7c2cd9d700 1 Processor -- start 2023-10-06T01:21:42.523 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:42.522+0000 7f7c2cd9d700 1 -- start start 2023-10-06T01:21:42.524 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:42.523+0000 7f7c2cd9d700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7c28159480 0x7f7c280b30d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:21:42.524 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:42.523+0000 7f7c2cd9d700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7c280cb7e0 con 0x7f7c280b3610 2023-10-06T01:21:42.524 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:42.523+0000 7f7c2cd9d700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7c280b08a0 con 0x7f7c280b2140 2023-10-06T01:21:42.524 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:42.523+0000 7f7c2cd9d700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c280cb190 con 0x7f7c28159480 2023-10-06T01:21:42.524 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:42.523+0000 7f7c26ffd700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f7c280b3610 0x7f7c280cbc70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:39048/0 (socket says 172.21.15.50:39048) 2023-10-06T01:21:42.524 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:42.523+0000 7f7c26ffd700 1 -- 172.21.15.50:0/61119149 learned_addr learned my addr 172.21.15.50:0/61119149 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-10-06T01:21:42.524 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:42.523+0000 7f7c277fe700 1 --2- 172.21.15.50:0/61119149 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7c28159480 0x7f7c280b30d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:21:42.526 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:42.524+0000 7f7c267fc700 1 -- 172.21.15.50:0/61119149 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2419297801 0 0) 0x7f7c280cb7e0 con 0x7f7c280b3610 2023-10-06T01:21:42.526 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:42.524+0000 7f7c267fc700 1 -- 172.21.15.50:0/61119149 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7c10003570 con 0x7f7c280b3610 2023-10-06T01:21:42.526 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:42.524+0000 7f7c267fc700 1 -- 172.21.15.50:0/61119149 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3731250181 0 0) 0x7f7c280b08a0 con 0x7f7c280b2140 2023-10-06T01:21:42.526 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:42.524+0000 7f7c267fc700 1 -- 172.21.15.50:0/61119149 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7c280cb7e0 con 0x7f7c280b2140 2023-10-06T01:21:42.526 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:42.524+0000 7f7c277fe700 1 -- 172.21.15.50:0/61119149 >> v1:172.21.15.155:6789/0 conn(0x7f7c280b2140 legacy=0x7f7c280b25c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:21:42.526 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:42.524+0000 7f7c277fe700 1 -- 172.21.15.50:0/61119149 >> v1:172.21.15.50:6789/0 conn(0x7f7c280b3610 legacy=0x7f7c280cbc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:21:42.527 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:42.524+0000 7f7c277fe700 1 -- 172.21.15.50:0/61119149 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c280cb470 con 0x7f7c28159480 2023-10-06T01:21:42.527 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:42.524+0000 7f7c277fe700 1 --2- 172.21.15.50:0/61119149 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7c28159480 0x7f7c280b30d0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f7c18009910 tx=0x7f7c180091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ade609c47b811fde server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:21:42.527 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:42.524+0000 7f7c267fc700 1 -- 172.21.15.50:0/61119149 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c18011630 con 0x7f7c28159480 2023-10-06T01:21:42.527 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:42.524+0000 7f7c267fc700 1 -- 172.21.15.50:0/61119149 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c18011790 con 0x7f7c28159480 2023-10-06T01:21:42.527 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:42.524+0000 7f7c267fc700 1 -- 172.21.15.50:0/61119149 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c18011b30 con 0x7f7c28159480 2023-10-06T01:21:42.527 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:42.525+0000 7f7c2cd9d700 1 -- 172.21.15.50:0/61119149 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7c28159480 msgr2=0x7f7c280b30d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:21:42.527 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:42.525+0000 7f7c2cd9d700 1 --2- 172.21.15.50:0/61119149 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7c28159480 0x7f7c280b30d0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f7c18009910 tx=0x7f7c180091a0 comp rx=0 tx=0).stop 2023-10-06T01:21:42.527 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:42.525+0000 7f7c2cd9d700 1 -- 172.21.15.50:0/61119149 shutdown_connections 2023-10-06T01:21:42.527 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:42.525+0000 7f7c2cd9d700 1 --2- 172.21.15.50:0/61119149 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7c28159480 0x7f7c280b30d0 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:21:42.527 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:42.525+0000 7f7c2cd9d700 1 -- 172.21.15.50:0/61119149 >> 172.21.15.50:0/61119149 conn(0x7f7c2806ed20 msgr2=0x7f7c2806f120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:21:42.527 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:42.525+0000 7f7c2cd9d700 1 -- 172.21.15.50:0/61119149 shutdown_connections 2023-10-06T01:21:42.528 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:42.525+0000 7f7c2cd9d700 1 -- 172.21.15.50:0/61119149 wait complete. 2023-10-06T01:21:42.529 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:42.527+0000 7f7c2cd9d700 1 Processor -- start 2023-10-06T01:21:42.529 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:42.527+0000 7f7c2cd9d700 1 -- start start 2023-10-06T01:21:42.529 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:42.528+0000 7f7c2cd9d700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7c280b2140 0x7f7c280c5a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:21:42.530 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:42.528+0000 7f7c2cd9d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7c280b3610 0x7f7c280cdf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:21:42.530 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:42.528+0000 7f7c2cd9d700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7c28159480 0x7f7c280d0c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:21:42.530 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:42.528+0000 7f7c2cd9d700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c280c66a0 con 0x7f7c280b3610 2023-10-06T01:21:42.530 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:42.528+0000 7f7c2cd9d700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c2815a460 con 0x7f7c280b2140 2023-10-06T01:21:42.530 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:42.528+0000 7f7c2cd9d700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c280c60e0 con 0x7f7c28159480 2023-10-06T01:21:42.530 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:42.528+0000 7f7c26ffd700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7c280b3610 0x7f7c280cdf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:21:42.530 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:42.528+0000 7f7c26ffd700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7c280b3610 0x7f7c280cdf80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:42190/0 (socket says 172.21.15.50:42190) 2023-10-06T01:21:42.530 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:42.528+0000 7f7c26ffd700 1 -- 172.21.15.50:0/1013576513 learned_addr learned my addr 172.21.15.50:0/1013576513 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-06T01:21:42.530 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:42.528+0000 7f7c277fe700 1 --2- 172.21.15.50:0/1013576513 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7c280b2140 0x7f7c280c5a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:21:42.530 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:42.528+0000 7f7c27fff700 1 --2- 172.21.15.50:0/1013576513 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7c28159480 0x7f7c280d0c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:21:42.530 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:42.528+0000 7f7c26ffd700 1 -- 172.21.15.50:0/1013576513 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7c28159480 msgr2=0x7f7c280d0c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:21:42.531 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:42.528+0000 7f7c26ffd700 1 --2- 172.21.15.50:0/1013576513 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7c28159480 0x7f7c280d0c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:21:42.531 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:42.528+0000 7f7c26ffd700 1 -- 172.21.15.50:0/1013576513 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7c280b2140 msgr2=0x7f7c280c5a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:21:42.531 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:42.528+0000 7f7c26ffd700 1 --2- 172.21.15.50:0/1013576513 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7c280b2140 0x7f7c280c5a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:21:42.531 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:42.528+0000 7f7c26ffd700 1 -- 172.21.15.50:0/1013576513 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c18009420 con 0x7f7c280b3610 2023-10-06T01:21:42.531 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:42.529+0000 7f7c26ffd700 1 --2- 172.21.15.50:0/1013576513 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7c280b3610 0x7f7c280cdf80 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f7c1c00c790 tx=0x7f7c1c007ea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:21:42.532 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:42.529+0000 7f7c0f7fe700 1 -- 172.21.15.50:0/1013576513 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c1c005b30 con 0x7f7c280b3610 2023-10-06T01:21:42.532 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:42.529+0000 7f7c0f7fe700 1 -- 172.21.15.50:0/1013576513 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c1c005c90 con 0x7f7c280b3610 2023-10-06T01:21:42.532 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:42.529+0000 7f7c0f7fe700 1 -- 172.21.15.50:0/1013576513 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c1c007300 con 0x7f7c280b3610 2023-10-06T01:21:42.532 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:42.529+0000 7f7c2cd9d700 1 -- 172.21.15.50:0/1013576513 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7c280c63c0 con 0x7f7c280b3610 2023-10-06T01:21:42.532 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:42.529+0000 7f7c2cd9d700 1 -- 172.21.15.50:0/1013576513 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7c280d1160 con 0x7f7c280b3610 2023-10-06T01:21:42.532 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:42.530+0000 7f7c2cd9d700 1 -- 172.21.15.50:0/1013576513 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7c28159f50 con 0x7f7c280b3610 2023-10-06T01:21:42.532 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:42.531+0000 7f7c0f7fe700 1 -- 172.21.15.50:0/1013576513 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f7c1c01b3b0 con 0x7f7c280b3610 2023-10-06T01:21:42.533 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:42.532+0000 7f7c0f7fe700 1 --2- 172.21.15.50:0/1013576513 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f7c14066f30 0x7f7c140693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:21:42.533 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:42.532+0000 7f7c0f7fe700 1 -- 172.21.15.50:0/1013576513 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f7c1c083f40 con 0x7f7c280b3610 2023-10-06T01:21:42.533 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:42.532+0000 7f7c277fe700 1 --2- 172.21.15.50:0/1013576513 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f7c14066f30 0x7f7c140693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:21:42.533 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:42.533+0000 7f7c277fe700 1 --2- 172.21.15.50:0/1013576513 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f7c14066f30 0x7f7c140693e0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f7c2815bbe0 tx=0x7f7c18017000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:21:42.536 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:42.536+0000 7f7c0f7fe700 1 -- 172.21.15.50:0/1013576513 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f7c28159f50 con 0x7f7c280b3610 2023-10-06T01:21:42.740 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:42.739+0000 7f7c2cd9d700 1 -- 172.21.15.50:0/1013576513 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7c2815a610 con 0x7f7c280b3610 2023-10-06T01:21:42.741 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:42.741+0000 7f7c0f7fe700 1 -- 172.21.15.50:0/1013576513 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+18707 (secure 0 0 0) 0x7f7c2815a610 con 0x7f7c280b3610 2023-10-06T01:21:42.742 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-10-06T01:21:42.742 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":25,"fsid":"0bfd9a6b-1587-4fe4-a89e-e43c00286b4e","created":"2023-10-06T01:21:16.828801+0000","modified":"2023-10-06T01:21:41.329781+0000","last_up_change":"2023-10-06T01:21:28.584523+0000","last_in_change":"2023-10-06T01:21:20.179863+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-10-06T01:21:29.304225+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":".mgr","create_time":"2023-10-06T01:21:29.835490+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-06T01:21:34.675315+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-06T01:21:35.753991+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-10-06T01:21:38.853108+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"9060727a-3959-4de3-8363-c5c5d7826c9a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":87837},{"type":"v1","addr":"172.21.15.50:6801","nonce":87837}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":87837},{"type":"v1","addr":"172.21.15.50:6803","nonce":87837}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":87837},{"type":"v1","addr":"172.21.15.50:6807","nonce":87837}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":87837},{"type":"v1","addr":"172.21.15.50:6805","nonce":87837}]},"public_addr":"172.21.15.50:6801/87837","cluster_addr":"172.21.15.50:6803/87837","heartbeat_back_addr":"172.21.15.50:6807/87837","heartbeat_front_addr":"172.21.15.50:6805/87837","state":["exists","up"]},{"osd":1,"uuid":"5ad9ef12-b579-47ea-b690-90ba887e2cef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":87853},{"type":"v1","addr":"172.21.15.50:6809","nonce":87853}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":87853},{"type":"v1","addr":"172.21.15.50:6811","nonce":87853}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":87853},{"type":"v1","addr":"172.21.15.50:6815","nonce":87853}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":87853},{"type":"v1","addr":"172.21.15.50:6813","nonce":87853}]},"public_addr":"172.21.15.50:6809/87853","cluster_addr":"172.21.15.50:6811/87853","heartbeat_back_addr":"172.21.15.50:6815/87853","heartbeat_front_addr":"172.21.15.50:6813/87853","state":["exists","up"]},{"osd":2,"uuid":"c7aee044-6f75-436f-90e1-ba42a57359bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6821","nonce":87855},{"type":"v1","addr":"172.21.15.50:6822","nonce":87855}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6824","nonce":87855},{"type":"v1","addr":"172.21.15.50:6826","nonce":87855}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":87855},{"type":"v1","addr":"172.21.15.50:6831","nonce":87855}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":87855},{"type":"v1","addr":"172.21.15.50:6829","nonce":87855}]},"public_addr":"172.21.15.50:6822/87855","cluster_addr":"172.21.15.50:6826/87855","heartbeat_back_addr":"172.21.15.50:6831/87855","heartbeat_front_addr":"172.21.15.50:6829/87855","state":["exists","up"]},{"osd":3,"uuid":"d9b901c8-e8b2-44af-9508-f453120a96c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":87856},{"type":"v1","addr":"172.21.15.50:6817","nonce":87856}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":87856},{"type":"v1","addr":"172.21.15.50:6819","nonce":87856}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6825","nonce":87856},{"type":"v1","addr":"172.21.15.50:6827","nonce":87856}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6820","nonce":87856},{"type":"v1","addr":"172.21.15.50:6823","nonce":87856}]},"public_addr":"172.21.15.50:6817/87856","cluster_addr":"172.21.15.50:6819/87856","heartbeat_back_addr":"172.21.15.50:6827/87856","heartbeat_front_addr":"172.21.15.50:6823/87856","state":["exists","up"]},{"osd":4,"uuid":"2b3c6b38-e3e9-4301-9445-60fd3fe8ce03","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":85805},{"type":"v1","addr":"172.21.15.155:6801","nonce":85805}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":85805},{"type":"v1","addr":"172.21.15.155:6803","nonce":85805}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6806","nonce":85805},{"type":"v1","addr":"172.21.15.155:6807","nonce":85805}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6804","nonce":85805},{"type":"v1","addr":"172.21.15.155:6805","nonce":85805}]},"public_addr":"172.21.15.155:6801/85805","cluster_addr":"172.21.15.155:6803/85805","heartbeat_back_addr":"172.21.15.155:6807/85805","heartbeat_front_addr":"172.21.15.155:6805/85805","state":["exists","up"]},{"osd":5,"uuid":"417b5f8f-65f1-4c94-91a7-a6ce03fe1679","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6816","nonce":85807},{"type":"v1","addr":"172.21.15.155:6818","nonce":85807}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6820","nonce":85807},{"type":"v1","addr":"172.21.15.155:6822","nonce":85807}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6828","nonce":85807},{"type":"v1","addr":"172.21.15.155:6830","nonce":85807}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6824","nonce":85807},{"type":"v1","addr":"172.21.15.155:6826","nonce":85807}]},"public_addr":"172.21.15.155:6818/85807","cluster_addr":"172.21.15.155:6822/85807","heartbeat_back_addr":"172.21.15.155:6830/85807","heartbeat_front_addr":"172.21.15.155:6826/85807","state":["exists","up"]},{"osd":6,"uuid":"c150cff3-aee4-4714-9c08-d182b1ba9ffd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6808","nonce":85806},{"type":"v1","addr":"172.21.15.155:6809","nonce":85806}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6810","nonce":85806},{"type":"v1","addr":"172.21.15.155:6811","nonce":85806}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6814","nonce":85806},{"type":"v1","addr":"172.21.15.155:6815","nonce":85806}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6812","nonce":85806},{"type":"v1","addr":"172.21.15.155:6813","nonce":85806}]},"public_addr":"172.21.15.155:6809/85806","cluster_addr":"172.21.15.155:6811/85806","heartbeat_back_addr":"172.21.15.155:6815/85806","heartbeat_front_addr":"172.21.15.155:6813/85806","state":["exists","up"]},{"osd":7,"uuid":"71107f0e-04d1-4e72-a0ec-0faf6af003e7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6817","nonce":85832},{"type":"v1","addr":"172.21.15.155:6819","nonce":85832}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6821","nonce":85832},{"type":"v1","addr":"172.21.15.155:6823","nonce":85832}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6829","nonce":85832},{"type":"v1","addr":"172.21.15.155:6831","nonce":85832}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6825","nonce":85832},{"type":"v1","addr":"172.21.15.155:6827","nonce":85832}]},"public_addr":"172.21.15.155:6819/85832","cluster_addr":"172.21.15.155:6823/85832","heartbeat_back_addr":"172.21.15.155:6831/85832","heartbeat_front_addr":"172.21.15.155:6827/85832","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:21:25.423389+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:21:25.472661+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:21:25.817562+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:21:25.551257+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:21:25.407818+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:21:25.557976+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:21:25.747299+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:21:25.827576+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T01:21:42.744 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:42.743+0000 7f7c2cd9d700 1 -- 172.21.15.50:0/1013576513 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f7c14066f30 msgr2=0x7f7c140693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:21:42.744 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:42.743+0000 7f7c2cd9d700 1 --2- 172.21.15.50:0/1013576513 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f7c14066f30 0x7f7c140693e0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f7c2815bbe0 tx=0x7f7c18017000 comp rx=0 tx=0).stop 2023-10-06T01:21:42.744 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:42.743+0000 7f7c2cd9d700 1 -- 172.21.15.50:0/1013576513 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7c280b3610 msgr2=0x7f7c280cdf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:21:42.744 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:42.743+0000 7f7c2cd9d700 1 --2- 172.21.15.50:0/1013576513 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7c280b3610 0x7f7c280cdf80 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f7c1c00c790 tx=0x7f7c1c007ea0 comp rx=0 tx=0).stop 2023-10-06T01:21:42.744 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:42.743+0000 7f7c2cd9d700 1 -- 172.21.15.50:0/1013576513 shutdown_connections 2023-10-06T01:21:42.744 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:42.743+0000 7f7c2cd9d700 1 --2- 172.21.15.50:0/1013576513 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7c28159480 0x7f7c280d0c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:21:42.744 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:42.743+0000 7f7c2cd9d700 1 --2- 172.21.15.50:0/1013576513 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f7c14066f30 0x7f7c140693e0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:21:42.744 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:42.743+0000 7f7c2cd9d700 1 --2- 172.21.15.50:0/1013576513 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7c280b2140 0x7f7c280c5a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:21:42.745 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:42.743+0000 7f7c2cd9d700 1 --2- 172.21.15.50:0/1013576513 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7c280b3610 0x7f7c280cdf80 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:21:42.745 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:42.743+0000 7f7c2cd9d700 1 -- 172.21.15.50:0/1013576513 >> 172.21.15.50:0/1013576513 conn(0x7f7c2806ed20 msgr2=0x7f7c28157d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:21:42.745 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:42.743+0000 7f7c2cd9d700 1 -- 172.21.15.50:0/1013576513 shutdown_connections 2023-10-06T01:21:42.745 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:42.743+0000 7f7c2cd9d700 1 -- 172.21.15.50:0/1013576513 wait complete. 2023-10-06T01:21:42.762 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T01:21:42.948 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:42.947+0000 7fef4b59d700 1 Processor -- start 2023-10-06T01:21:42.948 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:42.947+0000 7fef4b59d700 1 -- start start 2023-10-06T01:21:42.951 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:42.949+0000 7fef4b59d700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fef4406a5d0 0x7fef44153730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:21:42.952 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:42.949+0000 7fef4b59d700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fef4406a9a0 0x7fef44153c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:21:42.952 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:42.949+0000 7fef4b59d700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fef4406df90 0x7fef4406e3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:21:42.952 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:42.949+0000 7fef4b59d700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fef4406f5a0 con 0x7fef4406a5d0 2023-10-06T01:21:42.952 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:42.949+0000 7fef4b59d700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fef440c9d00 con 0x7fef4406df90 2023-10-06T01:21:42.952 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:42.949+0000 7fef4b59d700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef440c6750 con 0x7fef4406a9a0 2023-10-06T01:21:42.952 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:42.949+0000 7fef4a59b700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fef4406a5d0 0x7fef44153730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:21:42.952 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:42.949+0000 7fef4a59b700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fef4406a5d0 0x7fef44153730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:42200/0 (socket says 172.21.15.50:42200) 2023-10-06T01:21:42.952 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:42.949+0000 7fef4a59b700 1 -- 172.21.15.50:0/1446894181 learned_addr learned my addr 172.21.15.50:0/1446894181 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-06T01:21:42.952 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:42.949+0000 7fef49d9a700 1 --2- 172.21.15.50:0/1446894181 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fef4406a9a0 0x7fef44153c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:21:42.952 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:42.949+0000 7fef4ad9c700 1 --2- 172.21.15.50:0/1446894181 >> v2:172.21.15.155:3300/0 conn(0x7fef4406df90 0x7fef4406e3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:21:42.953 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:42.949+0000 7fef4a59b700 1 -- 172.21.15.50:0/1446894181 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fef4406a9a0 msgr2=0x7fef44153c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:21:42.953 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:42.949+0000 7fef4a59b700 1 --2- 172.21.15.50:0/1446894181 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fef4406a9a0 0x7fef44153c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:21:42.953 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:42.949+0000 7fef4a59b700 1 -- 172.21.15.50:0/1446894181 >> v2:172.21.15.155:3300/0 conn(0x7fef4406df90 msgr2=0x7fef4406e3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:21:42.953 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:42.949+0000 7fef4a59b700 1 --2- 172.21.15.50:0/1446894181 >> v2:172.21.15.155:3300/0 conn(0x7fef4406df90 0x7fef4406e3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:21:42.953 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:42.949+0000 7fef4a59b700 1 -- 172.21.15.50:0/1446894181 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef4406ed00 con 0x7fef4406a5d0 2023-10-06T01:21:42.953 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:42.949+0000 7fef49d9a700 1 --2- 172.21.15.50:0/1446894181 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fef4406a9a0 0x7fef44153c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T01:21:42.953 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:42.949+0000 7fef4ad9c700 1 --2- 172.21.15.50:0/1446894181 >> v2:172.21.15.155:3300/0 conn(0x7fef4406df90 0x7fef4406e3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T01:21:42.953 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:42.950+0000 7fef4a59b700 1 --2- 172.21.15.50:0/1446894181 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fef4406a5d0 0x7fef44153730 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fef4406c960 tx=0x7fef40009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a68541b3d3269062 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:21:42.953 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:42.950+0000 7fef49599700 1 -- 172.21.15.50:0/1446894181 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef4000b860 con 0x7fef4406a5d0 2023-10-06T01:21:42.953 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:42.950+0000 7fef49599700 1 -- 172.21.15.50:0/1446894181 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef4000b9c0 con 0x7fef4406a5d0 2023-10-06T01:21:42.953 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:42.950+0000 7fef49599700 1 -- 172.21.15.50:0/1446894181 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef4000bd60 con 0x7fef4406a5d0 2023-10-06T01:21:42.953 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:42.950+0000 7fef4b59d700 1 -- 172.21.15.50:0/1446894181 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fef4406a5d0 msgr2=0x7fef44153730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:21:42.954 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:42.950+0000 7fef4b59d700 1 --2- 172.21.15.50:0/1446894181 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fef4406a5d0 0x7fef44153730 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fef4406c960 tx=0x7fef40009250 comp rx=0 tx=0).stop 2023-10-06T01:21:42.954 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:42.951+0000 7fef4b59d700 1 -- 172.21.15.50:0/1446894181 shutdown_connections 2023-10-06T01:21:42.954 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:42.951+0000 7fef4b59d700 1 --2- 172.21.15.50:0/1446894181 >> v2:172.21.15.155:3300/0 conn(0x7fef4406df90 0x7fef4406e3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:21:42.954 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:42.951+0000 7fef4b59d700 1 --2- 172.21.15.50:0/1446894181 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fef4406a5d0 0x7fef44153730 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:21:42.954 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:42.951+0000 7fef4b59d700 1 --2- 172.21.15.50:0/1446894181 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fef4406a9a0 0x7fef44153c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:21:42.954 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:42.951+0000 7fef4b59d700 1 -- 172.21.15.50:0/1446894181 >> 172.21.15.50:0/1446894181 conn(0x7fef440680c0 msgr2=0x7fef440cbf00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:21:42.954 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:42.951+0000 7fef4b59d700 1 -- 172.21.15.50:0/1446894181 shutdown_connections 2023-10-06T01:21:42.954 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:42.951+0000 7fef4b59d700 1 -- 172.21.15.50:0/1446894181 wait complete. 2023-10-06T01:21:42.956 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:42.952+0000 7fef4b59d700 1 Processor -- start 2023-10-06T01:21:42.956 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:42.952+0000 7fef4b59d700 1 -- start start 2023-10-06T01:21:42.957 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:42.953+0000 7fef4b59d700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fef4406a5d0 0x7fef4415c780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:21:42.957 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:42.953+0000 7fef4b59d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fef4406a9a0 0x7fef4414cf50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:21:42.957 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:42.953+0000 7fef4b59d700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fef4406df90 0x7fef4416cea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:21:42.957 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:42.953+0000 7fef4b59d700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef4416d940 con 0x7fef4406a9a0 2023-10-06T01:21:42.957 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:42.953+0000 7fef4b59d700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef4416dc20 con 0x7fef4406df90 2023-10-06T01:21:42.957 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:42.953+0000 7fef4b59d700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef4415bcc0 con 0x7fef4406a5d0 2023-10-06T01:21:42.957 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:42.953+0000 7fef49d9a700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fef4406a9a0 0x7fef4414cf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:21:42.957 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:42.953+0000 7fef49d9a700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fef4406a9a0 0x7fef4414cf50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:42216/0 (socket says 172.21.15.50:42216) 2023-10-06T01:21:42.957 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:42.953+0000 7fef49d9a700 1 -- 172.21.15.50:0/1180703170 learned_addr learned my addr 172.21.15.50:0/1180703170 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-06T01:21:42.957 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:42.953+0000 7fef4a59b700 1 --2- 172.21.15.50:0/1180703170 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fef4406a5d0 0x7fef4415c780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:21:42.958 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:42.953+0000 7fef4ad9c700 1 --2- 172.21.15.50:0/1180703170 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fef4406df90 0x7fef4416cea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:21:42.958 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:42.954+0000 7fef49d9a700 1 -- 172.21.15.50:0/1180703170 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fef4406a5d0 msgr2=0x7fef4415c780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:21:42.958 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:42.954+0000 7fef49d9a700 1 --2- 172.21.15.50:0/1180703170 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fef4406a5d0 0x7fef4415c780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:21:42.958 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:42.954+0000 7fef49d9a700 1 -- 172.21.15.50:0/1180703170 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fef4406df90 msgr2=0x7fef4416cea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:21:42.958 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:42.954+0000 7fef49d9a700 1 --2- 172.21.15.50:0/1180703170 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fef4406df90 0x7fef4416cea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:21:42.958 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:42.954+0000 7fef49d9a700 1 -- 172.21.15.50:0/1180703170 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef400094f0 con 0x7fef4406a9a0 2023-10-06T01:21:42.958 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:42.954+0000 7fef4ad9c700 1 --2- 172.21.15.50:0/1180703170 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fef4406df90 0x7fef4416cea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T01:21:42.958 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:42.954+0000 7fef49d9a700 1 --2- 172.21.15.50:0/1180703170 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fef4406a9a0 0x7fef4414cf50 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fef3400c880 tx=0x7fef34008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:21:42.958 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:42.954+0000 7fef3a7fc700 1 -- 172.21.15.50:0/1180703170 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef34011660 con 0x7fef4406a9a0 2023-10-06T01:21:42.958 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:42.954+0000 7fef3a7fc700 1 -- 172.21.15.50:0/1180703170 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef340117c0 con 0x7fef4406a9a0 2023-10-06T01:21:42.958 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:42.954+0000 7fef4b59d700 1 -- 172.21.15.50:0/1180703170 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fef4415bfa0 con 0x7fef4406a9a0 2023-10-06T01:21:42.958 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:42.954+0000 7fef3a7fc700 1 -- 172.21.15.50:0/1180703170 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef34011b60 con 0x7fef4406a9a0 2023-10-06T01:21:42.959 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:42.954+0000 7fef4b59d700 1 -- 172.21.15.50:0/1180703170 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fef4414da40 con 0x7fef4406a9a0 2023-10-06T01:21:42.959 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:42.955+0000 7fef4b59d700 1 -- 172.21.15.50:0/1180703170 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fef4405f270 con 0x7fef4406a9a0 2023-10-06T01:21:42.959 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:42.956+0000 7fef3a7fc700 1 -- 172.21.15.50:0/1180703170 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fef34021350 con 0x7fef4406a9a0 2023-10-06T01:21:42.959 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:42.957+0000 7fef3a7fc700 1 --2- 172.21.15.50:0/1180703170 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7fef28066f30 0x7fef280693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:21:42.960 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:42.957+0000 7fef3a7fc700 1 -- 172.21.15.50:0/1180703170 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6809+0+0 (secure 0 0 0) 0x7fef34084930 con 0x7fef4406a9a0 2023-10-06T01:21:42.960 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:42.958+0000 7fef4a59b700 1 --2- 172.21.15.50:0/1180703170 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7fef28066f30 0x7fef280693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:21:42.960 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:42.958+0000 7fef4a59b700 1 --2- 172.21.15.50:0/1180703170 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7fef28066f30 0x7fef280693e0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fef4406c960 tx=0x7fef40019000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:21:42.962 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:42.961+0000 7fef3a7fc700 1 -- 172.21.15.50:0/1180703170 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fef340516b0 con 0x7fef4406a9a0 2023-10-06T01:21:43.165 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:43.164+0000 7fef4b59d700 1 -- 172.21.15.50:0/1180703170 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fef4414dd30 con 0x7fef4406a9a0 2023-10-06T01:21:43.166 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:43.165+0000 7fef3a7fc700 1 -- 172.21.15.50:0/1180703170 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+18707 (secure 0 0 0) 0x7fef34054cd0 con 0x7fef4406a9a0 2023-10-06T01:21:43.167 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-10-06T01:21:43.167 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":25,"fsid":"0bfd9a6b-1587-4fe4-a89e-e43c00286b4e","created":"2023-10-06T01:21:16.828801+0000","modified":"2023-10-06T01:21:41.329781+0000","last_up_change":"2023-10-06T01:21:28.584523+0000","last_in_change":"2023-10-06T01:21:20.179863+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-10-06T01:21:29.304225+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":".mgr","create_time":"2023-10-06T01:21:29.835490+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-06T01:21:34.675315+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-06T01:21:35.753991+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-10-06T01:21:38.853108+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"9060727a-3959-4de3-8363-c5c5d7826c9a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":87837},{"type":"v1","addr":"172.21.15.50:6801","nonce":87837}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":87837},{"type":"v1","addr":"172.21.15.50:6803","nonce":87837}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":87837},{"type":"v1","addr":"172.21.15.50:6807","nonce":87837}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":87837},{"type":"v1","addr":"172.21.15.50:6805","nonce":87837}]},"public_addr":"172.21.15.50:6801/87837","cluster_addr":"172.21.15.50:6803/87837","heartbeat_back_addr":"172.21.15.50:6807/87837","heartbeat_front_addr":"172.21.15.50:6805/87837","state":["exists","up"]},{"osd":1,"uuid":"5ad9ef12-b579-47ea-b690-90ba887e2cef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":87853},{"type":"v1","addr":"172.21.15.50:6809","nonce":87853}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":87853},{"type":"v1","addr":"172.21.15.50:6811","nonce":87853}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":87853},{"type":"v1","addr":"172.21.15.50:6815","nonce":87853}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":87853},{"type":"v1","addr":"172.21.15.50:6813","nonce":87853}]},"public_addr":"172.21.15.50:6809/87853","cluster_addr":"172.21.15.50:6811/87853","heartbeat_back_addr":"172.21.15.50:6815/87853","heartbeat_front_addr":"172.21.15.50:6813/87853","state":["exists","up"]},{"osd":2,"uuid":"c7aee044-6f75-436f-90e1-ba42a57359bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6821","nonce":87855},{"type":"v1","addr":"172.21.15.50:6822","nonce":87855}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6824","nonce":87855},{"type":"v1","addr":"172.21.15.50:6826","nonce":87855}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":87855},{"type":"v1","addr":"172.21.15.50:6831","nonce":87855}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":87855},{"type":"v1","addr":"172.21.15.50:6829","nonce":87855}]},"public_addr":"172.21.15.50:6822/87855","cluster_addr":"172.21.15.50:6826/87855","heartbeat_back_addr":"172.21.15.50:6831/87855","heartbeat_front_addr":"172.21.15.50:6829/87855","state":["exists","up"]},{"osd":3,"uuid":"d9b901c8-e8b2-44af-9508-f453120a96c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":87856},{"type":"v1","addr":"172.21.15.50:6817","nonce":87856}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":87856},{"type":"v1","addr":"172.21.15.50:6819","nonce":87856}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6825","nonce":87856},{"type":"v1","addr":"172.21.15.50:6827","nonce":87856}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6820","nonce":87856},{"type":"v1","addr":"172.21.15.50:6823","nonce":87856}]},"public_addr":"172.21.15.50:6817/87856","cluster_addr":"172.21.15.50:6819/87856","heartbeat_back_addr":"172.21.15.50:6827/87856","heartbeat_front_addr":"172.21.15.50:6823/87856","state":["exists","up"]},{"osd":4,"uuid":"2b3c6b38-e3e9-4301-9445-60fd3fe8ce03","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":85805},{"type":"v1","addr":"172.21.15.155:6801","nonce":85805}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":85805},{"type":"v1","addr":"172.21.15.155:6803","nonce":85805}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6806","nonce":85805},{"type":"v1","addr":"172.21.15.155:6807","nonce":85805}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6804","nonce":85805},{"type":"v1","addr":"172.21.15.155:6805","nonce":85805}]},"public_addr":"172.21.15.155:6801/85805","cluster_addr":"172.21.15.155:6803/85805","heartbeat_back_addr":"172.21.15.155:6807/85805","heartbeat_front_addr":"172.21.15.155:6805/85805","state":["exists","up"]},{"osd":5,"uuid":"417b5f8f-65f1-4c94-91a7-a6ce03fe1679","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6816","nonce":85807},{"type":"v1","addr":"172.21.15.155:6818","nonce":85807}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6820","nonce":85807},{"type":"v1","addr":"172.21.15.155:6822","nonce":85807}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6828","nonce":85807},{"type":"v1","addr":"172.21.15.155:6830","nonce":85807}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6824","nonce":85807},{"type":"v1","addr":"172.21.15.155:6826","nonce":85807}]},"public_addr":"172.21.15.155:6818/85807","cluster_addr":"172.21.15.155:6822/85807","heartbeat_back_addr":"172.21.15.155:6830/85807","heartbeat_front_addr":"172.21.15.155:6826/85807","state":["exists","up"]},{"osd":6,"uuid":"c150cff3-aee4-4714-9c08-d182b1ba9ffd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6808","nonce":85806},{"type":"v1","addr":"172.21.15.155:6809","nonce":85806}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6810","nonce":85806},{"type":"v1","addr":"172.21.15.155:6811","nonce":85806}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6814","nonce":85806},{"type":"v1","addr":"172.21.15.155:6815","nonce":85806}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6812","nonce":85806},{"type":"v1","addr":"172.21.15.155:6813","nonce":85806}]},"public_addr":"172.21.15.155:6809/85806","cluster_addr":"172.21.15.155:6811/85806","heartbeat_back_addr":"172.21.15.155:6815/85806","heartbeat_front_addr":"172.21.15.155:6813/85806","state":["exists","up"]},{"osd":7,"uuid":"71107f0e-04d1-4e72-a0ec-0faf6af003e7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6817","nonce":85832},{"type":"v1","addr":"172.21.15.155:6819","nonce":85832}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6821","nonce":85832},{"type":"v1","addr":"172.21.15.155:6823","nonce":85832}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6829","nonce":85832},{"type":"v1","addr":"172.21.15.155:6831","nonce":85832}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6825","nonce":85832},{"type":"v1","addr":"172.21.15.155:6827","nonce":85832}]},"public_addr":"172.21.15.155:6819/85832","cluster_addr":"172.21.15.155:6823/85832","heartbeat_back_addr":"172.21.15.155:6831/85832","heartbeat_front_addr":"172.21.15.155:6827/85832","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:21:25.423389+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:21:25.472661+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:21:25.817562+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:21:25.551257+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:21:25.407818+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:21:25.557976+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:21:25.747299+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:21:25.827576+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T01:21:43.169 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:43.168+0000 7fef4b59d700 1 -- 172.21.15.50:0/1180703170 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7fef28066f30 msgr2=0x7fef280693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:21:43.169 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:43.168+0000 7fef4b59d700 1 --2- 172.21.15.50:0/1180703170 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7fef28066f30 0x7fef280693e0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fef4406c960 tx=0x7fef40019000 comp rx=0 tx=0).stop 2023-10-06T01:21:43.169 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:43.168+0000 7fef4b59d700 1 -- 172.21.15.50:0/1180703170 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fef4406a9a0 msgr2=0x7fef4414cf50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:21:43.170 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:43.168+0000 7fef4b59d700 1 --2- 172.21.15.50:0/1180703170 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fef4406a9a0 0x7fef4414cf50 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fef3400c880 tx=0x7fef34008040 comp rx=0 tx=0).stop 2023-10-06T01:21:43.170 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:43.168+0000 7fef4b59d700 1 -- 172.21.15.50:0/1180703170 shutdown_connections 2023-10-06T01:21:43.170 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:43.168+0000 7fef4b59d700 1 --2- 172.21.15.50:0/1180703170 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7fef28066f30 0x7fef280693e0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:21:43.170 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:43.168+0000 7fef4b59d700 1 --2- 172.21.15.50:0/1180703170 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fef4406df90 0x7fef4416cea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:21:43.170 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:43.168+0000 7fef4b59d700 1 --2- 172.21.15.50:0/1180703170 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fef4406a5d0 0x7fef4415c780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:21:43.170 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:43.168+0000 7fef4b59d700 1 --2- 172.21.15.50:0/1180703170 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fef4406a9a0 0x7fef4414cf50 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:21:43.170 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:43.168+0000 7fef4b59d700 1 -- 172.21.15.50:0/1180703170 >> 172.21.15.50:0/1180703170 conn(0x7fef440680c0 msgr2=0x7fef4414f660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:21:43.170 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:43.168+0000 7fef4b59d700 1 -- 172.21.15.50:0/1180703170 shutdown_connections 2023-10-06T01:21:43.170 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:43.168+0000 7fef4b59d700 1 -- 172.21.15.50:0/1180703170 wait complete. 2023-10-06T01:21:43.197 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T01:21:43.383 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:43.382+0000 7fc28f59e700 1 Processor -- start 2023-10-06T01:21:43.384 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:43.383+0000 7fc28f59e700 1 -- start start 2023-10-06T01:21:43.385 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:43.384+0000 7fc28f59e700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc29006ec80 0x7fc2900c8250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:21:43.385 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:43.384+0000 7fc28f59e700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fc29006f050 0x7fc2901551a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:21:43.385 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:43.384+0000 7fc28f59e700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc2900ada00 con 0x7fc2900ade90 2023-10-06T01:21:43.385 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:43.384+0000 7fc28f59e700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc2900b1e20 con 0x7fc29006f050 2023-10-06T01:21:43.385 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:43.384+0000 7fc28f59e700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2900ad0d0 con 0x7fc29006ec80 2023-10-06T01:21:43.385 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:43.384+0000 7fc28dd9b700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fc2900ade90 0x7fc2900b15f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:39056/0 (socket says 172.21.15.50:39056) 2023-10-06T01:21:43.385 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:43.384+0000 7fc28dd9b700 1 -- 172.21.15.50:0/2115751988 learned_addr learned my addr 172.21.15.50:0/2115751988 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-10-06T01:21:43.388 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:43.384+0000 7fc28e59c700 1 --2- 172.21.15.50:0/2115751988 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc29006ec80 0x7fc2900c8250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:21:43.388 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:43.384+0000 7fc28ed9d700 1 --2- 172.21.15.50:0/2115751988 >> v2:172.21.15.155:3300/0 conn(0x7fc29006f050 0x7fc2901551a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:21:43.388 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:43.385+0000 7fc28d59a700 1 -- 172.21.15.50:0/2115751988 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3406714254 0 0) 0x7fc2900ada00 con 0x7fc2900ade90 2023-10-06T01:21:43.388 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:43.385+0000 7fc28d59a700 1 -- 172.21.15.50:0/2115751988 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc278003570 con 0x7fc2900ade90 2023-10-06T01:21:43.389 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:43.385+0000 7fc28d59a700 1 -- 172.21.15.50:0/2115751988 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 344923456 0 0) 0x7fc278003570 con 0x7fc2900ade90 2023-10-06T01:21:43.389 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:43.385+0000 7fc28d59a700 1 -- 172.21.15.50:0/2115751988 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc29006ec80 msgr2=0x7fc2900c8250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:21:43.389 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:43.385+0000 7fc28d59a700 1 --2- 172.21.15.50:0/2115751988 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc29006ec80 0x7fc2900c8250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:21:43.389 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:43.385+0000 7fc28d59a700 1 -- 172.21.15.50:0/2115751988 >> v2:172.21.15.155:3300/0 conn(0x7fc29006f050 msgr2=0x7fc2901551a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:21:43.389 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:43.385+0000 7fc28d59a700 1 --2- 172.21.15.50:0/2115751988 >> v2:172.21.15.155:3300/0 conn(0x7fc29006f050 0x7fc2901551a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:21:43.389 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:43.385+0000 7fc28d59a700 1 -- 172.21.15.50:0/2115751988 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2900ad3b0 con 0x7fc2900ade90 2023-10-06T01:21:43.389 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:43.385+0000 7fc28d59a700 1 -- 172.21.15.50:0/2115751988 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 347519148 0 0) 0x7fc284001470 con 0x7fc2900ade90 2023-10-06T01:21:43.389 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:43.385+0000 7fc28d59a700 1 -- 172.21.15.50:0/2115751988 >> v1:172.21.15.50:6789/0 conn(0x7fc2900ade90 legacy=0x7fc2900b15f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:21:43.389 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:43.385+0000 7fc28d59a700 1 --2- 172.21.15.50:0/2115751988 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc278003a60 0x7fc278003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:21:43.390 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:43.385+0000 7fc28d59a700 1 --2- 172.21.15.50:0/2115751988 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc29006ec80 0x7fc278004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:21:43.390 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:43.385+0000 7fc28d59a700 1 --2- 172.21.15.50:0/2115751988 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc278004d50 0x7fc2780051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:21:43.390 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:43.385+0000 7fc28d59a700 1 -- 172.21.15.50:0/2115751988 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2900b1e20 con 0x7fc278004d50 2023-10-06T01:21:43.390 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:43.385+0000 7fc28d59a700 1 -- 172.21.15.50:0/2115751988 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2900ad0d0 con 0x7fc278003a60 2023-10-06T01:21:43.390 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:43.385+0000 7fc28d59a700 1 -- 172.21.15.50:0/2115751988 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc27800ba60 con 0x7fc29006ec80 2023-10-06T01:21:43.390 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:43.385+0000 7fc28e59c700 1 --2- 172.21.15.50:0/2115751988 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc278003a60 0x7fc278003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:21:43.390 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:43.385+0000 7fc28ed9d700 1 --2- 172.21.15.50:0/2115751988 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc278004d50 0x7fc2780051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:21:43.390 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:43.386+0000 7fc28dd9b700 1 --2- 172.21.15.50:0/2115751988 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc29006ec80 0x7fc278004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:21:43.390 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:43.386+0000 7fc28ed9d700 1 -- 172.21.15.50:0/2115751988 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc29006ec80 msgr2=0x7fc278004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:21:43.390 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:43.386+0000 7fc28ed9d700 1 --2- 172.21.15.50:0/2115751988 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc29006ec80 0x7fc278004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:21:43.390 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:43.386+0000 7fc28ed9d700 1 -- 172.21.15.50:0/2115751988 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc278003a60 msgr2=0x7fc278003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:21:43.390 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:43.386+0000 7fc28ed9d700 1 --2- 172.21.15.50:0/2115751988 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc278003a60 0x7fc278003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:21:43.391 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:43.386+0000 7fc28ed9d700 1 -- 172.21.15.50:0/2115751988 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc278003570 con 0x7fc278004d50 2023-10-06T01:21:43.391 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:43.386+0000 7fc28ed9d700 1 --2- 172.21.15.50:0/2115751988 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc278004d50 0x7fc2780051c0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fc28800afd0 tx=0x7fc28800c040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c0ef71564c391b40 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:21:43.391 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:43.386+0000 7fc28d59a700 1 -- 172.21.15.50:0/2115751988 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc28800f040 con 0x7fc278004d50 2023-10-06T01:21:43.391 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:43.386+0000 7fc28d59a700 1 -- 172.21.15.50:0/2115751988 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc28800a0d0 con 0x7fc278004d50 2023-10-06T01:21:43.391 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:43.386+0000 7fc28d59a700 1 -- 172.21.15.50:0/2115751988 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc28800ea20 con 0x7fc278004d50 2023-10-06T01:21:43.391 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:43.387+0000 7fc28f59e700 1 -- 172.21.15.50:0/2115751988 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc278004d50 msgr2=0x7fc2780051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:21:43.391 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:43.387+0000 7fc28f59e700 1 --2- 172.21.15.50:0/2115751988 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc278004d50 0x7fc2780051c0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fc28800afd0 tx=0x7fc28800c040 comp rx=0 tx=0).stop 2023-10-06T01:21:43.391 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:43.387+0000 7fc28ed9d700 1 -- 172.21.15.50:0/2115751988 reap_dead start 2023-10-06T01:21:43.391 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:43.387+0000 7fc28f59e700 1 -- 172.21.15.50:0/2115751988 shutdown_connections 2023-10-06T01:21:43.391 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:43.387+0000 7fc28f59e700 1 -- 172.21.15.50:0/2115751988 >> 172.21.15.50:0/2115751988 conn(0x7fc2900cbeb0 msgr2=0x7fc2900cc2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:21:43.391 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:43.387+0000 7fc28f59e700 1 -- 172.21.15.50:0/2115751988 shutdown_connections 2023-10-06T01:21:43.392 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:43.387+0000 7fc28f59e700 1 -- 172.21.15.50:0/2115751988 wait complete. 2023-10-06T01:21:43.394 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:43.388+0000 7fc28f59e700 1 Processor -- start 2023-10-06T01:21:43.394 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:43.388+0000 7fc28f59e700 1 -- start start 2023-10-06T01:21:43.394 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:43.389+0000 7fc28f59e700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc278004d50 0x7fc2900c6e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:21:43.394 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:43.389+0000 7fc28f59e700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc290158290 0x7fc29013f8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:21:43.395 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:43.389+0000 7fc28f59e700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc290155920 0x7fc290155d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:21:43.395 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:43.389+0000 7fc28f59e700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc290158da0 con 0x7fc290155920 2023-10-06T01:21:43.395 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:43.389+0000 7fc28f59e700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2901562d0 con 0x7fc290158290 2023-10-06T01:21:43.395 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:43.389+0000 7fc28f59e700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc290158ac0 con 0x7fc278004d50 2023-10-06T01:21:43.395 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:43.390+0000 7fc28ed9d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc290155920 0x7fc290155d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:21:43.395 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:43.390+0000 7fc28ed9d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc290155920 0x7fc290155d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:42232/0 (socket says 172.21.15.50:42232) 2023-10-06T01:21:43.395 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:43.390+0000 7fc28ed9d700 1 -- 172.21.15.50:0/2766570595 learned_addr learned my addr 172.21.15.50:0/2766570595 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-06T01:21:43.395 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:43.390+0000 7fc28e59c700 1 --2- 172.21.15.50:0/2766570595 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc278004d50 0x7fc2900c6e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:21:43.395 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:43.390+0000 7fc28dd9b700 1 --2- 172.21.15.50:0/2766570595 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc290158290 0x7fc29013f8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:21:43.395 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:43.390+0000 7fc28ed9d700 1 -- 172.21.15.50:0/2766570595 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc278004d50 msgr2=0x7fc2900c6e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:21:43.395 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:43.390+0000 7fc28ed9d700 1 --2- 172.21.15.50:0/2766570595 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc278004d50 0x7fc2900c6e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:21:43.396 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:43.390+0000 7fc28ed9d700 1 -- 172.21.15.50:0/2766570595 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc290158290 msgr2=0x7fc29013f8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:21:43.396 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:43.390+0000 7fc28ed9d700 1 --2- 172.21.15.50:0/2766570595 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc290158290 0x7fc29013f8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:21:43.396 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:43.390+0000 7fc28ed9d700 1 -- 172.21.15.50:0/2766570595 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2900c9450 con 0x7fc290155920 2023-10-06T01:21:43.396 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:43.390+0000 7fc28ed9d700 1 --2- 172.21.15.50:0/2766570595 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc290155920 0x7fc290155d90 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fc288014000 tx=0x7fc288018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:21:43.396 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:43.390+0000 7fc27e7fc700 1 -- 172.21.15.50:0/2766570595 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc288008b10 con 0x7fc290155920 2023-10-06T01:21:43.396 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:43.390+0000 7fc27e7fc700 1 -- 172.21.15.50:0/2766570595 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc288008c90 con 0x7fc290155920 2023-10-06T01:21:43.396 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:43.390+0000 7fc27e7fc700 1 -- 172.21.15.50:0/2766570595 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc288025660 con 0x7fc290155920 2023-10-06T01:21:43.396 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:43.391+0000 7fc28f59e700 1 -- 172.21.15.50:0/2766570595 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc2900c9730 con 0x7fc290155920 2023-10-06T01:21:43.396 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:43.391+0000 7fc28f59e700 1 -- 172.21.15.50:0/2766570595 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc29013fdf0 con 0x7fc290155920 2023-10-06T01:21:43.396 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:43.392+0000 7fc28f59e700 1 -- 172.21.15.50:0/2766570595 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc2900c9c50 con 0x7fc290155920 2023-10-06T01:21:43.396 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:43.392+0000 7fc27e7fc700 1 -- 172.21.15.50:0/2766570595 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fc28801d400 con 0x7fc290155920 2023-10-06T01:21:43.396 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:43.393+0000 7fc27e7fc700 1 --2- 172.21.15.50:0/2766570595 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7fc270066f30 0x7fc2700693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:21:43.397 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:43.393+0000 7fc27e7fc700 1 -- 172.21.15.50:0/2766570595 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6809+0+0 (secure 0 0 0) 0x7fc288086110 con 0x7fc290155920 2023-10-06T01:21:43.397 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:43.394+0000 7fc28e59c700 1 --2- 172.21.15.50:0/2766570595 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7fc270066f30 0x7fc2700693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:21:43.397 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:43.394+0000 7fc28e59c700 1 --2- 172.21.15.50:0/2766570595 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7fc270066f30 0x7fc2700693e0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fc280006f00 tx=0x7fc2800091a0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:21:43.398 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:43.397+0000 7fc27e7fc700 1 -- 172.21.15.50:0/2766570595 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fc2900c9c50 con 0x7fc290155920 2023-10-06T01:21:43.645 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:43.644+0000 7fc28f59e700 1 -- 172.21.15.50:0/2766570595 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc2900c9c50 con 0x7fc290155920 2023-10-06T01:21:43.646 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:43.645+0000 7fc27e7fc700 1 -- 172.21.15.50:0/2766570595 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+4593 (secure 0 0 0) 0x7fc2900c9c50 con 0x7fc290155920 2023-10-06T01:21:43.646 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-10-06T01:21:43.646 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4214,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6835/33654067","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6833","nonce":33654067},{"type":"v1","addr":"172.21.15.50:6835","nonce":33654067}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4279,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6836/2571345069","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":2571345069},{"type":"v1","addr":"172.21.15.155:6836","nonce":2571345069}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4290,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6834/4140731341","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6832","nonce":4140731341},{"type":"v1","addr":"172.21.15.50:6834","nonce":4140731341}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T01:21:36.779774+0000","modified":"2023-10-06T01:21:41.833429+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4302},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4302":{"gid":4302,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.155:6837/3434423585","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6835","nonce":3434423585},{"type":"v1","addr":"172.21.15.155:6837","nonce":3434423585}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":1},"id":1}]} 2023-10-06T01:21:43.648 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:43.647+0000 7fc28f59e700 1 -- 172.21.15.50:0/2766570595 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7fc270066f30 msgr2=0x7fc2700693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:21:43.648 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:43.647+0000 7fc28f59e700 1 --2- 172.21.15.50:0/2766570595 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7fc270066f30 0x7fc2700693e0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fc280006f00 tx=0x7fc2800091a0 comp rx=0 tx=0).stop 2023-10-06T01:21:43.648 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:43.647+0000 7fc28f59e700 1 -- 172.21.15.50:0/2766570595 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc290155920 msgr2=0x7fc290155d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:21:43.648 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:43.647+0000 7fc28f59e700 1 --2- 172.21.15.50:0/2766570595 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc290155920 0x7fc290155d90 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fc288014000 tx=0x7fc288018000 comp rx=0 tx=0).stop 2023-10-06T01:21:43.648 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:43.647+0000 7fc28f59e700 1 -- 172.21.15.50:0/2766570595 shutdown_connections 2023-10-06T01:21:43.649 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:43.647+0000 7fc28f59e700 1 --2- 172.21.15.50:0/2766570595 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc290155920 0x7fc290155d90 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:21:43.649 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:43.647+0000 7fc28f59e700 1 --2- 172.21.15.50:0/2766570595 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc278004d50 0x7fc2900c6e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:21:43.649 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:43.647+0000 7fc28f59e700 1 --2- 172.21.15.50:0/2766570595 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7fc270066f30 0x7fc2700693e0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:21:43.649 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:43.647+0000 7fc28f59e700 1 --2- 172.21.15.50:0/2766570595 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc290158290 0x7fc29013f8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:21:43.649 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:43.647+0000 7fc28f59e700 1 -- 172.21.15.50:0/2766570595 >> 172.21.15.50:0/2766570595 conn(0x7fc2900cbeb0 msgr2=0x7fc29006a480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:21:43.649 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:43.647+0000 7fc28f59e700 1 -- 172.21.15.50:0/2766570595 shutdown_connections 2023-10-06T01:21:43.649 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:43.647+0000 7fc28f59e700 1 -- 172.21.15.50:0/2766570595 wait complete. 2023-10-06T01:21:43.649 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 7 2023-10-06T01:21:43.665 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T01:21:43.853 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:43.852+0000 7f7580b9d700 1 Processor -- start 2023-10-06T01:21:43.853 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:43.852+0000 7f7580b9d700 1 -- start start 2023-10-06T01:21:43.854 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:43.853+0000 7f7580b9d700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f757c0af220 0x7f757c069c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:21:43.854 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:43.853+0000 7f7580b9d700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f757c06a160 0x7f757c0abed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:21:43.854 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:43.853+0000 7f7580b9d700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f757c0aba40 con 0x7f757c159490 2023-10-06T01:21:43.854 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:43.853+0000 7f7580b9d700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f757c06a570 con 0x7f757c06a160 2023-10-06T01:21:43.855 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:43.853+0000 7f7580b9d700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f757c0aae30 con 0x7f757c0af220 2023-10-06T01:21:43.855 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:43.853+0000 7f757bfff700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f757c06a160 0x7f757c0abed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:21:43.855 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:43.853+0000 7f757bfff700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f757c06a160 0x7f757c0abed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:42236/0 (socket says 172.21.15.50:42236) 2023-10-06T01:21:43.855 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:43.853+0000 7f757bfff700 1 -- 172.21.15.50:0/260955204 learned_addr learned my addr 172.21.15.50:0/260955204 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-06T01:21:43.855 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:43.853+0000 7f757b7fe700 1 --1- >> v1:172.21.15.155:6789/0 conn(0x7f757c159490 0x7f757c15db50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.155:6789/0 says I am v1:172.21.15.50:47212/0 (socket says 172.21.15.50:47212) 2023-10-06T01:21:43.855 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:43.853+0000 7f757affd700 1 --2- 172.21.15.50:0/260955204 >> v2:172.21.15.155:3300/0 conn(0x7f757c0af220 0x7f757c069c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:21:43.856 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:43.854+0000 7f757bfff700 1 -- 172.21.15.50:0/260955204 >> v2:172.21.15.155:3300/0 conn(0x7f757c0af220 msgr2=0x7f757c069c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:21:43.856 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:43.854+0000 7f757bfff700 1 --2- 172.21.15.50:0/260955204 >> v2:172.21.15.155:3300/0 conn(0x7f757c0af220 0x7f757c069c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:21:43.857 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:43.854+0000 7f757bfff700 1 -- 172.21.15.50:0/260955204 >> v1:172.21.15.155:6789/0 conn(0x7f757c159490 legacy=0x7f757c15db50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:21:43.857 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:43.854+0000 7f757bfff700 1 -- 172.21.15.50:0/260955204 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f757c0ab110 con 0x7f757c06a160 2023-10-06T01:21:43.857 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:43.854+0000 7f757a7fc700 1 -- 172.21.15.50:0/260955204 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 935747393 0 0) 0x7f757c0aba40 con 0x7f757c159490 2023-10-06T01:21:43.857 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:43.854+0000 7f757bfff700 1 --2- 172.21.15.50:0/260955204 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f757c06a160 0x7f757c0abed0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f757c06d010 tx=0x7f7574009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=778bd17d1a9f4800 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:21:43.857 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:43.854+0000 7f757a7fc700 1 -- 172.21.15.50:0/260955204 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f757400e070 con 0x7f757c06a160 2023-10-06T01:21:43.857 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:43.854+0000 7f757a7fc700 1 -- 172.21.15.50:0/260955204 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f757400ba20 con 0x7f757c06a160 2023-10-06T01:21:43.857 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:43.854+0000 7f757a7fc700 1 -- 172.21.15.50:0/260955204 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75740092e0 con 0x7f757c06a160 2023-10-06T01:21:43.857 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:43.855+0000 7f7580b9d700 1 -- 172.21.15.50:0/260955204 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f757c06a160 msgr2=0x7f757c0abed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:21:43.857 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:43.855+0000 7f7580b9d700 1 --2- 172.21.15.50:0/260955204 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f757c06a160 0x7f757c0abed0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f757c06d010 tx=0x7f7574009840 comp rx=0 tx=0).stop 2023-10-06T01:21:43.857 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:43.855+0000 7f7580b9d700 1 -- 172.21.15.50:0/260955204 shutdown_connections 2023-10-06T01:21:43.857 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:43.855+0000 7f7580b9d700 1 --2- 172.21.15.50:0/260955204 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f757c06a160 0x7f757c0abed0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:21:43.857 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:43.855+0000 7f7580b9d700 1 --2- 172.21.15.50:0/260955204 >> v2:172.21.15.155:3300/0 conn(0x7f757c0af220 0x7f757c069c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:21:43.858 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:43.855+0000 7f7580b9d700 1 -- 172.21.15.50:0/260955204 >> 172.21.15.50:0/260955204 conn(0x7f757c0ccde0 msgr2=0x7f757c069510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:21:43.858 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:43.855+0000 7f7580b9d700 1 -- 172.21.15.50:0/260955204 shutdown_connections 2023-10-06T01:21:43.858 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:43.855+0000 7f7580b9d700 1 -- 172.21.15.50:0/260955204 wait complete. 2023-10-06T01:21:43.860 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:43.856+0000 7f7580b9d700 1 Processor -- start 2023-10-06T01:21:43.860 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:43.857+0000 7f7580b9d700 1 -- start start 2023-10-06T01:21:43.860 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:43.857+0000 7f7580b9d700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f757c06a160 0x7f757c13db70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:21:43.860 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:43.858+0000 7f7580b9d700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f757c0af220 0x7f757c159860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:21:43.860 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:43.858+0000 7f7580b9d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f757c159490 0x7f757c159da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:21:43.860 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:43.858+0000 7f7580b9d700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f757c15a2e0 con 0x7f757c159490 2023-10-06T01:21:43.860 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:43.858+0000 7f7580b9d700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f757c0c9eb0 con 0x7f757c0af220 2023-10-06T01:21:43.860 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:43.858+0000 7f7580b9d700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f757c0c92a0 con 0x7f757c06a160 2023-10-06T01:21:43.860 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:43.858+0000 7f757bfff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f757c159490 0x7f757c159da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:21:43.861 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:43.858+0000 7f757bfff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f757c159490 0x7f757c159da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:42242/0 (socket says 172.21.15.50:42242) 2023-10-06T01:21:43.861 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:43.858+0000 7f757bfff700 1 -- 172.21.15.50:0/898541762 learned_addr learned my addr 172.21.15.50:0/898541762 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-06T01:21:43.861 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:43.858+0000 7f757affd700 1 --2- 172.21.15.50:0/898541762 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f757c0af220 0x7f757c159860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:21:43.861 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:43.858+0000 7f757b7fe700 1 --2- 172.21.15.50:0/898541762 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f757c06a160 0x7f757c13db70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:21:43.861 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:43.858+0000 7f757bfff700 1 -- 172.21.15.50:0/898541762 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f757c06a160 msgr2=0x7f757c13db70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:21:43.861 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:43.858+0000 7f757bfff700 1 --2- 172.21.15.50:0/898541762 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f757c06a160 0x7f757c13db70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:21:43.861 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:43.858+0000 7f757bfff700 1 -- 172.21.15.50:0/898541762 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f757c0af220 msgr2=0x7f757c159860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:21:43.861 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:43.858+0000 7f757bfff700 1 --2- 172.21.15.50:0/898541762 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f757c0af220 0x7f757c159860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:21:43.861 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:43.858+0000 7f757bfff700 1 -- 172.21.15.50:0/898541762 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7574009ae0 con 0x7f757c159490 2023-10-06T01:21:43.861 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:43.858+0000 7f757b7fe700 1 --2- 172.21.15.50:0/898541762 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f757c06a160 0x7f757c13db70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T01:21:43.862 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:43.859+0000 7f757bfff700 1 --2- 172.21.15.50:0/898541762 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f757c159490 0x7f757c159da0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f7574009ab0 tx=0x7f7574018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:21:43.862 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:43.859+0000 7f75637fe700 1 -- 172.21.15.50:0/898541762 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7574008c60 con 0x7f757c159490 2023-10-06T01:21:43.862 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:43.859+0000 7f75637fe700 1 -- 172.21.15.50:0/898541762 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7574008dc0 con 0x7f757c159490 2023-10-06T01:21:43.862 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:43.859+0000 7f75637fe700 1 -- 172.21.15.50:0/898541762 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75740256b0 con 0x7f757c159490 2023-10-06T01:21:43.862 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:43.859+0000 7f7580b9d700 1 -- 172.21.15.50:0/898541762 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f757c0c9580 con 0x7f757c159490 2023-10-06T01:21:43.862 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:43.859+0000 7f7580b9d700 1 -- 172.21.15.50:0/898541762 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f757c0c9b40 con 0x7f757c159490 2023-10-06T01:21:43.863 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:43.860+0000 7f7580b9d700 1 -- 172.21.15.50:0/898541762 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f757c064f50 con 0x7f757c159490 2023-10-06T01:21:43.863 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:43.861+0000 7f75637fe700 1 -- 172.21.15.50:0/898541762 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f7574003040 con 0x7f757c159490 2023-10-06T01:21:43.863 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:43.862+0000 7f75637fe700 1 --2- 172.21.15.50:0/898541762 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f7568066f30 0x7f75680693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:21:43.863 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:43.862+0000 7f75637fe700 1 -- 172.21.15.50:0/898541762 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f75740865a0 con 0x7f757c159490 2023-10-06T01:21:43.863 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:43.862+0000 7f757b7fe700 1 --2- 172.21.15.50:0/898541762 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f7568066f30 0x7f75680693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:21:43.864 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:43.863+0000 7f757b7fe700 1 --2- 172.21.15.50:0/898541762 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f7568066f30 0x7f75680693e0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f756c0018d0 tx=0x7f756c009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:21:43.867 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:43.866+0000 7f75637fe700 1 -- 172.21.15.50:0/898541762 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f7574053320 con 0x7f757c159490 2023-10-06T01:21:44.071 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:44.070+0000 7f7580b9d700 1 -- 172.21.15.50:0/898541762 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f757c0ca020 con 0x7f757c159490 2023-10-06T01:21:44.072 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:44.071+0000 7f75637fe700 1 -- 172.21.15.50:0/898541762 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+18707 (secure 0 0 0) 0x7f7574008f30 con 0x7f757c159490 2023-10-06T01:21:44.072 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-10-06T01:21:44.072 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":25,"fsid":"0bfd9a6b-1587-4fe4-a89e-e43c00286b4e","created":"2023-10-06T01:21:16.828801+0000","modified":"2023-10-06T01:21:41.329781+0000","last_up_change":"2023-10-06T01:21:28.584523+0000","last_in_change":"2023-10-06T01:21:20.179863+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-10-06T01:21:29.304225+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":".mgr","create_time":"2023-10-06T01:21:29.835490+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-06T01:21:34.675315+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-06T01:21:35.753991+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-10-06T01:21:38.853108+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"9060727a-3959-4de3-8363-c5c5d7826c9a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":87837},{"type":"v1","addr":"172.21.15.50:6801","nonce":87837}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":87837},{"type":"v1","addr":"172.21.15.50:6803","nonce":87837}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":87837},{"type":"v1","addr":"172.21.15.50:6807","nonce":87837}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":87837},{"type":"v1","addr":"172.21.15.50:6805","nonce":87837}]},"public_addr":"172.21.15.50:6801/87837","cluster_addr":"172.21.15.50:6803/87837","heartbeat_back_addr":"172.21.15.50:6807/87837","heartbeat_front_addr":"172.21.15.50:6805/87837","state":["exists","up"]},{"osd":1,"uuid":"5ad9ef12-b579-47ea-b690-90ba887e2cef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":87853},{"type":"v1","addr":"172.21.15.50:6809","nonce":87853}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":87853},{"type":"v1","addr":"172.21.15.50:6811","nonce":87853}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":87853},{"type":"v1","addr":"172.21.15.50:6815","nonce":87853}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":87853},{"type":"v1","addr":"172.21.15.50:6813","nonce":87853}]},"public_addr":"172.21.15.50:6809/87853","cluster_addr":"172.21.15.50:6811/87853","heartbeat_back_addr":"172.21.15.50:6815/87853","heartbeat_front_addr":"172.21.15.50:6813/87853","state":["exists","up"]},{"osd":2,"uuid":"c7aee044-6f75-436f-90e1-ba42a57359bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6821","nonce":87855},{"type":"v1","addr":"172.21.15.50:6822","nonce":87855}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6824","nonce":87855},{"type":"v1","addr":"172.21.15.50:6826","nonce":87855}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":87855},{"type":"v1","addr":"172.21.15.50:6831","nonce":87855}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":87855},{"type":"v1","addr":"172.21.15.50:6829","nonce":87855}]},"public_addr":"172.21.15.50:6822/87855","cluster_addr":"172.21.15.50:6826/87855","heartbeat_back_addr":"172.21.15.50:6831/87855","heartbeat_front_addr":"172.21.15.50:6829/87855","state":["exists","up"]},{"osd":3,"uuid":"d9b901c8-e8b2-44af-9508-f453120a96c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":87856},{"type":"v1","addr":"172.21.15.50:6817","nonce":87856}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":87856},{"type":"v1","addr":"172.21.15.50:6819","nonce":87856}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6825","nonce":87856},{"type":"v1","addr":"172.21.15.50:6827","nonce":87856}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6820","nonce":87856},{"type":"v1","addr":"172.21.15.50:6823","nonce":87856}]},"public_addr":"172.21.15.50:6817/87856","cluster_addr":"172.21.15.50:6819/87856","heartbeat_back_addr":"172.21.15.50:6827/87856","heartbeat_front_addr":"172.21.15.50:6823/87856","state":["exists","up"]},{"osd":4,"uuid":"2b3c6b38-e3e9-4301-9445-60fd3fe8ce03","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":85805},{"type":"v1","addr":"172.21.15.155:6801","nonce":85805}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":85805},{"type":"v1","addr":"172.21.15.155:6803","nonce":85805}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6806","nonce":85805},{"type":"v1","addr":"172.21.15.155:6807","nonce":85805}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6804","nonce":85805},{"type":"v1","addr":"172.21.15.155:6805","nonce":85805}]},"public_addr":"172.21.15.155:6801/85805","cluster_addr":"172.21.15.155:6803/85805","heartbeat_back_addr":"172.21.15.155:6807/85805","heartbeat_front_addr":"172.21.15.155:6805/85805","state":["exists","up"]},{"osd":5,"uuid":"417b5f8f-65f1-4c94-91a7-a6ce03fe1679","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6816","nonce":85807},{"type":"v1","addr":"172.21.15.155:6818","nonce":85807}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6820","nonce":85807},{"type":"v1","addr":"172.21.15.155:6822","nonce":85807}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6828","nonce":85807},{"type":"v1","addr":"172.21.15.155:6830","nonce":85807}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6824","nonce":85807},{"type":"v1","addr":"172.21.15.155:6826","nonce":85807}]},"public_addr":"172.21.15.155:6818/85807","cluster_addr":"172.21.15.155:6822/85807","heartbeat_back_addr":"172.21.15.155:6830/85807","heartbeat_front_addr":"172.21.15.155:6826/85807","state":["exists","up"]},{"osd":6,"uuid":"c150cff3-aee4-4714-9c08-d182b1ba9ffd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6808","nonce":85806},{"type":"v1","addr":"172.21.15.155:6809","nonce":85806}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6810","nonce":85806},{"type":"v1","addr":"172.21.15.155:6811","nonce":85806}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6814","nonce":85806},{"type":"v1","addr":"172.21.15.155:6815","nonce":85806}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6812","nonce":85806},{"type":"v1","addr":"172.21.15.155:6813","nonce":85806}]},"public_addr":"172.21.15.155:6809/85806","cluster_addr":"172.21.15.155:6811/85806","heartbeat_back_addr":"172.21.15.155:6815/85806","heartbeat_front_addr":"172.21.15.155:6813/85806","state":["exists","up"]},{"osd":7,"uuid":"71107f0e-04d1-4e72-a0ec-0faf6af003e7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6817","nonce":85832},{"type":"v1","addr":"172.21.15.155:6819","nonce":85832}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6821","nonce":85832},{"type":"v1","addr":"172.21.15.155:6823","nonce":85832}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6829","nonce":85832},{"type":"v1","addr":"172.21.15.155:6831","nonce":85832}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6825","nonce":85832},{"type":"v1","addr":"172.21.15.155:6827","nonce":85832}]},"public_addr":"172.21.15.155:6819/85832","cluster_addr":"172.21.15.155:6823/85832","heartbeat_back_addr":"172.21.15.155:6831/85832","heartbeat_front_addr":"172.21.15.155:6827/85832","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:21:25.423389+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:21:25.472661+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:21:25.817562+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:21:25.551257+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:21:25.407818+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:21:25.557976+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:21:25.747299+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:21:25.827576+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T01:21:44.075 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:44.074+0000 7f7580b9d700 1 -- 172.21.15.50:0/898541762 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f7568066f30 msgr2=0x7f75680693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:21:44.075 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:44.074+0000 7f7580b9d700 1 --2- 172.21.15.50:0/898541762 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f7568066f30 0x7f75680693e0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f756c0018d0 tx=0x7f756c009040 comp rx=0 tx=0).stop 2023-10-06T01:21:44.075 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:44.074+0000 7f7580b9d700 1 -- 172.21.15.50:0/898541762 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f757c159490 msgr2=0x7f757c159da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:21:44.075 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:44.074+0000 7f7580b9d700 1 --2- 172.21.15.50:0/898541762 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f757c159490 0x7f757c159da0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f7574009ab0 tx=0x7f7574018000 comp rx=0 tx=0).stop 2023-10-06T01:21:44.075 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:44.074+0000 7f7580b9d700 1 -- 172.21.15.50:0/898541762 shutdown_connections 2023-10-06T01:21:44.075 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:44.074+0000 7f7580b9d700 1 --2- 172.21.15.50:0/898541762 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f757c159490 0x7f757c159da0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:21:44.075 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:44.074+0000 7f7580b9d700 1 --2- 172.21.15.50:0/898541762 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f757c06a160 0x7f757c13db70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:21:44.076 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:44.074+0000 7f7580b9d700 1 --2- 172.21.15.50:0/898541762 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f7568066f30 0x7f75680693e0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:21:44.076 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:44.074+0000 7f7580b9d700 1 --2- 172.21.15.50:0/898541762 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f757c0af220 0x7f757c159860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:21:44.076 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:44.074+0000 7f7580b9d700 1 -- 172.21.15.50:0/898541762 >> 172.21.15.50:0/898541762 conn(0x7f757c0ccde0 msgr2=0x7f757c153520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:21:44.076 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:44.074+0000 7f7580b9d700 1 -- 172.21.15.50:0/898541762 shutdown_connections 2023-10-06T01:21:44.076 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:44.074+0000 7f7580b9d700 1 -- 172.21.15.50:0/898541762 wait complete. 2023-10-06T01:21:44.495 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 7, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-10-06T01:21:36.779774+0000', 'modified': '2023-10-06T01:21:41.833429+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4302}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4302': {'gid': 4302, 'name': 'd', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.155:6837/3434423585', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.155:6835', 'nonce': 3434423585}, {'type': 'v1', 'addr': '172.21.15.155:6837', 'nonce': 3434423585}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138320759226367, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [4, 5], 'metadata_pool': 3, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 1} 2023-10-06T01:21:44.495 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-10-06T01:21:44.495 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.d status 2023-10-06T01:21:44.684 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:44.683+0000 7fe54cf9d700 1 Processor -- start 2023-10-06T01:21:44.684 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:44.683+0000 7fe54cf9d700 1 -- start start 2023-10-06T01:21:44.685 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:44.684+0000 7fe54cf9d700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe548159480 0x7fe5480b30d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:21:44.685 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:44.684+0000 7fe54cf9d700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fe5480b2140 0x7fe5480b25c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:21:44.685 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:44.684+0000 7fe54cf9d700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe5480cb7e0 con 0x7fe5480b3610 2023-10-06T01:21:44.685 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:44.684+0000 7fe54cf9d700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe5480b08a0 con 0x7fe5480b2140 2023-10-06T01:21:44.685 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:44.684+0000 7fe54cf9d700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5480cb190 con 0x7fe548159480 2023-10-06T01:21:44.686 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:44.684+0000 7fe547fff700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fe5480b2140 0x7fe5480b25c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:21:44.686 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:44.685+0000 7fe547fff700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fe5480b2140 0x7fe5480b25c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:42250/0 (socket says 172.21.15.50:42250) 2023-10-06T01:21:44.686 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:44.685+0000 7fe547fff700 1 -- 172.21.15.50:0/1679538194 learned_addr learned my addr 172.21.15.50:0/1679538194 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-06T01:21:44.687 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:44.685+0000 7fe5477fe700 1 --2- 172.21.15.50:0/1679538194 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe548159480 0x7fe5480b30d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:21:44.687 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:44.685+0000 7fe547fff700 1 -- 172.21.15.50:0/1679538194 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe548159480 msgr2=0x7fe5480b30d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:21:44.687 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:44.685+0000 7fe547fff700 1 --2- 172.21.15.50:0/1679538194 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe548159480 0x7fe5480b30d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:21:44.688 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:44.685+0000 7fe547fff700 1 -- 172.21.15.50:0/1679538194 >> v1:172.21.15.155:6789/0 conn(0x7fe5480b3610 legacy=0x7fe5480cbc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:21:44.688 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:44.685+0000 7fe547fff700 1 -- 172.21.15.50:0/1679538194 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5480cb470 con 0x7fe5480b2140 2023-10-06T01:21:44.688 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:44.685+0000 7fe5477fe700 1 --2- 172.21.15.50:0/1679538194 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe548159480 0x7fe5480b30d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T01:21:44.688 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:44.685+0000 7fe547fff700 1 --2- 172.21.15.50:0/1679538194 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe5480b2140 0x7fe5480b25c0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fe540009f20 tx=0x7fe540009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=16f925c122570601 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:21:44.688 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:44.686+0000 7fe5467fc700 1 -- 172.21.15.50:0/1679538194 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe54000e070 con 0x7fe5480b2140 2023-10-06T01:21:44.688 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:44.686+0000 7fe5467fc700 1 -- 172.21.15.50:0/1679538194 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe54000ba80 con 0x7fe5480b2140 2023-10-06T01:21:44.688 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:44.686+0000 7fe5467fc700 1 -- 172.21.15.50:0/1679538194 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5400092e0 con 0x7fe5480b2140 2023-10-06T01:21:44.688 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:44.686+0000 7fe54cf9d700 1 -- 172.21.15.50:0/1679538194 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe5480b2140 msgr2=0x7fe5480b25c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:21:44.688 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:44.686+0000 7fe54cf9d700 1 --2- 172.21.15.50:0/1679538194 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe5480b2140 0x7fe5480b25c0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fe540009f20 tx=0x7fe540009840 comp rx=0 tx=0).stop 2023-10-06T01:21:44.688 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:44.686+0000 7fe54cf9d700 1 -- 172.21.15.50:0/1679538194 shutdown_connections 2023-10-06T01:21:44.688 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:44.686+0000 7fe54cf9d700 1 --2- 172.21.15.50:0/1679538194 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe5480b2140 0x7fe5480b25c0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:21:44.689 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:44.686+0000 7fe54cf9d700 1 --2- 172.21.15.50:0/1679538194 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe548159480 0x7fe5480b30d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:21:44.689 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:44.686+0000 7fe54cf9d700 1 -- 172.21.15.50:0/1679538194 >> 172.21.15.50:0/1679538194 conn(0x7fe54806ed20 msgr2=0x7fe54806f120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:21:44.689 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:44.686+0000 7fe54cf9d700 1 -- 172.21.15.50:0/1679538194 shutdown_connections 2023-10-06T01:21:44.689 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:44.686+0000 7fe54cf9d700 1 -- 172.21.15.50:0/1679538194 wait complete. 2023-10-06T01:21:44.691 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:44.688+0000 7fe54cf9d700 1 Processor -- start 2023-10-06T01:21:44.691 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:44.688+0000 7fe54cf9d700 1 -- start start 2023-10-06T01:21:44.691 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:44.689+0000 7fe54cf9d700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe5480b2140 0x7fe5480cffc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:21:44.691 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:44.689+0000 7fe54cf9d700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe5480b3610 0x7fe5480cf560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:21:44.691 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:44.689+0000 7fe54cf9d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe548159480 0x7fe5480c5520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:21:44.691 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:44.689+0000 7fe54cf9d700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5480c4b00 con 0x7fe548159480 2023-10-06T01:21:44.692 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:44.689+0000 7fe54cf9d700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5480c4670 con 0x7fe5480b2140 2023-10-06T01:21:44.692 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:44.689+0000 7fe54cf9d700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5480c3a60 con 0x7fe5480b3610 2023-10-06T01:21:44.692 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:44.689+0000 7fe547fff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe548159480 0x7fe5480c5520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:21:44.692 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:44.689+0000 7fe547fff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe548159480 0x7fe5480c5520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:42262/0 (socket says 172.21.15.50:42262) 2023-10-06T01:21:44.692 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:44.689+0000 7fe547fff700 1 -- 172.21.15.50:0/2038860184 learned_addr learned my addr 172.21.15.50:0/2038860184 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-06T01:21:44.692 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:44.689+0000 7fe546ffd700 1 --2- 172.21.15.50:0/2038860184 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe5480b3610 0x7fe5480cf560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:21:44.692 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:44.689+0000 7fe547fff700 1 -- 172.21.15.50:0/2038860184 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe5480b3610 msgr2=0x7fe5480cf560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:21:44.692 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:44.689+0000 7fe5477fe700 1 --2- 172.21.15.50:0/2038860184 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe5480b2140 0x7fe5480cffc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:21:44.692 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:44.689+0000 7fe547fff700 1 --2- 172.21.15.50:0/2038860184 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe5480b3610 0x7fe5480cf560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:21:44.692 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:44.689+0000 7fe547fff700 1 -- 172.21.15.50:0/2038860184 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe5480b2140 msgr2=0x7fe5480cffc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:21:44.692 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:44.689+0000 7fe547fff700 1 --2- 172.21.15.50:0/2038860184 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe5480b2140 0x7fe5480cffc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:21:44.693 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:44.689+0000 7fe547fff700 1 -- 172.21.15.50:0/2038860184 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe540009ae0 con 0x7fe548159480 2023-10-06T01:21:44.693 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:44.689+0000 7fe5477fe700 1 --2- 172.21.15.50:0/2038860184 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe5480b2140 0x7fe5480cffc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T01:21:44.693 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:44.689+0000 7fe546ffd700 1 --2- 172.21.15.50:0/2038860184 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe5480b3610 0x7fe5480cf560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T01:21:44.693 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:44.690+0000 7fe547fff700 1 --2- 172.21.15.50:0/2038860184 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe548159480 0x7fe5480c5520 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fe54000b6c0 tx=0x7fe540018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:21:44.693 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:44.690+0000 7fe52f7fe700 1 -- 172.21.15.50:0/2038860184 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5400032f0 con 0x7fe548159480 2023-10-06T01:21:44.693 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:44.690+0000 7fe52f7fe700 1 -- 172.21.15.50:0/2038860184 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe540026460 con 0x7fe548159480 2023-10-06T01:21:44.693 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:44.690+0000 7fe52f7fe700 1 -- 172.21.15.50:0/2038860184 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe540026800 con 0x7fe548159480 2023-10-06T01:21:44.693 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:44.690+0000 7fe54cf9d700 1 -- 172.21.15.50:0/2038860184 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe5480c3d40 con 0x7fe548159480 2023-10-06T01:21:44.693 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:44.690+0000 7fe54cf9d700 1 -- 172.21.15.50:0/2038860184 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe5480c4300 con 0x7fe548159480 2023-10-06T01:21:44.694 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:44.692+0000 7fe52f7fe700 1 -- 172.21.15.50:0/2038860184 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fe540003040 con 0x7fe548159480 2023-10-06T01:21:44.694 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:44.693+0000 7fe52f7fe700 1 --2- 172.21.15.50:0/2038860184 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7fe534066f30 0x7fe5340693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:21:44.694 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:44.693+0000 7fe52f7fe700 1 -- 172.21.15.50:0/2038860184 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6809+0+0 (secure 0 0 0) 0x7fe5400869b0 con 0x7fe548159480 2023-10-06T01:21:44.694 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:44.693+0000 7fe5477fe700 1 --2- 172.21.15.50:0/2038860184 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7fe534066f30 0x7fe5340693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:21:44.695 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:44.694+0000 7fe5477fe700 1 --2- 172.21.15.50:0/2038860184 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7fe534066f30 0x7fe5340693e0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fe538006f00 tx=0x7fe538008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:21:44.696 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:44.695+0000 7fe55c963b80 1 Processor -- start 2023-10-06T01:21:44.696 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:44.695+0000 7fe55c963b80 1 -- start start 2023-10-06T01:21:44.699 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:44.696+0000 7fe55c963b80 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x55764cf92e50 0x55764cf6dcc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:21:44.699 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:44.696+0000 7fe55c963b80 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55764cf732c0 0x55764cf6e200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:21:44.700 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:44.696+0000 7fe55c963b80 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55764cf74a10 0x55764cf6e740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:21:44.700 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:44.696+0000 7fe55c963b80 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x55764cec8a70 con 0x55764cf74a10 2023-10-06T01:21:44.700 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:44.696+0000 7fe55c963b80 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x55764cec6270 con 0x55764cf732c0 2023-10-06T01:21:44.700 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:44.696+0000 7fe55c963b80 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x55764cec2060 con 0x55764cf92e50 2023-10-06T01:21:44.700 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:44.696+0000 7fe547fff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55764cf74a10 0x55764cf6e740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:21:44.700 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:44.696+0000 7fe547fff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55764cf74a10 0x55764cf6e740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:42272/0 (socket says 172.21.15.50:42272) 2023-10-06T01:21:44.700 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:44.696+0000 7fe547fff700 1 -- 172.21.15.50:0/950438801 learned_addr learned my addr 172.21.15.50:0/950438801 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-06T01:21:44.700 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:44.696+0000 7fe5477fe700 1 --2- 172.21.15.50:0/950438801 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x55764cf92e50 0x55764cf6dcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:21:44.700 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:44.696+0000 7fe546ffd700 1 --2- 172.21.15.50:0/950438801 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55764cf732c0 0x55764cf6e200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:21:44.701 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:44.697+0000 7fe547fff700 1 -- 172.21.15.50:0/950438801 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x55764cf92e50 msgr2=0x55764cf6dcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:21:44.701 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:44.697+0000 7fe547fff700 1 --2- 172.21.15.50:0/950438801 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x55764cf92e50 0x55764cf6dcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:21:44.701 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:44.697+0000 7fe547fff700 1 -- 172.21.15.50:0/950438801 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55764cf732c0 msgr2=0x55764cf6e200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:21:44.701 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:44.697+0000 7fe547fff700 1 --2- 172.21.15.50:0/950438801 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55764cf732c0 0x55764cf6e200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:21:44.701 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:44.697+0000 7fe547fff700 1 -- 172.21.15.50:0/950438801 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55764cd5c270 con 0x55764cf74a10 2023-10-06T01:21:44.701 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:44.697+0000 7fe546ffd700 1 --2- 172.21.15.50:0/950438801 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55764cf732c0 0x55764cf6e200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T01:21:44.701 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:44.697+0000 7fe547fff700 1 --2- 172.21.15.50:0/950438801 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55764cf74a10 0x55764cf6e740 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fe5400269b0 tx=0x7fe540084940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2349bd8cef50579b server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:21:44.701 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:44.697+0000 7fe52cff9700 1 -- 172.21.15.50:0/950438801 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe54005e390 con 0x55764cf74a10 2023-10-06T01:21:44.701 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:44.697+0000 7fe52cff9700 1 -- 172.21.15.50:0/950438801 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe540009360 con 0x55764cf74a10 2023-10-06T01:21:44.701 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:44.697+0000 7fe52cff9700 1 -- 172.21.15.50:0/950438801 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe54002fc20 con 0x55764cf74a10 2023-10-06T01:21:44.702 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:44.697+0000 7fe55c963b80 1 -- 172.21.15.50:0/950438801 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55764cf74a10 msgr2=0x55764cf6e740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:21:44.702 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:44.697+0000 7fe55c963b80 1 --2- 172.21.15.50:0/950438801 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55764cf74a10 0x55764cf6e740 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fe5400269b0 tx=0x7fe540084940 comp rx=0 tx=0).stop 2023-10-06T01:21:44.702 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:44.698+0000 7fe55c963b80 1 -- 172.21.15.50:0/950438801 shutdown_connections 2023-10-06T01:21:44.702 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:44.698+0000 7fe55c963b80 1 --2- 172.21.15.50:0/950438801 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55764cf74a10 0x55764cf6e740 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:21:44.702 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:44.698+0000 7fe55c963b80 1 --2- 172.21.15.50:0/950438801 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x55764cf92e50 0x55764cf6dcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:21:44.702 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:44.698+0000 7fe55c963b80 1 --2- 172.21.15.50:0/950438801 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55764cf732c0 0x55764cf6e200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:21:44.702 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:44.698+0000 7fe55c963b80 1 -- 172.21.15.50:0/950438801 >> 172.21.15.50:0/950438801 conn(0x55764cf72e80 msgr2=0x55764cf736b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:21:44.702 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:44.698+0000 7fe55c963b80 1 -- 172.21.15.50:0/950438801 shutdown_connections 2023-10-06T01:21:44.702 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:44.698+0000 7fe55c963b80 1 -- 172.21.15.50:0/950438801 wait complete. 2023-10-06T01:21:44.703 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:44.698+0000 7fe55c963b80 1 -- start start 2023-10-06T01:21:44.703 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:44.699+0000 7fe55c963b80 1 Processor -- start 2023-10-06T01:21:44.707 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:44.699+0000 7fe55c963b80 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55764cf732c0 0x55764cf9ad00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:21:44.707 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:44.700+0000 7fe55c963b80 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x55764cf74a10 0x55764cf81ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:21:44.707 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:44.700+0000 7fe55c963b80 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55764cf92e50 0x55764cfbc870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:21:44.707 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:44.700+0000 7fe55c963b80 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x55764ce6d890 con 0x55764cf732c0 2023-10-06T01:21:44.707 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:44.700+0000 7fe55c963b80 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x55764ce88ea0 con 0x55764cf92e50 2023-10-06T01:21:44.707 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:44.700+0000 7fe55c963b80 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x55764cd44e30 con 0x55764cf74a10 2023-10-06T01:21:44.707 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:44.700+0000 7fe55c963b80 10 client.0 _ll_register_callbacks cb 0x55764cf35020 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T01:21:44.707 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:44.700+0000 7fe5477fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55764cf732c0 0x55764cf9ad00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:21:44.707 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:44.700+0000 7fe5477fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55764cf732c0 0x55764cf9ad00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:42278/0 (socket says 172.21.15.50:42278) 2023-10-06T01:21:44.708 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:44.700+0000 7fe5477fe700 1 -- 172.21.15.50:0/1885043030 learned_addr learned my addr 172.21.15.50:0/1885043030 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-06T01:21:44.708 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:44.700+0000 7fe546ffd700 1 --2- 172.21.15.50:0/1885043030 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x55764cf74a10 0x55764cf81ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:21:44.708 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:44.700+0000 7fe547fff700 1 --2- 172.21.15.50:0/1885043030 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55764cf92e50 0x55764cfbc870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:21:44.708 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:44.700+0000 7fe5477fe700 1 -- 172.21.15.50:0/1885043030 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x55764cf74a10 msgr2=0x55764cf81ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:21:44.708 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:44.700+0000 7fe5477fe700 1 --2- 172.21.15.50:0/1885043030 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x55764cf74a10 0x55764cf81ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:21:44.708 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:44.700+0000 7fe5477fe700 1 -- 172.21.15.50:0/1885043030 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55764cf92e50 msgr2=0x55764cfbc870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:21:44.708 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:44.700+0000 7fe5477fe700 1 --2- 172.21.15.50:0/1885043030 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55764cf92e50 0x55764cfbc870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:21:44.708 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:44.700+0000 7fe5477fe700 1 -- 172.21.15.50:0/1885043030 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe5480c4300 con 0x55764cf732c0 2023-10-06T01:21:44.708 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:44.700+0000 7fe5477fe700 1 --2- 172.21.15.50:0/1885043030 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55764cf732c0 0x55764cf9ad00 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fe5380155f0 tx=0x7fe538015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e2abc12f69849f3a server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:21:44.708 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:44.700+0000 7fe525ffb700 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2023-10-06T01:21:44.708 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:44.701+0000 7fe525ffb700 1 -- 172.21.15.50:0/1885043030 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5380091d0 con 0x55764cf732c0 2023-10-06T01:21:44.709 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:44.701+0000 7fe525ffb700 1 -- 172.21.15.50:0/1885043030 <== mon.0 v2:172.21.15.50:3300/0 2 ==== osd_map(25..25 src has 1..25) v4 ==== 6809+0+0 (secure 0 0 0) 0x7fe538013600 con 0x55764cf732c0 2023-10-06T01:21:44.709 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:44.701+0000 7fe55c963b80 1 -- 172.21.15.50:0/1885043030 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55764cf66940 con 0x55764cf732c0 2023-10-06T01:21:44.709 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:44.701+0000 7fe525ffb700 1 -- 172.21.15.50:0/1885043030 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=7) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe5380139d0 con 0x55764cf732c0 2023-10-06T01:21:44.709 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:44.701+0000 7fe55c963b80 10 client.4446 fetch_fsmap learned FSMap version 7 2023-10-06T01:21:44.709 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:44.701+0000 7fe55c963b80 1 -- 172.21.15.50:0/1885043030 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=7,monmap=2+}) v3 -- 0x55764ccfefe0 con 0x55764cf732c0 2023-10-06T01:21:44.709 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:44.701+0000 7fe525ffb700 1 -- 172.21.15.50:0/1885043030 <== mon.0 v2:172.21.15.50:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55764cf66940 con 0x55764cf732c0 2023-10-06T01:21:44.709 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:44.701+0000 7fe525ffb700 1 -- 172.21.15.50:0/1885043030 <== mon.0 v2:172.21.15.50:3300/0 5 ==== fsmap(e 7) v1 ==== 3108+0+0 (secure 0 0 0) 0x7fe538020070 con 0x55764cf732c0 2023-10-06T01:21:44.709 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:44.702+0000 7fe55c963b80 10 client.4446 fetch_fsmap finished waiting for FSMap version 7 2023-10-06T01:21:44.709 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:44.702+0000 7fe55c963b80 10 client.4446 resolve_mds: resolved name 'd' to daemon mds.d 2023-10-06T01:21:44.709 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:44.702+0000 7fe55c963b80 20 client.4446 populate_metadata read hostname 'smithi050' 2023-10-06T01:21:44.710 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:44.702+0000 7fe55c963b80 1 --2- 172.21.15.50:0/1885043030 >> [v2:172.21.15.155:6835/3434423585,v1:172.21.15.155:6837/3434423585] conn(0x55764cf916f0 0x55764cf91ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:21:44.710 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:44.702+0000 7fe55c963b80 4 client.4446 mds_command: new command op to 4302 tid=0[{"prefix": "get_command_descriptions"}] 2023-10-06T01:21:44.710 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:44.702+0000 7fe55c963b80 1 -- 172.21.15.50:0/1885043030 --> [v2:172.21.15.155:6835/3434423585,v1:172.21.15.155:6837/3434423585] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55764cf43870 con 0x55764cf916f0 2023-10-06T01:21:44.710 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:44.702+0000 7fe546ffd700 1 --2- 172.21.15.50:0/1885043030 >> [v2:172.21.15.155:6835/3434423585,v1:172.21.15.155:6837/3434423585] conn(0x55764cf916f0 0x55764cf91ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:21:44.710 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:44.703+0000 7fe546ffd700 1 --2- 172.21.15.50:0/1885043030 >> [v2:172.21.15.155:6835/3434423585,v1:172.21.15.155:6837/3434423585] conn(0x55764cf916f0 0x55764cf91ac0 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=49407cd82c87f02c server_cookie=ba20a59c8231c0d9 in_seq=0 out_seq=0 2023-10-06T01:21:44.710 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:44.703+0000 7fe525ffb700 10 client.4446 ms_handle_connect on v2:172.21.15.155:6835/3434423585 2023-10-06T01:21:44.710 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:44.703+0000 7fe525ffb700 1 -- 172.21.15.50:0/1885043030 <== mds.0 v2:172.21.15.155:6835/3434423585 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+16954 (crc 0 0 0) 0x55764cf43870 con 0x55764cf916f0 2023-10-06T01:21:44.710 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:44.703+0000 7fe525ffb700 10 client.4446 handle_command_reply: tid=0 2023-10-06T01:21:44.710 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:44.703+0000 7fe55c963b80 1 client.4446 shutdown 2023-10-06T01:21:44.711 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:44.704+0000 7fe55c963b80 1 -- 172.21.15.50:0/1885043030 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55764cf732c0 msgr2=0x55764cf9ad00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:21:44.711 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:44.704+0000 7fe55c963b80 1 --2- 172.21.15.50:0/1885043030 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55764cf732c0 0x55764cf9ad00 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fe5380155f0 tx=0x7fe538015000 comp rx=0 tx=0).stop 2023-10-06T01:21:44.711 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:44.704+0000 7fe55c963b80 1 -- 172.21.15.50:0/1885043030 shutdown_connections 2023-10-06T01:21:44.711 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:44.704+0000 7fe55c963b80 1 --2- 172.21.15.50:0/1885043030 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55764cf92e50 0x55764cfbc870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:21:44.711 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:44.704+0000 7fe55c963b80 1 --2- 172.21.15.50:0/1885043030 >> [v2:172.21.15.155:6835/3434423585,v1:172.21.15.155:6837/3434423585] conn(0x55764cf916f0 0x55764cf91ac0 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:21:44.711 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:44.704+0000 7fe55c963b80 1 --2- 172.21.15.50:0/1885043030 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55764cf732c0 0x55764cf9ad00 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:21:44.711 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:44.704+0000 7fe55c963b80 1 --2- 172.21.15.50:0/1885043030 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x55764cf74a10 0x55764cf81ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:21:44.711 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:44.704+0000 7fe55c963b80 1 -- 172.21.15.50:0/1885043030 >> 172.21.15.50:0/1885043030 conn(0x55764cf72e80 msgr2=0x55764cf71c20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:21:44.711 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:44.704+0000 7fe525ffb700 0 client.4446 ms_handle_reset on v2:172.21.15.155:6835/3434423585 2023-10-06T01:21:44.712 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:44.704+0000 7fe55c963b80 1 -- 172.21.15.50:0/1885043030 shutdown_connections 2023-10-06T01:21:44.712 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:44.704+0000 7fe55c963b80 1 -- 172.21.15.50:0/1885043030 wait complete. 2023-10-06T01:21:44.712 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:44.704+0000 7fe55c963b80 20 client.4446 trim_cache size 0 max 16384 2023-10-06T01:21:44.722 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:44.721+0000 7fe55c963b80 1 Processor -- start 2023-10-06T01:21:44.722 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:44.721+0000 7fe55c963b80 1 -- start start 2023-10-06T01:21:44.724 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:44.722+0000 7fe55c963b80 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x55764cf732c0 0x55764cf71d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:21:44.724 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:44.722+0000 7fe55c963b80 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55764cf74a10 0x55764cf91c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:21:44.724 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:44.722+0000 7fe55c963b80 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55764cf92e50 0x55764cf6dad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:21:44.724 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:44.722+0000 7fe55c963b80 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x55764cf94070 con 0x55764cf92e50 2023-10-06T01:21:44.724 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:44.722+0000 7fe55c963b80 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x55764cfa1640 con 0x55764cf74a10 2023-10-06T01:21:44.724 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:44.722+0000 7fe55c963b80 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x55764cf4a280 con 0x55764cf732c0 2023-10-06T01:21:44.724 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:44.722+0000 7fe547fff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55764cf92e50 0x55764cf6dad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:21:44.725 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:44.722+0000 7fe547fff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55764cf92e50 0x55764cf6dad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:42292/0 (socket says 172.21.15.50:42292) 2023-10-06T01:21:44.725 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:44.722+0000 7fe547fff700 1 -- 172.21.15.50:0/979633034 learned_addr learned my addr 172.21.15.50:0/979633034 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-06T01:21:44.725 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:44.722+0000 7fe5477fe700 1 --2- 172.21.15.50:0/979633034 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x55764cf732c0 0x55764cf71d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:21:44.725 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:44.722+0000 7fe546ffd700 1 --2- 172.21.15.50:0/979633034 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55764cf74a10 0x55764cf91c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:21:44.725 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:44.723+0000 7fe547fff700 1 -- 172.21.15.50:0/979633034 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x55764cf732c0 msgr2=0x55764cf71d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:21:44.725 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:44.723+0000 7fe547fff700 1 --2- 172.21.15.50:0/979633034 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x55764cf732c0 0x55764cf71d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:21:44.725 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:44.723+0000 7fe547fff700 1 -- 172.21.15.50:0/979633034 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55764cf74a10 msgr2=0x55764cf91c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:21:44.725 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:44.723+0000 7fe547fff700 1 --2- 172.21.15.50:0/979633034 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55764cf74a10 0x55764cf91c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:21:44.726 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:44.723+0000 7fe547fff700 1 -- 172.21.15.50:0/979633034 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55764ce90780 con 0x55764cf92e50 2023-10-06T01:21:44.726 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:44.723+0000 7fe546ffd700 1 --2- 172.21.15.50:0/979633034 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55764cf74a10 0x55764cf91c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T01:21:44.726 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:44.723+0000 7fe547fff700 1 --2- 172.21.15.50:0/979633034 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55764cf92e50 0x55764cf6dad0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fe5400538f0 tx=0x7fe54006d000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5a45ff70e9f40cdc server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:21:44.726 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:44.723+0000 7fe52d7fa700 1 -- 172.21.15.50:0/979633034 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe540073070 con 0x55764cf92e50 2023-10-06T01:21:44.726 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:44.723+0000 7fe52d7fa700 1 -- 172.21.15.50:0/979633034 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe5400571c0 con 0x55764cf92e50 2023-10-06T01:21:44.726 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:44.723+0000 7fe52d7fa700 1 -- 172.21.15.50:0/979633034 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe54005a640 con 0x55764cf92e50 2023-10-06T01:21:44.730 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:44.724+0000 7fe55c963b80 1 -- 172.21.15.50:0/979633034 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55764cf92e50 msgr2=0x55764cf6dad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:21:44.730 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:44.724+0000 7fe55c963b80 1 --2- 172.21.15.50:0/979633034 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55764cf92e50 0x55764cf6dad0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fe5400538f0 tx=0x7fe54006d000 comp rx=0 tx=0).stop 2023-10-06T01:21:44.732 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:44.724+0000 7fe55c963b80 1 -- 172.21.15.50:0/979633034 shutdown_connections 2023-10-06T01:21:44.732 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:44.724+0000 7fe55c963b80 1 --2- 172.21.15.50:0/979633034 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55764cf92e50 0x55764cf6dad0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:21:44.732 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:44.724+0000 7fe55c963b80 1 --2- 172.21.15.50:0/979633034 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x55764cf732c0 0x55764cf71d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:21:44.733 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:44.724+0000 7fe55c963b80 1 --2- 172.21.15.50:0/979633034 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55764cf74a10 0x55764cf91c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:21:44.733 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:44.724+0000 7fe55c963b80 1 -- 172.21.15.50:0/979633034 >> 172.21.15.50:0/979633034 conn(0x55764cf72e80 msgr2=0x55764cf6fae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:21:44.733 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:44.724+0000 7fe55c963b80 1 -- 172.21.15.50:0/979633034 shutdown_connections 2023-10-06T01:21:44.733 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:44.724+0000 7fe55c963b80 1 -- 172.21.15.50:0/979633034 wait complete. 2023-10-06T01:21:44.733 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:44.724+0000 7fe55c963b80 1 -- start start 2023-10-06T01:21:44.733 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:44.725+0000 7fe55c963b80 1 Processor -- start 2023-10-06T01:21:44.733 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:44.725+0000 7fe55c963b80 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55764cf732c0 0x55764d0038a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:21:44.733 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:44.725+0000 7fe55c963b80 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x55764cf74a10 0x55764cf91c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:21:44.733 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:44.726+0000 7fe55c963b80 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55764cf92e50 0x55764cf921d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:21:44.733 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:44.726+0000 7fe55c963b80 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x55764cfa1600 con 0x55764cf92e50 2023-10-06T01:21:44.734 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:44.726+0000 7fe55c963b80 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x55764d017450 con 0x55764cf732c0 2023-10-06T01:21:44.734 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:44.726+0000 7fe55c963b80 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x55764d003de0 con 0x55764cf74a10 2023-10-06T01:21:44.734 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:44.726+0000 7fe55c963b80 10 client.0 _ll_register_callbacks cb 0x55764cf35020 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T01:21:44.734 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:44.726+0000 7fe547fff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55764cf92e50 0x55764cf921d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:21:44.734 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:44.726+0000 7fe547fff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55764cf92e50 0x55764cf921d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:42298/0 (socket says 172.21.15.50:42298) 2023-10-06T01:21:44.734 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:44.726+0000 7fe547fff700 1 -- 172.21.15.50:0/4245165866 learned_addr learned my addr 172.21.15.50:0/4245165866 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-06T01:21:44.734 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:44.726+0000 7fe547fff700 1 -- 172.21.15.50:0/4245165866 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x55764cf74a10 msgr2=0x55764cf91c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:21:44.734 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:44.726+0000 7fe547fff700 1 --2- 172.21.15.50:0/4245165866 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x55764cf74a10 0x55764cf91c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:21:44.734 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:44.726+0000 7fe547fff700 1 -- 172.21.15.50:0/4245165866 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55764cf732c0 msgr2=0x55764d0038a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:21:44.735 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:44.726+0000 7fe547fff700 1 --2- 172.21.15.50:0/4245165866 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55764cf732c0 0x55764d0038a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:21:44.735 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:44.726+0000 7fe547fff700 1 -- 172.21.15.50:0/4245165866 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55764cd5c270 con 0x55764cf92e50 2023-10-06T01:21:44.735 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:44.726+0000 7fe547fff700 1 --2- 172.21.15.50:0/4245165866 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55764cf92e50 0x55764cf921d0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fe540057380 tx=0x7fe540070070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6ada54d49c877c2 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:21:44.735 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:44.726+0000 7fe525ffb700 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2023-10-06T01:21:44.735 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:44.726+0000 7fe525ffb700 1 -- 172.21.15.50:0/4245165866 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe540073040 con 0x55764cf92e50 2023-10-06T01:21:44.735 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:44.726+0000 7fe525ffb700 1 -- 172.21.15.50:0/4245165866 <== mon.0 v2:172.21.15.50:3300/0 2 ==== osd_map(25..25 src has 1..25) v4 ==== 6809+0+0 (secure 0 0 0) 0x7fe540084e40 con 0x55764cf92e50 2023-10-06T01:21:44.735 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:44.726+0000 7fe55c963b80 1 -- 172.21.15.50:0/4245165866 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55764cf71380 con 0x55764cf92e50 2023-10-06T01:21:44.735 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:44.727+0000 7fe525ffb700 1 -- 172.21.15.50:0/4245165866 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=7) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe54005a640 con 0x55764cf92e50 2023-10-06T01:21:44.735 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:44.727+0000 7fe55c963b80 10 client.4452 fetch_fsmap learned FSMap version 7 2023-10-06T01:21:44.735 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:44.727+0000 7fe55c963b80 1 -- 172.21.15.50:0/4245165866 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=7,monmap=2+}) v3 -- 0x55764ce77470 con 0x55764cf92e50 2023-10-06T01:21:44.735 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:44.727+0000 7fe525ffb700 1 -- 172.21.15.50:0/4245165866 <== mon.0 v2:172.21.15.50:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55764cf71380 con 0x55764cf92e50 2023-10-06T01:21:44.736 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:44.727+0000 7fe525ffb700 1 -- 172.21.15.50:0/4245165866 <== mon.0 v2:172.21.15.50:3300/0 5 ==== fsmap(e 7) v1 ==== 3108+0+0 (secure 0 0 0) 0x7fe5400568e0 con 0x55764cf92e50 2023-10-06T01:21:44.736 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:44.727+0000 7fe55c963b80 10 client.4452 fetch_fsmap finished waiting for FSMap version 7 2023-10-06T01:21:44.736 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:44.727+0000 7fe55c963b80 10 client.4452 resolve_mds: resolved name 'd' to daemon mds.d 2023-10-06T01:21:44.736 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:44.727+0000 7fe55c963b80 20 client.4452 populate_metadata read hostname 'smithi050' 2023-10-06T01:21:44.736 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:44.727+0000 7fe55c963b80 1 --2- 172.21.15.50:0/4245165866 >> [v2:172.21.15.155:6835/3434423585,v1:172.21.15.155:6837/3434423585] conn(0x55764cf73690 0x55764cf73a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:21:44.736 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:44.727+0000 7fe55c963b80 4 client.4452 mds_command: new command op to 4302 tid=0[{"prefix": "status"}] 2023-10-06T01:21:44.736 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:44.727+0000 7fe55c963b80 1 -- 172.21.15.50:0/4245165866 --> [v2:172.21.15.155:6835/3434423585,v1:172.21.15.155:6837/3434423585] -- command(tid 0: {"prefix": "status"}) v1 -- 0x7fe540009360 con 0x55764cf73690 2023-10-06T01:21:44.736 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:44.727+0000 7fe5477fe700 1 --2- 172.21.15.50:0/4245165866 >> [v2:172.21.15.155:6835/3434423585,v1:172.21.15.155:6837/3434423585] conn(0x55764cf73690 0x55764cf73a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:21:44.736 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:44.728+0000 7fe5477fe700 1 --2- 172.21.15.50:0/4245165866 >> [v2:172.21.15.155:6835/3434423585,v1:172.21.15.155:6837/3434423585] conn(0x55764cf73690 0x55764cf73a60 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=410c095ef6475a22 server_cookie=d7534d435ea14d5f in_seq=0 out_seq=0 2023-10-06T01:21:44.737 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:44.728+0000 7fe525ffb700 10 client.4452 ms_handle_connect on v2:172.21.15.155:6835/3434423585 2023-10-06T01:21:44.737 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:44.728+0000 7fe525ffb700 1 -- 172.21.15.50:0/4245165866 <== mds.0 v2:172.21.15.155:6835/3434423585 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+322 (crc 0 0 0) 0x7fe540009360 con 0x55764cf73690 2023-10-06T01:21:44.737 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:44.728+0000 7fe525ffb700 10 client.4452 handle_command_reply: tid=0 2023-10-06T01:21:44.737 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:44.728+0000 7fe55c963b80 1 client.4452 shutdown 2023-10-06T01:21:44.737 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:44.728+0000 7fe55c963b80 1 -- 172.21.15.50:0/4245165866 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55764cf92e50 msgr2=0x55764cf921d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:21:44.737 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:44.728+0000 7fe55c963b80 1 --2- 172.21.15.50:0/4245165866 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55764cf92e50 0x55764cf921d0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fe540057380 tx=0x7fe540070070 comp rx=0 tx=0).stop 2023-10-06T01:21:44.737 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:44.728+0000 7fe55c963b80 1 -- 172.21.15.50:0/4245165866 shutdown_connections 2023-10-06T01:21:44.737 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:44.728+0000 7fe55c963b80 1 --2- 172.21.15.50:0/4245165866 >> [v2:172.21.15.155:6835/3434423585,v1:172.21.15.155:6837/3434423585] conn(0x55764cf73690 0x55764cf73a60 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:21:44.737 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:44.728+0000 7fe55c963b80 1 --2- 172.21.15.50:0/4245165866 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55764cf92e50 0x55764cf921d0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:21:44.737 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:44.728+0000 7fe55c963b80 1 --2- 172.21.15.50:0/4245165866 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55764cf732c0 0x55764d0038a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:21:44.737 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:44.728+0000 7fe525ffb700 0 client.4452 ms_handle_reset on v2:172.21.15.155:6835/3434423585 2023-10-06T01:21:44.738 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:44.728+0000 7fe55c963b80 1 --2- 172.21.15.50:0/4245165866 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x55764cf74a10 0x55764cf91c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:21:44.738 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:44.728+0000 7fe55c963b80 1 -- 172.21.15.50:0/4245165866 >> 172.21.15.50:0/4245165866 conn(0x55764cf72e80 msgr2=0x55764cf685a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:21:44.738 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:44.728+0000 7fe55c963b80 1 -- 172.21.15.50:0/4245165866 shutdown_connections 2023-10-06T01:21:44.738 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:44.729+0000 7fe55c963b80 1 -- 172.21.15.50:0/4245165866 wait complete. 2023-10-06T01:21:44.738 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:44.729+0000 7fe55c963b80 20 client.4452 trim_cache size 0 max 16384 2023-10-06T01:21:44.738 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2023-10-06T01:21:44.738 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_fsid": "0bfd9a6b-1587-4fe4-a89e-e43c00286b4e", 2023-10-06T01:21:44.738 INFO:teuthology.orchestra.run.smithi050.stdout: "whoami": 0, 2023-10-06T01:21:44.739 INFO:teuthology.orchestra.run.smithi050.stdout: "id": 4302, 2023-10-06T01:21:44.739 INFO:teuthology.orchestra.run.smithi050.stdout: "want_state": "up:active", 2023-10-06T01:21:44.739 INFO:teuthology.orchestra.run.smithi050.stdout: "state": "up:active", 2023-10-06T01:21:44.739 INFO:teuthology.orchestra.run.smithi050.stdout: "fs_name": "cephfs", 2023-10-06T01:21:44.739 INFO:teuthology.orchestra.run.smithi050.stdout: "rank_uptime": 7.4530370210000001, 2023-10-06T01:21:44.739 INFO:teuthology.orchestra.run.smithi050.stdout: "mdsmap_epoch": 7, 2023-10-06T01:21:44.739 INFO:teuthology.orchestra.run.smithi050.stdout: "osdmap_epoch": 25, 2023-10-06T01:21:44.739 INFO:teuthology.orchestra.run.smithi050.stdout: "osdmap_epoch_barrier": 25, 2023-10-06T01:21:44.739 INFO:teuthology.orchestra.run.smithi050.stdout: "uptime": 13.9454569 2023-10-06T01:21:44.739 INFO:teuthology.orchestra.run.smithi050.stdout:} 2023-10-06T01:21:44.740 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:44.729+0000 7fe54cf9d700 1 -- 172.21.15.50:0/2038860184 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7fe534066f30 msgr2=0x7fe5340693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:21:44.740 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:44.729+0000 7fe54cf9d700 1 --2- 172.21.15.50:0/2038860184 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7fe534066f30 0x7fe5340693e0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fe538006f00 tx=0x7fe538008040 comp rx=0 tx=0).stop 2023-10-06T01:21:44.740 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:44.729+0000 7fe54cf9d700 1 -- 172.21.15.50:0/2038860184 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe548159480 msgr2=0x7fe5480c5520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:21:44.741 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:44.729+0000 7fe54cf9d700 1 --2- 172.21.15.50:0/2038860184 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe548159480 0x7fe5480c5520 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fe54000b6c0 tx=0x7fe540018000 comp rx=0 tx=0).stop 2023-10-06T01:21:44.741 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:44.729+0000 7fe54cf9d700 1 -- 172.21.15.50:0/2038860184 shutdown_connections 2023-10-06T01:21:44.741 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:44.729+0000 7fe54cf9d700 1 --2- 172.21.15.50:0/2038860184 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe548159480 0x7fe5480c5520 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:21:44.741 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:44.729+0000 7fe54cf9d700 1 --2- 172.21.15.50:0/2038860184 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7fe534066f30 0x7fe5340693e0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:21:44.741 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:44.729+0000 7fe54cf9d700 1 --2- 172.21.15.50:0/2038860184 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe5480b2140 0x7fe5480cffc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:21:44.741 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:44.729+0000 7fe54cf9d700 1 --2- 172.21.15.50:0/2038860184 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe5480b3610 0x7fe5480cf560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:21:44.741 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:44.729+0000 7fe54cf9d700 1 -- 172.21.15.50:0/2038860184 >> 172.21.15.50:0/2038860184 conn(0x7fe54806ed20 msgr2=0x7fe548155c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:21:44.741 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:44.729+0000 7fe54cf9d700 1 -- 172.21.15.50:0/2038860184 shutdown_connections 2023-10-06T01:21:44.741 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:44.729+0000 7fe54cf9d700 1 -- 172.21.15.50:0/2038860184 wait complete. 2023-10-06T01:21:44.747 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-06T01:21:44.936 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:44.935+0000 7f58f2f9d700 1 Processor -- start 2023-10-06T01:21:44.936 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:44.935+0000 7f58f2f9d700 1 -- start start 2023-10-06T01:21:44.939 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:44.937+0000 7f58f2f9d700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f58ec0cabf0 0x7f58ec0cb070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:21:44.940 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:44.937+0000 7f58f2f9d700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f58ec06a890 con 0x7f58ec153cc0 2023-10-06T01:21:44.940 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:44.937+0000 7f58f2f9d700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f58ec15a520 con 0x7f58ec1538f0 2023-10-06T01:21:44.940 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:44.937+0000 7f58f2f9d700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f58ec15aae0 con 0x7f58ec0cabf0 2023-10-06T01:21:44.940 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:44.937+0000 7f58f179a700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f58ec153cc0 0x7f58ec159ad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:44310/0 (socket says 172.21.15.50:44310) 2023-10-06T01:21:44.940 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:44.937+0000 7f58f179a700 1 -- 172.21.15.50:0/3284861984 learned_addr learned my addr 172.21.15.50:0/3284861984 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-10-06T01:21:44.940 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:44.937+0000 7f58f279c700 1 --2- 172.21.15.50:0/3284861984 >> v2:172.21.15.50:3300/0 conn(0x7f58ec0cabf0 0x7f58ec0cb070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:21:44.940 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:44.937+0000 7f58f0f99700 1 -- 172.21.15.50:0/3284861984 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3401758721 0 0) 0x7f58ec06a890 con 0x7f58ec153cc0 2023-10-06T01:21:44.940 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:44.937+0000 7f58f0f99700 1 -- 172.21.15.50:0/3284861984 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f58d8003570 con 0x7f58ec153cc0 2023-10-06T01:21:44.940 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:44.937+0000 7f58f279c700 1 -- 172.21.15.50:0/3284861984 >> v1:172.21.15.155:6789/0 conn(0x7f58ec1538f0 legacy=0x7f58ec0a98e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:21:44.940 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:44.937+0000 7f58f279c700 1 -- 172.21.15.50:0/3284861984 >> v1:172.21.15.50:6789/0 conn(0x7f58ec153cc0 legacy=0x7f58ec159ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:21:44.940 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:44.937+0000 7f58f279c700 1 -- 172.21.15.50:0/3284861984 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58ec15a800 con 0x7f58ec0cabf0 2023-10-06T01:21:44.940 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:44.938+0000 7f58f279c700 1 --2- 172.21.15.50:0/3284861984 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f58ec0cabf0 0x7f58ec0cb070 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f58e4009e60 tx=0x7f58e4009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cc4fd0f4e70327e2 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:21:44.941 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:44.938+0000 7f58f0f99700 1 -- 172.21.15.50:0/3284861984 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58e400e070 con 0x7f58ec0cabf0 2023-10-06T01:21:44.941 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:44.938+0000 7f58f0f99700 1 -- 172.21.15.50:0/3284861984 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f58e400bb60 con 0x7f58ec0cabf0 2023-10-06T01:21:44.941 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:44.938+0000 7f58f0f99700 1 -- 172.21.15.50:0/3284861984 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58e4012430 con 0x7f58ec0cabf0 2023-10-06T01:21:44.941 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:44.938+0000 7f58f2f9d700 1 -- 172.21.15.50:0/3284861984 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f58ec0cabf0 msgr2=0x7f58ec0cb070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:21:44.941 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:44.938+0000 7f58f2f9d700 1 --2- 172.21.15.50:0/3284861984 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f58ec0cabf0 0x7f58ec0cb070 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f58e4009e60 tx=0x7f58e4009780 comp rx=0 tx=0).stop 2023-10-06T01:21:44.941 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:44.939+0000 7f58f2f9d700 1 -- 172.21.15.50:0/3284861984 shutdown_connections 2023-10-06T01:21:44.941 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:44.939+0000 7f58f2f9d700 1 --2- 172.21.15.50:0/3284861984 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f58ec0cabf0 0x7f58ec0cb070 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:21:44.941 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:44.939+0000 7f58f2f9d700 1 -- 172.21.15.50:0/3284861984 >> 172.21.15.50:0/3284861984 conn(0x7f58ec0691d0 msgr2=0x7f58ec0cd020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:21:44.941 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:44.939+0000 7f58f2f9d700 1 -- 172.21.15.50:0/3284861984 shutdown_connections 2023-10-06T01:21:44.941 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:44.939+0000 7f58f2f9d700 1 -- 172.21.15.50:0/3284861984 wait complete. 2023-10-06T01:21:44.943 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:44.940+0000 7f58f2f9d700 1 Processor -- start 2023-10-06T01:21:44.944 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:44.940+0000 7f58f2f9d700 1 -- start start 2023-10-06T01:21:44.944 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:44.941+0000 7f58f2f9d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f58ec0cabf0 0x7f58ec150500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:21:44.944 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:44.941+0000 7f58f2f9d700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f58ec1538f0 0x7f58ec0c2d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:21:44.944 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:44.941+0000 7f58f2f9d700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f58ec153cc0 0x7f58ec0c32b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:21:44.944 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:44.941+0000 7f58f2f9d700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58ec15c6d0 con 0x7f58ec0cabf0 2023-10-06T01:21:44.944 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:44.941+0000 7f58f2f9d700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58ec150a40 con 0x7f58ec1538f0 2023-10-06T01:21:44.944 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:44.941+0000 7f58f2f9d700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58ec15cb60 con 0x7f58ec153cc0 2023-10-06T01:21:44.944 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:44.941+0000 7f58f1f9b700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f58ec0cabf0 0x7f58ec150500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:21:44.944 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:44.941+0000 7f58f1f9b700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f58ec0cabf0 0x7f58ec150500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:37922/0 (socket says 172.21.15.50:37922) 2023-10-06T01:21:44.944 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:44.941+0000 7f58f1f9b700 1 -- 172.21.15.50:0/3119126049 learned_addr learned my addr 172.21.15.50:0/3119126049 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-06T01:21:44.945 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:44.941+0000 7f58f179a700 1 --2- 172.21.15.50:0/3119126049 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f58ec1538f0 0x7f58ec0c2d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:21:44.945 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:44.942+0000 7f58f279c700 1 --2- 172.21.15.50:0/3119126049 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f58ec153cc0 0x7f58ec0c32b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:21:44.945 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:44.942+0000 7f58f1f9b700 1 -- 172.21.15.50:0/3119126049 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f58ec153cc0 msgr2=0x7f58ec0c32b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:21:44.945 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:44.942+0000 7f58f1f9b700 1 --2- 172.21.15.50:0/3119126049 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f58ec153cc0 0x7f58ec0c32b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:21:44.945 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:44.942+0000 7f58f1f9b700 1 -- 172.21.15.50:0/3119126049 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f58ec1538f0 msgr2=0x7f58ec0c2d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:21:44.945 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:44.942+0000 7f58f1f9b700 1 --2- 172.21.15.50:0/3119126049 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f58ec1538f0 0x7f58ec0c2d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:21:44.945 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:44.942+0000 7f58f1f9b700 1 -- 172.21.15.50:0/3119126049 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58e4009a20 con 0x7f58ec0cabf0 2023-10-06T01:21:44.945 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:44.942+0000 7f58f1f9b700 1 --2- 172.21.15.50:0/3119126049 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f58ec0cabf0 0x7f58ec150500 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f58e800c790 tx=0x7f58e8007f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:21:44.945 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:44.942+0000 7f58e1ffb700 1 -- 172.21.15.50:0/3119126049 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58e8011590 con 0x7f58ec0cabf0 2023-10-06T01:21:44.945 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:44.942+0000 7f58e1ffb700 1 -- 172.21.15.50:0/3119126049 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f58e8011710 con 0x7f58ec0cabf0 2023-10-06T01:21:44.945 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:44.942+0000 7f58e1ffb700 1 -- 172.21.15.50:0/3119126049 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58e8011ad0 con 0x7f58ec0cabf0 2023-10-06T01:21:44.946 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:44.942+0000 7f58f2f9d700 1 -- 172.21.15.50:0/3119126049 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f58ec15bac0 con 0x7f58ec0cabf0 2023-10-06T01:21:44.946 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:44.943+0000 7f58f2f9d700 1 -- 172.21.15.50:0/3119126049 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f58ec15c080 con 0x7f58ec0cabf0 2023-10-06T01:21:44.946 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:44.944+0000 7f58f2f9d700 1 -- 172.21.15.50:0/3119126049 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f58ec15c9b0 con 0x7f58ec0cabf0 2023-10-06T01:21:44.947 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:44.944+0000 7f58e1ffb700 1 -- 172.21.15.50:0/3119126049 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f58e801b3b0 con 0x7f58ec0cabf0 2023-10-06T01:21:44.947 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:44.945+0000 7f58e1ffb700 1 --2- 172.21.15.50:0/3119126049 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f58d0066f30 0x7f58d00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:21:44.947 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:44.945+0000 7f58e1ffb700 1 -- 172.21.15.50:0/3119126049 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f58e8083ee0 con 0x7f58ec0cabf0 2023-10-06T01:21:44.947 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:44.946+0000 7f58f179a700 1 --2- 172.21.15.50:0/3119126049 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f58d0066f30 0x7f58d00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:21:44.947 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:44.946+0000 7f58f179a700 1 --2- 172.21.15.50:0/3119126049 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f58d0066f30 0x7f58d00693e0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f58ec0b16d0 tx=0x7f58dc009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:21:44.950 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:44.949+0000 7f58e1ffb700 1 -- 172.21.15.50:0/3119126049 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f58e8050c60 con 0x7f58ec0cabf0 2023-10-06T01:21:45.197 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:45.196+0000 7f58f2f9d700 1 -- 172.21.15.50:0/3119126049 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f58ec05f270 con 0x7f58ec0cabf0 2023-10-06T01:21:45.197 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:45.196+0000 7f58e1ffb700 1 -- 172.21.15.50:0/3119126049 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v7) v1 ==== 53+0+88 (secure 0 0 0) 0x7f58e8017070 con 0x7f58ec0cabf0 2023-10-06T01:21:45.197 INFO:teuthology.orchestra.run.smithi050.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2023-10-06T01:21:45.200 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:45.198+0000 7f58f2f9d700 1 -- 172.21.15.50:0/3119126049 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f58d0066f30 msgr2=0x7f58d00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:21:45.200 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:45.198+0000 7f58f2f9d700 1 --2- 172.21.15.50:0/3119126049 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f58d0066f30 0x7f58d00693e0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f58ec0b16d0 tx=0x7f58dc009040 comp rx=0 tx=0).stop 2023-10-06T01:21:45.200 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:45.198+0000 7f58f2f9d700 1 -- 172.21.15.50:0/3119126049 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f58ec0cabf0 msgr2=0x7f58ec150500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:21:45.200 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:45.198+0000 7f58f2f9d700 1 --2- 172.21.15.50:0/3119126049 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f58ec0cabf0 0x7f58ec150500 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f58e800c790 tx=0x7f58e8007f60 comp rx=0 tx=0).stop 2023-10-06T01:21:45.200 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:45.198+0000 7f58f2f9d700 1 -- 172.21.15.50:0/3119126049 shutdown_connections 2023-10-06T01:21:45.200 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:45.199+0000 7f58f2f9d700 1 --2- 172.21.15.50:0/3119126049 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f58ec153cc0 0x7f58ec0c32b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:21:45.200 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:45.199+0000 7f58f2f9d700 1 --2- 172.21.15.50:0/3119126049 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f58ec0cabf0 0x7f58ec150500 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:21:45.200 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:45.199+0000 7f58f2f9d700 1 --2- 172.21.15.50:0/3119126049 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f58d0066f30 0x7f58d00693e0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:21:45.200 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:45.199+0000 7f58f2f9d700 1 --2- 172.21.15.50:0/3119126049 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f58ec1538f0 0x7f58ec0c2d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:21:45.200 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:45.199+0000 7f58f2f9d700 1 -- 172.21.15.50:0/3119126049 >> 172.21.15.50:0/3119126049 conn(0x7f58ec0691d0 msgr2=0x7f58ec152300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:21:45.201 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:45.199+0000 7f58f2f9d700 1 -- 172.21.15.50:0/3119126049 shutdown_connections 2023-10-06T01:21:45.201 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:45.199+0000 7f58f2f9d700 1 -- 172.21.15.50:0/3119126049 wait complete. 2023-10-06T01:21:45.217 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-10-06T01:21:45.217 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-06T01:21:45.217 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi050.front.sepia.ceph.com 2023-10-06T01:21:45.217 INFO:tasks.cephfs.mount:self.client.name = client.admin 2023-10-06T01:21:45.217 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2023-10-06T01:21:45.217 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-10-06T01:21:45.217 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-10-06T01:21:45.217 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-06T01:21:45.217 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.admin' 2023-10-06T01:21:45.218 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T01:21:45.218 DEBUG:teuthology.orchestra.run.smithi050:> ip addr 2023-10-06T01:21:45.254 INFO:teuthology.orchestra.run.smithi050.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-06T01:21:45.254 INFO:teuthology.orchestra.run.smithi050.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-06T01:21:45.255 INFO:teuthology.orchestra.run.smithi050.stdout: inet 127.0.0.1/8 scope host lo 2023-10-06T01:21:45.255 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft forever preferred_lft forever 2023-10-06T01:21:45.255 INFO:teuthology.orchestra.run.smithi050.stdout: inet6 ::1/128 scope host 2023-10-06T01:21:45.255 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft forever preferred_lft forever 2023-10-06T01:21:45.255 INFO:teuthology.orchestra.run.smithi050.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T01:21:45.255 INFO:teuthology.orchestra.run.smithi050.stdout: link/ether 0c:c4:7a:6b:fd:f8 brd ff:ff:ff:ff:ff:ff 2023-10-06T01:21:45.255 INFO:teuthology.orchestra.run.smithi050.stdout: altname enp7s0f0 2023-10-06T01:21:45.255 INFO:teuthology.orchestra.run.smithi050.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T01:21:45.255 INFO:teuthology.orchestra.run.smithi050.stdout: link/ether 0c:c4:7a:6b:fd:f9 brd ff:ff:ff:ff:ff:ff 2023-10-06T01:21:45.255 INFO:teuthology.orchestra.run.smithi050.stdout: altname enp7s0f1 2023-10-06T01:21:45.255 INFO:teuthology.orchestra.run.smithi050.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-06T01:21:45.256 INFO:teuthology.orchestra.run.smithi050.stdout: link/ether 0c:c4:7a:bd:15:84 brd ff:ff:ff:ff:ff:ff 2023-10-06T01:21:45.256 INFO:teuthology.orchestra.run.smithi050.stdout: altname enp1s0f0 2023-10-06T01:21:45.256 INFO:teuthology.orchestra.run.smithi050.stdout: inet 172.21.15.50/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2023-10-06T01:21:45.256 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft 42248sec preferred_lft 42248sec 2023-10-06T01:21:45.256 INFO:teuthology.orchestra.run.smithi050.stdout: inet6 fe80::ec4:7aff:febd:1584/64 scope link 2023-10-06T01:21:45.256 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft forever preferred_lft forever 2023-10-06T01:21:45.256 INFO:teuthology.orchestra.run.smithi050.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T01:21:45.256 INFO:teuthology.orchestra.run.smithi050.stdout: link/ether 0c:c4:7a:bd:15:85 brd ff:ff:ff:ff:ff:ff 2023-10-06T01:21:45.256 INFO:teuthology.orchestra.run.smithi050.stdout: altname enp1s0f1 2023-10-06T01:21:45.257 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-10-06T01:21:45.257 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T01:21:45.257 DEBUG:teuthology.orchestra.run.smithi050:> (cd / && exec bash -c ' 2023-10-06T01:21:45.257 DEBUG:teuthology.orchestra.run.smithi050:> set -e 2023-10-06T01:21:45.257 DEBUG:teuthology.orchestra.run.smithi050:> sudo ip link add name ceph-brx type bridge 2023-10-06T01:21:45.257 DEBUG:teuthology.orchestra.run.smithi050:> sudo ip addr flush dev ceph-brx 2023-10-06T01:21:45.257 DEBUG:teuthology.orchestra.run.smithi050:> sudo ip link set ceph-brx up 2023-10-06T01:21:45.257 DEBUG:teuthology.orchestra.run.smithi050:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-10-06T01:21:45.258 DEBUG:teuthology.orchestra.run.smithi050:> ') 2023-10-06T01:21:45.705 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T01:21:45.705 DEBUG:teuthology.orchestra.run.smithi050:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-06T01:21:45.856 INFO:teuthology.orchestra.run.smithi050.stdout:1 2023-10-06T01:21:45.859 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T01:21:45.859 DEBUG:teuthology.orchestra.run.smithi050:> route 2023-10-06T01:21:45.910 INFO:teuthology.orchestra.run.smithi050.stdout:Kernel IP routing table 2023-10-06T01:21:45.911 INFO:teuthology.orchestra.run.smithi050.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-06T01:21:45.911 INFO:teuthology.orchestra.run.smithi050.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2023-10-06T01:21:45.911 INFO:teuthology.orchestra.run.smithi050.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2023-10-06T01:21:45.911 INFO:teuthology.orchestra.run.smithi050.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-06T01:21:45.912 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T01:21:45.912 DEBUG:teuthology.orchestra.run.smithi050:> (cd / && exec bash -c ' 2023-10-06T01:21:45.912 DEBUG:teuthology.orchestra.run.smithi050:> set -e 2023-10-06T01:21:45.912 DEBUG:teuthology.orchestra.run.smithi050:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-10-06T01:21:45.913 DEBUG:teuthology.orchestra.run.smithi050:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-10-06T01:21:45.913 DEBUG:teuthology.orchestra.run.smithi050:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-10-06T01:21:45.913 DEBUG:teuthology.orchestra.run.smithi050:> ') 2023-10-06T01:21:46.596 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T01:21:46.596 DEBUG:teuthology.orchestra.run.smithi050:> ip netns list 2023-10-06T01:21:46.633 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T01:21:46.633 DEBUG:teuthology.orchestra.run.smithi050:> ip netns list-id 2023-10-06T01:21:46.709 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T01:21:46.709 DEBUG:teuthology.orchestra.run.smithi050:> (cd / && exec bash -c ' 2023-10-06T01:21:46.709 DEBUG:teuthology.orchestra.run.smithi050:> set -e 2023-10-06T01:21:46.709 DEBUG:teuthology.orchestra.run.smithi050:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.admin 2023-10-06T01:21:46.709 DEBUG:teuthology.orchestra.run.smithi050:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.admin 0 2023-10-06T01:21:46.710 DEBUG:teuthology.orchestra.run.smithi050:> ') 2023-10-06T01:21:46.880 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.admin' with 192.168.0.1/16 2023-10-06T01:21:46.881 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T01:21:46.881 DEBUG:teuthology.orchestra.run.smithi050:> (cd / && exec bash -c ' 2023-10-06T01:21:46.881 DEBUG:teuthology.orchestra.run.smithi050:> set -e 2023-10-06T01:21:46.881 DEBUG:teuthology.orchestra.run.smithi050:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.admin type veth peer name brx.0 2023-10-06T01:21:46.881 DEBUG:teuthology.orchestra.run.smithi050:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-10-06T01:21:46.881 DEBUG:teuthology.orchestra.run.smithi050:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set veth0 up 2023-10-06T01:21:46.881 DEBUG:teuthology.orchestra.run.smithi050:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set lo up 2023-10-06T01:21:46.881 DEBUG:teuthology.orchestra.run.smithi050:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip route add default via 192.168.255.254 2023-10-06T01:21:46.881 DEBUG:teuthology.orchestra.run.smithi050:> ') 2023-10-06T01:21:47.149 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T01:21:47.149 DEBUG:teuthology.orchestra.run.smithi050:> (cd / && exec bash -c ' 2023-10-06T01:21:47.149 DEBUG:teuthology.orchestra.run.smithi050:> set -e 2023-10-06T01:21:47.149 DEBUG:teuthology.orchestra.run.smithi050:> sudo ip link set brx.0 up 2023-10-06T01:21:47.149 DEBUG:teuthology.orchestra.run.smithi050:> sudo ip link set dev brx.0 master ceph-brx 2023-10-06T01:21:47.150 DEBUG:teuthology.orchestra.run.smithi050:> ') 2023-10-06T01:21:47.310 INFO:tasks.cephfs.fuse_mount:Client client.admin config is {} 2023-10-06T01:21:47.311 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-06T01:21:47.311 DEBUG:teuthology.orchestra.run.smithi050:> mkdir -p -v /home/ubuntu/cephtest/mnt.admin 2023-10-06T01:21:47.348 INFO:teuthology.orchestra.run.smithi050.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.admin' 2023-10-06T01:21:47.348 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-06T01:21:47.349 DEBUG:teuthology.orchestra.run.smithi050:> chmod 0000 /home/ubuntu/cephtest/mnt.admin 2023-10-06T01:21:47.424 DEBUG:teuthology.orchestra.run.smithi050:> sudo modprobe fuse 2023-10-06T01:21:47.528 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-10-06T01:21:47.528 DEBUG:teuthology.orchestra.run.smithi050:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-10-06T01:21:47.589 INFO:teuthology.orchestra.run.smithi050.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-10-06T01:21:47.591 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-10-06T01:21:47.592 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T01:21:47.592 DEBUG:teuthology.orchestra.run.smithi050:> ls /sys/fs/fuse/connections 2023-10-06T01:21:47.629 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-10-06T01:21:47.629 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.admin --id admin --client_fs=cephfs) 2023-10-06T01:21:47.675 DEBUG:teuthology.orchestra.run.smithi050:> sudo modprobe fuse 2023-10-06T01:21:47.738 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-10-06T01:21:47.738 DEBUG:teuthology.orchestra.run.smithi050:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-10-06T01:21:47.804 INFO:teuthology.orchestra.run.smithi050.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-10-06T01:21:47.806 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-10-06T01:21:47.807 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T01:21:47.807 DEBUG:teuthology.orchestra.run.smithi050:> ls /sys/fs/fuse/connections 2023-10-06T01:21:47.855 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi050.stderr:2023-10-06T01:21:47.854+0000 7fa3c347e540 -1 init, newargv = 0x5585e0a94530 newargc=15 2023-10-06T01:21:47.855 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi050.stderr:ceph-fuse[93677]: starting ceph client 2023-10-06T01:21:47.865 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi050.stderr:ceph-fuse[93677]: starting fuse 2023-10-06T01:21:48.946 DEBUG:teuthology.orchestra.run.smithi050:> sudo modprobe fuse 2023-10-06T01:21:49.018 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-10-06T01:21:49.018 DEBUG:teuthology.orchestra.run.smithi050:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-10-06T01:21:49.081 INFO:teuthology.orchestra.run.smithi050.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-10-06T01:21:49.084 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-10-06T01:21:49.084 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T01:21:49.084 DEBUG:teuthology.orchestra.run.smithi050:> ls /sys/fs/fuse/connections 2023-10-06T01:21:49.121 INFO:teuthology.orchestra.run.smithi050.stdout:44 2023-10-06T01:21:49.122 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [44] 2023-10-06T01:21:49.122 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T01:21:49.122 DEBUG:teuthology.orchestra.run.smithi050:> import glob 2023-10-06T01:21:49.122 DEBUG:teuthology.orchestra.run.smithi050:> import re 2023-10-06T01:21:49.122 DEBUG:teuthology.orchestra.run.smithi050:> import os 2023-10-06T01:21:49.122 DEBUG:teuthology.orchestra.run.smithi050:> import subprocess 2023-10-06T01:21:49.122 DEBUG:teuthology.orchestra.run.smithi050:> 2023-10-06T01:21:49.122 DEBUG:teuthology.orchestra.run.smithi050:> def _find_admin_socket(client_name): 2023-10-06T01:21:49.122 DEBUG:teuthology.orchestra.run.smithi050:> asok_path = "/var/run/ceph/ceph-client.admin.*.asok" 2023-10-06T01:21:49.123 DEBUG:teuthology.orchestra.run.smithi050:> files = glob.glob(asok_path) 2023-10-06T01:21:49.123 DEBUG:teuthology.orchestra.run.smithi050:> mountpoint = "/home/ubuntu/cephtest/mnt.admin" 2023-10-06T01:21:49.123 DEBUG:teuthology.orchestra.run.smithi050:> 2023-10-06T01:21:49.123 DEBUG:teuthology.orchestra.run.smithi050:> # Given a non-glob path, it better be there 2023-10-06T01:21:49.123 DEBUG:teuthology.orchestra.run.smithi050:> if "*" not in asok_path: 2023-10-06T01:21:49.123 DEBUG:teuthology.orchestra.run.smithi050:> assert(len(files) == 1) 2023-10-06T01:21:49.123 DEBUG:teuthology.orchestra.run.smithi050:> return files[0] 2023-10-06T01:21:49.123 DEBUG:teuthology.orchestra.run.smithi050:> 2023-10-06T01:21:49.123 DEBUG:teuthology.orchestra.run.smithi050:> for f in files: 2023-10-06T01:21:49.123 DEBUG:teuthology.orchestra.run.smithi050:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-10-06T01:21:49.123 DEBUG:teuthology.orchestra.run.smithi050:> if os.path.exists("/proc/{0}".format(pid)): 2023-10-06T01:21:49.123 DEBUG:teuthology.orchestra.run.smithi050:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-10-06T01:21:49.123 DEBUG:teuthology.orchestra.run.smithi050:> contents = proc_f.read() 2023-10-06T01:21:49.123 DEBUG:teuthology.orchestra.run.smithi050:> if mountpoint in contents: 2023-10-06T01:21:49.124 DEBUG:teuthology.orchestra.run.smithi050:> return f 2023-10-06T01:21:49.124 DEBUG:teuthology.orchestra.run.smithi050:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-10-06T01:21:49.124 DEBUG:teuthology.orchestra.run.smithi050:> 2023-10-06T01:21:49.124 DEBUG:teuthology.orchestra.run.smithi050:> print(_find_admin_socket("client.admin")) 2023-10-06T01:21:49.124 DEBUG:teuthology.orchestra.run.smithi050:> ' 2023-10-06T01:21:49.300 INFO:teuthology.orchestra.run.smithi050.stdout:/var/run/ceph/ceph-client.admin.93677.asok 2023-10-06T01:21:49.477 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.admin.93677.asok 2023-10-06T01:21:49.477 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T01:21:49.477 DEBUG:teuthology.orchestra.run.smithi050:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.admin.93677.asok status 2023-10-06T01:21:49.692 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2023-10-06T01:21:49.692 INFO:teuthology.orchestra.run.smithi050.stdout: "metadata": { 2023-10-06T01:21:49.693 INFO:teuthology.orchestra.run.smithi050.stdout: "ceph_sha1": "736ac5ba72cb47af7d6f6666b1e100f7e20a20e2", 2023-10-06T01:21:49.693 INFO:teuthology.orchestra.run.smithi050.stdout: "ceph_version": "ceph version 17.2.6-1296-g736ac5ba (736ac5ba72cb47af7d6f6666b1e100f7e20a20e2) quincy (stable)", 2023-10-06T01:21:49.693 INFO:teuthology.orchestra.run.smithi050.stdout: "entity_id": "admin", 2023-10-06T01:21:49.693 INFO:teuthology.orchestra.run.smithi050.stdout: "hostname": "smithi050", 2023-10-06T01:21:49.693 INFO:teuthology.orchestra.run.smithi050.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.admin", 2023-10-06T01:21:49.693 INFO:teuthology.orchestra.run.smithi050.stdout: "pid": "93677", 2023-10-06T01:21:49.693 INFO:teuthology.orchestra.run.smithi050.stdout: "root": "/" 2023-10-06T01:21:49.693 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-06T01:21:49.693 INFO:teuthology.orchestra.run.smithi050.stdout: "dentry_count": 0, 2023-10-06T01:21:49.694 INFO:teuthology.orchestra.run.smithi050.stdout: "dentry_pinned_count": 0, 2023-10-06T01:21:49.694 INFO:teuthology.orchestra.run.smithi050.stdout: "id": 4467, 2023-10-06T01:21:49.694 INFO:teuthology.orchestra.run.smithi050.stdout: "inst": { 2023-10-06T01:21:49.694 INFO:teuthology.orchestra.run.smithi050.stdout: "name": { 2023-10-06T01:21:49.694 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "client", 2023-10-06T01:21:49.695 INFO:teuthology.orchestra.run.smithi050.stdout: "num": 4467 2023-10-06T01:21:49.695 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-06T01:21:49.695 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": { 2023-10-06T01:21:49.695 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-10-06T01:21:49.695 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "192.168.0.1:0", 2023-10-06T01:21:49.695 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 2553726575 2023-10-06T01:21:49.696 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-10-06T01:21:49.696 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-06T01:21:49.696 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": { 2023-10-06T01:21:49.696 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-10-06T01:21:49.696 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "192.168.0.1:0", 2023-10-06T01:21:49.696 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 2553726575 2023-10-06T01:21:49.696 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-06T01:21:49.697 INFO:teuthology.orchestra.run.smithi050.stdout: "inst_str": "client.4467 192.168.0.1:0/2553726575", 2023-10-06T01:21:49.697 INFO:teuthology.orchestra.run.smithi050.stdout: "addr_str": "192.168.0.1:0/2553726575", 2023-10-06T01:21:49.697 INFO:teuthology.orchestra.run.smithi050.stdout: "inode_count": 1, 2023-10-06T01:21:49.697 INFO:teuthology.orchestra.run.smithi050.stdout: "mds_epoch": 7, 2023-10-06T01:21:49.697 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_epoch": 25, 2023-10-06T01:21:49.697 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_epoch_barrier": 0, 2023-10-06T01:21:49.697 INFO:teuthology.orchestra.run.smithi050.stdout: "blocklisted": false, 2023-10-06T01:21:49.697 INFO:teuthology.orchestra.run.smithi050.stdout: "fs_name": "cephfs" 2023-10-06T01:21:49.698 INFO:teuthology.orchestra.run.smithi050.stdout:} 2023-10-06T01:21:49.706 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T01:21:49.706 DEBUG:teuthology.orchestra.run.smithi050:> stat --file-system '--printf=%T 2023-10-06T01:21:49.706 DEBUG:teuthology.orchestra.run.smithi050:> ' -- /home/ubuntu/cephtest/mnt.admin 2023-10-06T01:21:49.743 INFO:teuthology.orchestra.run.smithi050.stdout:fuseblk 2023-10-06T01:21:49.743 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.admin 2023-10-06T01:21:49.744 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T01:21:49.744 DEBUG:teuthology.orchestra.run.smithi050:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.admin 2023-10-06T01:21:49.847 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T01:21:49.847 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.admin && exec bash -c 'setfattr -n ceph.dir.layout.pool -v cephfs_data_ec . && getfattr -n ceph.dir.layout .') 2023-10-06T01:21:49.965 INFO:teuthology.orchestra.run.smithi050.stdout:# file: . 2023-10-06T01:21:49.966 INFO:teuthology.orchestra.run.smithi050.stdout:ceph.dir.layout="stripe_unit=4194304 stripe_count=1 object_size=4194304 pool=cephfs_data_ec" 2023-10-06T01:21:49.966 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-10-06T01:21:49.967 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi050.front.sepia.ceph.com... 2023-10-06T01:21:49.967 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-10-06T01:21:49.967 DEBUG:teuthology.orchestra.run.smithi050:> sudo fusermount -u /home/ubuntu/cephtest/mnt.admin 2023-10-06T01:21:50.026 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi050.stderr:ceph-fuse[93677]: fuse finished with error 0 and tester_r 0 2023-10-06T01:21:50.029 INFO:teuthology.orchestra.run:waiting for 900 2023-10-06T01:21:56.131 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi050.front.sepia.ceph.com 2023-10-06T01:21:56.131 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T01:21:56.131 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.admin) 2023-10-06T01:21:56.179 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T01:21:56.371 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:56.370+0000 7fca3939d700 1 Processor -- start 2023-10-06T01:21:56.371 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:56.370+0000 7fca3939d700 1 -- start start 2023-10-06T01:21:56.372 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:56.371+0000 7fca3939d700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fca3406a5d0 0x7fca34153730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:21:56.373 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:56.372+0000 7fca3939d700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fca3406a9a0 0x7fca34153c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:21:56.373 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:56.372+0000 7fca3939d700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fca340c9d00 con 0x7fca3406df90 2023-10-06T01:21:56.373 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:56.372+0000 7fca3939d700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fca3406f5a0 con 0x7fca3406a9a0 2023-10-06T01:21:56.373 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:56.372+0000 7fca3939d700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca3406eb00 con 0x7fca3406a5d0 2023-10-06T01:21:56.373 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:56.373+0000 7fca33fff700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fca3406a5d0 0x7fca34153730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:21:56.374 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:56.373+0000 7fca337fe700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fca3406a9a0 0x7fca34153c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:21:56.374 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:56.373+0000 7fca337fe700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fca3406a9a0 0x7fca34153c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.50:53942/0 (socket says 172.21.15.50:53942) 2023-10-06T01:21:56.374 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:56.373+0000 7fca337fe700 1 -- 172.21.15.50:0/2964628185 learned_addr learned my addr 172.21.15.50:0/2964628185 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-06T01:21:56.374 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:56.373+0000 7fca38b9c700 1 --1- 172.21.15.50:0/2964628185 >> v1:172.21.15.155:6789/0 conn(0x7fca3406df90 0x7fca3406e3f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.155:6789/0 says I am v1:172.21.15.50:56908/0 (socket says 172.21.15.50:56908) 2023-10-06T01:21:56.375 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:56.373+0000 7fca337fe700 1 -- 172.21.15.50:0/2964628185 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fca3406a5d0 msgr2=0x7fca34153730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:21:56.375 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:56.373+0000 7fca337fe700 1 --2- 172.21.15.50:0/2964628185 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fca3406a5d0 0x7fca34153730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:21:56.375 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:56.373+0000 7fca337fe700 1 -- 172.21.15.50:0/2964628185 >> v1:172.21.15.155:6789/0 conn(0x7fca3406df90 legacy=0x7fca3406e3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:21:56.375 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:56.373+0000 7fca337fe700 1 -- 172.21.15.50:0/2964628185 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca340c6750 con 0x7fca3406a9a0 2023-10-06T01:21:56.376 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:56.373+0000 7fca337fe700 1 --2- 172.21.15.50:0/2964628185 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fca3406a9a0 0x7fca34153c70 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fca2800bc80 tx=0x7fca2800b4f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cd8c2db4a5ebf701 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:21:56.376 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:56.374+0000 7fca32ffd700 1 -- 172.21.15.50:0/2964628185 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca2800dbb0 con 0x7fca3406a9a0 2023-10-06T01:21:56.376 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:56.374+0000 7fca32ffd700 1 -- 172.21.15.50:0/2964628185 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca2800dd10 con 0x7fca3406a9a0 2023-10-06T01:21:56.376 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:56.374+0000 7fca32ffd700 1 -- 172.21.15.50:0/2964628185 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca280196b0 con 0x7fca3406a9a0 2023-10-06T01:21:56.376 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:56.374+0000 7fca3939d700 1 -- 172.21.15.50:0/2964628185 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fca3406a9a0 msgr2=0x7fca34153c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:21:56.376 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:56.374+0000 7fca3939d700 1 --2- 172.21.15.50:0/2964628185 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fca3406a9a0 0x7fca34153c70 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fca2800bc80 tx=0x7fca2800b4f0 comp rx=0 tx=0).stop 2023-10-06T01:21:56.376 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:56.374+0000 7fca3939d700 1 -- 172.21.15.50:0/2964628185 shutdown_connections 2023-10-06T01:21:56.376 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:56.374+0000 7fca3939d700 1 --2- 172.21.15.50:0/2964628185 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fca3406a5d0 0x7fca34153730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:21:56.376 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:56.374+0000 7fca3939d700 1 --2- 172.21.15.50:0/2964628185 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fca3406a9a0 0x7fca34153c70 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:21:56.376 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:56.374+0000 7fca3939d700 1 -- 172.21.15.50:0/2964628185 >> 172.21.15.50:0/2964628185 conn(0x7fca340680c0 msgr2=0x7fca340cbf00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:21:56.376 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:56.374+0000 7fca3939d700 1 -- 172.21.15.50:0/2964628185 shutdown_connections 2023-10-06T01:21:56.376 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:56.374+0000 7fca3939d700 1 -- 172.21.15.50:0/2964628185 wait complete. 2023-10-06T01:21:56.377 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:56.376+0000 7fca3939d700 1 Processor -- start 2023-10-06T01:21:56.377 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:56.376+0000 7fca3939d700 1 -- start start 2023-10-06T01:21:56.379 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:56.377+0000 7fca3939d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fca3406a5d0 0x7fca340c5860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:21:56.379 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:56.377+0000 7fca3939d700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fca3406a9a0 0x7fca34158e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:21:56.379 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:56.377+0000 7fca3939d700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fca3406df90 0x7fca340aeca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:21:56.379 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:56.377+0000 7fca3939d700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca340cb8a0 con 0x7fca3406a5d0 2023-10-06T01:21:56.379 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:56.377+0000 7fca3939d700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca340cacd0 con 0x7fca3406a9a0 2023-10-06T01:21:56.379 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:56.377+0000 7fca3939d700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca340caf70 con 0x7fca3406df90 2023-10-06T01:21:56.379 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:56.377+0000 7fca33fff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fca3406a5d0 0x7fca340c5860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:21:56.380 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:56.377+0000 7fca33fff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fca3406a5d0 0x7fca340c5860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:47850/0 (socket says 172.21.15.50:47850) 2023-10-06T01:21:56.380 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:56.377+0000 7fca33fff700 1 -- 172.21.15.50:0/464422820 learned_addr learned my addr 172.21.15.50:0/464422820 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-06T01:21:56.380 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:56.377+0000 7fca337fe700 1 --2- 172.21.15.50:0/464422820 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fca3406a9a0 0x7fca34158e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:21:56.380 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:56.377+0000 7fca38b9c700 1 --2- 172.21.15.50:0/464422820 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fca3406df90 0x7fca340aeca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:21:56.380 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:56.378+0000 7fca337fe700 1 -- 172.21.15.50:0/464422820 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fca3406df90 msgr2=0x7fca340aeca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:21:56.380 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:56.378+0000 7fca337fe700 1 --2- 172.21.15.50:0/464422820 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fca3406df90 0x7fca340aeca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:21:56.380 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:56.378+0000 7fca337fe700 1 -- 172.21.15.50:0/464422820 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fca3406a5d0 msgr2=0x7fca340c5860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:21:56.380 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:56.378+0000 7fca337fe700 1 --2- 172.21.15.50:0/464422820 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fca3406a5d0 0x7fca340c5860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:21:56.380 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:56.378+0000 7fca337fe700 1 -- 172.21.15.50:0/464422820 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca2800b790 con 0x7fca3406a9a0 2023-10-06T01:21:56.380 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:56.378+0000 7fca33fff700 1 --2- 172.21.15.50:0/464422820 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fca3406a5d0 0x7fca340c5860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T01:21:56.380 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:56.378+0000 7fca337fe700 1 --2- 172.21.15.50:0/464422820 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fca3406a9a0 0x7fca34158e50 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fca3406c960 tx=0x7fca28019000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:21:56.380 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:56.378+0000 7fca1bfff700 1 -- 172.21.15.50:0/464422820 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca28010750 con 0x7fca3406a9a0 2023-10-06T01:21:56.380 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:56.378+0000 7fca1bfff700 1 -- 172.21.15.50:0/464422820 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca280108b0 con 0x7fca3406a9a0 2023-10-06T01:21:56.381 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:56.378+0000 7fca1bfff700 1 -- 172.21.15.50:0/464422820 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca28010c30 con 0x7fca3406a9a0 2023-10-06T01:21:56.381 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:56.378+0000 7fca3939d700 1 -- 172.21.15.50:0/464422820 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fca340cb250 con 0x7fca3406a9a0 2023-10-06T01:21:56.381 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:56.378+0000 7fca3939d700 1 -- 172.21.15.50:0/464422820 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fca340c5da0 con 0x7fca3406a9a0 2023-10-06T01:21:56.381 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:56.379+0000 7fca3939d700 1 -- 172.21.15.50:0/464422820 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fca340cba10 con 0x7fca3406a9a0 2023-10-06T01:21:56.381 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:56.381+0000 7fca1bfff700 1 -- 172.21.15.50:0/464422820 <== mon.1 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fca280183e0 con 0x7fca3406a9a0 2023-10-06T01:21:56.382 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:56.381+0000 7fca1bfff700 1 --2- 172.21.15.50:0/464422820 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7fca20066f30 0x7fca200693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:21:56.382 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:56.382+0000 7fca1bfff700 1 -- 172.21.15.50:0/464422820 <== mon.1 v2:172.21.15.155:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6809+0+0 (secure 0 0 0) 0x7fca28014070 con 0x7fca3406a9a0 2023-10-06T01:21:56.383 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:56.382+0000 7fca33fff700 1 --2- 172.21.15.50:0/464422820 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7fca20066f30 0x7fca200693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:21:56.383 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:56.383+0000 7fca33fff700 1 --2- 172.21.15.50:0/464422820 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7fca20066f30 0x7fca200693e0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fca24009fd0 tx=0x7fca240091a0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:21:56.386 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:56.386+0000 7fca1bfff700 1 -- 172.21.15.50:0/464422820 <== mon.1 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fca28053820 con 0x7fca3406a9a0 2023-10-06T01:21:56.590 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:56.589+0000 7fca3939d700 1 -- 172.21.15.50:0/464422820 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fca3405f270 con 0x7fca3406a9a0 2023-10-06T01:21:56.591 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:56.591+0000 7fca1bfff700 1 -- 172.21.15.50:0/464422820 <== mon.1 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+18707 (secure 0 0 0) 0x7fca28056e40 con 0x7fca3406a9a0 2023-10-06T01:21:56.592 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-10-06T01:21:56.592 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":25,"fsid":"0bfd9a6b-1587-4fe4-a89e-e43c00286b4e","created":"2023-10-06T01:21:16.828801+0000","modified":"2023-10-06T01:21:41.329781+0000","last_up_change":"2023-10-06T01:21:28.584523+0000","last_in_change":"2023-10-06T01:21:20.179863+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-10-06T01:21:29.304225+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":".mgr","create_time":"2023-10-06T01:21:29.835490+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-06T01:21:34.675315+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-06T01:21:35.753991+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-10-06T01:21:38.853108+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"9060727a-3959-4de3-8363-c5c5d7826c9a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":87837},{"type":"v1","addr":"172.21.15.50:6801","nonce":87837}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":87837},{"type":"v1","addr":"172.21.15.50:6803","nonce":87837}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":87837},{"type":"v1","addr":"172.21.15.50:6807","nonce":87837}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":87837},{"type":"v1","addr":"172.21.15.50:6805","nonce":87837}]},"public_addr":"172.21.15.50:6801/87837","cluster_addr":"172.21.15.50:6803/87837","heartbeat_back_addr":"172.21.15.50:6807/87837","heartbeat_front_addr":"172.21.15.50:6805/87837","state":["exists","up"]},{"osd":1,"uuid":"5ad9ef12-b579-47ea-b690-90ba887e2cef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":87853},{"type":"v1","addr":"172.21.15.50:6809","nonce":87853}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":87853},{"type":"v1","addr":"172.21.15.50:6811","nonce":87853}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":87853},{"type":"v1","addr":"172.21.15.50:6815","nonce":87853}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":87853},{"type":"v1","addr":"172.21.15.50:6813","nonce":87853}]},"public_addr":"172.21.15.50:6809/87853","cluster_addr":"172.21.15.50:6811/87853","heartbeat_back_addr":"172.21.15.50:6815/87853","heartbeat_front_addr":"172.21.15.50:6813/87853","state":["exists","up"]},{"osd":2,"uuid":"c7aee044-6f75-436f-90e1-ba42a57359bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6821","nonce":87855},{"type":"v1","addr":"172.21.15.50:6822","nonce":87855}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6824","nonce":87855},{"type":"v1","addr":"172.21.15.50:6826","nonce":87855}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":87855},{"type":"v1","addr":"172.21.15.50:6831","nonce":87855}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":87855},{"type":"v1","addr":"172.21.15.50:6829","nonce":87855}]},"public_addr":"172.21.15.50:6822/87855","cluster_addr":"172.21.15.50:6826/87855","heartbeat_back_addr":"172.21.15.50:6831/87855","heartbeat_front_addr":"172.21.15.50:6829/87855","state":["exists","up"]},{"osd":3,"uuid":"d9b901c8-e8b2-44af-9508-f453120a96c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":87856},{"type":"v1","addr":"172.21.15.50:6817","nonce":87856}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":87856},{"type":"v1","addr":"172.21.15.50:6819","nonce":87856}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6825","nonce":87856},{"type":"v1","addr":"172.21.15.50:6827","nonce":87856}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6820","nonce":87856},{"type":"v1","addr":"172.21.15.50:6823","nonce":87856}]},"public_addr":"172.21.15.50:6817/87856","cluster_addr":"172.21.15.50:6819/87856","heartbeat_back_addr":"172.21.15.50:6827/87856","heartbeat_front_addr":"172.21.15.50:6823/87856","state":["exists","up"]},{"osd":4,"uuid":"2b3c6b38-e3e9-4301-9445-60fd3fe8ce03","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":85805},{"type":"v1","addr":"172.21.15.155:6801","nonce":85805}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":85805},{"type":"v1","addr":"172.21.15.155:6803","nonce":85805}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6806","nonce":85805},{"type":"v1","addr":"172.21.15.155:6807","nonce":85805}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6804","nonce":85805},{"type":"v1","addr":"172.21.15.155:6805","nonce":85805}]},"public_addr":"172.21.15.155:6801/85805","cluster_addr":"172.21.15.155:6803/85805","heartbeat_back_addr":"172.21.15.155:6807/85805","heartbeat_front_addr":"172.21.15.155:6805/85805","state":["exists","up"]},{"osd":5,"uuid":"417b5f8f-65f1-4c94-91a7-a6ce03fe1679","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6816","nonce":85807},{"type":"v1","addr":"172.21.15.155:6818","nonce":85807}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6820","nonce":85807},{"type":"v1","addr":"172.21.15.155:6822","nonce":85807}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6828","nonce":85807},{"type":"v1","addr":"172.21.15.155:6830","nonce":85807}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6824","nonce":85807},{"type":"v1","addr":"172.21.15.155:6826","nonce":85807}]},"public_addr":"172.21.15.155:6818/85807","cluster_addr":"172.21.15.155:6822/85807","heartbeat_back_addr":"172.21.15.155:6830/85807","heartbeat_front_addr":"172.21.15.155:6826/85807","state":["exists","up"]},{"osd":6,"uuid":"c150cff3-aee4-4714-9c08-d182b1ba9ffd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6808","nonce":85806},{"type":"v1","addr":"172.21.15.155:6809","nonce":85806}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6810","nonce":85806},{"type":"v1","addr":"172.21.15.155:6811","nonce":85806}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6814","nonce":85806},{"type":"v1","addr":"172.21.15.155:6815","nonce":85806}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6812","nonce":85806},{"type":"v1","addr":"172.21.15.155:6813","nonce":85806}]},"public_addr":"172.21.15.155:6809/85806","cluster_addr":"172.21.15.155:6811/85806","heartbeat_back_addr":"172.21.15.155:6815/85806","heartbeat_front_addr":"172.21.15.155:6813/85806","state":["exists","up"]},{"osd":7,"uuid":"71107f0e-04d1-4e72-a0ec-0faf6af003e7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6817","nonce":85832},{"type":"v1","addr":"172.21.15.155:6819","nonce":85832}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6821","nonce":85832},{"type":"v1","addr":"172.21.15.155:6823","nonce":85832}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6829","nonce":85832},{"type":"v1","addr":"172.21.15.155:6831","nonce":85832}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6825","nonce":85832},{"type":"v1","addr":"172.21.15.155:6827","nonce":85832}]},"public_addr":"172.21.15.155:6819/85832","cluster_addr":"172.21.15.155:6823/85832","heartbeat_back_addr":"172.21.15.155:6831/85832","heartbeat_front_addr":"172.21.15.155:6827/85832","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:21:25.423389+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:21:25.472661+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:21:25.817562+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:21:25.551257+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:21:25.407818+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:21:25.557976+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:21:25.747299+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:21:25.827576+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T01:21:56.594 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:56.593+0000 7fca3939d700 1 -- 172.21.15.50:0/464422820 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7fca20066f30 msgr2=0x7fca200693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:21:56.594 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:56.593+0000 7fca3939d700 1 --2- 172.21.15.50:0/464422820 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7fca20066f30 0x7fca200693e0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fca24009fd0 tx=0x7fca240091a0 comp rx=0 tx=0).stop 2023-10-06T01:21:56.594 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:56.593+0000 7fca3939d700 1 -- 172.21.15.50:0/464422820 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fca3406a9a0 msgr2=0x7fca34158e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:21:56.595 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:56.593+0000 7fca3939d700 1 --2- 172.21.15.50:0/464422820 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fca3406a9a0 0x7fca34158e50 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fca3406c960 tx=0x7fca28019000 comp rx=0 tx=0).stop 2023-10-06T01:21:56.595 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:56.593+0000 7fca3939d700 1 -- 172.21.15.50:0/464422820 shutdown_connections 2023-10-06T01:21:56.595 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:56.593+0000 7fca3939d700 1 --2- 172.21.15.50:0/464422820 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fca3406df90 0x7fca340aeca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:21:56.595 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:56.593+0000 7fca3939d700 1 --2- 172.21.15.50:0/464422820 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fca3406a5d0 0x7fca340c5860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:21:56.595 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:56.593+0000 7fca3939d700 1 --2- 172.21.15.50:0/464422820 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7fca20066f30 0x7fca200693e0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:21:56.595 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:56.593+0000 7fca3939d700 1 --2- 172.21.15.50:0/464422820 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fca3406a9a0 0x7fca34158e50 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:21:56.595 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:56.593+0000 7fca3939d700 1 -- 172.21.15.50:0/464422820 >> 172.21.15.50:0/464422820 conn(0x7fca340680c0 msgr2=0x7fca340c6970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:21:56.595 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:56.593+0000 7fca3939d700 1 -- 172.21.15.50:0/464422820 shutdown_connections 2023-10-06T01:21:56.595 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:56.593+0000 7fca3939d700 1 -- 172.21.15.50:0/464422820 wait complete. 2023-10-06T01:21:56.612 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T01:21:56.797 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:56.796+0000 7f8f3119d700 1 Processor -- start 2023-10-06T01:21:56.798 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:56.796+0000 7f8f3119d700 1 -- start start 2023-10-06T01:21:56.799 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:56.798+0000 7f8f3119d700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8f2c153e40 0x7f8f2c06df90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:21:56.799 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:56.798+0000 7f8f3119d700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f8f2c06a9a0 0x7f8f2c06e4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:21:56.799 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:56.798+0000 7f8f3119d700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8f2c0c9d00 con 0x7f8f2c06a5d0 2023-10-06T01:21:56.799 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:56.798+0000 7f8f3119d700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8f2c06f5a0 con 0x7f8f2c06a9a0 2023-10-06T01:21:56.800 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:56.798+0000 7f8f3119d700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f2c0c6750 con 0x7f8f2c153e40 2023-10-06T01:21:56.800 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:56.798+0000 7f8f2bfff700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f8f2c06a5d0 0x7f8f2c153730 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:40184/0 (socket says 172.21.15.50:40184) 2023-10-06T01:21:56.800 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:56.798+0000 7f8f2bfff700 1 -- 172.21.15.50:0/1856882955 learned_addr learned my addr 172.21.15.50:0/1856882955 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-10-06T01:21:56.800 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:56.798+0000 7f8f3099c700 1 --2- 172.21.15.50:0/1856882955 >> v2:172.21.15.50:3300/0 conn(0x7f8f2c06a9a0 0x7f8f2c06e4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:21:56.800 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:56.798+0000 7f8f2b7fe700 1 --2- 172.21.15.50:0/1856882955 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8f2c153e40 0x7f8f2c06df90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:21:56.800 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:56.798+0000 7f8f3099c700 1 -- 172.21.15.50:0/1856882955 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8f2c153e40 msgr2=0x7f8f2c06df90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:21:56.800 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:56.798+0000 7f8f3099c700 1 --2- 172.21.15.50:0/1856882955 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8f2c153e40 0x7f8f2c06df90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:21:56.800 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:56.798+0000 7f8f3099c700 1 -- 172.21.15.50:0/1856882955 >> v1:172.21.15.50:6789/0 conn(0x7f8f2c06a5d0 legacy=0x7f8f2c153730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:21:56.800 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:56.798+0000 7f8f3099c700 1 -- 172.21.15.50:0/1856882955 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f2c06ed00 con 0x7f8f2c06a9a0 2023-10-06T01:21:56.800 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:56.798+0000 7f8f2b7fe700 1 --2- 172.21.15.50:0/1856882955 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8f2c153e40 0x7f8f2c06df90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T01:21:56.800 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:56.799+0000 7f8f3099c700 1 --2- 172.21.15.50:0/1856882955 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8f2c06a9a0 0x7f8f2c06e4d0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f8f24009ec0 tx=0x7f8f24009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=99041b54d52ece12 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:21:56.802 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:56.799+0000 7f8f2affd700 1 -- 172.21.15.50:0/1856882955 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f2400e070 con 0x7f8f2c06a9a0 2023-10-06T01:21:56.802 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:56.799+0000 7f8f2affd700 1 -- 172.21.15.50:0/1856882955 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f2400bbb0 con 0x7f8f2c06a9a0 2023-10-06T01:21:56.802 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:56.799+0000 7f8f2affd700 1 -- 172.21.15.50:0/1856882955 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f24012430 con 0x7f8f2c06a9a0 2023-10-06T01:21:56.802 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:56.799+0000 7f8f3119d700 1 -- 172.21.15.50:0/1856882955 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8f2c06a9a0 msgr2=0x7f8f2c06e4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:21:56.802 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:56.799+0000 7f8f3119d700 1 --2- 172.21.15.50:0/1856882955 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8f2c06a9a0 0x7f8f2c06e4d0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f8f24009ec0 tx=0x7f8f24009780 comp rx=0 tx=0).stop 2023-10-06T01:21:56.804 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:56.799+0000 7f8f3119d700 1 -- 172.21.15.50:0/1856882955 shutdown_connections 2023-10-06T01:21:56.805 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:56.799+0000 7f8f3119d700 1 --2- 172.21.15.50:0/1856882955 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8f2c06a9a0 0x7f8f2c06e4d0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:21:56.805 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:56.799+0000 7f8f3119d700 1 --2- 172.21.15.50:0/1856882955 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8f2c153e40 0x7f8f2c06df90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:21:56.805 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:56.799+0000 7f8f3119d700 1 -- 172.21.15.50:0/1856882955 >> 172.21.15.50:0/1856882955 conn(0x7f8f2c0680c0 msgr2=0x7f8f2c0cbf00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:21:56.805 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:56.800+0000 7f8f3119d700 1 -- 172.21.15.50:0/1856882955 shutdown_connections 2023-10-06T01:21:56.805 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:56.800+0000 7f8f3119d700 1 -- 172.21.15.50:0/1856882955 wait complete. 2023-10-06T01:21:56.805 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:56.801+0000 7f8f3119d700 1 Processor -- start 2023-10-06T01:21:56.805 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:56.801+0000 7f8f3119d700 1 -- start start 2023-10-06T01:21:56.807 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:56.802+0000 7f8f3119d700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8f2c06a5d0 0x7f8f2c0c5960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:21:56.807 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:56.802+0000 7f8f3119d700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8f2c06a9a0 0x7f8f2c13dae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:21:56.807 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:56.802+0000 7f8f3119d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8f2c153e40 0x7f8f2c0c3ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:21:56.808 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:56.802+0000 7f8f3119d700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f2c0c54d0 con 0x7f8f2c153e40 2023-10-06T01:21:56.808 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:56.802+0000 7f8f3119d700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f2c0c48c0 con 0x7f8f2c06a5d0 2023-10-06T01:21:56.808 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:56.802+0000 7f8f3119d700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f2c0c4ba0 con 0x7f8f2c06a9a0 2023-10-06T01:21:56.808 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:56.802+0000 7f8f3099c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8f2c153e40 0x7f8f2c0c3ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:21:56.808 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:56.802+0000 7f8f3099c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8f2c153e40 0x7f8f2c0c3ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:47862/0 (socket says 172.21.15.50:47862) 2023-10-06T01:21:56.808 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:56.802+0000 7f8f3099c700 1 -- 172.21.15.50:0/4158584727 learned_addr learned my addr 172.21.15.50:0/4158584727 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-06T01:21:56.808 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:56.803+0000 7f8f2b7fe700 1 --2- 172.21.15.50:0/4158584727 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8f2c06a9a0 0x7f8f2c13dae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:21:56.808 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:56.803+0000 7f8f2bfff700 1 --2- 172.21.15.50:0/4158584727 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8f2c06a5d0 0x7f8f2c0c5960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:21:56.808 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:56.803+0000 7f8f3099c700 1 -- 172.21.15.50:0/4158584727 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8f2c06a9a0 msgr2=0x7f8f2c13dae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:21:56.808 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:56.803+0000 7f8f3099c700 1 --2- 172.21.15.50:0/4158584727 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8f2c06a9a0 0x7f8f2c13dae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:21:56.808 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:56.803+0000 7f8f3099c700 1 -- 172.21.15.50:0/4158584727 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8f2c06a5d0 msgr2=0x7f8f2c0c5960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:21:56.809 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:56.803+0000 7f8f3099c700 1 --2- 172.21.15.50:0/4158584727 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8f2c06a5d0 0x7f8f2c0c5960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:21:56.809 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:56.803+0000 7f8f3099c700 1 -- 172.21.15.50:0/4158584727 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f24009a20 con 0x7f8f2c153e40 2023-10-06T01:21:56.809 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:56.803+0000 7f8f3099c700 1 --2- 172.21.15.50:0/4158584727 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8f2c153e40 0x7f8f2c0c3ec0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f8f2c06c7c0 tx=0x7f8f24019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:21:56.809 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:56.803+0000 7f8f13fff700 1 -- 172.21.15.50:0/4158584727 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f24027470 con 0x7f8f2c153e40 2023-10-06T01:21:56.809 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:56.803+0000 7f8f13fff700 1 -- 172.21.15.50:0/4158584727 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f240275f0 con 0x7f8f2c153e40 2023-10-06T01:21:56.809 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:56.803+0000 7f8f13fff700 1 -- 172.21.15.50:0/4158584727 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f240279b0 con 0x7f8f2c153e40 2023-10-06T01:21:56.809 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:56.803+0000 7f8f3119d700 1 -- 172.21.15.50:0/4158584727 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8f2c0c4e80 con 0x7f8f2c153e40 2023-10-06T01:21:56.809 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:56.804+0000 7f8f3119d700 1 -- 172.21.15.50:0/4158584727 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8f2c13e020 con 0x7f8f2c153e40 2023-10-06T01:21:56.809 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:56.805+0000 7f8f3119d700 1 -- 172.21.15.50:0/4158584727 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8f2c0c5680 con 0x7f8f2c153e40 2023-10-06T01:21:56.809 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:56.805+0000 7f8f13fff700 1 -- 172.21.15.50:0/4158584727 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f8f24024070 con 0x7f8f2c153e40 2023-10-06T01:21:56.809 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:56.806+0000 7f8f13fff700 1 --2- 172.21.15.50:0/4158584727 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f8f18066f30 0x7f8f180693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:21:56.809 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:56.806+0000 7f8f13fff700 1 -- 172.21.15.50:0/4158584727 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f8f240874a0 con 0x7f8f2c153e40 2023-10-06T01:21:56.809 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:56.806+0000 7f8f2bfff700 1 --2- 172.21.15.50:0/4158584727 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f8f18066f30 0x7f8f180693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:21:56.810 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:56.807+0000 7f8f2bfff700 1 --2- 172.21.15.50:0/4158584727 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f8f18066f30 0x7f8f180693e0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f8f1c001820 tx=0x7f8f1c009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:21:56.811 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:56.811+0000 7f8f13fff700 1 -- 172.21.15.50:0/4158584727 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f8f2c0c5680 con 0x7f8f2c153e40 2023-10-06T01:21:57.023 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:57.022+0000 7f8f3119d700 1 -- 172.21.15.50:0/4158584727 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f8f2c05f270 con 0x7f8f2c153e40 2023-10-06T01:21:57.024 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:57.023+0000 7f8f13fff700 1 -- 172.21.15.50:0/4158584727 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+18707 (secure 0 0 0) 0x7f8f24054220 con 0x7f8f2c153e40 2023-10-06T01:21:57.024 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-10-06T01:21:57.024 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":25,"fsid":"0bfd9a6b-1587-4fe4-a89e-e43c00286b4e","created":"2023-10-06T01:21:16.828801+0000","modified":"2023-10-06T01:21:41.329781+0000","last_up_change":"2023-10-06T01:21:28.584523+0000","last_in_change":"2023-10-06T01:21:20.179863+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-10-06T01:21:29.304225+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":".mgr","create_time":"2023-10-06T01:21:29.835490+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-06T01:21:34.675315+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-06T01:21:35.753991+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-10-06T01:21:38.853108+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"9060727a-3959-4de3-8363-c5c5d7826c9a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":87837},{"type":"v1","addr":"172.21.15.50:6801","nonce":87837}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":87837},{"type":"v1","addr":"172.21.15.50:6803","nonce":87837}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":87837},{"type":"v1","addr":"172.21.15.50:6807","nonce":87837}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":87837},{"type":"v1","addr":"172.21.15.50:6805","nonce":87837}]},"public_addr":"172.21.15.50:6801/87837","cluster_addr":"172.21.15.50:6803/87837","heartbeat_back_addr":"172.21.15.50:6807/87837","heartbeat_front_addr":"172.21.15.50:6805/87837","state":["exists","up"]},{"osd":1,"uuid":"5ad9ef12-b579-47ea-b690-90ba887e2cef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":87853},{"type":"v1","addr":"172.21.15.50:6809","nonce":87853}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":87853},{"type":"v1","addr":"172.21.15.50:6811","nonce":87853}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":87853},{"type":"v1","addr":"172.21.15.50:6815","nonce":87853}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":87853},{"type":"v1","addr":"172.21.15.50:6813","nonce":87853}]},"public_addr":"172.21.15.50:6809/87853","cluster_addr":"172.21.15.50:6811/87853","heartbeat_back_addr":"172.21.15.50:6815/87853","heartbeat_front_addr":"172.21.15.50:6813/87853","state":["exists","up"]},{"osd":2,"uuid":"c7aee044-6f75-436f-90e1-ba42a57359bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6821","nonce":87855},{"type":"v1","addr":"172.21.15.50:6822","nonce":87855}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6824","nonce":87855},{"type":"v1","addr":"172.21.15.50:6826","nonce":87855}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":87855},{"type":"v1","addr":"172.21.15.50:6831","nonce":87855}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":87855},{"type":"v1","addr":"172.21.15.50:6829","nonce":87855}]},"public_addr":"172.21.15.50:6822/87855","cluster_addr":"172.21.15.50:6826/87855","heartbeat_back_addr":"172.21.15.50:6831/87855","heartbeat_front_addr":"172.21.15.50:6829/87855","state":["exists","up"]},{"osd":3,"uuid":"d9b901c8-e8b2-44af-9508-f453120a96c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":87856},{"type":"v1","addr":"172.21.15.50:6817","nonce":87856}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":87856},{"type":"v1","addr":"172.21.15.50:6819","nonce":87856}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6825","nonce":87856},{"type":"v1","addr":"172.21.15.50:6827","nonce":87856}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6820","nonce":87856},{"type":"v1","addr":"172.21.15.50:6823","nonce":87856}]},"public_addr":"172.21.15.50:6817/87856","cluster_addr":"172.21.15.50:6819/87856","heartbeat_back_addr":"172.21.15.50:6827/87856","heartbeat_front_addr":"172.21.15.50:6823/87856","state":["exists","up"]},{"osd":4,"uuid":"2b3c6b38-e3e9-4301-9445-60fd3fe8ce03","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":85805},{"type":"v1","addr":"172.21.15.155:6801","nonce":85805}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":85805},{"type":"v1","addr":"172.21.15.155:6803","nonce":85805}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6806","nonce":85805},{"type":"v1","addr":"172.21.15.155:6807","nonce":85805}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6804","nonce":85805},{"type":"v1","addr":"172.21.15.155:6805","nonce":85805}]},"public_addr":"172.21.15.155:6801/85805","cluster_addr":"172.21.15.155:6803/85805","heartbeat_back_addr":"172.21.15.155:6807/85805","heartbeat_front_addr":"172.21.15.155:6805/85805","state":["exists","up"]},{"osd":5,"uuid":"417b5f8f-65f1-4c94-91a7-a6ce03fe1679","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6816","nonce":85807},{"type":"v1","addr":"172.21.15.155:6818","nonce":85807}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6820","nonce":85807},{"type":"v1","addr":"172.21.15.155:6822","nonce":85807}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6828","nonce":85807},{"type":"v1","addr":"172.21.15.155:6830","nonce":85807}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6824","nonce":85807},{"type":"v1","addr":"172.21.15.155:6826","nonce":85807}]},"public_addr":"172.21.15.155:6818/85807","cluster_addr":"172.21.15.155:6822/85807","heartbeat_back_addr":"172.21.15.155:6830/85807","heartbeat_front_addr":"172.21.15.155:6826/85807","state":["exists","up"]},{"osd":6,"uuid":"c150cff3-aee4-4714-9c08-d182b1ba9ffd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6808","nonce":85806},{"type":"v1","addr":"172.21.15.155:6809","nonce":85806}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6810","nonce":85806},{"type":"v1","addr":"172.21.15.155:6811","nonce":85806}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6814","nonce":85806},{"type":"v1","addr":"172.21.15.155:6815","nonce":85806}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6812","nonce":85806},{"type":"v1","addr":"172.21.15.155:6813","nonce":85806}]},"public_addr":"172.21.15.155:6809/85806","cluster_addr":"172.21.15.155:6811/85806","heartbeat_back_addr":"172.21.15.155:6815/85806","heartbeat_front_addr":"172.21.15.155:6813/85806","state":["exists","up"]},{"osd":7,"uuid":"71107f0e-04d1-4e72-a0ec-0faf6af003e7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6817","nonce":85832},{"type":"v1","addr":"172.21.15.155:6819","nonce":85832}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6821","nonce":85832},{"type":"v1","addr":"172.21.15.155:6823","nonce":85832}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6829","nonce":85832},{"type":"v1","addr":"172.21.15.155:6831","nonce":85832}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6825","nonce":85832},{"type":"v1","addr":"172.21.15.155:6827","nonce":85832}]},"public_addr":"172.21.15.155:6819/85832","cluster_addr":"172.21.15.155:6823/85832","heartbeat_back_addr":"172.21.15.155:6831/85832","heartbeat_front_addr":"172.21.15.155:6827/85832","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:21:25.423389+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:21:25.472661+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:21:25.817562+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:21:25.551257+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:21:25.407818+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:21:25.557976+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:21:25.747299+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:21:25.827576+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T01:21:57.026 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:57.025+0000 7f8f3119d700 1 -- 172.21.15.50:0/4158584727 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f8f18066f30 msgr2=0x7f8f180693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:21:57.027 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:57.025+0000 7f8f3119d700 1 --2- 172.21.15.50:0/4158584727 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f8f18066f30 0x7f8f180693e0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f8f1c001820 tx=0x7f8f1c009040 comp rx=0 tx=0).stop 2023-10-06T01:21:57.027 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:57.025+0000 7f8f3119d700 1 -- 172.21.15.50:0/4158584727 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8f2c153e40 msgr2=0x7f8f2c0c3ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:21:57.027 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:57.025+0000 7f8f3119d700 1 --2- 172.21.15.50:0/4158584727 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8f2c153e40 0x7f8f2c0c3ec0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f8f2c06c7c0 tx=0x7f8f24019000 comp rx=0 tx=0).stop 2023-10-06T01:21:57.027 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:57.025+0000 7f8f3119d700 1 -- 172.21.15.50:0/4158584727 shutdown_connections 2023-10-06T01:21:57.027 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:57.025+0000 7f8f3119d700 1 --2- 172.21.15.50:0/4158584727 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8f2c153e40 0x7f8f2c0c3ec0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:21:57.027 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:57.025+0000 7f8f3119d700 1 --2- 172.21.15.50:0/4158584727 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f8f18066f30 0x7f8f180693e0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:21:57.027 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:57.026+0000 7f8f3119d700 1 --2- 172.21.15.50:0/4158584727 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8f2c06a5d0 0x7f8f2c0c5960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:21:57.027 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:57.026+0000 7f8f3119d700 1 --2- 172.21.15.50:0/4158584727 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8f2c06a9a0 0x7f8f2c13dae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:21:57.027 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:57.026+0000 7f8f3119d700 1 -- 172.21.15.50:0/4158584727 >> 172.21.15.50:0/4158584727 conn(0x7f8f2c0680c0 msgr2=0x7f8f2c155950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:21:57.027 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:57.026+0000 7f8f3119d700 1 -- 172.21.15.50:0/4158584727 shutdown_connections 2023-10-06T01:21:57.027 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:57.026+0000 7f8f3119d700 1 -- 172.21.15.50:0/4158584727 wait complete. 2023-10-06T01:21:57.044 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-10-06T01:21:57.234 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:57.233+0000 7f394a19d700 1 Processor -- start 2023-10-06T01:21:57.235 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:57.233+0000 7f394a19d700 1 -- start start 2023-10-06T01:21:57.235 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:57.235+0000 7f394a19d700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f394406ea30 0x7f394406eeb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:21:57.236 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:57.235+0000 7f394a19d700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f39440ad830 con 0x7f39440cb7b0 2023-10-06T01:21:57.236 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:57.235+0000 7f394a19d700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3944156920 con 0x7f3944155df0 2023-10-06T01:21:57.236 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:57.235+0000 7f394a19d700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3944150360 con 0x7f394406ea30 2023-10-06T01:21:57.236 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:57.235+0000 7f394919b700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f39440cb7b0 0x7f3944156fc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:40198/0 (socket says 172.21.15.50:40198) 2023-10-06T01:21:57.236 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:57.235+0000 7f394919b700 1 -- 172.21.15.50:0/1682984666 learned_addr learned my addr 172.21.15.50:0/1682984666 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-10-06T01:21:57.239 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:57.235+0000 7f394899a700 1 --2- 172.21.15.50:0/1682984666 >> v2:172.21.15.155:3300/0 conn(0x7f394406ea30 0x7f394406eeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:21:57.239 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:57.235+0000 7f393bfff700 1 -- 172.21.15.50:0/1682984666 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3167468883 0 0) 0x7f39440ad830 con 0x7f39440cb7b0 2023-10-06T01:21:57.239 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:57.235+0000 7f393bfff700 1 -- 172.21.15.50:0/1682984666 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3930003570 con 0x7f39440cb7b0 2023-10-06T01:21:57.240 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:57.236+0000 7f393bfff700 1 -- 172.21.15.50:0/1682984666 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1734068352 0 0) 0x7f3944156920 con 0x7f3944155df0 2023-10-06T01:21:57.240 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:57.236+0000 7f393bfff700 1 -- 172.21.15.50:0/1682984666 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f39440ad830 con 0x7f3944155df0 2023-10-06T01:21:57.240 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:57.236+0000 7f393bfff700 1 -- 172.21.15.50:0/1682984666 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3903508096 0 0) 0x7f3930003570 con 0x7f39440cb7b0 2023-10-06T01:21:57.240 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:57.236+0000 7f393bfff700 1 -- 172.21.15.50:0/1682984666 >> v2:172.21.15.155:3300/0 conn(0x7f394406ea30 msgr2=0x7f394406eeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:21:57.240 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:57.236+0000 7f393bfff700 1 --2- 172.21.15.50:0/1682984666 >> v2:172.21.15.155:3300/0 conn(0x7f394406ea30 0x7f394406eeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:21:57.240 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:57.236+0000 7f393bfff700 1 -- 172.21.15.50:0/1682984666 >> v1:172.21.15.155:6789/0 conn(0x7f3944155df0 legacy=0x7f3944156210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:21:57.240 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:57.236+0000 7f393bfff700 1 -- 172.21.15.50:0/1682984666 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3944156b90 con 0x7f39440cb7b0 2023-10-06T01:21:57.240 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:57.236+0000 7f393bfff700 1 -- 172.21.15.50:0/1682984666 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 347519148 0 0) 0x7f3940001470 con 0x7f39440cb7b0 2023-10-06T01:21:57.240 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:57.236+0000 7f394899a700 1 --2- 172.21.15.50:0/1682984666 >> v2:172.21.15.155:3300/0 conn(0x7f394406ea30 0x7f394406eeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T01:21:57.240 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:57.236+0000 7f393bfff700 1 -- 172.21.15.50:0/1682984666 >> v1:172.21.15.50:6789/0 conn(0x7f39440cb7b0 legacy=0x7f3944156fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:21:57.240 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:57.236+0000 7f393bfff700 1 --2- 172.21.15.50:0/1682984666 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3930003bf0 0x7f3930003fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:21:57.241 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:57.236+0000 7f393bfff700 1 --2- 172.21.15.50:0/1682984666 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3930004810 0x7f3930004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:21:57.241 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:57.236+0000 7f393bfff700 1 --2- 172.21.15.50:0/1682984666 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f39300051c0 0x7f393000dc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:21:57.241 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:57.236+0000 7f393bfff700 1 -- 172.21.15.50:0/1682984666 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3944150360 con 0x7f3930004810 2023-10-06T01:21:57.241 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:57.236+0000 7f393bfff700 1 -- 172.21.15.50:0/1682984666 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f393000e2c0 con 0x7f39300051c0 2023-10-06T01:21:57.241 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:57.236+0000 7f393bfff700 1 -- 172.21.15.50:0/1682984666 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f393000e480 con 0x7f3930003bf0 2023-10-06T01:21:57.241 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:57.236+0000 7f394899a700 1 --2- 172.21.15.50:0/1682984666 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3930004810 0x7f3930004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:21:57.241 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:57.236+0000 7f394999c700 1 --2- 172.21.15.50:0/1682984666 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f39300051c0 0x7f393000dc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:21:57.241 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:57.236+0000 7f394919b700 1 --2- 172.21.15.50:0/1682984666 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3930003bf0 0x7f3930003fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:21:57.241 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:57.237+0000 7f394899a700 1 -- 172.21.15.50:0/1682984666 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3930003bf0 msgr2=0x7f3930003fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:21:57.242 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:57.237+0000 7f394899a700 1 --2- 172.21.15.50:0/1682984666 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3930003bf0 0x7f3930003fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:21:57.242 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:57.237+0000 7f394899a700 1 -- 172.21.15.50:0/1682984666 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f39300051c0 msgr2=0x7f393000dc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:21:57.242 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:57.237+0000 7f394899a700 1 --2- 172.21.15.50:0/1682984666 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f39300051c0 0x7f393000dc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:21:57.242 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:57.237+0000 7f394899a700 1 -- 172.21.15.50:0/1682984666 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3930003570 con 0x7f3930004810 2023-10-06T01:21:57.242 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:57.237+0000 7f394999c700 1 -- 172.21.15.50:0/1682984666 reap_dead start 2023-10-06T01:21:57.242 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:57.237+0000 7f394899a700 1 --2- 172.21.15.50:0/1682984666 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3930004810 0x7f3930004c80 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f393400ae70 tx=0x7f393400a330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c731e98c9ef3c4ed server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:21:57.242 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:57.237+0000 7f393bfff700 1 -- 172.21.15.50:0/1682984666 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f393400e9c0 con 0x7f3930004810 2023-10-06T01:21:57.242 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:57.237+0000 7f393bfff700 1 -- 172.21.15.50:0/1682984666 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f393400eb20 con 0x7f3930004810 2023-10-06T01:21:57.242 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:57.237+0000 7f393bfff700 1 -- 172.21.15.50:0/1682984666 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f393400ecb0 con 0x7f3930004810 2023-10-06T01:21:57.242 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:57.238+0000 7f394a19d700 1 -- 172.21.15.50:0/1682984666 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3930004810 msgr2=0x7f3930004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:21:57.242 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:57.238+0000 7f394a19d700 1 --2- 172.21.15.50:0/1682984666 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3930004810 0x7f3930004c80 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f393400ae70 tx=0x7f393400a330 comp rx=0 tx=0).stop 2023-10-06T01:21:57.243 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:57.238+0000 7f394a19d700 1 -- 172.21.15.50:0/1682984666 shutdown_connections 2023-10-06T01:21:57.243 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:57.238+0000 7f394a19d700 1 --2- 172.21.15.50:0/1682984666 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3930004810 0x7f3930004c80 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:21:57.243 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:57.238+0000 7f394a19d700 1 -- 172.21.15.50:0/1682984666 >> 172.21.15.50:0/1682984666 conn(0x7f39440cbf10 msgr2=0x7f39440cc310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:21:57.243 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:57.238+0000 7f394a19d700 1 -- 172.21.15.50:0/1682984666 shutdown_connections 2023-10-06T01:21:57.243 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:57.238+0000 7f394a19d700 1 -- 172.21.15.50:0/1682984666 wait complete. 2023-10-06T01:21:57.245 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:57.239+0000 7f394a19d700 1 Processor -- start 2023-10-06T01:21:57.246 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:57.239+0000 7f394a19d700 1 -- start start 2023-10-06T01:21:57.246 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:57.240+0000 7f394a19d700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3930004810 0x7f39440aaf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:21:57.246 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:57.240+0000 7f394a19d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3944165d20 0x7f39440a9130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:21:57.246 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:57.240+0000 7f394a19d700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f39440a9670 0x7f394413e080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:21:57.246 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:57.240+0000 7f394a19d700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39440ac230 con 0x7f3944165d20 2023-10-06T01:21:57.246 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:57.240+0000 7f394a19d700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3944168680 con 0x7f39440a9670 2023-10-06T01:21:57.246 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:57.240+0000 7f394a19d700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f39440ab620 con 0x7f3930004810 2023-10-06T01:21:57.247 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:57.241+0000 7f394899a700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3944165d20 0x7f39440a9130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:21:57.247 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:57.241+0000 7f394899a700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3944165d20 0x7f39440a9130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:47868/0 (socket says 172.21.15.50:47868) 2023-10-06T01:21:57.247 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:57.241+0000 7f394899a700 1 -- 172.21.15.50:0/2676145084 learned_addr learned my addr 172.21.15.50:0/2676145084 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-06T01:21:57.247 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:57.241+0000 7f394919b700 1 --2- 172.21.15.50:0/2676145084 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3930004810 0x7f39440aaf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:21:57.247 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:57.241+0000 7f394999c700 1 --2- 172.21.15.50:0/2676145084 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f39440a9670 0x7f394413e080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:21:57.247 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:57.241+0000 7f394899a700 1 -- 172.21.15.50:0/2676145084 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3930004810 msgr2=0x7f39440aaf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:21:57.247 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:57.241+0000 7f394899a700 1 --2- 172.21.15.50:0/2676145084 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3930004810 0x7f39440aaf60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:21:57.247 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:57.241+0000 7f394899a700 1 -- 172.21.15.50:0/2676145084 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f39440a9670 msgr2=0x7f394413e080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:21:57.247 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:57.241+0000 7f394899a700 1 --2- 172.21.15.50:0/2676145084 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f39440a9670 0x7f394413e080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:21:57.247 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:57.241+0000 7f394899a700 1 -- 172.21.15.50:0/2676145084 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39440ab900 con 0x7f3944165d20 2023-10-06T01:21:57.248 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:57.241+0000 7f394899a700 1 --2- 172.21.15.50:0/2676145084 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3944165d20 0x7f39440a9130 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f393400a530 tx=0x7f3934019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:21:57.248 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:57.242+0000 7f39397fa700 1 -- 172.21.15.50:0/2676145084 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3934020070 con 0x7f3944165d20 2023-10-06T01:21:57.248 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:57.242+0000 7f39397fa700 1 -- 172.21.15.50:0/2676145084 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3934000bc0 con 0x7f3944165d20 2023-10-06T01:21:57.248 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:57.242+0000 7f39397fa700 1 -- 172.21.15.50:0/2676145084 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3934026420 con 0x7f3944165d20 2023-10-06T01:21:57.248 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:57.242+0000 7f394a19d700 1 -- 172.21.15.50:0/2676145084 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f39440abbe0 con 0x7f3944165d20 2023-10-06T01:21:57.248 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:57.242+0000 7f394a19d700 1 -- 172.21.15.50:0/2676145084 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3944166190 con 0x7f3944165d20 2023-10-06T01:21:57.248 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:57.243+0000 7f394a19d700 1 -- 172.21.15.50:0/2676145084 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f39440ac080 con 0x7f3944165d20 2023-10-06T01:21:57.248 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:57.244+0000 7f39397fa700 1 -- 172.21.15.50:0/2676145084 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f3934024070 con 0x7f3944165d20 2023-10-06T01:21:57.248 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:57.245+0000 7f39397fa700 1 --2- 172.21.15.50:0/2676145084 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f3928066f30 0x7f39280693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:21:57.248 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:57.245+0000 7f39397fa700 1 -- 172.21.15.50:0/2676145084 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f3934015030 con 0x7f3944165d20 2023-10-06T01:21:57.249 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:57.246+0000 7f394919b700 1 --2- 172.21.15.50:0/2676145084 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f3928066f30 0x7f39280693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:21:57.249 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:57.246+0000 7f394919b700 1 --2- 172.21.15.50:0/2676145084 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f3928066f30 0x7f39280693e0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f3940000c00 tx=0x7f3940001df0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:21:57.250 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:57.250+0000 7f39397fa700 1 -- 172.21.15.50:0/2676145084 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f3934052880 con 0x7f3944165d20 2023-10-06T01:21:57.499 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:57.498+0000 7f394a19d700 1 -- 172.21.15.50:0/2676145084 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f39440cbd10 con 0x7f3944165d20 2023-10-06T01:21:57.878 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:57.876+0000 7f39397fa700 1 -- 172.21.15.50:0/2676145084 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v8) v1 ==== 118+0+0 (secure 0 0 0) 0x7f3934055ea0 con 0x7f3944165d20 2023-10-06T01:21:57.880 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:57.878+0000 7f394a19d700 1 -- 172.21.15.50:0/2676145084 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f3928066f30 msgr2=0x7f39280693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:21:57.881 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:57.878+0000 7f394a19d700 1 --2- 172.21.15.50:0/2676145084 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f3928066f30 0x7f39280693e0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f3940000c00 tx=0x7f3940001df0 comp rx=0 tx=0).stop 2023-10-06T01:21:57.881 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:57.878+0000 7f394a19d700 1 -- 172.21.15.50:0/2676145084 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3944165d20 msgr2=0x7f39440a9130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:21:57.881 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:57.878+0000 7f394a19d700 1 --2- 172.21.15.50:0/2676145084 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3944165d20 0x7f39440a9130 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f393400a530 tx=0x7f3934019000 comp rx=0 tx=0).stop 2023-10-06T01:21:57.881 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:57.878+0000 7f394a19d700 1 -- 172.21.15.50:0/2676145084 shutdown_connections 2023-10-06T01:21:57.881 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:57.878+0000 7f394a19d700 1 --2- 172.21.15.50:0/2676145084 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f3928066f30 0x7f39280693e0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:21:57.881 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:57.878+0000 7f394a19d700 1 --2- 172.21.15.50:0/2676145084 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f39440a9670 0x7f394413e080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:21:57.881 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:57.878+0000 7f394a19d700 1 --2- 172.21.15.50:0/2676145084 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3930004810 0x7f39440aaf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:21:57.881 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:57.878+0000 7f394a19d700 1 --2- 172.21.15.50:0/2676145084 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3944165d20 0x7f39440a9130 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:21:57.881 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:57.878+0000 7f394a19d700 1 -- 172.21.15.50:0/2676145084 >> 172.21.15.50:0/2676145084 conn(0x7f39440cbf10 msgr2=0x7f394414f730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:21:57.881 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:57.879+0000 7f394a19d700 1 -- 172.21.15.50:0/2676145084 shutdown_connections 2023-10-06T01:21:57.881 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:57.879+0000 7f394a19d700 1 -- 172.21.15.50:0/2676145084 wait complete. 2023-10-06T01:21:57.899 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-10-06T01:21:58.089 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:58.088+0000 7f729919d700 1 Processor -- start 2023-10-06T01:21:58.090 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:58.088+0000 7f729919d700 1 -- start start 2023-10-06T01:21:58.092 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:58.089+0000 7f729919d700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f72940b2660 0x7f72940cccf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:21:58.092 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:58.089+0000 7f729919d700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f72940b2a30 0x7f72940cd230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:21:58.092 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:58.089+0000 7f729919d700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f72940ceae0 0x7f72940cef80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:21:58.093 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:58.089+0000 7f729919d700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f72940cc9b0 con 0x7f72940b2a30 2023-10-06T01:21:58.093 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:58.089+0000 7f729919d700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f72940cf4c0 con 0x7f72940b2660 2023-10-06T01:21:58.093 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:58.089+0000 7f729919d700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72940cbda0 con 0x7f72940ceae0 2023-10-06T01:21:58.093 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:58.089+0000 7f72937fe700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f72940b2a30 0x7f72940cd230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:21:58.093 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:58.089+0000 7f72937fe700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f72940b2a30 0x7f72940cd230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:47878/0 (socket says 172.21.15.50:47878) 2023-10-06T01:21:58.093 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:58.089+0000 7f72937fe700 1 -- 172.21.15.50:0/3968361007 learned_addr learned my addr 172.21.15.50:0/3968361007 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-06T01:21:58.093 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:58.089+0000 7f729899c700 1 --2- 172.21.15.50:0/3968361007 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f72940ceae0 0x7f72940cef80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:21:58.093 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:58.089+0000 7f7293fff700 1 --2- 172.21.15.50:0/3968361007 >> v2:172.21.15.155:3300/0 conn(0x7f72940b2660 0x7f72940cccf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:21:58.093 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:58.090+0000 7f72937fe700 1 -- 172.21.15.50:0/3968361007 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f72940ceae0 msgr2=0x7f72940cef80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:21:58.093 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:58.090+0000 7f72937fe700 1 --2- 172.21.15.50:0/3968361007 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f72940ceae0 0x7f72940cef80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:21:58.094 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:58.090+0000 7f72937fe700 1 -- 172.21.15.50:0/3968361007 >> v2:172.21.15.155:3300/0 conn(0x7f72940b2660 msgr2=0x7f72940cccf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:21:58.094 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:58.090+0000 7f72937fe700 1 --2- 172.21.15.50:0/3968361007 >> v2:172.21.15.155:3300/0 conn(0x7f72940b2660 0x7f72940cccf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:21:58.094 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:58.090+0000 7f72937fe700 1 -- 172.21.15.50:0/3968361007 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72940cc080 con 0x7f72940b2a30 2023-10-06T01:21:58.094 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:58.090+0000 7f72937fe700 1 --2- 172.21.15.50:0/3968361007 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f72940b2a30 0x7f72940cd230 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f7294089500 tx=0x7f7288009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3e297eb733d74a9b server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:21:58.094 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:58.090+0000 7f7292ffd700 1 -- 172.21.15.50:0/3968361007 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f728800b640 con 0x7f72940b2a30 2023-10-06T01:21:58.094 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:58.090+0000 7f7292ffd700 1 -- 172.21.15.50:0/3968361007 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f728800b7a0 con 0x7f72940b2a30 2023-10-06T01:21:58.094 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:58.090+0000 7f7292ffd700 1 -- 172.21.15.50:0/3968361007 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f728800bb60 con 0x7f72940b2a30 2023-10-06T01:21:58.096 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:58.091+0000 7f729919d700 1 -- 172.21.15.50:0/3968361007 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f72940b2a30 msgr2=0x7f72940cd230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:21:58.096 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:58.091+0000 7f729919d700 1 --2- 172.21.15.50:0/3968361007 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f72940b2a30 0x7f72940cd230 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f7294089500 tx=0x7f7288009250 comp rx=0 tx=0).stop 2023-10-06T01:21:58.096 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:58.091+0000 7f729919d700 1 -- 172.21.15.50:0/3968361007 shutdown_connections 2023-10-06T01:21:58.096 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:58.091+0000 7f729919d700 1 --2- 172.21.15.50:0/3968361007 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f72940ceae0 0x7f72940cef80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:21:58.097 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:58.091+0000 7f729919d700 1 --2- 172.21.15.50:0/3968361007 >> v2:172.21.15.155:3300/0 conn(0x7f72940b2660 0x7f72940cccf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:21:58.097 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:58.091+0000 7f729919d700 1 --2- 172.21.15.50:0/3968361007 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f72940b2a30 0x7f72940cd230 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:21:58.097 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:58.091+0000 7f729919d700 1 -- 172.21.15.50:0/3968361007 >> 172.21.15.50:0/3968361007 conn(0x7f7294099560 msgr2=0x7f729406f500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:21:58.097 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:58.091+0000 7f729919d700 1 -- 172.21.15.50:0/3968361007 shutdown_connections 2023-10-06T01:21:58.097 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:58.091+0000 7f729919d700 1 -- 172.21.15.50:0/3968361007 wait complete. 2023-10-06T01:21:58.097 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:58.092+0000 7f729919d700 1 Processor -- start 2023-10-06T01:21:58.097 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:58.093+0000 7f729919d700 1 -- start start 2023-10-06T01:21:58.097 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:58.094+0000 7f729919d700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f72940b2660 0x7f7294158e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:21:58.097 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:58.094+0000 7f729919d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f72940b2a30 0x7f729409c2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:21:58.097 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:58.094+0000 7f729919d700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f72940ceae0 0x7f729409b110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:21:58.097 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:58.094+0000 7f729919d700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f729409ac80 con 0x7f72940b2a30 2023-10-06T01:21:58.098 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:58.094+0000 7f729919d700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f729415cb50 con 0x7f72940b2660 2023-10-06T01:21:58.098 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:58.094+0000 7f729919d700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f729409a070 con 0x7f72940ceae0 2023-10-06T01:21:58.098 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:58.094+0000 7f72937fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f72940b2a30 0x7f729409c2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:21:58.098 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:58.094+0000 7f72937fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f72940b2a30 0x7f729409c2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:47886/0 (socket says 172.21.15.50:47886) 2023-10-06T01:21:58.098 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:58.094+0000 7f72937fe700 1 -- 172.21.15.50:0/2176744288 learned_addr learned my addr 172.21.15.50:0/2176744288 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-06T01:21:58.098 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:58.094+0000 7f7293fff700 1 --2- 172.21.15.50:0/2176744288 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f72940b2660 0x7f7294158e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:21:58.098 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:58.094+0000 7f729899c700 1 --2- 172.21.15.50:0/2176744288 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f72940ceae0 0x7f729409b110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:21:58.098 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:58.094+0000 7f72937fe700 1 -- 172.21.15.50:0/2176744288 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f72940ceae0 msgr2=0x7f729409b110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:21:58.098 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:58.094+0000 7f72937fe700 1 --2- 172.21.15.50:0/2176744288 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f72940ceae0 0x7f729409b110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:21:58.098 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:58.094+0000 7f72937fe700 1 -- 172.21.15.50:0/2176744288 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f72940b2660 msgr2=0x7f7294158e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:21:58.098 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:58.094+0000 7f72937fe700 1 --2- 172.21.15.50:0/2176744288 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f72940b2660 0x7f7294158e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:21:58.098 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:58.094+0000 7f72937fe700 1 -- 172.21.15.50:0/2176744288 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72880094f0 con 0x7f72940b2a30 2023-10-06T01:21:58.098 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:58.095+0000 7f72937fe700 1 --2- 172.21.15.50:0/2176744288 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f72940b2a30 0x7f729409c2f0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f729406fd00 tx=0x7f7288017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:21:58.101 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:58.095+0000 7f727bfff700 1 -- 172.21.15.50:0/2176744288 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f728800b910 con 0x7f72940b2a30 2023-10-06T01:21:58.101 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:58.095+0000 7f727bfff700 1 -- 172.21.15.50:0/2176744288 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f728800ba70 con 0x7f72940b2a30 2023-10-06T01:21:58.101 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:58.095+0000 7f729919d700 1 -- 172.21.15.50:0/2176744288 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f729409a350 con 0x7f72940b2a30 2023-10-06T01:21:58.101 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:58.095+0000 7f727bfff700 1 -- 172.21.15.50:0/2176744288 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7288011630 con 0x7f72940b2a30 2023-10-06T01:21:58.101 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:58.095+0000 7f729919d700 1 -- 172.21.15.50:0/2176744288 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f729409a910 con 0x7f72940b2a30 2023-10-06T01:21:58.101 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:58.096+0000 7f729919d700 1 -- 172.21.15.50:0/2176744288 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f729409adf0 con 0x7f72940b2a30 2023-10-06T01:21:58.102 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:58.097+0000 7f727bfff700 1 -- 172.21.15.50:0/2176744288 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f72880119a0 con 0x7f72940b2a30 2023-10-06T01:21:58.102 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:58.098+0000 7f727bfff700 1 --2- 172.21.15.50:0/2176744288 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f7280066f30 0x7f72800693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:21:58.102 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:58.098+0000 7f727bfff700 1 -- 172.21.15.50:0/2176744288 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f7288086110 con 0x7f72940b2a30 2023-10-06T01:21:58.102 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:58.098+0000 7f7293fff700 1 --2- 172.21.15.50:0/2176744288 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f7280066f30 0x7f72800693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:21:58.102 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:58.099+0000 7f7293fff700 1 --2- 172.21.15.50:0/2176744288 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f7280066f30 0x7f72800693e0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f7284009d00 tx=0x7f7284009120 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:21:58.104 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:58.102+0000 7f727bfff700 1 -- 172.21.15.50:0/2176744288 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f7288052e90 con 0x7f72940b2a30 2023-10-06T01:21:58.350 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:58.348+0000 7f729919d700 1 -- 172.21.15.50:0/2176744288 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f729405f270 con 0x7f72940b2a30 2023-10-06T01:21:58.883 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:58.881+0000 7f727bfff700 1 -- 172.21.15.50:0/2176744288 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v9) v1 ==== 122+0+0 (secure 0 0 0) 0x7f72880564b0 con 0x7f72940b2a30 2023-10-06T01:21:58.886 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:58.884+0000 7f729919d700 1 -- 172.21.15.50:0/2176744288 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f7280066f30 msgr2=0x7f72800693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:21:58.886 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:58.884+0000 7f729919d700 1 --2- 172.21.15.50:0/2176744288 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f7280066f30 0x7f72800693e0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f7284009d00 tx=0x7f7284009120 comp rx=0 tx=0).stop 2023-10-06T01:21:58.886 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:58.884+0000 7f729919d700 1 -- 172.21.15.50:0/2176744288 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f72940b2a30 msgr2=0x7f729409c2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:21:58.886 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:58.884+0000 7f729919d700 1 --2- 172.21.15.50:0/2176744288 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f72940b2a30 0x7f729409c2f0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f729406fd00 tx=0x7f7288017000 comp rx=0 tx=0).stop 2023-10-06T01:21:58.886 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:58.884+0000 7f729919d700 1 -- 172.21.15.50:0/2176744288 shutdown_connections 2023-10-06T01:21:58.886 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:58.884+0000 7f729919d700 1 --2- 172.21.15.50:0/2176744288 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f72940ceae0 0x7f729409b110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:21:58.886 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:58.884+0000 7f729919d700 1 --2- 172.21.15.50:0/2176744288 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f7280066f30 0x7f72800693e0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:21:58.886 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:58.884+0000 7f729919d700 1 --2- 172.21.15.50:0/2176744288 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f72940b2660 0x7f7294158e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:21:58.886 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:58.884+0000 7f729919d700 1 --2- 172.21.15.50:0/2176744288 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f72940b2a30 0x7f729409c2f0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:21:58.886 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:58.884+0000 7f729919d700 1 -- 172.21.15.50:0/2176744288 >> 172.21.15.50:0/2176744288 conn(0x7f7294099560 msgr2=0x7f72940b50e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:21:58.887 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:58.884+0000 7f729919d700 1 -- 172.21.15.50:0/2176744288 shutdown_connections 2023-10-06T01:21:58.887 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:58.884+0000 7f729919d700 1 -- 172.21.15.50:0/2176744288 wait complete. 2023-10-06T01:21:58.905 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T01:21:59.093 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:59.091+0000 7f7ce599d700 1 Processor -- start 2023-10-06T01:21:59.094 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:59.092+0000 7f7ce599d700 1 -- start start 2023-10-06T01:21:59.095 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:59.093+0000 7f7ce599d700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7ce00689b0 0x7f7ce015d9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:21:59.095 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:59.093+0000 7f7ce599d700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f7ce0068d80 0x7f7ce00c6d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:21:59.095 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:59.093+0000 7f7ce599d700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7ce015a860 con 0x7f7ce00cb0f0 2023-10-06T01:21:59.095 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:59.093+0000 7f7ce599d700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7ce00cac60 con 0x7f7ce0068d80 2023-10-06T01:21:59.096 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:59.093+0000 7f7ce599d700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ce00cb590 con 0x7f7ce00689b0 2023-10-06T01:21:59.096 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:59.093+0000 7f7cdffff700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f7ce0068d80 0x7f7ce00c6d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:21:59.096 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:59.093+0000 7f7cdffff700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f7ce0068d80 0x7f7ce00c6d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:47892/0 (socket says 172.21.15.50:47892) 2023-10-06T01:21:59.096 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:59.093+0000 7f7cdffff700 1 -- 172.21.15.50:0/121402479 learned_addr learned my addr 172.21.15.50:0/121402479 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-06T01:21:59.096 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:59.093+0000 7f7cdffff700 1 -- 172.21.15.50:0/121402479 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7ce00689b0 msgr2=0x7f7ce015d9d0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-10-06T01:21:59.096 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:59.093+0000 7f7cdffff700 1 --2- 172.21.15.50:0/121402479 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7ce00689b0 0x7f7ce015d9d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:21:59.096 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:59.093+0000 7f7cdffff700 1 -- 172.21.15.50:0/121402479 >> v1:172.21.15.155:6789/0 conn(0x7f7ce00cb0f0 legacy=0x7f7ce00cb9c0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-10-06T01:21:59.096 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:59.093+0000 7f7cdffff700 1 -- 172.21.15.50:0/121402479 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ce00c7400 con 0x7f7ce0068d80 2023-10-06T01:21:59.097 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:59.094+0000 7f7cdffff700 1 --2- 172.21.15.50:0/121402479 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7ce0068d80 0x7f7ce00c6d00 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f7ccc0099b0 tx=0x7f7ccc009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=91db2c3550fc891f server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:21:59.097 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:59.094+0000 7f7cdf7fe700 1 -- 172.21.15.50:0/121402479 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ccc00b820 con 0x7f7ce0068d80 2023-10-06T01:21:59.098 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:59.094+0000 7f7cdf7fe700 1 -- 172.21.15.50:0/121402479 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ccc00b980 con 0x7f7ce0068d80 2023-10-06T01:21:59.098 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:59.094+0000 7f7cdf7fe700 1 -- 172.21.15.50:0/121402479 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ccc00bd20 con 0x7f7ce0068d80 2023-10-06T01:21:59.098 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:59.094+0000 7f7ce599d700 1 -- 172.21.15.50:0/121402479 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7ce0068d80 msgr2=0x7f7ce00c6d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:21:59.098 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:59.094+0000 7f7ce599d700 1 --2- 172.21.15.50:0/121402479 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7ce0068d80 0x7f7ce00c6d00 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f7ccc0099b0 tx=0x7f7ccc009250 comp rx=0 tx=0).stop 2023-10-06T01:21:59.098 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:59.095+0000 7f7ce599d700 1 -- 172.21.15.50:0/121402479 shutdown_connections 2023-10-06T01:21:59.098 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:59.095+0000 7f7ce599d700 1 --2- 172.21.15.50:0/121402479 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7ce00689b0 0x7f7ce015d9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:21:59.098 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:59.095+0000 7f7ce599d700 1 --2- 172.21.15.50:0/121402479 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7ce0068d80 0x7f7ce00c6d00 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:21:59.098 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:59.095+0000 7f7ce599d700 1 -- 172.21.15.50:0/121402479 >> 172.21.15.50:0/121402479 conn(0x7f7ce00cd230 msgr2=0x7f7ce00c91d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:21:59.098 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:59.095+0000 7f7ce599d700 1 -- 172.21.15.50:0/121402479 shutdown_connections 2023-10-06T01:21:59.098 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:59.095+0000 7f7ce599d700 1 -- 172.21.15.50:0/121402479 wait complete. 2023-10-06T01:21:59.101 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:59.096+0000 7f7ce599d700 1 Processor -- start 2023-10-06T01:21:59.101 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:59.096+0000 7f7ce599d700 1 -- start start 2023-10-06T01:21:59.101 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:59.097+0000 7f7ce599d700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7ce00689b0 0x7f7ce00c1190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:21:59.101 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:59.097+0000 7f7ce599d700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7ce0068d80 0x7f7ce00b1880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:21:59.101 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:59.097+0000 7f7ce599d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7ce00cb0f0 0x7f7ce01573d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:21:59.101 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:59.097+0000 7f7ce599d700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ce00acbe0 con 0x7f7ce00cb0f0 2023-10-06T01:21:59.101 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:59.097+0000 7f7ce599d700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ce00b1dc0 con 0x7f7ce00689b0 2023-10-06T01:21:59.102 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:59.097+0000 7f7ce599d700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ce00acd70 con 0x7f7ce0068d80 2023-10-06T01:21:59.102 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:59.097+0000 7f7ce519c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7ce00cb0f0 0x7f7ce01573d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:21:59.102 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:59.097+0000 7f7ce519c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7ce00cb0f0 0x7f7ce01573d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:47904/0 (socket says 172.21.15.50:47904) 2023-10-06T01:21:59.102 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:59.097+0000 7f7ce519c700 1 -- 172.21.15.50:0/3707499140 learned_addr learned my addr 172.21.15.50:0/3707499140 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-06T01:21:59.102 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:59.098+0000 7f7cdffff700 1 --2- 172.21.15.50:0/3707499140 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7ce0068d80 0x7f7ce00b1880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:21:59.102 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:59.097+0000 7f7ce499b700 1 --2- 172.21.15.50:0/3707499140 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7ce00689b0 0x7f7ce00c1190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:21:59.102 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:59.098+0000 7f7ce519c700 1 -- 172.21.15.50:0/3707499140 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7ce0068d80 msgr2=0x7f7ce00b1880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:21:59.102 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:59.098+0000 7f7ce519c700 1 --2- 172.21.15.50:0/3707499140 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7ce0068d80 0x7f7ce00b1880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:21:59.102 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:59.098+0000 7f7ce519c700 1 -- 172.21.15.50:0/3707499140 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7ce00689b0 msgr2=0x7f7ce00c1190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:21:59.102 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:59.098+0000 7f7ce519c700 1 --2- 172.21.15.50:0/3707499140 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7ce00689b0 0x7f7ce00c1190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:21:59.103 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:59.098+0000 7f7ce519c700 1 -- 172.21.15.50:0/3707499140 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ccc0094f0 con 0x7f7ce00cb0f0 2023-10-06T01:21:59.103 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:59.098+0000 7f7ce519c700 1 --2- 172.21.15.50:0/3707499140 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7ce00cb0f0 0x7f7ce01573d0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f7cd800bbb0 tx=0x7f7cd8009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:21:59.103 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:59.098+0000 7f7cdcff9700 1 -- 172.21.15.50:0/3707499140 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cd80092e0 con 0x7f7ce00cb0f0 2023-10-06T01:21:59.103 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:59.098+0000 7f7cdcff9700 1 -- 172.21.15.50:0/3707499140 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7cd800c630 con 0x7f7ce00cb0f0 2023-10-06T01:21:59.103 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:59.098+0000 7f7cdcff9700 1 -- 172.21.15.50:0/3707499140 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cd800c9f0 con 0x7f7ce00cb0f0 2023-10-06T01:21:59.103 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:59.098+0000 7f7ce599d700 1 -- 172.21.15.50:0/3707499140 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7ce00c1770 con 0x7f7ce00cb0f0 2023-10-06T01:21:59.103 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:59.099+0000 7f7ce599d700 1 -- 172.21.15.50:0/3707499140 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7ce00c1d30 con 0x7f7ce00cb0f0 2023-10-06T01:21:59.104 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:59.099+0000 7f7ce599d700 1 -- 172.21.15.50:0/3707499140 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7ce00acee0 con 0x7f7ce00cb0f0 2023-10-06T01:21:59.104 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:59.100+0000 7f7cdcff9700 1 -- 172.21.15.50:0/3707499140 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f7cd8012070 con 0x7f7ce00cb0f0 2023-10-06T01:21:59.104 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:59.101+0000 7f7cdcff9700 1 --2- 172.21.15.50:0/3707499140 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f7cc4066f30 0x7f7cc40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:21:59.104 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:59.101+0000 7f7cdcff9700 1 -- 172.21.15.50:0/3707499140 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f7cd8084630 con 0x7f7ce00cb0f0 2023-10-06T01:21:59.105 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:59.102+0000 7f7ce499b700 1 --2- 172.21.15.50:0/3707499140 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f7cc4066f30 0x7f7cc40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:21:59.105 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:59.102+0000 7f7ce499b700 1 --2- 172.21.15.50:0/3707499140 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f7cc4066f30 0x7f7cc40693e0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f7cd4009ab0 tx=0x7f7cd4009060 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:21:59.107 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:59.105+0000 7f7cdcff9700 1 -- 172.21.15.50:0/3707499140 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f7cd80513b0 con 0x7f7ce00cb0f0 2023-10-06T01:21:59.351 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:59.349+0000 7f7ce599d700 1 -- 172.21.15.50:0/3707499140 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f7ce005f270 con 0x7f7ce00cb0f0 2023-10-06T01:21:59.351 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:59.350+0000 7f7cdcff9700 1 -- 172.21.15.50:0/3707499140 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4593 (secure 0 0 0) 0x7f7cd80549d0 con 0x7f7ce00cb0f0 2023-10-06T01:21:59.352 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-10-06T01:21:59.352 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4214,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6835/33654067","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6833","nonce":33654067},{"type":"v1","addr":"172.21.15.50:6835","nonce":33654067}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4279,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6836/2571345069","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":2571345069},{"type":"v1","addr":"172.21.15.155:6836","nonce":2571345069}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4290,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6834/4140731341","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6832","nonce":4140731341},{"type":"v1","addr":"172.21.15.50:6834","nonce":4140731341}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T01:21:36.779774+0000","modified":"2023-10-06T01:21:58.876370+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4302},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4302":{"gid":4302,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.155:6837/3434423585","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6835","nonce":3434423585},{"type":"v1","addr":"172.21.15.155:6837","nonce":3434423585}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2023-10-06T01:21:59.354 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:59.352+0000 7f7ce599d700 1 -- 172.21.15.50:0/3707499140 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f7cc4066f30 msgr2=0x7f7cc40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:21:59.355 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:59.352+0000 7f7ce599d700 1 --2- 172.21.15.50:0/3707499140 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f7cc4066f30 0x7f7cc40693e0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f7cd4009ab0 tx=0x7f7cd4009060 comp rx=0 tx=0).stop 2023-10-06T01:21:59.355 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:59.352+0000 7f7ce599d700 1 -- 172.21.15.50:0/3707499140 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7ce00cb0f0 msgr2=0x7f7ce01573d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:21:59.355 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:59.352+0000 7f7ce599d700 1 --2- 172.21.15.50:0/3707499140 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7ce00cb0f0 0x7f7ce01573d0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f7cd800bbb0 tx=0x7f7cd8009840 comp rx=0 tx=0).stop 2023-10-06T01:21:59.355 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:59.352+0000 7f7ce599d700 1 -- 172.21.15.50:0/3707499140 shutdown_connections 2023-10-06T01:21:59.355 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:59.352+0000 7f7ce599d700 1 --2- 172.21.15.50:0/3707499140 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7ce00cb0f0 0x7f7ce01573d0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:21:59.355 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:59.352+0000 7f7ce599d700 1 --2- 172.21.15.50:0/3707499140 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f7cc4066f30 0x7f7cc40693e0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:21:59.355 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:59.352+0000 7f7ce599d700 1 --2- 172.21.15.50:0/3707499140 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7ce00689b0 0x7f7ce00c1190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:21:59.355 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:59.352+0000 7f7ce599d700 1 --2- 172.21.15.50:0/3707499140 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7ce0068d80 0x7f7ce00b1880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:21:59.355 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:59.352+0000 7f7ce599d700 1 -- 172.21.15.50:0/3707499140 >> 172.21.15.50:0/3707499140 conn(0x7f7ce00cd230 msgr2=0x7f7ce006e480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:21:59.355 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:59.352+0000 7f7ce599d700 1 -- 172.21.15.50:0/3707499140 shutdown_connections 2023-10-06T01:21:59.355 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:59.352+0000 7f7ce599d700 1 -- 172.21.15.50:0/3707499140 wait complete. 2023-10-06T01:21:59.356 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 9 2023-10-06T01:21:59.372 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T01:21:59.559 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:59.557+0000 7f9a7319d700 1 Processor -- start 2023-10-06T01:21:59.559 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:59.557+0000 7f9a7319d700 1 -- start start 2023-10-06T01:21:59.560 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:59.558+0000 7f9a7319d700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9a6c1407b0 0x7f9a6c06d250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:21:59.561 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:59.558+0000 7f9a7319d700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f9a6c140b80 0x7f9a6c0aecc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:21:59.561 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:59.558+0000 7f9a7319d700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9a6c0c6540 con 0x7f9a6c0af200 2023-10-06T01:21:59.561 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:59.558+0000 7f9a7319d700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9a6c0c6820 con 0x7f9a6c140b80 2023-10-06T01:21:59.561 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:59.558+0000 7f9a7319d700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a6c0c6b00 con 0x7f9a6c1407b0 2023-10-06T01:21:59.563 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:59.559+0000 7f9a7199a700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f9a6c140b80 0x7f9a6c0aecc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:21:59.563 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:59.559+0000 7f9a7219b700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9a6c1407b0 0x7f9a6c06d250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:21:59.563 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:59.559+0000 7f9a7219b700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9a6c1407b0 0x7f9a6c06d250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3301/0 says I am v2:172.21.15.50:49460/0 (socket says 172.21.15.50:49460) 2023-10-06T01:21:59.563 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:59.559+0000 7f9a7199a700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f9a6c140b80 0x7f9a6c0aecc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.50:54028/0 (socket says 172.21.15.50:54028) 2023-10-06T01:21:59.564 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:59.559+0000 7f9a7219b700 1 -- 172.21.15.50:0/3975293385 learned_addr learned my addr 172.21.15.50:0/3975293385 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-06T01:21:59.564 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:59.560+0000 7f9a7219b700 1 -- 172.21.15.50:0/3975293385 >> v2:172.21.15.155:3300/0 conn(0x7f9a6c140b80 msgr2=0x7f9a6c0aecc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:21:59.564 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:59.560+0000 7f9a7219b700 1 --2- 172.21.15.50:0/3975293385 >> v2:172.21.15.155:3300/0 conn(0x7f9a6c140b80 0x7f9a6c0aecc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:21:59.564 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:59.560+0000 7f9a7219b700 1 -- 172.21.15.50:0/3975293385 >> v1:172.21.15.155:6789/0 conn(0x7f9a6c0af200 legacy=0x7f9a6c15adf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:21:59.564 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:59.560+0000 7f9a7219b700 1 -- 172.21.15.50:0/3975293385 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a6c0c6de0 con 0x7f9a6c1407b0 2023-10-06T01:21:59.564 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:59.560+0000 7f9a7199a700 1 --2- 172.21.15.50:0/3975293385 >> v2:172.21.15.155:3300/0 conn(0x7f9a6c140b80 0x7f9a6c0aecc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T01:21:59.564 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:59.560+0000 7f9a7219b700 1 --2- 172.21.15.50:0/3975293385 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9a6c1407b0 0x7f9a6c06d250 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f9a680099b0 tx=0x7f9a68009250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a414d38396442402 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:21:59.564 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:59.560+0000 7f9a71199700 1 -- 172.21.15.50:0/3975293385 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a68009ea0 con 0x7f9a6c1407b0 2023-10-06T01:21:59.564 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:59.560+0000 7f9a71199700 1 -- 172.21.15.50:0/3975293385 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a6800b860 con 0x7f9a6c1407b0 2023-10-06T01:21:59.564 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:59.560+0000 7f9a71199700 1 -- 172.21.15.50:0/3975293385 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a6800bc00 con 0x7f9a6c1407b0 2023-10-06T01:21:59.564 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:59.561+0000 7f9a7319d700 1 -- 172.21.15.50:0/3975293385 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9a6c1407b0 msgr2=0x7f9a6c06d250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:21:59.565 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:59.561+0000 7f9a7319d700 1 --2- 172.21.15.50:0/3975293385 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9a6c1407b0 0x7f9a6c06d250 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f9a680099b0 tx=0x7f9a68009250 comp rx=0 tx=0).stop 2023-10-06T01:21:59.565 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:59.561+0000 7f9a7319d700 1 -- 172.21.15.50:0/3975293385 shutdown_connections 2023-10-06T01:21:59.565 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:59.561+0000 7f9a7319d700 1 --2- 172.21.15.50:0/3975293385 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9a6c1407b0 0x7f9a6c06d250 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:21:59.565 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:59.561+0000 7f9a7319d700 1 --2- 172.21.15.50:0/3975293385 >> v2:172.21.15.155:3300/0 conn(0x7f9a6c140b80 0x7f9a6c0aecc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:21:59.565 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:59.561+0000 7f9a7319d700 1 -- 172.21.15.50:0/3975293385 >> 172.21.15.50:0/3975293385 conn(0x7f9a6c0680c0 msgr2=0x7f9a6c0cbf00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:21:59.565 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:59.561+0000 7f9a7319d700 1 -- 172.21.15.50:0/3975293385 shutdown_connections 2023-10-06T01:21:59.565 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:59.561+0000 7f9a7319d700 1 -- 172.21.15.50:0/3975293385 wait complete. 2023-10-06T01:21:59.567 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:59.562+0000 7f9a7319d700 1 Processor -- start 2023-10-06T01:21:59.568 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:59.563+0000 7f9a7319d700 1 -- start start 2023-10-06T01:21:59.568 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:59.563+0000 7f9a7319d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9a6c0af200 0x7f9a6c0c4cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:21:59.568 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:59.563+0000 7f9a7319d700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9a6c1407b0 0x7f9a6c0c7ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:21:59.568 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:59.563+0000 7f9a7319d700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9a6c0c7ff0 0x7f9a6c158dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:21:59.568 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:59.563+0000 7f9a7319d700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a6c0c8470 con 0x7f9a6c0af200 2023-10-06T01:21:59.568 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:59.563+0000 7f9a7319d700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a6c1560c0 con 0x7f9a6c1407b0 2023-10-06T01:21:59.568 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:59.563+0000 7f9a7319d700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a6c15a6a0 con 0x7f9a6c0c7ff0 2023-10-06T01:21:59.568 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:59.564+0000 7f9a7219b700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9a6c0af200 0x7f9a6c0c4cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:21:59.568 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:59.564+0000 7f9a7219b700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9a6c0af200 0x7f9a6c0c4cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:47908/0 (socket says 172.21.15.50:47908) 2023-10-06T01:21:59.568 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:59.564+0000 7f9a7219b700 1 -- 172.21.15.50:0/4086713177 learned_addr learned my addr 172.21.15.50:0/4086713177 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-06T01:21:59.569 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:59.564+0000 7f9a7299c700 1 --2- 172.21.15.50:0/4086713177 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9a6c0c7ff0 0x7f9a6c158dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:21:59.569 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:59.564+0000 7f9a7219b700 1 -- 172.21.15.50:0/4086713177 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9a6c0c7ff0 msgr2=0x7f9a6c158dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:21:59.569 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:59.564+0000 7f9a7219b700 1 --2- 172.21.15.50:0/4086713177 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9a6c0c7ff0 0x7f9a6c158dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:21:59.569 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:59.564+0000 7f9a7199a700 1 --2- 172.21.15.50:0/4086713177 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9a6c1407b0 0x7f9a6c0c7ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:21:59.569 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:59.564+0000 7f9a7219b700 1 -- 172.21.15.50:0/4086713177 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9a6c1407b0 msgr2=0x7f9a6c0c7ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:21:59.569 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:59.564+0000 7f9a7219b700 1 --2- 172.21.15.50:0/4086713177 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9a6c1407b0 0x7f9a6c0c7ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:21:59.569 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:59.564+0000 7f9a7219b700 1 -- 172.21.15.50:0/4086713177 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a5c009420 con 0x7f9a6c0af200 2023-10-06T01:21:59.569 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:59.564+0000 7f9a7199a700 1 --2- 172.21.15.50:0/4086713177 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9a6c1407b0 0x7f9a6c0c7ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T01:21:59.569 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:59.564+0000 7f9a7219b700 1 --2- 172.21.15.50:0/4086713177 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9a6c0af200 0x7f9a6c0c4cf0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f9a68006fd0 tx=0x7f9a68017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:21:59.569 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:59.565+0000 7f9a627fc700 1 -- 172.21.15.50:0/4086713177 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a6800bbe0 con 0x7f9a6c0af200 2023-10-06T01:21:59.569 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:59.565+0000 7f9a627fc700 1 -- 172.21.15.50:0/4086713177 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a68011420 con 0x7f9a6c0af200 2023-10-06T01:21:59.570 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:59.565+0000 7f9a7319d700 1 -- 172.21.15.50:0/4086713177 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9a680094f0 con 0x7f9a6c0af200 2023-10-06T01:21:59.570 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:59.565+0000 7f9a627fc700 1 -- 172.21.15.50:0/4086713177 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a680117c0 con 0x7f9a6c0af200 2023-10-06T01:21:59.570 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:59.565+0000 7f9a7319d700 1 -- 172.21.15.50:0/4086713177 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9a6c159d70 con 0x7f9a6c0af200 2023-10-06T01:21:59.570 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:59.566+0000 7f9a7319d700 1 -- 172.21.15.50:0/4086713177 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9a6c05f270 con 0x7f9a6c0af200 2023-10-06T01:21:59.571 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:59.567+0000 7f9a627fc700 1 -- 172.21.15.50:0/4086713177 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f9a68011bb0 con 0x7f9a6c0af200 2023-10-06T01:21:59.571 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:59.567+0000 7f9a627fc700 1 --2- 172.21.15.50:0/4086713177 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f9a50066f30 0x7f9a500693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:21:59.571 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:59.568+0000 7f9a627fc700 1 -- 172.21.15.50:0/4086713177 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f9a680863b0 con 0x7f9a6c0af200 2023-10-06T01:21:59.571 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:59.568+0000 7f9a7199a700 1 --2- 172.21.15.50:0/4086713177 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f9a50066f30 0x7f9a500693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:21:59.571 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:59.569+0000 7f9a7199a700 1 --2- 172.21.15.50:0/4086713177 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f9a50066f30 0x7f9a500693e0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f9a5c0093f0 tx=0x7f9a5c008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:21:59.573 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:59.572+0000 7f9a627fc700 1 -- 172.21.15.50:0/4086713177 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f9a68053130 con 0x7f9a6c0af200 2023-10-06T01:21:59.781 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:59.780+0000 7f9a7319d700 1 -- 172.21.15.50:0/4086713177 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9a6c0c7150 con 0x7f9a6c0af200 2023-10-06T01:21:59.782 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:59.781+0000 7f9a627fc700 1 -- 172.21.15.50:0/4086713177 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+18707 (secure 0 0 0) 0x7f9a68011e60 con 0x7f9a6c0af200 2023-10-06T01:21:59.783 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-10-06T01:21:59.783 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":25,"fsid":"0bfd9a6b-1587-4fe4-a89e-e43c00286b4e","created":"2023-10-06T01:21:16.828801+0000","modified":"2023-10-06T01:21:41.329781+0000","last_up_change":"2023-10-06T01:21:28.584523+0000","last_in_change":"2023-10-06T01:21:20.179863+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-10-06T01:21:29.304225+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":".mgr","create_time":"2023-10-06T01:21:29.835490+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-06T01:21:34.675315+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-06T01:21:35.753991+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-10-06T01:21:38.853108+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"9060727a-3959-4de3-8363-c5c5d7826c9a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":87837},{"type":"v1","addr":"172.21.15.50:6801","nonce":87837}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":87837},{"type":"v1","addr":"172.21.15.50:6803","nonce":87837}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":87837},{"type":"v1","addr":"172.21.15.50:6807","nonce":87837}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":87837},{"type":"v1","addr":"172.21.15.50:6805","nonce":87837}]},"public_addr":"172.21.15.50:6801/87837","cluster_addr":"172.21.15.50:6803/87837","heartbeat_back_addr":"172.21.15.50:6807/87837","heartbeat_front_addr":"172.21.15.50:6805/87837","state":["exists","up"]},{"osd":1,"uuid":"5ad9ef12-b579-47ea-b690-90ba887e2cef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":87853},{"type":"v1","addr":"172.21.15.50:6809","nonce":87853}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":87853},{"type":"v1","addr":"172.21.15.50:6811","nonce":87853}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":87853},{"type":"v1","addr":"172.21.15.50:6815","nonce":87853}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":87853},{"type":"v1","addr":"172.21.15.50:6813","nonce":87853}]},"public_addr":"172.21.15.50:6809/87853","cluster_addr":"172.21.15.50:6811/87853","heartbeat_back_addr":"172.21.15.50:6815/87853","heartbeat_front_addr":"172.21.15.50:6813/87853","state":["exists","up"]},{"osd":2,"uuid":"c7aee044-6f75-436f-90e1-ba42a57359bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6821","nonce":87855},{"type":"v1","addr":"172.21.15.50:6822","nonce":87855}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6824","nonce":87855},{"type":"v1","addr":"172.21.15.50:6826","nonce":87855}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":87855},{"type":"v1","addr":"172.21.15.50:6831","nonce":87855}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":87855},{"type":"v1","addr":"172.21.15.50:6829","nonce":87855}]},"public_addr":"172.21.15.50:6822/87855","cluster_addr":"172.21.15.50:6826/87855","heartbeat_back_addr":"172.21.15.50:6831/87855","heartbeat_front_addr":"172.21.15.50:6829/87855","state":["exists","up"]},{"osd":3,"uuid":"d9b901c8-e8b2-44af-9508-f453120a96c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":87856},{"type":"v1","addr":"172.21.15.50:6817","nonce":87856}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":87856},{"type":"v1","addr":"172.21.15.50:6819","nonce":87856}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6825","nonce":87856},{"type":"v1","addr":"172.21.15.50:6827","nonce":87856}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6820","nonce":87856},{"type":"v1","addr":"172.21.15.50:6823","nonce":87856}]},"public_addr":"172.21.15.50:6817/87856","cluster_addr":"172.21.15.50:6819/87856","heartbeat_back_addr":"172.21.15.50:6827/87856","heartbeat_front_addr":"172.21.15.50:6823/87856","state":["exists","up"]},{"osd":4,"uuid":"2b3c6b38-e3e9-4301-9445-60fd3fe8ce03","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":85805},{"type":"v1","addr":"172.21.15.155:6801","nonce":85805}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":85805},{"type":"v1","addr":"172.21.15.155:6803","nonce":85805}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6806","nonce":85805},{"type":"v1","addr":"172.21.15.155:6807","nonce":85805}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6804","nonce":85805},{"type":"v1","addr":"172.21.15.155:6805","nonce":85805}]},"public_addr":"172.21.15.155:6801/85805","cluster_addr":"172.21.15.155:6803/85805","heartbeat_back_addr":"172.21.15.155:6807/85805","heartbeat_front_addr":"172.21.15.155:6805/85805","state":["exists","up"]},{"osd":5,"uuid":"417b5f8f-65f1-4c94-91a7-a6ce03fe1679","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6816","nonce":85807},{"type":"v1","addr":"172.21.15.155:6818","nonce":85807}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6820","nonce":85807},{"type":"v1","addr":"172.21.15.155:6822","nonce":85807}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6828","nonce":85807},{"type":"v1","addr":"172.21.15.155:6830","nonce":85807}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6824","nonce":85807},{"type":"v1","addr":"172.21.15.155:6826","nonce":85807}]},"public_addr":"172.21.15.155:6818/85807","cluster_addr":"172.21.15.155:6822/85807","heartbeat_back_addr":"172.21.15.155:6830/85807","heartbeat_front_addr":"172.21.15.155:6826/85807","state":["exists","up"]},{"osd":6,"uuid":"c150cff3-aee4-4714-9c08-d182b1ba9ffd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6808","nonce":85806},{"type":"v1","addr":"172.21.15.155:6809","nonce":85806}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6810","nonce":85806},{"type":"v1","addr":"172.21.15.155:6811","nonce":85806}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6814","nonce":85806},{"type":"v1","addr":"172.21.15.155:6815","nonce":85806}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6812","nonce":85806},{"type":"v1","addr":"172.21.15.155:6813","nonce":85806}]},"public_addr":"172.21.15.155:6809/85806","cluster_addr":"172.21.15.155:6811/85806","heartbeat_back_addr":"172.21.15.155:6815/85806","heartbeat_front_addr":"172.21.15.155:6813/85806","state":["exists","up"]},{"osd":7,"uuid":"71107f0e-04d1-4e72-a0ec-0faf6af003e7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6817","nonce":85832},{"type":"v1","addr":"172.21.15.155:6819","nonce":85832}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6821","nonce":85832},{"type":"v1","addr":"172.21.15.155:6823","nonce":85832}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6829","nonce":85832},{"type":"v1","addr":"172.21.15.155:6831","nonce":85832}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6825","nonce":85832},{"type":"v1","addr":"172.21.15.155:6827","nonce":85832}]},"public_addr":"172.21.15.155:6819/85832","cluster_addr":"172.21.15.155:6823/85832","heartbeat_back_addr":"172.21.15.155:6831/85832","heartbeat_front_addr":"172.21.15.155:6827/85832","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:21:25.423389+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:21:25.472661+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:21:25.817562+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:21:25.551257+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:21:25.407818+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:21:25.557976+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:21:25.747299+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:21:25.827576+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T01:21:59.785 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:59.783+0000 7f9a7319d700 1 -- 172.21.15.50:0/4086713177 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f9a50066f30 msgr2=0x7f9a500693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:21:59.785 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:59.783+0000 7f9a7319d700 1 --2- 172.21.15.50:0/4086713177 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f9a50066f30 0x7f9a500693e0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f9a5c0093f0 tx=0x7f9a5c008040 comp rx=0 tx=0).stop 2023-10-06T01:21:59.785 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:59.783+0000 7f9a7319d700 1 -- 172.21.15.50:0/4086713177 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9a6c0af200 msgr2=0x7f9a6c0c4cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:21:59.785 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:59.783+0000 7f9a7319d700 1 --2- 172.21.15.50:0/4086713177 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9a6c0af200 0x7f9a6c0c4cf0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f9a68006fd0 tx=0x7f9a68017000 comp rx=0 tx=0).stop 2023-10-06T01:21:59.785 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:59.783+0000 7f9a7319d700 1 -- 172.21.15.50:0/4086713177 shutdown_connections 2023-10-06T01:21:59.786 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:59.783+0000 7f9a7319d700 1 --2- 172.21.15.50:0/4086713177 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9a6c0c7ff0 0x7f9a6c158dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:21:59.786 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:59.783+0000 7f9a7319d700 1 --2- 172.21.15.50:0/4086713177 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9a6c0af200 0x7f9a6c0c4cf0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:21:59.786 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:59.783+0000 7f9a7319d700 1 --2- 172.21.15.50:0/4086713177 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f9a50066f30 0x7f9a500693e0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:21:59.786 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:59.783+0000 7f9a7319d700 1 --2- 172.21.15.50:0/4086713177 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9a6c1407b0 0x7f9a6c0c7ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:21:59.786 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:59.783+0000 7f9a7319d700 1 -- 172.21.15.50:0/4086713177 >> 172.21.15.50:0/4086713177 conn(0x7f9a6c0680c0 msgr2=0x7f9a6c156a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:21:59.786 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:59.783+0000 7f9a7319d700 1 -- 172.21.15.50:0/4086713177 shutdown_connections 2023-10-06T01:21:59.786 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:59.783+0000 7f9a7319d700 1 -- 172.21.15.50:0/4086713177 wait complete. 2023-10-06T01:21:59.803 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-10-06T01:21:59.803 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-06T01:21:59.991 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:59.989+0000 7eff08d9d700 1 Processor -- start 2023-10-06T01:21:59.991 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:59.989+0000 7eff08d9d700 1 -- start start 2023-10-06T01:21:59.993 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:59.990+0000 7eff08d9d700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7eff04159480 0x7eff040b30d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:21:59.993 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:59.990+0000 7eff08d9d700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7eff040b2140 0x7eff040b2560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:21:59.993 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:59.990+0000 7eff08d9d700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7eff040cb7e0 con 0x7eff040b3610 2023-10-06T01:21:59.993 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:59.990+0000 7eff08d9d700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7eff040b08a0 con 0x7eff04159480 2023-10-06T01:21:59.993 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:59.990+0000 7eff08d9d700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7eff040cb190 con 0x7eff040b2140 2023-10-06T01:21:59.993 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:59.990+0000 7eff037fe700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7eff04159480 0x7eff040b30d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:21:59.993 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:59.990+0000 7eff037fe700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7eff04159480 0x7eff040b30d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:47924/0 (socket says 172.21.15.50:47924) 2023-10-06T01:21:59.993 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:59.990+0000 7eff037fe700 1 -- 172.21.15.50:0/580282394 learned_addr learned my addr 172.21.15.50:0/580282394 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-06T01:21:59.993 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:59.991+0000 7eff03fff700 1 --2- 172.21.15.50:0/580282394 >> v2:172.21.15.155:3300/0 conn(0x7eff040b2140 0x7eff040b2560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:21:59.994 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:59.991+0000 7eff037fe700 1 -- 172.21.15.50:0/580282394 >> v2:172.21.15.155:3300/0 conn(0x7eff040b2140 msgr2=0x7eff040b2560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:21:59.994 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:59.991+0000 7eff037fe700 1 --2- 172.21.15.50:0/580282394 >> v2:172.21.15.155:3300/0 conn(0x7eff040b2140 0x7eff040b2560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:21:59.994 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:59.991+0000 7eff037fe700 1 -- 172.21.15.50:0/580282394 >> v1:172.21.15.155:6789/0 conn(0x7eff040b3610 legacy=0x7eff040cbc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:21:59.994 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:59.991+0000 7eff037fe700 1 -- 172.21.15.50:0/580282394 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff040cb470 con 0x7eff04159480 2023-10-06T01:21:59.994 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:59.991+0000 7eff037fe700 1 --2- 172.21.15.50:0/580282394 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7eff04159480 0x7eff040b30d0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7eff040ca830 tx=0x7efef4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f1f366af7deb478c server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:21:59.995 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:59.991+0000 7eff027fc700 1 -- 172.21.15.50:0/580282394 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efef400b860 con 0x7eff04159480 2023-10-06T01:21:59.995 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:59.992+0000 7eff027fc700 1 -- 172.21.15.50:0/580282394 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efef400b9c0 con 0x7eff04159480 2023-10-06T01:21:59.995 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:59.992+0000 7eff027fc700 1 -- 172.21.15.50:0/580282394 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efef400bd60 con 0x7eff04159480 2023-10-06T01:21:59.995 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:59.992+0000 7eff08d9d700 1 -- 172.21.15.50:0/580282394 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7eff04159480 msgr2=0x7eff040b30d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:21:59.995 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:59.992+0000 7eff08d9d700 1 --2- 172.21.15.50:0/580282394 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7eff04159480 0x7eff040b30d0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7eff040ca830 tx=0x7efef4009250 comp rx=0 tx=0).stop 2023-10-06T01:21:59.995 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:59.992+0000 7eff08d9d700 1 -- 172.21.15.50:0/580282394 shutdown_connections 2023-10-06T01:21:59.995 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:59.992+0000 7eff08d9d700 1 --2- 172.21.15.50:0/580282394 >> v2:172.21.15.155:3300/0 conn(0x7eff040b2140 0x7eff040b2560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:21:59.996 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:59.992+0000 7eff08d9d700 1 --2- 172.21.15.50:0/580282394 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7eff04159480 0x7eff040b30d0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:21:59.996 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:59.992+0000 7eff08d9d700 1 -- 172.21.15.50:0/580282394 >> 172.21.15.50:0/580282394 conn(0x7eff0406ed20 msgr2=0x7eff0406f120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:21:59.996 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:59.992+0000 7eff08d9d700 1 -- 172.21.15.50:0/580282394 shutdown_connections 2023-10-06T01:21:59.996 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:59.992+0000 7eff08d9d700 1 -- 172.21.15.50:0/580282394 wait complete. 2023-10-06T01:21:59.998 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:59.994+0000 7eff08d9d700 1 Processor -- start 2023-10-06T01:21:59.998 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:59.994+0000 7eff08d9d700 1 -- start start 2023-10-06T01:21:59.998 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:59.995+0000 7eff08d9d700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7eff040b2140 0x7eff040c4ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:21:59.998 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:59.995+0000 7eff08d9d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7eff040b3610 0x7eff0416cc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:21:59.998 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:59.995+0000 7eff08d9d700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7eff04159480 0x7eff0416d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:21:59.998 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:59.995+0000 7eff08d9d700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff040c6210 con 0x7eff040b3610 2023-10-06T01:21:59.998 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:59.995+0000 7eff08d9d700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff040c5590 con 0x7eff04159480 2023-10-06T01:21:59.998 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:59.995+0000 7eff08d9d700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff040c5870 con 0x7eff040b2140 2023-10-06T01:21:59.998 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:59.995+0000 7eff02ffd700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7eff040b3610 0x7eff0416cc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:21:59.999 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:59.995+0000 7eff02ffd700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7eff040b3610 0x7eff0416cc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:47938/0 (socket says 172.21.15.50:47938) 2023-10-06T01:21:59.999 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:59.995+0000 7eff02ffd700 1 -- 172.21.15.50:0/1559979360 learned_addr learned my addr 172.21.15.50:0/1559979360 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-06T01:21:59.999 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:59.995+0000 7eff03fff700 1 --2- 172.21.15.50:0/1559979360 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7eff04159480 0x7eff0416d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:21:59.999 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:59.995+0000 7eff037fe700 1 --2- 172.21.15.50:0/1559979360 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7eff040b2140 0x7eff040c4ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:21:59.999 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:59.995+0000 7eff02ffd700 1 -- 172.21.15.50:0/1559979360 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7eff040b2140 msgr2=0x7eff040c4ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:21:59.999 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:59.995+0000 7eff02ffd700 1 --2- 172.21.15.50:0/1559979360 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7eff040b2140 0x7eff040c4ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:21:59.999 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:59.995+0000 7eff02ffd700 1 -- 172.21.15.50:0/1559979360 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7eff04159480 msgr2=0x7eff0416d190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:21:59.999 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:59.995+0000 7eff02ffd700 1 --2- 172.21.15.50:0/1559979360 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7eff04159480 0x7eff0416d190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:21:59.999 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:59.995+0000 7eff02ffd700 1 -- 172.21.15.50:0/1559979360 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efef40094f0 con 0x7eff040b3610 2023-10-06T01:21:59.999 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:59.996+0000 7eff02ffd700 1 --2- 172.21.15.50:0/1559979360 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7eff040b3610 0x7eff0416cc50 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7efef800c590 tx=0x7efef800c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:21:59.999 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:59.996+0000 7efeeb7fe700 1 -- 172.21.15.50:0/1559979360 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efef8011590 con 0x7eff040b3610 2023-10-06T01:21:59.999 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:59.996+0000 7efeeb7fe700 1 -- 172.21.15.50:0/1559979360 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efef8011710 con 0x7eff040b3610 2023-10-06T01:22:00.000 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:59.996+0000 7eff08d9d700 1 -- 172.21.15.50:0/1559979360 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7eff040c5b50 con 0x7eff040b3610 2023-10-06T01:22:00.000 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:59.996+0000 7efeeb7fe700 1 -- 172.21.15.50:0/1559979360 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efef8011ad0 con 0x7eff040b3610 2023-10-06T01:22:00.000 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:59.996+0000 7eff08d9d700 1 -- 172.21.15.50:0/1559979360 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7eff04156370 con 0x7eff040b3610 2023-10-06T01:22:00.000 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:59.997+0000 7eff08d9d700 1 -- 172.21.15.50:0/1559979360 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7eff040c6350 con 0x7eff040b3610 2023-10-06T01:22:00.000 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:59.998+0000 7efeeb7fe700 1 -- 172.21.15.50:0/1559979360 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7efef801b3b0 con 0x7eff040b3610 2023-10-06T01:22:00.001 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:59.999+0000 7efeeb7fe700 1 --2- 172.21.15.50:0/1559979360 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7efef0066f30 0x7efef00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:00.001 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:21:59.999+0000 7efeeb7fe700 1 -- 172.21.15.50:0/1559979360 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6809+0+0 (secure 0 0 0) 0x7efef8083eb0 con 0x7eff040b3610 2023-10-06T01:22:00.001 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:00.000+0000 7eff037fe700 1 --2- 172.21.15.50:0/1559979360 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7efef0066f30 0x7efef00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:00.002 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:00.000+0000 7eff037fe700 1 --2- 172.21.15.50:0/1559979360 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7efef0066f30 0x7efef00693e0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7eff040ca830 tx=0x7efef4017000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:22:00.005 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:00.004+0000 7efeeb7fe700 1 -- 172.21.15.50:0/1559979360 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7eff040c6350 con 0x7eff040b3610 2023-10-06T01:22:00.203 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:00.201+0000 7eff08d9d700 1 -- 172.21.15.50:0/1559979360 --> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7eff040c6350 con 0x7efef0066f30 2023-10-06T01:22:00.217 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:00.215+0000 7efeeb7fe700 1 -- 172.21.15.50:0/1559979360 <== mgr.4099 v2:172.21.15.155:6832/85215 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+367591 (secure 0 0 0) 0x7eff040c6350 con 0x7efef0066f30 2023-10-06T01:22:00.222 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-10-06T01:22:00.225 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:00.220+0000 7eff08d9d700 1 -- 172.21.15.50:0/1559979360 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7efef0066f30 msgr2=0x7efef00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:00.225 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:00.220+0000 7eff08d9d700 1 --2- 172.21.15.50:0/1559979360 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7efef0066f30 0x7efef00693e0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7eff040ca830 tx=0x7efef4017000 comp rx=0 tx=0).stop 2023-10-06T01:22:00.225 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:00.220+0000 7eff08d9d700 1 -- 172.21.15.50:0/1559979360 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7eff040b3610 msgr2=0x7eff0416cc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:00.225 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:00.220+0000 7eff08d9d700 1 --2- 172.21.15.50:0/1559979360 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7eff040b3610 0x7eff0416cc50 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7efef800c590 tx=0x7efef800c8a0 comp rx=0 tx=0).stop 2023-10-06T01:22:00.225 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:00.220+0000 7eff08d9d700 1 -- 172.21.15.50:0/1559979360 shutdown_connections 2023-10-06T01:22:00.225 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:00.220+0000 7eff08d9d700 1 --2- 172.21.15.50:0/1559979360 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7efef0066f30 0x7efef00693e0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:00.225 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:00.220+0000 7eff08d9d700 1 --2- 172.21.15.50:0/1559979360 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7eff04159480 0x7eff0416d190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:00.225 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:00.220+0000 7eff08d9d700 1 --2- 172.21.15.50:0/1559979360 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7eff040b2140 0x7eff040c4ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:00.226 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:00.220+0000 7eff08d9d700 1 --2- 172.21.15.50:0/1559979360 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7eff040b3610 0x7eff0416cc50 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:00.226 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:00.220+0000 7eff08d9d700 1 -- 172.21.15.50:0/1559979360 >> 172.21.15.50:0/1559979360 conn(0x7eff0406ed20 msgr2=0x7eff040d0290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:22:00.226 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:00.220+0000 7eff08d9d700 1 -- 172.21.15.50:0/1559979360 shutdown_connections 2023-10-06T01:22:00.226 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:00.220+0000 7eff08d9d700 1 -- 172.21.15.50:0/1559979360 wait complete. 2023-10-06T01:22:00.226 INFO:teuthology.orchestra.run.smithi050.stderr:dumped all 2023-10-06T01:22:00.239 INFO:teuthology.orchestra.run.smithi050.stdout:{"pg_ready":true,"pg_map":{"version":34,"stamp":"2023-10-06T01:21:59.775370+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":594852,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":207,"num_write_kb":2433,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":159,"ondisk_log_size":159,"up":338,"acting":338,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":338,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2397980,"kb_used_data":3292,"kb_used_omap":0,"kb_used_meta":2394624,"kb_avail":752576740,"statfs":{"total":773094113280,"available":770638581760,"internally_reserved":0,"allocated":3371008,"data_stored":2062434,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2452094976},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2178,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003105"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T01:21:40.818033+0000","last_change":"2023-10-06T01:21:36.824186+0000","last_active":"2023-10-06T01:21:40.818033+0000","last_peered":"2023-10-06T01:21:40.818033+0000","last_clean":"2023-10-06T01:21:40.818033+0000","last_became_active":"2023-10-06T01:21:36.823943+0000","last_became_peered":"2023-10-06T01:21:36.823943+0000","last_unstale":"2023-10-06T01:21:40.818033+0000","last_undegraded":"2023-10-06T01:21:40.818033+0000","last_fullsized":"2023-10-06T01:21:40.818033+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:21:36.268170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:21:36.268170+0000","last_clean_scrub_stamp":"2023-10-06T01:21:36.268170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:03:03.146121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T01:21:40.829968+0000","last_change":"2023-10-06T01:21:36.827051+0000","last_active":"2023-10-06T01:21:40.829968+0000","last_peered":"2023-10-06T01:21:40.829968+0000","last_clean":"2023-10-06T01:21:40.829968+0000","last_became_active":"2023-10-06T01:21:36.826789+0000","last_became_peered":"2023-10-06T01:21:36.826789+0000","last_unstale":"2023-10-06T01:21:40.829968+0000","last_undegraded":"2023-10-06T01:21:40.829968+0000","last_fullsized":"2023-10-06T01:21:40.829968+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:21:36.268170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:21:36.268170+0000","last_clean_scrub_stamp":"2023-10-06T01:21:36.268170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:53:49.542750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T01:21:40.825569+0000","last_change":"2023-10-06T01:21:36.841714+0000","last_active":"2023-10-06T01:21:40.825569+0000","last_peered":"2023-10-06T01:21:40.825569+0000","last_clean":"2023-10-06T01:21:40.825569+0000","last_became_active":"2023-10-06T01:21:36.841309+0000","last_became_peered":"2023-10-06T01:21:36.841309+0000","last_unstale":"2023-10-06T01:21:40.825569+0000","last_undegraded":"2023-10-06T01:21:40.825569+0000","last_fullsized":"2023-10-06T01:21:40.825569+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:21:36.268170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:21:36.268170+0000","last_clean_scrub_stamp":"2023-10-06T01:21:36.268170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:21:06.849534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T01:21:40.820783+0000","last_change":"2023-10-06T01:21:36.839886+0000","last_active":"2023-10-06T01:21:40.820783+0000","last_peered":"2023-10-06T01:21:40.820783+0000","last_clean":"2023-10-06T01:21:40.820783+0000","last_became_active":"2023-10-06T01:21:36.839587+0000","last_became_peered":"2023-10-06T01:21:36.839587+0000","last_unstale":"2023-10-06T01:21:40.820783+0000","last_undegraded":"2023-10-06T01:21:40.820783+0000","last_fullsized":"2023-10-06T01:21:40.820783+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:21:36.268170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:21:36.268170+0000","last_clean_scrub_stamp":"2023-10-06T01:21:36.268170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:28:29.254293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T01:21:40.844272+0000","last_change":"2023-10-06T01:21:36.836485+0000","last_active":"2023-10-06T01:21:40.844272+0000","last_peered":"2023-10-06T01:21:40.844272+0000","last_clean":"2023-10-06T01:21:40.844272+0000","last_became_active":"2023-10-06T01:21:36.836212+0000","last_became_peered":"2023-10-06T01:21:36.836212+0000","last_unstale":"2023-10-06T01:21:40.844272+0000","last_undegraded":"2023-10-06T01:21:40.844272+0000","last_fullsized":"2023-10-06T01:21:40.844272+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:21:36.268170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:21:36.268170+0000","last_clean_scrub_stamp":"2023-10-06T01:21:36.268170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:03:40.763134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T01:21:40.824705+0000","last_change":"2023-10-06T01:21:36.842364+0000","last_active":"2023-10-06T01:21:40.824705+0000","last_peered":"2023-10-06T01:21:40.824705+0000","last_clean":"2023-10-06T01:21:40.824705+0000","last_became_active":"2023-10-06T01:21:36.842065+0000","last_became_peered":"2023-10-06T01:21:36.842065+0000","last_unstale":"2023-10-06T01:21:40.824705+0000","last_undegraded":"2023-10-06T01:21:40.824705+0000","last_fullsized":"2023-10-06T01:21:40.824705+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:21:36.268170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:21:36.268170+0000","last_clean_scrub_stamp":"2023-10-06T01:21:36.268170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:28:15.885944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T01:21:40.830001+0000","last_change":"2023-10-06T01:21:36.835095+0000","last_active":"2023-10-06T01:21:40.830001+0000","last_peered":"2023-10-06T01:21:40.830001+0000","last_clean":"2023-10-06T01:21:40.830001+0000","last_became_active":"2023-10-06T01:21:36.834833+0000","last_became_peered":"2023-10-06T01:21:36.834833+0000","last_unstale":"2023-10-06T01:21:40.830001+0000","last_undegraded":"2023-10-06T01:21:40.830001+0000","last_fullsized":"2023-10-06T01:21:40.830001+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:21:36.268170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:21:36.268170+0000","last_clean_scrub_stamp":"2023-10-06T01:21:36.268170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:26:07.073491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T01:21:40.827937+0000","last_change":"2023-10-06T01:21:36.841569+0000","last_active":"2023-10-06T01:21:40.827937+0000","last_peered":"2023-10-06T01:21:40.827937+0000","last_clean":"2023-10-06T01:21:40.827937+0000","last_became_active":"2023-10-06T01:21:36.841279+0000","last_became_peered":"2023-10-06T01:21:36.841279+0000","last_unstale":"2023-10-06T01:21:40.827937+0000","last_undegraded":"2023-10-06T01:21:40.827937+0000","last_fullsized":"2023-10-06T01:21:40.827937+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:21:36.268170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:21:36.268170+0000","last_clean_scrub_stamp":"2023-10-06T01:21:36.268170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:22:57.339224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T01:21:40.843139+0000","last_change":"2023-10-06T01:21:36.840627+0000","last_active":"2023-10-06T01:21:40.843139+0000","last_peered":"2023-10-06T01:21:40.843139+0000","last_clean":"2023-10-06T01:21:40.843139+0000","last_became_active":"2023-10-06T01:21:36.840352+0000","last_became_peered":"2023-10-06T01:21:36.840352+0000","last_unstale":"2023-10-06T01:21:40.843139+0000","last_undegraded":"2023-10-06T01:21:40.843139+0000","last_fullsized":"2023-10-06T01:21:40.843139+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:21:36.268170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:21:36.268170+0000","last_clean_scrub_stamp":"2023-10-06T01:21:36.268170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:53:49.542750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T01:21:40.830823+0000","last_change":"2023-10-06T01:21:36.836461+0000","last_active":"2023-10-06T01:21:40.830823+0000","last_peered":"2023-10-06T01:21:40.830823+0000","last_clean":"2023-10-06T01:21:40.830823+0000","last_became_active":"2023-10-06T01:21:36.836153+0000","last_became_peered":"2023-10-06T01:21:36.836153+0000","last_unstale":"2023-10-06T01:21:40.830823+0000","last_undegraded":"2023-10-06T01:21:40.830823+0000","last_fullsized":"2023-10-06T01:21:40.830823+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:21:36.268170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:21:36.268170+0000","last_clean_scrub_stamp":"2023-10-06T01:21:36.268170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:48:35.151895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T01:21:40.825486+0000","last_change":"2023-10-06T01:21:36.829914+0000","last_active":"2023-10-06T01:21:40.825486+0000","last_peered":"2023-10-06T01:21:40.825486+0000","last_clean":"2023-10-06T01:21:40.825486+0000","last_became_active":"2023-10-06T01:21:36.829628+0000","last_became_peered":"2023-10-06T01:21:36.829628+0000","last_unstale":"2023-10-06T01:21:40.825486+0000","last_undegraded":"2023-10-06T01:21:40.825486+0000","last_fullsized":"2023-10-06T01:21:40.825486+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:21:36.268170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:21:36.268170+0000","last_clean_scrub_stamp":"2023-10-06T01:21:36.268170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:08:14.866921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T01:21:40.817667+0000","last_change":"2023-10-06T01:21:36.835080+0000","last_active":"2023-10-06T01:21:40.817667+0000","last_peered":"2023-10-06T01:21:40.817667+0000","last_clean":"2023-10-06T01:21:40.817667+0000","last_became_active":"2023-10-06T01:21:36.834739+0000","last_became_peered":"2023-10-06T01:21:36.834739+0000","last_unstale":"2023-10-06T01:21:40.817667+0000","last_undegraded":"2023-10-06T01:21:40.817667+0000","last_fullsized":"2023-10-06T01:21:40.817667+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:21:36.268170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:21:36.268170+0000","last_clean_scrub_stamp":"2023-10-06T01:21:36.268170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:48:20.926655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T01:21:40.817292+0000","last_change":"2023-10-06T01:21:36.827097+0000","last_active":"2023-10-06T01:21:40.817292+0000","last_peered":"2023-10-06T01:21:40.817292+0000","last_clean":"2023-10-06T01:21:40.817292+0000","last_became_active":"2023-10-06T01:21:36.826834+0000","last_became_peered":"2023-10-06T01:21:36.826834+0000","last_unstale":"2023-10-06T01:21:40.817292+0000","last_undegraded":"2023-10-06T01:21:40.817292+0000","last_fullsized":"2023-10-06T01:21:40.817292+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:21:36.268170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:21:36.268170+0000","last_clean_scrub_stamp":"2023-10-06T01:21:36.268170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:54:56.312476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T01:21:40.829936+0000","last_change":"2023-10-06T01:21:36.821926+0000","last_active":"2023-10-06T01:21:40.829936+0000","last_peered":"2023-10-06T01:21:40.829936+0000","last_clean":"2023-10-06T01:21:40.829936+0000","last_became_active":"2023-10-06T01:21:36.821634+0000","last_became_peered":"2023-10-06T01:21:36.821634+0000","last_unstale":"2023-10-06T01:21:40.829936+0000","last_undegraded":"2023-10-06T01:21:40.829936+0000","last_fullsized":"2023-10-06T01:21:40.829936+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:21:36.268170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:21:36.268170+0000","last_clean_scrub_stamp":"2023-10-06T01:21:36.268170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:25:14.997580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T01:21:40.829788+0000","last_change":"2023-10-06T01:21:36.835675+0000","last_active":"2023-10-06T01:21:40.829788+0000","last_peered":"2023-10-06T01:21:40.829788+0000","last_clean":"2023-10-06T01:21:40.829788+0000","last_became_active":"2023-10-06T01:21:36.835263+0000","last_became_peered":"2023-10-06T01:21:36.835263+0000","last_unstale":"2023-10-06T01:21:40.829788+0000","last_undegraded":"2023-10-06T01:21:40.829788+0000","last_fullsized":"2023-10-06T01:21:40.829788+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:21:36.268170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:21:36.268170+0000","last_clean_scrub_stamp":"2023-10-06T01:21:36.268170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:48:35.151895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T01:21:40.824974+0000","last_change":"2023-10-06T01:21:36.844306+0000","last_active":"2023-10-06T01:21:40.824974+0000","last_peered":"2023-10-06T01:21:40.824974+0000","last_clean":"2023-10-06T01:21:40.824974+0000","last_became_active":"2023-10-06T01:21:36.843273+0000","last_became_peered":"2023-10-06T01:21:36.843273+0000","last_unstale":"2023-10-06T01:21:40.824974+0000","last_undegraded":"2023-10-06T01:21:40.824974+0000","last_fullsized":"2023-10-06T01:21:40.824974+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:21:36.268170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:21:36.268170+0000","last_clean_scrub_stamp":"2023-10-06T01:21:36.268170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:26:07.073491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T01:21:40.843241+0000","last_change":"2023-10-06T01:21:36.836865+0000","last_active":"2023-10-06T01:21:40.843241+0000","last_peered":"2023-10-06T01:21:40.843241+0000","last_clean":"2023-10-06T01:21:40.843241+0000","last_became_active":"2023-10-06T01:21:36.836583+0000","last_became_peered":"2023-10-06T01:21:36.836583+0000","last_unstale":"2023-10-06T01:21:40.843241+0000","last_undegraded":"2023-10-06T01:21:40.843241+0000","last_fullsized":"2023-10-06T01:21:40.843241+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:21:36.268170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:21:36.268170+0000","last_clean_scrub_stamp":"2023-10-06T01:21:36.268170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:25:14.997580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T01:21:40.827081+0000","last_change":"2023-10-06T01:21:36.833429+0000","last_active":"2023-10-06T01:21:40.827081+0000","last_peered":"2023-10-06T01:21:40.827081+0000","last_clean":"2023-10-06T01:21:40.827081+0000","last_became_active":"2023-10-06T01:21:36.833139+0000","last_became_peered":"2023-10-06T01:21:36.833139+0000","last_unstale":"2023-10-06T01:21:40.827081+0000","last_undegraded":"2023-10-06T01:21:40.827081+0000","last_fullsized":"2023-10-06T01:21:40.827081+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:21:36.268170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:21:36.268170+0000","last_clean_scrub_stamp":"2023-10-06T01:21:36.268170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:51:16.522318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T01:21:40.817681+0000","last_change":"2023-10-06T01:21:36.822258+0000","last_active":"2023-10-06T01:21:40.817681+0000","last_peered":"2023-10-06T01:21:40.817681+0000","last_clean":"2023-10-06T01:21:40.817681+0000","last_became_active":"2023-10-06T01:21:36.822002+0000","last_became_peered":"2023-10-06T01:21:36.822002+0000","last_unstale":"2023-10-06T01:21:40.817681+0000","last_undegraded":"2023-10-06T01:21:40.817681+0000","last_fullsized":"2023-10-06T01:21:40.817681+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:21:36.268170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:21:36.268170+0000","last_clean_scrub_stamp":"2023-10-06T01:21:36.268170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:46:14.981833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T01:21:40.825982+0000","last_change":"2023-10-06T01:21:36.841868+0000","last_active":"2023-10-06T01:21:40.825982+0000","last_peered":"2023-10-06T01:21:40.825982+0000","last_clean":"2023-10-06T01:21:40.825982+0000","last_became_active":"2023-10-06T01:21:36.841579+0000","last_became_peered":"2023-10-06T01:21:36.841579+0000","last_unstale":"2023-10-06T01:21:40.825982+0000","last_undegraded":"2023-10-06T01:21:40.825982+0000","last_fullsized":"2023-10-06T01:21:40.825982+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:21:36.268170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:21:36.268170+0000","last_clean_scrub_stamp":"2023-10-06T01:21:36.268170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:44:16.024192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T01:21:40.830265+0000","last_change":"2023-10-06T01:21:36.836541+0000","last_active":"2023-10-06T01:21:40.830265+0000","last_peered":"2023-10-06T01:21:40.830265+0000","last_clean":"2023-10-06T01:21:40.830265+0000","last_became_active":"2023-10-06T01:21:36.836230+0000","last_became_peered":"2023-10-06T01:21:36.836230+0000","last_unstale":"2023-10-06T01:21:40.830265+0000","last_undegraded":"2023-10-06T01:21:40.830265+0000","last_fullsized":"2023-10-06T01:21:40.830265+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:21:36.268170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:21:36.268170+0000","last_clean_scrub_stamp":"2023-10-06T01:21:36.268170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:22:57.339224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T01:21:40.842277+0000","last_change":"2023-10-06T01:21:36.835952+0000","last_active":"2023-10-06T01:21:40.842277+0000","last_peered":"2023-10-06T01:21:40.842277+0000","last_clean":"2023-10-06T01:21:40.842277+0000","last_became_active":"2023-10-06T01:21:36.835674+0000","last_became_peered":"2023-10-06T01:21:36.835674+0000","last_unstale":"2023-10-06T01:21:40.842277+0000","last_undegraded":"2023-10-06T01:21:40.842277+0000","last_fullsized":"2023-10-06T01:21:40.842277+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:21:36.268170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:21:36.268170+0000","last_clean_scrub_stamp":"2023-10-06T01:21:36.268170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:51:16.522318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T01:21:40.823914+0000","last_change":"2023-10-06T01:21:36.837170+0000","last_active":"2023-10-06T01:21:40.823914+0000","last_peered":"2023-10-06T01:21:40.823914+0000","last_clean":"2023-10-06T01:21:40.823914+0000","last_became_active":"2023-10-06T01:21:36.836919+0000","last_became_peered":"2023-10-06T01:21:36.836919+0000","last_unstale":"2023-10-06T01:21:40.823914+0000","last_undegraded":"2023-10-06T01:21:40.823914+0000","last_fullsized":"2023-10-06T01:21:40.823914+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:21:36.268170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:21:36.268170+0000","last_clean_scrub_stamp":"2023-10-06T01:21:36.268170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:32:46.966379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T01:21:40.832089+0000","last_change":"2023-10-06T01:21:36.836732+0000","last_active":"2023-10-06T01:21:40.832089+0000","last_peered":"2023-10-06T01:21:40.832089+0000","last_clean":"2023-10-06T01:21:40.832089+0000","last_became_active":"2023-10-06T01:21:36.835547+0000","last_became_peered":"2023-10-06T01:21:36.835547+0000","last_unstale":"2023-10-06T01:21:40.832089+0000","last_undegraded":"2023-10-06T01:21:40.832089+0000","last_fullsized":"2023-10-06T01:21:40.832089+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:21:36.268170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:21:36.268170+0000","last_clean_scrub_stamp":"2023-10-06T01:21:36.268170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:53:49.542750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T01:21:40.824805+0000","last_change":"2023-10-06T01:21:36.825216+0000","last_active":"2023-10-06T01:21:40.824805+0000","last_peered":"2023-10-06T01:21:40.824805+0000","last_clean":"2023-10-06T01:21:40.824805+0000","last_became_active":"2023-10-06T01:21:36.824966+0000","last_became_peered":"2023-10-06T01:21:36.824966+0000","last_unstale":"2023-10-06T01:21:40.824805+0000","last_undegraded":"2023-10-06T01:21:40.824805+0000","last_fullsized":"2023-10-06T01:21:40.824805+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:21:36.268170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:21:36.268170+0000","last_clean_scrub_stamp":"2023-10-06T01:21:36.268170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:47:05.161793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T01:21:40.825009+0000","last_change":"2023-10-06T01:21:36.814942+0000","last_active":"2023-10-06T01:21:40.825009+0000","last_peered":"2023-10-06T01:21:40.825009+0000","last_clean":"2023-10-06T01:21:40.825009+0000","last_became_active":"2023-10-06T01:21:36.814669+0000","last_became_peered":"2023-10-06T01:21:36.814669+0000","last_unstale":"2023-10-06T01:21:40.825009+0000","last_undegraded":"2023-10-06T01:21:40.825009+0000","last_fullsized":"2023-10-06T01:21:40.825009+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:21:36.268170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:21:36.268170+0000","last_clean_scrub_stamp":"2023-10-06T01:21:36.268170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:25:14.997580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T01:21:40.830312+0000","last_change":"2023-10-06T01:21:36.830638+0000","last_active":"2023-10-06T01:21:40.830312+0000","last_peered":"2023-10-06T01:21:40.830312+0000","last_clean":"2023-10-06T01:21:40.830312+0000","last_became_active":"2023-10-06T01:21:36.830451+0000","last_became_peered":"2023-10-06T01:21:36.830451+0000","last_unstale":"2023-10-06T01:21:40.830312+0000","last_undegraded":"2023-10-06T01:21:40.830312+0000","last_fullsized":"2023-10-06T01:21:40.830312+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:21:36.268170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:21:36.268170+0000","last_clean_scrub_stamp":"2023-10-06T01:21:36.268170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:26:27.490800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T01:21:40.845528+0000","last_change":"2023-10-06T01:21:40.841583+0000","last_active":"2023-10-06T01:21:40.845528+0000","last_peered":"2023-10-06T01:21:40.845528+0000","last_clean":"2023-10-06T01:21:40.845528+0000","last_became_active":"2023-10-06T01:21:40.841186+0000","last_became_peered":"2023-10-06T01:21:40.841186+0000","last_unstale":"2023-10-06T01:21:40.845528+0000","last_undegraded":"2023-10-06T01:21:40.845528+0000","last_fullsized":"2023-10-06T01:21:40.845528+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:21:39.809888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:21:39.809888+0000","last_clean_scrub_stamp":"2023-10-06T01:21:39.809888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:32:16.087643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,2,0],"acting":[4,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1a","version":"20'1","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T01:21:40.824542+0000","last_change":"2023-10-06T01:21:36.304872+0000","last_active":"2023-10-06T01:21:40.824542+0000","last_peered":"2023-10-06T01:21:40.824542+0000","last_clean":"2023-10-06T01:21:40.824542+0000","last_became_active":"2023-10-06T01:21:36.304341+0000","last_became_peered":"2023-10-06T01:21:36.304341+0000","last_unstale":"2023-10-06T01:21:40.824542+0000","last_undegraded":"2023-10-06T01:21:40.824542+0000","last_fullsized":"2023-10-06T01:21:40.824542+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:21:35.260777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:21:35.260777+0000","last_clean_scrub_stamp":"2023-10-06T01:21:35.260777+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:30:20.955423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T01:21:40.824330+0000","last_change":"2023-10-06T01:21:36.829886+0000","last_active":"2023-10-06T01:21:40.824330+0000","last_peered":"2023-10-06T01:21:40.824330+0000","last_clean":"2023-10-06T01:21:40.824330+0000","last_became_active":"2023-10-06T01:21:36.829585+0000","last_became_peered":"2023-10-06T01:21:36.829585+0000","last_unstale":"2023-10-06T01:21:40.824330+0000","last_undegraded":"2023-10-06T01:21:40.824330+0000","last_fullsized":"2023-10-06T01:21:40.824330+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:21:36.268170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:21:36.268170+0000","last_clean_scrub_stamp":"2023-10-06T01:21:36.268170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:51:16.522318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T01:21:40.844382+0000","last_change":"2023-10-06T01:21:40.837198+0000","last_active":"2023-10-06T01:21:40.844382+0000","last_peered":"2023-10-06T01:21:40.844382+0000","last_clean":"2023-10-06T01:21:40.844382+0000","last_became_active":"2023-10-06T01:21:40.836811+0000","last_became_peered":"2023-10-06T01:21:40.836811+0000","last_unstale":"2023-10-06T01:21:40.844382+0000","last_undegraded":"2023-10-06T01:21:40.844382+0000","last_fullsized":"2023-10-06T01:21:40.844382+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:21:39.809888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:21:39.809888+0000","last_clean_scrub_stamp":"2023-10-06T01:21:39.809888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:48:17.365413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,3,7],"acting":[6,4,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T01:21:40.826208+0000","last_change":"2023-10-06T01:21:36.306212+0000","last_active":"2023-10-06T01:21:40.826208+0000","last_peered":"2023-10-06T01:21:40.826208+0000","last_clean":"2023-10-06T01:21:40.826208+0000","last_became_active":"2023-10-06T01:21:36.305708+0000","last_became_peered":"2023-10-06T01:21:36.305708+0000","last_unstale":"2023-10-06T01:21:40.826208+0000","last_undegraded":"2023-10-06T01:21:40.826208+0000","last_fullsized":"2023-10-06T01:21:40.826208+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:21:35.260777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:21:35.260777+0000","last_clean_scrub_stamp":"2023-10-06T01:21:35.260777+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:30:20.955423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T01:21:40.842466+0000","last_change":"2023-10-06T01:21:36.835259+0000","last_active":"2023-10-06T01:21:40.842466+0000","last_peered":"2023-10-06T01:21:40.842466+0000","last_clean":"2023-10-06T01:21:40.842466+0000","last_became_active":"2023-10-06T01:21:36.834601+0000","last_became_peered":"2023-10-06T01:21:36.834601+0000","last_unstale":"2023-10-06T01:21:40.842466+0000","last_undegraded":"2023-10-06T01:21:40.842466+0000","last_fullsized":"2023-10-06T01:21:40.842466+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:21:36.268170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:21:36.268170+0000","last_clean_scrub_stamp":"2023-10-06T01:21:36.268170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:26:27.490800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T01:21:40.861034+0000","last_change":"2023-10-06T01:21:40.859811+0000","last_active":"2023-10-06T01:21:40.861034+0000","last_peered":"2023-10-06T01:21:40.861034+0000","last_clean":"2023-10-06T01:21:40.861034+0000","last_became_active":"2023-10-06T01:21:40.859403+0000","last_became_peered":"2023-10-06T01:21:40.859403+0000","last_unstale":"2023-10-06T01:21:40.861034+0000","last_undegraded":"2023-10-06T01:21:40.861034+0000","last_fullsized":"2023-10-06T01:21:40.861034+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:21:39.809888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:21:39.809888+0000","last_clean_scrub_stamp":"2023-10-06T01:21:39.809888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:57:11.609623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,1,2],"acting":[0,7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T01:21:40.825496+0000","last_change":"2023-10-06T01:21:36.293850+0000","last_active":"2023-10-06T01:21:40.825496+0000","last_peered":"2023-10-06T01:21:40.825496+0000","last_clean":"2023-10-06T01:21:40.825496+0000","last_became_active":"2023-10-06T01:21:36.293488+0000","last_became_peered":"2023-10-06T01:21:36.293488+0000","last_unstale":"2023-10-06T01:21:40.825496+0000","last_undegraded":"2023-10-06T01:21:40.825496+0000","last_fullsized":"2023-10-06T01:21:40.825496+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:21:35.260777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:21:35.260777+0000","last_clean_scrub_stamp":"2023-10-06T01:21:35.260777+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:03:02.138728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T01:21:40.821094+0000","last_change":"2023-10-06T01:21:36.828340+0000","last_active":"2023-10-06T01:21:40.821094+0000","last_peered":"2023-10-06T01:21:40.821094+0000","last_clean":"2023-10-06T01:21:40.821094+0000","last_became_active":"2023-10-06T01:21:36.827891+0000","last_became_peered":"2023-10-06T01:21:36.827891+0000","last_unstale":"2023-10-06T01:21:40.821094+0000","last_undegraded":"2023-10-06T01:21:40.821094+0000","last_fullsized":"2023-10-06T01:21:40.821094+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:21:36.268170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:21:36.268170+0000","last_clean_scrub_stamp":"2023-10-06T01:21:36.268170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:12:59.424963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T01:21:40.844982+0000","last_change":"2023-10-06T01:21:40.837490+0000","last_active":"2023-10-06T01:21:40.844982+0000","last_peered":"2023-10-06T01:21:40.844982+0000","last_clean":"2023-10-06T01:21:40.844982+0000","last_became_active":"2023-10-06T01:21:40.836992+0000","last_became_peered":"2023-10-06T01:21:40.836992+0000","last_unstale":"2023-10-06T01:21:40.844982+0000","last_undegraded":"2023-10-06T01:21:40.844982+0000","last_fullsized":"2023-10-06T01:21:40.844982+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:21:39.809888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:21:39.809888+0000","last_clean_scrub_stamp":"2023-10-06T01:21:39.809888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:08:18.408639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7,1],"acting":[6,4,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T01:21:40.843338+0000","last_change":"2023-10-06T01:21:36.299763+0000","last_active":"2023-10-06T01:21:40.843338+0000","last_peered":"2023-10-06T01:21:40.843338+0000","last_clean":"2023-10-06T01:21:40.843338+0000","last_became_active":"2023-10-06T01:21:36.299294+0000","last_became_peered":"2023-10-06T01:21:36.299294+0000","last_unstale":"2023-10-06T01:21:40.843338+0000","last_undegraded":"2023-10-06T01:21:40.843338+0000","last_fullsized":"2023-10-06T01:21:40.843338+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:21:35.260777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:21:35.260777+0000","last_clean_scrub_stamp":"2023-10-06T01:21:35.260777+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:48:42.234958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T01:21:40.825416+0000","last_change":"2023-10-06T01:21:36.827009+0000","last_active":"2023-10-06T01:21:40.825416+0000","last_peered":"2023-10-06T01:21:40.825416+0000","last_clean":"2023-10-06T01:21:40.825416+0000","last_became_active":"2023-10-06T01:21:36.826543+0000","last_became_peered":"2023-10-06T01:21:36.826543+0000","last_unstale":"2023-10-06T01:21:40.825416+0000","last_undegraded":"2023-10-06T01:21:40.825416+0000","last_fullsized":"2023-10-06T01:21:40.825416+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:21:36.268170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:21:36.268170+0000","last_clean_scrub_stamp":"2023-10-06T01:21:36.268170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:21:06.849534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T01:21:40.852806+0000","last_change":"2023-10-06T01:21:40.847656+0000","last_active":"2023-10-06T01:21:40.852806+0000","last_peered":"2023-10-06T01:21:40.852806+0000","last_clean":"2023-10-06T01:21:40.852806+0000","last_became_active":"2023-10-06T01:21:40.847177+0000","last_became_peered":"2023-10-06T01:21:40.847177+0000","last_unstale":"2023-10-06T01:21:40.852806+0000","last_undegraded":"2023-10-06T01:21:40.852806+0000","last_fullsized":"2023-10-06T01:21:40.852806+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:21:39.809888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:21:39.809888+0000","last_clean_scrub_stamp":"2023-10-06T01:21:39.809888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:57:11.609623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6,0],"acting":[7,4,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T01:21:40.830754+0000","last_change":"2023-10-06T01:21:36.296695+0000","last_active":"2023-10-06T01:21:40.830754+0000","last_peered":"2023-10-06T01:21:40.830754+0000","last_clean":"2023-10-06T01:21:40.830754+0000","last_became_active":"2023-10-06T01:21:36.296338+0000","last_became_peered":"2023-10-06T01:21:36.296338+0000","last_unstale":"2023-10-06T01:21:40.830754+0000","last_undegraded":"2023-10-06T01:21:40.830754+0000","last_fullsized":"2023-10-06T01:21:40.830754+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:21:35.260777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:21:35.260777+0000","last_clean_scrub_stamp":"2023-10-06T01:21:35.260777+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:13:12.787972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T01:21:40.823710+0000","last_change":"2023-10-06T01:21:36.830617+0000","last_active":"2023-10-06T01:21:40.823710+0000","last_peered":"2023-10-06T01:21:40.823710+0000","last_clean":"2023-10-06T01:21:40.823710+0000","last_became_active":"2023-10-06T01:21:36.830336+0000","last_became_peered":"2023-10-06T01:21:36.830336+0000","last_unstale":"2023-10-06T01:21:40.823710+0000","last_undegraded":"2023-10-06T01:21:40.823710+0000","last_fullsized":"2023-10-06T01:21:40.823710+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:21:36.268170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:21:36.268170+0000","last_clean_scrub_stamp":"2023-10-06T01:21:36.268170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:48:35.151895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T01:21:40.860402+0000","last_change":"2023-10-06T01:21:40.848992+0000","last_active":"2023-10-06T01:21:40.860402+0000","last_peered":"2023-10-06T01:21:40.860402+0000","last_clean":"2023-10-06T01:21:40.860402+0000","last_became_active":"2023-10-06T01:21:40.848631+0000","last_became_peered":"2023-10-06T01:21:40.848631+0000","last_unstale":"2023-10-06T01:21:40.860402+0000","last_undegraded":"2023-10-06T01:21:40.860402+0000","last_fullsized":"2023-10-06T01:21:40.860402+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:21:39.809888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:21:39.809888+0000","last_clean_scrub_stamp":"2023-10-06T01:21:39.809888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:11:30.651756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,5],"acting":[3,0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"20'3","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T01:21:40.831260+0000","last_change":"2023-10-06T01:21:36.302987+0000","last_active":"2023-10-06T01:21:40.831260+0000","last_peered":"2023-10-06T01:21:40.831260+0000","last_clean":"2023-10-06T01:21:40.831260+0000","last_became_active":"2023-10-06T01:21:36.302712+0000","last_became_peered":"2023-10-06T01:21:36.302712+0000","last_unstale":"2023-10-06T01:21:40.831260+0000","last_undegraded":"2023-10-06T01:21:40.831260+0000","last_fullsized":"2023-10-06T01:21:40.831260+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:21:35.260777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:21:35.260777+0000","last_clean_scrub_stamp":"2023-10-06T01:21:35.260777+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:47:04.154399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T01:21:40.825424+0000","last_change":"2023-10-06T01:21:36.829217+0000","last_active":"2023-10-06T01:21:40.825424+0000","last_peered":"2023-10-06T01:21:40.825424+0000","last_clean":"2023-10-06T01:21:40.825424+0000","last_became_active":"2023-10-06T01:21:36.828005+0000","last_became_peered":"2023-10-06T01:21:36.828005+0000","last_unstale":"2023-10-06T01:21:40.825424+0000","last_undegraded":"2023-10-06T01:21:40.825424+0000","last_fullsized":"2023-10-06T01:21:40.825424+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:21:36.268170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:21:36.268170+0000","last_clean_scrub_stamp":"2023-10-06T01:21:36.268170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:12:59.424963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T01:21:40.844125+0000","last_change":"2023-10-06T01:21:40.838989+0000","last_active":"2023-10-06T01:21:40.844125+0000","last_peered":"2023-10-06T01:21:40.844125+0000","last_clean":"2023-10-06T01:21:40.844125+0000","last_became_active":"2023-10-06T01:21:40.837659+0000","last_became_peered":"2023-10-06T01:21:40.837659+0000","last_unstale":"2023-10-06T01:21:40.844125+0000","last_undegraded":"2023-10-06T01:21:40.844125+0000","last_fullsized":"2023-10-06T01:21:40.844125+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:21:39.809888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:21:39.809888+0000","last_clean_scrub_stamp":"2023-10-06T01:21:39.809888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:39:50.108444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,3,7],"acting":[1,5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"25'9","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-06T01:21:49.958650+0000","last_change":"2023-10-06T01:21:36.301140+0000","last_active":"2023-10-06T01:21:49.958650+0000","last_peered":"2023-10-06T01:21:49.958650+0000","last_clean":"2023-10-06T01:21:49.958650+0000","last_became_active":"2023-10-06T01:21:36.296099+0000","last_became_peered":"2023-10-06T01:21:36.296099+0000","last_unstale":"2023-10-06T01:21:49.958650+0000","last_undegraded":"2023-10-06T01:21:49.958650+0000","last_fullsized":"2023-10-06T01:21:49.958650+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:21:35.260777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:21:35.260777+0000","last_clean_scrub_stamp":"2023-10-06T01:21:35.260777+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:03:02.138728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3714,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T01:21:40.826661+0000","last_change":"2023-10-06T01:21:36.842618+0000","last_active":"2023-10-06T01:21:40.826661+0000","last_peered":"2023-10-06T01:21:40.826661+0000","last_clean":"2023-10-06T01:21:40.826661+0000","last_became_active":"2023-10-06T01:21:36.842343+0000","last_became_peered":"2023-10-06T01:21:36.842343+0000","last_unstale":"2023-10-06T01:21:40.826661+0000","last_undegraded":"2023-10-06T01:21:40.826661+0000","last_fullsized":"2023-10-06T01:21:40.826661+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:21:36.268170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:21:36.268170+0000","last_clean_scrub_stamp":"2023-10-06T01:21:36.268170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:21:33.868021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T01:21:40.851721+0000","last_change":"2023-10-06T01:21:40.849230+0000","last_active":"2023-10-06T01:21:40.851721+0000","last_peered":"2023-10-06T01:21:40.851721+0000","last_clean":"2023-10-06T01:21:40.851721+0000","last_became_active":"2023-10-06T01:21:40.848850+0000","last_became_peered":"2023-10-06T01:21:40.848850+0000","last_unstale":"2023-10-06T01:21:40.851721+0000","last_undegraded":"2023-10-06T01:21:40.851721+0000","last_fullsized":"2023-10-06T01:21:40.851721+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:21:39.809888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:21:39.809888+0000","last_clean_scrub_stamp":"2023-10-06T01:21:39.809888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:31:58.220361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,3,0],"acting":[5,1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"20'2","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T01:21:40.830178+0000","last_change":"2023-10-06T01:21:36.307193+0000","last_active":"2023-10-06T01:21:40.830178+0000","last_peered":"2023-10-06T01:21:40.830178+0000","last_clean":"2023-10-06T01:21:40.830178+0000","last_became_active":"2023-10-06T01:21:36.306908+0000","last_became_peered":"2023-10-06T01:21:36.306908+0000","last_unstale":"2023-10-06T01:21:40.830178+0000","last_undegraded":"2023-10-06T01:21:40.830178+0000","last_fullsized":"2023-10-06T01:21:40.830178+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:21:35.260777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:21:35.260777+0000","last_clean_scrub_stamp":"2023-10-06T01:21:35.260777+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:38:59.100770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T01:21:40.823389+0000","last_change":"2023-10-06T01:21:36.826306+0000","last_active":"2023-10-06T01:21:40.823389+0000","last_peered":"2023-10-06T01:21:40.823389+0000","last_clean":"2023-10-06T01:21:40.823389+0000","last_became_active":"2023-10-06T01:21:36.826052+0000","last_became_peered":"2023-10-06T01:21:36.826052+0000","last_unstale":"2023-10-06T01:21:40.823389+0000","last_undegraded":"2023-10-06T01:21:40.823389+0000","last_fullsized":"2023-10-06T01:21:40.823389+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:21:36.268170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:21:36.268170+0000","last_clean_scrub_stamp":"2023-10-06T01:21:36.268170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:30:56.051770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T01:21:40.848294+0000","last_change":"2023-10-06T01:21:40.843226+0000","last_active":"2023-10-06T01:21:40.848294+0000","last_peered":"2023-10-06T01:21:40.848294+0000","last_clean":"2023-10-06T01:21:40.848294+0000","last_became_active":"2023-10-06T01:21:40.841607+0000","last_became_peered":"2023-10-06T01:21:40.841607+0000","last_unstale":"2023-10-06T01:21:40.848294+0000","last_undegraded":"2023-10-06T01:21:40.848294+0000","last_fullsized":"2023-10-06T01:21:40.848294+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:21:39.809888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:21:39.809888+0000","last_clean_scrub_stamp":"2023-10-06T01:21:39.809888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:54:53.178521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,2,1],"acting":[3,7,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T01:21:40.842017+0000","last_change":"2023-10-06T01:21:36.301285+0000","last_active":"2023-10-06T01:21:40.842017+0000","last_peered":"2023-10-06T01:21:40.842017+0000","last_clean":"2023-10-06T01:21:40.842017+0000","last_became_active":"2023-10-06T01:21:36.300676+0000","last_became_peered":"2023-10-06T01:21:36.300676+0000","last_unstale":"2023-10-06T01:21:40.842017+0000","last_undegraded":"2023-10-06T01:21:40.842017+0000","last_fullsized":"2023-10-06T01:21:40.842017+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:21:35.260777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:21:35.260777+0000","last_clean_scrub_stamp":"2023-10-06T01:21:35.260777+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:13:12.787972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T01:21:40.830219+0000","last_change":"2023-10-06T01:21:36.826226+0000","last_active":"2023-10-06T01:21:40.830219+0000","last_peered":"2023-10-06T01:21:40.830219+0000","last_clean":"2023-10-06T01:21:40.830219+0000","last_became_active":"2023-10-06T01:21:36.825921+0000","last_became_peered":"2023-10-06T01:21:36.825921+0000","last_unstale":"2023-10-06T01:21:40.830219+0000","last_undegraded":"2023-10-06T01:21:40.830219+0000","last_fullsized":"2023-10-06T01:21:40.830219+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:21:36.268170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:21:36.268170+0000","last_clean_scrub_stamp":"2023-10-06T01:21:36.268170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:01:50.180814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T01:21:40.859960+0000","last_change":"2023-10-06T01:21:40.845788+0000","last_active":"2023-10-06T01:21:40.859960+0000","last_peered":"2023-10-06T01:21:40.859960+0000","last_clean":"2023-10-06T01:21:40.859960+0000","last_became_active":"2023-10-06T01:21:40.845410+0000","last_became_peered":"2023-10-06T01:21:40.845410+0000","last_unstale":"2023-10-06T01:21:40.859960+0000","last_undegraded":"2023-10-06T01:21:40.859960+0000","last_fullsized":"2023-10-06T01:21:40.859960+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:21:39.809888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:21:39.809888+0000","last_clean_scrub_stamp":"2023-10-06T01:21:39.809888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:35:36.949771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,0],"acting":[3,1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T01:21:40.829873+0000","last_change":"2023-10-06T01:21:36.307137+0000","last_active":"2023-10-06T01:21:40.829873+0000","last_peered":"2023-10-06T01:21:40.829873+0000","last_clean":"2023-10-06T01:21:40.829873+0000","last_became_active":"2023-10-06T01:21:36.306781+0000","last_became_peered":"2023-10-06T01:21:36.306781+0000","last_unstale":"2023-10-06T01:21:40.829873+0000","last_undegraded":"2023-10-06T01:21:40.829873+0000","last_fullsized":"2023-10-06T01:21:40.829873+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:21:35.260777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:21:35.260777+0000","last_clean_scrub_stamp":"2023-10-06T01:21:35.260777+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:13:12.787972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T01:21:40.842737+0000","last_change":"2023-10-06T01:21:36.838019+0000","last_active":"2023-10-06T01:21:40.842737+0000","last_peered":"2023-10-06T01:21:40.842737+0000","last_clean":"2023-10-06T01:21:40.842737+0000","last_became_active":"2023-10-06T01:21:36.837484+0000","last_became_peered":"2023-10-06T01:21:36.837484+0000","last_unstale":"2023-10-06T01:21:40.842737+0000","last_undegraded":"2023-10-06T01:21:40.842737+0000","last_fullsized":"2023-10-06T01:21:40.842737+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:21:36.268170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:21:36.268170+0000","last_clean_scrub_stamp":"2023-10-06T01:21:36.268170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:26:07.073491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T01:21:40.849782+0000","last_change":"2023-10-06T01:21:40.846902+0000","last_active":"2023-10-06T01:21:40.849782+0000","last_peered":"2023-10-06T01:21:40.849782+0000","last_clean":"2023-10-06T01:21:40.849782+0000","last_became_active":"2023-10-06T01:21:40.846515+0000","last_became_peered":"2023-10-06T01:21:40.846515+0000","last_unstale":"2023-10-06T01:21:40.849782+0000","last_undegraded":"2023-10-06T01:21:40.849782+0000","last_fullsized":"2023-10-06T01:21:40.849782+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:21:39.809888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:21:39.809888+0000","last_clean_scrub_stamp":"2023-10-06T01:21:39.809888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:17:23.971056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,1,6],"acting":[5,3,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"20'8","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T01:21:40.820366+0000","last_change":"2023-10-06T01:21:36.314508+0000","last_active":"2023-10-06T01:21:40.820366+0000","last_peered":"2023-10-06T01:21:40.820366+0000","last_clean":"2023-10-06T01:21:40.820366+0000","last_became_active":"2023-10-06T01:21:36.314195+0000","last_became_peered":"2023-10-06T01:21:36.314195+0000","last_unstale":"2023-10-06T01:21:40.820366+0000","last_undegraded":"2023-10-06T01:21:40.820366+0000","last_fullsized":"2023-10-06T01:21:40.820366+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:21:35.260777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:21:35.260777+0000","last_clean_scrub_stamp":"2023-10-06T01:21:35.260777+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:54:55.305083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T01:21:40.824505+0000","last_change":"2023-10-06T01:21:36.831875+0000","last_active":"2023-10-06T01:21:40.824505+0000","last_peered":"2023-10-06T01:21:40.824505+0000","last_clean":"2023-10-06T01:21:40.824505+0000","last_became_active":"2023-10-06T01:21:36.831328+0000","last_became_peered":"2023-10-06T01:21:36.831328+0000","last_unstale":"2023-10-06T01:21:40.824505+0000","last_undegraded":"2023-10-06T01:21:40.824505+0000","last_fullsized":"2023-10-06T01:21:40.824505+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:21:36.268170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:21:36.268170+0000","last_clean_scrub_stamp":"2023-10-06T01:21:36.268170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:03:40.763134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T01:21:40.851310+0000","last_change":"2023-10-06T01:21:40.846661+0000","last_active":"2023-10-06T01:21:40.851310+0000","last_peered":"2023-10-06T01:21:40.851310+0000","last_clean":"2023-10-06T01:21:40.851310+0000","last_became_active":"2023-10-06T01:21:40.845846+0000","last_became_peered":"2023-10-06T01:21:40.845846+0000","last_unstale":"2023-10-06T01:21:40.851310+0000","last_undegraded":"2023-10-06T01:21:40.851310+0000","last_fullsized":"2023-10-06T01:21:40.851310+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:21:39.809888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:21:39.809888+0000","last_clean_scrub_stamp":"2023-10-06T01:21:39.809888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:26:15.414115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,3,4],"acting":[7,6,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.f","version":"20'1","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T01:21:40.831539+0000","last_change":"2023-10-06T01:21:36.307931+0000","last_active":"2023-10-06T01:21:40.831539+0000","last_peered":"2023-10-06T01:21:40.831539+0000","last_clean":"2023-10-06T01:21:40.831539+0000","last_became_active":"2023-10-06T01:21:36.307539+0000","last_became_peered":"2023-10-06T01:21:36.307539+0000","last_unstale":"2023-10-06T01:21:40.831539+0000","last_undegraded":"2023-10-06T01:21:40.831539+0000","last_fullsized":"2023-10-06T01:21:40.831539+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:21:35.260777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:21:35.260777+0000","last_clean_scrub_stamp":"2023-10-06T01:21:35.260777+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:28:28.246900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T01:21:40.827851+0000","last_change":"2023-10-06T01:21:36.824841+0000","last_active":"2023-10-06T01:21:40.827851+0000","last_peered":"2023-10-06T01:21:40.827851+0000","last_clean":"2023-10-06T01:21:40.827851+0000","last_became_active":"2023-10-06T01:21:36.824575+0000","last_became_peered":"2023-10-06T01:21:36.824575+0000","last_unstale":"2023-10-06T01:21:40.827851+0000","last_undegraded":"2023-10-06T01:21:40.827851+0000","last_fullsized":"2023-10-06T01:21:40.827851+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:21:36.268170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:21:36.268170+0000","last_clean_scrub_stamp":"2023-10-06T01:21:36.268170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:27:54.680295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T01:21:40.850673+0000","last_change":"2023-10-06T01:21:40.844715+0000","last_active":"2023-10-06T01:21:40.850673+0000","last_peered":"2023-10-06T01:21:40.850673+0000","last_clean":"2023-10-06T01:21:40.850673+0000","last_became_active":"2023-10-06T01:21:40.843713+0000","last_became_peered":"2023-10-06T01:21:40.843713+0000","last_unstale":"2023-10-06T01:21:40.850673+0000","last_undegraded":"2023-10-06T01:21:40.850673+0000","last_fullsized":"2023-10-06T01:21:40.850673+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:21:39.809888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:21:39.809888+0000","last_clean_scrub_stamp":"2023-10-06T01:21:39.809888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:59:32.714013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,5],"acting":[2,0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"20'2","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T01:21:40.831428+0000","last_change":"2023-10-06T01:21:36.307165+0000","last_active":"2023-10-06T01:21:40.831428+0000","last_peered":"2023-10-06T01:21:40.831428+0000","last_clean":"2023-10-06T01:21:40.831428+0000","last_became_active":"2023-10-06T01:21:36.306877+0000","last_became_peered":"2023-10-06T01:21:36.306877+0000","last_unstale":"2023-10-06T01:21:40.831428+0000","last_undegraded":"2023-10-06T01:21:40.831428+0000","last_fullsized":"2023-10-06T01:21:40.831428+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:21:35.260777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:21:35.260777+0000","last_clean_scrub_stamp":"2023-10-06T01:21:35.260777+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:38:56.761956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T01:21:40.827687+0000","last_change":"2023-10-06T01:21:36.840414+0000","last_active":"2023-10-06T01:21:40.827687+0000","last_peered":"2023-10-06T01:21:40.827687+0000","last_clean":"2023-10-06T01:21:40.827687+0000","last_became_active":"2023-10-06T01:21:36.840067+0000","last_became_peered":"2023-10-06T01:21:36.840067+0000","last_unstale":"2023-10-06T01:21:40.827687+0000","last_undegraded":"2023-10-06T01:21:40.827687+0000","last_fullsized":"2023-10-06T01:21:40.827687+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:21:36.268170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:21:36.268170+0000","last_clean_scrub_stamp":"2023-10-06T01:21:36.268170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:48:18.526486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T01:21:40.849984+0000","last_change":"2023-10-06T01:21:40.841506+0000","last_active":"2023-10-06T01:21:40.849984+0000","last_peered":"2023-10-06T01:21:40.849984+0000","last_clean":"2023-10-06T01:21:40.849984+0000","last_became_active":"2023-10-06T01:21:40.840966+0000","last_became_peered":"2023-10-06T01:21:40.840966+0000","last_unstale":"2023-10-06T01:21:40.849984+0000","last_undegraded":"2023-10-06T01:21:40.849984+0000","last_fullsized":"2023-10-06T01:21:40.849984+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:21:39.809888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:21:39.809888+0000","last_clean_scrub_stamp":"2023-10-06T01:21:39.809888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:48:17.365413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5,6],"acting":[2,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"20'1","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T01:21:40.831177+0000","last_change":"2023-10-06T01:21:36.296492+0000","last_active":"2023-10-06T01:21:40.831177+0000","last_peered":"2023-10-06T01:21:40.831177+0000","last_clean":"2023-10-06T01:21:40.831177+0000","last_became_active":"2023-10-06T01:21:36.296064+0000","last_became_peered":"2023-10-06T01:21:36.296064+0000","last_unstale":"2023-10-06T01:21:40.831177+0000","last_undegraded":"2023-10-06T01:21:40.831177+0000","last_fullsized":"2023-10-06T01:21:40.831177+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:21:35.260777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:21:35.260777+0000","last_clean_scrub_stamp":"2023-10-06T01:21:35.260777+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:53:26.082920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T01:21:40.820682+0000","last_change":"2023-10-06T01:21:36.833212+0000","last_active":"2023-10-06T01:21:40.820682+0000","last_peered":"2023-10-06T01:21:40.820682+0000","last_clean":"2023-10-06T01:21:40.820682+0000","last_became_active":"2023-10-06T01:21:36.832753+0000","last_became_peered":"2023-10-06T01:21:36.832753+0000","last_unstale":"2023-10-06T01:21:40.820682+0000","last_undegraded":"2023-10-06T01:21:40.820682+0000","last_fullsized":"2023-10-06T01:21:40.820682+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:21:36.268170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:21:36.268170+0000","last_clean_scrub_stamp":"2023-10-06T01:21:36.268170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:47:05.161793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T01:21:40.839046+0000","last_change":"2023-10-06T01:21:40.837287+0000","last_active":"2023-10-06T01:21:40.839046+0000","last_peered":"2023-10-06T01:21:40.839046+0000","last_clean":"2023-10-06T01:21:40.839046+0000","last_became_active":"2023-10-06T01:21:40.836599+0000","last_became_peered":"2023-10-06T01:21:40.836599+0000","last_unstale":"2023-10-06T01:21:40.839046+0000","last_undegraded":"2023-10-06T01:21:40.839046+0000","last_fullsized":"2023-10-06T01:21:40.839046+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:21:39.809888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:21:39.809888+0000","last_clean_scrub_stamp":"2023-10-06T01:21:39.809888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:51:20.064036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3,6],"acting":[2,4,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T01:21:40.829807+0000","last_change":"2023-10-06T01:21:36.304239+0000","last_active":"2023-10-06T01:21:40.829807+0000","last_peered":"2023-10-06T01:21:40.829807+0000","last_clean":"2023-10-06T01:21:40.829807+0000","last_became_active":"2023-10-06T01:21:36.303858+0000","last_became_peered":"2023-10-06T01:21:36.303858+0000","last_unstale":"2023-10-06T01:21:40.829807+0000","last_undegraded":"2023-10-06T01:21:40.829807+0000","last_fullsized":"2023-10-06T01:21:40.829807+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:21:35.260777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:21:35.260777+0000","last_clean_scrub_stamp":"2023-10-06T01:21:35.260777+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:54:55.305083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T01:21:40.844788+0000","last_change":"2023-10-06T01:21:36.835234+0000","last_active":"2023-10-06T01:21:40.844788+0000","last_peered":"2023-10-06T01:21:40.844788+0000","last_clean":"2023-10-06T01:21:40.844788+0000","last_became_active":"2023-10-06T01:21:36.834751+0000","last_became_peered":"2023-10-06T01:21:36.834751+0000","last_unstale":"2023-10-06T01:21:40.844788+0000","last_undegraded":"2023-10-06T01:21:40.844788+0000","last_fullsized":"2023-10-06T01:21:40.844788+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:21:36.268170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:21:36.268170+0000","last_clean_scrub_stamp":"2023-10-06T01:21:36.268170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:22:57.339224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T01:21:40.848598+0000","last_change":"2023-10-06T01:21:40.839486+0000","last_active":"2023-10-06T01:21:40.848598+0000","last_peered":"2023-10-06T01:21:40.848598+0000","last_clean":"2023-10-06T01:21:40.848598+0000","last_became_active":"2023-10-06T01:21:40.839013+0000","last_became_peered":"2023-10-06T01:21:40.839013+0000","last_unstale":"2023-10-06T01:21:40.848598+0000","last_undegraded":"2023-10-06T01:21:40.848598+0000","last_fullsized":"2023-10-06T01:21:40.848598+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:21:39.809888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:21:39.809888+0000","last_clean_scrub_stamp":"2023-10-06T01:21:39.809888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:44:19.565910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,5,6],"acting":[2,7,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"20'2","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T01:21:40.825787+0000","last_change":"2023-10-06T01:21:36.302862+0000","last_active":"2023-10-06T01:21:40.825787+0000","last_peered":"2023-10-06T01:21:40.825787+0000","last_clean":"2023-10-06T01:21:40.825787+0000","last_became_active":"2023-10-06T01:21:36.302568+0000","last_became_peered":"2023-10-06T01:21:36.302568+0000","last_unstale":"2023-10-06T01:21:40.825787+0000","last_undegraded":"2023-10-06T01:21:40.825787+0000","last_fullsized":"2023-10-06T01:21:40.825787+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:21:35.260777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:21:35.260777+0000","last_clean_scrub_stamp":"2023-10-06T01:21:35.260777+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:54:55.305083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T01:21:40.825801+0000","last_change":"2023-10-06T01:21:36.840041+0000","last_active":"2023-10-06T01:21:40.825801+0000","last_peered":"2023-10-06T01:21:40.825801+0000","last_clean":"2023-10-06T01:21:40.825801+0000","last_became_active":"2023-10-06T01:21:36.839757+0000","last_became_peered":"2023-10-06T01:21:36.839757+0000","last_unstale":"2023-10-06T01:21:40.825801+0000","last_undegraded":"2023-10-06T01:21:40.825801+0000","last_fullsized":"2023-10-06T01:21:40.825801+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:21:36.268170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:21:36.268170+0000","last_clean_scrub_stamp":"2023-10-06T01:21:36.268170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:32:46.966379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T01:21:40.858246+0000","last_change":"2023-10-06T01:21:40.855180+0000","last_active":"2023-10-06T01:21:40.858246+0000","last_peered":"2023-10-06T01:21:40.858246+0000","last_clean":"2023-10-06T01:21:40.858246+0000","last_became_active":"2023-10-06T01:21:40.854696+0000","last_became_peered":"2023-10-06T01:21:40.854696+0000","last_unstale":"2023-10-06T01:21:40.858246+0000","last_undegraded":"2023-10-06T01:21:40.858246+0000","last_fullsized":"2023-10-06T01:21:40.858246+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:21:39.809888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:21:39.809888+0000","last_clean_scrub_stamp":"2023-10-06T01:21:39.809888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:17:23.971056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0,6],"acting":[1,4,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T01:21:40.820767+0000","last_change":"2023-10-06T01:21:36.305613+0000","last_active":"2023-10-06T01:21:40.820767+0000","last_peered":"2023-10-06T01:21:40.820767+0000","last_clean":"2023-10-06T01:21:40.820767+0000","last_became_active":"2023-10-06T01:21:36.305297+0000","last_became_peered":"2023-10-06T01:21:36.305297+0000","last_unstale":"2023-10-06T01:21:40.820767+0000","last_undegraded":"2023-10-06T01:21:40.820767+0000","last_fullsized":"2023-10-06T01:21:40.820767+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:21:35.260777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:21:35.260777+0000","last_clean_scrub_stamp":"2023-10-06T01:21:35.260777+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:03:02.138728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T01:21:40.825239+0000","last_change":"2023-10-06T01:21:36.834711+0000","last_active":"2023-10-06T01:21:40.825239+0000","last_peered":"2023-10-06T01:21:40.825239+0000","last_clean":"2023-10-06T01:21:40.825239+0000","last_became_active":"2023-10-06T01:21:36.833708+0000","last_became_peered":"2023-10-06T01:21:36.833708+0000","last_unstale":"2023-10-06T01:21:40.825239+0000","last_undegraded":"2023-10-06T01:21:40.825239+0000","last_fullsized":"2023-10-06T01:21:40.825239+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:21:36.268170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:21:36.268170+0000","last_clean_scrub_stamp":"2023-10-06T01:21:36.268170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:30:56.051770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T01:21:40.849727+0000","last_change":"2023-10-06T01:21:40.847193+0000","last_active":"2023-10-06T01:21:40.849727+0000","last_peered":"2023-10-06T01:21:40.849727+0000","last_clean":"2023-10-06T01:21:40.849727+0000","last_became_active":"2023-10-06T01:21:40.846404+0000","last_became_peered":"2023-10-06T01:21:40.846404+0000","last_unstale":"2023-10-06T01:21:40.849727+0000","last_undegraded":"2023-10-06T01:21:40.849727+0000","last_fullsized":"2023-10-06T01:21:40.849727+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:21:39.809888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:21:39.809888+0000","last_clean_scrub_stamp":"2023-10-06T01:21:39.809888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:37:36.730320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6,2],"acting":[5,4,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T01:21:40.827525+0000","last_change":"2023-10-06T01:21:36.301030+0000","last_active":"2023-10-06T01:21:40.827525+0000","last_peered":"2023-10-06T01:21:40.827525+0000","last_clean":"2023-10-06T01:21:40.827525+0000","last_became_active":"2023-10-06T01:21:36.300725+0000","last_became_peered":"2023-10-06T01:21:36.300725+0000","last_unstale":"2023-10-06T01:21:40.827525+0000","last_undegraded":"2023-10-06T01:21:40.827525+0000","last_fullsized":"2023-10-06T01:21:40.827525+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:21:35.260777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:21:35.260777+0000","last_clean_scrub_stamp":"2023-10-06T01:21:35.260777+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:33:04.318590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T01:21:40.827164+0000","last_change":"2023-10-06T01:21:36.841950+0000","last_active":"2023-10-06T01:21:40.827164+0000","last_peered":"2023-10-06T01:21:40.827164+0000","last_clean":"2023-10-06T01:21:40.827164+0000","last_became_active":"2023-10-06T01:21:36.841666+0000","last_became_peered":"2023-10-06T01:21:36.841666+0000","last_unstale":"2023-10-06T01:21:40.827164+0000","last_undegraded":"2023-10-06T01:21:40.827164+0000","last_fullsized":"2023-10-06T01:21:40.827164+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:21:36.268170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:21:36.268170+0000","last_clean_scrub_stamp":"2023-10-06T01:21:36.268170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:48:35.151895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T01:21:40.851364+0000","last_change":"2023-10-06T01:21:40.843838+0000","last_active":"2023-10-06T01:21:40.851364+0000","last_peered":"2023-10-06T01:21:40.851364+0000","last_clean":"2023-10-06T01:21:40.851364+0000","last_became_active":"2023-10-06T01:21:40.843470+0000","last_became_peered":"2023-10-06T01:21:40.843470+0000","last_unstale":"2023-10-06T01:21:40.851364+0000","last_undegraded":"2023-10-06T01:21:40.851364+0000","last_fullsized":"2023-10-06T01:21:40.851364+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:21:39.809888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:21:39.809888+0000","last_clean_scrub_stamp":"2023-10-06T01:21:39.809888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:49:27.574363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,0,2],"acting":[4,5,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T01:21:40.825329+0000","last_change":"2023-10-06T01:21:36.306829+0000","last_active":"2023-10-06T01:21:40.825329+0000","last_peered":"2023-10-06T01:21:40.825329+0000","last_clean":"2023-10-06T01:21:40.825329+0000","last_became_active":"2023-10-06T01:21:36.306636+0000","last_became_peered":"2023-10-06T01:21:36.306636+0000","last_unstale":"2023-10-06T01:21:40.825329+0000","last_undegraded":"2023-10-06T01:21:40.825329+0000","last_fullsized":"2023-10-06T01:21:40.825329+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:21:35.260777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:21:35.260777+0000","last_clean_scrub_stamp":"2023-10-06T01:21:35.260777+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:13:12.787972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T01:21:40.825013+0000","last_change":"2023-10-06T01:21:36.827181+0000","last_active":"2023-10-06T01:21:40.825013+0000","last_peered":"2023-10-06T01:21:40.825013+0000","last_clean":"2023-10-06T01:21:40.825013+0000","last_became_active":"2023-10-06T01:21:36.826926+0000","last_became_peered":"2023-10-06T01:21:36.826926+0000","last_unstale":"2023-10-06T01:21:40.825013+0000","last_undegraded":"2023-10-06T01:21:40.825013+0000","last_fullsized":"2023-10-06T01:21:40.825013+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:21:36.268170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:21:36.268170+0000","last_clean_scrub_stamp":"2023-10-06T01:21:36.268170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:50:38.966977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T01:21:40.848984+0000","last_change":"2023-10-06T01:21:40.842824+0000","last_active":"2023-10-06T01:21:40.848984+0000","last_peered":"2023-10-06T01:21:40.848984+0000","last_clean":"2023-10-06T01:21:40.848984+0000","last_became_active":"2023-10-06T01:21:40.842426+0000","last_became_peered":"2023-10-06T01:21:40.842426+0000","last_unstale":"2023-10-06T01:21:40.848984+0000","last_undegraded":"2023-10-06T01:21:40.848984+0000","last_fullsized":"2023-10-06T01:21:40.848984+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:21:39.809888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:21:39.809888+0000","last_clean_scrub_stamp":"2023-10-06T01:21:39.809888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:12:51.722789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,7,0],"acting":[4,3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"20'2","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T01:21:40.824298+0000","last_change":"2023-10-06T01:21:36.302700+0000","last_active":"2023-10-06T01:21:40.824298+0000","last_peered":"2023-10-06T01:21:40.824298+0000","last_clean":"2023-10-06T01:21:40.824298+0000","last_became_active":"2023-10-06T01:21:36.302436+0000","last_became_peered":"2023-10-06T01:21:36.302436+0000","last_unstale":"2023-10-06T01:21:40.824298+0000","last_undegraded":"2023-10-06T01:21:40.824298+0000","last_fullsized":"2023-10-06T01:21:40.824298+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:21:35.260777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:21:35.260777+0000","last_clean_scrub_stamp":"2023-10-06T01:21:35.260777+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:28:28.246900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T01:21:40.825404+0000","last_change":"2023-10-06T01:21:30.601117+0000","last_active":"2023-10-06T01:21:40.825404+0000","last_peered":"2023-10-06T01:21:40.825404+0000","last_clean":"2023-10-06T01:21:40.825404+0000","last_became_active":"2023-10-06T01:21:30.600724+0000","last_became_peered":"2023-10-06T01:21:30.600724+0000","last_unstale":"2023-10-06T01:21:40.825404+0000","last_undegraded":"2023-10-06T01:21:40.825404+0000","last_fullsized":"2023-10-06T01:21:40.825404+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:21:29.586558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:21:29.586558+0000","last_clean_scrub_stamp":"2023-10-06T01:21:29.586558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:47:24.449013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T01:21:40.825234+0000","last_change":"2023-10-06T01:21:36.824653+0000","last_active":"2023-10-06T01:21:40.825234+0000","last_peered":"2023-10-06T01:21:40.825234+0000","last_clean":"2023-10-06T01:21:40.825234+0000","last_became_active":"2023-10-06T01:21:36.824411+0000","last_became_peered":"2023-10-06T01:21:36.824411+0000","last_unstale":"2023-10-06T01:21:40.825234+0000","last_undegraded":"2023-10-06T01:21:40.825234+0000","last_fullsized":"2023-10-06T01:21:40.825234+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:21:36.268170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:21:36.268170+0000","last_clean_scrub_stamp":"2023-10-06T01:21:36.268170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:22:57.339224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T01:21:40.863893+0000","last_change":"2023-10-06T01:21:40.862887+0000","last_active":"2023-10-06T01:21:40.863893+0000","last_peered":"2023-10-06T01:21:40.863893+0000","last_clean":"2023-10-06T01:21:40.863893+0000","last_became_active":"2023-10-06T01:21:40.862455+0000","last_became_peered":"2023-10-06T01:21:40.862455+0000","last_unstale":"2023-10-06T01:21:40.863893+0000","last_undegraded":"2023-10-06T01:21:40.863893+0000","last_fullsized":"2023-10-06T01:21:40.863893+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:21:39.809888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:21:39.809888+0000","last_clean_scrub_stamp":"2023-10-06T01:21:39.809888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:31:58.220361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,0],"acting":[3,1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T01:21:40.823254+0000","last_change":"2023-10-06T01:21:30.603434+0000","last_active":"2023-10-06T01:21:40.823254+0000","last_peered":"2023-10-06T01:21:40.823254+0000","last_clean":"2023-10-06T01:21:40.823254+0000","last_became_active":"2023-10-06T01:21:30.603215+0000","last_became_peered":"2023-10-06T01:21:30.603215+0000","last_unstale":"2023-10-06T01:21:40.823254+0000","last_undegraded":"2023-10-06T01:21:40.823254+0000","last_fullsized":"2023-10-06T01:21:40.823254+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:21:29.586558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:21:29.586558+0000","last_clean_scrub_stamp":"2023-10-06T01:21:29.586558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:47:24.449013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"23'1","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T01:21:40.840164+0000","last_change":"2023-10-06T01:21:36.314457+0000","last_active":"2023-10-06T01:21:40.840164+0000","last_peered":"2023-10-06T01:21:40.840164+0000","last_clean":"2023-10-06T01:21:40.840164+0000","last_became_active":"2023-10-06T01:21:36.314115+0000","last_became_peered":"2023-10-06T01:21:36.314115+0000","last_unstale":"2023-10-06T01:21:40.840164+0000","last_undegraded":"2023-10-06T01:21:40.840164+0000","last_fullsized":"2023-10-06T01:21:40.840164+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:21:35.260777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:21:35.260777+0000","last_clean_scrub_stamp":"2023-10-06T01:21:35.260777+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:54:55.305083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T01:21:40.827608+0000","last_change":"2023-10-06T01:21:36.834738+0000","last_active":"2023-10-06T01:21:40.827608+0000","last_peered":"2023-10-06T01:21:40.827608+0000","last_clean":"2023-10-06T01:21:40.827608+0000","last_became_active":"2023-10-06T01:21:36.830039+0000","last_became_peered":"2023-10-06T01:21:36.830039+0000","last_unstale":"2023-10-06T01:21:40.827608+0000","last_undegraded":"2023-10-06T01:21:40.827608+0000","last_fullsized":"2023-10-06T01:21:40.827608+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:21:36.268170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:21:36.268170+0000","last_clean_scrub_stamp":"2023-10-06T01:21:36.268170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:32:53.580584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T01:21:40.849746+0000","last_change":"2023-10-06T01:21:40.847419+0000","last_active":"2023-10-06T01:21:40.849746+0000","last_peered":"2023-10-06T01:21:40.849746+0000","last_clean":"2023-10-06T01:21:40.849746+0000","last_became_active":"2023-10-06T01:21:40.847033+0000","last_became_peered":"2023-10-06T01:21:40.847033+0000","last_unstale":"2023-10-06T01:21:40.849746+0000","last_undegraded":"2023-10-06T01:21:40.849746+0000","last_fullsized":"2023-10-06T01:21:40.849746+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:21:39.809888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:21:39.809888+0000","last_clean_scrub_stamp":"2023-10-06T01:21:39.809888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:48:34.766396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0,4],"acting":[5,1,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T01:21:40.824624+0000","last_change":"2023-10-06T01:21:30.604889+0000","last_active":"2023-10-06T01:21:40.824624+0000","last_peered":"2023-10-06T01:21:40.824624+0000","last_clean":"2023-10-06T01:21:40.824624+0000","last_became_active":"2023-10-06T01:21:30.604535+0000","last_became_peered":"2023-10-06T01:21:30.604535+0000","last_unstale":"2023-10-06T01:21:40.824624+0000","last_undegraded":"2023-10-06T01:21:40.824624+0000","last_fullsized":"2023-10-06T01:21:40.824624+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:21:29.586558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:21:29.586558+0000","last_clean_scrub_stamp":"2023-10-06T01:21:29.586558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:17:59.434982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"17'117","reported_seq":167,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T01:21:40.832005+0000","last_change":"2023-10-06T01:21:31.602437+0000","last_active":"2023-10-06T01:21:40.832005+0000","last_peered":"2023-10-06T01:21:40.832005+0000","last_clean":"2023-10-06T01:21:40.832005+0000","last_became_active":"2023-10-06T01:21:31.601431+0000","last_became_peered":"2023-10-06T01:21:31.601431+0000","last_unstale":"2023-10-06T01:21:40.832005+0000","last_undegraded":"2023-10-06T01:21:40.832005+0000","last_fullsized":"2023-10-06T01:21:40.832005+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:21:30.589171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:21:30.589171+0000","last_clean_scrub_stamp":"2023-10-06T01:21:30.589171+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T01:48:45.877807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T01:21:40.840247+0000","last_change":"2023-10-06T01:21:36.308132+0000","last_active":"2023-10-06T01:21:40.840247+0000","last_peered":"2023-10-06T01:21:40.840247+0000","last_clean":"2023-10-06T01:21:40.840247+0000","last_became_active":"2023-10-06T01:21:36.307806+0000","last_became_peered":"2023-10-06T01:21:36.307806+0000","last_unstale":"2023-10-06T01:21:40.840247+0000","last_undegraded":"2023-10-06T01:21:40.840247+0000","last_fullsized":"2023-10-06T01:21:40.840247+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:21:35.260777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:21:35.260777+0000","last_clean_scrub_stamp":"2023-10-06T01:21:35.260777+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:48:19.919262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T01:21:40.842645+0000","last_change":"2023-10-06T01:21:36.835445+0000","last_active":"2023-10-06T01:21:40.842645+0000","last_peered":"2023-10-06T01:21:40.842645+0000","last_clean":"2023-10-06T01:21:40.842645+0000","last_became_active":"2023-10-06T01:21:36.834925+0000","last_became_peered":"2023-10-06T01:21:36.834925+0000","last_unstale":"2023-10-06T01:21:40.842645+0000","last_undegraded":"2023-10-06T01:21:40.842645+0000","last_fullsized":"2023-10-06T01:21:40.842645+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:21:36.268170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:21:36.268170+0000","last_clean_scrub_stamp":"2023-10-06T01:21:36.268170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:48:35.151895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T01:21:40.840299+0000","last_change":"2023-10-06T01:21:40.838204+0000","last_active":"2023-10-06T01:21:40.840299+0000","last_peered":"2023-10-06T01:21:40.840299+0000","last_clean":"2023-10-06T01:21:40.840299+0000","last_became_active":"2023-10-06T01:21:40.837815+0000","last_became_peered":"2023-10-06T01:21:40.837815+0000","last_unstale":"2023-10-06T01:21:40.840299+0000","last_undegraded":"2023-10-06T01:21:40.840299+0000","last_fullsized":"2023-10-06T01:21:40.840299+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:21:39.809888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:21:39.809888+0000","last_clean_scrub_stamp":"2023-10-06T01:21:39.809888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:21:10.391252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,1,7],"acting":[2,5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T01:21:40.830958+0000","last_change":"2023-10-06T01:21:31.338236+0000","last_active":"2023-10-06T01:21:40.830958+0000","last_peered":"2023-10-06T01:21:40.830958+0000","last_clean":"2023-10-06T01:21:40.830958+0000","last_became_active":"2023-10-06T01:21:31.337918+0000","last_became_peered":"2023-10-06T01:21:31.337918+0000","last_unstale":"2023-10-06T01:21:40.830958+0000","last_undegraded":"2023-10-06T01:21:40.830958+0000","last_fullsized":"2023-10-06T01:21:40.830958+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:21:29.586558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:21:29.586558+0000","last_clean_scrub_stamp":"2023-10-06T01:21:29.586558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:02:13.010488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T01:21:40.826976+0000","last_change":"2023-10-06T01:21:36.309135+0000","last_active":"2023-10-06T01:21:40.826976+0000","last_peered":"2023-10-06T01:21:40.826976+0000","last_clean":"2023-10-06T01:21:40.826976+0000","last_became_active":"2023-10-06T01:21:36.300992+0000","last_became_peered":"2023-10-06T01:21:36.300992+0000","last_unstale":"2023-10-06T01:21:40.826976+0000","last_undegraded":"2023-10-06T01:21:40.826976+0000","last_fullsized":"2023-10-06T01:21:40.826976+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:21:35.260777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:21:35.260777+0000","last_clean_scrub_stamp":"2023-10-06T01:21:35.260777+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:33:04.318590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T01:21:40.824922+0000","last_change":"2023-10-06T01:21:36.825744+0000","last_active":"2023-10-06T01:21:40.824922+0000","last_peered":"2023-10-06T01:21:40.824922+0000","last_clean":"2023-10-06T01:21:40.824922+0000","last_became_active":"2023-10-06T01:21:36.825474+0000","last_became_peered":"2023-10-06T01:21:36.825474+0000","last_unstale":"2023-10-06T01:21:40.824922+0000","last_undegraded":"2023-10-06T01:21:40.824922+0000","last_fullsized":"2023-10-06T01:21:40.824922+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:21:36.268170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:21:36.268170+0000","last_clean_scrub_stamp":"2023-10-06T01:21:36.268170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:01:50.180814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T01:21:40.842542+0000","last_change":"2023-10-06T01:21:40.839804+0000","last_active":"2023-10-06T01:21:40.842542+0000","last_peered":"2023-10-06T01:21:40.842542+0000","last_clean":"2023-10-06T01:21:40.842542+0000","last_became_active":"2023-10-06T01:21:40.838895+0000","last_became_peered":"2023-10-06T01:21:40.838895+0000","last_unstale":"2023-10-06T01:21:40.842542+0000","last_undegraded":"2023-10-06T01:21:40.842542+0000","last_fullsized":"2023-10-06T01:21:40.842542+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:21:39.809888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:21:39.809888+0000","last_clean_scrub_stamp":"2023-10-06T01:21:39.809888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:37:36.730320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,5,3],"acting":[7,2,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T01:21:40.831878+0000","last_change":"2023-10-06T01:21:31.338209+0000","last_active":"2023-10-06T01:21:40.831878+0000","last_peered":"2023-10-06T01:21:40.831878+0000","last_clean":"2023-10-06T01:21:40.831878+0000","last_became_active":"2023-10-06T01:21:31.337870+0000","last_became_peered":"2023-10-06T01:21:31.337870+0000","last_unstale":"2023-10-06T01:21:40.831878+0000","last_undegraded":"2023-10-06T01:21:40.831878+0000","last_fullsized":"2023-10-06T01:21:40.831878+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:21:29.586558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:21:29.586558+0000","last_clean_scrub_stamp":"2023-10-06T01:21:29.586558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:53:47.117299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T01:21:40.823530+0000","last_change":"2023-10-06T01:21:36.300292+0000","last_active":"2023-10-06T01:21:40.823530+0000","last_peered":"2023-10-06T01:21:40.823530+0000","last_clean":"2023-10-06T01:21:40.823530+0000","last_became_active":"2023-10-06T01:21:36.299999+0000","last_became_peered":"2023-10-06T01:21:36.299999+0000","last_unstale":"2023-10-06T01:21:40.823530+0000","last_undegraded":"2023-10-06T01:21:40.823530+0000","last_fullsized":"2023-10-06T01:21:40.823530+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:21:35.260777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:21:35.260777+0000","last_clean_scrub_stamp":"2023-10-06T01:21:35.260777+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:46:13.974439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T01:21:40.820907+0000","last_change":"2023-10-06T01:21:36.839337+0000","last_active":"2023-10-06T01:21:40.820907+0000","last_peered":"2023-10-06T01:21:40.820907+0000","last_clean":"2023-10-06T01:21:40.820907+0000","last_became_active":"2023-10-06T01:21:36.831706+0000","last_became_peered":"2023-10-06T01:21:36.831706+0000","last_unstale":"2023-10-06T01:21:40.820907+0000","last_undegraded":"2023-10-06T01:21:40.820907+0000","last_fullsized":"2023-10-06T01:21:40.820907+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:21:36.268170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:21:36.268170+0000","last_clean_scrub_stamp":"2023-10-06T01:21:36.268170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:01:50.180814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T01:21:40.861012+0000","last_change":"2023-10-06T01:21:40.858510+0000","last_active":"2023-10-06T01:21:40.861012+0000","last_peered":"2023-10-06T01:21:40.861012+0000","last_clean":"2023-10-06T01:21:40.861012+0000","last_became_active":"2023-10-06T01:21:40.858081+0000","last_became_peered":"2023-10-06T01:21:40.858081+0000","last_unstale":"2023-10-06T01:21:40.861012+0000","last_undegraded":"2023-10-06T01:21:40.861012+0000","last_fullsized":"2023-10-06T01:21:40.861012+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:21:39.809888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:21:39.809888+0000","last_clean_scrub_stamp":"2023-10-06T01:21:39.809888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:37:36.730320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,6],"acting":[0,1,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T01:21:40.829308+0000","last_change":"2023-10-06T01:21:31.338177+0000","last_active":"2023-10-06T01:21:40.829308+0000","last_peered":"2023-10-06T01:21:40.829308+0000","last_clean":"2023-10-06T01:21:40.829308+0000","last_became_active":"2023-10-06T01:21:31.337872+0000","last_became_peered":"2023-10-06T01:21:31.337872+0000","last_unstale":"2023-10-06T01:21:40.829308+0000","last_undegraded":"2023-10-06T01:21:40.829308+0000","last_fullsized":"2023-10-06T01:21:40.829308+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:21:29.586558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:21:29.586558+0000","last_clean_scrub_stamp":"2023-10-06T01:21:29.586558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:17:59.434982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T01:21:40.826747+0000","last_change":"2023-10-06T01:21:36.304934+0000","last_active":"2023-10-06T01:21:40.826747+0000","last_peered":"2023-10-06T01:21:40.826747+0000","last_clean":"2023-10-06T01:21:40.826747+0000","last_became_active":"2023-10-06T01:21:36.304472+0000","last_became_peered":"2023-10-06T01:21:36.304472+0000","last_unstale":"2023-10-06T01:21:40.826747+0000","last_undegraded":"2023-10-06T01:21:40.826747+0000","last_fullsized":"2023-10-06T01:21:40.826747+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:21:35.260777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:21:35.260777+0000","last_clean_scrub_stamp":"2023-10-06T01:21:35.260777+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:54:55.305083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T01:21:40.825749+0000","last_change":"2023-10-06T01:21:36.814330+0000","last_active":"2023-10-06T01:21:40.825749+0000","last_peered":"2023-10-06T01:21:40.825749+0000","last_clean":"2023-10-06T01:21:40.825749+0000","last_became_active":"2023-10-06T01:21:36.814069+0000","last_became_peered":"2023-10-06T01:21:36.814069+0000","last_unstale":"2023-10-06T01:21:40.825749+0000","last_undegraded":"2023-10-06T01:21:40.825749+0000","last_fullsized":"2023-10-06T01:21:40.825749+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:21:36.268170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:21:36.268170+0000","last_clean_scrub_stamp":"2023-10-06T01:21:36.268170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:26:27.490800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T01:21:40.854566+0000","last_change":"2023-10-06T01:21:40.849926+0000","last_active":"2023-10-06T01:21:40.854566+0000","last_peered":"2023-10-06T01:21:40.854566+0000","last_clean":"2023-10-06T01:21:40.854566+0000","last_became_active":"2023-10-06T01:21:40.849188+0000","last_became_peered":"2023-10-06T01:21:40.849188+0000","last_unstale":"2023-10-06T01:21:40.854566+0000","last_undegraded":"2023-10-06T01:21:40.854566+0000","last_fullsized":"2023-10-06T01:21:40.854566+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:21:39.809888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:21:39.809888+0000","last_clean_scrub_stamp":"2023-10-06T01:21:39.809888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:21:10.391252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5,2],"acting":[6,0,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T01:21:40.820997+0000","last_change":"2023-10-06T01:21:31.338181+0000","last_active":"2023-10-06T01:21:40.820997+0000","last_peered":"2023-10-06T01:21:40.820997+0000","last_clean":"2023-10-06T01:21:40.820997+0000","last_became_active":"2023-10-06T01:21:31.337820+0000","last_became_peered":"2023-10-06T01:21:31.337820+0000","last_unstale":"2023-10-06T01:21:40.820997+0000","last_undegraded":"2023-10-06T01:21:40.820997+0000","last_fullsized":"2023-10-06T01:21:40.820997+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:21:29.586558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:21:29.586558+0000","last_clean_scrub_stamp":"2023-10-06T01:21:29.586558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:44:49.740873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T01:21:40.825927+0000","last_change":"2023-10-06T01:21:36.309352+0000","last_active":"2023-10-06T01:21:40.825927+0000","last_peered":"2023-10-06T01:21:40.825927+0000","last_clean":"2023-10-06T01:21:40.825927+0000","last_became_active":"2023-10-06T01:21:36.308864+0000","last_became_peered":"2023-10-06T01:21:36.308864+0000","last_unstale":"2023-10-06T01:21:40.825927+0000","last_undegraded":"2023-10-06T01:21:40.825927+0000","last_fullsized":"2023-10-06T01:21:40.825927+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:21:35.260777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:21:35.260777+0000","last_clean_scrub_stamp":"2023-10-06T01:21:35.260777+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:48:42.234958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T01:21:40.844152+0000","last_change":"2023-10-06T01:21:36.835013+0000","last_active":"2023-10-06T01:21:40.844152+0000","last_peered":"2023-10-06T01:21:40.844152+0000","last_clean":"2023-10-06T01:21:40.844152+0000","last_became_active":"2023-10-06T01:21:36.834427+0000","last_became_peered":"2023-10-06T01:21:36.834427+0000","last_unstale":"2023-10-06T01:21:40.844152+0000","last_undegraded":"2023-10-06T01:21:40.844152+0000","last_fullsized":"2023-10-06T01:21:40.844152+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:21:36.268170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:21:36.268170+0000","last_clean_scrub_stamp":"2023-10-06T01:21:36.268170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:28:15.885944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T01:21:40.858145+0000","last_change":"2023-10-06T01:21:40.857260+0000","last_active":"2023-10-06T01:21:40.858145+0000","last_peered":"2023-10-06T01:21:40.858145+0000","last_clean":"2023-10-06T01:21:40.858145+0000","last_became_active":"2023-10-06T01:21:40.856823+0000","last_became_peered":"2023-10-06T01:21:40.856823+0000","last_unstale":"2023-10-06T01:21:40.858145+0000","last_undegraded":"2023-10-06T01:21:40.858145+0000","last_fullsized":"2023-10-06T01:21:40.858145+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:21:39.809888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:21:39.809888+0000","last_clean_scrub_stamp":"2023-10-06T01:21:39.809888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:26:15.414115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,6,5],"acting":[0,1,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T01:21:40.821025+0000","last_change":"2023-10-06T01:21:30.604007+0000","last_active":"2023-10-06T01:21:40.821025+0000","last_peered":"2023-10-06T01:21:40.821025+0000","last_clean":"2023-10-06T01:21:40.821025+0000","last_became_active":"2023-10-06T01:21:30.603673+0000","last_became_peered":"2023-10-06T01:21:30.603673+0000","last_unstale":"2023-10-06T01:21:40.821025+0000","last_undegraded":"2023-10-06T01:21:40.821025+0000","last_fullsized":"2023-10-06T01:21:40.821025+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:21:29.586558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:21:29.586558+0000","last_clean_scrub_stamp":"2023-10-06T01:21:29.586558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:53:47.117299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T01:21:40.830136+0000","last_change":"2023-10-06T01:21:36.302956+0000","last_active":"2023-10-06T01:21:40.830136+0000","last_peered":"2023-10-06T01:21:40.830136+0000","last_clean":"2023-10-06T01:21:40.830136+0000","last_became_active":"2023-10-06T01:21:36.302668+0000","last_became_peered":"2023-10-06T01:21:36.302668+0000","last_unstale":"2023-10-06T01:21:40.830136+0000","last_undegraded":"2023-10-06T01:21:40.830136+0000","last_fullsized":"2023-10-06T01:21:40.830136+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:21:35.260777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:21:35.260777+0000","last_clean_scrub_stamp":"2023-10-06T01:21:35.260777+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:46:13.974439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T01:21:40.825330+0000","last_change":"2023-10-06T01:21:36.825472+0000","last_active":"2023-10-06T01:21:40.825330+0000","last_peered":"2023-10-06T01:21:40.825330+0000","last_clean":"2023-10-06T01:21:40.825330+0000","last_became_active":"2023-10-06T01:21:36.825199+0000","last_became_peered":"2023-10-06T01:21:36.825199+0000","last_unstale":"2023-10-06T01:21:40.825330+0000","last_undegraded":"2023-10-06T01:21:40.825330+0000","last_fullsized":"2023-10-06T01:21:40.825330+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:21:36.268170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:21:36.268170+0000","last_clean_scrub_stamp":"2023-10-06T01:21:36.268170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:53:27.090314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T01:21:40.858038+0000","last_change":"2023-10-06T01:21:40.855138+0000","last_active":"2023-10-06T01:21:40.858038+0000","last_peered":"2023-10-06T01:21:40.858038+0000","last_clean":"2023-10-06T01:21:40.858038+0000","last_became_active":"2023-10-06T01:21:40.854323+0000","last_became_peered":"2023-10-06T01:21:40.854323+0000","last_unstale":"2023-10-06T01:21:40.858038+0000","last_undegraded":"2023-10-06T01:21:40.858038+0000","last_fullsized":"2023-10-06T01:21:40.858038+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:21:39.809888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:21:39.809888+0000","last_clean_scrub_stamp":"2023-10-06T01:21:39.809888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:48:17.365413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,0],"acting":[1,3,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"20'1","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T01:21:40.844060+0000","last_change":"2023-10-06T01:21:36.308100+0000","last_active":"2023-10-06T01:21:40.844060+0000","last_peered":"2023-10-06T01:21:40.844060+0000","last_clean":"2023-10-06T01:21:40.844060+0000","last_became_active":"2023-10-06T01:21:36.307829+0000","last_became_peered":"2023-10-06T01:21:36.307829+0000","last_unstale":"2023-10-06T01:21:40.844060+0000","last_undegraded":"2023-10-06T01:21:40.844060+0000","last_fullsized":"2023-10-06T01:21:40.844060+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:21:35.260777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:21:35.260777+0000","last_clean_scrub_stamp":"2023-10-06T01:21:35.260777+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:46:13.974439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T01:21:40.817731+0000","last_change":"2023-10-06T01:21:36.820796+0000","last_active":"2023-10-06T01:21:40.817731+0000","last_peered":"2023-10-06T01:21:40.817731+0000","last_clean":"2023-10-06T01:21:40.817731+0000","last_became_active":"2023-10-06T01:21:36.820534+0000","last_became_peered":"2023-10-06T01:21:36.820534+0000","last_unstale":"2023-10-06T01:21:40.817731+0000","last_undegraded":"2023-10-06T01:21:40.817731+0000","last_fullsized":"2023-10-06T01:21:40.817731+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:21:36.268170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:21:36.268170+0000","last_clean_scrub_stamp":"2023-10-06T01:21:36.268170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:13:13.795366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T01:21:40.849961+0000","last_change":"2023-10-06T01:21:40.846085+0000","last_active":"2023-10-06T01:21:40.849961+0000","last_peered":"2023-10-06T01:21:40.849961+0000","last_clean":"2023-10-06T01:21:40.849961+0000","last_became_active":"2023-10-06T01:21:40.845695+0000","last_became_peered":"2023-10-06T01:21:40.845695+0000","last_unstale":"2023-10-06T01:21:40.849961+0000","last_undegraded":"2023-10-06T01:21:40.849961+0000","last_fullsized":"2023-10-06T01:21:40.849961+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:21:39.809888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:21:39.809888+0000","last_clean_scrub_stamp":"2023-10-06T01:21:39.809888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:05:45.908197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1,6],"acting":[7,4,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"20'2","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T01:21:40.829667+0000","last_change":"2023-10-06T01:21:36.307782+0000","last_active":"2023-10-06T01:21:40.829667+0000","last_peered":"2023-10-06T01:21:40.829667+0000","last_clean":"2023-10-06T01:21:40.829667+0000","last_became_active":"2023-10-06T01:21:36.307601+0000","last_became_peered":"2023-10-06T01:21:36.307601+0000","last_unstale":"2023-10-06T01:21:40.829667+0000","last_undegraded":"2023-10-06T01:21:40.829667+0000","last_fullsized":"2023-10-06T01:21:40.829667+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:21:35.260777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:21:35.260777+0000","last_clean_scrub_stamp":"2023-10-06T01:21:35.260777+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:03:02.138728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T01:21:40.826897+0000","last_change":"2023-10-06T01:21:36.840272+0000","last_active":"2023-10-06T01:21:40.826897+0000","last_peered":"2023-10-06T01:21:40.826897+0000","last_clean":"2023-10-06T01:21:40.826897+0000","last_became_active":"2023-10-06T01:21:36.839957+0000","last_became_peered":"2023-10-06T01:21:36.839957+0000","last_unstale":"2023-10-06T01:21:40.826897+0000","last_undegraded":"2023-10-06T01:21:40.826897+0000","last_fullsized":"2023-10-06T01:21:40.826897+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:21:36.268170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:21:36.268170+0000","last_clean_scrub_stamp":"2023-10-06T01:21:36.268170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:48:13.823695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T01:21:40.849688+0000","last_change":"2023-10-06T01:21:40.848222+0000","last_active":"2023-10-06T01:21:40.849688+0000","last_peered":"2023-10-06T01:21:40.849688+0000","last_clean":"2023-10-06T01:21:40.849688+0000","last_became_active":"2023-10-06T01:21:40.847832+0000","last_became_peered":"2023-10-06T01:21:40.847832+0000","last_unstale":"2023-10-06T01:21:40.849688+0000","last_undegraded":"2023-10-06T01:21:40.849688+0000","last_fullsized":"2023-10-06T01:21:40.849688+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:21:39.809888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:21:39.809888+0000","last_clean_scrub_stamp":"2023-10-06T01:21:39.809888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:06:39.429127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,7,4],"acting":[5,0,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1d","version":"20'2","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T01:21:40.830053+0000","last_change":"2023-10-06T01:21:36.307610+0000","last_active":"2023-10-06T01:21:40.830053+0000","last_peered":"2023-10-06T01:21:40.830053+0000","last_clean":"2023-10-06T01:21:40.830053+0000","last_became_active":"2023-10-06T01:21:36.306937+0000","last_became_peered":"2023-10-06T01:21:36.306937+0000","last_unstale":"2023-10-06T01:21:40.830053+0000","last_undegraded":"2023-10-06T01:21:40.830053+0000","last_fullsized":"2023-10-06T01:21:40.830053+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:21:35.260777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:21:35.260777+0000","last_clean_scrub_stamp":"2023-10-06T01:21:35.260777+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:48:19.919262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T01:21:40.824396+0000","last_change":"2023-10-06T01:21:36.840502+0000","last_active":"2023-10-06T01:21:40.824396+0000","last_peered":"2023-10-06T01:21:40.824396+0000","last_clean":"2023-10-06T01:21:40.824396+0000","last_became_active":"2023-10-06T01:21:36.840237+0000","last_became_peered":"2023-10-06T01:21:36.840237+0000","last_unstale":"2023-10-06T01:21:40.824396+0000","last_undegraded":"2023-10-06T01:21:40.824396+0000","last_fullsized":"2023-10-06T01:21:40.824396+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:21:36.268170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:21:36.268170+0000","last_clean_scrub_stamp":"2023-10-06T01:21:36.268170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:03:40.763134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T01:21:40.844533+0000","last_change":"2023-10-06T01:21:40.835338+0000","last_active":"2023-10-06T01:21:40.844533+0000","last_peered":"2023-10-06T01:21:40.844533+0000","last_clean":"2023-10-06T01:21:40.844533+0000","last_became_active":"2023-10-06T01:21:40.834902+0000","last_became_peered":"2023-10-06T01:21:40.834902+0000","last_unstale":"2023-10-06T01:21:40.844533+0000","last_undegraded":"2023-10-06T01:21:40.844533+0000","last_fullsized":"2023-10-06T01:21:40.844533+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:21:39.809888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:21:39.809888+0000","last_clean_scrub_stamp":"2023-10-06T01:21:39.809888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:04:16.001332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,2],"acting":[4,6,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"20'1","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T01:21:40.824449+0000","last_change":"2023-10-06T01:21:36.296572+0000","last_active":"2023-10-06T01:21:40.824449+0000","last_peered":"2023-10-06T01:21:40.824449+0000","last_clean":"2023-10-06T01:21:40.824449+0000","last_became_active":"2023-10-06T01:21:36.295666+0000","last_became_peered":"2023-10-06T01:21:36.295666+0000","last_unstale":"2023-10-06T01:21:40.824449+0000","last_undegraded":"2023-10-06T01:21:40.824449+0000","last_fullsized":"2023-10-06T01:21:40.824449+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:21:35.260777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:21:35.260777+0000","last_clean_scrub_stamp":"2023-10-06T01:21:35.260777+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:48:19.919262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T01:21:40.824070+0000","last_change":"2023-10-06T01:21:36.822907+0000","last_active":"2023-10-06T01:21:40.824070+0000","last_peered":"2023-10-06T01:21:40.824070+0000","last_clean":"2023-10-06T01:21:40.824070+0000","last_became_active":"2023-10-06T01:21:36.822537+0000","last_became_peered":"2023-10-06T01:21:36.822537+0000","last_unstale":"2023-10-06T01:21:40.824070+0000","last_undegraded":"2023-10-06T01:21:40.824070+0000","last_fullsized":"2023-10-06T01:21:40.824070+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:21:36.268170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:21:36.268170+0000","last_clean_scrub_stamp":"2023-10-06T01:21:36.268170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:53:49.542750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T01:21:40.856008+0000","last_change":"2023-10-06T01:21:40.845375+0000","last_active":"2023-10-06T01:21:40.856008+0000","last_peered":"2023-10-06T01:21:40.856008+0000","last_clean":"2023-10-06T01:21:40.856008+0000","last_became_active":"2023-10-06T01:21:40.845079+0000","last_became_peered":"2023-10-06T01:21:40.845079+0000","last_unstale":"2023-10-06T01:21:40.856008+0000","last_undegraded":"2023-10-06T01:21:40.856008+0000","last_fullsized":"2023-10-06T01:21:40.856008+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:21:39.809888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:21:39.809888+0000","last_clean_scrub_stamp":"2023-10-06T01:21:39.809888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:32:57.122301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,7,2],"acting":[1,5,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1f","version":"20'4","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T01:21:40.843463+0000","last_change":"2023-10-06T01:21:36.299553+0000","last_active":"2023-10-06T01:21:40.843463+0000","last_peered":"2023-10-06T01:21:40.843463+0000","last_clean":"2023-10-06T01:21:40.843463+0000","last_became_active":"2023-10-06T01:21:36.298968+0000","last_became_peered":"2023-10-06T01:21:36.298968+0000","last_unstale":"2023-10-06T01:21:40.843463+0000","last_undegraded":"2023-10-06T01:21:40.843463+0000","last_fullsized":"2023-10-06T01:21:40.843463+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:21:35.260777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:21:35.260777+0000","last_clean_scrub_stamp":"2023-10-06T01:21:35.260777+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:33:04.318590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T01:21:40.824895+0000","last_change":"2023-10-06T01:21:36.844505+0000","last_active":"2023-10-06T01:21:40.824895+0000","last_peered":"2023-10-06T01:21:40.824895+0000","last_clean":"2023-10-06T01:21:40.824895+0000","last_became_active":"2023-10-06T01:21:36.843624+0000","last_became_peered":"2023-10-06T01:21:36.843624+0000","last_unstale":"2023-10-06T01:21:40.824895+0000","last_undegraded":"2023-10-06T01:21:40.824895+0000","last_fullsized":"2023-10-06T01:21:40.824895+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:21:36.268170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:21:36.268170+0000","last_clean_scrub_stamp":"2023-10-06T01:21:36.268170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:59:29.172295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T01:21:40.820462+0000","last_change":"2023-10-06T01:21:36.832253+0000","last_active":"2023-10-06T01:21:40.820462+0000","last_peered":"2023-10-06T01:21:40.820462+0000","last_clean":"2023-10-06T01:21:40.820462+0000","last_became_active":"2023-10-06T01:21:36.824011+0000","last_became_peered":"2023-10-06T01:21:36.824011+0000","last_unstale":"2023-10-06T01:21:40.820462+0000","last_undegraded":"2023-10-06T01:21:40.820462+0000","last_fullsized":"2023-10-06T01:21:40.820462+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:21:36.268170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:21:36.268170+0000","last_clean_scrub_stamp":"2023-10-06T01:21:36.268170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:50:38.966977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T01:21:40.823808+0000","last_change":"2023-10-06T01:21:36.826465+0000","last_active":"2023-10-06T01:21:40.823808+0000","last_peered":"2023-10-06T01:21:40.823808+0000","last_clean":"2023-10-06T01:21:40.823808+0000","last_became_active":"2023-10-06T01:21:36.826146+0000","last_became_peered":"2023-10-06T01:21:36.826146+0000","last_unstale":"2023-10-06T01:21:40.823808+0000","last_undegraded":"2023-10-06T01:21:40.823808+0000","last_fullsized":"2023-10-06T01:21:40.823808+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:21:36.268170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:21:36.268170+0000","last_clean_scrub_stamp":"2023-10-06T01:21:36.268170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:28:15.885944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T01:21:40.824625+0000","last_change":"2023-10-06T01:21:36.834310+0000","last_active":"2023-10-06T01:21:40.824625+0000","last_peered":"2023-10-06T01:21:40.824625+0000","last_clean":"2023-10-06T01:21:40.824625+0000","last_became_active":"2023-10-06T01:21:36.834048+0000","last_became_peered":"2023-10-06T01:21:36.834048+0000","last_unstale":"2023-10-06T01:21:40.824625+0000","last_undegraded":"2023-10-06T01:21:40.824625+0000","last_fullsized":"2023-10-06T01:21:40.824625+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:21:36.268170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:21:36.268170+0000","last_clean_scrub_stamp":"2023-10-06T01:21:36.268170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:25:42.902143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T01:21:40.826182+0000","last_change":"2023-10-06T01:21:36.830563+0000","last_active":"2023-10-06T01:21:40.826182+0000","last_peered":"2023-10-06T01:21:40.826182+0000","last_clean":"2023-10-06T01:21:40.826182+0000","last_became_active":"2023-10-06T01:21:36.830334+0000","last_became_peered":"2023-10-06T01:21:36.830334+0000","last_unstale":"2023-10-06T01:21:40.826182+0000","last_undegraded":"2023-10-06T01:21:40.826182+0000","last_fullsized":"2023-10-06T01:21:40.826182+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:21:36.268170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:21:36.268170+0000","last_clean_scrub_stamp":"2023-10-06T01:21:36.268170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:26:07.073491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T01:21:40.825831+0000","last_change":"2023-10-06T01:21:36.828863+0000","last_active":"2023-10-06T01:21:40.825831+0000","last_peered":"2023-10-06T01:21:40.825831+0000","last_clean":"2023-10-06T01:21:40.825831+0000","last_became_active":"2023-10-06T01:21:36.828318+0000","last_became_peered":"2023-10-06T01:21:36.828318+0000","last_unstale":"2023-10-06T01:21:40.825831+0000","last_undegraded":"2023-10-06T01:21:40.825831+0000","last_fullsized":"2023-10-06T01:21:40.825831+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:21:36.268170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:21:36.268170+0000","last_clean_scrub_stamp":"2023-10-06T01:21:36.268170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:27:54.680295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":4484,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":8968,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574857,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298156,"kb_used_data":868,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073684,"statfs":{"total":96636764160,"available":96331452416,"internally_reserved":0,"allocated":888832,"data_stored":703756,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77000000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71799999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.751}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88700000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46500000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48799999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64300000000000002}]}]},{"osd":6,"up_from":13,"seq":55834574857,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297548,"kb_used_data":260,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074292,"statfs":{"total":96636764160,"available":96332075008,"internally_reserved":0,"allocated":266240,"data_stored":109458,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65700000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72699999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68600000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70299999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67600000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55400000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80600000000000005}]}]},{"osd":1,"up_from":13,"seq":55834574855,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302220,"kb_used_data":836,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069620,"statfs":{"total":96636764160,"available":96327290880,"internally_reserved":0,"allocated":856064,"data_stored":698848,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48199999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38800000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50600000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71099999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.748}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79200000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77900000000000003}]}]},{"osd":0,"up_from":13,"seq":55834574856,"num_pgs":47,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301644,"kb_used_data":260,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94070196,"statfs":{"total":96636764160,"available":96327880704,"internally_reserved":0,"allocated":266240,"data_stored":109034,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32700000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58899999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45400000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59999999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67500000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69999999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73199999999999998}]}]},{"osd":2,"up_from":13,"seq":55834574855,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301644,"kb_used_data":260,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94070196,"statfs":{"total":96636764160,"available":96327880704,"internally_reserved":0,"allocated":266240,"data_stored":109458,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40000000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47399999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64400000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82799999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95599999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97999999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84899999999999998}]}]},{"osd":3,"up_from":13,"seq":55834574855,"num_pgs":48,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301648,"kb_used_data":264,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94070192,"statfs":{"total":96636764160,"available":96327876608,"internally_reserved":0,"allocated":270336,"data_stored":109548,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.43099999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46700000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45200000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1080000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95899999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.131}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0309999999999999}]}]},{"osd":4,"up_from":13,"seq":55834574855,"num_pgs":50,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297568,"kb_used_data":280,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074272,"statfs":{"total":96636764160,"available":96332054528,"internally_reserved":0,"allocated":286720,"data_stored":113228,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38600000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40500000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50900000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60299999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80200000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71299999999999997}]}]},{"osd":5,"up_from":13,"seq":55834574857,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297552,"kb_used_data":264,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074288,"statfs":{"total":96636764160,"available":96332070912,"internally_reserved":0,"allocated":270336,"data_stored":109104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68400000000000005}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79100000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77500000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58399999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.628}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46500000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.438}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":3770,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":624,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":3930,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-06T01:22:00.249 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-06T01:22:00.467 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:00.465+0000 7f1c11f9d700 1 Processor -- start 2023-10-06T01:22:00.467 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:00.465+0000 7f1c11f9d700 1 -- start start 2023-10-06T01:22:00.468 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:00.466+0000 7f1c11f9d700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1c0c159480 0x7f1c0c0b30d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:00.469 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:00.466+0000 7f1c11f9d700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f1c0c0b3610 0x7f1c0c0cbc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:00.469 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:00.466+0000 7f1c11f9d700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1c0c0cb7e0 con 0x7f1c0c0cc1b0 2023-10-06T01:22:00.469 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:00.466+0000 7f1c11f9d700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1c0c0b08a0 con 0x7f1c0c0b3610 2023-10-06T01:22:00.469 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:00.466+0000 7f1c11f9d700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c0c0cb190 con 0x7f1c0c159480 2023-10-06T01:22:00.469 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:00.467+0000 7f1c0bfff700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f1c0c0b3610 0x7f1c0c0cbc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:00.469 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:00.467+0000 7f1c0bfff700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f1c0c0b3610 0x7f1c0c0cbc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:47948/0 (socket says 172.21.15.50:47948) 2023-10-06T01:22:00.469 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:00.467+0000 7f1c0bfff700 1 -- 172.21.15.50:0/1893478759 learned_addr learned my addr 172.21.15.50:0/1893478759 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-06T01:22:00.469 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:00.467+0000 7f1c10f9b700 1 --2- 172.21.15.50:0/1893478759 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1c0c159480 0x7f1c0c0b30d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:00.471 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:00.467+0000 7f1c0bfff700 1 -- 172.21.15.50:0/1893478759 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1c0c159480 msgr2=0x7f1c0c0b30d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:22:00.471 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:00.467+0000 7f1c0bfff700 1 --2- 172.21.15.50:0/1893478759 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1c0c159480 0x7f1c0c0b30d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:00.471 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:00.467+0000 7f1c0bfff700 1 -- 172.21.15.50:0/1893478759 >> v1:172.21.15.155:6789/0 conn(0x7f1c0c0cc1b0 legacy=0x7f1c0c0b2140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:00.471 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:00.467+0000 7f1c0bfff700 1 -- 172.21.15.50:0/1893478759 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c0c0cb470 con 0x7f1c0c0b3610 2023-10-06T01:22:00.471 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:00.467+0000 7f1c0bfff700 1 --2- 172.21.15.50:0/1893478759 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1c0c0b3610 0x7f1c0c0cbc70 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f1bf80099b0 tx=0x7f1bf8009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=536ad5e54857a101 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:22:00.471 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:00.468+0000 7f1c0b7fe700 1 -- 172.21.15.50:0/1893478759 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bf800b860 con 0x7f1c0c0b3610 2023-10-06T01:22:00.471 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:00.468+0000 7f1c0b7fe700 1 -- 172.21.15.50:0/1893478759 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1bf800b9c0 con 0x7f1c0c0b3610 2023-10-06T01:22:00.471 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:00.468+0000 7f1c0b7fe700 1 -- 172.21.15.50:0/1893478759 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bf800bd60 con 0x7f1c0c0b3610 2023-10-06T01:22:00.471 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:00.468+0000 7f1c11f9d700 1 -- 172.21.15.50:0/1893478759 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1c0c0b3610 msgr2=0x7f1c0c0cbc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:00.472 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:00.468+0000 7f1c11f9d700 1 --2- 172.21.15.50:0/1893478759 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1c0c0b3610 0x7f1c0c0cbc70 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f1bf80099b0 tx=0x7f1bf8009250 comp rx=0 tx=0).stop 2023-10-06T01:22:00.472 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:00.468+0000 7f1c11f9d700 1 -- 172.21.15.50:0/1893478759 shutdown_connections 2023-10-06T01:22:00.472 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:00.468+0000 7f1c11f9d700 1 --2- 172.21.15.50:0/1893478759 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1c0c159480 0x7f1c0c0b30d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:00.472 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:00.468+0000 7f1c11f9d700 1 --2- 172.21.15.50:0/1893478759 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1c0c0b3610 0x7f1c0c0cbc70 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:00.472 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:00.468+0000 7f1c11f9d700 1 -- 172.21.15.50:0/1893478759 >> 172.21.15.50:0/1893478759 conn(0x7f1c0c06ed20 msgr2=0x7f1c0c06f120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:22:00.472 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:00.468+0000 7f1c11f9d700 1 -- 172.21.15.50:0/1893478759 shutdown_connections 2023-10-06T01:22:00.472 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:00.468+0000 7f1c11f9d700 1 -- 172.21.15.50:0/1893478759 wait complete. 2023-10-06T01:22:00.474 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:00.470+0000 7f1c11f9d700 1 Processor -- start 2023-10-06T01:22:00.474 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:00.470+0000 7f1c11f9d700 1 -- start start 2023-10-06T01:22:00.474 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:00.471+0000 7f1c11f9d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1c0c0b3610 0x7f1c0c153b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:00.474 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:00.471+0000 7f1c11f9d700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1c0c0cc1b0 0x7f1c0c0c5240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:00.474 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:00.471+0000 7f1c11f9d700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1c0c159480 0x7f1c0c0c5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:00.475 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:00.471+0000 7f1c11f9d700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c0c15b430 con 0x7f1c0c0b3610 2023-10-06T01:22:00.475 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:00.471+0000 7f1c11f9d700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c0c0cf250 con 0x7f1c0c159480 2023-10-06T01:22:00.475 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:00.471+0000 7f1c11f9d700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c0c0cf7d0 con 0x7f1c0c0cc1b0 2023-10-06T01:22:00.475 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:00.471+0000 7f1c10f9b700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1c0c0b3610 0x7f1c0c153b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:00.475 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:00.471+0000 7f1c10f9b700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1c0c0b3610 0x7f1c0c153b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:47958/0 (socket says 172.21.15.50:47958) 2023-10-06T01:22:00.475 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:00.471+0000 7f1c10f9b700 1 -- 172.21.15.50:0/2545137847 learned_addr learned my addr 172.21.15.50:0/2545137847 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-06T01:22:00.475 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:00.471+0000 7f1c0bfff700 1 --2- 172.21.15.50:0/2545137847 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1c0c0cc1b0 0x7f1c0c0c5240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:00.475 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:00.471+0000 7f1c1179c700 1 --2- 172.21.15.50:0/2545137847 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1c0c159480 0x7f1c0c0c5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:00.475 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:00.471+0000 7f1c10f9b700 1 -- 172.21.15.50:0/2545137847 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1c0c0cc1b0 msgr2=0x7f1c0c0c5240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:00.475 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:00.471+0000 7f1c10f9b700 1 --2- 172.21.15.50:0/2545137847 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1c0c0cc1b0 0x7f1c0c0c5240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:00.475 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:00.471+0000 7f1c10f9b700 1 -- 172.21.15.50:0/2545137847 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1c0c159480 msgr2=0x7f1c0c0c5780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:00.476 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:00.471+0000 7f1c10f9b700 1 --2- 172.21.15.50:0/2545137847 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1c0c159480 0x7f1c0c0c5780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:00.476 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:00.471+0000 7f1c10f9b700 1 -- 172.21.15.50:0/2545137847 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1bf80094f0 con 0x7f1c0c0b3610 2023-10-06T01:22:00.476 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:00.472+0000 7f1c10f9b700 1 --2- 172.21.15.50:0/2545137847 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1c0c0b3610 0x7f1c0c153b10 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f1c0000d890 tx=0x7f1c00008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:22:00.476 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:00.472+0000 7f1c08ff9700 1 -- 172.21.15.50:0/2545137847 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c000125f0 con 0x7f1c0c0b3610 2023-10-06T01:22:00.476 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:00.472+0000 7f1c08ff9700 1 -- 172.21.15.50:0/2545137847 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c00012750 con 0x7f1c0c0b3610 2023-10-06T01:22:00.476 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:00.472+0000 7f1c08ff9700 1 -- 172.21.15.50:0/2545137847 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c00012b10 con 0x7f1c0c0b3610 2023-10-06T01:22:00.476 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:00.472+0000 7f1c11f9d700 1 -- 172.21.15.50:0/2545137847 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1c0c15ae70 con 0x7f1c0c0b3610 2023-10-06T01:22:00.476 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:00.472+0000 7f1c11f9d700 1 -- 172.21.15.50:0/2545137847 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1c0c0cf460 con 0x7f1c0c0b3610 2023-10-06T01:22:00.477 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:00.473+0000 7f1c11f9d700 1 -- 172.21.15.50:0/2545137847 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1c0c0cfab0 con 0x7f1c0c0b3610 2023-10-06T01:22:00.477 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:00.474+0000 7f1c08ff9700 1 -- 172.21.15.50:0/2545137847 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f1c0001e460 con 0x7f1c0c0b3610 2023-10-06T01:22:00.477 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:00.475+0000 7f1c08ff9700 1 --2- 172.21.15.50:0/2545137847 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f1bf0066f30 0x7f1bf00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:00.477 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:00.475+0000 7f1c08ff9700 1 -- 172.21.15.50:0/2545137847 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f1c00084e30 con 0x7f1c0c0b3610 2023-10-06T01:22:00.477 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:00.475+0000 7f1c0bfff700 1 --2- 172.21.15.50:0/2545137847 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f1bf0066f30 0x7f1bf00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:00.478 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:00.476+0000 7f1c0bfff700 1 --2- 172.21.15.50:0/2545137847 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f1bf0066f30 0x7f1bf00693e0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f1bf80099b0 tx=0x7f1bf8017000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:22:00.480 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:00.479+0000 7f1c08ff9700 1 -- 172.21.15.50:0/2545137847 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f1c00051bb0 con 0x7f1c0c0b3610 2023-10-06T01:22:00.678 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:00.676+0000 7f1c11f9d700 1 -- 172.21.15.50:0/2545137847 --> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f1c0c0cf910 con 0x7f1bf0066f30 2023-10-06T01:22:00.688 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:00.687+0000 7f1c08ff9700 1 -- 172.21.15.50:0/2545137847 <== mgr.4099 v2:172.21.15.155:6832/85215 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+367591 (secure 0 0 0) 0x7f1bf800bb30 con 0x7f1bf0066f30 2023-10-06T01:22:00.693 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-10-06T01:22:00.696 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:00.691+0000 7f1c11f9d700 1 -- 172.21.15.50:0/2545137847 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f1bf0066f30 msgr2=0x7f1bf00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:00.696 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:00.691+0000 7f1c11f9d700 1 --2- 172.21.15.50:0/2545137847 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f1bf0066f30 0x7f1bf00693e0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f1bf80099b0 tx=0x7f1bf8017000 comp rx=0 tx=0).stop 2023-10-06T01:22:00.696 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:00.691+0000 7f1c11f9d700 1 -- 172.21.15.50:0/2545137847 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1c0c0b3610 msgr2=0x7f1c0c153b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:00.696 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:00.691+0000 7f1c11f9d700 1 --2- 172.21.15.50:0/2545137847 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1c0c0b3610 0x7f1c0c153b10 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f1c0000d890 tx=0x7f1c00008040 comp rx=0 tx=0).stop 2023-10-06T01:22:00.696 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:00.691+0000 7f1c11f9d700 1 -- 172.21.15.50:0/2545137847 shutdown_connections 2023-10-06T01:22:00.696 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:00.691+0000 7f1c11f9d700 1 --2- 172.21.15.50:0/2545137847 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f1bf0066f30 0x7f1bf00693e0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:00.696 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:00.691+0000 7f1c11f9d700 1 --2- 172.21.15.50:0/2545137847 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1c0c159480 0x7f1c0c0c5780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:00.696 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:00.691+0000 7f1c11f9d700 1 --2- 172.21.15.50:0/2545137847 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1c0c0b3610 0x7f1c0c153b10 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:00.696 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:00.691+0000 7f1c11f9d700 1 --2- 172.21.15.50:0/2545137847 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1c0c0cc1b0 0x7f1c0c0c5240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:00.696 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:00.691+0000 7f1c11f9d700 1 -- 172.21.15.50:0/2545137847 >> 172.21.15.50:0/2545137847 conn(0x7f1c0c06ed20 msgr2=0x7f1c0c154a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:22:00.697 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:00.691+0000 7f1c11f9d700 1 -- 172.21.15.50:0/2545137847 shutdown_connections 2023-10-06T01:22:00.697 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:00.691+0000 7f1c11f9d700 1 -- 172.21.15.50:0/2545137847 wait complete. 2023-10-06T01:22:00.697 INFO:teuthology.orchestra.run.smithi050.stderr:dumped all 2023-10-06T01:22:00.710 INFO:teuthology.orchestra.run.smithi050.stdout:{"pg_ready":true,"pg_map":{"version":34,"stamp":"2023-10-06T01:21:59.775370+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":594852,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":207,"num_write_kb":2433,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":159,"ondisk_log_size":159,"up":338,"acting":338,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":338,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2397980,"kb_used_data":3292,"kb_used_omap":0,"kb_used_meta":2394624,"kb_avail":752576740,"statfs":{"total":773094113280,"available":770638581760,"internally_reserved":0,"allocated":3371008,"data_stored":2062434,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2452094976},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2178,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003105"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T01:21:40.818033+0000","last_change":"2023-10-06T01:21:36.824186+0000","last_active":"2023-10-06T01:21:40.818033+0000","last_peered":"2023-10-06T01:21:40.818033+0000","last_clean":"2023-10-06T01:21:40.818033+0000","last_became_active":"2023-10-06T01:21:36.823943+0000","last_became_peered":"2023-10-06T01:21:36.823943+0000","last_unstale":"2023-10-06T01:21:40.818033+0000","last_undegraded":"2023-10-06T01:21:40.818033+0000","last_fullsized":"2023-10-06T01:21:40.818033+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:21:36.268170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:21:36.268170+0000","last_clean_scrub_stamp":"2023-10-06T01:21:36.268170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:03:03.146121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T01:21:40.829968+0000","last_change":"2023-10-06T01:21:36.827051+0000","last_active":"2023-10-06T01:21:40.829968+0000","last_peered":"2023-10-06T01:21:40.829968+0000","last_clean":"2023-10-06T01:21:40.829968+0000","last_became_active":"2023-10-06T01:21:36.826789+0000","last_became_peered":"2023-10-06T01:21:36.826789+0000","last_unstale":"2023-10-06T01:21:40.829968+0000","last_undegraded":"2023-10-06T01:21:40.829968+0000","last_fullsized":"2023-10-06T01:21:40.829968+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:21:36.268170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:21:36.268170+0000","last_clean_scrub_stamp":"2023-10-06T01:21:36.268170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:53:49.542750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T01:21:40.825569+0000","last_change":"2023-10-06T01:21:36.841714+0000","last_active":"2023-10-06T01:21:40.825569+0000","last_peered":"2023-10-06T01:21:40.825569+0000","last_clean":"2023-10-06T01:21:40.825569+0000","last_became_active":"2023-10-06T01:21:36.841309+0000","last_became_peered":"2023-10-06T01:21:36.841309+0000","last_unstale":"2023-10-06T01:21:40.825569+0000","last_undegraded":"2023-10-06T01:21:40.825569+0000","last_fullsized":"2023-10-06T01:21:40.825569+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:21:36.268170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:21:36.268170+0000","last_clean_scrub_stamp":"2023-10-06T01:21:36.268170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:21:06.849534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T01:21:40.820783+0000","last_change":"2023-10-06T01:21:36.839886+0000","last_active":"2023-10-06T01:21:40.820783+0000","last_peered":"2023-10-06T01:21:40.820783+0000","last_clean":"2023-10-06T01:21:40.820783+0000","last_became_active":"2023-10-06T01:21:36.839587+0000","last_became_peered":"2023-10-06T01:21:36.839587+0000","last_unstale":"2023-10-06T01:21:40.820783+0000","last_undegraded":"2023-10-06T01:21:40.820783+0000","last_fullsized":"2023-10-06T01:21:40.820783+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:21:36.268170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:21:36.268170+0000","last_clean_scrub_stamp":"2023-10-06T01:21:36.268170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:28:29.254293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T01:21:40.844272+0000","last_change":"2023-10-06T01:21:36.836485+0000","last_active":"2023-10-06T01:21:40.844272+0000","last_peered":"2023-10-06T01:21:40.844272+0000","last_clean":"2023-10-06T01:21:40.844272+0000","last_became_active":"2023-10-06T01:21:36.836212+0000","last_became_peered":"2023-10-06T01:21:36.836212+0000","last_unstale":"2023-10-06T01:21:40.844272+0000","last_undegraded":"2023-10-06T01:21:40.844272+0000","last_fullsized":"2023-10-06T01:21:40.844272+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:21:36.268170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:21:36.268170+0000","last_clean_scrub_stamp":"2023-10-06T01:21:36.268170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:03:40.763134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T01:21:40.824705+0000","last_change":"2023-10-06T01:21:36.842364+0000","last_active":"2023-10-06T01:21:40.824705+0000","last_peered":"2023-10-06T01:21:40.824705+0000","last_clean":"2023-10-06T01:21:40.824705+0000","last_became_active":"2023-10-06T01:21:36.842065+0000","last_became_peered":"2023-10-06T01:21:36.842065+0000","last_unstale":"2023-10-06T01:21:40.824705+0000","last_undegraded":"2023-10-06T01:21:40.824705+0000","last_fullsized":"2023-10-06T01:21:40.824705+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:21:36.268170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:21:36.268170+0000","last_clean_scrub_stamp":"2023-10-06T01:21:36.268170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:28:15.885944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T01:21:40.830001+0000","last_change":"2023-10-06T01:21:36.835095+0000","last_active":"2023-10-06T01:21:40.830001+0000","last_peered":"2023-10-06T01:21:40.830001+0000","last_clean":"2023-10-06T01:21:40.830001+0000","last_became_active":"2023-10-06T01:21:36.834833+0000","last_became_peered":"2023-10-06T01:21:36.834833+0000","last_unstale":"2023-10-06T01:21:40.830001+0000","last_undegraded":"2023-10-06T01:21:40.830001+0000","last_fullsized":"2023-10-06T01:21:40.830001+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:21:36.268170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:21:36.268170+0000","last_clean_scrub_stamp":"2023-10-06T01:21:36.268170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:26:07.073491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T01:21:40.827937+0000","last_change":"2023-10-06T01:21:36.841569+0000","last_active":"2023-10-06T01:21:40.827937+0000","last_peered":"2023-10-06T01:21:40.827937+0000","last_clean":"2023-10-06T01:21:40.827937+0000","last_became_active":"2023-10-06T01:21:36.841279+0000","last_became_peered":"2023-10-06T01:21:36.841279+0000","last_unstale":"2023-10-06T01:21:40.827937+0000","last_undegraded":"2023-10-06T01:21:40.827937+0000","last_fullsized":"2023-10-06T01:21:40.827937+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:21:36.268170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:21:36.268170+0000","last_clean_scrub_stamp":"2023-10-06T01:21:36.268170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:22:57.339224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T01:21:40.843139+0000","last_change":"2023-10-06T01:21:36.840627+0000","last_active":"2023-10-06T01:21:40.843139+0000","last_peered":"2023-10-06T01:21:40.843139+0000","last_clean":"2023-10-06T01:21:40.843139+0000","last_became_active":"2023-10-06T01:21:36.840352+0000","last_became_peered":"2023-10-06T01:21:36.840352+0000","last_unstale":"2023-10-06T01:21:40.843139+0000","last_undegraded":"2023-10-06T01:21:40.843139+0000","last_fullsized":"2023-10-06T01:21:40.843139+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:21:36.268170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:21:36.268170+0000","last_clean_scrub_stamp":"2023-10-06T01:21:36.268170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:53:49.542750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T01:21:40.830823+0000","last_change":"2023-10-06T01:21:36.836461+0000","last_active":"2023-10-06T01:21:40.830823+0000","last_peered":"2023-10-06T01:21:40.830823+0000","last_clean":"2023-10-06T01:21:40.830823+0000","last_became_active":"2023-10-06T01:21:36.836153+0000","last_became_peered":"2023-10-06T01:21:36.836153+0000","last_unstale":"2023-10-06T01:21:40.830823+0000","last_undegraded":"2023-10-06T01:21:40.830823+0000","last_fullsized":"2023-10-06T01:21:40.830823+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:21:36.268170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:21:36.268170+0000","last_clean_scrub_stamp":"2023-10-06T01:21:36.268170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:48:35.151895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T01:21:40.825486+0000","last_change":"2023-10-06T01:21:36.829914+0000","last_active":"2023-10-06T01:21:40.825486+0000","last_peered":"2023-10-06T01:21:40.825486+0000","last_clean":"2023-10-06T01:21:40.825486+0000","last_became_active":"2023-10-06T01:21:36.829628+0000","last_became_peered":"2023-10-06T01:21:36.829628+0000","last_unstale":"2023-10-06T01:21:40.825486+0000","last_undegraded":"2023-10-06T01:21:40.825486+0000","last_fullsized":"2023-10-06T01:21:40.825486+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:21:36.268170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:21:36.268170+0000","last_clean_scrub_stamp":"2023-10-06T01:21:36.268170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:08:14.866921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T01:21:40.817667+0000","last_change":"2023-10-06T01:21:36.835080+0000","last_active":"2023-10-06T01:21:40.817667+0000","last_peered":"2023-10-06T01:21:40.817667+0000","last_clean":"2023-10-06T01:21:40.817667+0000","last_became_active":"2023-10-06T01:21:36.834739+0000","last_became_peered":"2023-10-06T01:21:36.834739+0000","last_unstale":"2023-10-06T01:21:40.817667+0000","last_undegraded":"2023-10-06T01:21:40.817667+0000","last_fullsized":"2023-10-06T01:21:40.817667+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:21:36.268170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:21:36.268170+0000","last_clean_scrub_stamp":"2023-10-06T01:21:36.268170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:48:20.926655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T01:21:40.817292+0000","last_change":"2023-10-06T01:21:36.827097+0000","last_active":"2023-10-06T01:21:40.817292+0000","last_peered":"2023-10-06T01:21:40.817292+0000","last_clean":"2023-10-06T01:21:40.817292+0000","last_became_active":"2023-10-06T01:21:36.826834+0000","last_became_peered":"2023-10-06T01:21:36.826834+0000","last_unstale":"2023-10-06T01:21:40.817292+0000","last_undegraded":"2023-10-06T01:21:40.817292+0000","last_fullsized":"2023-10-06T01:21:40.817292+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:21:36.268170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:21:36.268170+0000","last_clean_scrub_stamp":"2023-10-06T01:21:36.268170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:54:56.312476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T01:21:40.829936+0000","last_change":"2023-10-06T01:21:36.821926+0000","last_active":"2023-10-06T01:21:40.829936+0000","last_peered":"2023-10-06T01:21:40.829936+0000","last_clean":"2023-10-06T01:21:40.829936+0000","last_became_active":"2023-10-06T01:21:36.821634+0000","last_became_peered":"2023-10-06T01:21:36.821634+0000","last_unstale":"2023-10-06T01:21:40.829936+0000","last_undegraded":"2023-10-06T01:21:40.829936+0000","last_fullsized":"2023-10-06T01:21:40.829936+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:21:36.268170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:21:36.268170+0000","last_clean_scrub_stamp":"2023-10-06T01:21:36.268170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:25:14.997580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T01:21:40.829788+0000","last_change":"2023-10-06T01:21:36.835675+0000","last_active":"2023-10-06T01:21:40.829788+0000","last_peered":"2023-10-06T01:21:40.829788+0000","last_clean":"2023-10-06T01:21:40.829788+0000","last_became_active":"2023-10-06T01:21:36.835263+0000","last_became_peered":"2023-10-06T01:21:36.835263+0000","last_unstale":"2023-10-06T01:21:40.829788+0000","last_undegraded":"2023-10-06T01:21:40.829788+0000","last_fullsized":"2023-10-06T01:21:40.829788+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:21:36.268170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:21:36.268170+0000","last_clean_scrub_stamp":"2023-10-06T01:21:36.268170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:48:35.151895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T01:21:40.824974+0000","last_change":"2023-10-06T01:21:36.844306+0000","last_active":"2023-10-06T01:21:40.824974+0000","last_peered":"2023-10-06T01:21:40.824974+0000","last_clean":"2023-10-06T01:21:40.824974+0000","last_became_active":"2023-10-06T01:21:36.843273+0000","last_became_peered":"2023-10-06T01:21:36.843273+0000","last_unstale":"2023-10-06T01:21:40.824974+0000","last_undegraded":"2023-10-06T01:21:40.824974+0000","last_fullsized":"2023-10-06T01:21:40.824974+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:21:36.268170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:21:36.268170+0000","last_clean_scrub_stamp":"2023-10-06T01:21:36.268170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:26:07.073491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T01:21:40.843241+0000","last_change":"2023-10-06T01:21:36.836865+0000","last_active":"2023-10-06T01:21:40.843241+0000","last_peered":"2023-10-06T01:21:40.843241+0000","last_clean":"2023-10-06T01:21:40.843241+0000","last_became_active":"2023-10-06T01:21:36.836583+0000","last_became_peered":"2023-10-06T01:21:36.836583+0000","last_unstale":"2023-10-06T01:21:40.843241+0000","last_undegraded":"2023-10-06T01:21:40.843241+0000","last_fullsized":"2023-10-06T01:21:40.843241+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:21:36.268170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:21:36.268170+0000","last_clean_scrub_stamp":"2023-10-06T01:21:36.268170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:25:14.997580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T01:21:40.827081+0000","last_change":"2023-10-06T01:21:36.833429+0000","last_active":"2023-10-06T01:21:40.827081+0000","last_peered":"2023-10-06T01:21:40.827081+0000","last_clean":"2023-10-06T01:21:40.827081+0000","last_became_active":"2023-10-06T01:21:36.833139+0000","last_became_peered":"2023-10-06T01:21:36.833139+0000","last_unstale":"2023-10-06T01:21:40.827081+0000","last_undegraded":"2023-10-06T01:21:40.827081+0000","last_fullsized":"2023-10-06T01:21:40.827081+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:21:36.268170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:21:36.268170+0000","last_clean_scrub_stamp":"2023-10-06T01:21:36.268170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:51:16.522318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T01:21:40.817681+0000","last_change":"2023-10-06T01:21:36.822258+0000","last_active":"2023-10-06T01:21:40.817681+0000","last_peered":"2023-10-06T01:21:40.817681+0000","last_clean":"2023-10-06T01:21:40.817681+0000","last_became_active":"2023-10-06T01:21:36.822002+0000","last_became_peered":"2023-10-06T01:21:36.822002+0000","last_unstale":"2023-10-06T01:21:40.817681+0000","last_undegraded":"2023-10-06T01:21:40.817681+0000","last_fullsized":"2023-10-06T01:21:40.817681+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:21:36.268170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:21:36.268170+0000","last_clean_scrub_stamp":"2023-10-06T01:21:36.268170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:46:14.981833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T01:21:40.825982+0000","last_change":"2023-10-06T01:21:36.841868+0000","last_active":"2023-10-06T01:21:40.825982+0000","last_peered":"2023-10-06T01:21:40.825982+0000","last_clean":"2023-10-06T01:21:40.825982+0000","last_became_active":"2023-10-06T01:21:36.841579+0000","last_became_peered":"2023-10-06T01:21:36.841579+0000","last_unstale":"2023-10-06T01:21:40.825982+0000","last_undegraded":"2023-10-06T01:21:40.825982+0000","last_fullsized":"2023-10-06T01:21:40.825982+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:21:36.268170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:21:36.268170+0000","last_clean_scrub_stamp":"2023-10-06T01:21:36.268170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:44:16.024192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T01:21:40.830265+0000","last_change":"2023-10-06T01:21:36.836541+0000","last_active":"2023-10-06T01:21:40.830265+0000","last_peered":"2023-10-06T01:21:40.830265+0000","last_clean":"2023-10-06T01:21:40.830265+0000","last_became_active":"2023-10-06T01:21:36.836230+0000","last_became_peered":"2023-10-06T01:21:36.836230+0000","last_unstale":"2023-10-06T01:21:40.830265+0000","last_undegraded":"2023-10-06T01:21:40.830265+0000","last_fullsized":"2023-10-06T01:21:40.830265+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:21:36.268170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:21:36.268170+0000","last_clean_scrub_stamp":"2023-10-06T01:21:36.268170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:22:57.339224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T01:21:40.842277+0000","last_change":"2023-10-06T01:21:36.835952+0000","last_active":"2023-10-06T01:21:40.842277+0000","last_peered":"2023-10-06T01:21:40.842277+0000","last_clean":"2023-10-06T01:21:40.842277+0000","last_became_active":"2023-10-06T01:21:36.835674+0000","last_became_peered":"2023-10-06T01:21:36.835674+0000","last_unstale":"2023-10-06T01:21:40.842277+0000","last_undegraded":"2023-10-06T01:21:40.842277+0000","last_fullsized":"2023-10-06T01:21:40.842277+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:21:36.268170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:21:36.268170+0000","last_clean_scrub_stamp":"2023-10-06T01:21:36.268170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:51:16.522318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T01:21:40.823914+0000","last_change":"2023-10-06T01:21:36.837170+0000","last_active":"2023-10-06T01:21:40.823914+0000","last_peered":"2023-10-06T01:21:40.823914+0000","last_clean":"2023-10-06T01:21:40.823914+0000","last_became_active":"2023-10-06T01:21:36.836919+0000","last_became_peered":"2023-10-06T01:21:36.836919+0000","last_unstale":"2023-10-06T01:21:40.823914+0000","last_undegraded":"2023-10-06T01:21:40.823914+0000","last_fullsized":"2023-10-06T01:21:40.823914+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:21:36.268170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:21:36.268170+0000","last_clean_scrub_stamp":"2023-10-06T01:21:36.268170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:32:46.966379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T01:21:40.832089+0000","last_change":"2023-10-06T01:21:36.836732+0000","last_active":"2023-10-06T01:21:40.832089+0000","last_peered":"2023-10-06T01:21:40.832089+0000","last_clean":"2023-10-06T01:21:40.832089+0000","last_became_active":"2023-10-06T01:21:36.835547+0000","last_became_peered":"2023-10-06T01:21:36.835547+0000","last_unstale":"2023-10-06T01:21:40.832089+0000","last_undegraded":"2023-10-06T01:21:40.832089+0000","last_fullsized":"2023-10-06T01:21:40.832089+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:21:36.268170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:21:36.268170+0000","last_clean_scrub_stamp":"2023-10-06T01:21:36.268170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:53:49.542750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T01:21:40.824805+0000","last_change":"2023-10-06T01:21:36.825216+0000","last_active":"2023-10-06T01:21:40.824805+0000","last_peered":"2023-10-06T01:21:40.824805+0000","last_clean":"2023-10-06T01:21:40.824805+0000","last_became_active":"2023-10-06T01:21:36.824966+0000","last_became_peered":"2023-10-06T01:21:36.824966+0000","last_unstale":"2023-10-06T01:21:40.824805+0000","last_undegraded":"2023-10-06T01:21:40.824805+0000","last_fullsized":"2023-10-06T01:21:40.824805+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:21:36.268170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:21:36.268170+0000","last_clean_scrub_stamp":"2023-10-06T01:21:36.268170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:47:05.161793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T01:21:40.825009+0000","last_change":"2023-10-06T01:21:36.814942+0000","last_active":"2023-10-06T01:21:40.825009+0000","last_peered":"2023-10-06T01:21:40.825009+0000","last_clean":"2023-10-06T01:21:40.825009+0000","last_became_active":"2023-10-06T01:21:36.814669+0000","last_became_peered":"2023-10-06T01:21:36.814669+0000","last_unstale":"2023-10-06T01:21:40.825009+0000","last_undegraded":"2023-10-06T01:21:40.825009+0000","last_fullsized":"2023-10-06T01:21:40.825009+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:21:36.268170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:21:36.268170+0000","last_clean_scrub_stamp":"2023-10-06T01:21:36.268170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:25:14.997580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T01:21:40.830312+0000","last_change":"2023-10-06T01:21:36.830638+0000","last_active":"2023-10-06T01:21:40.830312+0000","last_peered":"2023-10-06T01:21:40.830312+0000","last_clean":"2023-10-06T01:21:40.830312+0000","last_became_active":"2023-10-06T01:21:36.830451+0000","last_became_peered":"2023-10-06T01:21:36.830451+0000","last_unstale":"2023-10-06T01:21:40.830312+0000","last_undegraded":"2023-10-06T01:21:40.830312+0000","last_fullsized":"2023-10-06T01:21:40.830312+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:21:36.268170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:21:36.268170+0000","last_clean_scrub_stamp":"2023-10-06T01:21:36.268170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:26:27.490800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T01:21:40.845528+0000","last_change":"2023-10-06T01:21:40.841583+0000","last_active":"2023-10-06T01:21:40.845528+0000","last_peered":"2023-10-06T01:21:40.845528+0000","last_clean":"2023-10-06T01:21:40.845528+0000","last_became_active":"2023-10-06T01:21:40.841186+0000","last_became_peered":"2023-10-06T01:21:40.841186+0000","last_unstale":"2023-10-06T01:21:40.845528+0000","last_undegraded":"2023-10-06T01:21:40.845528+0000","last_fullsized":"2023-10-06T01:21:40.845528+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:21:39.809888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:21:39.809888+0000","last_clean_scrub_stamp":"2023-10-06T01:21:39.809888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:32:16.087643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,2,0],"acting":[4,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1a","version":"20'1","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T01:21:40.824542+0000","last_change":"2023-10-06T01:21:36.304872+0000","last_active":"2023-10-06T01:21:40.824542+0000","last_peered":"2023-10-06T01:21:40.824542+0000","last_clean":"2023-10-06T01:21:40.824542+0000","last_became_active":"2023-10-06T01:21:36.304341+0000","last_became_peered":"2023-10-06T01:21:36.304341+0000","last_unstale":"2023-10-06T01:21:40.824542+0000","last_undegraded":"2023-10-06T01:21:40.824542+0000","last_fullsized":"2023-10-06T01:21:40.824542+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:21:35.260777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:21:35.260777+0000","last_clean_scrub_stamp":"2023-10-06T01:21:35.260777+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:30:20.955423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T01:21:40.824330+0000","last_change":"2023-10-06T01:21:36.829886+0000","last_active":"2023-10-06T01:21:40.824330+0000","last_peered":"2023-10-06T01:21:40.824330+0000","last_clean":"2023-10-06T01:21:40.824330+0000","last_became_active":"2023-10-06T01:21:36.829585+0000","last_became_peered":"2023-10-06T01:21:36.829585+0000","last_unstale":"2023-10-06T01:21:40.824330+0000","last_undegraded":"2023-10-06T01:21:40.824330+0000","last_fullsized":"2023-10-06T01:21:40.824330+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:21:36.268170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:21:36.268170+0000","last_clean_scrub_stamp":"2023-10-06T01:21:36.268170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:51:16.522318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T01:21:40.844382+0000","last_change":"2023-10-06T01:21:40.837198+0000","last_active":"2023-10-06T01:21:40.844382+0000","last_peered":"2023-10-06T01:21:40.844382+0000","last_clean":"2023-10-06T01:21:40.844382+0000","last_became_active":"2023-10-06T01:21:40.836811+0000","last_became_peered":"2023-10-06T01:21:40.836811+0000","last_unstale":"2023-10-06T01:21:40.844382+0000","last_undegraded":"2023-10-06T01:21:40.844382+0000","last_fullsized":"2023-10-06T01:21:40.844382+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:21:39.809888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:21:39.809888+0000","last_clean_scrub_stamp":"2023-10-06T01:21:39.809888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:48:17.365413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,3,7],"acting":[6,4,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T01:21:40.826208+0000","last_change":"2023-10-06T01:21:36.306212+0000","last_active":"2023-10-06T01:21:40.826208+0000","last_peered":"2023-10-06T01:21:40.826208+0000","last_clean":"2023-10-06T01:21:40.826208+0000","last_became_active":"2023-10-06T01:21:36.305708+0000","last_became_peered":"2023-10-06T01:21:36.305708+0000","last_unstale":"2023-10-06T01:21:40.826208+0000","last_undegraded":"2023-10-06T01:21:40.826208+0000","last_fullsized":"2023-10-06T01:21:40.826208+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:21:35.260777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:21:35.260777+0000","last_clean_scrub_stamp":"2023-10-06T01:21:35.260777+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:30:20.955423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T01:21:40.842466+0000","last_change":"2023-10-06T01:21:36.835259+0000","last_active":"2023-10-06T01:21:40.842466+0000","last_peered":"2023-10-06T01:21:40.842466+0000","last_clean":"2023-10-06T01:21:40.842466+0000","last_became_active":"2023-10-06T01:21:36.834601+0000","last_became_peered":"2023-10-06T01:21:36.834601+0000","last_unstale":"2023-10-06T01:21:40.842466+0000","last_undegraded":"2023-10-06T01:21:40.842466+0000","last_fullsized":"2023-10-06T01:21:40.842466+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:21:36.268170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:21:36.268170+0000","last_clean_scrub_stamp":"2023-10-06T01:21:36.268170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:26:27.490800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T01:21:40.861034+0000","last_change":"2023-10-06T01:21:40.859811+0000","last_active":"2023-10-06T01:21:40.861034+0000","last_peered":"2023-10-06T01:21:40.861034+0000","last_clean":"2023-10-06T01:21:40.861034+0000","last_became_active":"2023-10-06T01:21:40.859403+0000","last_became_peered":"2023-10-06T01:21:40.859403+0000","last_unstale":"2023-10-06T01:21:40.861034+0000","last_undegraded":"2023-10-06T01:21:40.861034+0000","last_fullsized":"2023-10-06T01:21:40.861034+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:21:39.809888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:21:39.809888+0000","last_clean_scrub_stamp":"2023-10-06T01:21:39.809888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:57:11.609623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,1,2],"acting":[0,7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T01:21:40.825496+0000","last_change":"2023-10-06T01:21:36.293850+0000","last_active":"2023-10-06T01:21:40.825496+0000","last_peered":"2023-10-06T01:21:40.825496+0000","last_clean":"2023-10-06T01:21:40.825496+0000","last_became_active":"2023-10-06T01:21:36.293488+0000","last_became_peered":"2023-10-06T01:21:36.293488+0000","last_unstale":"2023-10-06T01:21:40.825496+0000","last_undegraded":"2023-10-06T01:21:40.825496+0000","last_fullsized":"2023-10-06T01:21:40.825496+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:21:35.260777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:21:35.260777+0000","last_clean_scrub_stamp":"2023-10-06T01:21:35.260777+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:03:02.138728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T01:21:40.821094+0000","last_change":"2023-10-06T01:21:36.828340+0000","last_active":"2023-10-06T01:21:40.821094+0000","last_peered":"2023-10-06T01:21:40.821094+0000","last_clean":"2023-10-06T01:21:40.821094+0000","last_became_active":"2023-10-06T01:21:36.827891+0000","last_became_peered":"2023-10-06T01:21:36.827891+0000","last_unstale":"2023-10-06T01:21:40.821094+0000","last_undegraded":"2023-10-06T01:21:40.821094+0000","last_fullsized":"2023-10-06T01:21:40.821094+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:21:36.268170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:21:36.268170+0000","last_clean_scrub_stamp":"2023-10-06T01:21:36.268170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:12:59.424963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T01:21:40.844982+0000","last_change":"2023-10-06T01:21:40.837490+0000","last_active":"2023-10-06T01:21:40.844982+0000","last_peered":"2023-10-06T01:21:40.844982+0000","last_clean":"2023-10-06T01:21:40.844982+0000","last_became_active":"2023-10-06T01:21:40.836992+0000","last_became_peered":"2023-10-06T01:21:40.836992+0000","last_unstale":"2023-10-06T01:21:40.844982+0000","last_undegraded":"2023-10-06T01:21:40.844982+0000","last_fullsized":"2023-10-06T01:21:40.844982+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:21:39.809888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:21:39.809888+0000","last_clean_scrub_stamp":"2023-10-06T01:21:39.809888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:08:18.408639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7,1],"acting":[6,4,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T01:21:40.843338+0000","last_change":"2023-10-06T01:21:36.299763+0000","last_active":"2023-10-06T01:21:40.843338+0000","last_peered":"2023-10-06T01:21:40.843338+0000","last_clean":"2023-10-06T01:21:40.843338+0000","last_became_active":"2023-10-06T01:21:36.299294+0000","last_became_peered":"2023-10-06T01:21:36.299294+0000","last_unstale":"2023-10-06T01:21:40.843338+0000","last_undegraded":"2023-10-06T01:21:40.843338+0000","last_fullsized":"2023-10-06T01:21:40.843338+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:21:35.260777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:21:35.260777+0000","last_clean_scrub_stamp":"2023-10-06T01:21:35.260777+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:48:42.234958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T01:21:40.825416+0000","last_change":"2023-10-06T01:21:36.827009+0000","last_active":"2023-10-06T01:21:40.825416+0000","last_peered":"2023-10-06T01:21:40.825416+0000","last_clean":"2023-10-06T01:21:40.825416+0000","last_became_active":"2023-10-06T01:21:36.826543+0000","last_became_peered":"2023-10-06T01:21:36.826543+0000","last_unstale":"2023-10-06T01:21:40.825416+0000","last_undegraded":"2023-10-06T01:21:40.825416+0000","last_fullsized":"2023-10-06T01:21:40.825416+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:21:36.268170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:21:36.268170+0000","last_clean_scrub_stamp":"2023-10-06T01:21:36.268170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:21:06.849534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T01:21:40.852806+0000","last_change":"2023-10-06T01:21:40.847656+0000","last_active":"2023-10-06T01:21:40.852806+0000","last_peered":"2023-10-06T01:21:40.852806+0000","last_clean":"2023-10-06T01:21:40.852806+0000","last_became_active":"2023-10-06T01:21:40.847177+0000","last_became_peered":"2023-10-06T01:21:40.847177+0000","last_unstale":"2023-10-06T01:21:40.852806+0000","last_undegraded":"2023-10-06T01:21:40.852806+0000","last_fullsized":"2023-10-06T01:21:40.852806+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:21:39.809888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:21:39.809888+0000","last_clean_scrub_stamp":"2023-10-06T01:21:39.809888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:57:11.609623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6,0],"acting":[7,4,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T01:21:40.830754+0000","last_change":"2023-10-06T01:21:36.296695+0000","last_active":"2023-10-06T01:21:40.830754+0000","last_peered":"2023-10-06T01:21:40.830754+0000","last_clean":"2023-10-06T01:21:40.830754+0000","last_became_active":"2023-10-06T01:21:36.296338+0000","last_became_peered":"2023-10-06T01:21:36.296338+0000","last_unstale":"2023-10-06T01:21:40.830754+0000","last_undegraded":"2023-10-06T01:21:40.830754+0000","last_fullsized":"2023-10-06T01:21:40.830754+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:21:35.260777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:21:35.260777+0000","last_clean_scrub_stamp":"2023-10-06T01:21:35.260777+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:13:12.787972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T01:21:40.823710+0000","last_change":"2023-10-06T01:21:36.830617+0000","last_active":"2023-10-06T01:21:40.823710+0000","last_peered":"2023-10-06T01:21:40.823710+0000","last_clean":"2023-10-06T01:21:40.823710+0000","last_became_active":"2023-10-06T01:21:36.830336+0000","last_became_peered":"2023-10-06T01:21:36.830336+0000","last_unstale":"2023-10-06T01:21:40.823710+0000","last_undegraded":"2023-10-06T01:21:40.823710+0000","last_fullsized":"2023-10-06T01:21:40.823710+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:21:36.268170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:21:36.268170+0000","last_clean_scrub_stamp":"2023-10-06T01:21:36.268170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:48:35.151895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T01:21:40.860402+0000","last_change":"2023-10-06T01:21:40.848992+0000","last_active":"2023-10-06T01:21:40.860402+0000","last_peered":"2023-10-06T01:21:40.860402+0000","last_clean":"2023-10-06T01:21:40.860402+0000","last_became_active":"2023-10-06T01:21:40.848631+0000","last_became_peered":"2023-10-06T01:21:40.848631+0000","last_unstale":"2023-10-06T01:21:40.860402+0000","last_undegraded":"2023-10-06T01:21:40.860402+0000","last_fullsized":"2023-10-06T01:21:40.860402+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:21:39.809888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:21:39.809888+0000","last_clean_scrub_stamp":"2023-10-06T01:21:39.809888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:11:30.651756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,5],"acting":[3,0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"20'3","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T01:21:40.831260+0000","last_change":"2023-10-06T01:21:36.302987+0000","last_active":"2023-10-06T01:21:40.831260+0000","last_peered":"2023-10-06T01:21:40.831260+0000","last_clean":"2023-10-06T01:21:40.831260+0000","last_became_active":"2023-10-06T01:21:36.302712+0000","last_became_peered":"2023-10-06T01:21:36.302712+0000","last_unstale":"2023-10-06T01:21:40.831260+0000","last_undegraded":"2023-10-06T01:21:40.831260+0000","last_fullsized":"2023-10-06T01:21:40.831260+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:21:35.260777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:21:35.260777+0000","last_clean_scrub_stamp":"2023-10-06T01:21:35.260777+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:47:04.154399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T01:21:40.825424+0000","last_change":"2023-10-06T01:21:36.829217+0000","last_active":"2023-10-06T01:21:40.825424+0000","last_peered":"2023-10-06T01:21:40.825424+0000","last_clean":"2023-10-06T01:21:40.825424+0000","last_became_active":"2023-10-06T01:21:36.828005+0000","last_became_peered":"2023-10-06T01:21:36.828005+0000","last_unstale":"2023-10-06T01:21:40.825424+0000","last_undegraded":"2023-10-06T01:21:40.825424+0000","last_fullsized":"2023-10-06T01:21:40.825424+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:21:36.268170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:21:36.268170+0000","last_clean_scrub_stamp":"2023-10-06T01:21:36.268170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:12:59.424963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T01:21:40.844125+0000","last_change":"2023-10-06T01:21:40.838989+0000","last_active":"2023-10-06T01:21:40.844125+0000","last_peered":"2023-10-06T01:21:40.844125+0000","last_clean":"2023-10-06T01:21:40.844125+0000","last_became_active":"2023-10-06T01:21:40.837659+0000","last_became_peered":"2023-10-06T01:21:40.837659+0000","last_unstale":"2023-10-06T01:21:40.844125+0000","last_undegraded":"2023-10-06T01:21:40.844125+0000","last_fullsized":"2023-10-06T01:21:40.844125+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:21:39.809888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:21:39.809888+0000","last_clean_scrub_stamp":"2023-10-06T01:21:39.809888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:39:50.108444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,3,7],"acting":[1,5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"25'9","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-06T01:21:49.958650+0000","last_change":"2023-10-06T01:21:36.301140+0000","last_active":"2023-10-06T01:21:49.958650+0000","last_peered":"2023-10-06T01:21:49.958650+0000","last_clean":"2023-10-06T01:21:49.958650+0000","last_became_active":"2023-10-06T01:21:36.296099+0000","last_became_peered":"2023-10-06T01:21:36.296099+0000","last_unstale":"2023-10-06T01:21:49.958650+0000","last_undegraded":"2023-10-06T01:21:49.958650+0000","last_fullsized":"2023-10-06T01:21:49.958650+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:21:35.260777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:21:35.260777+0000","last_clean_scrub_stamp":"2023-10-06T01:21:35.260777+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:03:02.138728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3714,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T01:21:40.826661+0000","last_change":"2023-10-06T01:21:36.842618+0000","last_active":"2023-10-06T01:21:40.826661+0000","last_peered":"2023-10-06T01:21:40.826661+0000","last_clean":"2023-10-06T01:21:40.826661+0000","last_became_active":"2023-10-06T01:21:36.842343+0000","last_became_peered":"2023-10-06T01:21:36.842343+0000","last_unstale":"2023-10-06T01:21:40.826661+0000","last_undegraded":"2023-10-06T01:21:40.826661+0000","last_fullsized":"2023-10-06T01:21:40.826661+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:21:36.268170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:21:36.268170+0000","last_clean_scrub_stamp":"2023-10-06T01:21:36.268170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:21:33.868021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T01:21:40.851721+0000","last_change":"2023-10-06T01:21:40.849230+0000","last_active":"2023-10-06T01:21:40.851721+0000","last_peered":"2023-10-06T01:21:40.851721+0000","last_clean":"2023-10-06T01:21:40.851721+0000","last_became_active":"2023-10-06T01:21:40.848850+0000","last_became_peered":"2023-10-06T01:21:40.848850+0000","last_unstale":"2023-10-06T01:21:40.851721+0000","last_undegraded":"2023-10-06T01:21:40.851721+0000","last_fullsized":"2023-10-06T01:21:40.851721+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:21:39.809888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:21:39.809888+0000","last_clean_scrub_stamp":"2023-10-06T01:21:39.809888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:31:58.220361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,3,0],"acting":[5,1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"20'2","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T01:21:40.830178+0000","last_change":"2023-10-06T01:21:36.307193+0000","last_active":"2023-10-06T01:21:40.830178+0000","last_peered":"2023-10-06T01:21:40.830178+0000","last_clean":"2023-10-06T01:21:40.830178+0000","last_became_active":"2023-10-06T01:21:36.306908+0000","last_became_peered":"2023-10-06T01:21:36.306908+0000","last_unstale":"2023-10-06T01:21:40.830178+0000","last_undegraded":"2023-10-06T01:21:40.830178+0000","last_fullsized":"2023-10-06T01:21:40.830178+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:21:35.260777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:21:35.260777+0000","last_clean_scrub_stamp":"2023-10-06T01:21:35.260777+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:38:59.100770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T01:21:40.823389+0000","last_change":"2023-10-06T01:21:36.826306+0000","last_active":"2023-10-06T01:21:40.823389+0000","last_peered":"2023-10-06T01:21:40.823389+0000","last_clean":"2023-10-06T01:21:40.823389+0000","last_became_active":"2023-10-06T01:21:36.826052+0000","last_became_peered":"2023-10-06T01:21:36.826052+0000","last_unstale":"2023-10-06T01:21:40.823389+0000","last_undegraded":"2023-10-06T01:21:40.823389+0000","last_fullsized":"2023-10-06T01:21:40.823389+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:21:36.268170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:21:36.268170+0000","last_clean_scrub_stamp":"2023-10-06T01:21:36.268170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:30:56.051770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T01:21:40.848294+0000","last_change":"2023-10-06T01:21:40.843226+0000","last_active":"2023-10-06T01:21:40.848294+0000","last_peered":"2023-10-06T01:21:40.848294+0000","last_clean":"2023-10-06T01:21:40.848294+0000","last_became_active":"2023-10-06T01:21:40.841607+0000","last_became_peered":"2023-10-06T01:21:40.841607+0000","last_unstale":"2023-10-06T01:21:40.848294+0000","last_undegraded":"2023-10-06T01:21:40.848294+0000","last_fullsized":"2023-10-06T01:21:40.848294+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:21:39.809888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:21:39.809888+0000","last_clean_scrub_stamp":"2023-10-06T01:21:39.809888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:54:53.178521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,2,1],"acting":[3,7,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T01:21:40.842017+0000","last_change":"2023-10-06T01:21:36.301285+0000","last_active":"2023-10-06T01:21:40.842017+0000","last_peered":"2023-10-06T01:21:40.842017+0000","last_clean":"2023-10-06T01:21:40.842017+0000","last_became_active":"2023-10-06T01:21:36.300676+0000","last_became_peered":"2023-10-06T01:21:36.300676+0000","last_unstale":"2023-10-06T01:21:40.842017+0000","last_undegraded":"2023-10-06T01:21:40.842017+0000","last_fullsized":"2023-10-06T01:21:40.842017+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:21:35.260777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:21:35.260777+0000","last_clean_scrub_stamp":"2023-10-06T01:21:35.260777+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:13:12.787972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T01:21:40.830219+0000","last_change":"2023-10-06T01:21:36.826226+0000","last_active":"2023-10-06T01:21:40.830219+0000","last_peered":"2023-10-06T01:21:40.830219+0000","last_clean":"2023-10-06T01:21:40.830219+0000","last_became_active":"2023-10-06T01:21:36.825921+0000","last_became_peered":"2023-10-06T01:21:36.825921+0000","last_unstale":"2023-10-06T01:21:40.830219+0000","last_undegraded":"2023-10-06T01:21:40.830219+0000","last_fullsized":"2023-10-06T01:21:40.830219+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:21:36.268170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:21:36.268170+0000","last_clean_scrub_stamp":"2023-10-06T01:21:36.268170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:01:50.180814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T01:21:40.859960+0000","last_change":"2023-10-06T01:21:40.845788+0000","last_active":"2023-10-06T01:21:40.859960+0000","last_peered":"2023-10-06T01:21:40.859960+0000","last_clean":"2023-10-06T01:21:40.859960+0000","last_became_active":"2023-10-06T01:21:40.845410+0000","last_became_peered":"2023-10-06T01:21:40.845410+0000","last_unstale":"2023-10-06T01:21:40.859960+0000","last_undegraded":"2023-10-06T01:21:40.859960+0000","last_fullsized":"2023-10-06T01:21:40.859960+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:21:39.809888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:21:39.809888+0000","last_clean_scrub_stamp":"2023-10-06T01:21:39.809888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:35:36.949771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,0],"acting":[3,1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T01:21:40.829873+0000","last_change":"2023-10-06T01:21:36.307137+0000","last_active":"2023-10-06T01:21:40.829873+0000","last_peered":"2023-10-06T01:21:40.829873+0000","last_clean":"2023-10-06T01:21:40.829873+0000","last_became_active":"2023-10-06T01:21:36.306781+0000","last_became_peered":"2023-10-06T01:21:36.306781+0000","last_unstale":"2023-10-06T01:21:40.829873+0000","last_undegraded":"2023-10-06T01:21:40.829873+0000","last_fullsized":"2023-10-06T01:21:40.829873+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:21:35.260777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:21:35.260777+0000","last_clean_scrub_stamp":"2023-10-06T01:21:35.260777+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:13:12.787972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T01:21:40.842737+0000","last_change":"2023-10-06T01:21:36.838019+0000","last_active":"2023-10-06T01:21:40.842737+0000","last_peered":"2023-10-06T01:21:40.842737+0000","last_clean":"2023-10-06T01:21:40.842737+0000","last_became_active":"2023-10-06T01:21:36.837484+0000","last_became_peered":"2023-10-06T01:21:36.837484+0000","last_unstale":"2023-10-06T01:21:40.842737+0000","last_undegraded":"2023-10-06T01:21:40.842737+0000","last_fullsized":"2023-10-06T01:21:40.842737+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:21:36.268170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:21:36.268170+0000","last_clean_scrub_stamp":"2023-10-06T01:21:36.268170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:26:07.073491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T01:21:40.849782+0000","last_change":"2023-10-06T01:21:40.846902+0000","last_active":"2023-10-06T01:21:40.849782+0000","last_peered":"2023-10-06T01:21:40.849782+0000","last_clean":"2023-10-06T01:21:40.849782+0000","last_became_active":"2023-10-06T01:21:40.846515+0000","last_became_peered":"2023-10-06T01:21:40.846515+0000","last_unstale":"2023-10-06T01:21:40.849782+0000","last_undegraded":"2023-10-06T01:21:40.849782+0000","last_fullsized":"2023-10-06T01:21:40.849782+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:21:39.809888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:21:39.809888+0000","last_clean_scrub_stamp":"2023-10-06T01:21:39.809888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:17:23.971056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,1,6],"acting":[5,3,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"20'8","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T01:21:40.820366+0000","last_change":"2023-10-06T01:21:36.314508+0000","last_active":"2023-10-06T01:21:40.820366+0000","last_peered":"2023-10-06T01:21:40.820366+0000","last_clean":"2023-10-06T01:21:40.820366+0000","last_became_active":"2023-10-06T01:21:36.314195+0000","last_became_peered":"2023-10-06T01:21:36.314195+0000","last_unstale":"2023-10-06T01:21:40.820366+0000","last_undegraded":"2023-10-06T01:21:40.820366+0000","last_fullsized":"2023-10-06T01:21:40.820366+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:21:35.260777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:21:35.260777+0000","last_clean_scrub_stamp":"2023-10-06T01:21:35.260777+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:54:55.305083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T01:21:40.824505+0000","last_change":"2023-10-06T01:21:36.831875+0000","last_active":"2023-10-06T01:21:40.824505+0000","last_peered":"2023-10-06T01:21:40.824505+0000","last_clean":"2023-10-06T01:21:40.824505+0000","last_became_active":"2023-10-06T01:21:36.831328+0000","last_became_peered":"2023-10-06T01:21:36.831328+0000","last_unstale":"2023-10-06T01:21:40.824505+0000","last_undegraded":"2023-10-06T01:21:40.824505+0000","last_fullsized":"2023-10-06T01:21:40.824505+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:21:36.268170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:21:36.268170+0000","last_clean_scrub_stamp":"2023-10-06T01:21:36.268170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:03:40.763134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T01:21:40.851310+0000","last_change":"2023-10-06T01:21:40.846661+0000","last_active":"2023-10-06T01:21:40.851310+0000","last_peered":"2023-10-06T01:21:40.851310+0000","last_clean":"2023-10-06T01:21:40.851310+0000","last_became_active":"2023-10-06T01:21:40.845846+0000","last_became_peered":"2023-10-06T01:21:40.845846+0000","last_unstale":"2023-10-06T01:21:40.851310+0000","last_undegraded":"2023-10-06T01:21:40.851310+0000","last_fullsized":"2023-10-06T01:21:40.851310+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:21:39.809888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:21:39.809888+0000","last_clean_scrub_stamp":"2023-10-06T01:21:39.809888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:26:15.414115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,3,4],"acting":[7,6,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.f","version":"20'1","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T01:21:40.831539+0000","last_change":"2023-10-06T01:21:36.307931+0000","last_active":"2023-10-06T01:21:40.831539+0000","last_peered":"2023-10-06T01:21:40.831539+0000","last_clean":"2023-10-06T01:21:40.831539+0000","last_became_active":"2023-10-06T01:21:36.307539+0000","last_became_peered":"2023-10-06T01:21:36.307539+0000","last_unstale":"2023-10-06T01:21:40.831539+0000","last_undegraded":"2023-10-06T01:21:40.831539+0000","last_fullsized":"2023-10-06T01:21:40.831539+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:21:35.260777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:21:35.260777+0000","last_clean_scrub_stamp":"2023-10-06T01:21:35.260777+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:28:28.246900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T01:21:40.827851+0000","last_change":"2023-10-06T01:21:36.824841+0000","last_active":"2023-10-06T01:21:40.827851+0000","last_peered":"2023-10-06T01:21:40.827851+0000","last_clean":"2023-10-06T01:21:40.827851+0000","last_became_active":"2023-10-06T01:21:36.824575+0000","last_became_peered":"2023-10-06T01:21:36.824575+0000","last_unstale":"2023-10-06T01:21:40.827851+0000","last_undegraded":"2023-10-06T01:21:40.827851+0000","last_fullsized":"2023-10-06T01:21:40.827851+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:21:36.268170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:21:36.268170+0000","last_clean_scrub_stamp":"2023-10-06T01:21:36.268170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:27:54.680295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T01:21:40.850673+0000","last_change":"2023-10-06T01:21:40.844715+0000","last_active":"2023-10-06T01:21:40.850673+0000","last_peered":"2023-10-06T01:21:40.850673+0000","last_clean":"2023-10-06T01:21:40.850673+0000","last_became_active":"2023-10-06T01:21:40.843713+0000","last_became_peered":"2023-10-06T01:21:40.843713+0000","last_unstale":"2023-10-06T01:21:40.850673+0000","last_undegraded":"2023-10-06T01:21:40.850673+0000","last_fullsized":"2023-10-06T01:21:40.850673+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:21:39.809888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:21:39.809888+0000","last_clean_scrub_stamp":"2023-10-06T01:21:39.809888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:59:32.714013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,5],"acting":[2,0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"20'2","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T01:21:40.831428+0000","last_change":"2023-10-06T01:21:36.307165+0000","last_active":"2023-10-06T01:21:40.831428+0000","last_peered":"2023-10-06T01:21:40.831428+0000","last_clean":"2023-10-06T01:21:40.831428+0000","last_became_active":"2023-10-06T01:21:36.306877+0000","last_became_peered":"2023-10-06T01:21:36.306877+0000","last_unstale":"2023-10-06T01:21:40.831428+0000","last_undegraded":"2023-10-06T01:21:40.831428+0000","last_fullsized":"2023-10-06T01:21:40.831428+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:21:35.260777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:21:35.260777+0000","last_clean_scrub_stamp":"2023-10-06T01:21:35.260777+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:38:56.761956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T01:21:40.827687+0000","last_change":"2023-10-06T01:21:36.840414+0000","last_active":"2023-10-06T01:21:40.827687+0000","last_peered":"2023-10-06T01:21:40.827687+0000","last_clean":"2023-10-06T01:21:40.827687+0000","last_became_active":"2023-10-06T01:21:36.840067+0000","last_became_peered":"2023-10-06T01:21:36.840067+0000","last_unstale":"2023-10-06T01:21:40.827687+0000","last_undegraded":"2023-10-06T01:21:40.827687+0000","last_fullsized":"2023-10-06T01:21:40.827687+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:21:36.268170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:21:36.268170+0000","last_clean_scrub_stamp":"2023-10-06T01:21:36.268170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:48:18.526486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T01:21:40.849984+0000","last_change":"2023-10-06T01:21:40.841506+0000","last_active":"2023-10-06T01:21:40.849984+0000","last_peered":"2023-10-06T01:21:40.849984+0000","last_clean":"2023-10-06T01:21:40.849984+0000","last_became_active":"2023-10-06T01:21:40.840966+0000","last_became_peered":"2023-10-06T01:21:40.840966+0000","last_unstale":"2023-10-06T01:21:40.849984+0000","last_undegraded":"2023-10-06T01:21:40.849984+0000","last_fullsized":"2023-10-06T01:21:40.849984+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:21:39.809888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:21:39.809888+0000","last_clean_scrub_stamp":"2023-10-06T01:21:39.809888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:48:17.365413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5,6],"acting":[2,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"20'1","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T01:21:40.831177+0000","last_change":"2023-10-06T01:21:36.296492+0000","last_active":"2023-10-06T01:21:40.831177+0000","last_peered":"2023-10-06T01:21:40.831177+0000","last_clean":"2023-10-06T01:21:40.831177+0000","last_became_active":"2023-10-06T01:21:36.296064+0000","last_became_peered":"2023-10-06T01:21:36.296064+0000","last_unstale":"2023-10-06T01:21:40.831177+0000","last_undegraded":"2023-10-06T01:21:40.831177+0000","last_fullsized":"2023-10-06T01:21:40.831177+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:21:35.260777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:21:35.260777+0000","last_clean_scrub_stamp":"2023-10-06T01:21:35.260777+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:53:26.082920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T01:21:40.820682+0000","last_change":"2023-10-06T01:21:36.833212+0000","last_active":"2023-10-06T01:21:40.820682+0000","last_peered":"2023-10-06T01:21:40.820682+0000","last_clean":"2023-10-06T01:21:40.820682+0000","last_became_active":"2023-10-06T01:21:36.832753+0000","last_became_peered":"2023-10-06T01:21:36.832753+0000","last_unstale":"2023-10-06T01:21:40.820682+0000","last_undegraded":"2023-10-06T01:21:40.820682+0000","last_fullsized":"2023-10-06T01:21:40.820682+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:21:36.268170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:21:36.268170+0000","last_clean_scrub_stamp":"2023-10-06T01:21:36.268170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:47:05.161793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T01:21:40.839046+0000","last_change":"2023-10-06T01:21:40.837287+0000","last_active":"2023-10-06T01:21:40.839046+0000","last_peered":"2023-10-06T01:21:40.839046+0000","last_clean":"2023-10-06T01:21:40.839046+0000","last_became_active":"2023-10-06T01:21:40.836599+0000","last_became_peered":"2023-10-06T01:21:40.836599+0000","last_unstale":"2023-10-06T01:21:40.839046+0000","last_undegraded":"2023-10-06T01:21:40.839046+0000","last_fullsized":"2023-10-06T01:21:40.839046+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:21:39.809888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:21:39.809888+0000","last_clean_scrub_stamp":"2023-10-06T01:21:39.809888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:51:20.064036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3,6],"acting":[2,4,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T01:21:40.829807+0000","last_change":"2023-10-06T01:21:36.304239+0000","last_active":"2023-10-06T01:21:40.829807+0000","last_peered":"2023-10-06T01:21:40.829807+0000","last_clean":"2023-10-06T01:21:40.829807+0000","last_became_active":"2023-10-06T01:21:36.303858+0000","last_became_peered":"2023-10-06T01:21:36.303858+0000","last_unstale":"2023-10-06T01:21:40.829807+0000","last_undegraded":"2023-10-06T01:21:40.829807+0000","last_fullsized":"2023-10-06T01:21:40.829807+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:21:35.260777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:21:35.260777+0000","last_clean_scrub_stamp":"2023-10-06T01:21:35.260777+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:54:55.305083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T01:21:40.844788+0000","last_change":"2023-10-06T01:21:36.835234+0000","last_active":"2023-10-06T01:21:40.844788+0000","last_peered":"2023-10-06T01:21:40.844788+0000","last_clean":"2023-10-06T01:21:40.844788+0000","last_became_active":"2023-10-06T01:21:36.834751+0000","last_became_peered":"2023-10-06T01:21:36.834751+0000","last_unstale":"2023-10-06T01:21:40.844788+0000","last_undegraded":"2023-10-06T01:21:40.844788+0000","last_fullsized":"2023-10-06T01:21:40.844788+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:21:36.268170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:21:36.268170+0000","last_clean_scrub_stamp":"2023-10-06T01:21:36.268170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:22:57.339224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T01:21:40.848598+0000","last_change":"2023-10-06T01:21:40.839486+0000","last_active":"2023-10-06T01:21:40.848598+0000","last_peered":"2023-10-06T01:21:40.848598+0000","last_clean":"2023-10-06T01:21:40.848598+0000","last_became_active":"2023-10-06T01:21:40.839013+0000","last_became_peered":"2023-10-06T01:21:40.839013+0000","last_unstale":"2023-10-06T01:21:40.848598+0000","last_undegraded":"2023-10-06T01:21:40.848598+0000","last_fullsized":"2023-10-06T01:21:40.848598+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:21:39.809888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:21:39.809888+0000","last_clean_scrub_stamp":"2023-10-06T01:21:39.809888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:44:19.565910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,5,6],"acting":[2,7,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"20'2","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T01:21:40.825787+0000","last_change":"2023-10-06T01:21:36.302862+0000","last_active":"2023-10-06T01:21:40.825787+0000","last_peered":"2023-10-06T01:21:40.825787+0000","last_clean":"2023-10-06T01:21:40.825787+0000","last_became_active":"2023-10-06T01:21:36.302568+0000","last_became_peered":"2023-10-06T01:21:36.302568+0000","last_unstale":"2023-10-06T01:21:40.825787+0000","last_undegraded":"2023-10-06T01:21:40.825787+0000","last_fullsized":"2023-10-06T01:21:40.825787+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:21:35.260777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:21:35.260777+0000","last_clean_scrub_stamp":"2023-10-06T01:21:35.260777+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:54:55.305083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T01:21:40.825801+0000","last_change":"2023-10-06T01:21:36.840041+0000","last_active":"2023-10-06T01:21:40.825801+0000","last_peered":"2023-10-06T01:21:40.825801+0000","last_clean":"2023-10-06T01:21:40.825801+0000","last_became_active":"2023-10-06T01:21:36.839757+0000","last_became_peered":"2023-10-06T01:21:36.839757+0000","last_unstale":"2023-10-06T01:21:40.825801+0000","last_undegraded":"2023-10-06T01:21:40.825801+0000","last_fullsized":"2023-10-06T01:21:40.825801+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:21:36.268170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:21:36.268170+0000","last_clean_scrub_stamp":"2023-10-06T01:21:36.268170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:32:46.966379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T01:21:40.858246+0000","last_change":"2023-10-06T01:21:40.855180+0000","last_active":"2023-10-06T01:21:40.858246+0000","last_peered":"2023-10-06T01:21:40.858246+0000","last_clean":"2023-10-06T01:21:40.858246+0000","last_became_active":"2023-10-06T01:21:40.854696+0000","last_became_peered":"2023-10-06T01:21:40.854696+0000","last_unstale":"2023-10-06T01:21:40.858246+0000","last_undegraded":"2023-10-06T01:21:40.858246+0000","last_fullsized":"2023-10-06T01:21:40.858246+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:21:39.809888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:21:39.809888+0000","last_clean_scrub_stamp":"2023-10-06T01:21:39.809888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:17:23.971056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0,6],"acting":[1,4,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T01:21:40.820767+0000","last_change":"2023-10-06T01:21:36.305613+0000","last_active":"2023-10-06T01:21:40.820767+0000","last_peered":"2023-10-06T01:21:40.820767+0000","last_clean":"2023-10-06T01:21:40.820767+0000","last_became_active":"2023-10-06T01:21:36.305297+0000","last_became_peered":"2023-10-06T01:21:36.305297+0000","last_unstale":"2023-10-06T01:21:40.820767+0000","last_undegraded":"2023-10-06T01:21:40.820767+0000","last_fullsized":"2023-10-06T01:21:40.820767+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:21:35.260777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:21:35.260777+0000","last_clean_scrub_stamp":"2023-10-06T01:21:35.260777+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:03:02.138728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T01:21:40.825239+0000","last_change":"2023-10-06T01:21:36.834711+0000","last_active":"2023-10-06T01:21:40.825239+0000","last_peered":"2023-10-06T01:21:40.825239+0000","last_clean":"2023-10-06T01:21:40.825239+0000","last_became_active":"2023-10-06T01:21:36.833708+0000","last_became_peered":"2023-10-06T01:21:36.833708+0000","last_unstale":"2023-10-06T01:21:40.825239+0000","last_undegraded":"2023-10-06T01:21:40.825239+0000","last_fullsized":"2023-10-06T01:21:40.825239+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:21:36.268170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:21:36.268170+0000","last_clean_scrub_stamp":"2023-10-06T01:21:36.268170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:30:56.051770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T01:21:40.849727+0000","last_change":"2023-10-06T01:21:40.847193+0000","last_active":"2023-10-06T01:21:40.849727+0000","last_peered":"2023-10-06T01:21:40.849727+0000","last_clean":"2023-10-06T01:21:40.849727+0000","last_became_active":"2023-10-06T01:21:40.846404+0000","last_became_peered":"2023-10-06T01:21:40.846404+0000","last_unstale":"2023-10-06T01:21:40.849727+0000","last_undegraded":"2023-10-06T01:21:40.849727+0000","last_fullsized":"2023-10-06T01:21:40.849727+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:21:39.809888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:21:39.809888+0000","last_clean_scrub_stamp":"2023-10-06T01:21:39.809888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:37:36.730320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6,2],"acting":[5,4,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T01:21:40.827525+0000","last_change":"2023-10-06T01:21:36.301030+0000","last_active":"2023-10-06T01:21:40.827525+0000","last_peered":"2023-10-06T01:21:40.827525+0000","last_clean":"2023-10-06T01:21:40.827525+0000","last_became_active":"2023-10-06T01:21:36.300725+0000","last_became_peered":"2023-10-06T01:21:36.300725+0000","last_unstale":"2023-10-06T01:21:40.827525+0000","last_undegraded":"2023-10-06T01:21:40.827525+0000","last_fullsized":"2023-10-06T01:21:40.827525+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:21:35.260777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:21:35.260777+0000","last_clean_scrub_stamp":"2023-10-06T01:21:35.260777+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:33:04.318590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T01:21:40.827164+0000","last_change":"2023-10-06T01:21:36.841950+0000","last_active":"2023-10-06T01:21:40.827164+0000","last_peered":"2023-10-06T01:21:40.827164+0000","last_clean":"2023-10-06T01:21:40.827164+0000","last_became_active":"2023-10-06T01:21:36.841666+0000","last_became_peered":"2023-10-06T01:21:36.841666+0000","last_unstale":"2023-10-06T01:21:40.827164+0000","last_undegraded":"2023-10-06T01:21:40.827164+0000","last_fullsized":"2023-10-06T01:21:40.827164+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:21:36.268170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:21:36.268170+0000","last_clean_scrub_stamp":"2023-10-06T01:21:36.268170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:48:35.151895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T01:21:40.851364+0000","last_change":"2023-10-06T01:21:40.843838+0000","last_active":"2023-10-06T01:21:40.851364+0000","last_peered":"2023-10-06T01:21:40.851364+0000","last_clean":"2023-10-06T01:21:40.851364+0000","last_became_active":"2023-10-06T01:21:40.843470+0000","last_became_peered":"2023-10-06T01:21:40.843470+0000","last_unstale":"2023-10-06T01:21:40.851364+0000","last_undegraded":"2023-10-06T01:21:40.851364+0000","last_fullsized":"2023-10-06T01:21:40.851364+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:21:39.809888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:21:39.809888+0000","last_clean_scrub_stamp":"2023-10-06T01:21:39.809888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:49:27.574363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,0,2],"acting":[4,5,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T01:21:40.825329+0000","last_change":"2023-10-06T01:21:36.306829+0000","last_active":"2023-10-06T01:21:40.825329+0000","last_peered":"2023-10-06T01:21:40.825329+0000","last_clean":"2023-10-06T01:21:40.825329+0000","last_became_active":"2023-10-06T01:21:36.306636+0000","last_became_peered":"2023-10-06T01:21:36.306636+0000","last_unstale":"2023-10-06T01:21:40.825329+0000","last_undegraded":"2023-10-06T01:21:40.825329+0000","last_fullsized":"2023-10-06T01:21:40.825329+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:21:35.260777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:21:35.260777+0000","last_clean_scrub_stamp":"2023-10-06T01:21:35.260777+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:13:12.787972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T01:21:40.825013+0000","last_change":"2023-10-06T01:21:36.827181+0000","last_active":"2023-10-06T01:21:40.825013+0000","last_peered":"2023-10-06T01:21:40.825013+0000","last_clean":"2023-10-06T01:21:40.825013+0000","last_became_active":"2023-10-06T01:21:36.826926+0000","last_became_peered":"2023-10-06T01:21:36.826926+0000","last_unstale":"2023-10-06T01:21:40.825013+0000","last_undegraded":"2023-10-06T01:21:40.825013+0000","last_fullsized":"2023-10-06T01:21:40.825013+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:21:36.268170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:21:36.268170+0000","last_clean_scrub_stamp":"2023-10-06T01:21:36.268170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:50:38.966977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T01:21:40.848984+0000","last_change":"2023-10-06T01:21:40.842824+0000","last_active":"2023-10-06T01:21:40.848984+0000","last_peered":"2023-10-06T01:21:40.848984+0000","last_clean":"2023-10-06T01:21:40.848984+0000","last_became_active":"2023-10-06T01:21:40.842426+0000","last_became_peered":"2023-10-06T01:21:40.842426+0000","last_unstale":"2023-10-06T01:21:40.848984+0000","last_undegraded":"2023-10-06T01:21:40.848984+0000","last_fullsized":"2023-10-06T01:21:40.848984+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:21:39.809888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:21:39.809888+0000","last_clean_scrub_stamp":"2023-10-06T01:21:39.809888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:12:51.722789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,7,0],"acting":[4,3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"20'2","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T01:21:40.824298+0000","last_change":"2023-10-06T01:21:36.302700+0000","last_active":"2023-10-06T01:21:40.824298+0000","last_peered":"2023-10-06T01:21:40.824298+0000","last_clean":"2023-10-06T01:21:40.824298+0000","last_became_active":"2023-10-06T01:21:36.302436+0000","last_became_peered":"2023-10-06T01:21:36.302436+0000","last_unstale":"2023-10-06T01:21:40.824298+0000","last_undegraded":"2023-10-06T01:21:40.824298+0000","last_fullsized":"2023-10-06T01:21:40.824298+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:21:35.260777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:21:35.260777+0000","last_clean_scrub_stamp":"2023-10-06T01:21:35.260777+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:28:28.246900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T01:21:40.825404+0000","last_change":"2023-10-06T01:21:30.601117+0000","last_active":"2023-10-06T01:21:40.825404+0000","last_peered":"2023-10-06T01:21:40.825404+0000","last_clean":"2023-10-06T01:21:40.825404+0000","last_became_active":"2023-10-06T01:21:30.600724+0000","last_became_peered":"2023-10-06T01:21:30.600724+0000","last_unstale":"2023-10-06T01:21:40.825404+0000","last_undegraded":"2023-10-06T01:21:40.825404+0000","last_fullsized":"2023-10-06T01:21:40.825404+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:21:29.586558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:21:29.586558+0000","last_clean_scrub_stamp":"2023-10-06T01:21:29.586558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:47:24.449013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T01:21:40.825234+0000","last_change":"2023-10-06T01:21:36.824653+0000","last_active":"2023-10-06T01:21:40.825234+0000","last_peered":"2023-10-06T01:21:40.825234+0000","last_clean":"2023-10-06T01:21:40.825234+0000","last_became_active":"2023-10-06T01:21:36.824411+0000","last_became_peered":"2023-10-06T01:21:36.824411+0000","last_unstale":"2023-10-06T01:21:40.825234+0000","last_undegraded":"2023-10-06T01:21:40.825234+0000","last_fullsized":"2023-10-06T01:21:40.825234+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:21:36.268170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:21:36.268170+0000","last_clean_scrub_stamp":"2023-10-06T01:21:36.268170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:22:57.339224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T01:21:40.863893+0000","last_change":"2023-10-06T01:21:40.862887+0000","last_active":"2023-10-06T01:21:40.863893+0000","last_peered":"2023-10-06T01:21:40.863893+0000","last_clean":"2023-10-06T01:21:40.863893+0000","last_became_active":"2023-10-06T01:21:40.862455+0000","last_became_peered":"2023-10-06T01:21:40.862455+0000","last_unstale":"2023-10-06T01:21:40.863893+0000","last_undegraded":"2023-10-06T01:21:40.863893+0000","last_fullsized":"2023-10-06T01:21:40.863893+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:21:39.809888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:21:39.809888+0000","last_clean_scrub_stamp":"2023-10-06T01:21:39.809888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:31:58.220361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,0],"acting":[3,1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T01:21:40.823254+0000","last_change":"2023-10-06T01:21:30.603434+0000","last_active":"2023-10-06T01:21:40.823254+0000","last_peered":"2023-10-06T01:21:40.823254+0000","last_clean":"2023-10-06T01:21:40.823254+0000","last_became_active":"2023-10-06T01:21:30.603215+0000","last_became_peered":"2023-10-06T01:21:30.603215+0000","last_unstale":"2023-10-06T01:21:40.823254+0000","last_undegraded":"2023-10-06T01:21:40.823254+0000","last_fullsized":"2023-10-06T01:21:40.823254+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:21:29.586558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:21:29.586558+0000","last_clean_scrub_stamp":"2023-10-06T01:21:29.586558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:47:24.449013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"23'1","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T01:21:40.840164+0000","last_change":"2023-10-06T01:21:36.314457+0000","last_active":"2023-10-06T01:21:40.840164+0000","last_peered":"2023-10-06T01:21:40.840164+0000","last_clean":"2023-10-06T01:21:40.840164+0000","last_became_active":"2023-10-06T01:21:36.314115+0000","last_became_peered":"2023-10-06T01:21:36.314115+0000","last_unstale":"2023-10-06T01:21:40.840164+0000","last_undegraded":"2023-10-06T01:21:40.840164+0000","last_fullsized":"2023-10-06T01:21:40.840164+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:21:35.260777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:21:35.260777+0000","last_clean_scrub_stamp":"2023-10-06T01:21:35.260777+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:54:55.305083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T01:21:40.827608+0000","last_change":"2023-10-06T01:21:36.834738+0000","last_active":"2023-10-06T01:21:40.827608+0000","last_peered":"2023-10-06T01:21:40.827608+0000","last_clean":"2023-10-06T01:21:40.827608+0000","last_became_active":"2023-10-06T01:21:36.830039+0000","last_became_peered":"2023-10-06T01:21:36.830039+0000","last_unstale":"2023-10-06T01:21:40.827608+0000","last_undegraded":"2023-10-06T01:21:40.827608+0000","last_fullsized":"2023-10-06T01:21:40.827608+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:21:36.268170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:21:36.268170+0000","last_clean_scrub_stamp":"2023-10-06T01:21:36.268170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:32:53.580584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T01:21:40.849746+0000","last_change":"2023-10-06T01:21:40.847419+0000","last_active":"2023-10-06T01:21:40.849746+0000","last_peered":"2023-10-06T01:21:40.849746+0000","last_clean":"2023-10-06T01:21:40.849746+0000","last_became_active":"2023-10-06T01:21:40.847033+0000","last_became_peered":"2023-10-06T01:21:40.847033+0000","last_unstale":"2023-10-06T01:21:40.849746+0000","last_undegraded":"2023-10-06T01:21:40.849746+0000","last_fullsized":"2023-10-06T01:21:40.849746+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:21:39.809888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:21:39.809888+0000","last_clean_scrub_stamp":"2023-10-06T01:21:39.809888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:48:34.766396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0,4],"acting":[5,1,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T01:21:40.824624+0000","last_change":"2023-10-06T01:21:30.604889+0000","last_active":"2023-10-06T01:21:40.824624+0000","last_peered":"2023-10-06T01:21:40.824624+0000","last_clean":"2023-10-06T01:21:40.824624+0000","last_became_active":"2023-10-06T01:21:30.604535+0000","last_became_peered":"2023-10-06T01:21:30.604535+0000","last_unstale":"2023-10-06T01:21:40.824624+0000","last_undegraded":"2023-10-06T01:21:40.824624+0000","last_fullsized":"2023-10-06T01:21:40.824624+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:21:29.586558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:21:29.586558+0000","last_clean_scrub_stamp":"2023-10-06T01:21:29.586558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:17:59.434982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"17'117","reported_seq":167,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T01:21:40.832005+0000","last_change":"2023-10-06T01:21:31.602437+0000","last_active":"2023-10-06T01:21:40.832005+0000","last_peered":"2023-10-06T01:21:40.832005+0000","last_clean":"2023-10-06T01:21:40.832005+0000","last_became_active":"2023-10-06T01:21:31.601431+0000","last_became_peered":"2023-10-06T01:21:31.601431+0000","last_unstale":"2023-10-06T01:21:40.832005+0000","last_undegraded":"2023-10-06T01:21:40.832005+0000","last_fullsized":"2023-10-06T01:21:40.832005+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:21:30.589171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:21:30.589171+0000","last_clean_scrub_stamp":"2023-10-06T01:21:30.589171+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T01:48:45.877807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T01:21:40.840247+0000","last_change":"2023-10-06T01:21:36.308132+0000","last_active":"2023-10-06T01:21:40.840247+0000","last_peered":"2023-10-06T01:21:40.840247+0000","last_clean":"2023-10-06T01:21:40.840247+0000","last_became_active":"2023-10-06T01:21:36.307806+0000","last_became_peered":"2023-10-06T01:21:36.307806+0000","last_unstale":"2023-10-06T01:21:40.840247+0000","last_undegraded":"2023-10-06T01:21:40.840247+0000","last_fullsized":"2023-10-06T01:21:40.840247+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:21:35.260777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:21:35.260777+0000","last_clean_scrub_stamp":"2023-10-06T01:21:35.260777+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:48:19.919262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T01:21:40.842645+0000","last_change":"2023-10-06T01:21:36.835445+0000","last_active":"2023-10-06T01:21:40.842645+0000","last_peered":"2023-10-06T01:21:40.842645+0000","last_clean":"2023-10-06T01:21:40.842645+0000","last_became_active":"2023-10-06T01:21:36.834925+0000","last_became_peered":"2023-10-06T01:21:36.834925+0000","last_unstale":"2023-10-06T01:21:40.842645+0000","last_undegraded":"2023-10-06T01:21:40.842645+0000","last_fullsized":"2023-10-06T01:21:40.842645+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:21:36.268170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:21:36.268170+0000","last_clean_scrub_stamp":"2023-10-06T01:21:36.268170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:48:35.151895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T01:21:40.840299+0000","last_change":"2023-10-06T01:21:40.838204+0000","last_active":"2023-10-06T01:21:40.840299+0000","last_peered":"2023-10-06T01:21:40.840299+0000","last_clean":"2023-10-06T01:21:40.840299+0000","last_became_active":"2023-10-06T01:21:40.837815+0000","last_became_peered":"2023-10-06T01:21:40.837815+0000","last_unstale":"2023-10-06T01:21:40.840299+0000","last_undegraded":"2023-10-06T01:21:40.840299+0000","last_fullsized":"2023-10-06T01:21:40.840299+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:21:39.809888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:21:39.809888+0000","last_clean_scrub_stamp":"2023-10-06T01:21:39.809888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:21:10.391252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,1,7],"acting":[2,5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T01:21:40.830958+0000","last_change":"2023-10-06T01:21:31.338236+0000","last_active":"2023-10-06T01:21:40.830958+0000","last_peered":"2023-10-06T01:21:40.830958+0000","last_clean":"2023-10-06T01:21:40.830958+0000","last_became_active":"2023-10-06T01:21:31.337918+0000","last_became_peered":"2023-10-06T01:21:31.337918+0000","last_unstale":"2023-10-06T01:21:40.830958+0000","last_undegraded":"2023-10-06T01:21:40.830958+0000","last_fullsized":"2023-10-06T01:21:40.830958+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:21:29.586558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:21:29.586558+0000","last_clean_scrub_stamp":"2023-10-06T01:21:29.586558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:02:13.010488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T01:21:40.826976+0000","last_change":"2023-10-06T01:21:36.309135+0000","last_active":"2023-10-06T01:21:40.826976+0000","last_peered":"2023-10-06T01:21:40.826976+0000","last_clean":"2023-10-06T01:21:40.826976+0000","last_became_active":"2023-10-06T01:21:36.300992+0000","last_became_peered":"2023-10-06T01:21:36.300992+0000","last_unstale":"2023-10-06T01:21:40.826976+0000","last_undegraded":"2023-10-06T01:21:40.826976+0000","last_fullsized":"2023-10-06T01:21:40.826976+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:21:35.260777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:21:35.260777+0000","last_clean_scrub_stamp":"2023-10-06T01:21:35.260777+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:33:04.318590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T01:21:40.824922+0000","last_change":"2023-10-06T01:21:36.825744+0000","last_active":"2023-10-06T01:21:40.824922+0000","last_peered":"2023-10-06T01:21:40.824922+0000","last_clean":"2023-10-06T01:21:40.824922+0000","last_became_active":"2023-10-06T01:21:36.825474+0000","last_became_peered":"2023-10-06T01:21:36.825474+0000","last_unstale":"2023-10-06T01:21:40.824922+0000","last_undegraded":"2023-10-06T01:21:40.824922+0000","last_fullsized":"2023-10-06T01:21:40.824922+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:21:36.268170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:21:36.268170+0000","last_clean_scrub_stamp":"2023-10-06T01:21:36.268170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:01:50.180814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T01:21:40.842542+0000","last_change":"2023-10-06T01:21:40.839804+0000","last_active":"2023-10-06T01:21:40.842542+0000","last_peered":"2023-10-06T01:21:40.842542+0000","last_clean":"2023-10-06T01:21:40.842542+0000","last_became_active":"2023-10-06T01:21:40.838895+0000","last_became_peered":"2023-10-06T01:21:40.838895+0000","last_unstale":"2023-10-06T01:21:40.842542+0000","last_undegraded":"2023-10-06T01:21:40.842542+0000","last_fullsized":"2023-10-06T01:21:40.842542+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:21:39.809888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:21:39.809888+0000","last_clean_scrub_stamp":"2023-10-06T01:21:39.809888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:37:36.730320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,5,3],"acting":[7,2,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T01:21:40.831878+0000","last_change":"2023-10-06T01:21:31.338209+0000","last_active":"2023-10-06T01:21:40.831878+0000","last_peered":"2023-10-06T01:21:40.831878+0000","last_clean":"2023-10-06T01:21:40.831878+0000","last_became_active":"2023-10-06T01:21:31.337870+0000","last_became_peered":"2023-10-06T01:21:31.337870+0000","last_unstale":"2023-10-06T01:21:40.831878+0000","last_undegraded":"2023-10-06T01:21:40.831878+0000","last_fullsized":"2023-10-06T01:21:40.831878+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:21:29.586558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:21:29.586558+0000","last_clean_scrub_stamp":"2023-10-06T01:21:29.586558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:53:47.117299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T01:21:40.823530+0000","last_change":"2023-10-06T01:21:36.300292+0000","last_active":"2023-10-06T01:21:40.823530+0000","last_peered":"2023-10-06T01:21:40.823530+0000","last_clean":"2023-10-06T01:21:40.823530+0000","last_became_active":"2023-10-06T01:21:36.299999+0000","last_became_peered":"2023-10-06T01:21:36.299999+0000","last_unstale":"2023-10-06T01:21:40.823530+0000","last_undegraded":"2023-10-06T01:21:40.823530+0000","last_fullsized":"2023-10-06T01:21:40.823530+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:21:35.260777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:21:35.260777+0000","last_clean_scrub_stamp":"2023-10-06T01:21:35.260777+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:46:13.974439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T01:21:40.820907+0000","last_change":"2023-10-06T01:21:36.839337+0000","last_active":"2023-10-06T01:21:40.820907+0000","last_peered":"2023-10-06T01:21:40.820907+0000","last_clean":"2023-10-06T01:21:40.820907+0000","last_became_active":"2023-10-06T01:21:36.831706+0000","last_became_peered":"2023-10-06T01:21:36.831706+0000","last_unstale":"2023-10-06T01:21:40.820907+0000","last_undegraded":"2023-10-06T01:21:40.820907+0000","last_fullsized":"2023-10-06T01:21:40.820907+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:21:36.268170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:21:36.268170+0000","last_clean_scrub_stamp":"2023-10-06T01:21:36.268170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:01:50.180814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T01:21:40.861012+0000","last_change":"2023-10-06T01:21:40.858510+0000","last_active":"2023-10-06T01:21:40.861012+0000","last_peered":"2023-10-06T01:21:40.861012+0000","last_clean":"2023-10-06T01:21:40.861012+0000","last_became_active":"2023-10-06T01:21:40.858081+0000","last_became_peered":"2023-10-06T01:21:40.858081+0000","last_unstale":"2023-10-06T01:21:40.861012+0000","last_undegraded":"2023-10-06T01:21:40.861012+0000","last_fullsized":"2023-10-06T01:21:40.861012+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:21:39.809888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:21:39.809888+0000","last_clean_scrub_stamp":"2023-10-06T01:21:39.809888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:37:36.730320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,6],"acting":[0,1,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T01:21:40.829308+0000","last_change":"2023-10-06T01:21:31.338177+0000","last_active":"2023-10-06T01:21:40.829308+0000","last_peered":"2023-10-06T01:21:40.829308+0000","last_clean":"2023-10-06T01:21:40.829308+0000","last_became_active":"2023-10-06T01:21:31.337872+0000","last_became_peered":"2023-10-06T01:21:31.337872+0000","last_unstale":"2023-10-06T01:21:40.829308+0000","last_undegraded":"2023-10-06T01:21:40.829308+0000","last_fullsized":"2023-10-06T01:21:40.829308+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:21:29.586558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:21:29.586558+0000","last_clean_scrub_stamp":"2023-10-06T01:21:29.586558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:17:59.434982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T01:21:40.826747+0000","last_change":"2023-10-06T01:21:36.304934+0000","last_active":"2023-10-06T01:21:40.826747+0000","last_peered":"2023-10-06T01:21:40.826747+0000","last_clean":"2023-10-06T01:21:40.826747+0000","last_became_active":"2023-10-06T01:21:36.304472+0000","last_became_peered":"2023-10-06T01:21:36.304472+0000","last_unstale":"2023-10-06T01:21:40.826747+0000","last_undegraded":"2023-10-06T01:21:40.826747+0000","last_fullsized":"2023-10-06T01:21:40.826747+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:21:35.260777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:21:35.260777+0000","last_clean_scrub_stamp":"2023-10-06T01:21:35.260777+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:54:55.305083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T01:21:40.825749+0000","last_change":"2023-10-06T01:21:36.814330+0000","last_active":"2023-10-06T01:21:40.825749+0000","last_peered":"2023-10-06T01:21:40.825749+0000","last_clean":"2023-10-06T01:21:40.825749+0000","last_became_active":"2023-10-06T01:21:36.814069+0000","last_became_peered":"2023-10-06T01:21:36.814069+0000","last_unstale":"2023-10-06T01:21:40.825749+0000","last_undegraded":"2023-10-06T01:21:40.825749+0000","last_fullsized":"2023-10-06T01:21:40.825749+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:21:36.268170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:21:36.268170+0000","last_clean_scrub_stamp":"2023-10-06T01:21:36.268170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:26:27.490800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T01:21:40.854566+0000","last_change":"2023-10-06T01:21:40.849926+0000","last_active":"2023-10-06T01:21:40.854566+0000","last_peered":"2023-10-06T01:21:40.854566+0000","last_clean":"2023-10-06T01:21:40.854566+0000","last_became_active":"2023-10-06T01:21:40.849188+0000","last_became_peered":"2023-10-06T01:21:40.849188+0000","last_unstale":"2023-10-06T01:21:40.854566+0000","last_undegraded":"2023-10-06T01:21:40.854566+0000","last_fullsized":"2023-10-06T01:21:40.854566+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:21:39.809888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:21:39.809888+0000","last_clean_scrub_stamp":"2023-10-06T01:21:39.809888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:21:10.391252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5,2],"acting":[6,0,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T01:21:40.820997+0000","last_change":"2023-10-06T01:21:31.338181+0000","last_active":"2023-10-06T01:21:40.820997+0000","last_peered":"2023-10-06T01:21:40.820997+0000","last_clean":"2023-10-06T01:21:40.820997+0000","last_became_active":"2023-10-06T01:21:31.337820+0000","last_became_peered":"2023-10-06T01:21:31.337820+0000","last_unstale":"2023-10-06T01:21:40.820997+0000","last_undegraded":"2023-10-06T01:21:40.820997+0000","last_fullsized":"2023-10-06T01:21:40.820997+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:21:29.586558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:21:29.586558+0000","last_clean_scrub_stamp":"2023-10-06T01:21:29.586558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:44:49.740873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T01:21:40.825927+0000","last_change":"2023-10-06T01:21:36.309352+0000","last_active":"2023-10-06T01:21:40.825927+0000","last_peered":"2023-10-06T01:21:40.825927+0000","last_clean":"2023-10-06T01:21:40.825927+0000","last_became_active":"2023-10-06T01:21:36.308864+0000","last_became_peered":"2023-10-06T01:21:36.308864+0000","last_unstale":"2023-10-06T01:21:40.825927+0000","last_undegraded":"2023-10-06T01:21:40.825927+0000","last_fullsized":"2023-10-06T01:21:40.825927+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:21:35.260777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:21:35.260777+0000","last_clean_scrub_stamp":"2023-10-06T01:21:35.260777+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:48:42.234958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T01:21:40.844152+0000","last_change":"2023-10-06T01:21:36.835013+0000","last_active":"2023-10-06T01:21:40.844152+0000","last_peered":"2023-10-06T01:21:40.844152+0000","last_clean":"2023-10-06T01:21:40.844152+0000","last_became_active":"2023-10-06T01:21:36.834427+0000","last_became_peered":"2023-10-06T01:21:36.834427+0000","last_unstale":"2023-10-06T01:21:40.844152+0000","last_undegraded":"2023-10-06T01:21:40.844152+0000","last_fullsized":"2023-10-06T01:21:40.844152+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:21:36.268170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:21:36.268170+0000","last_clean_scrub_stamp":"2023-10-06T01:21:36.268170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:28:15.885944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T01:21:40.858145+0000","last_change":"2023-10-06T01:21:40.857260+0000","last_active":"2023-10-06T01:21:40.858145+0000","last_peered":"2023-10-06T01:21:40.858145+0000","last_clean":"2023-10-06T01:21:40.858145+0000","last_became_active":"2023-10-06T01:21:40.856823+0000","last_became_peered":"2023-10-06T01:21:40.856823+0000","last_unstale":"2023-10-06T01:21:40.858145+0000","last_undegraded":"2023-10-06T01:21:40.858145+0000","last_fullsized":"2023-10-06T01:21:40.858145+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:21:39.809888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:21:39.809888+0000","last_clean_scrub_stamp":"2023-10-06T01:21:39.809888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:26:15.414115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,6,5],"acting":[0,1,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T01:21:40.821025+0000","last_change":"2023-10-06T01:21:30.604007+0000","last_active":"2023-10-06T01:21:40.821025+0000","last_peered":"2023-10-06T01:21:40.821025+0000","last_clean":"2023-10-06T01:21:40.821025+0000","last_became_active":"2023-10-06T01:21:30.603673+0000","last_became_peered":"2023-10-06T01:21:30.603673+0000","last_unstale":"2023-10-06T01:21:40.821025+0000","last_undegraded":"2023-10-06T01:21:40.821025+0000","last_fullsized":"2023-10-06T01:21:40.821025+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:21:29.586558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:21:29.586558+0000","last_clean_scrub_stamp":"2023-10-06T01:21:29.586558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:53:47.117299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T01:21:40.830136+0000","last_change":"2023-10-06T01:21:36.302956+0000","last_active":"2023-10-06T01:21:40.830136+0000","last_peered":"2023-10-06T01:21:40.830136+0000","last_clean":"2023-10-06T01:21:40.830136+0000","last_became_active":"2023-10-06T01:21:36.302668+0000","last_became_peered":"2023-10-06T01:21:36.302668+0000","last_unstale":"2023-10-06T01:21:40.830136+0000","last_undegraded":"2023-10-06T01:21:40.830136+0000","last_fullsized":"2023-10-06T01:21:40.830136+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:21:35.260777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:21:35.260777+0000","last_clean_scrub_stamp":"2023-10-06T01:21:35.260777+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:46:13.974439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T01:21:40.825330+0000","last_change":"2023-10-06T01:21:36.825472+0000","last_active":"2023-10-06T01:21:40.825330+0000","last_peered":"2023-10-06T01:21:40.825330+0000","last_clean":"2023-10-06T01:21:40.825330+0000","last_became_active":"2023-10-06T01:21:36.825199+0000","last_became_peered":"2023-10-06T01:21:36.825199+0000","last_unstale":"2023-10-06T01:21:40.825330+0000","last_undegraded":"2023-10-06T01:21:40.825330+0000","last_fullsized":"2023-10-06T01:21:40.825330+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:21:36.268170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:21:36.268170+0000","last_clean_scrub_stamp":"2023-10-06T01:21:36.268170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:53:27.090314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T01:21:40.858038+0000","last_change":"2023-10-06T01:21:40.855138+0000","last_active":"2023-10-06T01:21:40.858038+0000","last_peered":"2023-10-06T01:21:40.858038+0000","last_clean":"2023-10-06T01:21:40.858038+0000","last_became_active":"2023-10-06T01:21:40.854323+0000","last_became_peered":"2023-10-06T01:21:40.854323+0000","last_unstale":"2023-10-06T01:21:40.858038+0000","last_undegraded":"2023-10-06T01:21:40.858038+0000","last_fullsized":"2023-10-06T01:21:40.858038+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:21:39.809888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:21:39.809888+0000","last_clean_scrub_stamp":"2023-10-06T01:21:39.809888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:48:17.365413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,0],"acting":[1,3,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"20'1","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T01:21:40.844060+0000","last_change":"2023-10-06T01:21:36.308100+0000","last_active":"2023-10-06T01:21:40.844060+0000","last_peered":"2023-10-06T01:21:40.844060+0000","last_clean":"2023-10-06T01:21:40.844060+0000","last_became_active":"2023-10-06T01:21:36.307829+0000","last_became_peered":"2023-10-06T01:21:36.307829+0000","last_unstale":"2023-10-06T01:21:40.844060+0000","last_undegraded":"2023-10-06T01:21:40.844060+0000","last_fullsized":"2023-10-06T01:21:40.844060+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:21:35.260777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:21:35.260777+0000","last_clean_scrub_stamp":"2023-10-06T01:21:35.260777+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:46:13.974439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T01:21:40.817731+0000","last_change":"2023-10-06T01:21:36.820796+0000","last_active":"2023-10-06T01:21:40.817731+0000","last_peered":"2023-10-06T01:21:40.817731+0000","last_clean":"2023-10-06T01:21:40.817731+0000","last_became_active":"2023-10-06T01:21:36.820534+0000","last_became_peered":"2023-10-06T01:21:36.820534+0000","last_unstale":"2023-10-06T01:21:40.817731+0000","last_undegraded":"2023-10-06T01:21:40.817731+0000","last_fullsized":"2023-10-06T01:21:40.817731+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:21:36.268170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:21:36.268170+0000","last_clean_scrub_stamp":"2023-10-06T01:21:36.268170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:13:13.795366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T01:21:40.849961+0000","last_change":"2023-10-06T01:21:40.846085+0000","last_active":"2023-10-06T01:21:40.849961+0000","last_peered":"2023-10-06T01:21:40.849961+0000","last_clean":"2023-10-06T01:21:40.849961+0000","last_became_active":"2023-10-06T01:21:40.845695+0000","last_became_peered":"2023-10-06T01:21:40.845695+0000","last_unstale":"2023-10-06T01:21:40.849961+0000","last_undegraded":"2023-10-06T01:21:40.849961+0000","last_fullsized":"2023-10-06T01:21:40.849961+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:21:39.809888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:21:39.809888+0000","last_clean_scrub_stamp":"2023-10-06T01:21:39.809888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:05:45.908197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1,6],"acting":[7,4,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"20'2","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T01:21:40.829667+0000","last_change":"2023-10-06T01:21:36.307782+0000","last_active":"2023-10-06T01:21:40.829667+0000","last_peered":"2023-10-06T01:21:40.829667+0000","last_clean":"2023-10-06T01:21:40.829667+0000","last_became_active":"2023-10-06T01:21:36.307601+0000","last_became_peered":"2023-10-06T01:21:36.307601+0000","last_unstale":"2023-10-06T01:21:40.829667+0000","last_undegraded":"2023-10-06T01:21:40.829667+0000","last_fullsized":"2023-10-06T01:21:40.829667+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:21:35.260777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:21:35.260777+0000","last_clean_scrub_stamp":"2023-10-06T01:21:35.260777+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:03:02.138728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T01:21:40.826897+0000","last_change":"2023-10-06T01:21:36.840272+0000","last_active":"2023-10-06T01:21:40.826897+0000","last_peered":"2023-10-06T01:21:40.826897+0000","last_clean":"2023-10-06T01:21:40.826897+0000","last_became_active":"2023-10-06T01:21:36.839957+0000","last_became_peered":"2023-10-06T01:21:36.839957+0000","last_unstale":"2023-10-06T01:21:40.826897+0000","last_undegraded":"2023-10-06T01:21:40.826897+0000","last_fullsized":"2023-10-06T01:21:40.826897+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:21:36.268170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:21:36.268170+0000","last_clean_scrub_stamp":"2023-10-06T01:21:36.268170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:48:13.823695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T01:21:40.849688+0000","last_change":"2023-10-06T01:21:40.848222+0000","last_active":"2023-10-06T01:21:40.849688+0000","last_peered":"2023-10-06T01:21:40.849688+0000","last_clean":"2023-10-06T01:21:40.849688+0000","last_became_active":"2023-10-06T01:21:40.847832+0000","last_became_peered":"2023-10-06T01:21:40.847832+0000","last_unstale":"2023-10-06T01:21:40.849688+0000","last_undegraded":"2023-10-06T01:21:40.849688+0000","last_fullsized":"2023-10-06T01:21:40.849688+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:21:39.809888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:21:39.809888+0000","last_clean_scrub_stamp":"2023-10-06T01:21:39.809888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:06:39.429127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,7,4],"acting":[5,0,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1d","version":"20'2","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T01:21:40.830053+0000","last_change":"2023-10-06T01:21:36.307610+0000","last_active":"2023-10-06T01:21:40.830053+0000","last_peered":"2023-10-06T01:21:40.830053+0000","last_clean":"2023-10-06T01:21:40.830053+0000","last_became_active":"2023-10-06T01:21:36.306937+0000","last_became_peered":"2023-10-06T01:21:36.306937+0000","last_unstale":"2023-10-06T01:21:40.830053+0000","last_undegraded":"2023-10-06T01:21:40.830053+0000","last_fullsized":"2023-10-06T01:21:40.830053+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:21:35.260777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:21:35.260777+0000","last_clean_scrub_stamp":"2023-10-06T01:21:35.260777+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:48:19.919262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T01:21:40.824396+0000","last_change":"2023-10-06T01:21:36.840502+0000","last_active":"2023-10-06T01:21:40.824396+0000","last_peered":"2023-10-06T01:21:40.824396+0000","last_clean":"2023-10-06T01:21:40.824396+0000","last_became_active":"2023-10-06T01:21:36.840237+0000","last_became_peered":"2023-10-06T01:21:36.840237+0000","last_unstale":"2023-10-06T01:21:40.824396+0000","last_undegraded":"2023-10-06T01:21:40.824396+0000","last_fullsized":"2023-10-06T01:21:40.824396+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:21:36.268170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:21:36.268170+0000","last_clean_scrub_stamp":"2023-10-06T01:21:36.268170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:03:40.763134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T01:21:40.844533+0000","last_change":"2023-10-06T01:21:40.835338+0000","last_active":"2023-10-06T01:21:40.844533+0000","last_peered":"2023-10-06T01:21:40.844533+0000","last_clean":"2023-10-06T01:21:40.844533+0000","last_became_active":"2023-10-06T01:21:40.834902+0000","last_became_peered":"2023-10-06T01:21:40.834902+0000","last_unstale":"2023-10-06T01:21:40.844533+0000","last_undegraded":"2023-10-06T01:21:40.844533+0000","last_fullsized":"2023-10-06T01:21:40.844533+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:21:39.809888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:21:39.809888+0000","last_clean_scrub_stamp":"2023-10-06T01:21:39.809888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:04:16.001332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,2],"acting":[4,6,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"20'1","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T01:21:40.824449+0000","last_change":"2023-10-06T01:21:36.296572+0000","last_active":"2023-10-06T01:21:40.824449+0000","last_peered":"2023-10-06T01:21:40.824449+0000","last_clean":"2023-10-06T01:21:40.824449+0000","last_became_active":"2023-10-06T01:21:36.295666+0000","last_became_peered":"2023-10-06T01:21:36.295666+0000","last_unstale":"2023-10-06T01:21:40.824449+0000","last_undegraded":"2023-10-06T01:21:40.824449+0000","last_fullsized":"2023-10-06T01:21:40.824449+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:21:35.260777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:21:35.260777+0000","last_clean_scrub_stamp":"2023-10-06T01:21:35.260777+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:48:19.919262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T01:21:40.824070+0000","last_change":"2023-10-06T01:21:36.822907+0000","last_active":"2023-10-06T01:21:40.824070+0000","last_peered":"2023-10-06T01:21:40.824070+0000","last_clean":"2023-10-06T01:21:40.824070+0000","last_became_active":"2023-10-06T01:21:36.822537+0000","last_became_peered":"2023-10-06T01:21:36.822537+0000","last_unstale":"2023-10-06T01:21:40.824070+0000","last_undegraded":"2023-10-06T01:21:40.824070+0000","last_fullsized":"2023-10-06T01:21:40.824070+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:21:36.268170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:21:36.268170+0000","last_clean_scrub_stamp":"2023-10-06T01:21:36.268170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:53:49.542750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T01:21:40.856008+0000","last_change":"2023-10-06T01:21:40.845375+0000","last_active":"2023-10-06T01:21:40.856008+0000","last_peered":"2023-10-06T01:21:40.856008+0000","last_clean":"2023-10-06T01:21:40.856008+0000","last_became_active":"2023-10-06T01:21:40.845079+0000","last_became_peered":"2023-10-06T01:21:40.845079+0000","last_unstale":"2023-10-06T01:21:40.856008+0000","last_undegraded":"2023-10-06T01:21:40.856008+0000","last_fullsized":"2023-10-06T01:21:40.856008+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:21:39.809888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:21:39.809888+0000","last_clean_scrub_stamp":"2023-10-06T01:21:39.809888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:32:57.122301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,7,2],"acting":[1,5,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1f","version":"20'4","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T01:21:40.843463+0000","last_change":"2023-10-06T01:21:36.299553+0000","last_active":"2023-10-06T01:21:40.843463+0000","last_peered":"2023-10-06T01:21:40.843463+0000","last_clean":"2023-10-06T01:21:40.843463+0000","last_became_active":"2023-10-06T01:21:36.298968+0000","last_became_peered":"2023-10-06T01:21:36.298968+0000","last_unstale":"2023-10-06T01:21:40.843463+0000","last_undegraded":"2023-10-06T01:21:40.843463+0000","last_fullsized":"2023-10-06T01:21:40.843463+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:21:35.260777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:21:35.260777+0000","last_clean_scrub_stamp":"2023-10-06T01:21:35.260777+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:33:04.318590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T01:21:40.824895+0000","last_change":"2023-10-06T01:21:36.844505+0000","last_active":"2023-10-06T01:21:40.824895+0000","last_peered":"2023-10-06T01:21:40.824895+0000","last_clean":"2023-10-06T01:21:40.824895+0000","last_became_active":"2023-10-06T01:21:36.843624+0000","last_became_peered":"2023-10-06T01:21:36.843624+0000","last_unstale":"2023-10-06T01:21:40.824895+0000","last_undegraded":"2023-10-06T01:21:40.824895+0000","last_fullsized":"2023-10-06T01:21:40.824895+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:21:36.268170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:21:36.268170+0000","last_clean_scrub_stamp":"2023-10-06T01:21:36.268170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:59:29.172295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T01:21:40.820462+0000","last_change":"2023-10-06T01:21:36.832253+0000","last_active":"2023-10-06T01:21:40.820462+0000","last_peered":"2023-10-06T01:21:40.820462+0000","last_clean":"2023-10-06T01:21:40.820462+0000","last_became_active":"2023-10-06T01:21:36.824011+0000","last_became_peered":"2023-10-06T01:21:36.824011+0000","last_unstale":"2023-10-06T01:21:40.820462+0000","last_undegraded":"2023-10-06T01:21:40.820462+0000","last_fullsized":"2023-10-06T01:21:40.820462+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:21:36.268170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:21:36.268170+0000","last_clean_scrub_stamp":"2023-10-06T01:21:36.268170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:50:38.966977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T01:21:40.823808+0000","last_change":"2023-10-06T01:21:36.826465+0000","last_active":"2023-10-06T01:21:40.823808+0000","last_peered":"2023-10-06T01:21:40.823808+0000","last_clean":"2023-10-06T01:21:40.823808+0000","last_became_active":"2023-10-06T01:21:36.826146+0000","last_became_peered":"2023-10-06T01:21:36.826146+0000","last_unstale":"2023-10-06T01:21:40.823808+0000","last_undegraded":"2023-10-06T01:21:40.823808+0000","last_fullsized":"2023-10-06T01:21:40.823808+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:21:36.268170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:21:36.268170+0000","last_clean_scrub_stamp":"2023-10-06T01:21:36.268170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:28:15.885944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T01:21:40.824625+0000","last_change":"2023-10-06T01:21:36.834310+0000","last_active":"2023-10-06T01:21:40.824625+0000","last_peered":"2023-10-06T01:21:40.824625+0000","last_clean":"2023-10-06T01:21:40.824625+0000","last_became_active":"2023-10-06T01:21:36.834048+0000","last_became_peered":"2023-10-06T01:21:36.834048+0000","last_unstale":"2023-10-06T01:21:40.824625+0000","last_undegraded":"2023-10-06T01:21:40.824625+0000","last_fullsized":"2023-10-06T01:21:40.824625+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:21:36.268170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:21:36.268170+0000","last_clean_scrub_stamp":"2023-10-06T01:21:36.268170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:25:42.902143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T01:21:40.826182+0000","last_change":"2023-10-06T01:21:36.830563+0000","last_active":"2023-10-06T01:21:40.826182+0000","last_peered":"2023-10-06T01:21:40.826182+0000","last_clean":"2023-10-06T01:21:40.826182+0000","last_became_active":"2023-10-06T01:21:36.830334+0000","last_became_peered":"2023-10-06T01:21:36.830334+0000","last_unstale":"2023-10-06T01:21:40.826182+0000","last_undegraded":"2023-10-06T01:21:40.826182+0000","last_fullsized":"2023-10-06T01:21:40.826182+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:21:36.268170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:21:36.268170+0000","last_clean_scrub_stamp":"2023-10-06T01:21:36.268170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:26:07.073491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T01:21:40.825831+0000","last_change":"2023-10-06T01:21:36.828863+0000","last_active":"2023-10-06T01:21:40.825831+0000","last_peered":"2023-10-06T01:21:40.825831+0000","last_clean":"2023-10-06T01:21:40.825831+0000","last_became_active":"2023-10-06T01:21:36.828318+0000","last_became_peered":"2023-10-06T01:21:36.828318+0000","last_unstale":"2023-10-06T01:21:40.825831+0000","last_undegraded":"2023-10-06T01:21:40.825831+0000","last_fullsized":"2023-10-06T01:21:40.825831+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:21:36.268170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:21:36.268170+0000","last_clean_scrub_stamp":"2023-10-06T01:21:36.268170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:27:54.680295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":4484,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":8968,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574857,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298156,"kb_used_data":868,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073684,"statfs":{"total":96636764160,"available":96331452416,"internally_reserved":0,"allocated":888832,"data_stored":703756,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77000000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71799999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.751}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88700000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46500000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48799999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64300000000000002}]}]},{"osd":6,"up_from":13,"seq":55834574857,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297548,"kb_used_data":260,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074292,"statfs":{"total":96636764160,"available":96332075008,"internally_reserved":0,"allocated":266240,"data_stored":109458,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65700000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72699999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68600000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70299999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67600000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55400000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80600000000000005}]}]},{"osd":1,"up_from":13,"seq":55834574855,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302220,"kb_used_data":836,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069620,"statfs":{"total":96636764160,"available":96327290880,"internally_reserved":0,"allocated":856064,"data_stored":698848,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48199999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38800000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50600000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71099999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.748}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79200000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77900000000000003}]}]},{"osd":0,"up_from":13,"seq":55834574856,"num_pgs":47,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301644,"kb_used_data":260,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94070196,"statfs":{"total":96636764160,"available":96327880704,"internally_reserved":0,"allocated":266240,"data_stored":109034,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32700000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58899999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45400000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59999999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67500000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69999999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73199999999999998}]}]},{"osd":2,"up_from":13,"seq":55834574855,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301644,"kb_used_data":260,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94070196,"statfs":{"total":96636764160,"available":96327880704,"internally_reserved":0,"allocated":266240,"data_stored":109458,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40000000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47399999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64400000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82799999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95599999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97999999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84899999999999998}]}]},{"osd":3,"up_from":13,"seq":55834574855,"num_pgs":48,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301648,"kb_used_data":264,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94070192,"statfs":{"total":96636764160,"available":96327876608,"internally_reserved":0,"allocated":270336,"data_stored":109548,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.43099999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46700000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45200000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1080000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95899999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.131}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0309999999999999}]}]},{"osd":4,"up_from":13,"seq":55834574855,"num_pgs":50,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297568,"kb_used_data":280,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074272,"statfs":{"total":96636764160,"available":96332054528,"internally_reserved":0,"allocated":286720,"data_stored":113228,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38600000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40500000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50900000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60299999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80200000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71299999999999997}]}]},{"osd":5,"up_from":13,"seq":55834574857,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297552,"kb_used_data":264,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074288,"statfs":{"total":96636764160,"available":96332070912,"internally_reserved":0,"allocated":270336,"data_stored":109104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68400000000000005}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79100000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77500000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58399999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.628}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46500000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.438}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":3770,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":624,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":3930,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-06T01:22:00.718 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-10-06T01:22:00.718 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2023-10-06T01:22:00.718 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2023-10-06T01:22:00.718 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2023-10-06T01:22:00.719 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2023-10-06T01:22:00.940 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:00.938+0000 7f8222d9d700 1 Processor -- start 2023-10-06T01:22:00.941 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:00.939+0000 7f8222d9d700 1 -- start start 2023-10-06T01:22:00.942 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:00.940+0000 7f8222d9d700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f821c1597a0 0x7f821c0aad40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:00.942 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:00.940+0000 7f8222d9d700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f821c06a160 0x7f821c0ab280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:00.942 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:00.940+0000 7f8222d9d700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f821c068700 con 0x7f821c1593d0 2023-10-06T01:22:00.942 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:00.940+0000 7f8222d9d700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f821c068cc0 con 0x7f821c06a160 2023-10-06T01:22:00.942 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:00.940+0000 7f8222d9d700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f821c0ad130 con 0x7f821c1597a0 2023-10-06T01:22:00.942 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:00.940+0000 7f8221d9b700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f821c1593d0 0x7f821c0ac920 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:40208/0 (socket says 172.21.15.50:40208) 2023-10-06T01:22:00.942 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:00.940+0000 7f8221d9b700 1 -- 172.21.15.50:0/348855279 learned_addr learned my addr 172.21.15.50:0/348855279 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-10-06T01:22:00.945 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:00.940+0000 7f822159a700 1 --2- 172.21.15.50:0/348855279 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f821c1597a0 0x7f821c0aad40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:00.945 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:00.941+0000 7f822259c700 1 --2- 172.21.15.50:0/348855279 >> v2:172.21.15.155:3300/0 conn(0x7f821c06a160 0x7f821c0ab280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:00.945 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:00.941+0000 7f8220d99700 1 -- 172.21.15.50:0/348855279 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1568570989 0 0) 0x7f821c068700 con 0x7f821c1593d0 2023-10-06T01:22:00.945 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:00.941+0000 7f8220d99700 1 -- 172.21.15.50:0/348855279 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8208003570 con 0x7f821c1593d0 2023-10-06T01:22:00.945 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:00.941+0000 7f8220d99700 1 -- 172.21.15.50:0/348855279 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4107589957 0 0) 0x7f8208003570 con 0x7f821c1593d0 2023-10-06T01:22:00.946 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:00.941+0000 7f8220d99700 1 -- 172.21.15.50:0/348855279 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f821c1597a0 msgr2=0x7f821c0aad40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:22:00.946 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:00.941+0000 7f8220d99700 1 --2- 172.21.15.50:0/348855279 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f821c1597a0 0x7f821c0aad40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:00.946 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:00.941+0000 7f8220d99700 1 -- 172.21.15.50:0/348855279 >> v2:172.21.15.155:3300/0 conn(0x7f821c06a160 msgr2=0x7f821c0ab280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:22:00.946 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:00.941+0000 7f8220d99700 1 --2- 172.21.15.50:0/348855279 >> v2:172.21.15.155:3300/0 conn(0x7f821c06a160 0x7f821c0ab280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:00.946 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:00.941+0000 7f8220d99700 1 -- 172.21.15.50:0/348855279 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f821c0ad410 con 0x7f821c1593d0 2023-10-06T01:22:00.946 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:00.941+0000 7f8220d99700 1 -- 172.21.15.50:0/348855279 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 347519148 0 0) 0x7f8218001470 con 0x7f821c1593d0 2023-10-06T01:22:00.946 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:00.941+0000 7f8220d99700 1 -- 172.21.15.50:0/348855279 >> v1:172.21.15.50:6789/0 conn(0x7f821c1593d0 legacy=0x7f821c0ac920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:00.946 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:00.941+0000 7f8220d99700 1 --2- 172.21.15.50:0/348855279 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8208003a60 0x7f8208003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:00.946 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:00.941+0000 7f8220d99700 1 --2- 172.21.15.50:0/348855279 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8208004810 0x7f8208004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:00.946 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:00.941+0000 7f8220d99700 1 --2- 172.21.15.50:0/348855279 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f821c1597a0 0x7f82080051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:00.946 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:00.941+0000 7f8220d99700 1 -- 172.21.15.50:0/348855279 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f821c068cc0 con 0x7f8208004810 2023-10-06T01:22:00.947 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:00.941+0000 7f8220d99700 1 -- 172.21.15.50:0/348855279 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f821c0ad130 con 0x7f8208003a60 2023-10-06T01:22:00.947 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:00.941+0000 7f8220d99700 1 -- 172.21.15.50:0/348855279 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f820800ba60 con 0x7f821c1597a0 2023-10-06T01:22:00.947 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:00.941+0000 7f822159a700 1 --2- 172.21.15.50:0/348855279 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8208004810 0x7f8208004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:00.947 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:00.941+0000 7f8221d9b700 1 --2- 172.21.15.50:0/348855279 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8208003a60 0x7f8208003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:00.947 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:00.942+0000 7f822259c700 1 --2- 172.21.15.50:0/348855279 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f821c1597a0 0x7f82080051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:00.947 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:00.942+0000 7f822159a700 1 -- 172.21.15.50:0/348855279 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f821c1597a0 msgr2=0x7f82080051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:22:00.947 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:00.942+0000 7f822159a700 1 --2- 172.21.15.50:0/348855279 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f821c1597a0 0x7f82080051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:00.947 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:00.942+0000 7f822159a700 1 -- 172.21.15.50:0/348855279 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8208003a60 msgr2=0x7f8208003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:22:00.947 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:00.942+0000 7f822159a700 1 --2- 172.21.15.50:0/348855279 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8208003a60 0x7f8208003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:00.947 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:00.942+0000 7f822159a700 1 -- 172.21.15.50:0/348855279 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8208003570 con 0x7f8208004810 2023-10-06T01:22:00.947 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:00.942+0000 7f822159a700 1 --2- 172.21.15.50:0/348855279 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8208004810 0x7f8208004c80 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f820c009c00 tx=0x7f820c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f8bfc116073fe3a6 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:22:00.947 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:00.942+0000 7f8220d99700 1 -- 172.21.15.50:0/348855279 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f820c00e710 con 0x7f8208004810 2023-10-06T01:22:00.948 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:00.942+0000 7f8220d99700 1 -- 172.21.15.50:0/348855279 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f820c00e870 con 0x7f8208004810 2023-10-06T01:22:00.948 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:00.942+0000 7f8220d99700 1 -- 172.21.15.50:0/348855279 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f820c00ec30 con 0x7f8208004810 2023-10-06T01:22:00.948 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:00.943+0000 7f8222d9d700 1 -- 172.21.15.50:0/348855279 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8208004810 msgr2=0x7f8208004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:00.948 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:00.943+0000 7f8222d9d700 1 --2- 172.21.15.50:0/348855279 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8208004810 0x7f8208004c80 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f820c009c00 tx=0x7f820c0091a0 comp rx=0 tx=0).stop 2023-10-06T01:22:00.948 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:00.943+0000 7f822259c700 1 -- 172.21.15.50:0/348855279 reap_dead start 2023-10-06T01:22:00.948 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:00.943+0000 7f8222d9d700 1 -- 172.21.15.50:0/348855279 shutdown_connections 2023-10-06T01:22:00.948 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:00.943+0000 7f8222d9d700 1 -- 172.21.15.50:0/348855279 >> 172.21.15.50:0/348855279 conn(0x7f821c097450 msgr2=0x7f821c067dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:22:00.948 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:00.943+0000 7f8222d9d700 1 -- 172.21.15.50:0/348855279 shutdown_connections 2023-10-06T01:22:00.948 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:00.943+0000 7f8222d9d700 1 -- 172.21.15.50:0/348855279 wait complete. 2023-10-06T01:22:00.951 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:00.944+0000 7f8222d9d700 1 Processor -- start 2023-10-06T01:22:00.951 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:00.945+0000 7f8222d9d700 1 -- start start 2023-10-06T01:22:00.951 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:00.945+0000 7f8222d9d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8208004810 0x7f821c0b2220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:00.951 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:00.946+0000 7f8222d9d700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f821c15cad0 0x7f821c14b9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:00.951 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:00.946+0000 7f8222d9d700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f821c15a7d0 0x7f821c16d3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:00.951 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:00.946+0000 7f8222d9d700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f821c15b130 con 0x7f8208004810 2023-10-06T01:22:00.951 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:00.946+0000 7f8222d9d700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f821c1537e0 con 0x7f821c15a7d0 2023-10-06T01:22:00.951 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:00.946+0000 7f8222d9d700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f821c153ac0 con 0x7f821c15cad0 2023-10-06T01:22:00.951 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:00.946+0000 7f8221d9b700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8208004810 0x7f821c0b2220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:00.951 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:00.946+0000 7f8221d9b700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8208004810 0x7f821c0b2220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:47988/0 (socket says 172.21.15.50:47988) 2023-10-06T01:22:00.952 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:00.946+0000 7f8221d9b700 1 -- 172.21.15.50:0/1477007719 learned_addr learned my addr 172.21.15.50:0/1477007719 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-06T01:22:00.952 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:00.946+0000 7f822159a700 1 --2- 172.21.15.50:0/1477007719 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f821c15cad0 0x7f821c14b9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:00.952 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:00.946+0000 7f822259c700 1 --2- 172.21.15.50:0/1477007719 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f821c15a7d0 0x7f821c16d3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:00.952 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:00.946+0000 7f8221d9b700 1 -- 172.21.15.50:0/1477007719 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f821c15cad0 msgr2=0x7f821c14b9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:00.952 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:00.946+0000 7f8221d9b700 1 --2- 172.21.15.50:0/1477007719 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f821c15cad0 0x7f821c14b9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:00.952 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:00.946+0000 7f8221d9b700 1 -- 172.21.15.50:0/1477007719 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f821c15a7d0 msgr2=0x7f821c16d3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:00.952 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:00.946+0000 7f8221d9b700 1 --2- 172.21.15.50:0/1477007719 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f821c15a7d0 0x7f821c16d3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:00.952 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:00.946+0000 7f8221d9b700 1 -- 172.21.15.50:0/1477007719 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f821c153da0 con 0x7f8208004810 2023-10-06T01:22:00.952 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:00.946+0000 7f822259c700 1 --2- 172.21.15.50:0/1477007719 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f821c15a7d0 0x7f821c16d3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T01:22:00.952 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:00.946+0000 7f822159a700 1 --2- 172.21.15.50:0/1477007719 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f821c15cad0 0x7f821c14b9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T01:22:00.952 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:00.946+0000 7f8221d9b700 1 --2- 172.21.15.50:0/1477007719 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8208004810 0x7f821c0b2220 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f8218001050 tx=0x7f8218001e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:22:00.952 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:00.947+0000 7f8211ffb700 1 -- 172.21.15.50:0/1477007719 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f821800f8d0 con 0x7f8208004810 2023-10-06T01:22:00.953 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:00.947+0000 7f8211ffb700 1 -- 172.21.15.50:0/1477007719 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f821800fa50 con 0x7f8208004810 2023-10-06T01:22:00.953 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:00.947+0000 7f8211ffb700 1 -- 172.21.15.50:0/1477007719 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f821800fe10 con 0x7f8208004810 2023-10-06T01:22:00.953 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:00.947+0000 7f8222d9d700 1 -- 172.21.15.50:0/1477007719 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f821c1534f0 con 0x7f8208004810 2023-10-06T01:22:00.953 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:00.947+0000 7f8222d9d700 1 -- 172.21.15.50:0/1477007719 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f821c15ac50 con 0x7f8208004810 2023-10-06T01:22:00.953 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:00.948+0000 7f8222d9d700 1 -- 172.21.15.50:0/1477007719 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f821c153f90 con 0x7f8208004810 2023-10-06T01:22:00.953 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:00.949+0000 7f8211ffb700 1 -- 172.21.15.50:0/1477007719 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f8218013600 con 0x7f8208004810 2023-10-06T01:22:00.954 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:00.949+0000 7f8211ffb700 1 --2- 172.21.15.50:0/1477007719 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f8200066f30 0x7f82000693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:00.954 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:00.950+0000 7f8211ffb700 1 -- 172.21.15.50:0/1477007719 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f8218084c70 con 0x7f8208004810 2023-10-06T01:22:00.954 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:00.950+0000 7f822159a700 1 --2- 172.21.15.50:0/1477007719 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f8200066f30 0x7f82000693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:00.954 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:00.951+0000 7f822159a700 1 --2- 172.21.15.50:0/1477007719 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f8200066f30 0x7f82000693e0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f821c152780 tx=0x7f820c01a000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:22:00.955 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:00.953+0000 7f8211ffb700 1 -- 172.21.15.50:0/1477007719 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f82180519f0 con 0x7f8208004810 2023-10-06T01:22:01.211 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:01.209+0000 7f8222d9d700 1 -- 172.21.15.50:0/1477007719 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7f821c05f270 con 0x7f8208004810 2023-10-06T01:22:01.214 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:01.212+0000 7f8211ffb700 1 -- 172.21.15.50:0/1477007719 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) v1 ==== 74+0+163705 (secure 0 0 0) 0x7f8218055010 con 0x7f8208004810 2023-10-06T01:22:01.216 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-10-06T01:22:01.218 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:01.215+0000 7f8222d9d700 1 -- 172.21.15.50:0/1477007719 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f8200066f30 msgr2=0x7f82000693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:01.218 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:01.215+0000 7f8222d9d700 1 --2- 172.21.15.50:0/1477007719 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f8200066f30 0x7f82000693e0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f821c152780 tx=0x7f820c01a000 comp rx=0 tx=0).stop 2023-10-06T01:22:01.218 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:01.215+0000 7f8222d9d700 1 -- 172.21.15.50:0/1477007719 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8208004810 msgr2=0x7f821c0b2220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:01.218 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:01.215+0000 7f8222d9d700 1 --2- 172.21.15.50:0/1477007719 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8208004810 0x7f821c0b2220 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f8218001050 tx=0x7f8218001e90 comp rx=0 tx=0).stop 2023-10-06T01:22:01.218 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:01.216+0000 7f8222d9d700 1 -- 172.21.15.50:0/1477007719 shutdown_connections 2023-10-06T01:22:01.218 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:01.216+0000 7f8222d9d700 1 --2- 172.21.15.50:0/1477007719 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f8200066f30 0x7f82000693e0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:01.218 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:01.216+0000 7f8222d9d700 1 --2- 172.21.15.50:0/1477007719 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f821c15a7d0 0x7f821c16d3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:01.218 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:01.216+0000 7f8222d9d700 1 --2- 172.21.15.50:0/1477007719 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8208004810 0x7f821c0b2220 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:01.218 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:01.216+0000 7f8222d9d700 1 --2- 172.21.15.50:0/1477007719 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f821c15cad0 0x7f821c14b9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:01.218 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:01.216+0000 7f8222d9d700 1 -- 172.21.15.50:0/1477007719 >> 172.21.15.50:0/1477007719 conn(0x7f821c097450 msgr2=0x7f821c157380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:22:01.218 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:01.216+0000 7f8222d9d700 1 -- 172.21.15.50:0/1477007719 shutdown_connections 2023-10-06T01:22:01.219 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:01.216+0000 7f8222d9d700 1 -- 172.21.15.50:0/1477007719 wait complete. 2023-10-06T01:22:01.235 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":5,"active_gid":4099,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6832","nonce":85215},{"type":"v1","addr":"172.21.15.155:6833","nonce":85215}]},"active_addr":"172.21.15.155:6833/85215","active_change":"2023-10-06T01:21:23.751170+0000","active_mgr_features":4540138320759226367,"available":true,"standbys":[{"gid":4107,"name":"y","mgr_features":4540138320759226367,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.1.5","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.1.5","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.155:0","nonce":1731381792}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.155:0","nonce":558307430}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.155:0","nonce":3051516842}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.155:0","nonce":1557688504}]}]} 2023-10-06T01:22:01.239 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2023-10-06T01:22:01.239 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2023-10-06T01:22:01.239 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T01:22:01.426 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:01.424+0000 7f116739d700 1 Processor -- start 2023-10-06T01:22:01.426 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:01.424+0000 7f116739d700 1 -- start start 2023-10-06T01:22:01.428 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:01.426+0000 7f116739d700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f11600cb5e0 0x7f11600cb9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:01.428 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:01.426+0000 7f116739d700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f116006f350 0x7f116006d630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:01.429 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:01.426+0000 7f116739d700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f116006db70 0x7f1160159490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:01.429 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:01.426+0000 7f116739d700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f116006ec00 con 0x7f116006f350 2023-10-06T01:22:01.429 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:01.426+0000 7f116739d700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f116006e080 con 0x7f116006db70 2023-10-06T01:22:01.429 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:01.426+0000 7f116739d700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f116006e360 con 0x7f11600cb5e0 2023-10-06T01:22:01.429 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:01.426+0000 7f1165b9a700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f116006f350 0x7f116006d630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:01.429 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:01.426+0000 7f1165b9a700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f116006f350 0x7f116006d630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:47998/0 (socket says 172.21.15.50:47998) 2023-10-06T01:22:01.429 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:01.426+0000 7f1165b9a700 1 -- 172.21.15.50:0/2873485619 learned_addr learned my addr 172.21.15.50:0/2873485619 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-06T01:22:01.429 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:01.426+0000 7f116639b700 1 --2- 172.21.15.50:0/2873485619 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f11600cb5e0 0x7f11600cb9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:01.429 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:01.426+0000 7f1166b9c700 1 --2- 172.21.15.50:0/2873485619 >> v2:172.21.15.155:3300/0 conn(0x7f116006db70 0x7f1160159490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:01.429 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:01.426+0000 7f1165b9a700 1 -- 172.21.15.50:0/2873485619 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f11600cb5e0 msgr2=0x7f11600cb9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:22:01.430 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:01.426+0000 7f1165b9a700 1 --2- 172.21.15.50:0/2873485619 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f11600cb5e0 0x7f11600cb9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:01.430 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:01.426+0000 7f1165b9a700 1 -- 172.21.15.50:0/2873485619 >> v2:172.21.15.155:3300/0 conn(0x7f116006db70 msgr2=0x7f1160159490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:22:01.430 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:01.426+0000 7f1165b9a700 1 --2- 172.21.15.50:0/2873485619 >> v2:172.21.15.155:3300/0 conn(0x7f116006db70 0x7f1160159490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:01.430 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:01.427+0000 7f1165b9a700 1 -- 172.21.15.50:0/2873485619 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f116006e640 con 0x7f116006f350 2023-10-06T01:22:01.430 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:01.427+0000 7f1165b9a700 1 --2- 172.21.15.50:0/2873485619 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f116006f350 0x7f116006d630 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f11600c64d0 tx=0x7f1150009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6370cfd978fa0f9e server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:22:01.431 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:01.427+0000 7f1165399700 1 -- 172.21.15.50:0/2873485619 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f115000b640 con 0x7f116006f350 2023-10-06T01:22:01.431 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:01.427+0000 7f1165399700 1 -- 172.21.15.50:0/2873485619 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f115000b7a0 con 0x7f116006f350 2023-10-06T01:22:01.431 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:01.427+0000 7f1165399700 1 -- 172.21.15.50:0/2873485619 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f115000bb60 con 0x7f116006f350 2023-10-06T01:22:01.431 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:01.428+0000 7f116739d700 1 -- 172.21.15.50:0/2873485619 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f116006f350 msgr2=0x7f116006d630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:01.432 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:01.428+0000 7f116739d700 1 --2- 172.21.15.50:0/2873485619 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f116006f350 0x7f116006d630 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f11600c64d0 tx=0x7f1150009250 comp rx=0 tx=0).stop 2023-10-06T01:22:01.432 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:01.428+0000 7f116739d700 1 -- 172.21.15.50:0/2873485619 shutdown_connections 2023-10-06T01:22:01.432 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:01.428+0000 7f116739d700 1 --2- 172.21.15.50:0/2873485619 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f11600cb5e0 0x7f11600cb9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:01.432 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:01.428+0000 7f116739d700 1 --2- 172.21.15.50:0/2873485619 >> v2:172.21.15.155:3300/0 conn(0x7f116006db70 0x7f1160159490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:01.432 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:01.428+0000 7f116739d700 1 --2- 172.21.15.50:0/2873485619 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f116006f350 0x7f116006d630 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:01.432 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:01.428+0000 7f116739d700 1 -- 172.21.15.50:0/2873485619 >> 172.21.15.50:0/2873485619 conn(0x7f11600680c0 msgr2=0x7f11600cbf00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:22:01.432 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:01.428+0000 7f116739d700 1 -- 172.21.15.50:0/2873485619 shutdown_connections 2023-10-06T01:22:01.432 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:01.428+0000 7f116739d700 1 -- 172.21.15.50:0/2873485619 wait complete. 2023-10-06T01:22:01.432 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:01.429+0000 7f116739d700 1 Processor -- start 2023-10-06T01:22:01.432 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:01.429+0000 7f116739d700 1 -- start start 2023-10-06T01:22:01.434 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:01.430+0000 7f116739d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f116006db70 0x7f11600ac4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:01.434 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:01.430+0000 7f116739d700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f11600cb5e0 0x7f116016dd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:01.434 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:01.430+0000 7f116739d700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f11600addc0 0x7f11600c25c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:01.434 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:01.430+0000 7f116739d700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f116016e260 con 0x7f116006db70 2023-10-06T01:22:01.434 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:01.430+0000 7f116739d700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11600ac040 con 0x7f11600addc0 2023-10-06T01:22:01.434 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:01.430+0000 7f116739d700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f11600ae330 con 0x7f11600cb5e0 2023-10-06T01:22:01.434 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:01.431+0000 7f116639b700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f116006db70 0x7f11600ac4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:01.434 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:01.431+0000 7f116639b700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f116006db70 0x7f11600ac4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:48010/0 (socket says 172.21.15.50:48010) 2023-10-06T01:22:01.435 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:01.431+0000 7f116639b700 1 -- 172.21.15.50:0/1456106095 learned_addr learned my addr 172.21.15.50:0/1456106095 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-06T01:22:01.435 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:01.431+0000 7f1165b9a700 1 --2- 172.21.15.50:0/1456106095 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f11600cb5e0 0x7f116016dd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:01.435 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:01.431+0000 7f1166b9c700 1 --2- 172.21.15.50:0/1456106095 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f11600addc0 0x7f11600c25c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:01.435 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:01.431+0000 7f116639b700 1 -- 172.21.15.50:0/1456106095 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f11600cb5e0 msgr2=0x7f116016dd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:01.435 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:01.431+0000 7f116639b700 1 --2- 172.21.15.50:0/1456106095 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f11600cb5e0 0x7f116016dd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:01.435 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:01.431+0000 7f116639b700 1 -- 172.21.15.50:0/1456106095 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f11600addc0 msgr2=0x7f11600c25c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:01.435 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:01.431+0000 7f116639b700 1 --2- 172.21.15.50:0/1456106095 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f11600addc0 0x7f11600c25c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:01.435 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:01.431+0000 7f116639b700 1 -- 172.21.15.50:0/1456106095 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11500094f0 con 0x7f116006db70 2023-10-06T01:22:01.435 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:01.431+0000 7f116639b700 1 --2- 172.21.15.50:0/1456106095 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f116006db70 0x7f11600ac4d0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f115c00ec80 tx=0x7f115c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:22:01.435 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:01.431+0000 7f11567fc700 1 -- 172.21.15.50:0/1456106095 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f115c00c9d0 con 0x7f116006db70 2023-10-06T01:22:01.435 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:01.431+0000 7f11567fc700 1 -- 172.21.15.50:0/1456106095 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f115c00cb50 con 0x7f116006db70 2023-10-06T01:22:01.435 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:01.431+0000 7f11567fc700 1 -- 172.21.15.50:0/1456106095 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f115c013470 con 0x7f116006db70 2023-10-06T01:22:01.436 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:01.431+0000 7f116739d700 1 -- 172.21.15.50:0/1456106095 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f11600ae610 con 0x7f116006db70 2023-10-06T01:22:01.436 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:01.432+0000 7f116739d700 1 -- 172.21.15.50:0/1456106095 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f11600abcd0 con 0x7f116006db70 2023-10-06T01:22:01.436 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:01.433+0000 7f116739d700 1 -- 172.21.15.50:0/1456106095 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f116005f270 con 0x7f116006db70 2023-10-06T01:22:01.437 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:01.433+0000 7f11567fc700 1 -- 172.21.15.50:0/1456106095 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f115c013860 con 0x7f116006db70 2023-10-06T01:22:01.437 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:01.434+0000 7f11567fc700 1 --2- 172.21.15.50:0/1456106095 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f1144066f30 0x7f11440693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:01.437 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:01.434+0000 7f11567fc700 1 -- 172.21.15.50:0/1456106095 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f115c084df0 con 0x7f116006db70 2023-10-06T01:22:01.437 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:01.435+0000 7f1165b9a700 1 --2- 172.21.15.50:0/1456106095 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f1144066f30 0x7f11440693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:01.437 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:01.436+0000 7f1165b9a700 1 --2- 172.21.15.50:0/1456106095 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f1144066f30 0x7f11440693e0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f11600c64d0 tx=0x7f1150017000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:22:01.440 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:01.438+0000 7f11567fc700 1 -- 172.21.15.50:0/1456106095 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f115c051b70 con 0x7f116006db70 2023-10-06T01:22:01.642 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:01.641+0000 7f116739d700 1 -- 172.21.15.50:0/1456106095 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f11600ac320 con 0x7f116006db70 2023-10-06T01:22:01.644 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:01.642+0000 7f11567fc700 1 -- 172.21.15.50:0/1456106095 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+18707 (secure 0 0 0) 0x7f115c055190 con 0x7f116006db70 2023-10-06T01:22:01.644 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-10-06T01:22:01.644 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":25,"fsid":"0bfd9a6b-1587-4fe4-a89e-e43c00286b4e","created":"2023-10-06T01:21:16.828801+0000","modified":"2023-10-06T01:21:41.329781+0000","last_up_change":"2023-10-06T01:21:28.584523+0000","last_in_change":"2023-10-06T01:21:20.179863+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-10-06T01:21:29.304225+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":".mgr","create_time":"2023-10-06T01:21:29.835490+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-06T01:21:34.675315+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-06T01:21:35.753991+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-10-06T01:21:38.853108+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"9060727a-3959-4de3-8363-c5c5d7826c9a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":87837},{"type":"v1","addr":"172.21.15.50:6801","nonce":87837}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":87837},{"type":"v1","addr":"172.21.15.50:6803","nonce":87837}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":87837},{"type":"v1","addr":"172.21.15.50:6807","nonce":87837}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":87837},{"type":"v1","addr":"172.21.15.50:6805","nonce":87837}]},"public_addr":"172.21.15.50:6801/87837","cluster_addr":"172.21.15.50:6803/87837","heartbeat_back_addr":"172.21.15.50:6807/87837","heartbeat_front_addr":"172.21.15.50:6805/87837","state":["exists","up"]},{"osd":1,"uuid":"5ad9ef12-b579-47ea-b690-90ba887e2cef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":87853},{"type":"v1","addr":"172.21.15.50:6809","nonce":87853}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":87853},{"type":"v1","addr":"172.21.15.50:6811","nonce":87853}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":87853},{"type":"v1","addr":"172.21.15.50:6815","nonce":87853}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":87853},{"type":"v1","addr":"172.21.15.50:6813","nonce":87853}]},"public_addr":"172.21.15.50:6809/87853","cluster_addr":"172.21.15.50:6811/87853","heartbeat_back_addr":"172.21.15.50:6815/87853","heartbeat_front_addr":"172.21.15.50:6813/87853","state":["exists","up"]},{"osd":2,"uuid":"c7aee044-6f75-436f-90e1-ba42a57359bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6821","nonce":87855},{"type":"v1","addr":"172.21.15.50:6822","nonce":87855}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6824","nonce":87855},{"type":"v1","addr":"172.21.15.50:6826","nonce":87855}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":87855},{"type":"v1","addr":"172.21.15.50:6831","nonce":87855}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":87855},{"type":"v1","addr":"172.21.15.50:6829","nonce":87855}]},"public_addr":"172.21.15.50:6822/87855","cluster_addr":"172.21.15.50:6826/87855","heartbeat_back_addr":"172.21.15.50:6831/87855","heartbeat_front_addr":"172.21.15.50:6829/87855","state":["exists","up"]},{"osd":3,"uuid":"d9b901c8-e8b2-44af-9508-f453120a96c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":87856},{"type":"v1","addr":"172.21.15.50:6817","nonce":87856}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":87856},{"type":"v1","addr":"172.21.15.50:6819","nonce":87856}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6825","nonce":87856},{"type":"v1","addr":"172.21.15.50:6827","nonce":87856}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6820","nonce":87856},{"type":"v1","addr":"172.21.15.50:6823","nonce":87856}]},"public_addr":"172.21.15.50:6817/87856","cluster_addr":"172.21.15.50:6819/87856","heartbeat_back_addr":"172.21.15.50:6827/87856","heartbeat_front_addr":"172.21.15.50:6823/87856","state":["exists","up"]},{"osd":4,"uuid":"2b3c6b38-e3e9-4301-9445-60fd3fe8ce03","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":85805},{"type":"v1","addr":"172.21.15.155:6801","nonce":85805}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":85805},{"type":"v1","addr":"172.21.15.155:6803","nonce":85805}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6806","nonce":85805},{"type":"v1","addr":"172.21.15.155:6807","nonce":85805}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6804","nonce":85805},{"type":"v1","addr":"172.21.15.155:6805","nonce":85805}]},"public_addr":"172.21.15.155:6801/85805","cluster_addr":"172.21.15.155:6803/85805","heartbeat_back_addr":"172.21.15.155:6807/85805","heartbeat_front_addr":"172.21.15.155:6805/85805","state":["exists","up"]},{"osd":5,"uuid":"417b5f8f-65f1-4c94-91a7-a6ce03fe1679","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6816","nonce":85807},{"type":"v1","addr":"172.21.15.155:6818","nonce":85807}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6820","nonce":85807},{"type":"v1","addr":"172.21.15.155:6822","nonce":85807}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6828","nonce":85807},{"type":"v1","addr":"172.21.15.155:6830","nonce":85807}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6824","nonce":85807},{"type":"v1","addr":"172.21.15.155:6826","nonce":85807}]},"public_addr":"172.21.15.155:6818/85807","cluster_addr":"172.21.15.155:6822/85807","heartbeat_back_addr":"172.21.15.155:6830/85807","heartbeat_front_addr":"172.21.15.155:6826/85807","state":["exists","up"]},{"osd":6,"uuid":"c150cff3-aee4-4714-9c08-d182b1ba9ffd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6808","nonce":85806},{"type":"v1","addr":"172.21.15.155:6809","nonce":85806}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6810","nonce":85806},{"type":"v1","addr":"172.21.15.155:6811","nonce":85806}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6814","nonce":85806},{"type":"v1","addr":"172.21.15.155:6815","nonce":85806}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6812","nonce":85806},{"type":"v1","addr":"172.21.15.155:6813","nonce":85806}]},"public_addr":"172.21.15.155:6809/85806","cluster_addr":"172.21.15.155:6811/85806","heartbeat_back_addr":"172.21.15.155:6815/85806","heartbeat_front_addr":"172.21.15.155:6813/85806","state":["exists","up"]},{"osd":7,"uuid":"71107f0e-04d1-4e72-a0ec-0faf6af003e7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6817","nonce":85832},{"type":"v1","addr":"172.21.15.155:6819","nonce":85832}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6821","nonce":85832},{"type":"v1","addr":"172.21.15.155:6823","nonce":85832}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6829","nonce":85832},{"type":"v1","addr":"172.21.15.155:6831","nonce":85832}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6825","nonce":85832},{"type":"v1","addr":"172.21.15.155:6827","nonce":85832}]},"public_addr":"172.21.15.155:6819/85832","cluster_addr":"172.21.15.155:6823/85832","heartbeat_back_addr":"172.21.15.155:6831/85832","heartbeat_front_addr":"172.21.15.155:6827/85832","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:21:25.423389+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:21:25.472661+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:21:25.817562+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:21:25.551257+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:21:25.407818+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:21:25.557976+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:21:25.747299+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:21:25.827576+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T01:22:01.646 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:01.644+0000 7f116739d700 1 -- 172.21.15.50:0/1456106095 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f1144066f30 msgr2=0x7f11440693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:01.646 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:01.644+0000 7f116739d700 1 --2- 172.21.15.50:0/1456106095 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f1144066f30 0x7f11440693e0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f11600c64d0 tx=0x7f1150017000 comp rx=0 tx=0).stop 2023-10-06T01:22:01.646 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:01.644+0000 7f116739d700 1 -- 172.21.15.50:0/1456106095 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f116006db70 msgr2=0x7f11600ac4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:01.646 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:01.644+0000 7f116739d700 1 --2- 172.21.15.50:0/1456106095 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f116006db70 0x7f11600ac4d0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f115c00ec80 tx=0x7f115c0091a0 comp rx=0 tx=0).stop 2023-10-06T01:22:01.646 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:01.644+0000 7f116739d700 1 -- 172.21.15.50:0/1456106095 shutdown_connections 2023-10-06T01:22:01.646 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:01.644+0000 7f116739d700 1 --2- 172.21.15.50:0/1456106095 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f1144066f30 0x7f11440693e0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:01.647 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:01.644+0000 7f116739d700 1 --2- 172.21.15.50:0/1456106095 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f11600addc0 0x7f11600c25c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:01.647 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:01.644+0000 7f116739d700 1 --2- 172.21.15.50:0/1456106095 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f116006db70 0x7f11600ac4d0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:01.647 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:01.644+0000 7f116739d700 1 --2- 172.21.15.50:0/1456106095 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f11600cb5e0 0x7f116016dd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:01.647 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:01.644+0000 7f116739d700 1 -- 172.21.15.50:0/1456106095 >> 172.21.15.50:0/1456106095 conn(0x7f11600680c0 msgr2=0x7f11600cb9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:22:01.647 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:01.644+0000 7f116739d700 1 -- 172.21.15.50:0/1456106095 shutdown_connections 2023-10-06T01:22:01.647 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:01.644+0000 7f116739d700 1 -- 172.21.15.50:0/1456106095 wait complete. 2023-10-06T01:22:01.663 INFO:tasks.ceph.ceph_manager.ceph:all up! 2023-10-06T01:22:01.664 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T01:22:01.851 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:01.849+0000 7f901359d700 1 Processor -- start 2023-10-06T01:22:01.851 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:01.849+0000 7f901359d700 1 -- start start 2023-10-06T01:22:01.853 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:01.851+0000 7f901359d700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f900c159ba0 0x7f900c0cb9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:01.853 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:01.851+0000 7f901359d700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f900c06e080 con 0x7f900c06f350 2023-10-06T01:22:01.853 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:01.851+0000 7f901359d700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f900c06e360 con 0x7f900c0cb5e0 2023-10-06T01:22:01.853 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:01.851+0000 7f901359d700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f900c06ec00 con 0x7f900c159ba0 2023-10-06T01:22:01.853 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:01.851+0000 7f9011d9a700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f900c06f350 0x7f900c159490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:40214/0 (socket says 172.21.15.50:40214) 2023-10-06T01:22:01.853 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:01.851+0000 7f9011d9a700 1 -- 172.21.15.50:0/2878754621 learned_addr learned my addr 172.21.15.50:0/2878754621 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-10-06T01:22:01.856 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:01.851+0000 7f9012d9c700 1 --2- 172.21.15.50:0/2878754621 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f900c159ba0 0x7f900c0cb9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:01.856 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:01.851+0000 7f9011599700 1 -- 172.21.15.50:0/2878754621 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3970245419 0 0) 0x7f900c06e080 con 0x7f900c06f350 2023-10-06T01:22:01.856 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:01.851+0000 7f9011599700 1 -- 172.21.15.50:0/2878754621 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8ff8003570 con 0x7f900c06f350 2023-10-06T01:22:01.856 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:01.852+0000 7f9011599700 1 -- 172.21.15.50:0/2878754621 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4139578649 0 0) 0x7f900c06e360 con 0x7f900c0cb5e0 2023-10-06T01:22:01.856 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:01.852+0000 7f9011599700 1 -- 172.21.15.50:0/2878754621 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f900c06e080 con 0x7f900c0cb5e0 2023-10-06T01:22:01.856 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:01.852+0000 7f9011599700 1 -- 172.21.15.50:0/2878754621 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1204561926 0 0) 0x7f8ff8003570 con 0x7f900c06f350 2023-10-06T01:22:01.856 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:01.852+0000 7f9011599700 1 -- 172.21.15.50:0/2878754621 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f900c159ba0 msgr2=0x7f900c0cb9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:22:01.857 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:01.852+0000 7f9011599700 1 --2- 172.21.15.50:0/2878754621 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f900c159ba0 0x7f900c0cb9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:01.857 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:01.852+0000 7f9011599700 1 -- 172.21.15.50:0/2878754621 >> v1:172.21.15.155:6789/0 conn(0x7f900c0cb5e0 legacy=0x7f900c06d630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:01.857 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:01.852+0000 7f9011599700 1 -- 172.21.15.50:0/2878754621 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f900c06e640 con 0x7f900c06f350 2023-10-06T01:22:01.857 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:01.852+0000 7f9011599700 1 -- 172.21.15.50:0/2878754621 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 347519148 0 0) 0x7f8ffc001470 con 0x7f900c06f350 2023-10-06T01:22:01.857 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:01.852+0000 7f9011599700 1 -- 172.21.15.50:0/2878754621 >> v1:172.21.15.50:6789/0 conn(0x7f900c06f350 legacy=0x7f900c159490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:01.857 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:01.852+0000 7f9011599700 1 --2- 172.21.15.50:0/2878754621 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8ff8003c20 0x7f8ff8004010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:01.857 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:01.852+0000 7f9011599700 1 --2- 172.21.15.50:0/2878754621 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8ff8004810 0x7f8ff8004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:01.857 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:01.852+0000 7f9011599700 1 --2- 172.21.15.50:0/2878754621 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f900c159ba0 0x7f8ff8005220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:01.857 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:01.852+0000 7f9011599700 1 -- 172.21.15.50:0/2878754621 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f900c06ec00 con 0x7f8ff8004810 2023-10-06T01:22:01.857 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:01.852+0000 7f9011599700 1 -- 172.21.15.50:0/2878754621 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ff800bbf0 con 0x7f8ff8003c20 2023-10-06T01:22:01.857 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:01.852+0000 7f9011599700 1 -- 172.21.15.50:0/2878754621 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ff800dfc0 con 0x7f900c159ba0 2023-10-06T01:22:01.858 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:01.852+0000 7f9011d9a700 1 --2- 172.21.15.50:0/2878754621 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8ff8004810 0x7f8ff8004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:01.858 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:01.852+0000 7f901259b700 1 --2- 172.21.15.50:0/2878754621 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8ff8003c20 0x7f8ff8004010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:01.858 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:01.852+0000 7f9012d9c700 1 --2- 172.21.15.50:0/2878754621 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f900c159ba0 0x7f8ff8005220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:01.858 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:01.853+0000 7f9011d9a700 1 -- 172.21.15.50:0/2878754621 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f900c159ba0 msgr2=0x7f8ff8005220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:22:01.858 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:01.853+0000 7f9011d9a700 1 --2- 172.21.15.50:0/2878754621 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f900c159ba0 0x7f8ff8005220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:01.858 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:01.853+0000 7f9011d9a700 1 -- 172.21.15.50:0/2878754621 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8ff8003c20 msgr2=0x7f8ff8004010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:22:01.858 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:01.853+0000 7f9011d9a700 1 --2- 172.21.15.50:0/2878754621 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8ff8003c20 0x7f8ff8004010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:01.858 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:01.853+0000 7f9011d9a700 1 -- 172.21.15.50:0/2878754621 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ff8003570 con 0x7f8ff8004810 2023-10-06T01:22:01.858 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:01.853+0000 7f901259b700 1 --2- 172.21.15.50:0/2878754621 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8ff8003c20 0x7f8ff8004010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T01:22:01.858 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:01.853+0000 7f9011d9a700 1 --2- 172.21.15.50:0/2878754621 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8ff8004810 0x7f8ff8004c80 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f8ffc00c210 tx=0x7f8ffc001d40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7ec4117ef9a2d5fc server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:22:01.858 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:01.853+0000 7f9011599700 1 -- 172.21.15.50:0/2878754621 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ffc00cc10 con 0x7f8ff8004810 2023-10-06T01:22:01.858 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:01.853+0000 7f9011599700 1 -- 172.21.15.50:0/2878754621 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ffc00cd70 con 0x7f8ff8004810 2023-10-06T01:22:01.859 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:01.853+0000 7f9011599700 1 -- 172.21.15.50:0/2878754621 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ffc005b70 con 0x7f8ff8004810 2023-10-06T01:22:01.859 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:01.854+0000 7f901359d700 1 -- 172.21.15.50:0/2878754621 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8ff8004810 msgr2=0x7f8ff8004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:01.859 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:01.854+0000 7f901359d700 1 --2- 172.21.15.50:0/2878754621 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8ff8004810 0x7f8ff8004c80 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f8ffc00c210 tx=0x7f8ffc001d40 comp rx=0 tx=0).stop 2023-10-06T01:22:01.859 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:01.854+0000 7f9012d9c700 1 -- 172.21.15.50:0/2878754621 reap_dead start 2023-10-06T01:22:01.859 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:01.854+0000 7f901359d700 1 -- 172.21.15.50:0/2878754621 shutdown_connections 2023-10-06T01:22:01.859 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:01.854+0000 7f901359d700 1 -- 172.21.15.50:0/2878754621 >> 172.21.15.50:0/2878754621 conn(0x7f900c0680c0 msgr2=0x7f900c0cbf00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:22:01.859 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:01.854+0000 7f901359d700 1 -- 172.21.15.50:0/2878754621 shutdown_connections 2023-10-06T01:22:01.859 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:01.854+0000 7f901359d700 1 -- 172.21.15.50:0/2878754621 wait complete. 2023-10-06T01:22:01.861 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:01.855+0000 7f901359d700 1 Processor -- start 2023-10-06T01:22:01.861 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:01.855+0000 7f901359d700 1 -- start start 2023-10-06T01:22:01.861 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:01.856+0000 7f901359d700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8ff8004810 0x7f900c14f840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:01.861 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:01.856+0000 7f901359d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f900c0ad6e0 0x7f900c0adb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:01.862 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:01.856+0000 7f901359d700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f900c0c32f0 0x7f900c0c3790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:01.862 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:01.856+0000 7f901359d700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f900c0ae090 con 0x7f900c0ad6e0 2023-10-06T01:22:01.862 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:01.856+0000 7f901359d700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f900c0c4060 con 0x7f8ff8004810 2023-10-06T01:22:01.862 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:01.856+0000 7f901359d700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f900c0c4340 con 0x7f900c0c32f0 2023-10-06T01:22:01.862 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:01.857+0000 7f9011d9a700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f900c0ad6e0 0x7f900c0adb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:01.862 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:01.857+0000 7f901259b700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8ff8004810 0x7f900c14f840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:01.862 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:01.857+0000 7f9011d9a700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f900c0ad6e0 0x7f900c0adb50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:48018/0 (socket says 172.21.15.50:48018) 2023-10-06T01:22:01.862 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:01.857+0000 7f9011d9a700 1 -- 172.21.15.50:0/3456347497 learned_addr learned my addr 172.21.15.50:0/3456347497 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-06T01:22:01.862 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:01.857+0000 7f9012d9c700 1 --2- 172.21.15.50:0/3456347497 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f900c0c32f0 0x7f900c0c3790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:01.862 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:01.857+0000 7f9011d9a700 1 -- 172.21.15.50:0/3456347497 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f900c0c32f0 msgr2=0x7f900c0c3790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:01.862 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:01.857+0000 7f9011d9a700 1 --2- 172.21.15.50:0/3456347497 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f900c0c32f0 0x7f900c0c3790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:01.863 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:01.857+0000 7f9011d9a700 1 -- 172.21.15.50:0/3456347497 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8ff8004810 msgr2=0x7f900c14f840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:01.863 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:01.857+0000 7f9011d9a700 1 --2- 172.21.15.50:0/3456347497 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8ff8004810 0x7f900c14f840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:01.863 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:01.857+0000 7f9011d9a700 1 -- 172.21.15.50:0/3456347497 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f900c0c4620 con 0x7f900c0ad6e0 2023-10-06T01:22:01.863 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:01.857+0000 7f9011d9a700 1 --2- 172.21.15.50:0/3456347497 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f900c0ad6e0 0x7f900c0adb50 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f8ffc00c800 tx=0x7f8ffc015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:22:01.863 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:01.858+0000 7f90027fc700 1 -- 172.21.15.50:0/3456347497 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ffc001d40 con 0x7f900c0ad6e0 2023-10-06T01:22:01.863 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:01.858+0000 7f90027fc700 1 -- 172.21.15.50:0/3456347497 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ffc001580 con 0x7f900c0ad6e0 2023-10-06T01:22:01.863 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:01.858+0000 7f90027fc700 1 -- 172.21.15.50:0/3456347497 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ffc007320 con 0x7f900c0ad6e0 2023-10-06T01:22:01.863 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:01.858+0000 7f901359d700 1 -- 172.21.15.50:0/3456347497 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f900c0c4900 con 0x7f900c0ad6e0 2023-10-06T01:22:01.863 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:01.858+0000 7f901359d700 1 -- 172.21.15.50:0/3456347497 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f900c0afb70 con 0x7f900c0ad6e0 2023-10-06T01:22:01.863 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:01.859+0000 7f901359d700 1 -- 172.21.15.50:0/3456347497 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f900c05f270 con 0x7f900c0ad6e0 2023-10-06T01:22:01.863 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:01.859+0000 7f90027fc700 1 -- 172.21.15.50:0/3456347497 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f8ffc019030 con 0x7f900c0ad6e0 2023-10-06T01:22:01.864 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:01.860+0000 7f90027fc700 1 --2- 172.21.15.50:0/3456347497 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f8ff0067000 0x7f8ff00694b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:01.864 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:01.860+0000 7f90027fc700 1 -- 172.21.15.50:0/3456347497 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f8ffc085e50 con 0x7f900c0ad6e0 2023-10-06T01:22:01.864 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:01.861+0000 7f901259b700 1 --2- 172.21.15.50:0/3456347497 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f8ff0067000 0x7f8ff00694b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:01.864 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:01.862+0000 7f901259b700 1 --2- 172.21.15.50:0/3456347497 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f8ff0067000 0x7f8ff00694b0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f9008002e80 tx=0x7f9008007d30 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:22:01.867 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:01.865+0000 7f90027fc700 1 -- 172.21.15.50:0/3456347497 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f8ffc052c50 con 0x7f900c0ad6e0 2023-10-06T01:22:02.069 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.067+0000 7f901359d700 1 -- 172.21.15.50:0/3456347497 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f900c0ae090 con 0x7f900c0ad6e0 2023-10-06T01:22:02.070 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.068+0000 7f90027fc700 1 -- 172.21.15.50:0/3456347497 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+18707 (secure 0 0 0) 0x7f8ffc056270 con 0x7f900c0ad6e0 2023-10-06T01:22:02.070 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-10-06T01:22:02.071 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":25,"fsid":"0bfd9a6b-1587-4fe4-a89e-e43c00286b4e","created":"2023-10-06T01:21:16.828801+0000","modified":"2023-10-06T01:21:41.329781+0000","last_up_change":"2023-10-06T01:21:28.584523+0000","last_in_change":"2023-10-06T01:21:20.179863+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-10-06T01:21:29.304225+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":".mgr","create_time":"2023-10-06T01:21:29.835490+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-06T01:21:34.675315+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-06T01:21:35.753991+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-10-06T01:21:38.853108+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"9060727a-3959-4de3-8363-c5c5d7826c9a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":87837},{"type":"v1","addr":"172.21.15.50:6801","nonce":87837}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":87837},{"type":"v1","addr":"172.21.15.50:6803","nonce":87837}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":87837},{"type":"v1","addr":"172.21.15.50:6807","nonce":87837}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":87837},{"type":"v1","addr":"172.21.15.50:6805","nonce":87837}]},"public_addr":"172.21.15.50:6801/87837","cluster_addr":"172.21.15.50:6803/87837","heartbeat_back_addr":"172.21.15.50:6807/87837","heartbeat_front_addr":"172.21.15.50:6805/87837","state":["exists","up"]},{"osd":1,"uuid":"5ad9ef12-b579-47ea-b690-90ba887e2cef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":87853},{"type":"v1","addr":"172.21.15.50:6809","nonce":87853}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":87853},{"type":"v1","addr":"172.21.15.50:6811","nonce":87853}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":87853},{"type":"v1","addr":"172.21.15.50:6815","nonce":87853}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":87853},{"type":"v1","addr":"172.21.15.50:6813","nonce":87853}]},"public_addr":"172.21.15.50:6809/87853","cluster_addr":"172.21.15.50:6811/87853","heartbeat_back_addr":"172.21.15.50:6815/87853","heartbeat_front_addr":"172.21.15.50:6813/87853","state":["exists","up"]},{"osd":2,"uuid":"c7aee044-6f75-436f-90e1-ba42a57359bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6821","nonce":87855},{"type":"v1","addr":"172.21.15.50:6822","nonce":87855}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6824","nonce":87855},{"type":"v1","addr":"172.21.15.50:6826","nonce":87855}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":87855},{"type":"v1","addr":"172.21.15.50:6831","nonce":87855}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":87855},{"type":"v1","addr":"172.21.15.50:6829","nonce":87855}]},"public_addr":"172.21.15.50:6822/87855","cluster_addr":"172.21.15.50:6826/87855","heartbeat_back_addr":"172.21.15.50:6831/87855","heartbeat_front_addr":"172.21.15.50:6829/87855","state":["exists","up"]},{"osd":3,"uuid":"d9b901c8-e8b2-44af-9508-f453120a96c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":87856},{"type":"v1","addr":"172.21.15.50:6817","nonce":87856}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":87856},{"type":"v1","addr":"172.21.15.50:6819","nonce":87856}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6825","nonce":87856},{"type":"v1","addr":"172.21.15.50:6827","nonce":87856}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6820","nonce":87856},{"type":"v1","addr":"172.21.15.50:6823","nonce":87856}]},"public_addr":"172.21.15.50:6817/87856","cluster_addr":"172.21.15.50:6819/87856","heartbeat_back_addr":"172.21.15.50:6827/87856","heartbeat_front_addr":"172.21.15.50:6823/87856","state":["exists","up"]},{"osd":4,"uuid":"2b3c6b38-e3e9-4301-9445-60fd3fe8ce03","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":85805},{"type":"v1","addr":"172.21.15.155:6801","nonce":85805}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":85805},{"type":"v1","addr":"172.21.15.155:6803","nonce":85805}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6806","nonce":85805},{"type":"v1","addr":"172.21.15.155:6807","nonce":85805}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6804","nonce":85805},{"type":"v1","addr":"172.21.15.155:6805","nonce":85805}]},"public_addr":"172.21.15.155:6801/85805","cluster_addr":"172.21.15.155:6803/85805","heartbeat_back_addr":"172.21.15.155:6807/85805","heartbeat_front_addr":"172.21.15.155:6805/85805","state":["exists","up"]},{"osd":5,"uuid":"417b5f8f-65f1-4c94-91a7-a6ce03fe1679","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6816","nonce":85807},{"type":"v1","addr":"172.21.15.155:6818","nonce":85807}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6820","nonce":85807},{"type":"v1","addr":"172.21.15.155:6822","nonce":85807}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6828","nonce":85807},{"type":"v1","addr":"172.21.15.155:6830","nonce":85807}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6824","nonce":85807},{"type":"v1","addr":"172.21.15.155:6826","nonce":85807}]},"public_addr":"172.21.15.155:6818/85807","cluster_addr":"172.21.15.155:6822/85807","heartbeat_back_addr":"172.21.15.155:6830/85807","heartbeat_front_addr":"172.21.15.155:6826/85807","state":["exists","up"]},{"osd":6,"uuid":"c150cff3-aee4-4714-9c08-d182b1ba9ffd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6808","nonce":85806},{"type":"v1","addr":"172.21.15.155:6809","nonce":85806}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6810","nonce":85806},{"type":"v1","addr":"172.21.15.155:6811","nonce":85806}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6814","nonce":85806},{"type":"v1","addr":"172.21.15.155:6815","nonce":85806}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6812","nonce":85806},{"type":"v1","addr":"172.21.15.155:6813","nonce":85806}]},"public_addr":"172.21.15.155:6809/85806","cluster_addr":"172.21.15.155:6811/85806","heartbeat_back_addr":"172.21.15.155:6815/85806","heartbeat_front_addr":"172.21.15.155:6813/85806","state":["exists","up"]},{"osd":7,"uuid":"71107f0e-04d1-4e72-a0ec-0faf6af003e7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6817","nonce":85832},{"type":"v1","addr":"172.21.15.155:6819","nonce":85832}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6821","nonce":85832},{"type":"v1","addr":"172.21.15.155:6823","nonce":85832}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6829","nonce":85832},{"type":"v1","addr":"172.21.15.155:6831","nonce":85832}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6825","nonce":85832},{"type":"v1","addr":"172.21.15.155:6827","nonce":85832}]},"public_addr":"172.21.15.155:6819/85832","cluster_addr":"172.21.15.155:6823/85832","heartbeat_back_addr":"172.21.15.155:6831/85832","heartbeat_front_addr":"172.21.15.155:6827/85832","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:21:25.423389+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:21:25.472661+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:21:25.817562+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:21:25.551257+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:21:25.407818+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:21:25.557976+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:21:25.747299+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:21:25.827576+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T01:22:02.073 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.070+0000 7f901359d700 1 -- 172.21.15.50:0/3456347497 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f8ff0067000 msgr2=0x7f8ff00694b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:02.073 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.070+0000 7f901359d700 1 --2- 172.21.15.50:0/3456347497 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f8ff0067000 0x7f8ff00694b0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f9008002e80 tx=0x7f9008007d30 comp rx=0 tx=0).stop 2023-10-06T01:22:02.073 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.070+0000 7f901359d700 1 -- 172.21.15.50:0/3456347497 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f900c0ad6e0 msgr2=0x7f900c0adb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:02.073 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.070+0000 7f901359d700 1 --2- 172.21.15.50:0/3456347497 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f900c0ad6e0 0x7f900c0adb50 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f8ffc00c800 tx=0x7f8ffc015000 comp rx=0 tx=0).stop 2023-10-06T01:22:02.073 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.071+0000 7f901359d700 1 -- 172.21.15.50:0/3456347497 shutdown_connections 2023-10-06T01:22:02.073 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.071+0000 7f901359d700 1 --2- 172.21.15.50:0/3456347497 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f900c0c32f0 0x7f900c0c3790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:02.073 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.071+0000 7f901359d700 1 --2- 172.21.15.50:0/3456347497 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f8ff0067000 0x7f8ff00694b0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:02.073 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.071+0000 7f901359d700 1 --2- 172.21.15.50:0/3456347497 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8ff8004810 0x7f900c14f840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:02.073 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.071+0000 7f901359d700 1 --2- 172.21.15.50:0/3456347497 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f900c0ad6e0 0x7f900c0adb50 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:02.073 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.071+0000 7f901359d700 1 -- 172.21.15.50:0/3456347497 >> 172.21.15.50:0/3456347497 conn(0x7f900c0680c0 msgr2=0x7f900c06a340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:22:02.073 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.071+0000 7f901359d700 1 -- 172.21.15.50:0/3456347497 shutdown_connections 2023-10-06T01:22:02.074 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.071+0000 7f901359d700 1 -- 172.21.15.50:0/3456347497 wait complete. 2023-10-06T01:22:02.091 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2023-10-06T01:22:02.091 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2023-10-06T01:22:02.092 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2023-10-06T01:22:02.092 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2023-10-06T01:22:02.092 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2023-10-06T01:22:02.093 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2023-10-06T01:22:02.093 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2023-10-06T01:22:02.093 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2023-10-06T01:22:02.425 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.423+0000 7f825e19d700 1 Processor -- start 2023-10-06T01:22:02.427 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.423+0000 7f825e19d700 1 -- start start 2023-10-06T01:22:02.428 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.425+0000 7f825e19d700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f82500e9a50 0x7f8250006300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:02.428 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.425+0000 7f825e19d700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f8250039160 0x7f825003bf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:02.428 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.425+0000 7f825e19d700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8250006be0 con 0x7f82500e9e20 2023-10-06T01:22:02.428 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.425+0000 7f825e19d700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8250007c80 con 0x7f8250039160 2023-10-06T01:22:02.428 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.425+0000 7f825e19d700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8250006ec0 con 0x7f82500e9a50 2023-10-06T01:22:02.429 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.426+0000 7f825c99a700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f82500e9e20 0x7f8250038a50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:40230/0 (socket says 172.21.15.50:40230) 2023-10-06T01:22:02.429 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.426+0000 7f825c99a700 1 -- 172.21.15.50:0/4065556966 learned_addr learned my addr 172.21.15.50:0/4065556966 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-10-06T01:22:02.429 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.427+0000 7f825d99c700 1 --2- 172.21.15.50:0/4065556966 >> v2:172.21.15.155:3300/0 conn(0x7f8250039160 0x7f825003bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:02.429 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.427+0000 7f825d19b700 1 --2- 172.21.15.50:0/4065556966 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f82500e9a50 0x7f8250006300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:02.430 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.427+0000 7f825d19b700 1 -- 172.21.15.50:0/4065556966 >> v2:172.21.15.155:3300/0 conn(0x7f8250039160 msgr2=0x7f825003bf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:22:02.430 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.427+0000 7f825d19b700 1 --2- 172.21.15.50:0/4065556966 >> v2:172.21.15.155:3300/0 conn(0x7f8250039160 0x7f825003bf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:02.430 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.427+0000 7f825d19b700 1 -- 172.21.15.50:0/4065556966 >> v1:172.21.15.50:6789/0 conn(0x7f82500e9e20 legacy=0x7f8250038a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:02.430 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.427+0000 7f825d19b700 1 -- 172.21.15.50:0/4065556966 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82500071a0 con 0x7f82500e9a50 2023-10-06T01:22:02.430 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.428+0000 7f825d19b700 1 --2- 172.21.15.50:0/4065556966 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f82500e9a50 0x7f8250006300 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f82540098e0 tx=0x7f82540091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f2fb223a3f1f9fc9 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:22:02.430 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.428+0000 7f824ffff700 1 -- 172.21.15.50:0/4065556966 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8254009e80 con 0x7f82500e9a50 2023-10-06T01:22:02.431 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.428+0000 7f824ffff700 1 -- 172.21.15.50:0/4065556966 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f825400b7a0 con 0x7f82500e9a50 2023-10-06T01:22:02.431 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.426+0000 7f1c753ff700 1 Processor -- start 2023-10-06T01:22:02.431 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.427+0000 7f1c753ff700 1 -- start start 2023-10-06T01:22:02.431 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.428+0000 7f824ffff700 1 -- 172.21.15.50:0/4065556966 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f825400bb40 con 0x7f82500e9a50 2023-10-06T01:22:02.432 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.429+0000 7f1c753ff700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f1c68052ec0 0x7f1c68053290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:02.432 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.429+0000 7f1c753ff700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f1c680ffbe0 0x7f1c6804fc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:02.432 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.430+0000 7f1c753ff700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1c680060c0 con 0x7f1c68100050 2023-10-06T01:22:02.432 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.430+0000 7f1c753ff700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1c68006c40 con 0x7f1c68052ec0 2023-10-06T01:22:02.432 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.430+0000 7f1c753ff700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1c680065f0 con 0x7f1c680ffbe0 2023-10-06T01:22:02.432 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.430+0000 7f825e19d700 1 -- 172.21.15.50:0/4065556966 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f82500e9a50 msgr2=0x7f8250006300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:02.433 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.430+0000 7f825e19d700 1 --2- 172.21.15.50:0/4065556966 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f82500e9a50 0x7f8250006300 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f82540098e0 tx=0x7f82540091a0 comp rx=0 tx=0).stop 2023-10-06T01:22:02.433 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.430+0000 7f1c6effd700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f1c68052ec0 0x7f1c68053290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:02.433 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.431+0000 7f1c6e7fc700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f1c680ffbe0 0x7f1c6804fc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:02.433 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.431+0000 7f825e19d700 1 -- 172.21.15.50:0/4065556966 shutdown_connections 2023-10-06T01:22:02.434 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.431+0000 7f825e19d700 1 --2- 172.21.15.50:0/4065556966 >> v2:172.21.15.155:3300/0 conn(0x7f8250039160 0x7f825003bf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:02.434 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.431+0000 7f825e19d700 1 --2- 172.21.15.50:0/4065556966 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f82500e9a50 0x7f8250006300 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:02.434 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.431+0000 7f825e19d700 1 -- 172.21.15.50:0/4065556966 >> 172.21.15.50:0/4065556966 conn(0x7f825000f1c0 msgr2=0x7f8250059180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:22:02.434 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.431+0000 7f1c6effd700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f1c68052ec0 0x7f1c68053290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:48026/0 (socket says 172.21.15.50:48026) 2023-10-06T01:22:02.434 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.431+0000 7f1c6effd700 1 -- 172.21.15.50:0/3681709892 learned_addr learned my addr 172.21.15.50:0/3681709892 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-06T01:22:02.435 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.431+0000 7f825e19d700 1 -- 172.21.15.50:0/4065556966 shutdown_connections 2023-10-06T01:22:02.435 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.432+0000 7f1c6effd700 1 -- 172.21.15.50:0/3681709892 >> v2:172.21.15.155:3300/0 conn(0x7f1c680ffbe0 msgr2=0x7f1c6804fc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:22:02.435 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.432+0000 7f1c6effd700 1 --2- 172.21.15.50:0/3681709892 >> v2:172.21.15.155:3300/0 conn(0x7f1c680ffbe0 0x7f1c6804fc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:02.435 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.432+0000 7f1c6effd700 1 -- 172.21.15.50:0/3681709892 >> v1:172.21.15.50:6789/0 conn(0x7f1c68100050 legacy=0x7f1c680070d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:22:02.435 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.432+0000 7f825e19d700 1 -- 172.21.15.50:0/4065556966 wait complete. 2023-10-06T01:22:02.436 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.432+0000 7f1c6dffb700 1 -- 172.21.15.50:0/3681709892 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3949635470 0 0) 0x7f1c680060c0 con 0x7f1c68100050 2023-10-06T01:22:02.436 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.432+0000 7f1c6effd700 1 -- 172.21.15.50:0/3681709892 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c680068d0 con 0x7f1c68052ec0 2023-10-06T01:22:02.436 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.432+0000 7f1c6e7fc700 1 --2- 172.21.15.50:0/3681709892 >> v2:172.21.15.155:3300/0 conn(0x7f1c680ffbe0 0x7f1c6804fc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T01:22:02.437 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.433+0000 7f1c6effd700 1 --2- 172.21.15.50:0/3681709892 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1c68052ec0 0x7f1c68053290 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f1c68104c30 tx=0x7f1c60009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9746a110ded8a8a1 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:22:02.437 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.433+0000 7f1c6dffb700 1 -- 172.21.15.50:0/3681709892 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c6000b860 con 0x7f1c68052ec0 2023-10-06T01:22:02.437 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.433+0000 7f1c6dffb700 1 -- 172.21.15.50:0/3681709892 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c6000b9c0 con 0x7f1c68052ec0 2023-10-06T01:22:02.437 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.433+0000 7f1c6dffb700 1 -- 172.21.15.50:0/3681709892 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c6000bd60 con 0x7f1c68052ec0 2023-10-06T01:22:02.437 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.434+0000 7f1c753ff700 1 -- 172.21.15.50:0/3681709892 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1c68052ec0 msgr2=0x7f1c68053290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:02.437 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.434+0000 7f1c753ff700 1 --2- 172.21.15.50:0/3681709892 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1c68052ec0 0x7f1c68053290 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f1c68104c30 tx=0x7f1c60009250 comp rx=0 tx=0).stop 2023-10-06T01:22:02.437 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.434+0000 7f825e19d700 1 Processor -- start 2023-10-06T01:22:02.438 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.434+0000 7f1c753ff700 1 -- 172.21.15.50:0/3681709892 shutdown_connections 2023-10-06T01:22:02.438 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.434+0000 7f1c753ff700 1 --2- 172.21.15.50:0/3681709892 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1c68052ec0 0x7f1c68053290 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:02.438 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.434+0000 7f1c753ff700 1 --2- 172.21.15.50:0/3681709892 >> v2:172.21.15.155:3300/0 conn(0x7f1c680ffbe0 0x7f1c6804fc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:02.438 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.434+0000 7f1c753ff700 1 -- 172.21.15.50:0/3681709892 >> 172.21.15.50:0/3681709892 conn(0x7f1c680518a0 msgr2=0x7f1c68051ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:22:02.438 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.435+0000 7f1c753ff700 1 -- 172.21.15.50:0/3681709892 shutdown_connections 2023-10-06T01:22:02.439 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.435+0000 7f1c753ff700 1 -- 172.21.15.50:0/3681709892 wait complete. 2023-10-06T01:22:02.439 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.435+0000 7f825e19d700 1 -- start start 2023-10-06T01:22:02.439 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.436+0000 7f825e19d700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8250039160 0x7f82500e8760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:02.439 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.437+0000 7f825e19d700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f82500e9a50 0x7f82500e6220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:02.439 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.437+0000 7f7ae639d700 1 Processor -- start 2023-10-06T01:22:02.440 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.437+0000 7f1c753ff700 1 Processor -- start 2023-10-06T01:22:02.440 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.437+0000 7f825e19d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f82500e9e20 0x7f82500e00d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:02.440 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.437+0000 7f1c753ff700 1 -- start start 2023-10-06T01:22:02.441 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.437+0000 7f825d99c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f82500e9e20 0x7f82500e00d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:02.441 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.437+0000 7f825d99c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f82500e9e20 0x7f82500e00d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:48042/0 (socket says 172.21.15.50:48042) 2023-10-06T01:22:02.441 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.437+0000 7f825d99c700 1 -- 172.21.15.50:0/374242969 learned_addr learned my addr 172.21.15.50:0/374242969 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-06T01:22:02.441 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.437+0000 7f825e19d700 1 -- 172.21.15.50:0/374242969 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82500f6b60 con 0x7f82500e9e20 2023-10-06T01:22:02.441 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.437+0000 7f825e19d700 1 -- 172.21.15.50:0/374242969 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f825000c0a0 con 0x7f8250039160 2023-10-06T01:22:02.441 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.437+0000 7f825e19d700 1 -- 172.21.15.50:0/374242969 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82500e8e20 con 0x7f82500e9a50 2023-10-06T01:22:02.441 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.438+0000 7f825d99c700 1 -- 172.21.15.50:0/374242969 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f82500e9a50 msgr2=0x7f82500e6220 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-06T01:22:02.442 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.438+0000 7f825d99c700 1 --2- 172.21.15.50:0/374242969 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f82500e9a50 0x7f82500e6220 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:02.442 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.438+0000 7f825d99c700 1 -- 172.21.15.50:0/374242969 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8250039160 msgr2=0x7f82500e8760 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-10-06T01:22:02.442 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.438+0000 7f825d99c700 1 --2- 172.21.15.50:0/374242969 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8250039160 0x7f82500e8760 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:02.442 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.438+0000 7f825d99c700 1 -- 172.21.15.50:0/374242969 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8254009420 con 0x7f82500e9e20 2023-10-06T01:22:02.442 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.438+0000 7f825d99c700 1 --2- 172.21.15.50:0/374242969 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f82500e9e20 0x7f82500e00d0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f824800d890 tx=0x7f8248008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:22:02.442 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.438+0000 7f7ae639d700 1 -- start start 2023-10-06T01:22:02.443 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.438+0000 7f1c753ff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1c680ffbe0 0x7f1c68038a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:02.443 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.438+0000 7f1c753ff700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1c68100050 0x7f1c68100d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:02.443 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.439+0000 7f1c753ff700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1c68037bd0 0x7f1c6804d8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:02.443 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.439+0000 7f1c753ff700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c680f62b0 con 0x7f1c680ffbe0 2023-10-06T01:22:02.443 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.439+0000 7f1c753ff700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c68114810 con 0x7f1c68037bd0 2023-10-06T01:22:02.443 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.439+0000 7f1c753ff700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c680398d0 con 0x7f1c68100050 2023-10-06T01:22:02.443 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.439+0000 7f1c6e7fc700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1c68100050 0x7f1c68100d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:02.443 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.439+0000 7f1c6e7fc700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1c68100050 0x7f1c68100d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3301/0 says I am v2:172.21.15.50:49618/0 (socket says 172.21.15.50:49618) 2023-10-06T01:22:02.443 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.439+0000 7f1c6e7fc700 1 -- 172.21.15.50:0/3521162484 learned_addr learned my addr 172.21.15.50:0/3521162484 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-06T01:22:02.444 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.439+0000 7f824d7fa700 1 -- 172.21.15.50:0/374242969 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82480125f0 con 0x7f82500e9e20 2023-10-06T01:22:02.444 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.439+0000 7f824d7fa700 1 -- 172.21.15.50:0/374242969 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8248012770 con 0x7f82500e9e20 2023-10-06T01:22:02.444 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.439+0000 7f1c6f7fe700 1 --2- 172.21.15.50:0/3521162484 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1c68037bd0 0x7f1c6804d8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:02.444 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.439+0000 7f824d7fa700 1 -- 172.21.15.50:0/374242969 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8248012b30 con 0x7f82500e9e20 2023-10-06T01:22:02.445 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.440+0000 7f1c6effd700 1 --2- 172.21.15.50:0/3521162484 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1c680ffbe0 0x7f1c68038a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:02.445 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.440+0000 7f825e19d700 1 -- 172.21.15.50:0/374242969 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f82500e9100 con 0x7f82500e9e20 2023-10-06T01:22:02.446 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.440+0000 7f1c6e7fc700 1 -- 172.21.15.50:0/3521162484 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1c68037bd0 msgr2=0x7f1c6804d8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:02.446 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.440+0000 7f1c6e7fc700 1 --2- 172.21.15.50:0/3521162484 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1c68037bd0 0x7f1c6804d8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:02.446 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.440+0000 7f1c6e7fc700 1 -- 172.21.15.50:0/3521162484 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1c680ffbe0 msgr2=0x7f1c68038a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:02.446 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.440+0000 7f1c6e7fc700 1 --2- 172.21.15.50:0/3521162484 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1c680ffbe0 0x7f1c68038a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:02.446 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.440+0000 7f1c6e7fc700 1 -- 172.21.15.50:0/3521162484 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c600094f0 con 0x7f1c68100050 2023-10-06T01:22:02.446 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.440+0000 7f1c6e7fc700 1 --2- 172.21.15.50:0/3521162484 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1c68100050 0x7f1c68100d60 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f1c6400c830 tx=0x7f1c64008040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:22:02.446 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.441+0000 7f1c56ffd700 1 -- 172.21.15.50:0/3521162484 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c64011600 con 0x7f1c68100050 2023-10-06T01:22:02.447 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.441+0000 7f1c56ffd700 1 -- 172.21.15.50:0/3521162484 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c64011760 con 0x7f1c68100050 2023-10-06T01:22:02.447 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.441+0000 7f1c56ffd700 1 -- 172.21.15.50:0/3521162484 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c64011b00 con 0x7f1c68100050 2023-10-06T01:22:02.447 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.441+0000 7f1c753ff700 1 -- 172.21.15.50:0/3521162484 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1c68101fe0 con 0x7f1c68100050 2023-10-06T01:22:02.447 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.441+0000 7f7ae639d700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7ae013b8c0 0x7f7ae00c9ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:02.447 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.441+0000 7f7ae639d700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f7ae006a6c0 0x7f7ae00cb230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:02.447 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.441+0000 7f1c753ff700 1 -- 172.21.15.50:0/3521162484 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1c68101740 con 0x7f1c68100050 2023-10-06T01:22:02.448 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.442+0000 7f7ae539b700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7ae013b8c0 0x7f7ae00c9ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:02.448 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.442+0000 7f7ae539b700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7ae013b8c0 0x7f7ae00c9ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3301/0 says I am v2:172.21.15.50:49620/0 (socket says 172.21.15.50:49620) 2023-10-06T01:22:02.448 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.442+0000 7f7ae539b700 1 -- 172.21.15.50:0/2311305343 learned_addr learned my addr 172.21.15.50:0/2311305343 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-06T01:22:02.448 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.442+0000 7fe6e0f9d700 1 Processor -- start 2023-10-06T01:22:02.449 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.442+0000 7f7ae639d700 1 -- 172.21.15.50:0/2311305343 --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7ae00cada0 con 0x7f7ae00c6750 2023-10-06T01:22:02.449 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.442+0000 7fe6e0f9d700 1 -- start start 2023-10-06T01:22:02.449 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.443+0000 7f1c54ff9700 1 -- 172.21.15.50:0/3521162484 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f1c48000fd0 con 0x7f1c68100050 2023-10-06T01:22:02.450 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.443+0000 7f7ae639d700 1 -- 172.21.15.50:0/2311305343 --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7ae00cb770 con 0x7f7ae006a6c0 2023-10-06T01:22:02.450 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.443+0000 7f7ae639d700 1 -- 172.21.15.50:0/2311305343 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ae00ca190 con 0x7f7ae013b8c0 2023-10-06T01:22:02.450 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.443+0000 7f7ae4b9a700 1 --2- 172.21.15.50:0/2311305343 >> v2:172.21.15.50:3300/0 conn(0x7f7ae006a6c0 0x7f7ae00cb230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:02.450 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.444+0000 7fe6e0f9d700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fe6dc0cc610 0x7fe6dc06e240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:02.450 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.444+0000 7fe6e0f9d700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe6dc159d20 0x7fe6dc06ecf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:02.451 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.444+0000 7fe6e0f9d700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe6dc06d250 con 0x7fe6dc0c6750 2023-10-06T01:22:02.451 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.444+0000 7fe6e0f9d700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe6dc06f5f0 con 0x7fe6dc0cc610 2023-10-06T01:22:02.451 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.444+0000 7fe6e0f9d700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6dc06d480 con 0x7fe6dc159d20 2023-10-06T01:22:02.451 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.443+0000 7f7ae539b700 1 -- 172.21.15.50:0/2311305343 >> v2:172.21.15.50:3300/0 conn(0x7f7ae006a6c0 msgr2=0x7f7ae00cb230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:22:02.451 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.443+0000 7f7ae539b700 1 --2- 172.21.15.50:0/2311305343 >> v2:172.21.15.50:3300/0 conn(0x7f7ae006a6c0 0x7f7ae00cb230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:02.451 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.443+0000 7f7ae539b700 1 -- 172.21.15.50:0/2311305343 >> v1:172.21.15.50:6789/0 conn(0x7f7ae00c6750 legacy=0x7f7ae006d250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:02.451 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.443+0000 7f7ae539b700 1 -- 172.21.15.50:0/2311305343 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ae00ca470 con 0x7f7ae013b8c0 2023-10-06T01:22:02.452 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.444+0000 7f7ae539b700 1 --2- 172.21.15.50:0/2311305343 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7ae013b8c0 0x7f7ae00c9ad0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f7ad00099b0 tx=0x7f7ad0009250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=977718e93a2f16e8 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:22:02.452 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.444+0000 7f7ad7fff700 1 -- 172.21.15.50:0/2311305343 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ad000b860 con 0x7f7ae013b8c0 2023-10-06T01:22:02.452 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.444+0000 7f7ad7fff700 1 -- 172.21.15.50:0/2311305343 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ad000b9c0 con 0x7f7ae013b8c0 2023-10-06T01:22:02.452 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.444+0000 7f7ad7fff700 1 -- 172.21.15.50:0/2311305343 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ad000bd40 con 0x7f7ae013b8c0 2023-10-06T01:22:02.452 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.445+0000 7fe6db7fe700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fe6dc0cc610 0x7fe6dc06e240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:02.452 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.445+0000 7fe6db7fe700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fe6dc0cc610 0x7fe6dc06e240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.50:54180/0 (socket says 172.21.15.50:54180) 2023-10-06T01:22:02.453 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.445+0000 7fe6db7fe700 1 -- 172.21.15.50:0/2403865915 learned_addr learned my addr 172.21.15.50:0/2403865915 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-06T01:22:02.453 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.445+0000 7fe6daffd700 1 --2- 172.21.15.50:0/2403865915 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe6dc159d20 0x7fe6dc06ecf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:02.453 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.446+0000 7f8e5e9ff700 1 Processor -- start 2023-10-06T01:22:02.453 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.446+0000 7fe6db7fe700 1 -- 172.21.15.50:0/2403865915 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe6dc159d20 msgr2=0x7fe6dc06ecf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:22:02.453 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.446+0000 7fe6db7fe700 1 --2- 172.21.15.50:0/2403865915 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe6dc159d20 0x7fe6dc06ecf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:02.454 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.446+0000 7fe6db7fe700 1 -- 172.21.15.50:0/2403865915 >> v1:172.21.15.50:6789/0 conn(0x7fe6dc0c6750 legacy=0x7fe6dc0c9f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:22:02.454 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.446+0000 7f8e5e9ff700 1 -- start start 2023-10-06T01:22:02.454 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.446+0000 7fe6db7fe700 1 -- 172.21.15.50:0/2403865915 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6dc06d760 con 0x7fe6dc0cc610 2023-10-06T01:22:02.454 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.445+0000 7f7ae639d700 1 -- 172.21.15.50:0/2311305343 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7ae013b8c0 msgr2=0x7f7ae00c9ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:02.455 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.445+0000 7f7ae639d700 1 --2- 172.21.15.50:0/2311305343 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7ae013b8c0 0x7f7ae00c9ad0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f7ad00099b0 tx=0x7f7ad0009250 comp rx=0 tx=0).stop 2023-10-06T01:22:02.455 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.447+0000 7fe6db7fe700 1 --2- 172.21.15.50:0/2403865915 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe6dc0cc610 0x7fe6dc06e240 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fe6c40099b0 tx=0x7fe6c4009250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2fd2b317248d3e00 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:22:02.455 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.447+0000 7f825e19d700 1 -- 172.21.15.50:0/374242969 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f825000c5d0 con 0x7f82500e9e20 2023-10-06T01:22:02.456 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.448+0000 7fe6da7fc700 1 -- 172.21.15.50:0/2403865915 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6c4009ea0 con 0x7fe6dc0cc610 2023-10-06T01:22:02.456 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.448+0000 7fe6da7fc700 1 -- 172.21.15.50:0/2403865915 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe6c400b820 con 0x7fe6dc0cc610 2023-10-06T01:22:02.456 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.448+0000 7fe6da7fc700 1 -- 172.21.15.50:0/2403865915 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6c4009ea0 con 0x7fe6dc0cc610 2023-10-06T01:22:02.456 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.448+0000 7f7ae639d700 1 -- 172.21.15.50:0/2311305343 shutdown_connections 2023-10-06T01:22:02.456 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.446+0000 7f1c56ffd700 1 -- 172.21.15.50:0/3521162484 <== mon.2 v2:172.21.15.155:3301/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f1c6401a450 con 0x7f1c68100050 2023-10-06T01:22:02.457 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.448+0000 7f1c56ffd700 1 --2- 172.21.15.50:0/3521162484 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f1c5c066fb0 0x7f1c5c069460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:02.457 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.448+0000 7f1c56ffd700 1 -- 172.21.15.50:0/3521162484 <== mon.2 v2:172.21.15.155:3301/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f1c64084d90 con 0x7f1c68100050 2023-10-06T01:22:02.457 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.448+0000 7f1c56ffd700 1 --2- 172.21.15.50:0/3521162484 >> [v2:172.21.15.50:6821/87855,v1:172.21.15.50:6822/87855] conn(0x7f1c5c070c80 0x7f1c5c0730b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:02.457 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.448+0000 7f1c56ffd700 1 -- 172.21.15.50:0/3521162484 --> [v2:172.21.15.50:6821/87855,v1:172.21.15.50:6822/87855] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f1c5c073780 con 0x7f1c5c070c80 2023-10-06T01:22:02.457 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.448+0000 7f1c56ffd700 1 -- 172.21.15.50:0/3521162484 <== mon.2 v2:172.21.15.155:3301/0 6 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1c640850c0 con 0x7f1c68100050 2023-10-06T01:22:02.457 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.449+0000 7f7ae639d700 1 --2- 172.21.15.50:0/2311305343 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7ae013b8c0 0x7f7ae00c9ad0 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:02.458 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.449+0000 7f7ae639d700 1 --2- 172.21.15.50:0/2311305343 >> v2:172.21.15.50:3300/0 conn(0x7f7ae006a6c0 0x7f7ae00cb230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:02.458 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.449+0000 7f7ae639d700 1 -- 172.21.15.50:0/2311305343 >> 172.21.15.50:0/2311305343 conn(0x7f7ae00680c0 msgr2=0x7f7ae00cbf00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:22:02.458 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.449+0000 7f1c6f7fe700 1 --2- 172.21.15.50:0/3521162484 >> [v2:172.21.15.50:6821/87855,v1:172.21.15.50:6822/87855] conn(0x7f1c5c070c80 0x7f1c5c0730b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:02.458 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.448+0000 7f824d7fa700 1 -- 172.21.15.50:0/374242969 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f824801e460 con 0x7f82500e9e20 2023-10-06T01:22:02.458 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.448+0000 7f8242ffd700 1 -- 172.21.15.50:0/374242969 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f8250005930 con 0x7f82500e9e20 2023-10-06T01:22:02.458 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.449+0000 7f824d7fa700 1 --2- 172.21.15.50:0/374242969 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f823c066f30 0x7f823c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:02.459 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.449+0000 7f7ae639d700 1 -- 172.21.15.50:0/2311305343 shutdown_connections 2023-10-06T01:22:02.459 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.449+0000 7f7ae639d700 1 -- 172.21.15.50:0/2311305343 wait complete. 2023-10-06T01:22:02.459 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.450+0000 7f1c6effd700 1 --2- 172.21.15.50:0/3521162484 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f1c5c066fb0 0x7f1c5c069460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:02.460 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.450+0000 7f8e5e9ff700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f8e580cc4a0 0x7f8e580c8310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:02.460 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.450+0000 7f825d19b700 1 --2- 172.21.15.50:0/374242969 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f823c066f30 0x7f823c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:02.460 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.449+0000 7fe6e0f9d700 1 -- 172.21.15.50:0/2403865915 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe6dc0cc610 msgr2=0x7fe6dc06e240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:02.460 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.449+0000 7fe6e0f9d700 1 --2- 172.21.15.50:0/2403865915 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe6dc0cc610 0x7fe6dc06e240 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fe6c40099b0 tx=0x7fe6c4009250 comp rx=0 tx=0).stop 2023-10-06T01:22:02.460 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.450+0000 7fe6e0f9d700 1 -- 172.21.15.50:0/2403865915 shutdown_connections 2023-10-06T01:22:02.461 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.450+0000 7f8e5e9ff700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8e580cad90 con 0x7f8e5806e4c0 2023-10-06T01:22:02.461 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.450+0000 7fe6e0f9d700 1 --2- 172.21.15.50:0/2403865915 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe6dc0cc610 0x7fe6dc06e240 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:02.461 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.450+0000 7fe6e0f9d700 1 --2- 172.21.15.50:0/2403865915 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe6dc159d20 0x7fe6dc06ecf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:02.461 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.450+0000 7fe6e0f9d700 1 -- 172.21.15.50:0/2403865915 >> 172.21.15.50:0/2403865915 conn(0x7fe6dc0680c0 msgr2=0x7fe6dc0cbf00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:22:02.462 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.450+0000 7f8e5e9ff700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8e580c1f60 con 0x7f8e580c92d0 2023-10-06T01:22:02.462 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.450+0000 7f8e5e9ff700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8e580c8850 con 0x7f8e580cc4a0 2023-10-06T01:22:02.462 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.450+0000 7f8e4ffff700 1 --1- >> v1:172.21.15.155:6789/0 conn(0x7f8e580c92d0 0x7f8e580cbd90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.155:6789/0 says I am v1:172.21.15.50:56964/0 (socket says 172.21.15.50:56964) 2023-10-06T01:22:02.462 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.450+0000 7f824d7fa700 1 -- 172.21.15.50:0/374242969 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f8248012ea0 con 0x7f82500e9e20 2023-10-06T01:22:02.462 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.451+0000 7f824d7fa700 1 --2- 172.21.15.50:0/374242969 >> [v2:172.21.15.50:6800/87837,v1:172.21.15.50:6801/87837] conn(0x7f823c070c00 0x7f823c073030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:02.462 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.451+0000 7f824d7fa700 1 -- 172.21.15.50:0/374242969 --> [v2:172.21.15.50:6800/87837,v1:172.21.15.50:6801/87837] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f823c073700 con 0x7f823c070c00 2023-10-06T01:22:02.462 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.451+0000 7f824d7fa700 1 -- 172.21.15.50:0/374242969 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8248051560 con 0x7f82500e9e20 2023-10-06T01:22:02.463 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.451+0000 7f8e4ffff700 1 -- 172.21.15.50:0/149609159 learned_addr learned my addr 172.21.15.50:0/149609159 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-10-06T01:22:02.463 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.451+0000 7fe6e0f9d700 1 -- 172.21.15.50:0/2403865915 shutdown_connections 2023-10-06T01:22:02.463 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.451+0000 7f825c99a700 1 --2- 172.21.15.50:0/374242969 >> [v2:172.21.15.50:6800/87837,v1:172.21.15.50:6801/87837] conn(0x7f823c070c00 0x7f823c073030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:02.464 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.451+0000 7fe6e0f9d700 1 -- 172.21.15.50:0/2403865915 wait complete. 2023-10-06T01:22:02.464 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.451+0000 7fd58fbff700 1 Processor -- start 2023-10-06T01:22:02.464 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.451+0000 7fd58fbff700 1 -- start start 2023-10-06T01:22:02.464 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.452+0000 7f8e57fff700 1 --2- 172.21.15.50:0/149609159 >> v2:172.21.15.155:3300/0 conn(0x7f8e580cc4a0 0x7f8e580c8310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:02.465 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.452+0000 7f7ae639d700 1 Processor -- start 2023-10-06T01:22:02.465 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.453+0000 7f7ae639d700 1 -- start start 2023-10-06T01:22:02.465 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.451+0000 7f1c6f7fe700 1 --2- 172.21.15.50:0/3521162484 >> [v2:172.21.15.50:6821/87855,v1:172.21.15.50:6822/87855] conn(0x7f1c5c070c80 0x7f1c5c0730b0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:22:02.465 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.453+0000 7f8e57fff700 1 -- 172.21.15.50:0/149609159 >> v1:172.21.15.155:6789/0 conn(0x7f8e580c92d0 legacy=0x7f8e580cbd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:02.466 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.453+0000 7f8e57fff700 1 -- 172.21.15.50:0/149609159 >> v1:172.21.15.50:6789/0 conn(0x7f8e5806e4c0 legacy=0x7f8e580c23f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:02.466 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.452+0000 7f1c6effd700 1 --2- 172.21.15.50:0/3521162484 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f1c5c066fb0 0x7f1c5c069460 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f1c68104c30 tx=0x7f1c60017000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:22:02.466 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.453+0000 7f1c56ffd700 1 -- 172.21.15.50:0/3521162484 <== osd.2 v2:172.21.15.50:6821/87855 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7f1c5c073780 con 0x7f1c5c070c80 2023-10-06T01:22:02.466 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.453+0000 7fe6e0f9d700 1 Processor -- start 2023-10-06T01:22:02.467 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.454+0000 7f8e57fff700 1 -- 172.21.15.50:0/149609159 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e58156860 con 0x7f8e580cc4a0 2023-10-06T01:22:02.467 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.454+0000 7fe6e0f9d700 1 -- start start 2023-10-06T01:22:02.467 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.454+0000 7f7ae639d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7ae006a6c0 0x7f7ae0157650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:02.468 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.454+0000 7f7ae539b700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7ae006a6c0 0x7f7ae0157650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:02.468 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.454+0000 7f825d19b700 1 --2- 172.21.15.50:0/374242969 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f823c066f30 0x7f823c0693e0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f82540098e0 tx=0x7f8254016000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:22:02.468 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.455+0000 7f7ae539b700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7ae006a6c0 0x7f7ae0157650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:48070/0 (socket says 172.21.15.50:48070) 2023-10-06T01:22:02.469 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.454+0000 7fd58fbff700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fd58815d5f0 0x7fd58806d250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:02.469 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.454+0000 7fd58fbff700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd58815d9c0 0x7fd58806d790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:02.469 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.454+0000 7fd58fbff700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fd5880c9fe0 0x7fd58806a490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:02.469 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.455+0000 7f7ae539b700 1 -- 172.21.15.50:0/1836066001 learned_addr learned my addr 172.21.15.50:0/1836066001 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-06T01:22:02.469 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.454+0000 7fd58fbff700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd58806a000 con 0x7fd58815d5f0 2023-10-06T01:22:02.470 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.454+0000 7fd58fbff700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd5880693f0 con 0x7fd5880c9fe0 2023-10-06T01:22:02.470 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.454+0000 7fd58fbff700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5880696d0 con 0x7fd58815d9c0 2023-10-06T01:22:02.470 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.454+0000 7fd58d99b700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fd58815d5f0 0x7fd58806d250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:02.470 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.454+0000 7fd58d99b700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fd58815d5f0 0x7fd58806d250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:48068/0 (socket says 172.21.15.50:48068) 2023-10-06T01:22:02.470 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.454+0000 7fd58d99b700 1 -- 172.21.15.50:0/3514554549 learned_addr learned my addr 172.21.15.50:0/3514554549 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-06T01:22:02.470 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.454+0000 7fd58d19a700 1 --2- 172.21.15.50:0/3514554549 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd58815d9c0 0x7fd58806d790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:02.470 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.455+0000 7f7ae639d700 1 --2- 172.21.15.50:0/1836066001 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7ae00c6750 0x7f7ae0153c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:02.471 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.455+0000 7fd58e19c700 1 --2- 172.21.15.50:0/3514554549 >> v2:172.21.15.155:3300/0 conn(0x7fd5880c9fe0 0x7fd58806a490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:02.471 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.455+0000 7fd58d99b700 1 -- 172.21.15.50:0/3514554549 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd58815d9c0 msgr2=0x7fd58806d790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:22:02.471 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.455+0000 7fd58d99b700 1 --2- 172.21.15.50:0/3514554549 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd58815d9c0 0x7fd58806d790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:02.471 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.455+0000 7fd58d99b700 1 -- 172.21.15.50:0/3514554549 >> v2:172.21.15.155:3300/0 conn(0x7fd5880c9fe0 msgr2=0x7fd58806a490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:22:02.471 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.455+0000 7fd58d99b700 1 --2- 172.21.15.50:0/3514554549 >> v2:172.21.15.155:3300/0 conn(0x7fd5880c9fe0 0x7fd58806a490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:02.471 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.455+0000 7fd58d99b700 1 -- 172.21.15.50:0/3514554549 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5880699b0 con 0x7fd58815d5f0 2023-10-06T01:22:02.472 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.455+0000 7fd58e19c700 1 --2- 172.21.15.50:0/3514554549 >> v2:172.21.15.155:3300/0 conn(0x7fd5880c9fe0 0x7fd58806a490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T01:22:02.472 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.455+0000 7f7ae639d700 1 --2- 172.21.15.50:0/1836066001 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7ae013b8c0 0x7f7ae01545b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:02.472 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.455+0000 7f7ae4b9a700 1 --2- 172.21.15.50:0/1836066001 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7ae00c6750 0x7f7ae0153c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:02.472 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.455+0000 7f825c99a700 1 --2- 172.21.15.50:0/374242969 >> [v2:172.21.15.50:6800/87837,v1:172.21.15.50:6801/87837] conn(0x7f823c070c00 0x7f823c073030 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:22:02.473 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.455+0000 7fd58d99b700 1 --2- 172.21.15.50:0/3514554549 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd58815d5f0 0x7fd58806d250 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fd5880c6470 tx=0x7fd580009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7c1d12cec1092464 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:22:02.473 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.456+0000 7fe6e0f9d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe6dc0c6750 0x7fe6dc14afc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:02.473 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.456+0000 7fd58c999700 1 -- 172.21.15.50:0/3514554549 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd58000e070 con 0x7fd58815d5f0 2023-10-06T01:22:02.473 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.456+0000 7fd58c999700 1 -- 172.21.15.50:0/3514554549 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd58000ba50 con 0x7fd58815d5f0 2023-10-06T01:22:02.474 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.456+0000 7fd58c999700 1 -- 172.21.15.50:0/3514554549 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5800092e0 con 0x7fd58815d5f0 2023-10-06T01:22:02.474 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.456+0000 7fe6e0f9d700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe6dc159d20 0x7fe6dc143bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:02.474 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.456+0000 7fe6e0f9d700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe6dc0c53d0 0x7fe6dc0c5850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:02.474 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.456+0000 7f7ae5b9c700 1 --2- 172.21.15.50:0/1836066001 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7ae013b8c0 0x7f7ae01545b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:02.475 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.456+0000 7fe6e0f9d700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6dc0c33f0 con 0x7fe6dc0c6750 2023-10-06T01:22:02.475 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.456+0000 7fe6e0f9d700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6dc1426b0 con 0x7fe6dc159d20 2023-10-06T01:22:02.475 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.456+0000 7f7ae639d700 1 -- 172.21.15.50:0/1836066001 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ae013d630 con 0x7f7ae006a6c0 2023-10-06T01:22:02.475 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.456+0000 7fe6e0f9d700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6dc0c3640 con 0x7fe6dc0c53d0 2023-10-06T01:22:02.476 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.456+0000 7f7ae639d700 1 -- 172.21.15.50:0/1836066001 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ae01541c0 con 0x7f7ae013b8c0 2023-10-06T01:22:02.476 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.456+0000 7f7ae639d700 1 -- 172.21.15.50:0/1836066001 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ae0154af0 con 0x7f7ae00c6750 2023-10-06T01:22:02.476 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.456+0000 7fe6dbfff700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe6dc0c53d0 0x7fe6dc0c5850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:02.476 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.456+0000 7fe6dbfff700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe6dc0c53d0 0x7fe6dc0c5850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3301/0 says I am v2:172.21.15.50:49650/0 (socket says 172.21.15.50:49650) 2023-10-06T01:22:02.476 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.456+0000 7fe6dbfff700 1 -- 172.21.15.50:0/3519207835 learned_addr learned my addr 172.21.15.50:0/3519207835 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-06T01:22:02.477 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.457+0000 7f8e57fff700 1 --2- 172.21.15.50:0/149609159 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8e580cc4a0 0x7f8e580c8310 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f8e480098e0 tx=0x7f8e480091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d15397b8c8d0edaf server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:22:02.477 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.457+0000 7f76a89ff700 1 Processor -- start 2023-10-06T01:22:02.477 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.457+0000 7fd58fbff700 1 -- 172.21.15.50:0/3514554549 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd58815d5f0 msgr2=0x7fd58806d250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:02.477 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.457+0000 7fd58fbff700 1 --2- 172.21.15.50:0/3514554549 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd58815d5f0 0x7fd58806d250 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fd5880c6470 tx=0x7fd580009840 comp rx=0 tx=0).stop 2023-10-06T01:22:02.478 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.456+0000 7fe6db7fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe6dc0c6750 0x7fe6dc14afc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:02.478 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.457+0000 7fe6daffd700 1 --2- 172.21.15.50:0/3519207835 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe6dc159d20 0x7fe6dc143bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:02.478 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.457+0000 7fe6dbfff700 1 -- 172.21.15.50:0/3519207835 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe6dc159d20 msgr2=0x7fe6dc143bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:02.478 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.457+0000 7fe6dbfff700 1 --2- 172.21.15.50:0/3519207835 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe6dc159d20 0x7fe6dc143bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:02.478 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.457+0000 7fe6dbfff700 1 -- 172.21.15.50:0/3519207835 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe6dc0c6750 msgr2=0x7fe6dc14afc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:02.478 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.457+0000 7fe6dbfff700 1 --2- 172.21.15.50:0/3519207835 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe6dc0c6750 0x7fe6dc14afc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:02.479 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.457+0000 7fe6dbfff700 1 -- 172.21.15.50:0/3519207835 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6c40094f0 con 0x7fe6dc0c53d0 2023-10-06T01:22:02.479 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.457+0000 7fd58fbff700 1 -- 172.21.15.50:0/3514554549 shutdown_connections 2023-10-06T01:22:02.479 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.457+0000 7fd58fbff700 1 --2- 172.21.15.50:0/3514554549 >> v2:172.21.15.155:3300/0 conn(0x7fd5880c9fe0 0x7fd58806a490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:02.479 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.457+0000 7fd58fbff700 1 --2- 172.21.15.50:0/3514554549 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd58815d5f0 0x7fd58806d250 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:02.479 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.457+0000 7f7ae539b700 1 -- 172.21.15.50:0/1836066001 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7ae00c6750 msgr2=0x7f7ae0153c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:02.479 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.457+0000 7f7ae539b700 1 --2- 172.21.15.50:0/1836066001 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7ae00c6750 0x7f7ae0153c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:02.479 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.457+0000 7f7ae539b700 1 -- 172.21.15.50:0/1836066001 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7ae013b8c0 msgr2=0x7f7ae01545b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:02.480 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.457+0000 7f7ae539b700 1 --2- 172.21.15.50:0/1836066001 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7ae013b8c0 0x7f7ae01545b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:02.480 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.457+0000 7fd58fbff700 1 --2- 172.21.15.50:0/3514554549 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd58815d9c0 0x7fd58806d790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:02.480 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.457+0000 7fd58fbff700 1 -- 172.21.15.50:0/3514554549 >> 172.21.15.50:0/3514554549 conn(0x7fd5880680c0 msgr2=0x7fd5880cbf00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:22:02.480 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.457+0000 7f824d7fa700 1 -- 172.21.15.50:0/374242969 <== osd.0 v2:172.21.15.50:6800/87837 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7f823c073700 con 0x7f823c070c00 2023-10-06T01:22:02.481 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.457+0000 7f7ae539b700 1 -- 172.21.15.50:0/1836066001 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ad00094f0 con 0x7f7ae006a6c0 2023-10-06T01:22:02.481 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.457+0000 7fe6dbfff700 1 --2- 172.21.15.50:0/3519207835 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe6dc0c53d0 0x7fe6dc0c5850 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fe6cc00c930 tx=0x7fe6cc0026e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:22:02.481 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.457+0000 7f76a89ff700 1 -- start start 2023-10-06T01:22:02.481 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.458+0000 7f8e577fe700 1 -- 172.21.15.50:0/149609159 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e48009e80 con 0x7f8e580cc4a0 2023-10-06T01:22:02.482 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.458+0000 7f8e577fe700 1 -- 172.21.15.50:0/149609159 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e4800b760 con 0x7f8e580cc4a0 2023-10-06T01:22:02.482 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.458+0000 7f7ae539b700 1 --2- 172.21.15.50:0/1836066001 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7ae006a6c0 0x7f7ae0157650 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f7ad0006fd0 tx=0x7f7ad0017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:22:02.482 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.458+0000 7f8e577fe700 1 -- 172.21.15.50:0/149609159 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e4800bb00 con 0x7f8e580cc4a0 2023-10-06T01:22:02.482 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.458+0000 7f7ae5b9c700 1 --2- 172.21.15.50:0/1836066001 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7ae013b8c0 0x7f7ae01545b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T01:22:02.483 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.458+0000 7fe6d37fe700 1 -- 172.21.15.50:0/3519207835 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6cc012630 con 0x7fe6dc0c53d0 2023-10-06T01:22:02.483 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.458+0000 7fe6d37fe700 1 -- 172.21.15.50:0/3519207835 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe6cc012790 con 0x7fe6dc0c53d0 2023-10-06T01:22:02.483 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.458+0000 7fe6d37fe700 1 -- 172.21.15.50:0/3519207835 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6cc012b30 con 0x7fe6dc0c53d0 2023-10-06T01:22:02.484 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.459+0000 7f8e5e9ff700 1 -- 172.21.15.50:0/149609159 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8e580cc4a0 msgr2=0x7f8e580c8310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:02.484 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.459+0000 7f8e5e9ff700 1 --2- 172.21.15.50:0/149609159 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8e580cc4a0 0x7f8e580c8310 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f8e480098e0 tx=0x7f8e480091a0 comp rx=0 tx=0).stop 2023-10-06T01:22:02.484 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.460+0000 7f8e5e9ff700 1 -- 172.21.15.50:0/149609159 shutdown_connections 2023-10-06T01:22:02.484 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.460+0000 7f8e5e9ff700 1 --2- 172.21.15.50:0/149609159 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8e580cc4a0 0x7f8e580c8310 secure :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f8e480098e0 tx=0x7f8e480091a0 comp rx=0 tx=0).stop 2023-10-06T01:22:02.484 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.460+0000 7f8e5e9ff700 1 -- 172.21.15.50:0/149609159 >> 172.21.15.50:0/149609159 conn(0x7f8e580691c0 msgr2=0x7f8e580cd1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:22:02.484 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.460+0000 7fe6e0f9d700 1 -- 172.21.15.50:0/3519207835 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe6dc0c3920 con 0x7fe6dc0c53d0 2023-10-06T01:22:02.485 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.460+0000 7f8e5e9ff700 1 -- 172.21.15.50:0/149609159 shutdown_connections 2023-10-06T01:22:02.485 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.460+0000 7f8e5e9ff700 1 -- 172.21.15.50:0/149609159 wait complete. 2023-10-06T01:22:02.485 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.459+0000 7f76a89ff700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f76a41594b0 0x7f76a40ccc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:02.485 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.459+0000 7f76a89ff700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f76a40cd1a0 0x7f76a40ce9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:02.485 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.459+0000 7f76a89ff700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f76a40cef00 0x7f76a40c5250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:02.485 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.459+0000 7f76a89ff700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f76a40cd610 con 0x7f76a40cef00 2023-10-06T01:22:02.485 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.459+0000 7f76a89ff700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f76a40cc840 con 0x7f76a41594b0 2023-10-06T01:22:02.485 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.459+0000 7f76a89ff700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76a40cbc70 con 0x7f76a40cd1a0 2023-10-06T01:22:02.485 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.459+0000 7f76a259c700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f76a41594b0 0x7f76a40ccc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:02.486 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.459+0000 7f76a259c700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f76a41594b0 0x7f76a40ccc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.50:54230/0 (socket says 172.21.15.50:54230) 2023-10-06T01:22:02.486 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.459+0000 7f76a259c700 1 -- 172.21.15.50:0/3309957259 learned_addr learned my addr 172.21.15.50:0/3309957259 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-06T01:22:02.486 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.460+0000 7f76a2d9d700 1 --2- 172.21.15.50:0/3309957259 >> v2:172.21.15.50:3300/0 conn(0x7f76a40cef00 0x7f76a40c5250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:02.486 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.460+0000 7f76a1d9b700 1 --2- 172.21.15.50:0/3309957259 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f76a40cd1a0 0x7f76a40ce9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:02.486 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.460+0000 7f76a259c700 1 -- 172.21.15.50:0/3309957259 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f76a40cd1a0 msgr2=0x7f76a40ce9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:22:02.486 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.460+0000 7f76a259c700 1 --2- 172.21.15.50:0/3309957259 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f76a40cd1a0 0x7f76a40ce9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:02.486 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.460+0000 7f76a259c700 1 -- 172.21.15.50:0/3309957259 >> v2:172.21.15.50:3300/0 conn(0x7f76a40cef00 msgr2=0x7f76a40c5250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:22:02.486 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.460+0000 7f76a259c700 1 --2- 172.21.15.50:0/3309957259 >> v2:172.21.15.50:3300/0 conn(0x7f76a40cef00 0x7f76a40c5250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:02.486 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.460+0000 7f76a259c700 1 -- 172.21.15.50:0/3309957259 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76a40cbf10 con 0x7f76a41594b0 2023-10-06T01:22:02.486 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.460+0000 7f76a1d9b700 1 --2- 172.21.15.50:0/3309957259 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f76a40cd1a0 0x7f76a40ce9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T01:22:02.486 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.460+0000 7f76a2d9d700 1 --2- 172.21.15.50:0/3309957259 >> v2:172.21.15.50:3300/0 conn(0x7f76a40cef00 0x7f76a40c5250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T01:22:02.487 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.461+0000 7fe6e0f9d700 1 -- 172.21.15.50:0/3519207835 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe6dc14cf60 con 0x7fe6dc0c53d0 2023-10-06T01:22:02.487 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.458+0000 7fd58fbff700 1 -- 172.21.15.50:0/3514554549 shutdown_connections 2023-10-06T01:22:02.487 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.458+0000 7fd58fbff700 1 -- 172.21.15.50:0/3514554549 wait complete. 2023-10-06T01:22:02.487 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.461+0000 7f7ad57fa700 1 -- 172.21.15.50:0/1836066001 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ad001a450 con 0x7f7ae006a6c0 2023-10-06T01:22:02.488 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.461+0000 7f7ad57fa700 1 -- 172.21.15.50:0/1836066001 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ad001a5b0 con 0x7f7ae006a6c0 2023-10-06T01:22:02.488 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.461+0000 7f7ad57fa700 1 -- 172.21.15.50:0/1836066001 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ad001a950 con 0x7f7ae006a6c0 2023-10-06T01:22:02.488 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.461+0000 7fd58fbff700 1 Processor -- start 2023-10-06T01:22:02.488 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.461+0000 7fd58fbff700 1 -- start start 2023-10-06T01:22:02.488 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.462+0000 7f76a259c700 1 --2- 172.21.15.50:0/3309957259 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f76a41594b0 0x7f76a40ccc60 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f76a40cd8c0 tx=0x7f768c009220 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8aa73934a69ec071 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:22:02.489 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.462+0000 7f76a159a700 1 -- 172.21.15.50:0/3309957259 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f768c005c10 con 0x7f76a41594b0 2023-10-06T01:22:02.489 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.462+0000 7f76a159a700 1 -- 172.21.15.50:0/3309957259 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f768c005d70 con 0x7f76a41594b0 2023-10-06T01:22:02.489 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.462+0000 7f76a159a700 1 -- 172.21.15.50:0/3309957259 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f768c00b860 con 0x7f76a41594b0 2023-10-06T01:22:02.489 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.462+0000 7fa3447ff700 1 Processor -- start 2023-10-06T01:22:02.489 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.463+0000 7f8e5e9ff700 1 Processor -- start 2023-10-06T01:22:02.490 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.463+0000 7f7ae639d700 1 -- 172.21.15.50:0/1836066001 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7ae0154dc0 con 0x7f7ae006a6c0 2023-10-06T01:22:02.490 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.463+0000 7f8e5e9ff700 1 -- start start 2023-10-06T01:22:02.490 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.463+0000 7f7ae639d700 1 -- 172.21.15.50:0/1836066001 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7ae0155380 con 0x7f7ae006a6c0 2023-10-06T01:22:02.491 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.463+0000 7fd58fbff700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd5880c9fe0 0x7fd5881513a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:02.491 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.463+0000 7fd58fbff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd58815d5f0 0x7fd5880b01a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:02.491 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.463+0000 7fd58fbff700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd58815d9c0 0x7fd5880c8b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:02.491 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.463+0000 7fd58fbff700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5880ac710 con 0x7fd58815d5f0 2023-10-06T01:22:02.491 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.463+0000 7fd58fbff700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5880acfb0 con 0x7fd58815d9c0 2023-10-06T01:22:02.491 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.463+0000 7fd58fbff700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5880b0b60 con 0x7fd5880c9fe0 2023-10-06T01:22:02.491 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.463+0000 7f76a89ff700 1 -- 172.21.15.50:0/3309957259 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f76a41594b0 msgr2=0x7f76a40ccc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:02.491 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.463+0000 7f76a89ff700 1 --2- 172.21.15.50:0/3309957259 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f76a41594b0 0x7f76a40ccc60 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f76a40cd8c0 tx=0x7f768c009220 comp rx=0 tx=0).stop 2023-10-06T01:22:02.492 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.464+0000 7fa3447ff700 1 -- start start 2023-10-06T01:22:02.492 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.464+0000 7fd58e19c700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd58815d9c0 0x7fd5880c8b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:02.492 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.464+0000 7fd58d19a700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd58815d5f0 0x7fd5880b01a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:02.492 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.464+0000 7fd58d19a700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd58815d5f0 0x7fd5880b01a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:48078/0 (socket says 172.21.15.50:48078) 2023-10-06T01:22:02.492 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.464+0000 7fd58d19a700 1 -- 172.21.15.50:0/2222827814 learned_addr learned my addr 172.21.15.50:0/2222827814 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-06T01:22:02.492 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.464+0000 7fd58d99b700 1 --2- 172.21.15.50:0/2222827814 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd5880c9fe0 0x7fd5881513a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:02.493 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.465+0000 7f8e5e9ff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8e5806e4c0 0x7f8e58098050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:02.493 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.465+0000 7f8e5e9ff700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8e580c92d0 0x7f8e58154070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:02.493 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.465+0000 7fd58e19c700 1 -- 172.21.15.50:0/2222827814 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd5880c9fe0 msgr2=0x7fd5881513a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:02.493 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.465+0000 7fd58e19c700 1 --2- 172.21.15.50:0/2222827814 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd5880c9fe0 0x7fd5881513a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:02.494 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.465+0000 7fd58e19c700 1 -- 172.21.15.50:0/2222827814 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd58815d5f0 msgr2=0x7fd5880b01a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:02.494 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.465+0000 7fd58e19c700 1 --2- 172.21.15.50:0/2222827814 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd58815d5f0 0x7fd5880b01a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:02.494 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.465+0000 7fd58e19c700 1 -- 172.21.15.50:0/2222827814 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd580009ae0 con 0x7fd58815d9c0 2023-10-06T01:22:02.494 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.465+0000 7fd58e19c700 1 --2- 172.21.15.50:0/2222827814 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd58815d9c0 0x7fd5880c8b70 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fd5880ca440 tx=0x7fd584008040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:22:02.494 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.465+0000 7f8e4ffff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8e5806e4c0 0x7f8e58098050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:02.494 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.465+0000 7f76a89ff700 1 -- 172.21.15.50:0/3309957259 shutdown_connections 2023-10-06T01:22:02.495 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.465+0000 7f76a89ff700 1 --2- 172.21.15.50:0/3309957259 >> v2:172.21.15.50:3300/0 conn(0x7f76a40cef00 0x7f76a40c5250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:02.495 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.465+0000 7f76a89ff700 1 --2- 172.21.15.50:0/3309957259 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f76a41594b0 0x7f76a40ccc60 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:02.495 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.465+0000 7f76a89ff700 1 --2- 172.21.15.50:0/3309957259 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f76a40cd1a0 0x7f76a40ce9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:02.495 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.465+0000 7f76a89ff700 1 -- 172.21.15.50:0/3309957259 >> 172.21.15.50:0/3309957259 conn(0x7f76a4099600 msgr2=0x7f76a406f500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:22:02.495 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.465+0000 7f8e57fff700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8e580c92d0 0x7f8e58154070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:02.495 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.466+0000 7f8e57fff700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8e580c92d0 0x7f8e58154070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3301/0 says I am v2:172.21.15.50:49680/0 (socket says 172.21.15.50:49680) 2023-10-06T01:22:02.496 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.466+0000 7fd57dffb700 1 -- 172.21.15.50:0/2222827814 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd584011600 con 0x7fd58815d9c0 2023-10-06T01:22:02.496 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.466+0000 7fd57dffb700 1 -- 172.21.15.50:0/2222827814 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd584011760 con 0x7fd58815d9c0 2023-10-06T01:22:02.496 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.466+0000 7fd57dffb700 1 -- 172.21.15.50:0/2222827814 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd584011b20 con 0x7fd58815d9c0 2023-10-06T01:22:02.496 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.462+0000 7fe6e0f9d700 1 -- 172.21.15.50:0/3519207835 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fe6dc05f270 con 0x7fe6dc0c53d0 2023-10-06T01:22:02.496 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.464+0000 7fe6d37fe700 1 -- 172.21.15.50:0/3519207835 <== mon.2 v2:172.21.15.155:3301/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fe6cc01b400 con 0x7fe6dc0c53d0 2023-10-06T01:22:02.496 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.465+0000 7fe6d37fe700 1 --2- 172.21.15.50:0/3519207835 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7fe6bc067080 0x7fe6bc069530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:02.496 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.466+0000 7fe6d37fe700 1 -- 172.21.15.50:0/3519207835 <== mon.2 v2:172.21.15.155:3301/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6809+0+0 (secure 0 0 0) 0x7fe6cc084cd0 con 0x7fe6dc0c53d0 2023-10-06T01:22:02.497 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.466+0000 7fe6db7fe700 1 --2- 172.21.15.50:0/3519207835 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7fe6bc067080 0x7fe6bc069530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:02.497 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.466+0000 7f8e57fff700 1 -- 172.21.15.50:0/2172171861 learned_addr learned my addr 172.21.15.50:0/2172171861 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-06T01:22:02.497 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.466+0000 7fe6d37fe700 1 --2- 172.21.15.50:0/3519207835 >> [v2:172.21.15.50:6816/87856,v1:172.21.15.50:6817/87856] conn(0x7fe6bc070d50 0x7fe6bc073180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:02.497 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.466+0000 7f76a89ff700 1 -- 172.21.15.50:0/3309957259 shutdown_connections 2023-10-06T01:22:02.498 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.466+0000 7f8e5e9ff700 1 --2- 172.21.15.50:0/2172171861 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8e580b10e0 0x7f8e580b1550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:02.498 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.466+0000 7fa34259b700 1 --1- >> v1:172.21.15.155:6789/0 conn(0x7fa33c1595a0 0x7fa33c0aa570 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.155:6789/0 says I am v1:172.21.15.50:56972/0 (socket says 172.21.15.50:56972) 2023-10-06T01:22:02.498 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.466+0000 7fa3447ff700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fa33c0b07a0 0x7fa33c0ccfd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:02.498 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.466+0000 7fa34259b700 1 -- 172.21.15.50:0/1608328506 learned_addr learned my addr 172.21.15.50:0/1608328506 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-10-06T01:22:02.499 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.466+0000 7fa3447ff700 1 -- 172.21.15.50:0/1608328506 --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa33c0b0ca0 con 0x7fa33c0b49e0 2023-10-06T01:22:02.499 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.465+0000 7f7ae639d700 1 -- 172.21.15.50:0/1836066001 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f7ae013d400 con 0x7f7ae006a6c0 2023-10-06T01:22:02.499 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.466+0000 7fa3447ff700 1 -- 172.21.15.50:0/1608328506 --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa33c0b0f80 con 0x7fa33c1595a0 2023-10-06T01:22:02.499 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.466+0000 7fa3447ff700 1 -- 172.21.15.50:0/1608328506 --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa33c0ab390 con 0x7fa33c0b07a0 2023-10-06T01:22:02.500 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.466+0000 7f8e5e9ff700 1 -- 172.21.15.50:0/2172171861 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e580b1a90 con 0x7f8e5806e4c0 2023-10-06T01:22:02.500 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.467+0000 7f8e5cf9c700 1 --2- 172.21.15.50:0/2172171861 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8e580b10e0 0x7f8e580b1550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:02.500 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.467+0000 7f8e5e9ff700 1 -- 172.21.15.50:0/2172171861 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e58158c30 con 0x7f8e580b10e0 2023-10-06T01:22:02.500 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.466+0000 7fe6d37fe700 1 -- 172.21.15.50:0/3519207835 --> [v2:172.21.15.50:6816/87856,v1:172.21.15.50:6817/87856] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fe6bc073850 con 0x7fe6bc070d50 2023-10-06T01:22:02.500 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.467+0000 7f8e5e9ff700 1 -- 172.21.15.50:0/2172171861 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e580b2260 con 0x7f8e580c92d0 2023-10-06T01:22:02.501 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.467+0000 7fe6d37fe700 1 -- 172.21.15.50:0/3519207835 <== mon.2 v2:172.21.15.155:3301/0 6 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe6cc08a220 con 0x7fe6dc0c53d0 2023-10-06T01:22:02.501 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.467+0000 7fa341599700 1 -- 172.21.15.50:0/1608328506 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1687090818 0 0) 0x7fa33c0b0f80 con 0x7fa33c1595a0 2023-10-06T01:22:02.501 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.467+0000 7fa341599700 1 -- 172.21.15.50:0/1608328506 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa328003570 con 0x7fa33c1595a0 2023-10-06T01:22:02.501 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.467+0000 7fe6daffd700 1 --2- 172.21.15.50:0/3519207835 >> [v2:172.21.15.50:6816/87856,v1:172.21.15.50:6817/87856] conn(0x7fe6bc070d50 0x7fe6bc073180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:02.502 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.467+0000 7fe6db7fe700 1 --2- 172.21.15.50:0/3519207835 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7fe6bc067080 0x7fe6bc069530 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fe6c40099b0 tx=0x7fe6c4016000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:22:02.502 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.467+0000 7fa341599700 1 -- 172.21.15.50:0/1608328506 <== mon.1 v1:172.21.15.155:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1579307924 0 0) 0x7fa328003570 con 0x7fa33c1595a0 2023-10-06T01:22:02.502 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.467+0000 7fa341599700 1 -- 172.21.15.50:0/1608328506 >> v2:172.21.15.50:3300/0 conn(0x7fa33c0b07a0 msgr2=0x7fa33c0ccfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:22:02.502 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.467+0000 7fa341599700 1 --2- 172.21.15.50:0/1608328506 >> v2:172.21.15.50:3300/0 conn(0x7fa33c0b07a0 0x7fa33c0ccfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:02.502 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.467+0000 7fa341599700 1 -- 172.21.15.50:0/1608328506 >> v1:172.21.15.50:6789/0 conn(0x7fa33c0b49e0 legacy=0x7fa33c0aac80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:22:02.502 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.467+0000 7fa341599700 1 -- 172.21.15.50:0/1608328506 --> v1:172.21.15.155:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa33c0b1260 con 0x7fa33c1595a0 2023-10-06T01:22:02.502 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.467+0000 7fa341599700 1 -- 172.21.15.50:0/1608328506 <== mon.1 v1:172.21.15.155:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 347519148 0 0) 0x7fa32c0014c0 con 0x7fa33c1595a0 2023-10-06T01:22:02.502 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.468+0000 7fa341599700 1 -- 172.21.15.50:0/1608328506 >> v1:172.21.15.155:6789/0 conn(0x7fa33c1595a0 legacy=0x7fa33c0aa570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:02.502 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.468+0000 7fa341599700 1 --2- 172.21.15.50:0/1608328506 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa328003ae0 0x7fa328003ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:02.503 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.468+0000 7fa341599700 1 --2- 172.21.15.50:0/1608328506 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa328004810 0x7fa328004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:02.503 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.468+0000 7fa341599700 1 --2- 172.21.15.50:0/1608328506 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa3280053c0 0x7fa328014290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:02.503 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.468+0000 7fa341599700 1 -- 172.21.15.50:0/1608328506 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa33c0ab390 con 0x7fa3280053c0 2023-10-06T01:22:02.503 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.468+0000 7fa341599700 1 -- 172.21.15.50:0/1608328506 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa328014ad0 con 0x7fa328004810 2023-10-06T01:22:02.503 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.468+0000 7fa341599700 1 -- 172.21.15.50:0/1608328506 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa328014c90 con 0x7fa328003ae0 2023-10-06T01:22:02.503 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.468+0000 7f8e4ffff700 1 -- 172.21.15.50:0/2172171861 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8e580c92d0 msgr2=0x7f8e58154070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:02.503 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.468+0000 7fa341d9a700 1 --2- 172.21.15.50:0/1608328506 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa328004810 0x7fa328004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:02.504 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.468+0000 7fe6daffd700 1 --2- 172.21.15.50:0/3519207835 >> [v2:172.21.15.50:6816/87856,v1:172.21.15.50:6817/87856] conn(0x7fe6bc070d50 0x7fe6bc073180 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:22:02.504 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.468+0000 7f8e4ffff700 1 --2- 172.21.15.50:0/2172171861 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8e580c92d0 0x7f8e58154070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:02.504 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.468+0000 7fa34259b700 1 --2- 172.21.15.50:0/1608328506 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa328003ae0 0x7fa328003ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:02.504 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.469+0000 7fa342d9c700 1 --2- 172.21.15.50:0/1608328506 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa3280053c0 0x7fa328014290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:02.505 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.468+0000 7f8e4ffff700 1 -- 172.21.15.50:0/2172171861 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8e580b10e0 msgr2=0x7f8e580b1550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:02.505 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.468+0000 7f8e4ffff700 1 --2- 172.21.15.50:0/2172171861 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8e580b10e0 0x7f8e580b1550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:02.505 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.468+0000 7f8e4ffff700 1 -- 172.21.15.50:0/2172171861 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e48009420 con 0x7f8e5806e4c0 2023-10-06T01:22:02.505 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.466+0000 7f76a89ff700 1 -- 172.21.15.50:0/3309957259 wait complete. 2023-10-06T01:22:02.506 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.469+0000 7f76a89ff700 1 Processor -- start 2023-10-06T01:22:02.506 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.469+0000 7f8e4ffff700 1 --2- 172.21.15.50:0/2172171861 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8e5806e4c0 0x7f8e58098050 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f8e40000c00 tx=0x7f8e40007e20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:22:02.506 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.469+0000 7f76a89ff700 1 -- start start 2023-10-06T01:22:02.506 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.469+0000 7f8e54ff9700 1 -- 172.21.15.50:0/2172171861 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e40005b30 con 0x7f8e5806e4c0 2023-10-06T01:22:02.507 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.469+0000 7fa341d9a700 1 -- 172.21.15.50:0/1608328506 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa328003ae0 msgr2=0x7fa328003ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:22:02.507 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.470+0000 7f8e54ff9700 1 -- 172.21.15.50:0/2172171861 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e40005cd0 con 0x7f8e5806e4c0 2023-10-06T01:22:02.508 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.470+0000 7fa341d9a700 1 --2- 172.21.15.50:0/1608328506 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa328003ae0 0x7fa328003ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:02.508 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.470+0000 7fa341d9a700 1 -- 172.21.15.50:0/1608328506 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa3280053c0 msgr2=0x7fa328014290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:22:02.508 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.470+0000 7fa341d9a700 1 --2- 172.21.15.50:0/1608328506 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa3280053c0 0x7fa328014290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:02.508 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.470+0000 7f8e5e9ff700 1 -- 172.21.15.50:0/2172171861 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8e580b1ca0 con 0x7f8e5806e4c0 2023-10-06T01:22:02.508 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.470+0000 7fa341d9a700 1 -- 172.21.15.50:0/1608328506 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa33c0b1260 con 0x7fa328004810 2023-10-06T01:22:02.509 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.470+0000 7fe6d37fe700 1 -- 172.21.15.50:0/3519207835 <== osd.3 v2:172.21.15.50:6816/87856 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7fe6bc073850 con 0x7fe6bc070d50 2023-10-06T01:22:02.509 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.470+0000 7fa342d9c700 1 -- 172.21.15.50:0/1608328506 reap_dead start 2023-10-06T01:22:02.509 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.470+0000 7fd58fbff700 1 -- 172.21.15.50:0/2222827814 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd5880ac960 con 0x7fd58815d9c0 2023-10-06T01:22:02.510 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.471+0000 7fa341d9a700 1 --2- 172.21.15.50:0/1608328506 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa328004810 0x7fa328004c80 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fa33c088e20 tx=0x7fa334002550 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fe8224fb2a8f3a66 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:22:02.510 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.471+0000 7fd58fbff700 1 -- 172.21.15.50:0/2222827814 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd5881521b0 con 0x7fd58815d9c0 2023-10-06T01:22:02.510 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.471+0000 7f76a89ff700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f76a40cd1a0 0x7f76a4151720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:02.510 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.471+0000 7fa341599700 1 -- 172.21.15.50:0/1608328506 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa334002860 con 0x7fa328004810 2023-10-06T01:22:02.511 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.471+0000 7f76a89ff700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f76a40cef00 0x7f76a4159f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:02.511 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.471+0000 7f76a259c700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f76a40cd1a0 0x7f76a4151720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:02.511 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.472+0000 7fa341599700 1 -- 172.21.15.50:0/1608328506 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa334006ba0 con 0x7fa328004810 2023-10-06T01:22:02.512 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.472+0000 7f76a259c700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f76a40cd1a0 0x7f76a4151720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3301/0 says I am v2:172.21.15.50:49702/0 (socket says 172.21.15.50:49702) 2023-10-06T01:22:02.512 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.472+0000 7fa341599700 1 -- 172.21.15.50:0/1608328506 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa334002860 con 0x7fa328004810 2023-10-06T01:22:02.512 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.472+0000 7f76a89ff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f76a41594b0 0x7f76a4099f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:02.512 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.472+0000 7fd56b7fe700 1 -- 172.21.15.50:0/2222827814 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fd58805f270 con 0x7fd58815d9c0 2023-10-06T01:22:02.513 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.470+0000 7f7ad57fa700 1 -- 172.21.15.50:0/1836066001 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f7ad001ad00 con 0x7f7ae006a6c0 2023-10-06T01:22:02.513 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.472+0000 7f7ad57fa700 1 --2- 172.21.15.50:0/1836066001 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f7ac4067000 0x7f7ac40694b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:02.513 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.472+0000 7f76a2d9d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f76a41594b0 0x7f76a4099f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:02.514 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.472+0000 7f7ad57fa700 1 -- 172.21.15.50:0/1836066001 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f7ad0086590 con 0x7f7ae006a6c0 2023-10-06T01:22:02.514 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.472+0000 7f7ad57fa700 1 --2- 172.21.15.50:0/1836066001 >> [v2:172.21.15.50:6808/87853,v1:172.21.15.50:6809/87853] conn(0x7f7ac4070cd0 0x7f7ac4073100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:02.514 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.473+0000 7f76a1d9b700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f76a40cef00 0x7f76a4159f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:02.514 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.473+0000 7f76a1d9b700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f76a40cef00 0x7f76a4159f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.50:54256/0 (socket says 172.21.15.50:54256) 2023-10-06T01:22:02.514 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.473+0000 7f76a2d9d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f76a41594b0 0x7f76a4099f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:48114/0 (socket says 172.21.15.50:48114) 2023-10-06T01:22:02.515 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.473+0000 7f76a259c700 1 -- 172.21.15.50:0/4229138925 learned_addr learned my addr 172.21.15.50:0/4229138925 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-06T01:22:02.515 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.472+0000 7f7ad57fa700 1 -- 172.21.15.50:0/1836066001 --> [v2:172.21.15.50:6808/87853,v1:172.21.15.50:6809/87853] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f7ac40737d0 con 0x7f7ac4070cd0 2023-10-06T01:22:02.515 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.473+0000 7f76a89ff700 1 -- 172.21.15.50:0/4229138925 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76a409a4b0 con 0x7f76a41594b0 2023-10-06T01:22:02.515 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.473+0000 7fa3447ff700 1 -- 172.21.15.50:0/1608328506 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa328004810 msgr2=0x7fa328004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:02.516 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.473+0000 7f76a89ff700 1 -- 172.21.15.50:0/4229138925 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76a41691c0 con 0x7f76a40cef00 2023-10-06T01:22:02.516 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.473+0000 7fa3447ff700 1 --2- 172.21.15.50:0/1608328506 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa328004810 0x7fa328004c80 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fa33c088e20 tx=0x7fa334002550 comp rx=0 tx=0).stop 2023-10-06T01:22:02.516 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.473+0000 7f76a89ff700 1 -- 172.21.15.50:0/4229138925 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76a40c8610 con 0x7f76a40cd1a0 2023-10-06T01:22:02.517 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.472+0000 7f7ad57fa700 1 -- 172.21.15.50:0/1836066001 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7ad0088a90 con 0x7f7ae006a6c0 2023-10-06T01:22:02.517 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.473+0000 7f7ae4b9a700 1 --2- 172.21.15.50:0/1836066001 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f7ac4067000 0x7f7ac40694b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:02.517 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.473+0000 7fa3447ff700 1 -- 172.21.15.50:0/1608328506 shutdown_connections 2023-10-06T01:22:02.517 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.473+0000 7fa3447ff700 1 --2- 172.21.15.50:0/1608328506 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa328004810 0x7fa328004c80 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:02.518 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.473+0000 7fa3447ff700 1 -- 172.21.15.50:0/1608328506 >> 172.21.15.50:0/1608328506 conn(0x7fa33c099830 msgr2=0x7fa33c06f500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:22:02.518 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.473+0000 7f7ae5b9c700 1 --2- 172.21.15.50:0/1836066001 >> [v2:172.21.15.50:6808/87853,v1:172.21.15.50:6809/87853] conn(0x7f7ac4070cd0 0x7f7ac4073100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:02.518 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.474+0000 7f7ae4b9a700 1 --2- 172.21.15.50:0/1836066001 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f7ac4067000 0x7f7ac40694b0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f7adc00f570 tx=0x7f7adc007750 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:22:02.519 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.474+0000 7f76a259c700 1 -- 172.21.15.50:0/4229138925 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f76a40cef00 msgr2=0x7f76a4159f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:02.519 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.474+0000 7f76a259c700 1 --2- 172.21.15.50:0/4229138925 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f76a40cef00 0x7f76a4159f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:02.519 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.474+0000 7f76a259c700 1 -- 172.21.15.50:0/4229138925 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f76a41594b0 msgr2=0x7f76a4099f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:02.519 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.474+0000 7f76a259c700 1 --2- 172.21.15.50:0/4229138925 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f76a41594b0 0x7f76a4099f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:02.519 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.474+0000 7f76a259c700 1 -- 172.21.15.50:0/4229138925 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f768c009480 con 0x7f76a40cd1a0 2023-10-06T01:22:02.519 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.474+0000 7f7ae5b9c700 1 --2- 172.21.15.50:0/1836066001 >> [v2:172.21.15.50:6808/87853,v1:172.21.15.50:6809/87853] conn(0x7f7ac4070cd0 0x7f7ac4073100 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:22:02.520 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.475+0000 7fa3447ff700 1 -- 172.21.15.50:0/1608328506 shutdown_connections 2023-10-06T01:22:02.520 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.474+0000 7f76a2d9d700 1 --2- 172.21.15.50:0/4229138925 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f76a41594b0 0x7f76a4099f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T01:22:02.520 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.475+0000 7f76a259c700 1 --2- 172.21.15.50:0/4229138925 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f76a40cd1a0 0x7f76a4151720 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f768c012000 tx=0x7f768c016000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:22:02.520 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.475+0000 7f769a7fc700 1 -- 172.21.15.50:0/4229138925 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f768c00be60 con 0x7f76a40cd1a0 2023-10-06T01:22:02.521 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.475+0000 7f769a7fc700 1 -- 172.21.15.50:0/4229138925 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f768c01a420 con 0x7f76a40cd1a0 2023-10-06T01:22:02.521 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.476+0000 7f76a89ff700 1 -- 172.21.15.50:0/4229138925 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f76a40c88f0 con 0x7f76a40cd1a0 2023-10-06T01:22:02.521 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.476+0000 7fa3447ff700 1 -- 172.21.15.50:0/1608328506 wait complete. 2023-10-06T01:22:02.521 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.474+0000 7f8e54ff9700 1 -- 172.21.15.50:0/2172171861 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e40007320 con 0x7f8e5806e4c0 2023-10-06T01:22:02.521 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.476+0000 7f7ad57fa700 1 -- 172.21.15.50:0/1836066001 <== osd.1 v2:172.21.15.50:6808/87853 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7f7ac40737d0 con 0x7f7ac4070cd0 2023-10-06T01:22:02.522 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.474+0000 7f8e5e9ff700 1 -- 172.21.15.50:0/2172171861 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8e58156b80 con 0x7f8e5806e4c0 2023-10-06T01:22:02.522 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.474+0000 7f8e5e9ff700 1 -- 172.21.15.50:0/2172171861 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f8e58064ad0 con 0x7f8e5806e4c0 2023-10-06T01:22:02.522 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.475+0000 7f8e54ff9700 1 -- 172.21.15.50:0/2172171861 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f8e40013770 con 0x7f8e5806e4c0 2023-10-06T01:22:02.522 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.476+0000 7f76a89ff700 1 -- 172.21.15.50:0/4229138925 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f76a415c650 con 0x7f76a40cd1a0 2023-10-06T01:22:02.523 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.476+0000 7f769a7fc700 1 -- 172.21.15.50:0/4229138925 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f768c01a7e0 con 0x7f76a40cd1a0 2023-10-06T01:22:02.523 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.476+0000 7fd57dffb700 1 -- 172.21.15.50:0/2222827814 <== mon.1 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fd5840193f0 con 0x7fd58815d9c0 2023-10-06T01:22:02.523 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.477+0000 7fd57dffb700 1 --2- 172.21.15.50:0/2222827814 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7fd56c067080 0x7fd56c069530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:02.523 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.477+0000 7fd57dffb700 1 -- 172.21.15.50:0/2222827814 <== mon.1 v2:172.21.15.155:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6809+0+0 (secure 0 0 0) 0x7fd584084b40 con 0x7fd58815d9c0 2023-10-06T01:22:02.523 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.477+0000 7f8e54ff9700 1 --2- 172.21.15.50:0/2172171861 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f8e38066f80 0x7f8e38069430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:02.524 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.478+0000 7fd57dffb700 1 --2- 172.21.15.50:0/2222827814 >> [v2:172.21.15.155:6808/85806,v1:172.21.15.155:6809/85806] conn(0x7fd56c070d50 0x7fd56c073180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:02.524 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.478+0000 7fd57dffb700 1 -- 172.21.15.50:0/2222827814 --> [v2:172.21.15.155:6808/85806,v1:172.21.15.155:6809/85806] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fd56c073850 con 0x7fd56c070d50 2023-10-06T01:22:02.524 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.478+0000 7fd57dffb700 1 -- 172.21.15.50:0/2222827814 <== mon.1 v2:172.21.15.155:3300/0 6 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd584084e70 con 0x7fd58815d9c0 2023-10-06T01:22:02.524 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.478+0000 7f8e54ff9700 1 -- 172.21.15.50:0/2172171861 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f8e40087870 con 0x7f8e5806e4c0 2023-10-06T01:22:02.524 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.478+0000 7f8e54ff9700 1 --2- 172.21.15.50:0/2172171861 >> [v2:172.21.15.155:6800/85805,v1:172.21.15.155:6801/85805] conn(0x7f8e38070ae0 0x7f8e38072f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:02.525 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.478+0000 7f8e54ff9700 1 -- 172.21.15.50:0/2172171861 --> [v2:172.21.15.155:6800/85805,v1:172.21.15.155:6801/85805] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f8e380735e0 con 0x7f8e38070ae0 2023-10-06T01:22:02.525 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.478+0000 7f8e54ff9700 1 -- 172.21.15.50:0/2172171861 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8e40087ab0 con 0x7f8e5806e4c0 2023-10-06T01:22:02.525 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.478+0000 7fd58d19a700 1 --2- 172.21.15.50:0/2222827814 >> [v2:172.21.15.155:6808/85806,v1:172.21.15.155:6809/85806] conn(0x7fd56c070d50 0x7fd56c073180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:02.525 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.478+0000 7fd58d99b700 1 --2- 172.21.15.50:0/2222827814 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7fd56c067080 0x7fd56c069530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:02.525 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.479+0000 7fd58d19a700 1 --2- 172.21.15.50:0/2222827814 >> [v2:172.21.15.155:6808/85806,v1:172.21.15.155:6809/85806] conn(0x7fd56c070d50 0x7fd56c073180 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:22:02.526 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.479+0000 7fd58d99b700 1 --2- 172.21.15.50:0/2222827814 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7fd56c067080 0x7fd56c069530 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fd580009880 tx=0x7fd580018000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:22:02.526 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.479+0000 7f8e5cf9c700 1 --2- 172.21.15.50:0/2172171861 >> [v2:172.21.15.155:6800/85805,v1:172.21.15.155:6801/85805] conn(0x7f8e38070ae0 0x7f8e38072f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:02.526 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.479+0000 7f8e57fff700 1 --2- 172.21.15.50:0/2172171861 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f8e38066f80 0x7f8e38069430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:02.526 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.479+0000 7fa3447ff700 1 Processor -- start 2023-10-06T01:22:02.527 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.479+0000 7f769a7fc700 1 -- 172.21.15.50:0/4229138925 <== mon.2 v2:172.21.15.155:3301/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f768c01abd0 con 0x7f76a40cd1a0 2023-10-06T01:22:02.527 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.480+0000 7f76a89ff700 1 -- 172.21.15.50:0/4229138925 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f7688000fd0 con 0x7f76a40cd1a0 2023-10-06T01:22:02.527 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.480+0000 7fa3447ff700 1 -- start start 2023-10-06T01:22:02.527 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.480+0000 7f8e5cf9c700 1 --2- 172.21.15.50:0/2172171861 >> [v2:172.21.15.155:6800/85805,v1:172.21.15.155:6801/85805] conn(0x7f8e38070ae0 0x7f8e38072f10 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:22:02.528 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.480+0000 7f769a7fc700 1 --2- 172.21.15.50:0/4229138925 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f7684067080 0x7f7684069530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:02.528 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.481+0000 7fd57dffb700 1 -- 172.21.15.50:0/2222827814 <== osd.6 v2:172.21.15.155:6808/85806 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7fd56c073850 con 0x7fd56c070d50 2023-10-06T01:22:02.528 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.481+0000 7f769a7fc700 1 -- 172.21.15.50:0/4229138925 <== mon.2 v2:172.21.15.155:3301/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f768c085b50 con 0x7f76a40cd1a0 2023-10-06T01:22:02.529 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.481+0000 7f769a7fc700 1 --2- 172.21.15.50:0/4229138925 >> [v2:172.21.15.155:6816/85807,v1:172.21.15.155:6818/85807] conn(0x7f7684070d50 0x7f7684073180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:02.529 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.481+0000 7f769a7fc700 1 -- 172.21.15.50:0/4229138925 --> [v2:172.21.15.155:6816/85807,v1:172.21.15.155:6818/85807] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f7684073850 con 0x7f7684070d50 2023-10-06T01:22:02.529 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.481+0000 7f769a7fc700 1 -- 172.21.15.50:0/4229138925 <== mon.2 v2:172.21.15.155:3301/0 6 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7f768c08a200 con 0x7f76a40cd1a0 2023-10-06T01:22:02.529 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.481+0000 7f8e57fff700 1 --2- 172.21.15.50:0/2172171861 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f8e38066f80 0x7f8e38069430 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f8e480091e0 tx=0x7f8e48017000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:22:02.529 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.482+0000 7fa3447ff700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa328004810 0x7fa33c06d130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:02.530 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.482+0000 7f8e54ff9700 1 -- 172.21.15.50:0/2172171861 <== osd.4 v2:172.21.15.155:6800/85805 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7f8e380735e0 con 0x7f8e38070ae0 2023-10-06T01:22:02.530 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.482+0000 7f76a1d9b700 1 --2- 172.21.15.50:0/4229138925 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f7684067080 0x7f7684069530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:02.531 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.482+0000 7fa3447ff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa33c153c30 0x7fa33c1540a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:02.531 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.482+0000 7fa34259b700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa328004810 0x7fa33c06d130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:02.531 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.482+0000 7fa34259b700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa328004810 0x7fa33c06d130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3301/0 says I am v2:172.21.15.50:49714/0 (socket says 172.21.15.50:49714) 2023-10-06T01:22:02.531 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.483+0000 7fa341d9a700 1 --2- 172.21.15.50:0/3564668007 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa33c153c30 0x7fa33c1540a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:02.531 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.482+0000 7fa34259b700 1 -- 172.21.15.50:0/3564668007 learned_addr learned my addr 172.21.15.50:0/3564668007 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-06T01:22:02.531 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.485+0000 7f76a2d9d700 1 --2- 172.21.15.50:0/4229138925 >> [v2:172.21.15.155:6816/85807,v1:172.21.15.155:6818/85807] conn(0x7f7684070d50 0x7f7684073180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:02.531 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.485+0000 7f76a1d9b700 1 --2- 172.21.15.50:0/4229138925 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f7684067080 0x7f7684069530 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f76a415c070 tx=0x7f7694008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:22:02.533 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.485+0000 7fa3447ff700 1 --2- 172.21.15.50:0/3564668007 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa33c0cde60 0x7fa33c0ce2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:02.533 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.486+0000 7fa3447ff700 1 -- 172.21.15.50:0/3564668007 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa33c1545e0 con 0x7fa33c153c30 2023-10-06T01:22:02.533 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.486+0000 7fa3447ff700 1 -- 172.21.15.50:0/3564668007 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa33c0ce820 con 0x7fa33c0cde60 2023-10-06T01:22:02.533 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.486+0000 7fa3447ff700 1 -- 172.21.15.50:0/3564668007 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa33c06da10 con 0x7fa328004810 2023-10-06T01:22:02.533 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.487+0000 7fa342d9c700 1 --2- 172.21.15.50:0/3564668007 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa33c0cde60 0x7fa33c0ce2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:02.533 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.487+0000 7fa34259b700 1 -- 172.21.15.50:0/3564668007 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa33c0cde60 msgr2=0x7fa33c0ce2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:02.533 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.487+0000 7fa34259b700 1 --2- 172.21.15.50:0/3564668007 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa33c0cde60 0x7fa33c0ce2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:02.533 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.487+0000 7fa34259b700 1 -- 172.21.15.50:0/3564668007 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa33c153c30 msgr2=0x7fa33c1540a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:02.533 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.487+0000 7fa34259b700 1 --2- 172.21.15.50:0/3564668007 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa33c153c30 0x7fa33c1540a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:02.533 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.487+0000 7fa34259b700 1 -- 172.21.15.50:0/3564668007 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa33c06dcf0 con 0x7fa328004810 2023-10-06T01:22:02.534 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.488+0000 7fa34259b700 1 --2- 172.21.15.50:0/3564668007 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa328004810 0x7fa33c06d130 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fa32c0077c0 tx=0x7fa32c001e50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:22:02.534 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.488+0000 7fa342d9c700 1 --2- 172.21.15.50:0/3564668007 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa33c0cde60 0x7fa33c0ce2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T01:22:02.534 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.488+0000 7fa3327fc700 1 -- 172.21.15.50:0/3564668007 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa32c018030 con 0x7fa328004810 2023-10-06T01:22:02.534 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.488+0000 7fa3327fc700 1 -- 172.21.15.50:0/3564668007 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa32c007e90 con 0x7fa328004810 2023-10-06T01:22:02.534 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.488+0000 7fa3327fc700 1 -- 172.21.15.50:0/3564668007 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa32c00fe70 con 0x7fa328004810 2023-10-06T01:22:02.534 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.488+0000 7fa3447ff700 1 -- 172.21.15.50:0/3564668007 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa33c06dfd0 con 0x7fa328004810 2023-10-06T01:22:02.534 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.489+0000 7f76a2d9d700 1 --2- 172.21.15.50:0/4229138925 >> [v2:172.21.15.155:6816/85807,v1:172.21.15.155:6818/85807] conn(0x7f7684070d50 0x7f7684073180 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:22:02.534 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.490+0000 7f769a7fc700 1 -- 172.21.15.50:0/4229138925 <== osd.5 v2:172.21.15.155:6816/85807 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7f7684073850 con 0x7f7684070d50 2023-10-06T01:22:02.535 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.492+0000 7fa3327fc700 1 -- 172.21.15.50:0/3564668007 <== mon.2 v2:172.21.15.155:3301/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fa32c01b070 con 0x7fa328004810 2023-10-06T01:22:02.535 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.493+0000 7f8242ffd700 1 -- 172.21.15.50:0/374242969 --> [v2:172.21.15.50:6800/87837,v1:172.21.15.50:6801/87837] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f8250007480 con 0x7f823c070c00 2023-10-06T01:22:02.535 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.493+0000 7fa3327fc700 1 --2- 172.21.15.50:0/3564668007 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7fa320067000 0x7fa3200694b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:02.536 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.494+0000 7f1c54ff9700 1 -- 172.21.15.50:0/3521162484 --> [v2:172.21.15.50:6821/87855,v1:172.21.15.50:6822/87855] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f1c48002d30 con 0x7f1c5c070c80 2023-10-06T01:22:02.536 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.494+0000 7fa3447ff700 1 -- 172.21.15.50:0/3564668007 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa33c06e590 con 0x7fa328004810 2023-10-06T01:22:02.536 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.494+0000 7f824d7fa700 1 -- 172.21.15.50:0/374242969 <== osd.0 v2:172.21.15.50:6800/87837 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f8250007480 con 0x7f823c070c00 2023-10-06T01:22:02.536 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.494+0000 7fa3327fc700 1 -- 172.21.15.50:0/3564668007 <== mon.2 v2:172.21.15.155:3301/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6809+0+0 (secure 0 0 0) 0x7fa32c019070 con 0x7fa328004810 2023-10-06T01:22:02.537 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.495+0000 7fa341d9a700 1 --2- 172.21.15.50:0/3564668007 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7fa320067000 0x7fa3200694b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:02.537 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.495+0000 7f1c56ffd700 1 -- 172.21.15.50:0/3521162484 <== osd.2 v2:172.21.15.50:6821/87855 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f1c48002d30 con 0x7f1c5c070c80 2023-10-06T01:22:02.537 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.495+0000 7f825e19d700 1 -- 172.21.15.50:0/374242969 >> [v2:172.21.15.50:6800/87837,v1:172.21.15.50:6801/87837] conn(0x7f823c070c00 msgr2=0x7f823c073030 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:02.538 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.495+0000 7fa3447ff700 1 --2- 172.21.15.50:0/3564668007 >> [v2:172.21.15.155:6817/85832,v1:172.21.15.155:6819/85832] conn(0x7fa33c159970 0x7fa33c159d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:02.538 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.495+0000 7fa3447ff700 1 -- 172.21.15.50:0/3564668007 --> [v2:172.21.15.155:6817/85832,v1:172.21.15.155:6819/85832] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fa33c0b1540 con 0x7fa33c159970 2023-10-06T01:22:02.538 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.496+0000 7fa342d9c700 1 --2- 172.21.15.50:0/3564668007 >> [v2:172.21.15.155:6817/85832,v1:172.21.15.155:6819/85832] conn(0x7fa33c159970 0x7fa33c159d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:02.539 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.495+0000 7f825e19d700 1 --2- 172.21.15.50:0/374242969 >> [v2:172.21.15.50:6800/87837,v1:172.21.15.50:6801/87837] conn(0x7f823c070c00 0x7f823c073030 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:02.539 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.495+0000 7f825e19d700 1 -- 172.21.15.50:0/374242969 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f823c066f30 msgr2=0x7f823c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:02.539 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.496+0000 7f1c753ff700 1 -- 172.21.15.50:0/3521162484 >> [v2:172.21.15.50:6821/87855,v1:172.21.15.50:6822/87855] conn(0x7f1c5c070c80 msgr2=0x7f1c5c0730b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:02.539 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.496+0000 7f1c753ff700 1 --2- 172.21.15.50:0/3521162484 >> [v2:172.21.15.50:6821/87855,v1:172.21.15.50:6822/87855] conn(0x7f1c5c070c80 0x7f1c5c0730b0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:02.540 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.495+0000 7f825e19d700 1 --2- 172.21.15.50:0/374242969 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f823c066f30 0x7f823c0693e0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f82540098e0 tx=0x7f8254016000 comp rx=0 tx=0).stop 2023-10-06T01:22:02.540 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.495+0000 7f825e19d700 1 -- 172.21.15.50:0/374242969 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f82500e9e20 msgr2=0x7f82500e00d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:02.540 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.495+0000 7f825e19d700 1 --2- 172.21.15.50:0/374242969 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f82500e9e20 0x7f82500e00d0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f824800d890 tx=0x7f8248008040 comp rx=0 tx=0).stop 2023-10-06T01:22:02.540 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.496+0000 7f1c753ff700 1 -- 172.21.15.50:0/3521162484 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f1c5c066fb0 msgr2=0x7f1c5c069460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:02.540 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.496+0000 7f1c753ff700 1 --2- 172.21.15.50:0/3521162484 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f1c5c066fb0 0x7f1c5c069460 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f1c68104c30 tx=0x7f1c60017000 comp rx=0 tx=0).stop 2023-10-06T01:22:02.541 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.496+0000 7f1c753ff700 1 -- 172.21.15.50:0/3521162484 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1c68100050 msgr2=0x7f1c68100d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:02.541 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.496+0000 7f1c753ff700 1 --2- 172.21.15.50:0/3521162484 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1c68100050 0x7f1c68100d60 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f1c6400c830 tx=0x7f1c64008040 comp rx=0 tx=0).stop 2023-10-06T01:22:02.541 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.497+0000 7f1c6f7fe700 1 -- 172.21.15.50:0/3521162484 reap_dead start 2023-10-06T01:22:02.541 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.497+0000 7f1c753ff700 1 -- 172.21.15.50:0/3521162484 shutdown_connections 2023-10-06T01:22:02.541 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.497+0000 7f1c753ff700 1 -- 172.21.15.50:0/3521162484 >> 172.21.15.50:0/3521162484 conn(0x7f1c680518a0 msgr2=0x7f1c68103db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:22:02.541 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.497+0000 7f825d99c700 1 -- 172.21.15.50:0/374242969 reap_dead start 2023-10-06T01:22:02.541 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.497+0000 7fa341d9a700 1 --2- 172.21.15.50:0/3564668007 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7fa320067000 0x7fa3200694b0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fa33c088e20 tx=0x7fa334015000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:22:02.542 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.497+0000 7f825e19d700 1 -- 172.21.15.50:0/374242969 shutdown_connections 2023-10-06T01:22:02.542 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.497+0000 7fa342d9c700 1 --2- 172.21.15.50:0/3564668007 >> [v2:172.21.15.155:6817/85832,v1:172.21.15.155:6819/85832] conn(0x7fa33c159970 0x7fa33c159d40 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:22:02.542 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.497+0000 7f825e19d700 1 -- 172.21.15.50:0/374242969 >> 172.21.15.50:0/374242969 conn(0x7f825000f1c0 msgr2=0x7f8250057420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:22:02.543 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.498+0000 7f1c753ff700 1 -- 172.21.15.50:0/3521162484 shutdown_connections 2023-10-06T01:22:02.543 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.498+0000 7f1c753ff700 1 -- 172.21.15.50:0/3521162484 wait complete. 2023-10-06T01:22:02.543 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.498+0000 7f825e19d700 1 -- 172.21.15.50:0/374242969 shutdown_connections 2023-10-06T01:22:02.543 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.498+0000 7f825e19d700 1 -- 172.21.15.50:0/374242969 wait complete. 2023-10-06T01:22:02.544 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.498+0000 7fa3327fc700 1 -- 172.21.15.50:0/3564668007 <== osd.7 v2:172.21.15.155:6817/85832 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7fa33c0b1540 con 0x7fa33c159970 2023-10-06T01:22:02.544 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.505+0000 7fe6e0f9d700 1 -- 172.21.15.50:0/3519207835 --> [v2:172.21.15.50:6816/87856,v1:172.21.15.50:6817/87856] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fe6dc06da40 con 0x7fe6bc070d50 2023-10-06T01:22:02.544 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.506+0000 7fe6d37fe700 1 -- 172.21.15.50:0/3519207835 <== osd.3 v2:172.21.15.50:6816/87856 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fe6dc06da40 con 0x7fe6bc070d50 2023-10-06T01:22:02.545 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.507+0000 7fe6e0f9d700 1 -- 172.21.15.50:0/3519207835 >> [v2:172.21.15.50:6816/87856,v1:172.21.15.50:6817/87856] conn(0x7fe6bc070d50 msgr2=0x7fe6bc073180 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:02.545 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.507+0000 7fe6e0f9d700 1 --2- 172.21.15.50:0/3519207835 >> [v2:172.21.15.50:6816/87856,v1:172.21.15.50:6817/87856] conn(0x7fe6bc070d50 0x7fe6bc073180 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:02.545 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.508+0000 7fe6e0f9d700 1 -- 172.21.15.50:0/3519207835 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7fe6bc067080 msgr2=0x7fe6bc069530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:02.545 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.508+0000 7fe6e0f9d700 1 --2- 172.21.15.50:0/3519207835 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7fe6bc067080 0x7fe6bc069530 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fe6c40099b0 tx=0x7fe6c4016000 comp rx=0 tx=0).stop 2023-10-06T01:22:02.545 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.508+0000 7fe6e0f9d700 1 -- 172.21.15.50:0/3519207835 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe6dc0c53d0 msgr2=0x7fe6dc0c5850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:02.546 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.508+0000 7fe6e0f9d700 1 --2- 172.21.15.50:0/3519207835 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe6dc0c53d0 0x7fe6dc0c5850 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fe6cc00c930 tx=0x7fe6cc0026e0 comp rx=0 tx=0).stop 2023-10-06T01:22:02.546 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.509+0000 7fe6dbfff700 1 -- 172.21.15.50:0/3519207835 reap_dead start 2023-10-06T01:22:02.546 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.509+0000 7fe6e0f9d700 1 -- 172.21.15.50:0/3519207835 shutdown_connections 2023-10-06T01:22:02.546 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.509+0000 7fe6e0f9d700 1 -- 172.21.15.50:0/3519207835 >> 172.21.15.50:0/3519207835 conn(0x7fe6dc0680c0 msgr2=0x7fe6dc0c1180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:22:02.546 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.511+0000 7fd56b7fe700 1 -- 172.21.15.50:0/2222827814 --> [v2:172.21.15.155:6808/85806,v1:172.21.15.155:6809/85806] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fd588069c90 con 0x7fd56c070d50 2023-10-06T01:22:02.546 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.511+0000 7fe6e0f9d700 1 -- 172.21.15.50:0/3519207835 shutdown_connections 2023-10-06T01:22:02.547 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.511+0000 7fe6e0f9d700 1 -- 172.21.15.50:0/3519207835 wait complete. 2023-10-06T01:22:02.547 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.512+0000 7fd57dffb700 1 -- 172.21.15.50:0/2222827814 <== osd.6 v2:172.21.15.155:6808/85806 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fd588069c90 con 0x7fd56c070d50 2023-10-06T01:22:02.547 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.513+0000 7fd56b7fe700 1 -- 172.21.15.50:0/2222827814 >> [v2:172.21.15.155:6808/85806,v1:172.21.15.155:6809/85806] conn(0x7fd56c070d50 msgr2=0x7fd56c073180 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:02.547 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.513+0000 7fd56b7fe700 1 --2- 172.21.15.50:0/2222827814 >> [v2:172.21.15.155:6808/85806,v1:172.21.15.155:6809/85806] conn(0x7fd56c070d50 0x7fd56c073180 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:02.548 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.513+0000 7f7ae639d700 1 -- 172.21.15.50:0/1836066001 --> [v2:172.21.15.50:6808/87853,v1:172.21.15.50:6809/87853] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f7ae005f270 con 0x7f7ac4070cd0 2023-10-06T01:22:02.548 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.513+0000 7fd56b7fe700 1 -- 172.21.15.50:0/2222827814 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7fd56c067080 msgr2=0x7fd56c069530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:02.548 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.514+0000 7fd56b7fe700 1 --2- 172.21.15.50:0/2222827814 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7fd56c067080 0x7fd56c069530 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fd580009880 tx=0x7fd580018000 comp rx=0 tx=0).stop 2023-10-06T01:22:02.548 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.514+0000 7fd56b7fe700 1 -- 172.21.15.50:0/2222827814 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd58815d9c0 msgr2=0x7fd5880c8b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:02.548 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.514+0000 7fd56b7fe700 1 --2- 172.21.15.50:0/2222827814 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd58815d9c0 0x7fd5880c8b70 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fd5880ca440 tx=0x7fd584008040 comp rx=0 tx=0).stop 2023-10-06T01:22:02.548 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.514+0000 7f7ad57fa700 1 -- 172.21.15.50:0/1836066001 <== osd.1 v2:172.21.15.50:6808/87853 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f7ae005f270 con 0x7f7ac4070cd0 2023-10-06T01:22:02.549 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.514+0000 7fd58e19c700 1 -- 172.21.15.50:0/2222827814 reap_dead start 2023-10-06T01:22:02.549 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.515+0000 7fd56b7fe700 1 -- 172.21.15.50:0/2222827814 shutdown_connections 2023-10-06T01:22:02.550 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.515+0000 7f7ae639d700 1 -- 172.21.15.50:0/1836066001 >> [v2:172.21.15.50:6808/87853,v1:172.21.15.50:6809/87853] conn(0x7f7ac4070cd0 msgr2=0x7f7ac4073100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:02.550 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.515+0000 7f7ae639d700 1 --2- 172.21.15.50:0/1836066001 >> [v2:172.21.15.50:6808/87853,v1:172.21.15.50:6809/87853] conn(0x7f7ac4070cd0 0x7f7ac4073100 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:02.550 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.515+0000 7fd56b7fe700 1 -- 172.21.15.50:0/2222827814 >> 172.21.15.50:0/2222827814 conn(0x7fd5880680c0 msgr2=0x7fd5880cb070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:22:02.550 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.515+0000 7f7ae639d700 1 -- 172.21.15.50:0/1836066001 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f7ac4067000 msgr2=0x7f7ac40694b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:02.550 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.515+0000 7f7ae639d700 1 --2- 172.21.15.50:0/1836066001 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f7ac4067000 0x7f7ac40694b0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f7adc00f570 tx=0x7f7adc007750 comp rx=0 tx=0).stop 2023-10-06T01:22:02.551 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.515+0000 7f7ae639d700 1 -- 172.21.15.50:0/1836066001 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7ae006a6c0 msgr2=0x7f7ae0157650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:02.551 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.515+0000 7f7ae639d700 1 --2- 172.21.15.50:0/1836066001 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7ae006a6c0 0x7f7ae0157650 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f7ad0006fd0 tx=0x7f7ad0017000 comp rx=0 tx=0).stop 2023-10-06T01:22:02.551 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.515+0000 7f7ae5b9c700 1 -- 172.21.15.50:0/1836066001 reap_dead start 2023-10-06T01:22:02.551 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.515+0000 7fd56b7fe700 1 -- 172.21.15.50:0/2222827814 shutdown_connections 2023-10-06T01:22:02.551 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.515+0000 7fd56b7fe700 1 -- 172.21.15.50:0/2222827814 wait complete. 2023-10-06T01:22:02.552 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.516+0000 7f7ae639d700 1 -- 172.21.15.50:0/1836066001 shutdown_connections 2023-10-06T01:22:02.552 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.516+0000 7f7ae639d700 1 -- 172.21.15.50:0/1836066001 >> 172.21.15.50:0/1836066001 conn(0x7f7ae00680c0 msgr2=0x7f7ae006d3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:22:02.552 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.516+0000 7f7ae639d700 1 -- 172.21.15.50:0/1836066001 shutdown_connections 2023-10-06T01:22:02.552 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.517+0000 7f7ae639d700 1 -- 172.21.15.50:0/1836066001 wait complete. 2023-10-06T01:22:02.552 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.520+0000 7f8e5e9ff700 1 -- 172.21.15.50:0/2172171861 --> [v2:172.21.15.155:6800/85805,v1:172.21.15.155:6801/85805] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f8e580afac0 con 0x7f8e38070ae0 2023-10-06T01:22:02.552 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.520+0000 7f76a89ff700 1 -- 172.21.15.50:0/4229138925 --> [v2:172.21.15.155:6816/85807,v1:172.21.15.155:6818/85807] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f7688002d30 con 0x7f7684070d50 2023-10-06T01:22:02.553 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.521+0000 7f8e54ff9700 1 -- 172.21.15.50:0/2172171861 <== osd.4 v2:172.21.15.155:6800/85805 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f8e580afac0 con 0x7f8e38070ae0 2023-10-06T01:22:02.553 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.522+0000 7f8e5e9ff700 1 -- 172.21.15.50:0/2172171861 >> [v2:172.21.15.155:6800/85805,v1:172.21.15.155:6801/85805] conn(0x7f8e38070ae0 msgr2=0x7f8e38072f10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:02.553 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.522+0000 7f8e5e9ff700 1 --2- 172.21.15.50:0/2172171861 >> [v2:172.21.15.155:6800/85805,v1:172.21.15.155:6801/85805] conn(0x7f8e38070ae0 0x7f8e38072f10 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:02.553 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.522+0000 7f8e5e9ff700 1 -- 172.21.15.50:0/2172171861 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f8e38066f80 msgr2=0x7f8e38069430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:02.554 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.522+0000 7f8e5e9ff700 1 --2- 172.21.15.50:0/2172171861 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f8e38066f80 0x7f8e38069430 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f8e480091e0 tx=0x7f8e48017000 comp rx=0 tx=0).stop 2023-10-06T01:22:02.554 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.522+0000 7f8e5e9ff700 1 -- 172.21.15.50:0/2172171861 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8e5806e4c0 msgr2=0x7f8e58098050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:02.554 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.522+0000 7f8e5e9ff700 1 --2- 172.21.15.50:0/2172171861 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8e5806e4c0 0x7f8e58098050 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f8e40000c00 tx=0x7f8e40007e20 comp rx=0 tx=0).stop 2023-10-06T01:22:02.554 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.522+0000 7f8e5cf9c700 1 -- 172.21.15.50:0/2172171861 reap_dead start 2023-10-06T01:22:02.554 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.522+0000 7f769a7fc700 1 -- 172.21.15.50:0/4229138925 <== osd.5 v2:172.21.15.155:6816/85807 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f7688002d30 con 0x7f7684070d50 2023-10-06T01:22:02.554 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.523+0000 7f8e5e9ff700 1 -- 172.21.15.50:0/2172171861 shutdown_connections 2023-10-06T01:22:02.555 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.523+0000 7f8e5e9ff700 1 -- 172.21.15.50:0/2172171861 >> 172.21.15.50:0/2172171861 conn(0x7f8e580691c0 msgr2=0x7f8e5806ade0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:22:02.555 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.524+0000 7f7683fff700 1 -- 172.21.15.50:0/4229138925 >> [v2:172.21.15.155:6816/85807,v1:172.21.15.155:6818/85807] conn(0x7f7684070d50 msgr2=0x7f7684073180 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:02.555 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.524+0000 7f7683fff700 1 --2- 172.21.15.50:0/4229138925 >> [v2:172.21.15.155:6816/85807,v1:172.21.15.155:6818/85807] conn(0x7f7684070d50 0x7f7684073180 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:02.556 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.524+0000 7f8e5e9ff700 1 -- 172.21.15.50:0/2172171861 shutdown_connections 2023-10-06T01:22:02.556 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.525+0000 7f8e5e9ff700 1 -- 172.21.15.50:0/2172171861 wait complete. 2023-10-06T01:22:02.556 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.525+0000 7f7683fff700 1 -- 172.21.15.50:0/4229138925 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f7684067080 msgr2=0x7f7684069530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:02.556 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.525+0000 7f7683fff700 1 --2- 172.21.15.50:0/4229138925 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f7684067080 0x7f7684069530 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f76a415c070 tx=0x7f7694008040 comp rx=0 tx=0).stop 2023-10-06T01:22:02.556 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.525+0000 7f7683fff700 1 -- 172.21.15.50:0/4229138925 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f76a40cd1a0 msgr2=0x7f76a4151720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:02.556 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.525+0000 7f7683fff700 1 --2- 172.21.15.50:0/4229138925 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f76a40cd1a0 0x7f76a4151720 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f768c012000 tx=0x7f768c016000 comp rx=0 tx=0).stop 2023-10-06T01:22:02.557 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.525+0000 7f76a2d9d700 1 -- 172.21.15.50:0/4229138925 reap_dead start 2023-10-06T01:22:02.557 INFO:teuthology.orchestra.run.smithi050.stdout:55834574857 2023-10-06T01:22:02.558 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-06T01:22:02.558 INFO:teuthology.orchestra.run.smithi050.stdout:55834574856 2023-10-06T01:22:02.559 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-06T01:22:02.559 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.528+0000 7f7683fff700 1 -- 172.21.15.50:0/4229138925 shutdown_connections 2023-10-06T01:22:02.560 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.528+0000 7f7683fff700 1 -- 172.21.15.50:0/4229138925 >> 172.21.15.50:0/4229138925 conn(0x7f76a4099600 msgr2=0x7f76a40c5250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:22:02.560 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.528+0000 7f7683fff700 1 -- 172.21.15.50:0/4229138925 shutdown_connections 2023-10-06T01:22:02.560 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.528+0000 7f7683fff700 1 -- 172.21.15.50:0/4229138925 wait complete. 2023-10-06T01:22:02.560 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.531+0000 7fa3447ff700 1 -- 172.21.15.50:0/3564668007 --> [v2:172.21.15.155:6817/85832,v1:172.21.15.155:6819/85832] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fa33c0895e0 con 0x7fa33c159970 2023-10-06T01:22:02.560 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.532+0000 7fa3327fc700 1 -- 172.21.15.50:0/3564668007 <== osd.7 v2:172.21.15.155:6817/85832 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fa33c0895e0 con 0x7fa33c159970 2023-10-06T01:22:02.561 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.533+0000 7fa3447ff700 1 -- 172.21.15.50:0/3564668007 >> [v2:172.21.15.155:6817/85832,v1:172.21.15.155:6819/85832] conn(0x7fa33c159970 msgr2=0x7fa33c159d40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:02.561 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.533+0000 7fa3447ff700 1 --2- 172.21.15.50:0/3564668007 >> [v2:172.21.15.155:6817/85832,v1:172.21.15.155:6819/85832] conn(0x7fa33c159970 0x7fa33c159d40 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:02.561 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.533+0000 7fa3447ff700 1 -- 172.21.15.50:0/3564668007 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7fa320067000 msgr2=0x7fa3200694b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:02.561 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.533+0000 7fa3447ff700 1 --2- 172.21.15.50:0/3564668007 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7fa320067000 0x7fa3200694b0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fa33c088e20 tx=0x7fa334015000 comp rx=0 tx=0).stop 2023-10-06T01:22:02.561 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.533+0000 7fa3447ff700 1 -- 172.21.15.50:0/3564668007 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa328004810 msgr2=0x7fa33c06d130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:02.562 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.533+0000 7fa3447ff700 1 --2- 172.21.15.50:0/3564668007 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa328004810 0x7fa33c06d130 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fa32c0077c0 tx=0x7fa32c001e50 comp rx=0 tx=0).stop 2023-10-06T01:22:02.562 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.533+0000 7fa342d9c700 1 -- 172.21.15.50:0/3564668007 reap_dead start 2023-10-06T01:22:02.562 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.533+0000 7fa3447ff700 1 -- 172.21.15.50:0/3564668007 shutdown_connections 2023-10-06T01:22:02.562 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.533+0000 7fa3447ff700 1 -- 172.21.15.50:0/3564668007 >> 172.21.15.50:0/3564668007 conn(0x7fa33c099830 msgr2=0x7fa33c0ccf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:22:02.562 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.534+0000 7fa3447ff700 1 -- 172.21.15.50:0/3564668007 shutdown_connections 2023-10-06T01:22:02.562 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.534+0000 7fa3447ff700 1 -- 172.21.15.50:0/3564668007 wait complete. 2023-10-06T01:22:02.562 INFO:teuthology.orchestra.run.smithi050.stdout:55834574856 2023-10-06T01:22:02.563 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-06T01:22:02.564 INFO:teuthology.orchestra.run.smithi050.stdout:55834574858 2023-10-06T01:22:02.564 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2023-10-06T01:22:02.565 INFO:teuthology.orchestra.run.smithi050.stdout:55834574856 2023-10-06T01:22:02.565 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-06T01:22:02.566 INFO:teuthology.orchestra.run.smithi050.stdout:55834574858 2023-10-06T01:22:02.566 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2023-10-06T01:22:02.567 INFO:teuthology.orchestra.run.smithi050.stdout:55834574858 2023-10-06T01:22:02.567 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2023-10-06T01:22:02.568 INFO:teuthology.orchestra.run.smithi050.stdout:55834574856 2023-10-06T01:22:02.568 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2023-10-06T01:22:02.934 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.932+0000 7f2d2b39d700 1 Processor -- start 2023-10-06T01:22:02.935 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.933+0000 7f2d2b39d700 1 -- start start 2023-10-06T01:22:02.935 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.934+0000 7f9b0219d700 1 Processor -- start 2023-10-06T01:22:02.936 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.934+0000 7f76223ff700 1 Processor -- start 2023-10-06T01:22:02.937 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.934+0000 7f9b0219d700 1 -- start start 2023-10-06T01:22:02.937 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.935+0000 7f2d2b39d700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f2d1c0dfc60 0x7f2d1c0e0030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:02.938 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.935+0000 7f2d2b39d700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f2d1c051ed0 0x7f2d1c052370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:02.939 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.936+0000 7f2d2b39d700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2d1c00d9c0 0x7f2d1c00de00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:02.939 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.936+0000 7f2d2b39d700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2d1c0563a0 con 0x7f2d1c0dfc60 2023-10-06T01:22:02.939 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.936+0000 7f2d2b39d700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2d1c00e340 con 0x7f2d1c051ed0 2023-10-06T01:22:02.939 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.936+0000 7f2d2b39d700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d1c056830 con 0x7f2d1c00d9c0 2023-10-06T01:22:02.939 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.936+0000 7f2d2a39b700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f2d1c0dfc60 0x7f2d1c0e0030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:02.939 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.936+0000 7f2d2a39b700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f2d1c0dfc60 0x7f2d1c0e0030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:48130/0 (socket says 172.21.15.50:48130) 2023-10-06T01:22:02.939 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.936+0000 7f2d2a39b700 1 -- 172.21.15.50:0/2882539566 learned_addr learned my addr 172.21.15.50:0/2882539566 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-06T01:22:02.939 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.936+0000 7f2d2ab9c700 1 --2- 172.21.15.50:0/2882539566 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2d1c00d9c0 0x7f2d1c00de00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:02.939 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.936+0000 7f2d29b9a700 1 --2- 172.21.15.50:0/2882539566 >> v2:172.21.15.155:3300/0 conn(0x7f2d1c051ed0 0x7f2d1c052370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:02.939 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.936+0000 7f2d2a39b700 1 -- 172.21.15.50:0/2882539566 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2d1c00d9c0 msgr2=0x7f2d1c00de00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:22:02.939 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.936+0000 7f2d2a39b700 1 --2- 172.21.15.50:0/2882539566 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2d1c00d9c0 0x7f2d1c00de00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:02.940 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.937+0000 7f2d2a39b700 1 -- 172.21.15.50:0/2882539566 >> v2:172.21.15.155:3300/0 conn(0x7f2d1c051ed0 msgr2=0x7f2d1c052370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:22:02.940 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.937+0000 7f2d2a39b700 1 --2- 172.21.15.50:0/2882539566 >> v2:172.21.15.155:3300/0 conn(0x7f2d1c051ed0 0x7f2d1c052370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:02.940 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.937+0000 7f2d2a39b700 1 -- 172.21.15.50:0/2882539566 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d1c055790 con 0x7f2d1c0dfc60 2023-10-06T01:22:02.940 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.937+0000 7f2d2ab9c700 1 --2- 172.21.15.50:0/2882539566 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2d1c00d9c0 0x7f2d1c00de00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T01:22:02.940 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.935+0000 7f76223ff700 1 -- start start 2023-10-06T01:22:02.940 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.937+0000 7f2d2a39b700 1 --2- 172.21.15.50:0/2882539566 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2d1c0dfc60 0x7f2d1c0e0030 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f2d24062fd0 tx=0x7f2d24067390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8208b2a509f0639f server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:22:02.941 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.938+0000 7f76223ff700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f761c069c70 0x7f761c1567a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:02.941 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.937+0000 7f2d29399700 1 -- 172.21.15.50:0/2882539566 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d240658d0 con 0x7f2d1c0dfc60 2023-10-06T01:22:02.941 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.937+0000 7f2d29399700 1 -- 172.21.15.50:0/2882539566 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d2404c0e0 con 0x7f2d1c0dfc60 2023-10-06T01:22:02.941 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.938+0000 7f76223ff700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f761c0addd0 0x7f761c0ae1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:02.942 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.937+0000 7f2d29399700 1 -- 172.21.15.50:0/2882539566 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d2404bb80 con 0x7f2d1c0dfc60 2023-10-06T01:22:02.943 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.939+0000 7f76223ff700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f761c06e360 con 0x7f761c1531e0 2023-10-06T01:22:02.943 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.939+0000 7f762099c700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f761c0addd0 0x7f761c0ae1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:02.943 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.939+0000 7f762099c700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f761c0addd0 0x7f761c0ae1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3301/0 says I am v2:172.21.15.50:49718/0 (socket says 172.21.15.50:49718) 2023-10-06T01:22:02.943 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.939+0000 7f762099c700 1 -- 172.21.15.50:0/2130167427 learned_addr learned my addr 172.21.15.50:0/2130167427 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-06T01:22:02.943 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.939+0000 7f76223ff700 1 -- 172.21.15.50:0/2130167427 --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f761c156ce0 con 0x7f761c069c70 2023-10-06T01:22:02.943 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.939+0000 7f76223ff700 1 -- 172.21.15.50:0/2130167427 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f761c06e7f0 con 0x7f761c0addd0 2023-10-06T01:22:02.943 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.939+0000 7f76137fe700 1 --2- 172.21.15.50:0/2130167427 >> v2:172.21.15.155:3300/0 conn(0x7f761c069c70 0x7f761c1567a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:02.944 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.939+0000 7f2d2b39d700 1 -- 172.21.15.50:0/2882539566 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2d1c0dfc60 msgr2=0x7f2d1c0e0030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:02.944 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.939+0000 7f2d2b39d700 1 --2- 172.21.15.50:0/2882539566 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2d1c0dfc60 0x7f2d1c0e0030 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f2d24062fd0 tx=0x7f2d24067390 comp rx=0 tx=0).stop 2023-10-06T01:22:02.944 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.939+0000 7f2d2b39d700 1 -- 172.21.15.50:0/2882539566 shutdown_connections 2023-10-06T01:22:02.944 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.939+0000 7f2d2b39d700 1 --2- 172.21.15.50:0/2882539566 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2d1c00d9c0 0x7f2d1c00de00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:02.945 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.940+0000 7f9b0219d700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9af403cfe0 0x7f9af40ed090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:02.945 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.940+0000 7f9b0219d700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9af4006c10 con 0x7f9af4039040 2023-10-06T01:22:02.945 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.941+0000 7f9b0219d700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9af4007a70 con 0x7f9af4039410 2023-10-06T01:22:02.945 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.941+0000 7f9b0219d700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9af403b940 con 0x7f9af403cfe0 2023-10-06T01:22:02.946 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.940+0000 7f761b7fe700 1 -- 172.21.15.50:0/2130167427 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2699874410 0 0) 0x7f761c06e360 con 0x7f761c1531e0 2023-10-06T01:22:02.946 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.940+0000 7f761b7fe700 1 -- 172.21.15.50:0/2130167427 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7608007980 con 0x7f761c1531e0 2023-10-06T01:22:02.946 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.940+0000 7f762099c700 1 -- 172.21.15.50:0/2130167427 >> v2:172.21.15.155:3300/0 conn(0x7f761c069c70 msgr2=0x7f761c1567a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:22:02.946 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.940+0000 7f762099c700 1 --2- 172.21.15.50:0/2130167427 >> v2:172.21.15.155:3300/0 conn(0x7f761c069c70 0x7f761c1567a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:02.946 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.940+0000 7f762099c700 1 -- 172.21.15.50:0/2130167427 >> v1:172.21.15.155:6789/0 conn(0x7f761c1531e0 legacy=0x7f761c069560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:02.946 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.940+0000 7f762099c700 1 -- 172.21.15.50:0/2130167427 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f761c06d750 con 0x7f761c0addd0 2023-10-06T01:22:02.946 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.940+0000 7f762099c700 1 --2- 172.21.15.50:0/2130167427 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f761c0addd0 0x7f761c0ae1f0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f7614009320 tx=0x7f7614009ae0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=57d0ab9daa24d659 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:22:02.946 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.941+0000 7f9b0099a700 1 --1- >> v1:172.21.15.155:6789/0 conn(0x7f9af4039410 0x7f9af40e1f70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.155:6789/0 says I am v1:172.21.15.50:56992/0 (socket says 172.21.15.50:56992) 2023-10-06T01:22:02.947 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.941+0000 7f9b0099a700 1 -- 172.21.15.50:0/1225200731 learned_addr learned my addr 172.21.15.50:0/1225200731 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-10-06T01:22:02.947 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.939+0000 7f2d2b39d700 1 --2- 172.21.15.50:0/2882539566 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2d1c0dfc60 0x7f2d1c0e0030 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:02.947 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.939+0000 7f2d2b39d700 1 --2- 172.21.15.50:0/2882539566 >> v2:172.21.15.155:3300/0 conn(0x7f2d1c051ed0 0x7f2d1c052370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:02.947 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.939+0000 7f2d2b39d700 1 -- 172.21.15.50:0/2882539566 >> 172.21.15.50:0/2882539566 conn(0x7f2d1c00cd60 msgr2=0x7f2d1c056e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:22:02.947 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.940+0000 7f2d2b39d700 1 -- 172.21.15.50:0/2882539566 shutdown_connections 2023-10-06T01:22:02.947 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.941+0000 7f2d2b39d700 1 -- 172.21.15.50:0/2882539566 wait complete. 2023-10-06T01:22:02.948 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.941+0000 7f761b7fe700 1 -- 172.21.15.50:0/2130167427 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7614009810 con 0x7f761c0addd0 2023-10-06T01:22:02.948 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.941+0000 7f761b7fe700 1 -- 172.21.15.50:0/2130167427 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7614015c80 con 0x7f761c0addd0 2023-10-06T01:22:02.948 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.942+0000 7f761b7fe700 1 -- 172.21.15.50:0/2130167427 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f761400b650 con 0x7f761c0addd0 2023-10-06T01:22:02.948 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.943+0000 7f76223ff700 1 -- 172.21.15.50:0/2130167427 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f761c0addd0 msgr2=0x7f761c0ae1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:02.948 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.943+0000 7f76223ff700 1 --2- 172.21.15.50:0/2130167427 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f761c0addd0 0x7f761c0ae1f0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f7614009320 tx=0x7f7614009ae0 comp rx=0 tx=0).stop 2023-10-06T01:22:02.949 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.942+0000 7f9b0199c700 1 --2- 172.21.15.50:0/1225200731 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9af403cfe0 0x7f9af40ed090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:02.949 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.942+0000 7f9af3fff700 1 -- 172.21.15.50:0/1225200731 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 965958967 0 0) 0x7f9af4007a70 con 0x7f9af4039410 2023-10-06T01:22:02.949 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.942+0000 7f9af3fff700 1 -- 172.21.15.50:0/1225200731 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9ae8003570 con 0x7f9af4039410 2023-10-06T01:22:02.949 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.942+0000 7f9af3fff700 1 -- 172.21.15.50:0/1225200731 <== mon.1 v1:172.21.15.155:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 409392865 0 0) 0x7f9ae8003570 con 0x7f9af4039410 2023-10-06T01:22:02.949 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.942+0000 7f9af3fff700 1 -- 172.21.15.50:0/1225200731 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9af403cfe0 msgr2=0x7f9af40ed090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:22:02.949 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.942+0000 7f9af3fff700 1 --2- 172.21.15.50:0/1225200731 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9af403cfe0 0x7f9af40ed090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:02.949 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.942+0000 7f9af3fff700 1 -- 172.21.15.50:0/1225200731 >> v1:172.21.15.50:6789/0 conn(0x7f9af4039040 legacy=0x7f9af403b230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:02.950 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.944+0000 7f2d2b39d700 1 Processor -- start 2023-10-06T01:22:02.950 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.944+0000 7f2d2b39d700 1 -- start start 2023-10-06T01:22:02.950 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.942+0000 7f9af3fff700 1 -- 172.21.15.50:0/1225200731 --> v1:172.21.15.155:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9af4006e60 con 0x7f9af4039410 2023-10-06T01:22:02.950 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.943+0000 7f9af3fff700 1 -- 172.21.15.50:0/1225200731 <== mon.1 v1:172.21.15.155:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 347519148 0 0) 0x7f9aec001470 con 0x7f9af4039410 2023-10-06T01:22:02.950 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.943+0000 7f9af3fff700 1 -- 172.21.15.50:0/1225200731 >> v1:172.21.15.155:6789/0 conn(0x7f9af4039410 legacy=0x7f9af40e1f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:02.950 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.943+0000 7f9af3fff700 1 --2- 172.21.15.50:0/1225200731 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9ae8003b30 0x7f9ae8003f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:02.950 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.943+0000 7f9af3fff700 1 --2- 172.21.15.50:0/1225200731 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9ae8004810 0x7f9ae8004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:02.951 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.943+0000 7f9af3fff700 1 --2- 172.21.15.50:0/1225200731 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9ae8005230 0x7f9ae8007a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:02.951 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.943+0000 7f9af3fff700 1 -- 172.21.15.50:0/1225200731 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9af403b940 con 0x7f9ae8004810 2023-10-06T01:22:02.951 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.943+0000 7f9af3fff700 1 -- 172.21.15.50:0/1225200731 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ae80081e0 con 0x7f9ae8005230 2023-10-06T01:22:02.951 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.943+0000 7f9af3fff700 1 -- 172.21.15.50:0/1225200731 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ae80083a0 con 0x7f9ae8003b30 2023-10-06T01:22:02.951 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.944+0000 7f9b0099a700 1 --2- 172.21.15.50:0/1225200731 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9ae8004810 0x7f9ae8004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:02.951 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.944+0000 7f9b0119b700 1 --2- 172.21.15.50:0/1225200731 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9ae8003b30 0x7f9ae8003f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:02.951 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.945+0000 7f9b0119b700 1 -- 172.21.15.50:0/1225200731 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9ae8005230 msgr2=0x7f9ae8007a40 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-06T01:22:02.951 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.945+0000 7f9b0119b700 1 --2- 172.21.15.50:0/1225200731 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9ae8005230 0x7f9ae8007a40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:02.951 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.945+0000 7f9b0119b700 1 -- 172.21.15.50:0/1225200731 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9ae8004810 msgr2=0x7f9ae8004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:22:02.951 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.944+0000 7f76223ff700 1 -- 172.21.15.50:0/2130167427 shutdown_connections 2023-10-06T01:22:02.952 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.944+0000 7f76223ff700 1 --2- 172.21.15.50:0/2130167427 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f761c0addd0 0x7f761c0ae1f0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:02.952 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.944+0000 7f76223ff700 1 --2- 172.21.15.50:0/2130167427 >> v2:172.21.15.155:3300/0 conn(0x7f761c069c70 0x7f761c1567a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:02.952 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.944+0000 7f76223ff700 1 -- 172.21.15.50:0/2130167427 >> 172.21.15.50:0/2130167427 conn(0x7f761c0680c0 msgr2=0x7f761c0cc120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:22:02.952 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.944+0000 7f76223ff700 1 -- 172.21.15.50:0/2130167427 shutdown_connections 2023-10-06T01:22:02.952 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.944+0000 7f76223ff700 1 -- 172.21.15.50:0/2130167427 wait complete. 2023-10-06T01:22:02.952 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.944+0000 7fa080b9d700 1 Processor -- start 2023-10-06T01:22:02.952 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.944+0000 7fa080b9d700 1 -- start start 2023-10-06T01:22:02.953 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.946+0000 7f9b0119b700 1 --2- 172.21.15.50:0/1225200731 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9ae8004810 0x7f9ae8004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:02.953 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.946+0000 7f9b0119b700 1 -- 172.21.15.50:0/1225200731 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ae8003570 con 0x7f9ae8003b30 2023-10-06T01:22:02.953 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.946+0000 7f9b0099a700 1 --2- 172.21.15.50:0/1225200731 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9ae8004810 0x7f9ae8004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T01:22:02.953 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.946+0000 7f9b0119b700 1 --2- 172.21.15.50:0/1225200731 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9ae8003b30 0x7f9ae8003f40 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f9af80017e0 tx=0x7f9af8007d30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=388d9e9f511c35ea server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:22:02.953 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.946+0000 7fa080b9d700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa07c0b2850 0x7fa07c0cc0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:02.954 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.947+0000 7f2d2b39d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2d1c00d9c0 0x7f2d1c0d9d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:02.954 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.947+0000 7fa080b9d700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa07c0cb7e0 con 0x7fa07c0cbc70 2023-10-06T01:22:02.954 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.947+0000 7f2d2a39b700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2d1c00d9c0 0x7f2d1c0d9d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:02.954 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.947+0000 7f2d2a39b700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2d1c00d9c0 0x7f2d1c0d9d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:48144/0 (socket says 172.21.15.50:48144) 2023-10-06T01:22:02.954 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.947+0000 7f2d2a39b700 1 -- 172.21.15.50:0/3092585580 learned_addr learned my addr 172.21.15.50:0/3092585580 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-06T01:22:02.954 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.948+0000 7f2d2b39d700 1 --2- 172.21.15.50:0/3092585580 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2d1c051ed0 0x7f2d1c0de7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:02.955 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.947+0000 7f9af3fff700 1 -- 172.21.15.50:0/1225200731 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9af8012420 con 0x7f9ae8003b30 2023-10-06T01:22:02.955 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.947+0000 7f9af3fff700 1 -- 172.21.15.50:0/1225200731 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9af8012580 con 0x7f9ae8003b30 2023-10-06T01:22:02.955 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.947+0000 7f9af3fff700 1 -- 172.21.15.50:0/1225200731 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9af8012920 con 0x7f9ae8003b30 2023-10-06T01:22:02.955 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.947+0000 7f76223ff700 1 Processor -- start 2023-10-06T01:22:02.955 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.947+0000 7fa07bfff700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa07c0b2850 0x7fa07c0cc0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:02.956 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.947+0000 7fa07bfff700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa07c0b2850 0x7fa07c0cc0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3301/0 says I am v2:172.21.15.50:49736/0 (socket says 172.21.15.50:49736) 2023-10-06T01:22:02.956 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.947+0000 7fa07bfff700 1 -- 172.21.15.50:0/529345553 learned_addr learned my addr 172.21.15.50:0/529345553 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-06T01:22:02.956 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.947+0000 7fa080b9d700 1 -- 172.21.15.50:0/529345553 --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa07c0b08a0 con 0x7fa07c159480 2023-10-06T01:22:02.956 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.947+0000 7fa080b9d700 1 -- 172.21.15.50:0/529345553 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa07c0cb190 con 0x7fa07c0b2850 2023-10-06T01:22:02.956 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.948+0000 7f2d2b39d700 1 --2- 172.21.15.50:0/3092585580 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2d1c0ded20 0x7f2d1c0505f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:02.956 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.948+0000 7f2d29b9a700 1 --2- 172.21.15.50:0/3092585580 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2d1c051ed0 0x7f2d1c0de7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:02.956 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.948+0000 7f2d2b39d700 1 -- 172.21.15.50:0/3092585580 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d1c0da240 con 0x7f2d1c00d9c0 2023-10-06T01:22:02.957 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.948+0000 7f2d2ab9c700 1 --2- 172.21.15.50:0/3092585580 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2d1c0ded20 0x7f2d1c0505f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:02.957 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.948+0000 7f2d2b39d700 1 -- 172.21.15.50:0/3092585580 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d1c0df190 con 0x7f2d1c051ed0 2023-10-06T01:22:02.957 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.948+0000 7f9b0219d700 1 -- 172.21.15.50:0/1225200731 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9ae8003b30 msgr2=0x7f9ae8003f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:02.957 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.948+0000 7f9b0219d700 1 --2- 172.21.15.50:0/1225200731 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9ae8003b30 0x7f9ae8003f40 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f9af80017e0 tx=0x7f9af8007d30 comp rx=0 tx=0).stop 2023-10-06T01:22:02.957 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.948+0000 7f9b0199c700 1 -- 172.21.15.50:0/1225200731 reap_dead start 2023-10-06T01:22:02.957 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.948+0000 7f9b0219d700 1 -- 172.21.15.50:0/1225200731 shutdown_connections 2023-10-06T01:22:02.957 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.948+0000 7f9b0219d700 1 -- 172.21.15.50:0/1225200731 >> 172.21.15.50:0/1225200731 conn(0x7f9af4059b20 msgr2=0x7f9af4055ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:22:02.958 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.947+0000 7f76223ff700 1 -- start start 2023-10-06T01:22:02.958 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.948+0000 7fa07bfff700 1 -- 172.21.15.50:0/529345553 >> v1:172.21.15.155:6789/0 conn(0x7fa07c159480 legacy=0x7fa07c0b30d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:22:02.958 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.948+0000 7fa07bfff700 1 -- 172.21.15.50:0/529345553 >> v1:172.21.15.50:6789/0 conn(0x7fa07c0cbc70 legacy=0x7fa07c0b2140 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-06T01:22:02.958 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.948+0000 7fa07bfff700 1 -- 172.21.15.50:0/529345553 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa07c0cb470 con 0x7fa07c0b2850 2023-10-06T01:22:02.958 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.948+0000 7f80025ff700 1 Processor -- start 2023-10-06T01:22:02.959 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.949+0000 7f2d2b39d700 1 -- 172.21.15.50:0/3092585580 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d1c04f460 con 0x7f2d1c0ded20 2023-10-06T01:22:02.959 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.949+0000 7f9b0219d700 1 -- 172.21.15.50:0/1225200731 shutdown_connections 2023-10-06T01:22:02.959 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.949+0000 7fa07bfff700 1 --2- 172.21.15.50:0/529345553 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa07c0b2850 0x7fa07c0cc0c0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fa074009f50 tx=0x7fa074009840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f71697547bfbcb83 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:22:02.960 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.949+0000 7f76223ff700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f761c069c70 0x7f761c0c36e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:02.960 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.949+0000 7f76223ff700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f761c0addd0 0x7f761c0c5ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:02.960 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.949+0000 7f76223ff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f761c1531e0 0x7f761c154230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:02.960 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.949+0000 7f2d29b9a700 1 -- 172.21.15.50:0/3092585580 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2d1c0ded20 msgr2=0x7f2d1c0505f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:02.961 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.949+0000 7f2d29b9a700 1 --2- 172.21.15.50:0/3092585580 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2d1c0ded20 0x7f2d1c0505f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:02.961 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.949+0000 7f2d29b9a700 1 -- 172.21.15.50:0/3092585580 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2d1c00d9c0 msgr2=0x7f2d1c0d9d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:02.961 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.950+0000 7f76137fe700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f761c0addd0 0x7f761c0c5ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:02.961 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.950+0000 7f2d29b9a700 1 --2- 172.21.15.50:0/3092585580 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2d1c00d9c0 0x7f2d1c0d9d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:02.961 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.950+0000 7f2d29b9a700 1 -- 172.21.15.50:0/3092585580 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d2404c9a0 con 0x7f2d1c051ed0 2023-10-06T01:22:02.962 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.950+0000 7f76137fe700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f761c0addd0 0x7f761c0c5ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.50:54312/0 (socket says 172.21.15.50:54312) 2023-10-06T01:22:02.962 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.950+0000 7f2d2a39b700 1 --2- 172.21.15.50:0/3092585580 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2d1c00d9c0 0x7f2d1c0d9d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T01:22:02.962 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.950+0000 7f2d29b9a700 1 --2- 172.21.15.50:0/3092585580 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2d1c051ed0 0x7f2d1c0de7e0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f2d2000d860 tx=0x7f2d20008040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:22:02.962 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.950+0000 7f762099c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f761c1531e0 0x7f761c154230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:02.963 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.949+0000 7f80025ff700 1 -- start start 2023-10-06T01:22:02.963 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.951+0000 7f762099c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f761c1531e0 0x7f761c154230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:48146/0 (socket says 172.21.15.50:48146) 2023-10-06T01:22:02.963 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.950+0000 7f80025ff700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f7ff40e22f0 0x7f7ff403bfc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:02.964 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.951+0000 7f76137fe700 1 -- 172.21.15.50:0/3594071787 learned_addr learned my addr 172.21.15.50:0/3594071787 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-06T01:22:02.964 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.951+0000 7f76223ff700 1 -- 172.21.15.50:0/3594071787 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f761c0c60e0 con 0x7f761c1531e0 2023-10-06T01:22:02.964 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.951+0000 7f76223ff700 1 -- 172.21.15.50:0/3594071787 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f761c0c5610 con 0x7f761c0addd0 2023-10-06T01:22:02.964 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.951+0000 7f2d1a7fc700 1 -- 172.21.15.50:0/3092585580 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d20014620 con 0x7f2d1c051ed0 2023-10-06T01:22:02.964 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.951+0000 7f2d1a7fc700 1 -- 172.21.15.50:0/3092585580 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d20014780 con 0x7f2d1c051ed0 2023-10-06T01:22:02.965 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.951+0000 7f2d1a7fc700 1 -- 172.21.15.50:0/3092585580 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d20014b20 con 0x7f2d1c051ed0 2023-10-06T01:22:02.965 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.951+0000 7f76223ff700 1 -- 172.21.15.50:0/3594071787 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f761c0b1870 con 0x7f761c069c70 2023-10-06T01:22:02.965 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.951+0000 7f2d2b39d700 1 -- 172.21.15.50:0/3092585580 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2d1c04e3c0 con 0x7f2d1c051ed0 2023-10-06T01:22:02.965 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.951+0000 7f7ffbfff700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f7ff40e22f0 0x7f7ff403bfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:02.966 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.949+0000 7f9b0219d700 1 -- 172.21.15.50:0/1225200731 wait complete. 2023-10-06T01:22:02.966 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.951+0000 7f7ffbfff700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f7ff40e22f0 0x7f7ff403bfc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:48152/0 (socket says 172.21.15.50:48152) 2023-10-06T01:22:02.966 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.951+0000 7f7ffbfff700 1 -- 172.21.15.50:0/3399492173 learned_addr learned my addr 172.21.15.50:0/3399492173 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-06T01:22:02.967 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.951+0000 7f9b0219d700 1 Processor -- start 2023-10-06T01:22:02.967 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.952+0000 7f2d2b39d700 1 -- 172.21.15.50:0/3092585580 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2d1c04e980 con 0x7f2d1c051ed0 2023-10-06T01:22:02.967 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.952+0000 7f762099c700 1 -- 172.21.15.50:0/3594071787 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f761c069c70 msgr2=0x7f761c0c36e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-06T01:22:02.967 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.952+0000 7f762099c700 1 --2- 172.21.15.50:0/3594071787 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f761c069c70 0x7f761c0c36e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:02.967 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.952+0000 7f762099c700 1 -- 172.21.15.50:0/3594071787 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f761c0addd0 msgr2=0x7f761c0c5ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:02.968 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.952+0000 7f762099c700 1 --2- 172.21.15.50:0/3594071787 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f761c0addd0 0x7f761c0c5ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:02.968 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.952+0000 7f762099c700 1 -- 172.21.15.50:0/3594071787 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7614009d80 con 0x7f761c1531e0 2023-10-06T01:22:02.968 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.952+0000 7f9b0219d700 1 -- start start 2023-10-06T01:22:02.968 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.952+0000 7f762099c700 1 --2- 172.21.15.50:0/3594071787 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f761c1531e0 0x7f761c154230 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f761c06d290 tx=0x7f761401f000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:22:02.968 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.953+0000 7fa07a7fc700 1 -- 172.21.15.50:0/529345553 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa07400e070 con 0x7fa07c0b2850 2023-10-06T01:22:02.969 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.953+0000 7f7618ff9700 1 -- 172.21.15.50:0/3594071787 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f761400b650 con 0x7f761c1531e0 2023-10-06T01:22:02.969 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.951+0000 7f80025ff700 1 -- 172.21.15.50:0/3399492173 --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7ff4054bc0 con 0x7f7ff4055050 2023-10-06T01:22:02.969 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.951+0000 7f80025ff700 1 -- 172.21.15.50:0/3399492173 --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7ff4053fb0 con 0x7f7ff403b070 2023-10-06T01:22:02.969 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.951+0000 7f80025ff700 1 -- 172.21.15.50:0/3399492173 --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7ff4054290 con 0x7f7ff40e22f0 2023-10-06T01:22:02.969 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.952+0000 7f7ffbfff700 1 -- 172.21.15.50:0/3399492173 >> v1:172.21.15.155:6789/0 conn(0x7f7ff403b070 legacy=0x7f7ff403b4f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-06T01:22:02.970 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.952+0000 7f7ffbfff700 1 -- 172.21.15.50:0/3399492173 >> v1:172.21.15.50:6789/0 conn(0x7f7ff4055050 legacy=0x7f7ff40554f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-06T01:22:02.970 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.952+0000 7f7ffbfff700 1 -- 172.21.15.50:0/3399492173 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ff4054570 con 0x7f7ff40e22f0 2023-10-06T01:22:02.970 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.953+0000 7f7ffbfff700 1 --2- 172.21.15.50:0/3399492173 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7ff40e22f0 0x7f7ff403bfc0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f7ff0009c10 tx=0x7f7ff0009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e10c01103207379a server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:22:02.970 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.953+0000 7f7618ff9700 1 -- 172.21.15.50:0/3594071787 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f761401de80 con 0x7f761c1531e0 2023-10-06T01:22:02.970 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.953+0000 7fa07a7fc700 1 -- 172.21.15.50:0/529345553 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa07400ba30 con 0x7fa07c0b2850 2023-10-06T01:22:02.971 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.953+0000 7f76223ff700 1 -- 172.21.15.50:0/3594071787 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f761c153750 con 0x7f761c1531e0 2023-10-06T01:22:02.971 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.954+0000 7f2d2b39d700 1 -- 172.21.15.50:0/3092585580 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2d1c0057d0 con 0x7f2d1c051ed0 2023-10-06T01:22:02.971 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.954+0000 7f9b0219d700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9ae8003b30 0x7f9af40dc590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:02.971 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.954+0000 7f9b0219d700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9af40eed20 0x7f9af40e1d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:02.971 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.954+0000 7f9b0219d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9af4050060 0x7f9af403d8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:02.971 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.954+0000 7f9b0119b700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9ae8003b30 0x7f9af40dc590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:02.972 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.955+0000 7f9b0119b700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9ae8003b30 0x7f9af40dc590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3301/0 says I am v2:172.21.15.50:49762/0 (socket says 172.21.15.50:49762) 2023-10-06T01:22:02.972 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.955+0000 7f9b0099a700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9af40eed20 0x7f9af40e1d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:02.972 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.955+0000 7f9b0099a700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9af40eed20 0x7f9af40e1d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.50:54322/0 (socket says 172.21.15.50:54322) 2023-10-06T01:22:02.972 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.955+0000 7f9b0119b700 1 -- 172.21.15.50:0/2430819561 learned_addr learned my addr 172.21.15.50:0/2430819561 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-06T01:22:02.972 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.954+0000 7fa080b9d700 1 -- 172.21.15.50:0/529345553 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa07c0b2850 msgr2=0x7fa07c0cc0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:02.972 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.954+0000 7fa080b9d700 1 --2- 172.21.15.50:0/529345553 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa07c0b2850 0x7fa07c0cc0c0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fa074009f50 tx=0x7fa074009840 comp rx=0 tx=0).stop 2023-10-06T01:22:02.972 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.954+0000 7fa080b9d700 1 -- 172.21.15.50:0/529345553 shutdown_connections 2023-10-06T01:22:02.972 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.954+0000 7fa080b9d700 1 --2- 172.21.15.50:0/529345553 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa07c0b2850 0x7fa07c0cc0c0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:02.972 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.954+0000 7fa080b9d700 1 -- 172.21.15.50:0/529345553 >> 172.21.15.50:0/529345553 conn(0x7fa07c06ed20 msgr2=0x7fa07c06f120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:22:02.973 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.954+0000 7f7ffaffd700 1 -- 172.21.15.50:0/3399492173 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ff0014a90 con 0x7f7ff40e22f0 2023-10-06T01:22:02.973 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.954+0000 7f7ffaffd700 1 -- 172.21.15.50:0/3399492173 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ff0014bf0 con 0x7f7ff40e22f0 2023-10-06T01:22:02.973 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.955+0000 7f9b0219d700 1 -- 172.21.15.50:0/2430819561 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9af4051070 con 0x7f9af4050060 2023-10-06T01:22:02.973 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.955+0000 7f80025ff700 1 -- 172.21.15.50:0/3399492173 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7ff40e22f0 msgr2=0x7f7ff403bfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:02.973 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.955+0000 7f80025ff700 1 --2- 172.21.15.50:0/3399492173 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7ff40e22f0 0x7f7ff403bfc0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f7ff0009c10 tx=0x7f7ff0009250 comp rx=0 tx=0).stop 2023-10-06T01:22:02.974 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.955+0000 7f9b0199c700 1 --2- 172.21.15.50:0/2430819561 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9af4050060 0x7f9af403d8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:02.974 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.955+0000 7f9b0219d700 1 -- 172.21.15.50:0/2430819561 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9af4051d70 con 0x7f9af40eed20 2023-10-06T01:22:02.974 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.955+0000 7fa080b9d700 1 -- 172.21.15.50:0/529345553 shutdown_connections 2023-10-06T01:22:02.975 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.956+0000 7f80025ff700 1 -- 172.21.15.50:0/3399492173 shutdown_connections 2023-10-06T01:22:02.975 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.956+0000 7f80025ff700 1 --2- 172.21.15.50:0/3399492173 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7ff40e22f0 0x7f7ff403bfc0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:02.975 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.956+0000 7f80025ff700 1 -- 172.21.15.50:0/3399492173 >> 172.21.15.50:0/3399492173 conn(0x7f7ff400f2b0 msgr2=0x7f7ff4059210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:22:02.975 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.956+0000 7f2d1a7fc700 1 -- 172.21.15.50:0/3092585580 <== mon.1 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f2d2001d400 con 0x7f2d1c051ed0 2023-10-06T01:22:02.975 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.956+0000 7f9b0219d700 1 -- 172.21.15.50:0/2430819561 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9af40ef190 con 0x7f9ae8003b30 2023-10-06T01:22:02.976 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.954+0000 7f7618ff9700 1 -- 172.21.15.50:0/3594071787 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7614009810 con 0x7f761c1531e0 2023-10-06T01:22:02.976 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.955+0000 7f76223ff700 1 -- 172.21.15.50:0/3594071787 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f761c153d10 con 0x7f761c1531e0 2023-10-06T01:22:02.976 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.956+0000 7fa080b9d700 1 -- 172.21.15.50:0/529345553 wait complete. 2023-10-06T01:22:02.976 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.956+0000 7f76223ff700 1 -- 172.21.15.50:0/3594071787 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f761c1535b0 con 0x7f761c1531e0 2023-10-06T01:22:02.977 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.956+0000 7f80025ff700 1 -- 172.21.15.50:0/3399492173 shutdown_connections 2023-10-06T01:22:02.977 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.956+0000 7f80025ff700 1 -- 172.21.15.50:0/3399492173 wait complete. 2023-10-06T01:22:02.977 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.956+0000 7f35d979d700 1 Processor -- start 2023-10-06T01:22:02.977 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.957+0000 7f7618ff9700 1 -- 172.21.15.50:0/3594071787 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f7614015720 con 0x7f761c1531e0 2023-10-06T01:22:02.978 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.957+0000 7f9b0199c700 1 -- 172.21.15.50:0/2430819561 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9ae8003b30 msgr2=0x7f9af40dc590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:02.978 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.957+0000 7f9b0199c700 1 --2- 172.21.15.50:0/2430819561 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9ae8003b30 0x7f9af40dc590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:02.978 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.957+0000 7f9b0199c700 1 -- 172.21.15.50:0/2430819561 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9af40eed20 msgr2=0x7f9af40e1d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:02.978 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.958+0000 7f9b0199c700 1 --2- 172.21.15.50:0/2430819561 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9af40eed20 0x7f9af40e1d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:02.979 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.958+0000 7f9b0199c700 1 -- 172.21.15.50:0/2430819561 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9af40507d0 con 0x7f9af4050060 2023-10-06T01:22:02.979 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.957+0000 7f2d1a7fc700 1 --2- 172.21.15.50:0/3092585580 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f2d08067050 0x7f2d08069500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:02.979 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.958+0000 7f2d1a7fc700 1 -- 172.21.15.50:0/3092585580 <== mon.1 v2:172.21.15.155:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f2d20084b80 con 0x7f2d1c051ed0 2023-10-06T01:22:02.979 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.958+0000 7f7618ff9700 1 --2- 172.21.15.50:0/3594071787 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f75fc066f80 0x7f75fc069430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:02.979 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.958+0000 7f7618ff9700 1 -- 172.21.15.50:0/3594071787 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f7614019070 con 0x7f761c1531e0 2023-10-06T01:22:02.980 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.958+0000 7f2d2a39b700 1 --2- 172.21.15.50:0/3092585580 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f2d08067050 0x7f2d08069500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:02.980 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.958+0000 7fa080b9d700 1 Processor -- start 2023-10-06T01:22:02.980 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.959+0000 7fa080b9d700 1 -- start start 2023-10-06T01:22:02.980 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.959+0000 7f9b0199c700 1 --2- 172.21.15.50:0/2430819561 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9af4050060 0x7f9af403d8f0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f9afc0656e0 tx=0x7f9afc067390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:22:02.981 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.957+0000 7f35d979d700 1 -- start start 2023-10-06T01:22:02.981 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.959+0000 7f35d979d700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f35d41551e0 0x7f35d406e240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:02.981 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.959+0000 7f761bfff700 1 --2- 172.21.15.50:0/3594071787 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f75fc066f80 0x7f75fc069430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:02.981 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.959+0000 7fe96b59e700 1 Processor -- start 2023-10-06T01:22:02.982 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.959+0000 7f2d2a39b700 1 --2- 172.21.15.50:0/3092585580 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f2d08067050 0x7f2d08069500 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f2d2404d1b0 tx=0x7f2d2406b000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:22:02.982 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.959+0000 7f80025ff700 1 Processor -- start 2023-10-06T01:22:02.982 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.960+0000 7f80025ff700 1 -- start start 2023-10-06T01:22:02.982 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.960+0000 7fa080b9d700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa07c0b2850 0x7fa07c1695e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:02.983 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.960+0000 7f35d979d700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f35d4159d20 0x7f35d406ecf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:02.983 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.960+0000 7f35d979d700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f35d406d250 con 0x7f35d40cc610 2023-10-06T01:22:02.983 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.960+0000 7f35d979d700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f35d406f5f0 con 0x7f35d4159d20 2023-10-06T01:22:02.983 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.960+0000 7f35d979d700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35d406d480 con 0x7f35d41551e0 2023-10-06T01:22:02.983 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.960+0000 7f761bfff700 1 --2- 172.21.15.50:0/3594071787 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f75fc066f80 0x7f75fc069430 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f760c002c70 tx=0x7f760c007c80 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:22:02.984 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.960+0000 7fa080b9d700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa07c0cbc70 0x7fa07c159ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:02.984 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.960+0000 7fa080b9d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa07c159480 0x7fa07c15a010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:02.984 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.960+0000 7fa080b9d700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa07c16a0d0 con 0x7fa07c159480 2023-10-06T01:22:02.984 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.960+0000 7fa080b9d700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa07c15c960 con 0x7fa07c0b2850 2023-10-06T01:22:02.984 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.960+0000 7fa080b9d700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa07c15cc40 con 0x7fa07c0cbc70 2023-10-06T01:22:02.985 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.960+0000 7f35d3fff700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f35d41551e0 0x7f35d406e240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:02.985 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.961+0000 7fa07b7fe700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa07c0b2850 0x7fa07c1695e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:02.985 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.961+0000 7fa07affd700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa07c0cbc70 0x7fa07c159ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:02.985 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.961+0000 7fa07b7fe700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa07c0b2850 0x7fa07c1695e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.50:54328/0 (socket says 172.21.15.50:54328) 2023-10-06T01:22:02.985 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.961+0000 7f35d3fff700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f35d41551e0 0x7f35d406e240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3301/0 says I am v2:172.21.15.50:49766/0 (socket says 172.21.15.50:49766) 2023-10-06T01:22:02.985 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.961+0000 7f35d3fff700 1 -- 172.21.15.50:0/1335401379 learned_addr learned my addr 172.21.15.50:0/1335401379 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-06T01:22:02.986 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.961+0000 7f35d37fe700 1 --2- 172.21.15.50:0/1335401379 >> v2:172.21.15.50:3300/0 conn(0x7f35d4159d20 0x7f35d406ecf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:02.986 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.961+0000 7fa07affd700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa07c0cbc70 0x7fa07c159ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3301/0 says I am v2:172.21.15.50:49772/0 (socket says 172.21.15.50:49772) 2023-10-06T01:22:02.986 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.961+0000 7fa07b7fe700 1 -- 172.21.15.50:0/3373739373 learned_addr learned my addr 172.21.15.50:0/3373739373 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-06T01:22:02.986 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.961+0000 7f80025ff700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7ff403b070 0x7f7ff4050220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:02.987 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.961+0000 7fa07bfff700 1 --2- 172.21.15.50:0/3373739373 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa07c159480 0x7fa07c15a010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:02.987 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.961+0000 7f80025ff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7ff4055050 0x7f7ff4052bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:02.987 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.961+0000 7f80025ff700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7ff40e22f0 0x7f7ff40f2360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:02.987 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.961+0000 7fa07b7fe700 1 -- 172.21.15.50:0/3373739373 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa07c0cbc70 msgr2=0x7fa07c159ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:02.988 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.962+0000 7fa07b7fe700 1 --2- 172.21.15.50:0/3373739373 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa07c0cbc70 0x7fa07c159ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:02.988 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.962+0000 7fa07b7fe700 1 -- 172.21.15.50:0/3373739373 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa07c159480 msgr2=0x7fa07c15a010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:02.988 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.962+0000 7f35d3fff700 1 -- 172.21.15.50:0/1335401379 >> v2:172.21.15.50:3300/0 conn(0x7f35d4159d20 msgr2=0x7f35d406ecf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:22:02.988 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.962+0000 7f35d3fff700 1 --2- 172.21.15.50:0/1335401379 >> v2:172.21.15.50:3300/0 conn(0x7f35d4159d20 0x7f35d406ecf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:02.988 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.962+0000 7fa07b7fe700 1 --2- 172.21.15.50:0/3373739373 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa07c159480 0x7fa07c15a010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:02.989 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.962+0000 7f35d3fff700 1 -- 172.21.15.50:0/1335401379 >> v1:172.21.15.155:6789/0 conn(0x7f35d40cc610 legacy=0x7f35d40c6750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:02.989 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.962+0000 7f35d3fff700 1 -- 172.21.15.50:0/1335401379 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35d406d760 con 0x7f35d41551e0 2023-10-06T01:22:02.989 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.959+0000 7fe96b59e700 1 -- start start 2023-10-06T01:22:02.989 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.962+0000 7fa07b7fe700 1 -- 172.21.15.50:0/3373739373 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa074009ae0 con 0x7fa07c0b2850 2023-10-06T01:22:02.990 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.962+0000 7fe96b59e700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fe96c0cd370 0x7fe96c0ce9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:02.990 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.962+0000 7fe96b59e700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe96c0cc840 con 0x7fe96c0c6260 2023-10-06T01:22:02.990 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.962+0000 7fe96b59e700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe96c0cbc70 con 0x7fe96c1594b0 2023-10-06T01:22:02.990 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.962+0000 7fe96b59e700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe96c0cbf10 con 0x7fe96c0cd370 2023-10-06T01:22:02.990 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.962+0000 7f80025ff700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ff40f1ed0 con 0x7f7ff4055050 2023-10-06T01:22:02.990 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.962+0000 7f80025ff700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ff404cf00 con 0x7f7ff40e22f0 2023-10-06T01:22:02.990 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.962+0000 7f80025ff700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ff4050800 con 0x7f7ff403b070 2023-10-06T01:22:02.991 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.962+0000 7f7ffbfff700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7ff403b070 0x7f7ff4050220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:02.991 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.962+0000 7f8000b9c700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7ff40e22f0 0x7f7ff40f2360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:02.991 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.962+0000 7fa07affd700 1 --2- 172.21.15.50:0/3373739373 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa07c0cbc70 0x7fa07c159ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T01:22:02.991 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.962+0000 7fe96a59c700 1 --1- >> v1:172.21.15.155:6789/0 conn(0x7fe96c1594b0 0x7fe96c0ccc60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.155:6789/0 says I am v1:172.21.15.50:57018/0 (socket says 172.21.15.50:57018) 2023-10-06T01:22:02.991 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.962+0000 7f7ffbfff700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7ff403b070 0x7f7ff4050220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3301/0 says I am v2:172.21.15.50:49778/0 (socket says 172.21.15.50:49778) 2023-10-06T01:22:02.992 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.962+0000 7f7ffbfff700 1 -- 172.21.15.50:0/2984833442 learned_addr learned my addr 172.21.15.50:0/2984833442 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-06T01:22:02.992 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.962+0000 7f7ffb7fe700 1 --2- 172.21.15.50:0/2984833442 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7ff4055050 0x7f7ff4052bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:02.992 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.963+0000 7fa07b7fe700 1 --2- 172.21.15.50:0/3373739373 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa07c0b2850 0x7fa07c1695e0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fa07000b5e0 tx=0x7fa070009120 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:22:02.992 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.963+0000 7f2d1a7fc700 1 -- 172.21.15.50:0/3092585580 <== mon.1 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f2d20051980 con 0x7f2d1c051ed0 2023-10-06T01:22:02.993 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.963+0000 7f35d3fff700 1 --2- 172.21.15.50:0/1335401379 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f35d41551e0 0x7f35d406e240 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f35c40099b0 tx=0x7f35c4009250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=21eecca901c249f5 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:22:02.993 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.963+0000 7fe96ad9d700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fe96c0c6260 0x7fe96c0cef00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:40284/0 (socket says 172.21.15.50:40284) 2023-10-06T01:22:02.993 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.963+0000 7fe96a59c700 1 -- 172.21.15.50:0/4097167320 learned_addr learned my addr 172.21.15.50:0/4097167320 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-10-06T01:22:02.993 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.963+0000 7fe969d9b700 1 --2- 172.21.15.50:0/4097167320 >> v2:172.21.15.50:3300/0 conn(0x7fe96c0cd370 0x7fe96c0ce9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:02.994 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.963+0000 7fa0637fe700 1 -- 172.21.15.50:0/3373739373 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa07000f510 con 0x7fa07c0b2850 2023-10-06T01:22:02.994 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.963+0000 7fa0637fe700 1 -- 172.21.15.50:0/3373739373 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa07000f670 con 0x7fa07c0b2850 2023-10-06T01:22:02.994 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.963+0000 7fa0637fe700 1 -- 172.21.15.50:0/3373739373 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa07000fa30 con 0x7fa07c0b2850 2023-10-06T01:22:02.994 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.963+0000 7fa080b9d700 1 -- 172.21.15.50:0/3373739373 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa07c0c8830 con 0x7fa07c0b2850 2023-10-06T01:22:02.994 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.963+0000 7fa080b9d700 1 -- 172.21.15.50:0/3373739373 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa07c0c8df0 con 0x7fa07c0b2850 2023-10-06T01:22:02.994 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.963+0000 7f7ffbfff700 1 -- 172.21.15.50:0/2984833442 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7ff40e22f0 msgr2=0x7f7ff40f2360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:02.994 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.963+0000 7f7ffbfff700 1 --2- 172.21.15.50:0/2984833442 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7ff40e22f0 0x7f7ff40f2360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:02.994 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.963+0000 7f7ffbfff700 1 -- 172.21.15.50:0/2984833442 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7ff4055050 msgr2=0x7f7ff4052bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:02.995 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.963+0000 7f7ffbfff700 1 --2- 172.21.15.50:0/2984833442 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7ff4055050 0x7f7ff4052bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:02.995 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.963+0000 7f7ffbfff700 1 -- 172.21.15.50:0/2984833442 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ff00094f0 con 0x7f7ff403b070 2023-10-06T01:22:02.995 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.964+0000 7fe969d9b700 1 -- 172.21.15.50:0/4097167320 >> v1:172.21.15.155:6789/0 conn(0x7fe96c1594b0 legacy=0x7fe96c0ccc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:02.995 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.964+0000 7fe969d9b700 1 -- 172.21.15.50:0/4097167320 >> v1:172.21.15.50:6789/0 conn(0x7fe96c0c6260 legacy=0x7fe96c0cef00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:02.995 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.964+0000 7fe969d9b700 1 -- 172.21.15.50:0/4097167320 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe96c0cc1f0 con 0x7fe96c0cd370 2023-10-06T01:22:02.995 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.964+0000 7f7ffbfff700 1 --2- 172.21.15.50:0/2984833442 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7ff403b070 0x7f7ff4050220 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f7ff001e040 tx=0x7f7ff001b000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:22:02.996 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.963+0000 7f35d2ffd700 1 -- 172.21.15.50:0/1335401379 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35c4009ea0 con 0x7f35d41551e0 2023-10-06T01:22:02.996 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.963+0000 7f35d2ffd700 1 -- 172.21.15.50:0/1335401379 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35c400b860 con 0x7f35d41551e0 2023-10-06T01:22:02.996 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.963+0000 7f35d2ffd700 1 -- 172.21.15.50:0/1335401379 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35c400bbe0 con 0x7f35d41551e0 2023-10-06T01:22:02.996 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.964+0000 7f35d979d700 1 -- 172.21.15.50:0/1335401379 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f35d41551e0 msgr2=0x7f35d406e240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:02.996 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.964+0000 7f35d979d700 1 --2- 172.21.15.50:0/1335401379 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f35d41551e0 0x7f35d406e240 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f35c40099b0 tx=0x7f35c4009250 comp rx=0 tx=0).stop 2023-10-06T01:22:02.996 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.964+0000 7fe969d9b700 1 --2- 172.21.15.50:0/4097167320 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe96c0cd370 0x7fe96c0ce9c0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fe954009e30 tx=0x7fe954009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=10f906d0d6793e7a server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:22:02.997 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.965+0000 7f7fe7fff700 1 -- 172.21.15.50:0/2984833442 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ff001c9d0 con 0x7f7ff403b070 2023-10-06T01:22:02.997 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.965+0000 7f7fe7fff700 1 -- 172.21.15.50:0/2984833442 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ff001cb50 con 0x7f7ff403b070 2023-10-06T01:22:02.997 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.965+0000 7f7fe7fff700 1 -- 172.21.15.50:0/2984833442 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ff0027400 con 0x7f7ff403b070 2023-10-06T01:22:02.997 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.965+0000 7f35d979d700 1 -- 172.21.15.50:0/1335401379 shutdown_connections 2023-10-06T01:22:02.998 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.965+0000 7f35d979d700 1 --2- 172.21.15.50:0/1335401379 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f35d41551e0 0x7f35d406e240 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:02.998 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.965+0000 7f35d979d700 1 --2- 172.21.15.50:0/1335401379 >> v2:172.21.15.50:3300/0 conn(0x7f35d4159d20 0x7f35d406ecf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:02.998 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.965+0000 7f35d979d700 1 -- 172.21.15.50:0/1335401379 >> 172.21.15.50:0/1335401379 conn(0x7f35d40680c0 msgr2=0x7f35d40cbf00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:22:02.998 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.965+0000 7f80025ff700 1 -- 172.21.15.50:0/2984833442 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7ff4050ae0 con 0x7f7ff403b070 2023-10-06T01:22:02.998 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.965+0000 7fa080b9d700 1 -- 172.21.15.50:0/3373739373 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa05c0052b0 con 0x7fa07c0b2850 2023-10-06T01:22:02.999 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.966+0000 7f80025ff700 1 -- 172.21.15.50:0/2984833442 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7ff40f1b60 con 0x7f7ff403b070 2023-10-06T01:22:02.999 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.966+0000 7f31483ff700 1 Processor -- start 2023-10-06T01:22:02.999 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.966+0000 7f35d979d700 1 -- 172.21.15.50:0/1335401379 shutdown_connections 2023-10-06T01:22:02.999 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.966+0000 7f35d979d700 1 -- 172.21.15.50:0/1335401379 wait complete. 2023-10-06T01:22:03.000 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.966+0000 7f31483ff700 1 -- start start 2023-10-06T01:22:03.000 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.968+0000 7f7fe5ffb700 1 -- 172.21.15.50:0/2984833442 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7ff4005980 con 0x7f7ff403b070 2023-10-06T01:22:03.000 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.968+0000 7fe96959a700 1 -- 172.21.15.50:0/4097167320 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe95400e070 con 0x7fe96c0cd370 2023-10-06T01:22:03.000 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.968+0000 7fa0637fe700 1 -- 172.21.15.50:0/3373739373 <== mon.1 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fa07001a400 con 0x7fa07c0b2850 2023-10-06T01:22:03.001 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.968+0000 7f7618ff9700 1 -- 172.21.15.50:0/3594071787 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f761c1535b0 con 0x7f761c1531e0 2023-10-06T01:22:03.001 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.968+0000 7fe96959a700 1 -- 172.21.15.50:0/4097167320 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe95400bbb0 con 0x7fe96c0cd370 2023-10-06T01:22:03.001 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.968+0000 7fe96959a700 1 -- 172.21.15.50:0/4097167320 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe954012430 con 0x7fe96c0cd370 2023-10-06T01:22:03.002 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.968+0000 7f31483ff700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f31400bf360 0x7f31400c8490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:03.002 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.968+0000 7f31483ff700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f3140069c70 0x7f31400c66c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:03.002 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.969+0000 7fa0637fe700 1 --2- 172.21.15.50:0/3373739373 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7fa068067080 0x7fa068069530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:03.002 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.969+0000 7f31483ff700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f31400c8000 con 0x7f31400bf730 2023-10-06T01:22:03.002 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.969+0000 7f31483ff700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f314015e1d0 con 0x7f3140069c70 2023-10-06T01:22:03.002 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.969+0000 7f31483ff700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31400c73f0 con 0x7f31400bf360 2023-10-06T01:22:03.003 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.969+0000 7fe96b59e700 1 -- 172.21.15.50:0/4097167320 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe96c0cd370 msgr2=0x7fe96c0ce9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:03.003 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.969+0000 7fe96b59e700 1 --2- 172.21.15.50:0/4097167320 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe96c0cd370 0x7fe96c0ce9c0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fe954009e30 tx=0x7fe954009780 comp rx=0 tx=0).stop 2023-10-06T01:22:03.003 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.970+0000 7f314699c700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f3140069c70 0x7f31400c66c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:03.004 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.970+0000 7fa0637fe700 1 -- 172.21.15.50:0/3373739373 <== mon.1 v2:172.21.15.155:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6809+0+0 (secure 0 0 0) 0x7fa070084830 con 0x7fa07c0b2850 2023-10-06T01:22:03.004 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.970+0000 7f314699c700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f3140069c70 0x7f31400c66c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.50:54340/0 (socket says 172.21.15.50:54340) 2023-10-06T01:22:03.004 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.970+0000 7f314699c700 1 -- 172.21.15.50:0/3787164763 learned_addr learned my addr 172.21.15.50:0/3787164763 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-06T01:22:03.004 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.969+0000 7f7fe7fff700 1 -- 172.21.15.50:0/2984833442 <== mon.2 v2:172.21.15.155:3301/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f7ff00277f0 con 0x7f7ff403b070 2023-10-06T01:22:03.005 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.970+0000 7f7fe7fff700 1 --2- 172.21.15.50:0/2984833442 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f7fe0067080 0x7f7fe0069530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:03.005 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.968+0000 7f35d979d700 1 Processor -- start 2023-10-06T01:22:03.005 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.968+0000 7f35d979d700 1 -- start start 2023-10-06T01:22:03.005 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.970+0000 7f35d979d700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f35d40cc610 0x7f35d4156310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:03.005 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.970+0000 7f35d979d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f35d41551e0 0x7f35d417a760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:03.005 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.970+0000 7f35d3fff700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f35d40cc610 0x7f35d4156310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:03.005 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.970+0000 7f35d979d700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f35d4159d20 0x7f35d414e080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:03.005 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.970+0000 7f35d3fff700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f35d40cc610 0x7f35d4156310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3301/0 says I am v2:172.21.15.50:49798/0 (socket says 172.21.15.50:49798) 2023-10-06T01:22:03.005 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.970+0000 7f35d3fff700 1 -- 172.21.15.50:0/3710370790 learned_addr learned my addr 172.21.15.50:0/3710370790 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-06T01:22:03.006 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.970+0000 7f35d979d700 1 -- 172.21.15.50:0/3710370790 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35d4157600 con 0x7f35d41551e0 2023-10-06T01:22:03.006 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.970+0000 7f35d979d700 1 -- 172.21.15.50:0/3710370790 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35d417aca0 con 0x7f35d4159d20 2023-10-06T01:22:03.006 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.970+0000 7f35d979d700 1 -- 172.21.15.50:0/3710370790 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35d41569f0 con 0x7f35d40cc610 2023-10-06T01:22:03.006 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.971+0000 7f35d8f9c700 1 --2- 172.21.15.50:0/3710370790 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f35d4159d20 0x7f35d414e080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:03.006 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.970+0000 7f314699c700 1 -- 172.21.15.50:0/3787164763 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f31400bf360 msgr2=0x7f31400c8490 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-10-06T01:22:03.006 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.970+0000 7f314699c700 1 --2- 172.21.15.50:0/3787164763 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f31400bf360 0x7f31400c8490 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:03.006 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.970+0000 7f314699c700 1 -- 172.21.15.50:0/3787164763 >> v1:172.21.15.50:6789/0 conn(0x7f31400bf730 legacy=0x7f3140069560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:22:03.006 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.970+0000 7f314699c700 1 -- 172.21.15.50:0/3787164763 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31400c76d0 con 0x7f3140069c70 2023-10-06T01:22:03.007 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.971+0000 7f35d37fe700 1 --2- 172.21.15.50:0/3710370790 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f35d41551e0 0x7f35d417a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:03.007 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.971+0000 7f7fe7fff700 1 -- 172.21.15.50:0/2984833442 <== mon.2 v2:172.21.15.155:3301/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f7ff008ee40 con 0x7f7ff403b070 2023-10-06T01:22:03.007 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.968+0000 7f9af17fa700 1 -- 172.21.15.50:0/2430819561 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9afc08c070 con 0x7f9af4050060 2023-10-06T01:22:03.007 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.968+0000 7f9b0219d700 1 -- 172.21.15.50:0/2430819561 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9af4050ab0 con 0x7f9af4050060 2023-10-06T01:22:03.007 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.968+0000 7f9b0219d700 1 -- 172.21.15.50:0/2430819561 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9af40504d0 con 0x7f9af4050060 2023-10-06T01:22:03.009 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.968+0000 7f9af17fa700 1 -- 172.21.15.50:0/2430819561 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9afc068980 con 0x7f9af4050060 2023-10-06T01:22:03.009 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.968+0000 7f9af17fa700 1 -- 172.21.15.50:0/2430819561 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9afc068d20 con 0x7f9af4050060 2023-10-06T01:22:03.009 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.971+0000 7f35d3fff700 1 -- 172.21.15.50:0/3710370790 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f35d4159d20 msgr2=0x7f35d414e080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:03.009 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.971+0000 7f35d3fff700 1 --2- 172.21.15.50:0/3710370790 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f35d4159d20 0x7f35d414e080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:03.009 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.971+0000 7f35d3fff700 1 -- 172.21.15.50:0/3710370790 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f35d41551e0 msgr2=0x7f35d417a760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:03.010 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.971+0000 7f35d3fff700 1 --2- 172.21.15.50:0/3710370790 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f35d41551e0 0x7f35d417a760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:03.010 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.971+0000 7f35d3fff700 1 -- 172.21.15.50:0/3710370790 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35c40094f0 con 0x7f35d40cc610 2023-10-06T01:22:03.010 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.971+0000 7f314699c700 1 --2- 172.21.15.50:0/3787164763 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3140069c70 0x7f31400c66c0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f3138009f20 tx=0x7f3138009840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=82e3c9fce636ea4a server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:22:03.010 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.971+0000 7fa07affd700 1 --2- 172.21.15.50:0/3373739373 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7fa068067080 0x7fa068069530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:03.010 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.971+0000 7f7ffb7fe700 1 --2- 172.21.15.50:0/2984833442 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f7fe0067080 0x7f7fe0069530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:03.011 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.971+0000 7f35d3fff700 1 --2- 172.21.15.50:0/3710370790 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f35d40cc610 0x7f35d4156310 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f35d406d5c0 tx=0x7f35c4017000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:22:03.011 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.972+0000 7fe96b59e700 1 -- 172.21.15.50:0/4097167320 shutdown_connections 2023-10-06T01:22:03.011 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.972+0000 7fe96b59e700 1 --2- 172.21.15.50:0/4097167320 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe96c0cd370 0x7fe96c0ce9c0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:03.011 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.972+0000 7fe96b59e700 1 -- 172.21.15.50:0/4097167320 >> 172.21.15.50:0/4097167320 conn(0x7fe96c099600 msgr2=0x7fe96c06f500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:22:03.012 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.972+0000 7f7ffb7fe700 1 --2- 172.21.15.50:0/2984833442 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f7fe0067080 0x7f7fe0069530 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f7ff40de340 tx=0x7f7fe8000f90 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:22:03.012 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.972+0000 7f9af17fa700 1 -- 172.21.15.50:0/2430819561 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f9afc070810 con 0x7f9af4050060 2023-10-06T01:22:03.012 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.972+0000 7f9b0219d700 1 -- 172.21.15.50:0/2430819561 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9adc0052b0 con 0x7f9af4050060 2023-10-06T01:22:03.012 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.972+0000 7fe96b59e700 1 -- 172.21.15.50:0/4097167320 shutdown_connections 2023-10-06T01:22:03.012 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.972+0000 7fe96b59e700 1 -- 172.21.15.50:0/4097167320 wait complete. 2023-10-06T01:22:03.013 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.972+0000 7fa07affd700 1 --2- 172.21.15.50:0/3373739373 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7fa068067080 0x7fa068069530 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fa07c0cce60 tx=0x7fa06c000f90 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:22:03.013 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.973+0000 7f3145199700 1 -- 172.21.15.50:0/3787164763 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f313800e070 con 0x7f3140069c70 2023-10-06T01:22:03.013 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.973+0000 7f3145199700 1 -- 172.21.15.50:0/3787164763 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f313800ba40 con 0x7f3140069c70 2023-10-06T01:22:03.013 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.973+0000 7f3145199700 1 -- 172.21.15.50:0/3787164763 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31380092e0 con 0x7f3140069c70 2023-10-06T01:22:03.014 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.974+0000 7fe96b59e700 1 Processor -- start 2023-10-06T01:22:03.014 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.974+0000 7f9af17fa700 1 --2- 172.21.15.50:0/2430819561 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f9ae0067000 0x7f9ae00694b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:03.014 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.974+0000 7f9af17fa700 1 -- 172.21.15.50:0/2430819561 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f9afc0faaa0 con 0x7f9af4050060 2023-10-06T01:22:03.014 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.974+0000 7fe96b59e700 1 -- start start 2023-10-06T01:22:03.015 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.974+0000 7fa0637fe700 1 -- 172.21.15.50:0/3373739373 <== mon.1 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fa0700516b0 con 0x7fa07c0b2850 2023-10-06T01:22:03.015 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.974+0000 7f9b0119b700 1 --2- 172.21.15.50:0/2430819561 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f9ae0067000 0x7f9ae00694b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:03.015 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.974+0000 7f31483ff700 1 -- 172.21.15.50:0/3787164763 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3140069c70 msgr2=0x7f31400c66c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:03.016 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.974+0000 7f31483ff700 1 --2- 172.21.15.50:0/3787164763 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3140069c70 0x7f31400c66c0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f3138009f20 tx=0x7f3138009840 comp rx=0 tx=0).stop 2023-10-06T01:22:03.016 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.975+0000 7f31483ff700 1 -- 172.21.15.50:0/3787164763 shutdown_connections 2023-10-06T01:22:03.016 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.975+0000 7f31483ff700 1 --2- 172.21.15.50:0/3787164763 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3140069c70 0x7f31400c66c0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:03.016 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.975+0000 7f31483ff700 1 --2- 172.21.15.50:0/3787164763 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f31400bf360 0x7f31400c8490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:03.016 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.975+0000 7f31483ff700 1 -- 172.21.15.50:0/3787164763 >> 172.21.15.50:0/3787164763 conn(0x7f31400680c0 msgr2=0x7f31400cc120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:22:03.016 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.975+0000 7f31483ff700 1 -- 172.21.15.50:0/3787164763 shutdown_connections 2023-10-06T01:22:03.016 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.975+0000 7f9b0119b700 1 --2- 172.21.15.50:0/2430819561 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f9ae0067000 0x7f9ae00694b0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f9af8008fd0 tx=0x7f9af8015000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:22:03.017 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.975+0000 7fe96b59e700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe96c0c6260 0x7fe96c1514e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:03.017 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.975+0000 7fe96b59e700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe96c0cd370 0x7fe96c152c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:03.017 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.976+0000 7fe96b59e700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe96c1594b0 0x7fe96c0c82d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:03.017 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.976+0000 7fe969d9b700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe96c0cd370 0x7fe96c152c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:03.018 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.976+0000 7fe969d9b700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe96c0cd370 0x7fe96c152c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.50:54364/0 (socket says 172.21.15.50:54364) 2023-10-06T01:22:03.018 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.976+0000 7fe969d9b700 1 -- 172.21.15.50:0/4217977287 learned_addr learned my addr 172.21.15.50:0/4217977287 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-06T01:22:03.018 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.976+0000 7fe96a59c700 1 --2- 172.21.15.50:0/4217977287 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe96c0c6260 0x7fe96c1514e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:03.018 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.976+0000 7fe96b59e700 1 -- 172.21.15.50:0/4217977287 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe96c1527a0 con 0x7fe96c0c6260 2023-10-06T01:22:03.018 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.976+0000 7fe96b59e700 1 -- 172.21.15.50:0/4217977287 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe96c151b90 con 0x7fe96c0cd370 2023-10-06T01:22:03.018 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.976+0000 7fe96b59e700 1 -- 172.21.15.50:0/4217977287 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe96c151e70 con 0x7fe96c1594b0 2023-10-06T01:22:03.018 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.975+0000 7f31483ff700 1 -- 172.21.15.50:0/3787164763 wait complete. 2023-10-06T01:22:03.019 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.977+0000 7fe96ad9d700 1 --2- 172.21.15.50:0/4217977287 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe96c1594b0 0x7fe96c0c82d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:03.019 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.977+0000 7fe969d9b700 1 -- 172.21.15.50:0/4217977287 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe96c1594b0 msgr2=0x7fe96c0c82d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:03.019 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.977+0000 7fe969d9b700 1 --2- 172.21.15.50:0/4217977287 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe96c1594b0 0x7fe96c0c82d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:03.019 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.977+0000 7fe969d9b700 1 -- 172.21.15.50:0/4217977287 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe96c0c6260 msgr2=0x7fe96c1514e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:03.019 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.977+0000 7fe969d9b700 1 --2- 172.21.15.50:0/4217977287 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe96c0c6260 0x7fe96c1514e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:03.019 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.977+0000 7fe969d9b700 1 -- 172.21.15.50:0/4217977287 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe954009a20 con 0x7fe96c0cd370 2023-10-06T01:22:03.019 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.977+0000 7f31483ff700 1 Processor -- start 2023-10-06T01:22:03.020 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.978+0000 7fe969d9b700 1 --2- 172.21.15.50:0/4217977287 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe96c0cd370 0x7fe96c152c30 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fe95400b6c0 tx=0x7fe954018000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:22:03.020 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.978+0000 7f31483ff700 1 -- start start 2023-10-06T01:22:03.020 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.979+0000 7f7fe7fff700 1 -- 172.21.15.50:0/2984833442 <== mon.2 v2:172.21.15.155:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f7ff005bc40 con 0x7f7ff403b070 2023-10-06T01:22:03.021 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.979+0000 7f31483ff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3140069c70 0x7f3140157da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:03.021 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.979+0000 7f35bbfff700 1 -- 172.21.15.50:0/3710370790 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35c4011420 con 0x7f35d40cc610 2023-10-06T01:22:03.021 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.980+0000 7f9af17fa700 1 -- 172.21.15.50:0/2430819561 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f9afc0c78a0 con 0x7f9af4050060 2023-10-06T01:22:03.022 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.979+0000 7f35bbfff700 1 -- 172.21.15.50:0/3710370790 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35c40115c0 con 0x7f35d40cc610 2023-10-06T01:22:03.022 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.980+0000 7f35bbfff700 1 -- 172.21.15.50:0/3710370790 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35c4011980 con 0x7f35d40cc610 2023-10-06T01:22:03.022 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.980+0000 7f35d979d700 1 -- 172.21.15.50:0/3710370790 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f35d4156cd0 con 0x7f35d40cc610 2023-10-06T01:22:03.022 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.980+0000 7f35d979d700 1 -- 172.21.15.50:0/3710370790 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f35d4157290 con 0x7f35d40cc610 2023-10-06T01:22:03.023 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.979+0000 7f31483ff700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f31400bf360 0x7f314015ecd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:03.023 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.979+0000 7f31483ff700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f31400bf730 0x7f31400c8760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:03.024 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.979+0000 7f314619b700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3140069c70 0x7f3140157da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:03.024 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.979+0000 7f314619b700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3140069c70 0x7f3140157da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:48224/0 (socket says 172.21.15.50:48224) 2023-10-06T01:22:03.024 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.980+0000 7f314699c700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f31400bf730 0x7f31400c8760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:03.024 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.980+0000 7f314699c700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f31400bf730 0x7f31400c8760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3301/0 says I am v2:172.21.15.50:49824/0 (socket says 172.21.15.50:49824) 2023-10-06T01:22:03.024 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.980+0000 7f314599a700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f31400bf360 0x7f314015ecd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:03.024 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.980+0000 7f314599a700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f31400bf360 0x7f314015ecd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.50:54378/0 (socket says 172.21.15.50:54378) 2023-10-06T01:22:03.024 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.980+0000 7f314619b700 1 -- 172.21.15.50:0/3523232773 learned_addr learned my addr 172.21.15.50:0/3523232773 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-06T01:22:03.024 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.980+0000 7f31483ff700 1 -- 172.21.15.50:0/3523232773 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3140172630 con 0x7f3140069c70 2023-10-06T01:22:03.024 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.980+0000 7f31483ff700 1 -- 172.21.15.50:0/3523232773 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3140171a60 con 0x7f31400bf360 2023-10-06T01:22:03.024 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.980+0000 7f31483ff700 1 -- 172.21.15.50:0/3523232773 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31401582e0 con 0x7f31400bf730 2023-10-06T01:22:03.025 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.980+0000 7f314619b700 1 -- 172.21.15.50:0/3523232773 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f31400bf730 msgr2=0x7f31400c8760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:03.025 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.980+0000 7f314619b700 1 --2- 172.21.15.50:0/3523232773 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f31400bf730 0x7f31400c8760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:03.025 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.982+0000 7fe9627fc700 1 -- 172.21.15.50:0/4217977287 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe95400be70 con 0x7fe96c0cd370 2023-10-06T01:22:03.025 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.982+0000 7fe9627fc700 1 -- 172.21.15.50:0/4217977287 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe95401c620 con 0x7fe96c0cd370 2023-10-06T01:22:03.025 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.980+0000 7f314619b700 1 -- 172.21.15.50:0/3523232773 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f31400bf360 msgr2=0x7f314015ecd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:03.026 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.982+0000 7fe9627fc700 1 -- 172.21.15.50:0/4217977287 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe95401c9c0 con 0x7fe96c0cd370 2023-10-06T01:22:03.026 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.980+0000 7f314619b700 1 --2- 172.21.15.50:0/3523232773 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f31400bf360 0x7f314015ecd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:03.026 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.983+0000 7fe96b59e700 1 -- 172.21.15.50:0/4217977287 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe96c152150 con 0x7fe96c0cd370 2023-10-06T01:22:03.027 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.980+0000 7f314619b700 1 -- 172.21.15.50:0/3523232773 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3138009ae0 con 0x7f3140069c70 2023-10-06T01:22:03.027 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.981+0000 7f314619b700 1 --2- 172.21.15.50:0/3523232773 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3140069c70 0x7f3140157da0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f313c00b600 tx=0x7f313c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:22:03.027 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.981+0000 7f314599a700 1 --2- 172.21.15.50:0/3523232773 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f31400bf360 0x7f314015ecd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T01:22:03.027 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.984+0000 7fe96b59e700 1 -- 172.21.15.50:0/4217977287 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe96c15c1e0 con 0x7fe96c0cd370 2023-10-06T01:22:03.028 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.983+0000 7f31367fc700 1 -- 172.21.15.50:0/3523232773 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f313c00f510 con 0x7f3140069c70 2023-10-06T01:22:03.028 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.983+0000 7f31483ff700 1 -- 172.21.15.50:0/3523232773 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3140171d00 con 0x7f3140069c70 2023-10-06T01:22:03.028 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.983+0000 7f31483ff700 1 -- 172.21.15.50:0/3523232773 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f31401722c0 con 0x7f3140069c70 2023-10-06T01:22:03.028 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.983+0000 7f31367fc700 1 -- 172.21.15.50:0/3523232773 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f313c00f670 con 0x7f3140069c70 2023-10-06T01:22:03.028 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.983+0000 7f31367fc700 1 -- 172.21.15.50:0/3523232773 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f313c00fa30 con 0x7f3140069c70 2023-10-06T01:22:03.029 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.983+0000 7f35bbfff700 1 -- 172.21.15.50:0/3710370790 <== mon.2 v2:172.21.15.155:3301/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f35c40473f0 con 0x7f35d40cc610 2023-10-06T01:22:03.029 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.985+0000 7f35bbfff700 1 --2- 172.21.15.50:0/3710370790 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f35c0067000 0x7f35c00694b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:03.029 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.985+0000 7f35bbfff700 1 -- 172.21.15.50:0/3710370790 <== mon.2 v2:172.21.15.155:3301/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f35c40a87a0 con 0x7f35d40cc610 2023-10-06T01:22:03.029 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.985+0000 7f35d37fe700 1 --2- 172.21.15.50:0/3710370790 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f35c0067000 0x7f35c00694b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:03.029 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.986+0000 7f35d37fe700 1 --2- 172.21.15.50:0/3710370790 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f35c0067000 0x7f35c00694b0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f35d40cab40 tx=0x7f35cc00b040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:22:03.029 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.986+0000 7f31367fc700 1 -- 172.21.15.50:0/3523232773 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f313c01a400 con 0x7f3140069c70 2023-10-06T01:22:03.030 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.986+0000 7fe94bfff700 1 -- 172.21.15.50:0/4217977287 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe96c152910 con 0x7fe96c0cd370 2023-10-06T01:22:03.030 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.988+0000 7f31367fc700 1 --2- 172.21.15.50:0/3523232773 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f3124067080 0x7f3124069530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:03.030 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.988+0000 7f31367fc700 1 -- 172.21.15.50:0/3523232773 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f313c084450 con 0x7f3140069c70 2023-10-06T01:22:03.030 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.988+0000 7f314599a700 1 --2- 172.21.15.50:0/3523232773 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f3124067080 0x7f3124069530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:03.031 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.988+0000 7fe9627fc700 1 -- 172.21.15.50:0/4217977287 <== mon.1 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fe95402e3f0 con 0x7fe96c0cd370 2023-10-06T01:22:03.031 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.989+0000 7f314599a700 1 --2- 172.21.15.50:0/3523232773 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f3124067080 0x7f3124069530 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f3130006fd0 tx=0x7f3130008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:22:03.031 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.990+0000 7f35d979d700 1 -- 172.21.15.50:0/3710370790 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f35d405f270 con 0x7f35d40cc610 2023-10-06T01:22:03.032 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.990+0000 7fe9627fc700 1 --2- 172.21.15.50:0/4217977287 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7fe94c067080 0x7fe94c069530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:03.032 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.990+0000 7fe9627fc700 1 -- 172.21.15.50:0/4217977287 <== mon.1 v2:172.21.15.155:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6809+0+0 (secure 0 0 0) 0x7fe954086af0 con 0x7fe96c0cd370 2023-10-06T01:22:03.032 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.991+0000 7fe96a59c700 1 --2- 172.21.15.50:0/4217977287 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7fe94c067080 0x7fe94c069530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:03.032 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.991+0000 7f31483ff700 1 -- 172.21.15.50:0/3523232773 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f31280052b0 con 0x7f3140069c70 2023-10-06T01:22:03.033 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.991+0000 7fe96a59c700 1 --2- 172.21.15.50:0/4217977287 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7fe94c067080 0x7fe94c069530 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fe964000c00 tx=0x7fe964009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:22:03.033 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.994+0000 7fe9627fc700 1 -- 172.21.15.50:0/4217977287 <== mon.1 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe9540539a0 con 0x7fe96c0cd370 2023-10-06T01:22:03.033 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:02.999+0000 7f35bbfff700 1 -- 172.21.15.50:0/3710370790 <== mon.2 v2:172.21.15.155:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f35c40755a0 con 0x7f35d40cc610 2023-10-06T01:22:03.033 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:03.001+0000 7f31367fc700 1 -- 172.21.15.50:0/3523232773 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f313c054d60 con 0x7f3140069c70 2023-10-06T01:22:03.410 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:03.408+0000 7f76223ff700 1 -- 172.21.15.50:0/3594071787 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f761c1535b0 con 0x7f761c1531e0 2023-10-06T01:22:03.411 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:03.409+0000 7f7618ff9700 1 -- 172.21.15.50:0/3594071787 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f761c1535b0 con 0x7f761c1531e0 2023-10-06T01:22:03.411 INFO:teuthology.orchestra.run.smithi050.stdout:55834574855 2023-10-06T01:22:03.415 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:03.413+0000 7f7611ffb700 1 -- 172.21.15.50:0/3594071787 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f75fc066f80 msgr2=0x7f75fc069430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:03.415 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:03.414+0000 7f7611ffb700 1 --2- 172.21.15.50:0/3594071787 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f75fc066f80 0x7f75fc069430 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f760c002c70 tx=0x7f760c007c80 comp rx=0 tx=0).stop 2023-10-06T01:22:03.416 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:03.414+0000 7f7611ffb700 1 -- 172.21.15.50:0/3594071787 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f761c1531e0 msgr2=0x7f761c154230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:03.416 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:03.414+0000 7f7611ffb700 1 --2- 172.21.15.50:0/3594071787 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f761c1531e0 0x7f761c154230 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f761c06d290 tx=0x7f761401f000 comp rx=0 tx=0).stop 2023-10-06T01:22:03.416 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:03.415+0000 7f7611ffb700 1 -- 172.21.15.50:0/3594071787 shutdown_connections 2023-10-06T01:22:03.417 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:03.415+0000 7f7611ffb700 1 --2- 172.21.15.50:0/3594071787 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f761c1531e0 0x7f761c154230 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:03.417 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:03.415+0000 7f7611ffb700 1 --2- 172.21.15.50:0/3594071787 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f761c069c70 0x7f761c0c36e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:03.417 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:03.415+0000 7f7611ffb700 1 --2- 172.21.15.50:0/3594071787 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f75fc066f80 0x7f75fc069430 secure :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f760c002c70 tx=0x7f760c007c80 comp rx=0 tx=0).stop 2023-10-06T01:22:03.417 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:03.415+0000 7f7611ffb700 1 --2- 172.21.15.50:0/3594071787 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f761c0addd0 0x7f761c0c5ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:03.418 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:03.415+0000 7f7611ffb700 1 -- 172.21.15.50:0/3594071787 >> 172.21.15.50:0/3594071787 conn(0x7f761c0680c0 msgr2=0x7f761c0cc030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:22:03.418 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:03.416+0000 7f7611ffb700 1 -- 172.21.15.50:0/3594071787 shutdown_connections 2023-10-06T01:22:03.418 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:03.416+0000 7f7611ffb700 1 -- 172.21.15.50:0/3594071787 wait complete. 2023-10-06T01:22:03.423 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:03.422+0000 7f2d2b39d700 1 -- 172.21.15.50:0/3092585580 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f2d1c055a70 con 0x7f2d1c051ed0 2023-10-06T01:22:03.425 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:03.423+0000 7f2d1a7fc700 1 -- 172.21.15.50:0/3092585580 <== mon.1 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f2d20054fa0 con 0x7f2d1c051ed0 2023-10-06T01:22:03.425 INFO:teuthology.orchestra.run.smithi050.stdout:55834574856 2023-10-06T01:22:03.427 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:03.426+0000 7f7fe5ffb700 1 -- 172.21.15.50:0/2984833442 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f7ff4005980 con 0x7f7ff403b070 2023-10-06T01:22:03.429 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:03.427+0000 7f7fe7fff700 1 -- 172.21.15.50:0/2984833442 <== mon.2 v2:172.21.15.155:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f7ff005f260 con 0x7f7ff403b070 2023-10-06T01:22:03.429 INFO:teuthology.orchestra.run.smithi050.stdout:55834574855 2023-10-06T01:22:03.429 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:03.427+0000 7f2d07fff700 1 -- 172.21.15.50:0/3092585580 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f2d08067050 msgr2=0x7f2d08069500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:03.430 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:03.427+0000 7f2d07fff700 1 --2- 172.21.15.50:0/3092585580 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f2d08067050 0x7f2d08069500 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f2d2404d1b0 tx=0x7f2d2406b000 comp rx=0 tx=0).stop 2023-10-06T01:22:03.430 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:03.427+0000 7f2d07fff700 1 -- 172.21.15.50:0/3092585580 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2d1c051ed0 msgr2=0x7f2d1c0de7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:03.430 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:03.428+0000 7f2d07fff700 1 --2- 172.21.15.50:0/3092585580 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2d1c051ed0 0x7f2d1c0de7e0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f2d2000d860 tx=0x7f2d20008040 comp rx=0 tx=0).stop 2023-10-06T01:22:03.430 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:03.428+0000 7f2d07fff700 1 -- 172.21.15.50:0/3092585580 shutdown_connections 2023-10-06T01:22:03.430 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:03.428+0000 7f2d07fff700 1 --2- 172.21.15.50:0/3092585580 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2d1c0ded20 0x7f2d1c0505f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:03.431 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:03.428+0000 7f2d07fff700 1 --2- 172.21.15.50:0/3092585580 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2d1c00d9c0 0x7f2d1c0d9d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:03.431 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:03.428+0000 7f2d07fff700 1 --2- 172.21.15.50:0/3092585580 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f2d08067050 0x7f2d08069500 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:03.431 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:03.428+0000 7f2d07fff700 1 --2- 172.21.15.50:0/3092585580 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2d1c051ed0 0x7f2d1c0de7e0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:03.431 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:03.428+0000 7f2d07fff700 1 -- 172.21.15.50:0/3092585580 >> 172.21.15.50:0/3092585580 conn(0x7f2d1c00cd60 msgr2=0x7f2d1c036ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:22:03.431 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:03.429+0000 7f2d07fff700 1 -- 172.21.15.50:0/3092585580 shutdown_connections 2023-10-06T01:22:03.431 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:03.429+0000 7f2d07fff700 1 -- 172.21.15.50:0/3092585580 wait complete. 2023-10-06T01:22:03.432 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:03.430+0000 7fa080b9d700 1 -- 172.21.15.50:0/3373739373 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7fa05c005830 con 0x7fa07c0b2850 2023-10-06T01:22:03.433 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:03.431+0000 7f80025ff700 1 -- 172.21.15.50:0/2984833442 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f7fe0067080 msgr2=0x7f7fe0069530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:03.433 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:03.431+0000 7f80025ff700 1 --2- 172.21.15.50:0/2984833442 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f7fe0067080 0x7f7fe0069530 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f7ff40de340 tx=0x7f7fe8000f90 comp rx=0 tx=0).stop 2023-10-06T01:22:03.433 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:03.431+0000 7f80025ff700 1 -- 172.21.15.50:0/2984833442 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7ff403b070 msgr2=0x7f7ff4050220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:03.433 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:03.431+0000 7f80025ff700 1 --2- 172.21.15.50:0/2984833442 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7ff403b070 0x7f7ff4050220 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f7ff001e040 tx=0x7f7ff001b000 comp rx=0 tx=0).stop 2023-10-06T01:22:03.434 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:03.432+0000 7f80025ff700 1 -- 172.21.15.50:0/2984833442 shutdown_connections 2023-10-06T01:22:03.435 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:03.432+0000 7f80025ff700 1 --2- 172.21.15.50:0/2984833442 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f7fe0067080 0x7f7fe0069530 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:03.435 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:03.432+0000 7f80025ff700 1 --2- 172.21.15.50:0/2984833442 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7ff40e22f0 0x7f7ff40f2360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:03.435 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:03.432+0000 7f80025ff700 1 --2- 172.21.15.50:0/2984833442 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7ff403b070 0x7f7ff4050220 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:03.435 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:03.432+0000 7f80025ff700 1 --2- 172.21.15.50:0/2984833442 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7ff4055050 0x7f7ff4052bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:03.435 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:03.432+0000 7f80025ff700 1 -- 172.21.15.50:0/2984833442 >> 172.21.15.50:0/2984833442 conn(0x7f7ff400f2b0 msgr2=0x7f7ff40d88b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:22:03.435 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:03.432+0000 7f80025ff700 1 -- 172.21.15.50:0/2984833442 shutdown_connections 2023-10-06T01:22:03.435 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:03.432+0000 7f80025ff700 1 -- 172.21.15.50:0/2984833442 wait complete. 2023-10-06T01:22:03.435 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:03.433+0000 7fa0637fe700 1 -- 172.21.15.50:0/3373739373 <== mon.1 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fa070009220 con 0x7fa07c0b2850 2023-10-06T01:22:03.436 INFO:teuthology.orchestra.run.smithi050.stdout:55834574857 2023-10-06T01:22:03.440 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:03.438+0000 7fa080b9d700 1 -- 172.21.15.50:0/3373739373 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7fa068067080 msgr2=0x7fa068069530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:03.440 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:03.438+0000 7fa080b9d700 1 --2- 172.21.15.50:0/3373739373 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7fa068067080 0x7fa068069530 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fa07c0cce60 tx=0x7fa06c000f90 comp rx=0 tx=0).stop 2023-10-06T01:22:03.440 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:03.439+0000 7fa080b9d700 1 -- 172.21.15.50:0/3373739373 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa07c0b2850 msgr2=0x7fa07c1695e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:03.441 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:03.439+0000 7fa080b9d700 1 --2- 172.21.15.50:0/3373739373 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa07c0b2850 0x7fa07c1695e0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fa07000b5e0 tx=0x7fa070009120 comp rx=0 tx=0).stop 2023-10-06T01:22:03.442 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:03.439+0000 7fa080b9d700 1 -- 172.21.15.50:0/3373739373 shutdown_connections 2023-10-06T01:22:03.442 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:03.439+0000 7fa080b9d700 1 --2- 172.21.15.50:0/3373739373 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa07c159480 0x7fa07c15a010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:03.442 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:03.439+0000 7fa080b9d700 1 --2- 172.21.15.50:0/3373739373 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7fa068067080 0x7fa068069530 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:03.442 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:03.440+0000 7fa080b9d700 1 --2- 172.21.15.50:0/3373739373 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa07c0b2850 0x7fa07c1695e0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:03.442 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:03.440+0000 7fa080b9d700 1 --2- 172.21.15.50:0/3373739373 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa07c0cbc70 0x7fa07c159ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:03.442 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:03.440+0000 7fa080b9d700 1 -- 172.21.15.50:0/3373739373 >> 172.21.15.50:0/3373739373 conn(0x7fa07c06ed20 msgr2=0x7fa07c0cc730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:22:03.442 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:03.440+0000 7fa080b9d700 1 -- 172.21.15.50:0/3373739373 shutdown_connections 2023-10-06T01:22:03.443 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:03.440+0000 7fe94bfff700 1 -- 172.21.15.50:0/4217977287 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7fe96c05f270 con 0x7fe96c0cd370 2023-10-06T01:22:03.443 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:03.440+0000 7fa080b9d700 1 -- 172.21.15.50:0/3373739373 wait complete. 2023-10-06T01:22:03.443 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:03.441+0000 7f9b0219d700 1 -- 172.21.15.50:0/2430819561 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f9adc005560 con 0x7f9af4050060 2023-10-06T01:22:03.444 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:03.441+0000 7fe9627fc700 1 -- 172.21.15.50:0/4217977287 <== mon.1 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fe95401cdb0 con 0x7fe96c0cd370 2023-10-06T01:22:03.444 INFO:teuthology.orchestra.run.smithi050.stdout:55834574857 2023-10-06T01:22:03.444 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:03.442+0000 7f9af17fa700 1 -- 172.21.15.50:0/2430819561 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f9afc0caec0 con 0x7f9af4050060 2023-10-06T01:22:03.444 INFO:teuthology.orchestra.run.smithi050.stdout:55834574855 2023-10-06T01:22:03.448 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:03.445+0000 7fe96b59e700 1 -- 172.21.15.50:0/4217977287 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7fe94c067080 msgr2=0x7fe94c069530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:03.449 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:03.445+0000 7fe96b59e700 1 --2- 172.21.15.50:0/4217977287 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7fe94c067080 0x7fe94c069530 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fe964000c00 tx=0x7fe964009040 comp rx=0 tx=0).stop 2023-10-06T01:22:03.449 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:03.446+0000 7fe96b59e700 1 -- 172.21.15.50:0/4217977287 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe96c0cd370 msgr2=0x7fe96c152c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:03.449 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:03.446+0000 7fe96b59e700 1 --2- 172.21.15.50:0/4217977287 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe96c0cd370 0x7fe96c152c30 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fe95400b6c0 tx=0x7fe954018000 comp rx=0 tx=0).stop 2023-10-06T01:22:03.449 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:03.446+0000 7fe96b59e700 1 -- 172.21.15.50:0/4217977287 shutdown_connections 2023-10-06T01:22:03.449 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:03.446+0000 7fe96b59e700 1 --2- 172.21.15.50:0/4217977287 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe96c1594b0 0x7fe96c0c82d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:03.449 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:03.446+0000 7fe96b59e700 1 --2- 172.21.15.50:0/4217977287 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe96c0c6260 0x7fe96c1514e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:03.449 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:03.446+0000 7fe96b59e700 1 --2- 172.21.15.50:0/4217977287 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7fe94c067080 0x7fe94c069530 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:03.449 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:03.446+0000 7fe96b59e700 1 --2- 172.21.15.50:0/4217977287 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe96c0cd370 0x7fe96c152c30 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:03.449 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:03.446+0000 7fe96b59e700 1 -- 172.21.15.50:0/4217977287 >> 172.21.15.50:0/4217977287 conn(0x7fe96c099600 msgr2=0x7fe96c068390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:22:03.449 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:03.447+0000 7fe96b59e700 1 -- 172.21.15.50:0/4217977287 shutdown_connections 2023-10-06T01:22:03.450 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:03.447+0000 7fe96b59e700 1 -- 172.21.15.50:0/4217977287 wait complete. 2023-10-06T01:22:03.450 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:03.447+0000 7f9b0219d700 1 -- 172.21.15.50:0/2430819561 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f9ae0067000 msgr2=0x7f9ae00694b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:03.450 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:03.447+0000 7f31483ff700 1 -- 172.21.15.50:0/3523232773 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7f3128005560 con 0x7f3140069c70 2023-10-06T01:22:03.451 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:03.448+0000 7f9b0219d700 1 --2- 172.21.15.50:0/2430819561 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f9ae0067000 0x7f9ae00694b0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f9af8008fd0 tx=0x7f9af8015000 comp rx=0 tx=0).stop 2023-10-06T01:22:03.451 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:03.448+0000 7f9b0219d700 1 -- 172.21.15.50:0/2430819561 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9af4050060 msgr2=0x7f9af403d8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:03.451 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:03.448+0000 7f9b0219d700 1 --2- 172.21.15.50:0/2430819561 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9af4050060 0x7f9af403d8f0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f9afc0656e0 tx=0x7f9afc067390 comp rx=0 tx=0).stop 2023-10-06T01:22:03.452 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:03.448+0000 7f35d979d700 1 -- 172.21.15.50:0/3710370790 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7f35d406da40 con 0x7f35d40cc610 2023-10-06T01:22:03.452 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574855 for osd.3 2023-10-06T01:22:03.452 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:03.448+0000 7f31367fc700 1 -- 172.21.15.50:0/3523232773 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f313c0548f0 con 0x7f3140069c70 2023-10-06T01:22:03.453 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:03.448+0000 7f9b0219d700 1 -- 172.21.15.50:0/2430819561 shutdown_connections 2023-10-06T01:22:03.453 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:03.448+0000 7f9b0219d700 1 --2- 172.21.15.50:0/2430819561 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9af4050060 0x7f9af403d8f0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:03.453 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:03.448+0000 7f9b0219d700 1 --2- 172.21.15.50:0/2430819561 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9ae8003b30 0x7f9af40dc590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:03.453 INFO:teuthology.orchestra.run.smithi050.stdout:55834574855 2023-10-06T01:22:03.454 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:03.448+0000 7f9b0219d700 1 --2- 172.21.15.50:0/2430819561 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f9ae0067000 0x7f9ae00694b0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:03.454 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:03.449+0000 7f9b0219d700 1 --2- 172.21.15.50:0/2430819561 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9af40eed20 0x7f9af40e1d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:03.454 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:03.449+0000 7f9b0219d700 1 -- 172.21.15.50:0/2430819561 >> 172.21.15.50:0/2430819561 conn(0x7f9af4059b20 msgr2=0x7f9af4056b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:22:03.454 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:03.449+0000 7f9b0219d700 1 -- 172.21.15.50:0/2430819561 shutdown_connections 2023-10-06T01:22:03.454 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:03.449+0000 7f9b0219d700 1 -- 172.21.15.50:0/2430819561 wait complete. 2023-10-06T01:22:03.455 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:03.450+0000 7f35bbfff700 1 -- 172.21.15.50:0/3710370790 <== mon.2 v2:172.21.15.155:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f35c4015020 con 0x7f35d40cc610 2023-10-06T01:22:03.455 INFO:teuthology.orchestra.run.smithi050.stdout:55834574857 2023-10-06T01:22:03.455 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:03.453+0000 7f31483ff700 1 -- 172.21.15.50:0/3523232773 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f3124067080 msgr2=0x7f3124069530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:03.455 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:03.453+0000 7f31483ff700 1 --2- 172.21.15.50:0/3523232773 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f3124067080 0x7f3124069530 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f3130006fd0 tx=0x7f3130008040 comp rx=0 tx=0).stop 2023-10-06T01:22:03.455 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:03.453+0000 7f31483ff700 1 -- 172.21.15.50:0/3523232773 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3140069c70 msgr2=0x7f3140157da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:03.456 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:03.453+0000 7f31483ff700 1 --2- 172.21.15.50:0/3523232773 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3140069c70 0x7f3140157da0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f313c00b600 tx=0x7f313c0091a0 comp rx=0 tx=0).stop 2023-10-06T01:22:03.456 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:03.454+0000 7f35d979d700 1 -- 172.21.15.50:0/3710370790 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f35c0067000 msgr2=0x7f35c00694b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:03.456 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:03.454+0000 7f35d979d700 1 --2- 172.21.15.50:0/3710370790 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f35c0067000 0x7f35c00694b0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f35d40cab40 tx=0x7f35cc00b040 comp rx=0 tx=0).stop 2023-10-06T01:22:03.456 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:03.454+0000 7f35d979d700 1 -- 172.21.15.50:0/3710370790 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f35d40cc610 msgr2=0x7f35d4156310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:03.456 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:03.454+0000 7f35d979d700 1 --2- 172.21.15.50:0/3710370790 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f35d40cc610 0x7f35d4156310 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f35d406d5c0 tx=0x7f35c4017000 comp rx=0 tx=0).stop 2023-10-06T01:22:03.457 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:03.454+0000 7f31483ff700 1 -- 172.21.15.50:0/3523232773 shutdown_connections 2023-10-06T01:22:03.457 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:03.454+0000 7f31483ff700 1 --2- 172.21.15.50:0/3523232773 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f31400bf730 0x7f31400c8760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:03.457 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:03.454+0000 7f31483ff700 1 --2- 172.21.15.50:0/3523232773 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3140069c70 0x7f3140157da0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:03.457 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:03.454+0000 7f31483ff700 1 --2- 172.21.15.50:0/3523232773 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f3124067080 0x7f3124069530 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:03.457 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:03.454+0000 7f31483ff700 1 --2- 172.21.15.50:0/3523232773 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f31400bf360 0x7f314015ecd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:03.457 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:03.454+0000 7f31483ff700 1 -- 172.21.15.50:0/3523232773 >> 172.21.15.50:0/3523232773 conn(0x7f31400680c0 msgr2=0x7f31400ca2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:22:03.458 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:03.454+0000 7f35d979d700 1 -- 172.21.15.50:0/3710370790 shutdown_connections 2023-10-06T01:22:03.458 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:03.454+0000 7f35d979d700 1 --2- 172.21.15.50:0/3710370790 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f35c0067000 0x7f35c00694b0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:03.458 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:03.455+0000 7f35d979d700 1 --2- 172.21.15.50:0/3710370790 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f35d4159d20 0x7f35d414e080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:03.458 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:03.455+0000 7f35d979d700 1 --2- 172.21.15.50:0/3710370790 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f35d40cc610 0x7f35d4156310 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:03.458 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:03.455+0000 7f35d979d700 1 --2- 172.21.15.50:0/3710370790 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f35d41551e0 0x7f35d417a760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:03.458 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:03.455+0000 7f35d979d700 1 -- 172.21.15.50:0/3710370790 >> 172.21.15.50:0/3710370790 conn(0x7f35d40680c0 msgr2=0x7f35d40c2500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:22:03.459 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:03.455+0000 7f35d979d700 1 -- 172.21.15.50:0/3710370790 shutdown_connections 2023-10-06T01:22:03.459 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:03.455+0000 7f35d979d700 1 -- 172.21.15.50:0/3710370790 wait complete. 2023-10-06T01:22:03.459 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:03.455+0000 7f31483ff700 1 -- 172.21.15.50:0/3523232773 shutdown_connections 2023-10-06T01:22:03.459 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:03.455+0000 7f31483ff700 1 -- 172.21.15.50:0/3523232773 wait complete. 2023-10-06T01:22:03.469 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574856 for osd.0 2023-10-06T01:22:03.469 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574855 for osd.1 2023-10-06T01:22:03.478 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574858 got 55834574857 for osd.6 2023-10-06T01:22:03.479 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574855 for osd.2 2023-10-06T01:22:03.482 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574858 got 55834574857 for osd.7 2023-10-06T01:22:03.485 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574858 got 55834574857 for osd.5 2023-10-06T01:22:03.486 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574855 for osd.4 2023-10-06T01:22:04.032 DEBUG:teuthology.orchestra.run.smithi050:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T01:22:04.037 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T01:22:04.453 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-06T01:22:04.470 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-06T01:22:04.470 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-06T01:22:04.479 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2023-10-06T01:22:04.479 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-06T01:22:04.483 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2023-10-06T01:22:04.486 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2023-10-06T01:22:04.486 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2023-10-06T01:22:04.759 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:04.751+0000 7ff7cf5ff700 1 Processor -- start 2023-10-06T01:22:04.759 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:04.751+0000 7ff7cf5ff700 1 -- start start 2023-10-06T01:22:04.759 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:04.754+0000 7ff7cf5ff700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff7c80b4aa0 0x7ff7c80b21f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:04.759 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:04.754+0000 7ff7cf5ff700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7ff7c80cc820 0x7ff7c80b2730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:04.759 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:04.754+0000 7ff7cf5ff700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff7c80b3600 con 0x7ff7c80b1e20 2023-10-06T01:22:04.759 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:04.754+0000 7ff7cf5ff700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff7c80b2c70 con 0x7ff7c80cc820 2023-10-06T01:22:04.759 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:04.754+0000 7ff7cf5ff700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7c80b0e60 con 0x7ff7c80b4aa0 2023-10-06T01:22:04.759 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:04.755+0000 7ff7cdb9c700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7ff7c80cc820 0x7ff7c80b2730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:04.759 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:04.755+0000 7ff7cdb9c700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7ff7c80cc820 0x7ff7c80b2730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:48228/0 (socket says 172.21.15.50:48228) 2023-10-06T01:22:04.760 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:04.755+0000 7ff7cdb9c700 1 -- 172.21.15.50:0/825918379 learned_addr learned my addr 172.21.15.50:0/825918379 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-06T01:22:04.760 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:04.755+0000 7ff7cdb9c700 1 -- 172.21.15.50:0/825918379 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff7c80b4aa0 msgr2=0x7ff7c80b21f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-06T01:22:04.760 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:04.755+0000 7ff7cdb9c700 1 --2- 172.21.15.50:0/825918379 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff7c80b4aa0 0x7ff7c80b21f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:04.760 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:04.755+0000 7ff7cdb9c700 1 -- 172.21.15.50:0/825918379 >> v1:172.21.15.155:6789/0 conn(0x7ff7c80b1e20 legacy=0x7ff7c80b0750 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-06T01:22:04.760 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:04.755+0000 7ff7cdb9c700 1 -- 172.21.15.50:0/825918379 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7c80b1110 con 0x7ff7c80cc820 2023-10-06T01:22:04.760 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:04.756+0000 7ff7cdb9c700 1 --2- 172.21.15.50:0/825918379 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff7c80cc820 0x7ff7c80b2730 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7ff7c000b1f0 tx=0x7ff7c0009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5286e4a161fe166f server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:22:04.760 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:04.759+0000 7ff7bffff700 1 -- 172.21.15.50:0/825918379 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7c000e070 con 0x7ff7c80cc820 2023-10-06T01:22:04.761 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:04.759+0000 7ff7bffff700 1 -- 172.21.15.50:0/825918379 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7c000bcc0 con 0x7ff7c80cc820 2023-10-06T01:22:04.762 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:04.760+0000 7ff7cf5ff700 1 -- 172.21.15.50:0/825918379 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff7c80cc820 msgr2=0x7ff7c80b2730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:04.762 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:04.760+0000 7ff7cf5ff700 1 --2- 172.21.15.50:0/825918379 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff7c80cc820 0x7ff7c80b2730 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7ff7c000b1f0 tx=0x7ff7c0009840 comp rx=0 tx=0).stop 2023-10-06T01:22:04.762 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:04.761+0000 7ff7cf5ff700 1 -- 172.21.15.50:0/825918379 shutdown_connections 2023-10-06T01:22:04.762 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:04.761+0000 7ff7cf5ff700 1 --2- 172.21.15.50:0/825918379 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff7c80cc820 0x7ff7c80b2730 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:04.762 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:04.761+0000 7ff7cf5ff700 1 --2- 172.21.15.50:0/825918379 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff7c80b4aa0 0x7ff7c80b21f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:04.762 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:04.761+0000 7ff7cf5ff700 1 -- 172.21.15.50:0/825918379 >> 172.21.15.50:0/825918379 conn(0x7ff7c8099830 msgr2=0x7ff7c806f500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:22:04.767 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:04.762+0000 7ff7cf5ff700 1 -- 172.21.15.50:0/825918379 shutdown_connections 2023-10-06T01:22:04.767 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:04.762+0000 7ff7cf5ff700 1 -- 172.21.15.50:0/825918379 wait complete. 2023-10-06T01:22:04.767 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:04.764+0000 7ff7cf5ff700 1 Processor -- start 2023-10-06T01:22:04.767 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:04.764+0000 7ff7cf5ff700 1 -- start start 2023-10-06T01:22:04.767 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:04.766+0000 7ff7cf5ff700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff7c80b1e20 0x7ff7c8068400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:04.768 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:04.767+0000 7ff7cf5ff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff7c80b4aa0 0x7ff7c8068940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:04.769 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:04.768+0000 7ff7cd39b700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff7c80b1e20 0x7ff7c8068400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:04.769 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:04.768+0000 7ff7cd39b700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff7c80b1e20 0x7ff7c8068400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.50:54388/0 (socket says 172.21.15.50:54388) 2023-10-06T01:22:04.769 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:04.768+0000 7ff7ccb9a700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff7c80b4aa0 0x7ff7c8068940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:04.769 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:04.768+0000 7ff7ccb9a700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff7c80b4aa0 0x7ff7c8068940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:48244/0 (socket says 172.21.15.50:48244) 2023-10-06T01:22:04.770 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:04.768+0000 7ff7cd39b700 1 -- 172.21.15.50:0/390397228 learned_addr learned my addr 172.21.15.50:0/390397228 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-06T01:22:04.770 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:04.769+0000 7ff7cf5ff700 1 --2- 172.21.15.50:0/390397228 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff7c80acf30 0x7ff7c80ad360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:04.773 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:04.769+0000 7ff7cf5ff700 1 -- 172.21.15.50:0/390397228 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7c80abb10 con 0x7ff7c80b4aa0 2023-10-06T01:22:04.773 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:04.769+0000 7ff7cf5ff700 1 -- 172.21.15.50:0/390397228 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7c80ae820 con 0x7ff7c80b1e20 2023-10-06T01:22:04.773 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:04.769+0000 7ff7cf5ff700 1 -- 172.21.15.50:0/390397228 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7c8179250 con 0x7ff7c80acf30 2023-10-06T01:22:04.773 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:04.769+0000 7ff7cdb9c700 1 --2- 172.21.15.50:0/390397228 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff7c80acf30 0x7ff7c80ad360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:04.773 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:04.770+0000 7ff7ccb9a700 1 -- 172.21.15.50:0/390397228 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff7c80acf30 msgr2=0x7ff7c80ad360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:04.773 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:04.770+0000 7ff7ccb9a700 1 --2- 172.21.15.50:0/390397228 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff7c80acf30 0x7ff7c80ad360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:04.773 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:04.770+0000 7ff7ccb9a700 1 -- 172.21.15.50:0/390397228 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff7c80b1e20 msgr2=0x7ff7c8068400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:04.774 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:04.770+0000 7ff7ccb9a700 1 --2- 172.21.15.50:0/390397228 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff7c80b1e20 0x7ff7c8068400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:04.774 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:04.770+0000 7ff7ccb9a700 1 -- 172.21.15.50:0/390397228 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7c0009ae0 con 0x7ff7c80b4aa0 2023-10-06T01:22:04.774 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:04.771+0000 7ff7ccb9a700 1 --2- 172.21.15.50:0/390397228 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff7c80b4aa0 0x7ff7c8068940 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7ff7c400b7e0 tx=0x7ff7c4009060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:22:04.774 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:04.772+0000 7ff7bd7fa700 1 -- 172.21.15.50:0/390397228 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7c4010480 con 0x7ff7c80b4aa0 2023-10-06T01:22:04.774 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:04.772+0000 7ff7bd7fa700 1 -- 172.21.15.50:0/390397228 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7c40105e0 con 0x7ff7c80b4aa0 2023-10-06T01:22:04.774 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:04.772+0000 7ff7bd7fa700 1 -- 172.21.15.50:0/390397228 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7c40109a0 con 0x7ff7c80b4aa0 2023-10-06T01:22:04.774 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:04.773+0000 7ff7cf5ff700 1 -- 172.21.15.50:0/390397228 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff7c80adc10 con 0x7ff7c80b4aa0 2023-10-06T01:22:04.778 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:04.776+0000 7ff7cf5ff700 1 -- 172.21.15.50:0/390397228 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff7c80ae1d0 con 0x7ff7c80b4aa0 2023-10-06T01:22:04.779 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:04.779+0000 7ff7bd7fa700 1 -- 172.21.15.50:0/390397228 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7ff7c4010d50 con 0x7ff7c80b4aa0 2023-10-06T01:22:04.781 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:04.780+0000 7ff7bd7fa700 1 --2- 172.21.15.50:0/390397228 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7ff7b40671f0 0x7ff7b40696a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:04.782 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:04.781+0000 7ff7bd7fa700 1 -- 172.21.15.50:0/390397228 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6809+0+0 (secure 0 0 0) 0x7ff7c4083e10 con 0x7ff7c80b4aa0 2023-10-06T01:22:04.782 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:04.781+0000 7ff7cd39b700 1 --2- 172.21.15.50:0/390397228 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7ff7b40671f0 0x7ff7b40696a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:04.783 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:04.783+0000 7ff7cd39b700 1 --2- 172.21.15.50:0/390397228 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7ff7b40671f0 0x7ff7b40696a0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7ff7c815b9c0 tx=0x7ff7b80091a0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:22:04.784 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:04.783+0000 7ff7cf5ff700 1 -- 172.21.15.50:0/390397228 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff7a80052b0 con 0x7ff7c80b4aa0 2023-10-06T01:22:04.794 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:04.793+0000 7ff7bd7fa700 1 -- 172.21.15.50:0/390397228 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff7c4050ca0 con 0x7ff7c80b4aa0 2023-10-06T01:22:04.840 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:04.839+0000 7f9db3dff700 1 Processor -- start 2023-10-06T01:22:04.840 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:04.837+0000 7f28d15ff700 1 Processor -- start 2023-10-06T01:22:04.840 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:04.837+0000 7f28d15ff700 1 -- start start 2023-10-06T01:22:04.840 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:04.839+0000 7f28d15ff700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f28c4039050 0x7f28c40f1520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:04.841 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:04.840+0000 7f28ca7fc700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f28c40eae70 0x7f28c4038940 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:40288/0 (socket says 172.21.15.50:40288) 2023-10-06T01:22:04.841 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:04.840+0000 7f28cb7fe700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f28c4039050 0x7f28c40f1520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:04.841 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:04.840+0000 7f28cb7fe700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f28c4039050 0x7f28c40f1520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:48254/0 (socket says 172.21.15.50:48254) 2023-10-06T01:22:04.841 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:04.840+0000 7f28caffd700 1 --1- >> v1:172.21.15.155:6789/0 conn(0x7f28c40e6340 0x7f28c403a8b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.155:6789/0 says I am v1:172.21.15.50:57032/0 (socket says 172.21.15.50:57032) 2023-10-06T01:22:04.842 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:04.840+0000 7f28d15ff700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f28c40061b0 con 0x7f28c40eae70 2023-10-06T01:22:04.842 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:04.840+0000 7f61e899d700 1 Processor -- start 2023-10-06T01:22:04.842 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:04.840+0000 7f28d15ff700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f28c4006490 con 0x7f28c40e6340 2023-10-06T01:22:04.842 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:04.840+0000 7f28d15ff700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f28c403b2c0 con 0x7f28c4039050 2023-10-06T01:22:04.843 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:04.840+0000 7f9db3dff700 1 -- start start 2023-10-06T01:22:04.843 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:04.841+0000 7f28ca7fc700 1 -- 172.21.15.50:0/3141762361 learned_addr learned my addr 172.21.15.50:0/3141762361 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-10-06T01:22:04.843 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:04.841+0000 7f61e899d700 1 -- start start 2023-10-06T01:22:04.843 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:04.842+0000 7f9db3dff700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f9dac0bf360 0x7f9dac0c8490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:04.844 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:04.842+0000 7f9db3dff700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f9dac0bf730 0x7f9dac069560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:04.844 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:04.842+0000 7f9db3dff700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9dac069aa0 0x7f9dac0c66c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:04.844 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:04.842+0000 7f9db3dff700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9dac15e1d0 con 0x7f9dac0bf360 2023-10-06T01:22:04.844 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:04.842+0000 7f9db3dff700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9dac069f20 con 0x7f9dac0bf730 2023-10-06T01:22:04.844 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:04.842+0000 7f9db3dff700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9dac0c8000 con 0x7f9dac069aa0 2023-10-06T01:22:04.844 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:04.843+0000 7f28cb7fe700 1 -- 172.21.15.50:0/3141762361 >> v1:172.21.15.155:6789/0 conn(0x7f28c40e6340 legacy=0x7f28c403a8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:22:04.845 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:04.843+0000 7f28cb7fe700 1 -- 172.21.15.50:0/3141762361 >> v1:172.21.15.50:6789/0 conn(0x7f28c40eae70 legacy=0x7f28c4038940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:04.845 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:04.843+0000 7f28cb7fe700 1 -- 172.21.15.50:0/3141762361 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28c403b5a0 con 0x7f28c4039050 2023-10-06T01:22:04.845 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:04.843+0000 7f9db139a700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f9dac0bf730 0x7f9dac069560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:04.845 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:04.843+0000 7f9db139a700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f9dac0bf730 0x7f9dac069560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.50:54394/0 (socket says 172.21.15.50:54394) 2023-10-06T01:22:04.845 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:04.843+0000 7f9db139a700 1 -- 172.21.15.50:0/2014302651 learned_addr learned my addr 172.21.15.50:0/2014302651 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-06T01:22:04.845 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:04.843+0000 7f9db239c700 1 --2- 172.21.15.50:0/2014302651 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9dac069aa0 0x7f9dac0c66c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:04.845 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:04.844+0000 7f9db1b9b700 1 --2- 172.21.15.50:0/2014302651 >> v2:172.21.15.50:3300/0 conn(0x7f9dac0bf360 0x7f9dac0c8490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:04.846 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:04.844+0000 7f61e899d700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f61e4159480 0x7f61e40b30d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:04.846 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:04.844+0000 7f61e899d700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f61e40b3610 0x7f61e40cbc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:04.846 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:04.845+0000 7f61e899d700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f61e40cb7e0 con 0x7f61e40cc1b0 2023-10-06T01:22:04.846 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:04.845+0000 7f61e899d700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f61e40b08a0 con 0x7f61e4159480 2023-10-06T01:22:04.846 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:04.845+0000 7f61e899d700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61e40cb190 con 0x7f61e40b3610 2023-10-06T01:22:04.847 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:04.846+0000 7f28cb7fe700 1 --2- 172.21.15.50:0/3141762361 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f28c4039050 0x7f28c40f1520 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f28cc0674f0 tx=0x7f28cc067390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7b22f271fa2c3181 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:22:04.848 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:04.846+0000 7f9db1b9b700 1 -- 172.21.15.50:0/2014302651 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9dac069aa0 msgr2=0x7f9dac0c66c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:22:04.848 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:04.846+0000 7f9db1b9b700 1 --2- 172.21.15.50:0/2014302651 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9dac069aa0 0x7f9dac0c66c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:04.848 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:04.846+0000 7f9db1b9b700 1 -- 172.21.15.50:0/2014302651 >> v2:172.21.15.155:3300/0 conn(0x7f9dac0bf730 msgr2=0x7f9dac069560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:22:04.848 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:04.846+0000 7f9db1b9b700 1 --2- 172.21.15.50:0/2014302651 >> v2:172.21.15.155:3300/0 conn(0x7f9dac0bf730 0x7f9dac069560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:04.848 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:04.846+0000 7f9db1b9b700 1 -- 172.21.15.50:0/2014302651 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9dac0c73f0 con 0x7f9dac0bf360 2023-10-06T01:22:04.849 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:04.847+0000 7f61e37fe700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f61e4159480 0x7f61e40b30d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:04.849 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:04.847+0000 7f61e3fff700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f61e40cc1b0 0x7f61e40b2140 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:40300/0 (socket says 172.21.15.50:40300) 2023-10-06T01:22:04.849 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:04.847+0000 7f61e3fff700 1 -- 172.21.15.50:0/1888535749 learned_addr learned my addr 172.21.15.50:0/1888535749 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-10-06T01:22:04.849 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:04.848+0000 7f9db1b9b700 1 --2- 172.21.15.50:0/2014302651 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9dac0bf360 0x7f9dac0c8490 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f9dac0cc950 tx=0x7f9da80091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f7ebb80b4954e644 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:22:04.849 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:04.848+0000 7f3f0a1ff700 1 Processor -- start 2023-10-06T01:22:04.850 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:04.849+0000 7f28c9ffb700 1 -- 172.21.15.50:0/3141762361 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28cc0704d0 con 0x7f28c4039050 2023-10-06T01:22:04.850 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:04.849+0000 7f28c9ffb700 1 -- 172.21.15.50:0/3141762361 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f28cc0658d0 con 0x7f28c4039050 2023-10-06T01:22:04.851 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:04.849+0000 7f28c9ffb700 1 -- 172.21.15.50:0/3141762361 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28cc04c0e0 con 0x7f28c4039050 2023-10-06T01:22:04.851 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:04.849+0000 7f61e2ffd700 1 --2- 172.21.15.50:0/1888535749 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f61e40b3610 0x7f61e40cbc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:04.851 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:04.849+0000 7f61e37fe700 1 -- 172.21.15.50:0/1888535749 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f61e40b3610 msgr2=0x7f61e40cbc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:22:04.851 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:04.849+0000 7f61e37fe700 1 --2- 172.21.15.50:0/1888535749 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f61e40b3610 0x7f61e40cbc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:04.851 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:04.849+0000 7f61e37fe700 1 -- 172.21.15.50:0/1888535749 >> v1:172.21.15.50:6789/0 conn(0x7f61e40cc1b0 legacy=0x7f61e40b2140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:04.852 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:04.850+0000 7f28d15ff700 1 -- 172.21.15.50:0/3141762361 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f28c4039050 msgr2=0x7f28c40f1520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:04.852 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:04.850+0000 7f28d15ff700 1 --2- 172.21.15.50:0/3141762361 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f28c4039050 0x7f28c40f1520 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f28cc0674f0 tx=0x7f28cc067390 comp rx=0 tx=0).stop 2023-10-06T01:22:04.852 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:04.850+0000 7f61e37fe700 1 -- 172.21.15.50:0/1888535749 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61e40cb470 con 0x7f61e4159480 2023-10-06T01:22:04.853 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:04.848+0000 7f3f0a1ff700 1 -- start start 2023-10-06T01:22:04.853 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:04.850+0000 7f3f0a1ff700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f3f04155860 0x7f3f040ae4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:04.853 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:04.850+0000 7f3f0a1ff700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3f04069c70 0x7f3f040abcd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:04.853 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:04.850+0000 7f3f0a1ff700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3f040c7e10 con 0x7f3f040c82a0 2023-10-06T01:22:04.853 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:04.850+0000 7f3f0a1ff700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3f040aea00 con 0x7f3f04155860 2023-10-06T01:22:04.853 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:04.850+0000 7f3f0a1ff700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f040c7200 con 0x7f3f04069c70 2023-10-06T01:22:04.853 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:04.851+0000 7f3f037fe700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f3f04155860 0x7f3f040ae4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:04.853 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:04.851+0000 7f3f03fff700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3f04069c70 0x7f3f040abcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:04.854 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:04.851+0000 7f61e37fe700 1 --2- 172.21.15.50:0/1888535749 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f61e4159480 0x7f61e40b30d0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f61dc009e60 tx=0x7f61dc009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d4967b25f4877589 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:22:04.854 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:04.851+0000 7f3f03fff700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3f04069c70 0x7f3f040abcd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3301/0 says I am v2:172.21.15.50:49854/0 (socket says 172.21.15.50:49854) 2023-10-06T01:22:04.854 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:04.851+0000 7f3f03fff700 1 -- 172.21.15.50:0/1203368168 learned_addr learned my addr 172.21.15.50:0/1203368168 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-06T01:22:04.854 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:04.851+0000 7f3f037fe700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f3f04155860 0x7f3f040ae4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:48274/0 (socket says 172.21.15.50:48274) 2023-10-06T01:22:04.855 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:04.851+0000 7f28d15ff700 1 -- 172.21.15.50:0/3141762361 shutdown_connections 2023-10-06T01:22:04.855 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:04.851+0000 7f28d15ff700 1 --2- 172.21.15.50:0/3141762361 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f28c4039050 0x7f28c40f1520 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:04.855 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:04.851+0000 7f28d15ff700 1 -- 172.21.15.50:0/3141762361 >> 172.21.15.50:0/3141762361 conn(0x7f28c400f0b0 msgr2=0x7f28c4059070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:22:04.855 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:04.852+0000 7f28d15ff700 1 -- 172.21.15.50:0/3141762361 shutdown_connections 2023-10-06T01:22:04.855 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:04.852+0000 7f28d15ff700 1 -- 172.21.15.50:0/3141762361 wait complete. 2023-10-06T01:22:04.855 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:04.852+0000 7f61e27fc700 1 -- 172.21.15.50:0/1888535749 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61dc00bb60 con 0x7f61e4159480 2023-10-06T01:22:04.855 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:04.852+0000 7f61e27fc700 1 -- 172.21.15.50:0/1888535749 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61dc00bcc0 con 0x7f61e4159480 2023-10-06T01:22:04.855 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:04.852+0000 7f61e27fc700 1 -- 172.21.15.50:0/1888535749 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61dc014b20 con 0x7f61e4159480 2023-10-06T01:22:04.856 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:04.851+0000 7f9db0b99700 1 -- 172.21.15.50:0/2014302651 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9da8011630 con 0x7f9dac0bf360 2023-10-06T01:22:04.856 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:04.851+0000 7f9db0b99700 1 -- 172.21.15.50:0/2014302651 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9da8011790 con 0x7f9dac0bf360 2023-10-06T01:22:04.856 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:04.852+0000 7f9db3dff700 1 -- 172.21.15.50:0/2014302651 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9dac0bf360 msgr2=0x7f9dac0c8490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:04.856 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:04.852+0000 7f9db3dff700 1 --2- 172.21.15.50:0/2014302651 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9dac0bf360 0x7f9dac0c8490 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f9dac0cc950 tx=0x7f9da80091a0 comp rx=0 tx=0).stop 2023-10-06T01:22:04.856 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:04.853+0000 7f3f03fff700 1 -- 172.21.15.50:0/1203368168 >> v2:172.21.15.50:3300/0 conn(0x7f3f04155860 msgr2=0x7f3f040ae4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:22:04.856 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:04.853+0000 7f3f03fff700 1 --2- 172.21.15.50:0/1203368168 >> v2:172.21.15.50:3300/0 conn(0x7f3f04155860 0x7f3f040ae4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:04.856 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:04.853+0000 7f3f03fff700 1 -- 172.21.15.50:0/1203368168 >> v1:172.21.15.155:6789/0 conn(0x7f3f040c82a0 legacy=0x7f3f04069560 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-10-06T01:22:04.856 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:04.853+0000 7f3f03fff700 1 -- 172.21.15.50:0/1203368168 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f040c74e0 con 0x7f3f04069c70 2023-10-06T01:22:04.857 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:04.853+0000 7f9db3dff700 1 -- 172.21.15.50:0/2014302651 shutdown_connections 2023-10-06T01:22:04.857 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:04.853+0000 7f9db3dff700 1 --2- 172.21.15.50:0/2014302651 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9dac069aa0 0x7f9dac0c66c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:04.857 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:04.853+0000 7f9db3dff700 1 --2- 172.21.15.50:0/2014302651 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9dac0bf360 0x7f9dac0c8490 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:04.857 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:04.854+0000 7f9db3dff700 1 --2- 172.21.15.50:0/2014302651 >> v2:172.21.15.155:3300/0 conn(0x7f9dac0bf730 0x7f9dac069560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:04.857 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:04.854+0000 7f9db3dff700 1 -- 172.21.15.50:0/2014302651 >> 172.21.15.50:0/2014302651 conn(0x7f9dac0680c0 msgr2=0x7f9dac0cc120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:22:04.858 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:04.854+0000 7f61e899d700 1 -- 172.21.15.50:0/1888535749 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f61e4159480 msgr2=0x7f61e40b30d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:04.858 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:04.854+0000 7f61e899d700 1 --2- 172.21.15.50:0/1888535749 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f61e4159480 0x7f61e40b30d0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f61dc009e60 tx=0x7f61dc009780 comp rx=0 tx=0).stop 2023-10-06T01:22:04.858 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:04.854+0000 7f3f03fff700 1 --2- 172.21.15.50:0/1203368168 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3f04069c70 0x7f3f040abcd0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f3ef8008990 tx=0x7f3ef80082d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3ebfe0e0538aa60f server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:22:04.858 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:04.854+0000 7f61e899d700 1 -- 172.21.15.50:0/1888535749 shutdown_connections 2023-10-06T01:22:04.859 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:04.854+0000 7f61e899d700 1 --2- 172.21.15.50:0/1888535749 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f61e4159480 0x7f61e40b30d0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:04.859 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:04.854+0000 7f61e899d700 1 --2- 172.21.15.50:0/1888535749 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f61e40b3610 0x7f61e40cbc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:04.859 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:04.854+0000 7f61e899d700 1 -- 172.21.15.50:0/1888535749 >> 172.21.15.50:0/1888535749 conn(0x7f61e406ed20 msgr2=0x7f61e406f120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:22:04.859 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:04.854+0000 7f9db3dff700 1 -- 172.21.15.50:0/2014302651 shutdown_connections 2023-10-06T01:22:04.859 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:04.855+0000 7f9db3dff700 1 -- 172.21.15.50:0/2014302651 wait complete. 2023-10-06T01:22:04.859 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:04.855+0000 7f28d15ff700 1 Processor -- start 2023-10-06T01:22:04.861 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:04.855+0000 7f61e899d700 1 -- 172.21.15.50:0/1888535749 shutdown_connections 2023-10-06T01:22:04.861 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:04.855+0000 7f61e899d700 1 -- 172.21.15.50:0/1888535749 wait complete. 2023-10-06T01:22:04.862 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:04.855+0000 7f28d15ff700 1 -- start start 2023-10-06T01:22:04.862 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:04.857+0000 7f28d15ff700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f28c4039050 0x7f28c400d250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:04.862 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:04.857+0000 7f28d15ff700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f28c40e6340 0x7f28c40f7ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:04.862 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:04.857+0000 7f61e899d700 1 Processor -- start 2023-10-06T01:22:04.863 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:04.857+0000 7f28d15ff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f28c40eae70 0x7f28c404ca40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:04.863 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:04.858+0000 7f28d15ff700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28c40e4c50 con 0x7f28c40eae70 2023-10-06T01:22:04.863 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:04.858+0000 7f28ca7fc700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f28c40e6340 0x7f28c40f7ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:04.863 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:04.858+0000 7f28d15ff700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28c404f990 con 0x7f28c4039050 2023-10-06T01:22:04.863 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:04.858+0000 7f28d15ff700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28c40e7f10 con 0x7f28c40e6340 2023-10-06T01:22:04.863 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:04.858+0000 7f28caffd700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f28c4039050 0x7f28c400d250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:04.863 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:04.858+0000 7f28ca7fc700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f28c40e6340 0x7f28c40f7ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3301/0 says I am v2:172.21.15.50:49862/0 (socket says 172.21.15.50:49862) 2023-10-06T01:22:04.863 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:04.858+0000 7f28ca7fc700 1 -- 172.21.15.50:0/3290852588 learned_addr learned my addr 172.21.15.50:0/3290852588 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-06T01:22:04.864 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:04.859+0000 7f61e899d700 1 -- start start 2023-10-06T01:22:04.864 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:04.858+0000 7f9db3dff700 1 Processor -- start 2023-10-06T01:22:04.864 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:04.858+0000 7f9db3dff700 1 -- start start 2023-10-06T01:22:04.864 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:04.860+0000 7f61e899d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f61e40b3610 0x7f61e40c7310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:04.865 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:04.855+0000 7f3f027fc700 1 -- 172.21.15.50:0/1203368168 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ef8010070 con 0x7f3f04069c70 2023-10-06T01:22:04.865 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:04.855+0000 7f3f027fc700 1 -- 172.21.15.50:0/1203368168 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ef8005a50 con 0x7f3f04069c70 2023-10-06T01:22:04.865 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:04.855+0000 7f3f027fc700 1 -- 172.21.15.50:0/1203368168 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ef8005df0 con 0x7f3f04069c70 2023-10-06T01:22:04.865 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:04.856+0000 7f3f0a1ff700 1 -- 172.21.15.50:0/1203368168 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3f04069c70 msgr2=0x7f3f040abcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:04.865 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:04.856+0000 7f3f0a1ff700 1 --2- 172.21.15.50:0/1203368168 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3f04069c70 0x7f3f040abcd0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f3ef8008990 tx=0x7f3ef80082d0 comp rx=0 tx=0).stop 2023-10-06T01:22:04.866 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:04.856+0000 7f3f0a1ff700 1 -- 172.21.15.50:0/1203368168 shutdown_connections 2023-10-06T01:22:04.866 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:04.856+0000 7f3f0a1ff700 1 --2- 172.21.15.50:0/1203368168 >> v2:172.21.15.50:3300/0 conn(0x7f3f04155860 0x7f3f040ae4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:04.866 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:04.856+0000 7f3f0a1ff700 1 --2- 172.21.15.50:0/1203368168 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3f04069c70 0x7f3f040abcd0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:04.866 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:04.856+0000 7f3f0a1ff700 1 -- 172.21.15.50:0/1203368168 >> 172.21.15.50:0/1203368168 conn(0x7f3f040680c0 msgr2=0x7f3f040cc120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:22:04.866 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:04.857+0000 7f3f0a1ff700 1 -- 172.21.15.50:0/1203368168 shutdown_connections 2023-10-06T01:22:04.866 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:04.857+0000 7f3f0a1ff700 1 -- 172.21.15.50:0/1203368168 wait complete. 2023-10-06T01:22:04.866 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:04.859+0000 7f3f0a1ff700 1 Processor -- start 2023-10-06T01:22:04.866 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:04.860+0000 7f3f0a1ff700 1 -- start start 2023-10-06T01:22:04.867 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:04.859+0000 7f28caffd700 1 -- 172.21.15.50:0/3290852588 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f28c40e6340 msgr2=0x7f28c40f7ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:04.867 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:04.859+0000 7f28caffd700 1 --2- 172.21.15.50:0/3290852588 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f28c40e6340 0x7f28c40f7ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:04.867 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:04.859+0000 7f28caffd700 1 -- 172.21.15.50:0/3290852588 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f28c40eae70 msgr2=0x7f28c404ca40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:04.867 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:04.859+0000 7f28caffd700 1 --2- 172.21.15.50:0/3290852588 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f28c40eae70 0x7f28c404ca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:04.867 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:04.859+0000 7f28caffd700 1 -- 172.21.15.50:0/3290852588 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28cc04c9a0 con 0x7f28c4039050 2023-10-06T01:22:04.867 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:04.861+0000 7f28caffd700 1 --2- 172.21.15.50:0/3290852588 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f28c4039050 0x7f28c400d250 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f28bc00c530 tx=0x7f28bc007ed0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:22:04.867 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:04.860+0000 7f9db3dff700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9dac069aa0 0x7f9dac1578a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:04.868 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:04.860+0000 7f9db3dff700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9dac0bf730 0x7f9dac0c2150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:04.868 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:04.860+0000 7f9db3dff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9dac0c2690 0x7f9dac15c810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:04.868 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:04.860+0000 7f9db3dff700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9dac16e1e0 con 0x7f9dac0c2690 2023-10-06T01:22:04.868 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:04.860+0000 7f9db3dff700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9dac15f120 con 0x7f9dac069aa0 2023-10-06T01:22:04.868 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:04.860+0000 7f9db3dff700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9dac15f400 con 0x7f9dac0bf730 2023-10-06T01:22:04.868 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:04.861+0000 7f61e899d700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f61e40cc1b0 0x7f61e414fc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:04.868 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:04.861+0000 7f61e899d700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f61e4159480 0x7f61e4168c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:04.869 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:04.861+0000 7f3f0a1ff700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3f04069c70 0x7f3f0414bcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:04.869 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:04.861+0000 7f61e899d700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61e40c4010 con 0x7f61e40b3610 2023-10-06T01:22:04.869 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:04.861+0000 7f61e899d700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61e40ca2e0 con 0x7f61e4159480 2023-10-06T01:22:04.869 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:04.861+0000 7f61e899d700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61e40cf2d0 con 0x7f61e40cc1b0 2023-10-06T01:22:04.869 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:04.861+0000 7f28b2ffd700 1 -- 172.21.15.50:0/3290852588 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28bc005a70 con 0x7f28c4039050 2023-10-06T01:22:04.870 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:04.862+0000 7f61e37fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f61e40b3610 0x7f61e40c7310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:04.870 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:04.861+0000 7f3f0a1ff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3f040c82a0 0x7f3f040c2640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:04.870 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:04.862+0000 7f3f0a1ff700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3f04155860 0x7f3f0414c360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:04.870 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:04.862+0000 7f3f037fe700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3f04069c70 0x7f3f0414bcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:04.870 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:04.862+0000 7f3f0a1ff700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f040c0d40 con 0x7f3f040c82a0 2023-10-06T01:22:04.870 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:04.862+0000 7f3f0a1ff700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f040c2b80 con 0x7f3f04155860 2023-10-06T01:22:04.871 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:04.862+0000 7f3f0a1ff700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f040c3890 con 0x7f3f04069c70 2023-10-06T01:22:04.871 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:04.862+0000 7f3f03fff700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3f04155860 0x7f3f0414c360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:04.871 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:04.862+0000 7f3f03fff700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3f04155860 0x7f3f0414c360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.50:54406/0 (socket says 172.21.15.50:54406) 2023-10-06T01:22:04.871 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:04.862+0000 7f28d15ff700 1 -- 172.21.15.50:0/3290852588 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f28c40e81f0 con 0x7f28c4039050 2023-10-06T01:22:04.871 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:04.862+0000 7f28b2ffd700 1 -- 172.21.15.50:0/3290852588 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f28bc005bf0 con 0x7f28c4039050 2023-10-06T01:22:04.871 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:04.863+0000 7f28d15ff700 1 -- 172.21.15.50:0/3290852588 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f28c40e87b0 con 0x7f28c4039050 2023-10-06T01:22:04.871 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:04.863+0000 7f28b2ffd700 1 -- 172.21.15.50:0/3290852588 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28bc0070d0 con 0x7f28c4039050 2023-10-06T01:22:04.872 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:04.863+0000 7f9db239c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9dac0c2690 0x7f9dac15c810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:04.872 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:04.863+0000 7f9db239c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9dac0c2690 0x7f9dac15c810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:48302/0 (socket says 172.21.15.50:48302) 2023-10-06T01:22:04.872 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:04.863+0000 7f9db239c700 1 -- 172.21.15.50:0/109760795 learned_addr learned my addr 172.21.15.50:0/109760795 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-06T01:22:04.872 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:04.863+0000 7f9db139a700 1 --2- 172.21.15.50:0/109760795 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9dac0bf730 0x7f9dac0c2150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:04.872 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:04.863+0000 7f9db1b9b700 1 --2- 172.21.15.50:0/109760795 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9dac069aa0 0x7f9dac1578a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:04.872 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:04.863+0000 7f500a1ff700 1 Processor -- start 2023-10-06T01:22:04.872 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:04.863+0000 7f72b85ff700 1 Processor -- start 2023-10-06T01:22:04.872 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:04.863+0000 7f72b85ff700 1 -- start start 2023-10-06T01:22:04.873 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:04.862+0000 7f61e3fff700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f61e4159480 0x7f61e4168c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:04.873 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:04.863+0000 7f61e3fff700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f61e4159480 0x7f61e4168c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.50:54416/0 (socket says 172.21.15.50:54416) 2023-10-06T01:22:04.873 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:04.863+0000 7f61e3fff700 1 -- 172.21.15.50:0/3936697089 learned_addr learned my addr 172.21.15.50:0/3936697089 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-06T01:22:04.873 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:04.863+0000 7f61e2ffd700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f61e40cc1b0 0x7f61e414fc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:04.873 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:04.863+0000 7f61e3fff700 1 -- 172.21.15.50:0/3936697089 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f61e40cc1b0 msgr2=0x7f61e414fc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:04.873 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:04.863+0000 7f61e3fff700 1 --2- 172.21.15.50:0/3936697089 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f61e40cc1b0 0x7f61e414fc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:04.873 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:04.863+0000 7f61e3fff700 1 -- 172.21.15.50:0/3936697089 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f61e40b3610 msgr2=0x7f61e40c7310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:04.873 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:04.863+0000 7f61e3fff700 1 --2- 172.21.15.50:0/3936697089 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f61e40b3610 0x7f61e40c7310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:04.873 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:04.863+0000 7f61e3fff700 1 -- 172.21.15.50:0/3936697089 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61dc009a20 con 0x7f61e4159480 2023-10-06T01:22:04.874 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:04.863+0000 7f3f037fe700 1 -- 172.21.15.50:0/73166728 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3f04155860 msgr2=0x7f3f0414c360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:04.874 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:04.863+0000 7f3f037fe700 1 --2- 172.21.15.50:0/73166728 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3f04155860 0x7f3f0414c360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:04.874 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:04.863+0000 7f3f037fe700 1 -- 172.21.15.50:0/73166728 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3f040c82a0 msgr2=0x7f3f040c2640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:04.874 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:04.863+0000 7f3f037fe700 1 --2- 172.21.15.50:0/73166728 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3f040c82a0 0x7f3f040c2640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:04.874 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:04.863+0000 7f3f037fe700 1 -- 172.21.15.50:0/73166728 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ef8008550 con 0x7f3f04069c70 2023-10-06T01:22:04.874 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:04.862+0000 7f3f03fff700 1 -- 172.21.15.50:0/73166728 learned_addr learned my addr 172.21.15.50:0/73166728 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-06T01:22:04.874 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:04.864+0000 7f3f037fe700 1 --2- 172.21.15.50:0/73166728 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3f04069c70 0x7f3f0414bcd0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f3ef400e880 tx=0x7f3ef40091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:22:04.874 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:04.864+0000 7f3f03fff700 1 --2- 172.21.15.50:0/73166728 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3f04155860 0x7f3f0414c360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello state changed while learned_addr, mark_down or replacing must be happened just now 2023-10-06T01:22:04.875 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:04.864+0000 7f9db239c700 1 -- 172.21.15.50:0/109760795 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9dac0bf730 msgr2=0x7f9dac0c2150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:04.875 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:04.864+0000 7f9db239c700 1 --2- 172.21.15.50:0/109760795 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9dac0bf730 0x7f9dac0c2150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:04.875 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:04.864+0000 7f9db239c700 1 -- 172.21.15.50:0/109760795 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9dac069aa0 msgr2=0x7f9dac1578a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:04.875 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:04.864+0000 7f9db239c700 1 --2- 172.21.15.50:0/109760795 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9dac069aa0 0x7f9dac1578a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:04.875 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:04.864+0000 7f9db239c700 1 -- 172.21.15.50:0/109760795 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9da8009420 con 0x7f9dac0c2690 2023-10-06T01:22:04.876 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:04.863+0000 7f500a1ff700 1 -- start start 2023-10-06T01:22:04.876 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:04.865+0000 7f3eeb7fe700 1 -- 172.21.15.50:0/73166728 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ef40133f0 con 0x7f3f04069c70 2023-10-06T01:22:04.876 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:04.865+0000 7f3eeb7fe700 1 -- 172.21.15.50:0/73166728 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ef4013990 con 0x7f3f04069c70 2023-10-06T01:22:04.876 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:04.865+0000 7f3eeb7fe700 1 -- 172.21.15.50:0/73166728 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ef4013d50 con 0x7f3f04069c70 2023-10-06T01:22:04.877 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:04.865+0000 7f61e3fff700 1 --2- 172.21.15.50:0/3936697089 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f61e4159480 0x7f61e4168c20 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f61d400c7f0 tx=0x7f61d4007eb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:22:04.877 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:04.866+0000 7f3f0a1ff700 1 -- 172.21.15.50:0/73166728 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3f040c32d0 con 0x7f3f04069c70 2023-10-06T01:22:04.877 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:04.866+0000 7f3f0a1ff700 1 -- 172.21.15.50:0/73166728 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3f040c0f30 con 0x7f3f04069c70 2023-10-06T01:22:04.877 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:04.866+0000 7f72b85ff700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f72b0069890 0x7f72b00c8560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:04.878 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:04.866+0000 7f72b85ff700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f72b00c7d60 0x7f72b00c72a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:04.878 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:04.866+0000 7f9db239c700 1 --2- 172.21.15.50:0/109760795 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9dac0c2690 0x7f9dac15c810 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f9da4009fa0 tx=0x7f9da4009900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:22:04.878 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:04.866+0000 7f500a1ff700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f50040ccb10 0x7f50040ca5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:04.878 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:04.866+0000 7f500a1ff700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f50041559d0 0x7f50040cab30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:04.878 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:04.866+0000 7f500a1ff700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f50040c6850 con 0x7f500406d7f0 2023-10-06T01:22:04.878 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:04.866+0000 7f500a1ff700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f50040c70f0 con 0x7f50040ccb10 2023-10-06T01:22:04.879 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:04.866+0000 7f500a1ff700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50040cb390 con 0x7f50041559d0 2023-10-06T01:22:04.879 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:04.866+0000 7f28d15ff700 1 -- 172.21.15.50:0/3290852588 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f28c40e89c0 con 0x7f28c4039050 2023-10-06T01:22:04.879 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:04.867+0000 7f28b2ffd700 1 -- 172.21.15.50:0/3290852588 <== mon.1 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f28bc007480 con 0x7f28c4039050 2023-10-06T01:22:04.879 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:04.866+0000 7f50037fe700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f500406d7f0 0x7f50041552c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:40316/0 (socket says 172.21.15.50:40316) 2023-10-06T01:22:04.879 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:04.866+0000 7f50037fe700 1 -- 172.21.15.50:0/3607318921 learned_addr learned my addr 172.21.15.50:0/3607318921 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-10-06T01:22:04.880 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:04.867+0000 7f72b85ff700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f72b00c8aa0 con 0x7f72b00c77e0 2023-10-06T01:22:04.880 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:04.867+0000 7f61cb7fe700 1 -- 172.21.15.50:0/3936697089 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61d4005b30 con 0x7f61e4159480 2023-10-06T01:22:04.880 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:04.867+0000 7f72b5b9a700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f72b00c7d60 0x7f72b00c72a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:04.880 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:04.867+0000 7f72b5b9a700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f72b00c7d60 0x7f72b00c72a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3301/0 says I am v2:172.21.15.50:49906/0 (socket says 172.21.15.50:49906) 2023-10-06T01:22:04.880 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:04.867+0000 7f72b739d700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f72b00c77e0 0x7f72b00aef90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:40322/0 (socket says 172.21.15.50:40322) 2023-10-06T01:22:04.880 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:04.867+0000 7f72b739d700 1 -- 172.21.15.50:0/1571734457 learned_addr learned my addr 172.21.15.50:0/1571734457 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-10-06T01:22:04.881 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:04.867+0000 7f61e899d700 1 -- 172.21.15.50:0/3936697089 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f61e40cefa0 con 0x7f61e4159480 2023-10-06T01:22:04.881 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:04.867+0000 7f61e899d700 1 -- 172.21.15.50:0/3936697089 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f61e4150180 con 0x7f61e4159480 2023-10-06T01:22:04.881 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:04.867+0000 7f61cb7fe700 1 -- 172.21.15.50:0/3936697089 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61d4005cb0 con 0x7f61e4159480 2023-10-06T01:22:04.881 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:04.867+0000 7f61cb7fe700 1 -- 172.21.15.50:0/3936697089 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61d4007320 con 0x7f61e4159480 2023-10-06T01:22:04.881 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:04.867+0000 7f9da1ffb700 1 -- 172.21.15.50:0/109760795 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9da400ec70 con 0x7f9dac0c2690 2023-10-06T01:22:04.881 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:04.868+0000 7f9da1ffb700 1 -- 172.21.15.50:0/109760795 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9da400edd0 con 0x7f9dac0c2690 2023-10-06T01:22:04.882 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:04.868+0000 7f5003fff700 1 --2- 172.21.15.50:0/3607318921 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f50041559d0 0x7f50040cab30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:04.882 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:04.868+0000 7f28b2ffd700 1 --2- 172.21.15.50:0/3290852588 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f28b8067000 0x7f28b80694b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:04.882 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:04.868+0000 7f28b2ffd700 1 -- 172.21.15.50:0/3290852588 <== mon.1 v2:172.21.15.155:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f28bc083f90 con 0x7f28c4039050 2023-10-06T01:22:04.882 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:04.868+0000 7f72b639b700 1 --2- 172.21.15.50:0/1571734457 >> v2:172.21.15.155:3300/0 conn(0x7f72b0069890 0x7f72b00c8560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:04.883 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:04.869+0000 7f9da1ffb700 1 -- 172.21.15.50:0/109760795 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9da400ec70 con 0x7f9dac0c2690 2023-10-06T01:22:04.883 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:04.869+0000 7f3f0a1ff700 1 -- 172.21.15.50:0/73166728 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3f04064ad0 con 0x7f3f04069c70 2023-10-06T01:22:04.883 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:04.869+0000 7f72b5399700 1 -- 172.21.15.50:0/1571734457 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 843088019 0 0) 0x7f72b00c8aa0 con 0x7f72b00c77e0 2023-10-06T01:22:04.883 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:04.869+0000 7f5003fff700 1 -- 172.21.15.50:0/3607318921 >> v2:172.21.15.155:3300/0 conn(0x7f50040ccb10 msgr2=0x7f50040ca5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:22:04.884 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:04.869+0000 7f9db3dff700 1 -- 172.21.15.50:0/109760795 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9dac15f6e0 con 0x7f9dac0c2690 2023-10-06T01:22:04.884 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:04.867+0000 7f72b85ff700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f72b00c6800 con 0x7f72b0069890 2023-10-06T01:22:04.884 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:04.869+0000 7f72b85ff700 1 -- 172.21.15.50:0/1571734457 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72b006e140 con 0x7f72b00c7d60 2023-10-06T01:22:04.884 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:04.869+0000 7f5002ffd700 1 --2- 172.21.15.50:0/3607318921 >> v2:172.21.15.155:3300/0 conn(0x7f50040ccb10 0x7f50040ca5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:04.885 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:04.869+0000 7f9db3dff700 1 -- 172.21.15.50:0/109760795 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9dac15fca0 con 0x7f9dac0c2690 2023-10-06T01:22:04.885 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:04.869+0000 7f5003fff700 1 --2- 172.21.15.50:0/3607318921 >> v2:172.21.15.155:3300/0 conn(0x7f50040ccb10 0x7f50040ca5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:04.885 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:04.869+0000 7f5003fff700 1 -- 172.21.15.50:0/3607318921 >> v1:172.21.15.50:6789/0 conn(0x7f500406d7f0 legacy=0x7f50041552c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:04.885 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:04.869+0000 7f5003fff700 1 -- 172.21.15.50:0/3607318921 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50040c6aa0 con 0x7f50041559d0 2023-10-06T01:22:04.886 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:04.869+0000 7f5002ffd700 1 --2- 172.21.15.50:0/3607318921 >> v2:172.21.15.155:3300/0 conn(0x7f50040ccb10 0x7f50040ca5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T01:22:04.886 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:04.869+0000 7f5003fff700 1 --2- 172.21.15.50:0/3607318921 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f50041559d0 0x7f50040cab30 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f4ff40098e0 tx=0x7f4ff40091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5a83072b368e00d server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:22:04.886 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:04.869+0000 7f50027fc700 1 -- 172.21.15.50:0/3607318921 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1782836307 0 0) 0x7f50040c6850 con 0x7f500406d7f0 2023-10-06T01:22:04.886 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:04.869+0000 7f72b5399700 1 -- 172.21.15.50:0/1571734457 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f729c003570 con 0x7f72b00c77e0 2023-10-06T01:22:04.886 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:04.870+0000 7f72b639b700 1 -- 172.21.15.50:0/1571734457 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f72b00c7d60 msgr2=0x7f72b00c72a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:22:04.886 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:04.870+0000 7f72b639b700 1 --2- 172.21.15.50:0/1571734457 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f72b00c7d60 0x7f72b00c72a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:04.886 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:04.870+0000 7f72b639b700 1 -- 172.21.15.50:0/1571734457 >> v1:172.21.15.50:6789/0 conn(0x7f72b00c77e0 legacy=0x7f72b00aef90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:04.887 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:04.870+0000 7f72b639b700 1 -- 172.21.15.50:0/1571734457 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72b00c6aa0 con 0x7f72b0069890 2023-10-06T01:22:04.887 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:04.870+0000 7f28ca7fc700 1 --2- 172.21.15.50:0/3290852588 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f28b8067000 0x7f28b80694b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:04.887 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:04.870+0000 7f72b639b700 1 --2- 172.21.15.50:0/1571734457 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f72b0069890 0x7f72b00c8560 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f72ac0098d0 tx=0x7f72ac009120 comp rx=0 tx=0).ready entity=mon.1 client_cookie=da26266694b0fd62 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:22:04.887 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:04.871+0000 7f61e899d700 1 -- 172.21.15.50:0/3936697089 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f61c40052b0 con 0x7f61e4159480 2023-10-06T01:22:04.888 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:04.871+0000 7f28ca7fc700 1 --2- 172.21.15.50:0/3290852588 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f28b8067000 0x7f28b80694b0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f28c0007fd0 tx=0x7f28c0009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:22:04.888 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:04.871+0000 7f3eeb7fe700 1 -- 172.21.15.50:0/73166728 <== mon.2 v2:172.21.15.155:3301/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f3ef4005a00 con 0x7f3f04069c70 2023-10-06T01:22:04.888 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:04.872+0000 7f9db3dff700 1 -- 172.21.15.50:0/109760795 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9dac15fec0 con 0x7f9dac0c2690 2023-10-06T01:22:04.889 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:04.872+0000 7f3eeb7fe700 1 --2- 172.21.15.50:0/73166728 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f3ef0067000 0x7f3ef00694b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:04.889 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:04.872+0000 7f3eeb7fe700 1 -- 172.21.15.50:0/73166728 <== mon.2 v2:172.21.15.155:3301/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f3ef4084a30 con 0x7f3f04069c70 2023-10-06T01:22:04.889 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:04.873+0000 7f3f02ffd700 1 --2- 172.21.15.50:0/73166728 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f3ef0067000 0x7f3ef00694b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:04.889 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:04.873+0000 7f9da1ffb700 1 -- 172.21.15.50:0/109760795 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f9da401e460 con 0x7f9dac0c2690 2023-10-06T01:22:04.889 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:04.873+0000 7f9da1ffb700 1 --2- 172.21.15.50:0/109760795 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f9d90066ff0 0x7f9d900694a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:04.890 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:04.874+0000 7f3f02ffd700 1 --2- 172.21.15.50:0/73166728 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f3ef0067000 0x7f3ef00694b0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f3f040b1f60 tx=0x7f3efc009370 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:22:04.890 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:04.874+0000 7f9da1ffb700 1 -- 172.21.15.50:0/109760795 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f9da4084ab0 con 0x7f9dac0c2690 2023-10-06T01:22:04.890 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:04.874+0000 7f9db1b9b700 1 --2- 172.21.15.50:0/109760795 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f9d90066ff0 0x7f9d900694a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:04.890 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:04.875+0000 7f28b2ffd700 1 -- 172.21.15.50:0/3290852588 <== mon.1 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f28bc050d90 con 0x7f28c4039050 2023-10-06T01:22:04.891 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:04.875+0000 7f9db1b9b700 1 --2- 172.21.15.50:0/109760795 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f9d90066ff0 0x7f9d900694a0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f9dac0cc950 tx=0x7f9da8017000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:22:04.891 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:04.875+0000 7f72b5399700 1 -- 172.21.15.50:0/1571734457 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72ac005c10 con 0x7f72b0069890 2023-10-06T01:22:04.891 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:04.875+0000 7f72b5399700 1 -- 172.21.15.50:0/1571734457 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72ac005d70 con 0x7f72b0069890 2023-10-06T01:22:04.892 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:04.875+0000 7f72b5399700 1 -- 172.21.15.50:0/1571734457 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72ac006240 con 0x7f72b0069890 2023-10-06T01:22:04.892 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:04.876+0000 7f72b85ff700 1 -- 172.21.15.50:0/1571734457 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f72b0069890 msgr2=0x7f72b00c8560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:04.892 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:04.876+0000 7f72b85ff700 1 --2- 172.21.15.50:0/1571734457 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f72b0069890 0x7f72b00c8560 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f72ac0098d0 tx=0x7f72ac009120 comp rx=0 tx=0).stop 2023-10-06T01:22:04.892 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:04.876+0000 7f72b85ff700 1 -- 172.21.15.50:0/1571734457 shutdown_connections 2023-10-06T01:22:04.892 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:04.876+0000 7fed1afff700 1 Processor -- start 2023-10-06T01:22:04.893 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:04.876+0000 7f72b85ff700 1 --2- 172.21.15.50:0/1571734457 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f72b0069890 0x7f72b00c8560 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:04.893 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:04.876+0000 7f72b85ff700 1 --2- 172.21.15.50:0/1571734457 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f72b00c7d60 0x7f72b00c72a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:04.893 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:04.876+0000 7f72b85ff700 1 -- 172.21.15.50:0/1571734457 >> 172.21.15.50:0/1571734457 conn(0x7f72b00680c0 msgr2=0x7f72b00cc1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:22:04.893 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:04.876+0000 7fed1afff700 1 -- start start 2023-10-06T01:22:04.893 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:04.877+0000 7f61cb7fe700 1 -- 172.21.15.50:0/3936697089 <== mon.1 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f61d4007690 con 0x7f61e4159480 2023-10-06T01:22:04.894 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:04.878+0000 7fed1afff700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fed14156540 0x7fed140c7070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:04.894 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:04.878+0000 7fed1afff700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fed140c75b0 0x7fed1406e690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:04.894 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:04.878+0000 7f72b85ff700 1 -- 172.21.15.50:0/1571734457 shutdown_connections 2023-10-06T01:22:04.895 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:04.878+0000 7fed1afff700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fed1406ebd0 0x7fed1406d390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:04.895 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:04.878+0000 7fed1afff700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fed1406f470 con 0x7fed1406ebd0 2023-10-06T01:22:04.895 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:04.878+0000 7fed1afff700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fed1406f050 con 0x7fed14156540 2023-10-06T01:22:04.895 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:04.878+0000 7fed1afff700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed140acd60 con 0x7fed140c75b0 2023-10-06T01:22:04.895 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:04.878+0000 7fed18d9b700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fed14156540 0x7fed140c7070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:04.895 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:04.878+0000 7fed18d9b700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fed14156540 0x7fed140c7070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.50:54438/0 (socket says 172.21.15.50:54438) 2023-10-06T01:22:04.895 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:04.878+0000 7fed18d9b700 1 -- 172.21.15.50:0/618144709 learned_addr learned my addr 172.21.15.50:0/618144709 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-06T01:22:04.895 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:04.878+0000 7fed13fff700 1 --2- 172.21.15.50:0/618144709 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fed140c75b0 0x7fed1406e690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:04.896 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:04.879+0000 7f72b85ff700 1 -- 172.21.15.50:0/1571734457 wait complete. 2023-10-06T01:22:04.896 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:04.878+0000 7fed1959c700 1 --2- 172.21.15.50:0/618144709 >> v2:172.21.15.50:3300/0 conn(0x7fed1406ebd0 0x7fed1406d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:04.896 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:04.879+0000 7fed18d9b700 1 -- 172.21.15.50:0/618144709 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fed140c75b0 msgr2=0x7fed1406e690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:22:04.896 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:04.879+0000 7fed18d9b700 1 --2- 172.21.15.50:0/618144709 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fed140c75b0 0x7fed1406e690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:04.896 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:04.879+0000 7fed18d9b700 1 -- 172.21.15.50:0/618144709 >> v2:172.21.15.50:3300/0 conn(0x7fed1406ebd0 msgr2=0x7fed1406d390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:22:04.897 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:04.879+0000 7fed18d9b700 1 --2- 172.21.15.50:0/618144709 >> v2:172.21.15.50:3300/0 conn(0x7fed1406ebd0 0x7fed1406d390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:04.897 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:04.879+0000 7fed18d9b700 1 -- 172.21.15.50:0/618144709 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed14156910 con 0x7fed14156540 2023-10-06T01:22:04.897 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:04.879+0000 7f61cb7fe700 1 --2- 172.21.15.50:0/3936697089 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f61d0067080 0x7f61d0069530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:04.897 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:04.879+0000 7f61cb7fe700 1 -- 172.21.15.50:0/3936697089 <== mon.1 v2:172.21.15.155:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f61d4084260 con 0x7f61e4159480 2023-10-06T01:22:04.897 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:04.879+0000 7f61e37fe700 1 --2- 172.21.15.50:0/3936697089 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f61d0067080 0x7f61d0069530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:04.898 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:04.880+0000 7fed18d9b700 1 --2- 172.21.15.50:0/618144709 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fed14156540 0x7fed140c7070 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fed1406fd80 tx=0x7fed08009250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f79ccc5ccfed4c3 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:22:04.898 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:04.880+0000 7f50027fc700 1 -- 172.21.15.50:0/3607318921 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ff4009e80 con 0x7f50041559d0 2023-10-06T01:22:04.898 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:04.880+0000 7f50027fc700 1 -- 172.21.15.50:0/3607318921 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ff400b860 con 0x7f50041559d0 2023-10-06T01:22:04.898 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:04.880+0000 7f50027fc700 1 -- 172.21.15.50:0/3607318921 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ff400bbe0 con 0x7f50041559d0 2023-10-06T01:22:04.898 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:04.881+0000 7f3eeb7fe700 1 -- 172.21.15.50:0/73166728 <== mon.2 v2:172.21.15.155:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f3ef40518b0 con 0x7f3f04069c70 2023-10-06T01:22:04.899 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:04.881+0000 7f9da1ffb700 1 -- 172.21.15.50:0/109760795 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f9da4051830 con 0x7f9dac0c2690 2023-10-06T01:22:04.899 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:04.881+0000 7f500a1ff700 1 -- 172.21.15.50:0/3607318921 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f50041559d0 msgr2=0x7f50040cab30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:04.899 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:04.881+0000 7f500a1ff700 1 --2- 172.21.15.50:0/3607318921 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f50041559d0 0x7f50040cab30 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f4ff40098e0 tx=0x7f4ff40091a0 comp rx=0 tx=0).stop 2023-10-06T01:22:04.899 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:04.881+0000 7f72b85ff700 1 Processor -- start 2023-10-06T01:22:04.900 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:04.881+0000 7f500a1ff700 1 -- 172.21.15.50:0/3607318921 shutdown_connections 2023-10-06T01:22:04.900 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:04.881+0000 7f500a1ff700 1 --2- 172.21.15.50:0/3607318921 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f50041559d0 0x7f50040cab30 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:04.900 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:04.881+0000 7f500a1ff700 1 --2- 172.21.15.50:0/3607318921 >> v2:172.21.15.155:3300/0 conn(0x7f50040ccb10 0x7f50040ca5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:04.900 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:04.881+0000 7f500a1ff700 1 -- 172.21.15.50:0/3607318921 >> 172.21.15.50:0/3607318921 conn(0x7f50040cc000 msgr2=0x7f50040cc400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:22:04.900 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:04.882+0000 7f61e37fe700 1 --2- 172.21.15.50:0/3936697089 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f61d0067080 0x7f61d0069530 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f61dc00bc90 tx=0x7f61dc01f000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:22:04.900 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:04.882+0000 7f61cb7fe700 1 -- 172.21.15.50:0/3936697089 <== mon.1 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f61d40510e0 con 0x7f61e4159480 2023-10-06T01:22:04.901 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:04.882+0000 7f500a1ff700 1 -- 172.21.15.50:0/3607318921 shutdown_connections 2023-10-06T01:22:04.901 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:04.882+0000 7fed137fe700 1 -- 172.21.15.50:0/618144709 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed08009e70 con 0x7fed14156540 2023-10-06T01:22:04.901 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:04.882+0000 7fed137fe700 1 -- 172.21.15.50:0/618144709 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed0800b860 con 0x7fed14156540 2023-10-06T01:22:04.901 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:04.883+0000 7fed137fe700 1 -- 172.21.15.50:0/618144709 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed0800bc00 con 0x7fed14156540 2023-10-06T01:22:04.901 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:04.882+0000 7f72b85ff700 1 -- start start 2023-10-06T01:22:04.902 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:04.884+0000 7fed1afff700 1 -- 172.21.15.50:0/618144709 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fed14156540 msgr2=0x7fed140c7070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:04.903 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:04.883+0000 7f72b85ff700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f72b0069890 0x7f72b014c980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:04.903 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:04.883+0000 7f72b85ff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f72b00c77e0 0x7f72b00c3b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:04.903 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:04.883+0000 7f72b85ff700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f72b00c7d60 0x7f72b00cbea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:04.903 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:04.884+0000 7f72b85ff700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72b00b2100 con 0x7f72b00c77e0 2023-10-06T01:22:04.903 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:04.884+0000 7f72b85ff700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72b014cec0 con 0x7f72b0069890 2023-10-06T01:22:04.903 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:04.884+0000 7f72b85ff700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72b0148f80 con 0x7f72b00c7d60 2023-10-06T01:22:04.903 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:04.884+0000 7f72b639b700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f72b0069890 0x7f72b014c980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:04.903 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:04.884+0000 7f72b639b700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f72b0069890 0x7f72b014c980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.50:54442/0 (socket says 172.21.15.50:54442) 2023-10-06T01:22:04.903 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:04.884+0000 7f72b639b700 1 -- 172.21.15.50:0/2594259223 learned_addr learned my addr 172.21.15.50:0/2594259223 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-06T01:22:04.903 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:04.884+0000 7f72b639b700 1 -- 172.21.15.50:0/2594259223 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f72b00c7d60 msgr2=0x7f72b00cbea0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-06T01:22:04.903 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:04.884+0000 7f72b639b700 1 --2- 172.21.15.50:0/2594259223 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f72b00c7d60 0x7f72b00cbea0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:04.904 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:04.884+0000 7f72b639b700 1 -- 172.21.15.50:0/2594259223 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f72b00c77e0 msgr2=0x7f72b00c3b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:04.904 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:04.884+0000 7f72b639b700 1 --2- 172.21.15.50:0/2594259223 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f72b00c77e0 0x7f72b00c3b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:04.904 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:04.884+0000 7f72b639b700 1 -- 172.21.15.50:0/2594259223 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72ac0093c0 con 0x7f72b0069890 2023-10-06T01:22:04.904 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:04.885+0000 7f72b639b700 1 --2- 172.21.15.50:0/2594259223 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f72b0069890 0x7f72b014c980 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f72b0064e80 tx=0x7f72ac016000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:22:04.904 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:04.885+0000 7fed1afff700 1 --2- 172.21.15.50:0/618144709 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fed14156540 0x7fed140c7070 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fed1406fd80 tx=0x7fed08009250 comp rx=0 tx=0).stop 2023-10-06T01:22:04.904 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:04.885+0000 7f72a67fc700 1 -- 172.21.15.50:0/2594259223 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72ac01d890 con 0x7f72b0069890 2023-10-06T01:22:04.905 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:04.885+0000 7f72a67fc700 1 -- 172.21.15.50:0/2594259223 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72ac01d9f0 con 0x7f72b0069890 2023-10-06T01:22:04.905 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:04.886+0000 7f500a1ff700 1 -- 172.21.15.50:0/3607318921 wait complete. 2023-10-06T01:22:04.905 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:04.885+0000 7f72a67fc700 1 -- 172.21.15.50:0/2594259223 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72ac01ddb0 con 0x7f72b0069890 2023-10-06T01:22:04.906 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:04.886+0000 7fed1afff700 1 -- 172.21.15.50:0/618144709 shutdown_connections 2023-10-06T01:22:04.906 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:04.886+0000 7fed1afff700 1 --2- 172.21.15.50:0/618144709 >> v2:172.21.15.50:3300/0 conn(0x7fed1406ebd0 0x7fed1406d390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:04.906 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:04.886+0000 7fed1afff700 1 --2- 172.21.15.50:0/618144709 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fed14156540 0x7fed140c7070 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:04.906 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:04.886+0000 7fed1afff700 1 --2- 172.21.15.50:0/618144709 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fed140c75b0 0x7fed1406e690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:04.906 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:04.886+0000 7fed1afff700 1 -- 172.21.15.50:0/618144709 >> 172.21.15.50:0/618144709 conn(0x7fed140680c0 msgr2=0x7fed140cc120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:22:04.906 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:04.886+0000 7f72b85ff700 1 -- 172.21.15.50:0/2594259223 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f72b00afe90 con 0x7f72b0069890 2023-10-06T01:22:04.907 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:04.886+0000 7f72b85ff700 1 -- 172.21.15.50:0/2594259223 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f72b00c5c00 con 0x7f72b0069890 2023-10-06T01:22:04.907 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:04.888+0000 7f500a1ff700 1 Processor -- start 2023-10-06T01:22:04.907 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:04.888+0000 7fed1afff700 1 -- 172.21.15.50:0/618144709 shutdown_connections 2023-10-06T01:22:04.907 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:04.889+0000 7f7293fff700 1 -- 172.21.15.50:0/2594259223 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f728c0052b0 con 0x7f72b0069890 2023-10-06T01:22:04.908 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:04.888+0000 7f500a1ff700 1 -- start start 2023-10-06T01:22:04.908 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:04.890+0000 7f500a1ff700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f500406d7f0 0x7f5004149920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:04.908 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:04.890+0000 7f500a1ff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f50040ccb10 0x7f50040c3fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:04.908 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:04.890+0000 7f500a1ff700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f50041559d0 0x7f50040c4520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:04.908 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:04.890+0000 7f500a1ff700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5004156570 con 0x7f50040ccb10 2023-10-06T01:22:04.909 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:04.890+0000 7f500a1ff700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f500414cfd0 con 0x7f50041559d0 2023-10-06T01:22:04.909 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:04.890+0000 7f500a1ff700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f500414d2b0 con 0x7f500406d7f0 2023-10-06T01:22:04.909 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:04.890+0000 7f5002ffd700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f50040ccb10 0x7f50040c3fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:04.909 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:04.890+0000 7f5002ffd700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f50040ccb10 0x7f50040c3fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:48328/0 (socket says 172.21.15.50:48328) 2023-10-06T01:22:04.909 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:04.891+0000 7f5002ffd700 1 -- 172.21.15.50:0/634857693 learned_addr learned my addr 172.21.15.50:0/634857693 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-06T01:22:04.909 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:04.890+0000 7fed1afff700 1 -- 172.21.15.50:0/618144709 wait complete. 2023-10-06T01:22:04.909 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:04.893+0000 7f50037fe700 1 --2- 172.21.15.50:0/634857693 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f500406d7f0 0x7f5004149920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:04.910 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:04.893+0000 7f5003fff700 1 --2- 172.21.15.50:0/634857693 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f50041559d0 0x7f50040c4520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:04.910 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:04.894+0000 7fed1afff700 1 Processor -- start 2023-10-06T01:22:04.910 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:04.893+0000 7f72a67fc700 1 -- 172.21.15.50:0/2594259223 <== mon.1 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f72ac045bd0 con 0x7f72b0069890 2023-10-06T01:22:04.910 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:04.894+0000 7fed1afff700 1 -- start start 2023-10-06T01:22:04.911 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:04.894+0000 7f72a67fc700 1 --2- 172.21.15.50:0/2594259223 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f7294067080 0x7f7294069530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:04.911 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:04.894+0000 7f72a67fc700 1 -- 172.21.15.50:0/2594259223 <== mon.1 v2:172.21.15.155:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f72ac086b40 con 0x7f72b0069890 2023-10-06T01:22:04.911 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:04.895+0000 7f72b5b9a700 1 --2- 172.21.15.50:0/2594259223 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f7294067080 0x7f7294069530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:04.911 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:04.896+0000 7fed1afff700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fed1406ebd0 0x7fed140c3af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:04.912 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:04.896+0000 7f72b5b9a700 1 --2- 172.21.15.50:0/2594259223 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f7294067080 0x7f7294069530 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f72b00c28e0 tx=0x7f72a00091a0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:22:04.912 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:04.896+0000 7fed1afff700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fed140c75b0 0x7fed140aeed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:04.912 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:04.896+0000 7f72a67fc700 1 -- 172.21.15.50:0/2594259223 <== mon.1 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f72ac0539c0 con 0x7f72b0069890 2023-10-06T01:22:04.913 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:04.897+0000 7fed18d9b700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fed1406ebd0 0x7fed140c3af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:04.913 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:04.897+0000 7fed18d9b700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fed1406ebd0 0x7fed140c3af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3301/0 says I am v2:172.21.15.50:57686/0 (socket says 172.21.15.50:57686) 2023-10-06T01:22:04.913 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:04.897+0000 7fed1afff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fed14156540 0x7fed140af410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:04.913 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:04.897+0000 7fed18d9b700 1 -- 172.21.15.50:0/441326346 learned_addr learned my addr 172.21.15.50:0/441326346 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-06T01:22:04.913 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:04.897+0000 7fed1afff700 1 -- 172.21.15.50:0/441326346 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed1414e140 con 0x7fed14156540 2023-10-06T01:22:04.913 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:04.894+0000 7f5003fff700 1 -- 172.21.15.50:0/634857693 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f500406d7f0 msgr2=0x7f5004149920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:04.914 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:04.894+0000 7f5003fff700 1 --2- 172.21.15.50:0/634857693 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f500406d7f0 0x7f5004149920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:04.914 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:04.894+0000 7f5003fff700 1 -- 172.21.15.50:0/634857693 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f50040ccb10 msgr2=0x7f50040c3fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:04.914 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:04.894+0000 7f5003fff700 1 --2- 172.21.15.50:0/634857693 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f50040ccb10 0x7f50040c3fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:04.914 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:04.894+0000 7f5003fff700 1 -- 172.21.15.50:0/634857693 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ff4009420 con 0x7f50041559d0 2023-10-06T01:22:04.914 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:04.895+0000 7f5003fff700 1 --2- 172.21.15.50:0/634857693 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f50041559d0 0x7f50040c4520 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f4ff4016000 tx=0x7f4ff4017000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:22:04.914 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:04.896+0000 7f4feb7fe700 1 -- 172.21.15.50:0/634857693 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ff401f070 con 0x7f50041559d0 2023-10-06T01:22:04.914 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:04.896+0000 7f500a1ff700 1 -- 172.21.15.50:0/634857693 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5004155f20 con 0x7f50041559d0 2023-10-06T01:22:04.914 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:04.896+0000 7f500a1ff700 1 -- 172.21.15.50:0/634857693 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5004149e60 con 0x7f50041559d0 2023-10-06T01:22:04.914 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:04.897+0000 7f4feb7fe700 1 -- 172.21.15.50:0/634857693 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ff400baa0 con 0x7f50041559d0 2023-10-06T01:22:04.914 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:04.898+0000 7f4feb7fe700 1 -- 172.21.15.50:0/634857693 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ff401f070 con 0x7f50041559d0 2023-10-06T01:22:04.915 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:04.899+0000 7f500a1ff700 1 -- 172.21.15.50:0/634857693 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4fe40052b0 con 0x7f50041559d0 2023-10-06T01:22:04.916 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:04.897+0000 7fed1afff700 1 -- 172.21.15.50:0/441326346 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed140c4590 con 0x7fed140c75b0 2023-10-06T01:22:04.916 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:04.898+0000 7fed1afff700 1 -- 172.21.15.50:0/441326346 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed140c4870 con 0x7fed1406ebd0 2023-10-06T01:22:04.916 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:04.898+0000 7fed1959c700 1 --2- 172.21.15.50:0/441326346 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fed14156540 0x7fed140af410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:04.916 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:04.899+0000 7fed13fff700 1 --2- 172.21.15.50:0/441326346 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fed140c75b0 0x7fed140aeed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:04.916 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:04.899+0000 7fed1959c700 1 -- 172.21.15.50:0/441326346 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fed1406ebd0 msgr2=0x7fed140c3af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:04.916 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:04.899+0000 7fed1959c700 1 --2- 172.21.15.50:0/441326346 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fed1406ebd0 0x7fed140c3af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:04.916 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:04.899+0000 7fed1959c700 1 -- 172.21.15.50:0/441326346 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fed140c75b0 msgr2=0x7fed140aeed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:04.916 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:04.899+0000 7fed1959c700 1 --2- 172.21.15.50:0/441326346 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fed140c75b0 0x7fed140aeed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:04.916 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:04.899+0000 7fed1959c700 1 -- 172.21.15.50:0/441326346 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed080094f0 con 0x7fed14156540 2023-10-06T01:22:04.916 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:04.900+0000 7fed1959c700 1 --2- 172.21.15.50:0/441326346 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fed14156540 0x7fed140af410 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fed0c011450 tx=0x7fed0c00dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:22:04.916 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:04.901+0000 7fed10ff9700 1 -- 172.21.15.50:0/441326346 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed0c011e20 con 0x7fed14156540 2023-10-06T01:22:04.917 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:04.901+0000 7fed10ff9700 1 -- 172.21.15.50:0/441326346 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed0c013040 con 0x7fed14156540 2023-10-06T01:22:04.917 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:04.902+0000 7fed1afff700 1 -- 172.21.15.50:0/441326346 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fed140c4b50 con 0x7fed14156540 2023-10-06T01:22:04.917 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:04.902+0000 7fed1afff700 1 -- 172.21.15.50:0/441326346 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fed140c4e30 con 0x7fed14156540 2023-10-06T01:22:04.917 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:04.902+0000 7fed10ff9700 1 -- 172.21.15.50:0/441326346 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed0c019650 con 0x7fed14156540 2023-10-06T01:22:04.917 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:04.904+0000 7fed1afff700 1 -- 172.21.15.50:0/441326346 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fed1414df10 con 0x7fed14156540 2023-10-06T01:22:04.918 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:04.904+0000 7f4feb7fe700 1 -- 172.21.15.50:0/634857693 <== mon.1 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f4ff4023070 con 0x7f50041559d0 2023-10-06T01:22:04.918 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:04.905+0000 7f4feb7fe700 1 --2- 172.21.15.50:0/634857693 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f4ff0066ff0 0x7f4ff00694a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:04.918 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:04.906+0000 7f50037fe700 1 --2- 172.21.15.50:0/634857693 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f4ff0066ff0 0x7f4ff00694a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:04.918 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:04.907+0000 7f4feb7fe700 1 -- 172.21.15.50:0/634857693 <== mon.1 v2:172.21.15.155:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f4ff4056d00 con 0x7f50041559d0 2023-10-06T01:22:04.918 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:04.907+0000 7f50037fe700 1 --2- 172.21.15.50:0/634857693 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f4ff0066ff0 0x7f4ff00694a0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f4ffc001560 tx=0x7f4ffc009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:22:04.918 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:04.908+0000 7f4feb7fe700 1 -- 172.21.15.50:0/634857693 <== mon.1 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4ff40530d0 con 0x7f50041559d0 2023-10-06T01:22:04.919 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:04.912+0000 7fed10ff9700 1 -- 172.21.15.50:0/441326346 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fed0c003020 con 0x7fed14156540 2023-10-06T01:22:04.919 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:04.913+0000 7fed10ff9700 1 --2- 172.21.15.50:0/441326346 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7fecf8066f30 0x7fecf80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:04.919 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:04.913+0000 7fed10ff9700 1 -- 172.21.15.50:0/441326346 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6809+0+0 (secure 0 0 0) 0x7fed0c089100 con 0x7fed14156540 2023-10-06T01:22:04.919 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:04.915+0000 7fed18d9b700 1 --2- 172.21.15.50:0/441326346 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7fecf8066f30 0x7fecf80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:04.919 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:04.917+0000 7fed10ff9700 1 -- 172.21.15.50:0/441326346 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fed1414df10 con 0x7fed14156540 2023-10-06T01:22:04.926 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:04.926+0000 7fed18d9b700 1 --2- 172.21.15.50:0/441326346 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7fecf8066f30 0x7fecf80693e0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fed08009fd0 tx=0x7fed08017000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:22:05.264 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:05.263+0000 7ff7cf5ff700 1 -- 172.21.15.50:0/390397228 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7ff7a8005830 con 0x7ff7c80b4aa0 2023-10-06T01:22:05.266 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:05.265+0000 7ff7bd7fa700 1 -- 172.21.15.50:0/390397228 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7ff7c40542c0 con 0x7ff7c80b4aa0 2023-10-06T01:22:05.266 INFO:teuthology.orchestra.run.smithi050.stdout:55834574856 2023-10-06T01:22:05.271 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:05.269+0000 7ff7b2ffd700 1 -- 172.21.15.50:0/390397228 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7ff7b40671f0 msgr2=0x7ff7b40696a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:05.271 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:05.270+0000 7ff7b2ffd700 1 --2- 172.21.15.50:0/390397228 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7ff7b40671f0 0x7ff7b40696a0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7ff7c815b9c0 tx=0x7ff7b80091a0 comp rx=0 tx=0).stop 2023-10-06T01:22:05.271 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:05.270+0000 7ff7b2ffd700 1 -- 172.21.15.50:0/390397228 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff7c80b4aa0 msgr2=0x7ff7c8068940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:05.271 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:05.270+0000 7ff7b2ffd700 1 --2- 172.21.15.50:0/390397228 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff7c80b4aa0 0x7ff7c8068940 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7ff7c400b7e0 tx=0x7ff7c4009060 comp rx=0 tx=0).stop 2023-10-06T01:22:05.271 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:05.271+0000 7ff7b2ffd700 1 -- 172.21.15.50:0/390397228 shutdown_connections 2023-10-06T01:22:05.272 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:05.271+0000 7ff7b2ffd700 1 --2- 172.21.15.50:0/390397228 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff7c80acf30 0x7ff7c80ad360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:05.272 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:05.271+0000 7ff7b2ffd700 1 --2- 172.21.15.50:0/390397228 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7ff7b40671f0 0x7ff7b40696a0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:05.272 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:05.271+0000 7ff7b2ffd700 1 --2- 172.21.15.50:0/390397228 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff7c80b1e20 0x7ff7c8068400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:05.272 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:05.271+0000 7ff7b2ffd700 1 --2- 172.21.15.50:0/390397228 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff7c80b4aa0 0x7ff7c8068940 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:05.273 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:05.271+0000 7ff7b2ffd700 1 -- 172.21.15.50:0/390397228 >> 172.21.15.50:0/390397228 conn(0x7ff7c8099830 msgr2=0x7ff7c815c950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:22:05.273 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:05.272+0000 7ff7b2ffd700 1 -- 172.21.15.50:0/390397228 shutdown_connections 2023-10-06T01:22:05.273 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:05.272+0000 7ff7b2ffd700 1 -- 172.21.15.50:0/390397228 wait complete. 2023-10-06T01:22:05.304 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574856 for osd.3 2023-10-06T01:22:05.304 DEBUG:teuthology.parallel:result is None 2023-10-06T01:22:05.310 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:05.310+0000 7f28d15ff700 1 -- 172.21.15.50:0/3290852588 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f28c40057e0 con 0x7f28c4039050 2023-10-06T01:22:05.311 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:05.310+0000 7f28b2ffd700 1 -- 172.21.15.50:0/3290852588 <== mon.1 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f28bc017070 con 0x7f28c4039050 2023-10-06T01:22:05.311 INFO:teuthology.orchestra.run.smithi050.stdout:55834574857 2023-10-06T01:22:05.313 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:05.312+0000 7f9db3dff700 1 -- 172.21.15.50:0/109760795 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7f9dac064ad0 con 0x7f9dac0c2690 2023-10-06T01:22:05.314 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:05.313+0000 7f9da1ffb700 1 -- 172.21.15.50:0/109760795 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f9da4009a40 con 0x7f9dac0c2690 2023-10-06T01:22:05.317 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:05.313+0000 7f28d15ff700 1 -- 172.21.15.50:0/3290852588 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f28b8067000 msgr2=0x7f28b80694b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:05.317 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:05.314+0000 7f28d15ff700 1 --2- 172.21.15.50:0/3290852588 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f28b8067000 0x7f28b80694b0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f28c0007fd0 tx=0x7f28c0009040 comp rx=0 tx=0).stop 2023-10-06T01:22:05.318 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:05.314+0000 7f28d15ff700 1 -- 172.21.15.50:0/3290852588 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f28c4039050 msgr2=0x7f28c400d250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:05.318 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:05.314+0000 7f28d15ff700 1 --2- 172.21.15.50:0/3290852588 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f28c4039050 0x7f28c400d250 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f28bc00c530 tx=0x7f28bc007ed0 comp rx=0 tx=0).stop 2023-10-06T01:22:05.318 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:05.314+0000 7f28d15ff700 1 -- 172.21.15.50:0/3290852588 shutdown_connections 2023-10-06T01:22:05.318 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:05.314+0000 7f28d15ff700 1 --2- 172.21.15.50:0/3290852588 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f28c40eae70 0x7f28c404ca40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:05.318 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:05.314+0000 7f28d15ff700 1 --2- 172.21.15.50:0/3290852588 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f28b8067000 0x7f28b80694b0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:05.318 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:05.314+0000 7f28d15ff700 1 --2- 172.21.15.50:0/3290852588 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f28c4039050 0x7f28c400d250 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:05.318 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:05.314+0000 7f28d15ff700 1 --2- 172.21.15.50:0/3290852588 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f28c40e6340 0x7f28c40f7ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:05.318 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:05.314+0000 7f28d15ff700 1 -- 172.21.15.50:0/3290852588 >> 172.21.15.50:0/3290852588 conn(0x7f28c400f0b0 msgr2=0x7f28c40e5480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:22:05.318 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:05.315+0000 7f28d15ff700 1 -- 172.21.15.50:0/3290852588 shutdown_connections 2023-10-06T01:22:05.318 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:05.315+0000 7f28d15ff700 1 -- 172.21.15.50:0/3290852588 wait complete. 2023-10-06T01:22:05.319 INFO:teuthology.orchestra.run.smithi050.stdout:55834574858 2023-10-06T01:22:05.320 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:05.319+0000 7f9db3dff700 1 -- 172.21.15.50:0/109760795 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f9d90066ff0 msgr2=0x7f9d900694a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:05.320 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:05.319+0000 7f9db3dff700 1 --2- 172.21.15.50:0/109760795 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f9d90066ff0 0x7f9d900694a0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f9dac0cc950 tx=0x7f9da8017000 comp rx=0 tx=0).stop 2023-10-06T01:22:05.320 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:05.319+0000 7f9db3dff700 1 -- 172.21.15.50:0/109760795 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9dac0c2690 msgr2=0x7f9dac15c810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:05.320 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:05.319+0000 7f9db3dff700 1 --2- 172.21.15.50:0/109760795 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9dac0c2690 0x7f9dac15c810 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f9da4009fa0 tx=0x7f9da4009900 comp rx=0 tx=0).stop 2023-10-06T01:22:05.321 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:05.320+0000 7f9db3dff700 1 -- 172.21.15.50:0/109760795 shutdown_connections 2023-10-06T01:22:05.322 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:05.320+0000 7f9db3dff700 1 --2- 172.21.15.50:0/109760795 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9dac0c2690 0x7f9dac15c810 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:05.322 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:05.320+0000 7f9db3dff700 1 --2- 172.21.15.50:0/109760795 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f9d90066ff0 0x7f9d900694a0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:05.322 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:05.320+0000 7f9db3dff700 1 --2- 172.21.15.50:0/109760795 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9dac069aa0 0x7f9dac1578a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:05.322 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:05.320+0000 7f9db3dff700 1 --2- 172.21.15.50:0/109760795 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9dac0bf730 0x7f9dac0c2150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:05.322 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:05.320+0000 7f9db3dff700 1 -- 172.21.15.50:0/109760795 >> 172.21.15.50:0/109760795 conn(0x7f9dac0680c0 msgr2=0x7f9dac0ca850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:22:05.322 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:05.321+0000 7f9db3dff700 1 -- 172.21.15.50:0/109760795 shutdown_connections 2023-10-06T01:22:05.322 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:05.321+0000 7f9db3dff700 1 -- 172.21.15.50:0/109760795 wait complete. 2023-10-06T01:22:05.331 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:05.331+0000 7f61e899d700 1 -- 172.21.15.50:0/3936697089 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f61c4005830 con 0x7f61e4159480 2023-10-06T01:22:05.333 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:05.332+0000 7f3f0a1ff700 1 -- 172.21.15.50:0/73166728 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f3f040c77c0 con 0x7f3f04069c70 2023-10-06T01:22:05.334 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:05.334+0000 7f3eeb7fe700 1 -- 172.21.15.50:0/73166728 <== mon.2 v2:172.21.15.155:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f3ef4020020 con 0x7f3f04069c70 2023-10-06T01:22:05.335 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:05.334+0000 7f61cb7fe700 1 -- 172.21.15.50:0/3936697089 <== mon.1 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f61d4017090 con 0x7f61e4159480 2023-10-06T01:22:05.335 INFO:teuthology.orchestra.run.smithi050.stdout:55834574856 2023-10-06T01:22:05.337 INFO:teuthology.orchestra.run.smithi050.stdout:55834574856 2023-10-06T01:22:05.340 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:05.339+0000 7f3f0a1ff700 1 -- 172.21.15.50:0/73166728 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f3ef0067000 msgr2=0x7f3ef00694b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:05.340 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:05.339+0000 7f3f0a1ff700 1 --2- 172.21.15.50:0/73166728 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f3ef0067000 0x7f3ef00694b0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f3f040b1f60 tx=0x7f3efc009370 comp rx=0 tx=0).stop 2023-10-06T01:22:05.341 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:05.339+0000 7f3f0a1ff700 1 -- 172.21.15.50:0/73166728 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3f04069c70 msgr2=0x7f3f0414bcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:05.341 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:05.339+0000 7f3f0a1ff700 1 --2- 172.21.15.50:0/73166728 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3f04069c70 0x7f3f0414bcd0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f3ef400e880 tx=0x7f3ef40091a0 comp rx=0 tx=0).stop 2023-10-06T01:22:05.341 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:05.340+0000 7f61e899d700 1 -- 172.21.15.50:0/3936697089 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f61d0067080 msgr2=0x7f61d0069530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:05.342 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:05.340+0000 7f3f0a1ff700 1 -- 172.21.15.50:0/73166728 shutdown_connections 2023-10-06T01:22:05.342 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:05.340+0000 7f3f0a1ff700 1 --2- 172.21.15.50:0/73166728 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f3ef0067000 0x7f3ef00694b0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:05.342 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:05.340+0000 7f3f0a1ff700 1 --2- 172.21.15.50:0/73166728 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3f04155860 0x7f3f0414c360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:05.342 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:05.340+0000 7f3f0a1ff700 1 --2- 172.21.15.50:0/73166728 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3f04069c70 0x7f3f0414bcd0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:05.342 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:05.340+0000 7f3f0a1ff700 1 --2- 172.21.15.50:0/73166728 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3f040c82a0 0x7f3f040c2640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:05.342 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:05.340+0000 7f3f0a1ff700 1 -- 172.21.15.50:0/73166728 >> 172.21.15.50:0/73166728 conn(0x7f3f040680c0 msgr2=0x7f3f041531b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:22:05.343 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:05.340+0000 7f61e899d700 1 --2- 172.21.15.50:0/3936697089 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f61d0067080 0x7f61d0069530 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f61dc00bc90 tx=0x7f61dc01f000 comp rx=0 tx=0).stop 2023-10-06T01:22:05.343 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:05.340+0000 7f3f0a1ff700 1 -- 172.21.15.50:0/73166728 shutdown_connections 2023-10-06T01:22:05.343 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:05.340+0000 7f61e899d700 1 -- 172.21.15.50:0/3936697089 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f61e4159480 msgr2=0x7f61e4168c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:05.343 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:05.340+0000 7f61e899d700 1 --2- 172.21.15.50:0/3936697089 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f61e4159480 0x7f61e4168c20 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f61d400c7f0 tx=0x7f61d4007eb0 comp rx=0 tx=0).stop 2023-10-06T01:22:05.344 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:05.340+0000 7f3f0a1ff700 1 -- 172.21.15.50:0/73166728 wait complete. 2023-10-06T01:22:05.344 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:05.341+0000 7f61e899d700 1 -- 172.21.15.50:0/3936697089 shutdown_connections 2023-10-06T01:22:05.344 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:05.341+0000 7f61e899d700 1 --2- 172.21.15.50:0/3936697089 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f61d0067080 0x7f61d0069530 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:05.344 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:05.341+0000 7f61e899d700 1 --2- 172.21.15.50:0/3936697089 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f61e4159480 0x7f61e4168c20 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:05.344 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:05.341+0000 7f61e899d700 1 --2- 172.21.15.50:0/3936697089 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f61e40b3610 0x7f61e40c7310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:05.344 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:05.341+0000 7f61e899d700 1 --2- 172.21.15.50:0/3936697089 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f61e40cc1b0 0x7f61e414fc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:05.344 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:05.341+0000 7f61e899d700 1 -- 172.21.15.50:0/3936697089 >> 172.21.15.50:0/3936697089 conn(0x7f61e406ed20 msgr2=0x7f61e41544d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:22:05.345 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574857 for osd.0 2023-10-06T01:22:05.345 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:05.341+0000 7f61e899d700 1 -- 172.21.15.50:0/3936697089 shutdown_connections 2023-10-06T01:22:05.346 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:05.341+0000 7f61e899d700 1 -- 172.21.15.50:0/3936697089 wait complete. 2023-10-06T01:22:05.346 DEBUG:teuthology.parallel:result is None 2023-10-06T01:22:05.354 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574858 got 55834574858 for osd.6 2023-10-06T01:22:05.354 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:05.353+0000 7f500a1ff700 1 -- 172.21.15.50:0/634857693 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7f4fe4005830 con 0x7f50041559d0 2023-10-06T01:22:05.354 DEBUG:teuthology.parallel:result is None 2023-10-06T01:22:05.354 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:05.353+0000 7f4feb7fe700 1 -- 172.21.15.50:0/634857693 <== mon.1 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f4ff40530d0 con 0x7f50041559d0 2023-10-06T01:22:05.355 INFO:teuthology.orchestra.run.smithi050.stdout:55834574858 2023-10-06T01:22:05.355 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:05.354+0000 7f7293fff700 1 -- 172.21.15.50:0/2594259223 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7f728c005830 con 0x7f72b0069890 2023-10-06T01:22:05.355 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:05.355+0000 7f72a67fc700 1 -- 172.21.15.50:0/2594259223 <== mon.1 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f72ac056fe0 con 0x7f72b0069890 2023-10-06T01:22:05.356 INFO:teuthology.orchestra.run.smithi050.stdout:55834574858 2023-10-06T01:22:05.358 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:05.357+0000 7f7293fff700 1 -- 172.21.15.50:0/2594259223 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f7294067080 msgr2=0x7f7294069530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:05.358 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:05.357+0000 7f7293fff700 1 --2- 172.21.15.50:0/2594259223 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f7294067080 0x7f7294069530 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f72b00c28e0 tx=0x7f72a00091a0 comp rx=0 tx=0).stop 2023-10-06T01:22:05.358 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:05.357+0000 7f7293fff700 1 -- 172.21.15.50:0/2594259223 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f72b0069890 msgr2=0x7f72b014c980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:05.358 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:05.357+0000 7f7293fff700 1 --2- 172.21.15.50:0/2594259223 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f72b0069890 0x7f72b014c980 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f72b0064e80 tx=0x7f72ac016000 comp rx=0 tx=0).stop 2023-10-06T01:22:05.359 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:05.357+0000 7fed1afff700 1 -- 172.21.15.50:0/441326346 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7fed1414df10 con 0x7fed14156540 2023-10-06T01:22:05.359 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:05.358+0000 7f7293fff700 1 -- 172.21.15.50:0/2594259223 shutdown_connections 2023-10-06T01:22:05.360 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:05.358+0000 7f7293fff700 1 --2- 172.21.15.50:0/2594259223 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f72b00c7d60 0x7f72b00cbea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:05.360 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:05.358+0000 7f7293fff700 1 --2- 172.21.15.50:0/2594259223 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f7294067080 0x7f7294069530 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:05.360 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:05.358+0000 7f7293fff700 1 --2- 172.21.15.50:0/2594259223 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f72b0069890 0x7f72b014c980 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:05.360 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:05.358+0000 7f7293fff700 1 --2- 172.21.15.50:0/2594259223 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f72b00c77e0 0x7f72b00c3b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:05.360 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:05.358+0000 7f7293fff700 1 -- 172.21.15.50:0/2594259223 >> 172.21.15.50:0/2594259223 conn(0x7f72b00680c0 msgr2=0x7f72b014fde0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:22:05.360 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:05.358+0000 7f7293fff700 1 -- 172.21.15.50:0/2594259223 shutdown_connections 2023-10-06T01:22:05.360 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:05.358+0000 7f7293fff700 1 -- 172.21.15.50:0/2594259223 wait complete. 2023-10-06T01:22:05.361 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:05.358+0000 7f500a1ff700 1 -- 172.21.15.50:0/634857693 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f4ff0066ff0 msgr2=0x7f4ff00694a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:05.361 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:05.358+0000 7f500a1ff700 1 --2- 172.21.15.50:0/634857693 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f4ff0066ff0 0x7f4ff00694a0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f4ffc001560 tx=0x7f4ffc009040 comp rx=0 tx=0).stop 2023-10-06T01:22:05.361 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:05.358+0000 7f500a1ff700 1 -- 172.21.15.50:0/634857693 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f50041559d0 msgr2=0x7f50040c4520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:05.361 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:05.358+0000 7f500a1ff700 1 --2- 172.21.15.50:0/634857693 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f50041559d0 0x7f50040c4520 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f4ff4016000 tx=0x7f4ff4017000 comp rx=0 tx=0).stop 2023-10-06T01:22:05.361 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:05.358+0000 7fed10ff9700 1 -- 172.21.15.50:0/441326346 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fed1414df10 con 0x7fed14156540 2023-10-06T01:22:05.361 INFO:teuthology.orchestra.run.smithi050.stdout:55834574856 2023-10-06T01:22:05.362 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:05.359+0000 7f500a1ff700 1 -- 172.21.15.50:0/634857693 shutdown_connections 2023-10-06T01:22:05.362 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:05.359+0000 7f500a1ff700 1 --2- 172.21.15.50:0/634857693 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f4ff0066ff0 0x7f4ff00694a0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:05.362 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:05.359+0000 7f500a1ff700 1 --2- 172.21.15.50:0/634857693 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f50041559d0 0x7f50040c4520 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:05.362 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:05.359+0000 7f500a1ff700 1 --2- 172.21.15.50:0/634857693 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f500406d7f0 0x7f5004149920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:05.362 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:05.359+0000 7f500a1ff700 1 --2- 172.21.15.50:0/634857693 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f50040ccb10 0x7f50040c3fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:05.362 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:05.359+0000 7f500a1ff700 1 -- 172.21.15.50:0/634857693 >> 172.21.15.50:0/634857693 conn(0x7f50040cc000 msgr2=0x7f50041595c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:22:05.363 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:05.359+0000 7f500a1ff700 1 -- 172.21.15.50:0/634857693 shutdown_connections 2023-10-06T01:22:05.363 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:05.359+0000 7f500a1ff700 1 -- 172.21.15.50:0/634857693 wait complete. 2023-10-06T01:22:05.363 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:05.361+0000 7fed1afff700 1 -- 172.21.15.50:0/441326346 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7fecf8066f30 msgr2=0x7fecf80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:05.364 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:05.361+0000 7fed1afff700 1 --2- 172.21.15.50:0/441326346 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7fecf8066f30 0x7fecf80693e0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fed08009fd0 tx=0x7fed08017000 comp rx=0 tx=0).stop 2023-10-06T01:22:05.364 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:05.361+0000 7fed1afff700 1 -- 172.21.15.50:0/441326346 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fed14156540 msgr2=0x7fed140af410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:05.364 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:05.361+0000 7fed1afff700 1 --2- 172.21.15.50:0/441326346 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fed14156540 0x7fed140af410 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fed0c011450 tx=0x7fed0c00dcf0 comp rx=0 tx=0).stop 2023-10-06T01:22:05.364 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:05.361+0000 7fed1afff700 1 -- 172.21.15.50:0/441326346 shutdown_connections 2023-10-06T01:22:05.364 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:05.361+0000 7fed1afff700 1 --2- 172.21.15.50:0/441326346 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fed14156540 0x7fed140af410 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:05.364 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:05.361+0000 7fed1afff700 1 --2- 172.21.15.50:0/441326346 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fed1406ebd0 0x7fed140c3af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:05.364 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:05.361+0000 7fed1afff700 1 --2- 172.21.15.50:0/441326346 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7fecf8066f30 0x7fecf80693e0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:05.364 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:05.361+0000 7fed1afff700 1 --2- 172.21.15.50:0/441326346 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fed140c75b0 0x7fed140aeed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:05.364 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:05.361+0000 7fed1afff700 1 -- 172.21.15.50:0/441326346 >> 172.21.15.50:0/441326346 conn(0x7fed140680c0 msgr2=0x7fed14069df0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:22:05.364 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:05.362+0000 7fed1afff700 1 -- 172.21.15.50:0/441326346 shutdown_connections 2023-10-06T01:22:05.364 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:05.362+0000 7fed1afff700 1 -- 172.21.15.50:0/441326346 wait complete. 2023-10-06T01:22:05.368 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574856 for osd.2 2023-10-06T01:22:05.369 DEBUG:teuthology.parallel:result is None 2023-10-06T01:22:05.369 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574856 for osd.1 2023-10-06T01:22:05.369 DEBUG:teuthology.parallel:result is None 2023-10-06T01:22:05.384 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574856 for osd.4 2023-10-06T01:22:05.384 DEBUG:teuthology.parallel:result is None 2023-10-06T01:22:05.390 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574858 got 55834574858 for osd.5 2023-10-06T01:22:05.390 DEBUG:teuthology.parallel:result is None 2023-10-06T01:22:05.391 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574858 got 55834574858 for osd.7 2023-10-06T01:22:05.391 DEBUG:teuthology.parallel:result is None 2023-10-06T01:22:05.391 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2023-10-06T01:22:05.391 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-06T01:22:05.618 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:05.617+0000 7fad20f9d700 1 Processor -- start 2023-10-06T01:22:05.619 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:05.618+0000 7fad20f9d700 1 -- start start 2023-10-06T01:22:05.620 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:05.619+0000 7fad20f9d700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fad1c0cbc70 0x7fad1c0cc0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:05.620 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:05.619+0000 7fad20f9d700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fad1c0b2140 0x7fad1c0b2560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:05.620 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:05.619+0000 7fad20f9d700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fad1c0cb7e0 con 0x7fad1c159480 2023-10-06T01:22:05.620 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:05.619+0000 7fad20f9d700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fad1c0b08a0 con 0x7fad1c0cbc70 2023-10-06T01:22:05.620 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:05.619+0000 7fad20f9d700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fad1c0cb190 con 0x7fad1c0b2140 2023-10-06T01:22:05.620 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:05.619+0000 7fad1affd700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fad1c0cbc70 0x7fad1c0cc0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:05.620 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:05.619+0000 7fad1affd700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fad1c0cbc70 0x7fad1c0cc0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:37094/0 (socket says 172.21.15.50:37094) 2023-10-06T01:22:05.620 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:05.619+0000 7fad1affd700 1 -- 172.21.15.50:0/268075297 learned_addr learned my addr 172.21.15.50:0/268075297 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-06T01:22:05.622 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:05.619+0000 7fad1bfff700 1 --2- 172.21.15.50:0/268075297 >> v2:172.21.15.155:3300/0 conn(0x7fad1c0b2140 0x7fad1c0b2560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:05.622 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:05.619+0000 7fad1affd700 1 -- 172.21.15.50:0/268075297 >> v2:172.21.15.155:3300/0 conn(0x7fad1c0b2140 msgr2=0x7fad1c0b2560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:22:05.622 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:05.619+0000 7fad1affd700 1 --2- 172.21.15.50:0/268075297 >> v2:172.21.15.155:3300/0 conn(0x7fad1c0b2140 0x7fad1c0b2560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:05.622 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:05.619+0000 7fad1affd700 1 -- 172.21.15.50:0/268075297 >> v1:172.21.15.155:6789/0 conn(0x7fad1c159480 legacy=0x7fad1c0b30d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:05.622 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:05.620+0000 7fad1affd700 1 -- 172.21.15.50:0/268075297 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad1c0cb470 con 0x7fad1c0cbc70 2023-10-06T01:22:05.622 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:05.620+0000 7fad1affd700 1 --2- 172.21.15.50:0/268075297 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fad1c0cbc70 0x7fad1c0cc0c0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fad1c0ca830 tx=0x7fad10009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9b5c837d4009227 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:22:05.622 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:05.620+0000 7fad1a7fc700 1 -- 172.21.15.50:0/268075297 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad1000b860 con 0x7fad1c0cbc70 2023-10-06T01:22:05.622 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:05.620+0000 7fad1a7fc700 1 -- 172.21.15.50:0/268075297 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad1000b9c0 con 0x7fad1c0cbc70 2023-10-06T01:22:05.622 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:05.620+0000 7fad1a7fc700 1 -- 172.21.15.50:0/268075297 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad1000bd60 con 0x7fad1c0cbc70 2023-10-06T01:22:05.622 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:05.621+0000 7fad20f9d700 1 -- 172.21.15.50:0/268075297 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fad1c0cbc70 msgr2=0x7fad1c0cc0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:05.623 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:05.621+0000 7fad20f9d700 1 --2- 172.21.15.50:0/268075297 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fad1c0cbc70 0x7fad1c0cc0c0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fad1c0ca830 tx=0x7fad10009250 comp rx=0 tx=0).stop 2023-10-06T01:22:05.623 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:05.621+0000 7fad20f9d700 1 -- 172.21.15.50:0/268075297 shutdown_connections 2023-10-06T01:22:05.623 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:05.621+0000 7fad20f9d700 1 --2- 172.21.15.50:0/268075297 >> v2:172.21.15.155:3300/0 conn(0x7fad1c0b2140 0x7fad1c0b2560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:05.623 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:05.621+0000 7fad20f9d700 1 --2- 172.21.15.50:0/268075297 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fad1c0cbc70 0x7fad1c0cc0c0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:05.623 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:05.621+0000 7fad20f9d700 1 -- 172.21.15.50:0/268075297 >> 172.21.15.50:0/268075297 conn(0x7fad1c06ed20 msgr2=0x7fad1c06f120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:22:05.623 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:05.621+0000 7fad20f9d700 1 -- 172.21.15.50:0/268075297 shutdown_connections 2023-10-06T01:22:05.623 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:05.621+0000 7fad20f9d700 1 -- 172.21.15.50:0/268075297 wait complete. 2023-10-06T01:22:05.623 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:05.622+0000 7fad20f9d700 1 Processor -- start 2023-10-06T01:22:05.624 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:05.622+0000 7fad20f9d700 1 -- start start 2023-10-06T01:22:05.625 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:05.623+0000 7fad20f9d700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fad1c0b2140 0x7fad1c153370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:05.625 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:05.623+0000 7fad20f9d700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fad1c0cbc70 0x7fad1c0cfe40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:05.625 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:05.623+0000 7fad20f9d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fad1c159480 0x7fad1c0c5e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:05.625 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:05.623+0000 7fad20f9d700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad1c0c9550 con 0x7fad1c159480 2023-10-06T01:22:05.625 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:05.623+0000 7fad20f9d700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad1c153bc0 con 0x7fad1c0b2140 2023-10-06T01:22:05.625 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:05.623+0000 7fad20f9d700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad1c1698d0 con 0x7fad1c0cbc70 2023-10-06T01:22:05.625 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:05.624+0000 7fad1bfff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fad1c159480 0x7fad1c0c5e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:05.625 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:05.624+0000 7fad1bfff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fad1c159480 0x7fad1c0c5e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:37108/0 (socket says 172.21.15.50:37108) 2023-10-06T01:22:05.626 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:05.624+0000 7fad1bfff700 1 -- 172.21.15.50:0/3401055143 learned_addr learned my addr 172.21.15.50:0/3401055143 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-06T01:22:05.626 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:05.624+0000 7fad1b7fe700 1 --2- 172.21.15.50:0/3401055143 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fad1c0b2140 0x7fad1c153370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:05.626 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:05.624+0000 7fad1affd700 1 --2- 172.21.15.50:0/3401055143 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fad1c0cbc70 0x7fad1c0cfe40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:05.626 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:05.624+0000 7fad1bfff700 1 -- 172.21.15.50:0/3401055143 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fad1c0cbc70 msgr2=0x7fad1c0cfe40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:05.626 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:05.624+0000 7fad1bfff700 1 --2- 172.21.15.50:0/3401055143 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fad1c0cbc70 0x7fad1c0cfe40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:05.626 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:05.624+0000 7fad1bfff700 1 -- 172.21.15.50:0/3401055143 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fad1c0b2140 msgr2=0x7fad1c153370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:05.626 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:05.624+0000 7fad1bfff700 1 --2- 172.21.15.50:0/3401055143 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fad1c0b2140 0x7fad1c153370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:05.626 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:05.624+0000 7fad1bfff700 1 -- 172.21.15.50:0/3401055143 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad100094f0 con 0x7fad1c159480 2023-10-06T01:22:05.626 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:05.624+0000 7fad1affd700 1 --2- 172.21.15.50:0/3401055143 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fad1c0cbc70 0x7fad1c0cfe40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T01:22:05.626 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:05.624+0000 7fad1bfff700 1 --2- 172.21.15.50:0/3401055143 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fad1c159480 0x7fad1c0c5e20 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fad14009fa0 tx=0x7fad14009900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:22:05.627 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:05.625+0000 7fad037fe700 1 -- 172.21.15.50:0/3401055143 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad1400ed20 con 0x7fad1c159480 2023-10-06T01:22:05.627 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:05.625+0000 7fad037fe700 1 -- 172.21.15.50:0/3401055143 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad1400ee80 con 0x7fad1c159480 2023-10-06T01:22:05.627 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:05.625+0000 7fad20f9d700 1 -- 172.21.15.50:0/3401055143 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fad1c169bb0 con 0x7fad1c159480 2023-10-06T01:22:05.627 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:05.625+0000 7fad037fe700 1 -- 172.21.15.50:0/3401055143 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad14014670 con 0x7fad1c159480 2023-10-06T01:22:05.628 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:05.625+0000 7fad20f9d700 1 -- 172.21.15.50:0/3401055143 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fad1c16a170 con 0x7fad1c159480 2023-10-06T01:22:05.628 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:05.626+0000 7fad20f9d700 1 -- 172.21.15.50:0/3401055143 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fad1c05f270 con 0x7fad1c159480 2023-10-06T01:22:05.628 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:05.627+0000 7fad037fe700 1 -- 172.21.15.50:0/3401055143 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fad140149e0 con 0x7fad1c159480 2023-10-06T01:22:05.628 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:05.627+0000 7fad037fe700 1 --2- 172.21.15.50:0/3401055143 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7fad08066f30 0x7fad080693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:05.628 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:05.628+0000 7fad037fe700 1 -- 172.21.15.50:0/3401055143 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6809+0+0 (secure 0 0 0) 0x7fad140851d0 con 0x7fad1c159480 2023-10-06T01:22:05.628 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:05.628+0000 7fad1b7fe700 1 --2- 172.21.15.50:0/3401055143 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7fad08066f30 0x7fad080693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:05.629 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:05.629+0000 7fad1b7fe700 1 --2- 172.21.15.50:0/3401055143 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7fad08066f30 0x7fad080693e0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fad0c0037c0 tx=0x7fad0c009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:22:05.632 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:05.631+0000 7fad037fe700 1 -- 172.21.15.50:0/3401055143 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fad14051f50 con 0x7fad1c159480 2023-10-06T01:22:05.830 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:05.830+0000 7fad20f9d700 1 -- 172.21.15.50:0/3401055143 --> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fad1c159850 con 0x7fad08066f30 2023-10-06T01:22:05.842 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:05.841+0000 7fad037fe700 1 -- 172.21.15.50:0/3401055143 <== mgr.4099 v2:172.21.15.155:6832/85215 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+367527 (secure 0 0 0) 0x7fad1c159850 con 0x7fad08066f30 2023-10-06T01:22:05.847 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-10-06T01:22:05.850 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:05.846+0000 7fad20f9d700 1 -- 172.21.15.50:0/3401055143 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7fad08066f30 msgr2=0x7fad080693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:05.851 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:05.846+0000 7fad20f9d700 1 --2- 172.21.15.50:0/3401055143 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7fad08066f30 0x7fad080693e0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fad0c0037c0 tx=0x7fad0c009040 comp rx=0 tx=0).stop 2023-10-06T01:22:05.851 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:05.846+0000 7fad20f9d700 1 -- 172.21.15.50:0/3401055143 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fad1c159480 msgr2=0x7fad1c0c5e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:05.851 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:05.846+0000 7fad20f9d700 1 --2- 172.21.15.50:0/3401055143 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fad1c159480 0x7fad1c0c5e20 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fad14009fa0 tx=0x7fad14009900 comp rx=0 tx=0).stop 2023-10-06T01:22:05.851 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:05.846+0000 7fad20f9d700 1 -- 172.21.15.50:0/3401055143 shutdown_connections 2023-10-06T01:22:05.851 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:05.846+0000 7fad20f9d700 1 --2- 172.21.15.50:0/3401055143 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fad1c159480 0x7fad1c0c5e20 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:05.851 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:05.846+0000 7fad20f9d700 1 --2- 172.21.15.50:0/3401055143 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7fad08066f30 0x7fad080693e0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:05.851 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:05.846+0000 7fad20f9d700 1 --2- 172.21.15.50:0/3401055143 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fad1c0b2140 0x7fad1c153370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:05.851 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:05.846+0000 7fad20f9d700 1 --2- 172.21.15.50:0/3401055143 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fad1c0cbc70 0x7fad1c0cfe40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:05.851 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:05.846+0000 7fad20f9d700 1 -- 172.21.15.50:0/3401055143 >> 172.21.15.50:0/3401055143 conn(0x7fad1c06ed20 msgr2=0x7fad1c1586a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:22:05.851 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:05.846+0000 7fad20f9d700 1 -- 172.21.15.50:0/3401055143 shutdown_connections 2023-10-06T01:22:05.852 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:05.846+0000 7fad20f9d700 1 -- 172.21.15.50:0/3401055143 wait complete. 2023-10-06T01:22:05.852 INFO:teuthology.orchestra.run.smithi050.stderr:dumped all 2023-10-06T01:22:05.865 INFO:teuthology.orchestra.run.smithi050.stdout:{"pg_ready":true,"pg_map":{"version":37,"stamp":"2023-10-06T01:22:05.777311+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":594852,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":207,"num_write_kb":2433,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":159,"ondisk_log_size":159,"up":338,"acting":338,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":338,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2397980,"kb_used_data":3292,"kb_used_omap":0,"kb_used_meta":2394624,"kb_avail":752576740,"statfs":{"total":773094113280,"available":770638581760,"internally_reserved":0,"allocated":3371008,"data_stored":2062434,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2452094976},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1725,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003597"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T01:21:40.818033+0000","last_change":"2023-10-06T01:21:36.824186+0000","last_active":"2023-10-06T01:21:40.818033+0000","last_peered":"2023-10-06T01:21:40.818033+0000","last_clean":"2023-10-06T01:21:40.818033+0000","last_became_active":"2023-10-06T01:21:36.823943+0000","last_became_peered":"2023-10-06T01:21:36.823943+0000","last_unstale":"2023-10-06T01:21:40.818033+0000","last_undegraded":"2023-10-06T01:21:40.818033+0000","last_fullsized":"2023-10-06T01:21:40.818033+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:21:36.268170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:21:36.268170+0000","last_clean_scrub_stamp":"2023-10-06T01:21:36.268170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:03:03.146121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T01:21:40.829968+0000","last_change":"2023-10-06T01:21:36.827051+0000","last_active":"2023-10-06T01:21:40.829968+0000","last_peered":"2023-10-06T01:21:40.829968+0000","last_clean":"2023-10-06T01:21:40.829968+0000","last_became_active":"2023-10-06T01:21:36.826789+0000","last_became_peered":"2023-10-06T01:21:36.826789+0000","last_unstale":"2023-10-06T01:21:40.829968+0000","last_undegraded":"2023-10-06T01:21:40.829968+0000","last_fullsized":"2023-10-06T01:21:40.829968+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:21:36.268170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:21:36.268170+0000","last_clean_scrub_stamp":"2023-10-06T01:21:36.268170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:53:49.542750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T01:21:40.825569+0000","last_change":"2023-10-06T01:21:36.841714+0000","last_active":"2023-10-06T01:21:40.825569+0000","last_peered":"2023-10-06T01:21:40.825569+0000","last_clean":"2023-10-06T01:21:40.825569+0000","last_became_active":"2023-10-06T01:21:36.841309+0000","last_became_peered":"2023-10-06T01:21:36.841309+0000","last_unstale":"2023-10-06T01:21:40.825569+0000","last_undegraded":"2023-10-06T01:21:40.825569+0000","last_fullsized":"2023-10-06T01:21:40.825569+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:21:36.268170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:21:36.268170+0000","last_clean_scrub_stamp":"2023-10-06T01:21:36.268170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:21:06.849534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T01:21:40.820783+0000","last_change":"2023-10-06T01:21:36.839886+0000","last_active":"2023-10-06T01:21:40.820783+0000","last_peered":"2023-10-06T01:21:40.820783+0000","last_clean":"2023-10-06T01:21:40.820783+0000","last_became_active":"2023-10-06T01:21:36.839587+0000","last_became_peered":"2023-10-06T01:21:36.839587+0000","last_unstale":"2023-10-06T01:21:40.820783+0000","last_undegraded":"2023-10-06T01:21:40.820783+0000","last_fullsized":"2023-10-06T01:21:40.820783+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:21:36.268170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:21:36.268170+0000","last_clean_scrub_stamp":"2023-10-06T01:21:36.268170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:28:29.254293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T01:21:40.844272+0000","last_change":"2023-10-06T01:21:36.836485+0000","last_active":"2023-10-06T01:21:40.844272+0000","last_peered":"2023-10-06T01:21:40.844272+0000","last_clean":"2023-10-06T01:21:40.844272+0000","last_became_active":"2023-10-06T01:21:36.836212+0000","last_became_peered":"2023-10-06T01:21:36.836212+0000","last_unstale":"2023-10-06T01:21:40.844272+0000","last_undegraded":"2023-10-06T01:21:40.844272+0000","last_fullsized":"2023-10-06T01:21:40.844272+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:21:36.268170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:21:36.268170+0000","last_clean_scrub_stamp":"2023-10-06T01:21:36.268170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:03:40.763134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T01:21:40.824705+0000","last_change":"2023-10-06T01:21:36.842364+0000","last_active":"2023-10-06T01:21:40.824705+0000","last_peered":"2023-10-06T01:21:40.824705+0000","last_clean":"2023-10-06T01:21:40.824705+0000","last_became_active":"2023-10-06T01:21:36.842065+0000","last_became_peered":"2023-10-06T01:21:36.842065+0000","last_unstale":"2023-10-06T01:21:40.824705+0000","last_undegraded":"2023-10-06T01:21:40.824705+0000","last_fullsized":"2023-10-06T01:21:40.824705+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:21:36.268170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:21:36.268170+0000","last_clean_scrub_stamp":"2023-10-06T01:21:36.268170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:28:15.885944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T01:21:40.830001+0000","last_change":"2023-10-06T01:21:36.835095+0000","last_active":"2023-10-06T01:21:40.830001+0000","last_peered":"2023-10-06T01:21:40.830001+0000","last_clean":"2023-10-06T01:21:40.830001+0000","last_became_active":"2023-10-06T01:21:36.834833+0000","last_became_peered":"2023-10-06T01:21:36.834833+0000","last_unstale":"2023-10-06T01:21:40.830001+0000","last_undegraded":"2023-10-06T01:21:40.830001+0000","last_fullsized":"2023-10-06T01:21:40.830001+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:21:36.268170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:21:36.268170+0000","last_clean_scrub_stamp":"2023-10-06T01:21:36.268170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:26:07.073491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T01:21:40.827937+0000","last_change":"2023-10-06T01:21:36.841569+0000","last_active":"2023-10-06T01:21:40.827937+0000","last_peered":"2023-10-06T01:21:40.827937+0000","last_clean":"2023-10-06T01:21:40.827937+0000","last_became_active":"2023-10-06T01:21:36.841279+0000","last_became_peered":"2023-10-06T01:21:36.841279+0000","last_unstale":"2023-10-06T01:21:40.827937+0000","last_undegraded":"2023-10-06T01:21:40.827937+0000","last_fullsized":"2023-10-06T01:21:40.827937+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:21:36.268170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:21:36.268170+0000","last_clean_scrub_stamp":"2023-10-06T01:21:36.268170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:22:57.339224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T01:21:40.843139+0000","last_change":"2023-10-06T01:21:36.840627+0000","last_active":"2023-10-06T01:21:40.843139+0000","last_peered":"2023-10-06T01:21:40.843139+0000","last_clean":"2023-10-06T01:21:40.843139+0000","last_became_active":"2023-10-06T01:21:36.840352+0000","last_became_peered":"2023-10-06T01:21:36.840352+0000","last_unstale":"2023-10-06T01:21:40.843139+0000","last_undegraded":"2023-10-06T01:21:40.843139+0000","last_fullsized":"2023-10-06T01:21:40.843139+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:21:36.268170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:21:36.268170+0000","last_clean_scrub_stamp":"2023-10-06T01:21:36.268170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:53:49.542750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T01:21:40.830823+0000","last_change":"2023-10-06T01:21:36.836461+0000","last_active":"2023-10-06T01:21:40.830823+0000","last_peered":"2023-10-06T01:21:40.830823+0000","last_clean":"2023-10-06T01:21:40.830823+0000","last_became_active":"2023-10-06T01:21:36.836153+0000","last_became_peered":"2023-10-06T01:21:36.836153+0000","last_unstale":"2023-10-06T01:21:40.830823+0000","last_undegraded":"2023-10-06T01:21:40.830823+0000","last_fullsized":"2023-10-06T01:21:40.830823+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:21:36.268170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:21:36.268170+0000","last_clean_scrub_stamp":"2023-10-06T01:21:36.268170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:48:35.151895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T01:21:40.825486+0000","last_change":"2023-10-06T01:21:36.829914+0000","last_active":"2023-10-06T01:21:40.825486+0000","last_peered":"2023-10-06T01:21:40.825486+0000","last_clean":"2023-10-06T01:21:40.825486+0000","last_became_active":"2023-10-06T01:21:36.829628+0000","last_became_peered":"2023-10-06T01:21:36.829628+0000","last_unstale":"2023-10-06T01:21:40.825486+0000","last_undegraded":"2023-10-06T01:21:40.825486+0000","last_fullsized":"2023-10-06T01:21:40.825486+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:21:36.268170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:21:36.268170+0000","last_clean_scrub_stamp":"2023-10-06T01:21:36.268170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:08:14.866921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T01:21:40.817667+0000","last_change":"2023-10-06T01:21:36.835080+0000","last_active":"2023-10-06T01:21:40.817667+0000","last_peered":"2023-10-06T01:21:40.817667+0000","last_clean":"2023-10-06T01:21:40.817667+0000","last_became_active":"2023-10-06T01:21:36.834739+0000","last_became_peered":"2023-10-06T01:21:36.834739+0000","last_unstale":"2023-10-06T01:21:40.817667+0000","last_undegraded":"2023-10-06T01:21:40.817667+0000","last_fullsized":"2023-10-06T01:21:40.817667+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:21:36.268170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:21:36.268170+0000","last_clean_scrub_stamp":"2023-10-06T01:21:36.268170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:48:20.926655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T01:21:40.817292+0000","last_change":"2023-10-06T01:21:36.827097+0000","last_active":"2023-10-06T01:21:40.817292+0000","last_peered":"2023-10-06T01:21:40.817292+0000","last_clean":"2023-10-06T01:21:40.817292+0000","last_became_active":"2023-10-06T01:21:36.826834+0000","last_became_peered":"2023-10-06T01:21:36.826834+0000","last_unstale":"2023-10-06T01:21:40.817292+0000","last_undegraded":"2023-10-06T01:21:40.817292+0000","last_fullsized":"2023-10-06T01:21:40.817292+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:21:36.268170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:21:36.268170+0000","last_clean_scrub_stamp":"2023-10-06T01:21:36.268170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:54:56.312476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T01:21:40.829936+0000","last_change":"2023-10-06T01:21:36.821926+0000","last_active":"2023-10-06T01:21:40.829936+0000","last_peered":"2023-10-06T01:21:40.829936+0000","last_clean":"2023-10-06T01:21:40.829936+0000","last_became_active":"2023-10-06T01:21:36.821634+0000","last_became_peered":"2023-10-06T01:21:36.821634+0000","last_unstale":"2023-10-06T01:21:40.829936+0000","last_undegraded":"2023-10-06T01:21:40.829936+0000","last_fullsized":"2023-10-06T01:21:40.829936+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:21:36.268170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:21:36.268170+0000","last_clean_scrub_stamp":"2023-10-06T01:21:36.268170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:25:14.997580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T01:21:40.829788+0000","last_change":"2023-10-06T01:21:36.835675+0000","last_active":"2023-10-06T01:21:40.829788+0000","last_peered":"2023-10-06T01:21:40.829788+0000","last_clean":"2023-10-06T01:21:40.829788+0000","last_became_active":"2023-10-06T01:21:36.835263+0000","last_became_peered":"2023-10-06T01:21:36.835263+0000","last_unstale":"2023-10-06T01:21:40.829788+0000","last_undegraded":"2023-10-06T01:21:40.829788+0000","last_fullsized":"2023-10-06T01:21:40.829788+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:21:36.268170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:21:36.268170+0000","last_clean_scrub_stamp":"2023-10-06T01:21:36.268170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:48:35.151895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T01:21:40.824974+0000","last_change":"2023-10-06T01:21:36.844306+0000","last_active":"2023-10-06T01:21:40.824974+0000","last_peered":"2023-10-06T01:21:40.824974+0000","last_clean":"2023-10-06T01:21:40.824974+0000","last_became_active":"2023-10-06T01:21:36.843273+0000","last_became_peered":"2023-10-06T01:21:36.843273+0000","last_unstale":"2023-10-06T01:21:40.824974+0000","last_undegraded":"2023-10-06T01:21:40.824974+0000","last_fullsized":"2023-10-06T01:21:40.824974+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:21:36.268170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:21:36.268170+0000","last_clean_scrub_stamp":"2023-10-06T01:21:36.268170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:26:07.073491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T01:21:40.843241+0000","last_change":"2023-10-06T01:21:36.836865+0000","last_active":"2023-10-06T01:21:40.843241+0000","last_peered":"2023-10-06T01:21:40.843241+0000","last_clean":"2023-10-06T01:21:40.843241+0000","last_became_active":"2023-10-06T01:21:36.836583+0000","last_became_peered":"2023-10-06T01:21:36.836583+0000","last_unstale":"2023-10-06T01:21:40.843241+0000","last_undegraded":"2023-10-06T01:21:40.843241+0000","last_fullsized":"2023-10-06T01:21:40.843241+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:21:36.268170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:21:36.268170+0000","last_clean_scrub_stamp":"2023-10-06T01:21:36.268170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:25:14.997580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T01:21:40.827081+0000","last_change":"2023-10-06T01:21:36.833429+0000","last_active":"2023-10-06T01:21:40.827081+0000","last_peered":"2023-10-06T01:21:40.827081+0000","last_clean":"2023-10-06T01:21:40.827081+0000","last_became_active":"2023-10-06T01:21:36.833139+0000","last_became_peered":"2023-10-06T01:21:36.833139+0000","last_unstale":"2023-10-06T01:21:40.827081+0000","last_undegraded":"2023-10-06T01:21:40.827081+0000","last_fullsized":"2023-10-06T01:21:40.827081+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:21:36.268170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:21:36.268170+0000","last_clean_scrub_stamp":"2023-10-06T01:21:36.268170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:51:16.522318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T01:21:40.817681+0000","last_change":"2023-10-06T01:21:36.822258+0000","last_active":"2023-10-06T01:21:40.817681+0000","last_peered":"2023-10-06T01:21:40.817681+0000","last_clean":"2023-10-06T01:21:40.817681+0000","last_became_active":"2023-10-06T01:21:36.822002+0000","last_became_peered":"2023-10-06T01:21:36.822002+0000","last_unstale":"2023-10-06T01:21:40.817681+0000","last_undegraded":"2023-10-06T01:21:40.817681+0000","last_fullsized":"2023-10-06T01:21:40.817681+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:21:36.268170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:21:36.268170+0000","last_clean_scrub_stamp":"2023-10-06T01:21:36.268170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:46:14.981833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T01:21:40.825982+0000","last_change":"2023-10-06T01:21:36.841868+0000","last_active":"2023-10-06T01:21:40.825982+0000","last_peered":"2023-10-06T01:21:40.825982+0000","last_clean":"2023-10-06T01:21:40.825982+0000","last_became_active":"2023-10-06T01:21:36.841579+0000","last_became_peered":"2023-10-06T01:21:36.841579+0000","last_unstale":"2023-10-06T01:21:40.825982+0000","last_undegraded":"2023-10-06T01:21:40.825982+0000","last_fullsized":"2023-10-06T01:21:40.825982+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:21:36.268170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:21:36.268170+0000","last_clean_scrub_stamp":"2023-10-06T01:21:36.268170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:44:16.024192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T01:21:40.830265+0000","last_change":"2023-10-06T01:21:36.836541+0000","last_active":"2023-10-06T01:21:40.830265+0000","last_peered":"2023-10-06T01:21:40.830265+0000","last_clean":"2023-10-06T01:21:40.830265+0000","last_became_active":"2023-10-06T01:21:36.836230+0000","last_became_peered":"2023-10-06T01:21:36.836230+0000","last_unstale":"2023-10-06T01:21:40.830265+0000","last_undegraded":"2023-10-06T01:21:40.830265+0000","last_fullsized":"2023-10-06T01:21:40.830265+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:21:36.268170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:21:36.268170+0000","last_clean_scrub_stamp":"2023-10-06T01:21:36.268170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:22:57.339224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T01:21:40.842277+0000","last_change":"2023-10-06T01:21:36.835952+0000","last_active":"2023-10-06T01:21:40.842277+0000","last_peered":"2023-10-06T01:21:40.842277+0000","last_clean":"2023-10-06T01:21:40.842277+0000","last_became_active":"2023-10-06T01:21:36.835674+0000","last_became_peered":"2023-10-06T01:21:36.835674+0000","last_unstale":"2023-10-06T01:21:40.842277+0000","last_undegraded":"2023-10-06T01:21:40.842277+0000","last_fullsized":"2023-10-06T01:21:40.842277+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:21:36.268170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:21:36.268170+0000","last_clean_scrub_stamp":"2023-10-06T01:21:36.268170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:51:16.522318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T01:21:40.823914+0000","last_change":"2023-10-06T01:21:36.837170+0000","last_active":"2023-10-06T01:21:40.823914+0000","last_peered":"2023-10-06T01:21:40.823914+0000","last_clean":"2023-10-06T01:21:40.823914+0000","last_became_active":"2023-10-06T01:21:36.836919+0000","last_became_peered":"2023-10-06T01:21:36.836919+0000","last_unstale":"2023-10-06T01:21:40.823914+0000","last_undegraded":"2023-10-06T01:21:40.823914+0000","last_fullsized":"2023-10-06T01:21:40.823914+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:21:36.268170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:21:36.268170+0000","last_clean_scrub_stamp":"2023-10-06T01:21:36.268170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:32:46.966379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T01:21:40.832089+0000","last_change":"2023-10-06T01:21:36.836732+0000","last_active":"2023-10-06T01:21:40.832089+0000","last_peered":"2023-10-06T01:21:40.832089+0000","last_clean":"2023-10-06T01:21:40.832089+0000","last_became_active":"2023-10-06T01:21:36.835547+0000","last_became_peered":"2023-10-06T01:21:36.835547+0000","last_unstale":"2023-10-06T01:21:40.832089+0000","last_undegraded":"2023-10-06T01:21:40.832089+0000","last_fullsized":"2023-10-06T01:21:40.832089+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:21:36.268170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:21:36.268170+0000","last_clean_scrub_stamp":"2023-10-06T01:21:36.268170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:53:49.542750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T01:21:40.824805+0000","last_change":"2023-10-06T01:21:36.825216+0000","last_active":"2023-10-06T01:21:40.824805+0000","last_peered":"2023-10-06T01:21:40.824805+0000","last_clean":"2023-10-06T01:21:40.824805+0000","last_became_active":"2023-10-06T01:21:36.824966+0000","last_became_peered":"2023-10-06T01:21:36.824966+0000","last_unstale":"2023-10-06T01:21:40.824805+0000","last_undegraded":"2023-10-06T01:21:40.824805+0000","last_fullsized":"2023-10-06T01:21:40.824805+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:21:36.268170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:21:36.268170+0000","last_clean_scrub_stamp":"2023-10-06T01:21:36.268170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:47:05.161793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T01:21:40.825009+0000","last_change":"2023-10-06T01:21:36.814942+0000","last_active":"2023-10-06T01:21:40.825009+0000","last_peered":"2023-10-06T01:21:40.825009+0000","last_clean":"2023-10-06T01:21:40.825009+0000","last_became_active":"2023-10-06T01:21:36.814669+0000","last_became_peered":"2023-10-06T01:21:36.814669+0000","last_unstale":"2023-10-06T01:21:40.825009+0000","last_undegraded":"2023-10-06T01:21:40.825009+0000","last_fullsized":"2023-10-06T01:21:40.825009+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:21:36.268170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:21:36.268170+0000","last_clean_scrub_stamp":"2023-10-06T01:21:36.268170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:25:14.997580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T01:21:40.830312+0000","last_change":"2023-10-06T01:21:36.830638+0000","last_active":"2023-10-06T01:21:40.830312+0000","last_peered":"2023-10-06T01:21:40.830312+0000","last_clean":"2023-10-06T01:21:40.830312+0000","last_became_active":"2023-10-06T01:21:36.830451+0000","last_became_peered":"2023-10-06T01:21:36.830451+0000","last_unstale":"2023-10-06T01:21:40.830312+0000","last_undegraded":"2023-10-06T01:21:40.830312+0000","last_fullsized":"2023-10-06T01:21:40.830312+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:21:36.268170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:21:36.268170+0000","last_clean_scrub_stamp":"2023-10-06T01:21:36.268170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:26:27.490800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T01:21:40.845528+0000","last_change":"2023-10-06T01:21:40.841583+0000","last_active":"2023-10-06T01:21:40.845528+0000","last_peered":"2023-10-06T01:21:40.845528+0000","last_clean":"2023-10-06T01:21:40.845528+0000","last_became_active":"2023-10-06T01:21:40.841186+0000","last_became_peered":"2023-10-06T01:21:40.841186+0000","last_unstale":"2023-10-06T01:21:40.845528+0000","last_undegraded":"2023-10-06T01:21:40.845528+0000","last_fullsized":"2023-10-06T01:21:40.845528+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:21:39.809888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:21:39.809888+0000","last_clean_scrub_stamp":"2023-10-06T01:21:39.809888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:32:16.087643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,2,0],"acting":[4,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1a","version":"20'1","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T01:21:40.824542+0000","last_change":"2023-10-06T01:21:36.304872+0000","last_active":"2023-10-06T01:21:40.824542+0000","last_peered":"2023-10-06T01:21:40.824542+0000","last_clean":"2023-10-06T01:21:40.824542+0000","last_became_active":"2023-10-06T01:21:36.304341+0000","last_became_peered":"2023-10-06T01:21:36.304341+0000","last_unstale":"2023-10-06T01:21:40.824542+0000","last_undegraded":"2023-10-06T01:21:40.824542+0000","last_fullsized":"2023-10-06T01:21:40.824542+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:21:35.260777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:21:35.260777+0000","last_clean_scrub_stamp":"2023-10-06T01:21:35.260777+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:30:20.955423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T01:21:40.824330+0000","last_change":"2023-10-06T01:21:36.829886+0000","last_active":"2023-10-06T01:21:40.824330+0000","last_peered":"2023-10-06T01:21:40.824330+0000","last_clean":"2023-10-06T01:21:40.824330+0000","last_became_active":"2023-10-06T01:21:36.829585+0000","last_became_peered":"2023-10-06T01:21:36.829585+0000","last_unstale":"2023-10-06T01:21:40.824330+0000","last_undegraded":"2023-10-06T01:21:40.824330+0000","last_fullsized":"2023-10-06T01:21:40.824330+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:21:36.268170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:21:36.268170+0000","last_clean_scrub_stamp":"2023-10-06T01:21:36.268170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:51:16.522318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T01:21:40.844382+0000","last_change":"2023-10-06T01:21:40.837198+0000","last_active":"2023-10-06T01:21:40.844382+0000","last_peered":"2023-10-06T01:21:40.844382+0000","last_clean":"2023-10-06T01:21:40.844382+0000","last_became_active":"2023-10-06T01:21:40.836811+0000","last_became_peered":"2023-10-06T01:21:40.836811+0000","last_unstale":"2023-10-06T01:21:40.844382+0000","last_undegraded":"2023-10-06T01:21:40.844382+0000","last_fullsized":"2023-10-06T01:21:40.844382+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:21:39.809888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:21:39.809888+0000","last_clean_scrub_stamp":"2023-10-06T01:21:39.809888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:48:17.365413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,3,7],"acting":[6,4,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T01:21:40.826208+0000","last_change":"2023-10-06T01:21:36.306212+0000","last_active":"2023-10-06T01:21:40.826208+0000","last_peered":"2023-10-06T01:21:40.826208+0000","last_clean":"2023-10-06T01:21:40.826208+0000","last_became_active":"2023-10-06T01:21:36.305708+0000","last_became_peered":"2023-10-06T01:21:36.305708+0000","last_unstale":"2023-10-06T01:21:40.826208+0000","last_undegraded":"2023-10-06T01:21:40.826208+0000","last_fullsized":"2023-10-06T01:21:40.826208+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:21:35.260777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:21:35.260777+0000","last_clean_scrub_stamp":"2023-10-06T01:21:35.260777+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:30:20.955423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T01:21:40.842466+0000","last_change":"2023-10-06T01:21:36.835259+0000","last_active":"2023-10-06T01:21:40.842466+0000","last_peered":"2023-10-06T01:21:40.842466+0000","last_clean":"2023-10-06T01:21:40.842466+0000","last_became_active":"2023-10-06T01:21:36.834601+0000","last_became_peered":"2023-10-06T01:21:36.834601+0000","last_unstale":"2023-10-06T01:21:40.842466+0000","last_undegraded":"2023-10-06T01:21:40.842466+0000","last_fullsized":"2023-10-06T01:21:40.842466+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:21:36.268170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:21:36.268170+0000","last_clean_scrub_stamp":"2023-10-06T01:21:36.268170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:26:27.490800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T01:21:40.861034+0000","last_change":"2023-10-06T01:21:40.859811+0000","last_active":"2023-10-06T01:21:40.861034+0000","last_peered":"2023-10-06T01:21:40.861034+0000","last_clean":"2023-10-06T01:21:40.861034+0000","last_became_active":"2023-10-06T01:21:40.859403+0000","last_became_peered":"2023-10-06T01:21:40.859403+0000","last_unstale":"2023-10-06T01:21:40.861034+0000","last_undegraded":"2023-10-06T01:21:40.861034+0000","last_fullsized":"2023-10-06T01:21:40.861034+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:21:39.809888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:21:39.809888+0000","last_clean_scrub_stamp":"2023-10-06T01:21:39.809888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:57:11.609623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,1,2],"acting":[0,7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T01:21:40.825496+0000","last_change":"2023-10-06T01:21:36.293850+0000","last_active":"2023-10-06T01:21:40.825496+0000","last_peered":"2023-10-06T01:21:40.825496+0000","last_clean":"2023-10-06T01:21:40.825496+0000","last_became_active":"2023-10-06T01:21:36.293488+0000","last_became_peered":"2023-10-06T01:21:36.293488+0000","last_unstale":"2023-10-06T01:21:40.825496+0000","last_undegraded":"2023-10-06T01:21:40.825496+0000","last_fullsized":"2023-10-06T01:21:40.825496+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:21:35.260777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:21:35.260777+0000","last_clean_scrub_stamp":"2023-10-06T01:21:35.260777+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:03:02.138728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T01:21:40.821094+0000","last_change":"2023-10-06T01:21:36.828340+0000","last_active":"2023-10-06T01:21:40.821094+0000","last_peered":"2023-10-06T01:21:40.821094+0000","last_clean":"2023-10-06T01:21:40.821094+0000","last_became_active":"2023-10-06T01:21:36.827891+0000","last_became_peered":"2023-10-06T01:21:36.827891+0000","last_unstale":"2023-10-06T01:21:40.821094+0000","last_undegraded":"2023-10-06T01:21:40.821094+0000","last_fullsized":"2023-10-06T01:21:40.821094+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:21:36.268170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:21:36.268170+0000","last_clean_scrub_stamp":"2023-10-06T01:21:36.268170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:12:59.424963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T01:21:40.844982+0000","last_change":"2023-10-06T01:21:40.837490+0000","last_active":"2023-10-06T01:21:40.844982+0000","last_peered":"2023-10-06T01:21:40.844982+0000","last_clean":"2023-10-06T01:21:40.844982+0000","last_became_active":"2023-10-06T01:21:40.836992+0000","last_became_peered":"2023-10-06T01:21:40.836992+0000","last_unstale":"2023-10-06T01:21:40.844982+0000","last_undegraded":"2023-10-06T01:21:40.844982+0000","last_fullsized":"2023-10-06T01:21:40.844982+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:21:39.809888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:21:39.809888+0000","last_clean_scrub_stamp":"2023-10-06T01:21:39.809888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:08:18.408639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7,1],"acting":[6,4,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T01:21:40.843338+0000","last_change":"2023-10-06T01:21:36.299763+0000","last_active":"2023-10-06T01:21:40.843338+0000","last_peered":"2023-10-06T01:21:40.843338+0000","last_clean":"2023-10-06T01:21:40.843338+0000","last_became_active":"2023-10-06T01:21:36.299294+0000","last_became_peered":"2023-10-06T01:21:36.299294+0000","last_unstale":"2023-10-06T01:21:40.843338+0000","last_undegraded":"2023-10-06T01:21:40.843338+0000","last_fullsized":"2023-10-06T01:21:40.843338+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:21:35.260777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:21:35.260777+0000","last_clean_scrub_stamp":"2023-10-06T01:21:35.260777+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:48:42.234958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T01:21:40.825416+0000","last_change":"2023-10-06T01:21:36.827009+0000","last_active":"2023-10-06T01:21:40.825416+0000","last_peered":"2023-10-06T01:21:40.825416+0000","last_clean":"2023-10-06T01:21:40.825416+0000","last_became_active":"2023-10-06T01:21:36.826543+0000","last_became_peered":"2023-10-06T01:21:36.826543+0000","last_unstale":"2023-10-06T01:21:40.825416+0000","last_undegraded":"2023-10-06T01:21:40.825416+0000","last_fullsized":"2023-10-06T01:21:40.825416+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:21:36.268170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:21:36.268170+0000","last_clean_scrub_stamp":"2023-10-06T01:21:36.268170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:21:06.849534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T01:21:40.852806+0000","last_change":"2023-10-06T01:21:40.847656+0000","last_active":"2023-10-06T01:21:40.852806+0000","last_peered":"2023-10-06T01:21:40.852806+0000","last_clean":"2023-10-06T01:21:40.852806+0000","last_became_active":"2023-10-06T01:21:40.847177+0000","last_became_peered":"2023-10-06T01:21:40.847177+0000","last_unstale":"2023-10-06T01:21:40.852806+0000","last_undegraded":"2023-10-06T01:21:40.852806+0000","last_fullsized":"2023-10-06T01:21:40.852806+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:21:39.809888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:21:39.809888+0000","last_clean_scrub_stamp":"2023-10-06T01:21:39.809888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:57:11.609623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6,0],"acting":[7,4,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T01:21:40.830754+0000","last_change":"2023-10-06T01:21:36.296695+0000","last_active":"2023-10-06T01:21:40.830754+0000","last_peered":"2023-10-06T01:21:40.830754+0000","last_clean":"2023-10-06T01:21:40.830754+0000","last_became_active":"2023-10-06T01:21:36.296338+0000","last_became_peered":"2023-10-06T01:21:36.296338+0000","last_unstale":"2023-10-06T01:21:40.830754+0000","last_undegraded":"2023-10-06T01:21:40.830754+0000","last_fullsized":"2023-10-06T01:21:40.830754+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:21:35.260777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:21:35.260777+0000","last_clean_scrub_stamp":"2023-10-06T01:21:35.260777+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:13:12.787972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T01:21:40.823710+0000","last_change":"2023-10-06T01:21:36.830617+0000","last_active":"2023-10-06T01:21:40.823710+0000","last_peered":"2023-10-06T01:21:40.823710+0000","last_clean":"2023-10-06T01:21:40.823710+0000","last_became_active":"2023-10-06T01:21:36.830336+0000","last_became_peered":"2023-10-06T01:21:36.830336+0000","last_unstale":"2023-10-06T01:21:40.823710+0000","last_undegraded":"2023-10-06T01:21:40.823710+0000","last_fullsized":"2023-10-06T01:21:40.823710+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:21:36.268170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:21:36.268170+0000","last_clean_scrub_stamp":"2023-10-06T01:21:36.268170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:48:35.151895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T01:21:40.860402+0000","last_change":"2023-10-06T01:21:40.848992+0000","last_active":"2023-10-06T01:21:40.860402+0000","last_peered":"2023-10-06T01:21:40.860402+0000","last_clean":"2023-10-06T01:21:40.860402+0000","last_became_active":"2023-10-06T01:21:40.848631+0000","last_became_peered":"2023-10-06T01:21:40.848631+0000","last_unstale":"2023-10-06T01:21:40.860402+0000","last_undegraded":"2023-10-06T01:21:40.860402+0000","last_fullsized":"2023-10-06T01:21:40.860402+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:21:39.809888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:21:39.809888+0000","last_clean_scrub_stamp":"2023-10-06T01:21:39.809888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:11:30.651756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,5],"acting":[3,0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"20'3","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T01:21:40.831260+0000","last_change":"2023-10-06T01:21:36.302987+0000","last_active":"2023-10-06T01:21:40.831260+0000","last_peered":"2023-10-06T01:21:40.831260+0000","last_clean":"2023-10-06T01:21:40.831260+0000","last_became_active":"2023-10-06T01:21:36.302712+0000","last_became_peered":"2023-10-06T01:21:36.302712+0000","last_unstale":"2023-10-06T01:21:40.831260+0000","last_undegraded":"2023-10-06T01:21:40.831260+0000","last_fullsized":"2023-10-06T01:21:40.831260+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:21:35.260777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:21:35.260777+0000","last_clean_scrub_stamp":"2023-10-06T01:21:35.260777+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:47:04.154399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T01:21:40.825424+0000","last_change":"2023-10-06T01:21:36.829217+0000","last_active":"2023-10-06T01:21:40.825424+0000","last_peered":"2023-10-06T01:21:40.825424+0000","last_clean":"2023-10-06T01:21:40.825424+0000","last_became_active":"2023-10-06T01:21:36.828005+0000","last_became_peered":"2023-10-06T01:21:36.828005+0000","last_unstale":"2023-10-06T01:21:40.825424+0000","last_undegraded":"2023-10-06T01:21:40.825424+0000","last_fullsized":"2023-10-06T01:21:40.825424+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:21:36.268170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:21:36.268170+0000","last_clean_scrub_stamp":"2023-10-06T01:21:36.268170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:12:59.424963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T01:21:40.844125+0000","last_change":"2023-10-06T01:21:40.838989+0000","last_active":"2023-10-06T01:21:40.844125+0000","last_peered":"2023-10-06T01:21:40.844125+0000","last_clean":"2023-10-06T01:21:40.844125+0000","last_became_active":"2023-10-06T01:21:40.837659+0000","last_became_peered":"2023-10-06T01:21:40.837659+0000","last_unstale":"2023-10-06T01:21:40.844125+0000","last_undegraded":"2023-10-06T01:21:40.844125+0000","last_fullsized":"2023-10-06T01:21:40.844125+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:21:39.809888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:21:39.809888+0000","last_clean_scrub_stamp":"2023-10-06T01:21:39.809888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:39:50.108444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,3,7],"acting":[1,5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"25'9","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-06T01:21:49.958650+0000","last_change":"2023-10-06T01:21:36.301140+0000","last_active":"2023-10-06T01:21:49.958650+0000","last_peered":"2023-10-06T01:21:49.958650+0000","last_clean":"2023-10-06T01:21:49.958650+0000","last_became_active":"2023-10-06T01:21:36.296099+0000","last_became_peered":"2023-10-06T01:21:36.296099+0000","last_unstale":"2023-10-06T01:21:49.958650+0000","last_undegraded":"2023-10-06T01:21:49.958650+0000","last_fullsized":"2023-10-06T01:21:49.958650+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:21:35.260777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:21:35.260777+0000","last_clean_scrub_stamp":"2023-10-06T01:21:35.260777+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:03:02.138728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3714,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T01:21:40.826661+0000","last_change":"2023-10-06T01:21:36.842618+0000","last_active":"2023-10-06T01:21:40.826661+0000","last_peered":"2023-10-06T01:21:40.826661+0000","last_clean":"2023-10-06T01:21:40.826661+0000","last_became_active":"2023-10-06T01:21:36.842343+0000","last_became_peered":"2023-10-06T01:21:36.842343+0000","last_unstale":"2023-10-06T01:21:40.826661+0000","last_undegraded":"2023-10-06T01:21:40.826661+0000","last_fullsized":"2023-10-06T01:21:40.826661+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:21:36.268170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:21:36.268170+0000","last_clean_scrub_stamp":"2023-10-06T01:21:36.268170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:21:33.868021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T01:21:40.851721+0000","last_change":"2023-10-06T01:21:40.849230+0000","last_active":"2023-10-06T01:21:40.851721+0000","last_peered":"2023-10-06T01:21:40.851721+0000","last_clean":"2023-10-06T01:21:40.851721+0000","last_became_active":"2023-10-06T01:21:40.848850+0000","last_became_peered":"2023-10-06T01:21:40.848850+0000","last_unstale":"2023-10-06T01:21:40.851721+0000","last_undegraded":"2023-10-06T01:21:40.851721+0000","last_fullsized":"2023-10-06T01:21:40.851721+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:21:39.809888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:21:39.809888+0000","last_clean_scrub_stamp":"2023-10-06T01:21:39.809888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:31:58.220361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,3,0],"acting":[5,1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"20'2","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T01:21:40.830178+0000","last_change":"2023-10-06T01:21:36.307193+0000","last_active":"2023-10-06T01:21:40.830178+0000","last_peered":"2023-10-06T01:21:40.830178+0000","last_clean":"2023-10-06T01:21:40.830178+0000","last_became_active":"2023-10-06T01:21:36.306908+0000","last_became_peered":"2023-10-06T01:21:36.306908+0000","last_unstale":"2023-10-06T01:21:40.830178+0000","last_undegraded":"2023-10-06T01:21:40.830178+0000","last_fullsized":"2023-10-06T01:21:40.830178+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:21:35.260777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:21:35.260777+0000","last_clean_scrub_stamp":"2023-10-06T01:21:35.260777+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:38:59.100770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T01:21:40.823389+0000","last_change":"2023-10-06T01:21:36.826306+0000","last_active":"2023-10-06T01:21:40.823389+0000","last_peered":"2023-10-06T01:21:40.823389+0000","last_clean":"2023-10-06T01:21:40.823389+0000","last_became_active":"2023-10-06T01:21:36.826052+0000","last_became_peered":"2023-10-06T01:21:36.826052+0000","last_unstale":"2023-10-06T01:21:40.823389+0000","last_undegraded":"2023-10-06T01:21:40.823389+0000","last_fullsized":"2023-10-06T01:21:40.823389+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:21:36.268170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:21:36.268170+0000","last_clean_scrub_stamp":"2023-10-06T01:21:36.268170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:30:56.051770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T01:21:40.848294+0000","last_change":"2023-10-06T01:21:40.843226+0000","last_active":"2023-10-06T01:21:40.848294+0000","last_peered":"2023-10-06T01:21:40.848294+0000","last_clean":"2023-10-06T01:21:40.848294+0000","last_became_active":"2023-10-06T01:21:40.841607+0000","last_became_peered":"2023-10-06T01:21:40.841607+0000","last_unstale":"2023-10-06T01:21:40.848294+0000","last_undegraded":"2023-10-06T01:21:40.848294+0000","last_fullsized":"2023-10-06T01:21:40.848294+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:21:39.809888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:21:39.809888+0000","last_clean_scrub_stamp":"2023-10-06T01:21:39.809888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:54:53.178521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,2,1],"acting":[3,7,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T01:21:40.842017+0000","last_change":"2023-10-06T01:21:36.301285+0000","last_active":"2023-10-06T01:21:40.842017+0000","last_peered":"2023-10-06T01:21:40.842017+0000","last_clean":"2023-10-06T01:21:40.842017+0000","last_became_active":"2023-10-06T01:21:36.300676+0000","last_became_peered":"2023-10-06T01:21:36.300676+0000","last_unstale":"2023-10-06T01:21:40.842017+0000","last_undegraded":"2023-10-06T01:21:40.842017+0000","last_fullsized":"2023-10-06T01:21:40.842017+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:21:35.260777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:21:35.260777+0000","last_clean_scrub_stamp":"2023-10-06T01:21:35.260777+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:13:12.787972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T01:21:40.830219+0000","last_change":"2023-10-06T01:21:36.826226+0000","last_active":"2023-10-06T01:21:40.830219+0000","last_peered":"2023-10-06T01:21:40.830219+0000","last_clean":"2023-10-06T01:21:40.830219+0000","last_became_active":"2023-10-06T01:21:36.825921+0000","last_became_peered":"2023-10-06T01:21:36.825921+0000","last_unstale":"2023-10-06T01:21:40.830219+0000","last_undegraded":"2023-10-06T01:21:40.830219+0000","last_fullsized":"2023-10-06T01:21:40.830219+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:21:36.268170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:21:36.268170+0000","last_clean_scrub_stamp":"2023-10-06T01:21:36.268170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:01:50.180814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T01:21:40.859960+0000","last_change":"2023-10-06T01:21:40.845788+0000","last_active":"2023-10-06T01:21:40.859960+0000","last_peered":"2023-10-06T01:21:40.859960+0000","last_clean":"2023-10-06T01:21:40.859960+0000","last_became_active":"2023-10-06T01:21:40.845410+0000","last_became_peered":"2023-10-06T01:21:40.845410+0000","last_unstale":"2023-10-06T01:21:40.859960+0000","last_undegraded":"2023-10-06T01:21:40.859960+0000","last_fullsized":"2023-10-06T01:21:40.859960+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:21:39.809888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:21:39.809888+0000","last_clean_scrub_stamp":"2023-10-06T01:21:39.809888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:35:36.949771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,0],"acting":[3,1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T01:21:40.829873+0000","last_change":"2023-10-06T01:21:36.307137+0000","last_active":"2023-10-06T01:21:40.829873+0000","last_peered":"2023-10-06T01:21:40.829873+0000","last_clean":"2023-10-06T01:21:40.829873+0000","last_became_active":"2023-10-06T01:21:36.306781+0000","last_became_peered":"2023-10-06T01:21:36.306781+0000","last_unstale":"2023-10-06T01:21:40.829873+0000","last_undegraded":"2023-10-06T01:21:40.829873+0000","last_fullsized":"2023-10-06T01:21:40.829873+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:21:35.260777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:21:35.260777+0000","last_clean_scrub_stamp":"2023-10-06T01:21:35.260777+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:13:12.787972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T01:21:40.842737+0000","last_change":"2023-10-06T01:21:36.838019+0000","last_active":"2023-10-06T01:21:40.842737+0000","last_peered":"2023-10-06T01:21:40.842737+0000","last_clean":"2023-10-06T01:21:40.842737+0000","last_became_active":"2023-10-06T01:21:36.837484+0000","last_became_peered":"2023-10-06T01:21:36.837484+0000","last_unstale":"2023-10-06T01:21:40.842737+0000","last_undegraded":"2023-10-06T01:21:40.842737+0000","last_fullsized":"2023-10-06T01:21:40.842737+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:21:36.268170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:21:36.268170+0000","last_clean_scrub_stamp":"2023-10-06T01:21:36.268170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:26:07.073491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T01:21:40.849782+0000","last_change":"2023-10-06T01:21:40.846902+0000","last_active":"2023-10-06T01:21:40.849782+0000","last_peered":"2023-10-06T01:21:40.849782+0000","last_clean":"2023-10-06T01:21:40.849782+0000","last_became_active":"2023-10-06T01:21:40.846515+0000","last_became_peered":"2023-10-06T01:21:40.846515+0000","last_unstale":"2023-10-06T01:21:40.849782+0000","last_undegraded":"2023-10-06T01:21:40.849782+0000","last_fullsized":"2023-10-06T01:21:40.849782+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:21:39.809888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:21:39.809888+0000","last_clean_scrub_stamp":"2023-10-06T01:21:39.809888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:17:23.971056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,1,6],"acting":[5,3,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"20'8","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T01:21:40.820366+0000","last_change":"2023-10-06T01:21:36.314508+0000","last_active":"2023-10-06T01:21:40.820366+0000","last_peered":"2023-10-06T01:21:40.820366+0000","last_clean":"2023-10-06T01:21:40.820366+0000","last_became_active":"2023-10-06T01:21:36.314195+0000","last_became_peered":"2023-10-06T01:21:36.314195+0000","last_unstale":"2023-10-06T01:21:40.820366+0000","last_undegraded":"2023-10-06T01:21:40.820366+0000","last_fullsized":"2023-10-06T01:21:40.820366+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:21:35.260777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:21:35.260777+0000","last_clean_scrub_stamp":"2023-10-06T01:21:35.260777+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:54:55.305083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T01:21:40.824505+0000","last_change":"2023-10-06T01:21:36.831875+0000","last_active":"2023-10-06T01:21:40.824505+0000","last_peered":"2023-10-06T01:21:40.824505+0000","last_clean":"2023-10-06T01:21:40.824505+0000","last_became_active":"2023-10-06T01:21:36.831328+0000","last_became_peered":"2023-10-06T01:21:36.831328+0000","last_unstale":"2023-10-06T01:21:40.824505+0000","last_undegraded":"2023-10-06T01:21:40.824505+0000","last_fullsized":"2023-10-06T01:21:40.824505+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:21:36.268170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:21:36.268170+0000","last_clean_scrub_stamp":"2023-10-06T01:21:36.268170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:03:40.763134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T01:21:40.851310+0000","last_change":"2023-10-06T01:21:40.846661+0000","last_active":"2023-10-06T01:21:40.851310+0000","last_peered":"2023-10-06T01:21:40.851310+0000","last_clean":"2023-10-06T01:21:40.851310+0000","last_became_active":"2023-10-06T01:21:40.845846+0000","last_became_peered":"2023-10-06T01:21:40.845846+0000","last_unstale":"2023-10-06T01:21:40.851310+0000","last_undegraded":"2023-10-06T01:21:40.851310+0000","last_fullsized":"2023-10-06T01:21:40.851310+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:21:39.809888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:21:39.809888+0000","last_clean_scrub_stamp":"2023-10-06T01:21:39.809888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:26:15.414115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,3,4],"acting":[7,6,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.f","version":"20'1","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T01:21:40.831539+0000","last_change":"2023-10-06T01:21:36.307931+0000","last_active":"2023-10-06T01:21:40.831539+0000","last_peered":"2023-10-06T01:21:40.831539+0000","last_clean":"2023-10-06T01:21:40.831539+0000","last_became_active":"2023-10-06T01:21:36.307539+0000","last_became_peered":"2023-10-06T01:21:36.307539+0000","last_unstale":"2023-10-06T01:21:40.831539+0000","last_undegraded":"2023-10-06T01:21:40.831539+0000","last_fullsized":"2023-10-06T01:21:40.831539+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:21:35.260777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:21:35.260777+0000","last_clean_scrub_stamp":"2023-10-06T01:21:35.260777+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:28:28.246900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T01:21:40.827851+0000","last_change":"2023-10-06T01:21:36.824841+0000","last_active":"2023-10-06T01:21:40.827851+0000","last_peered":"2023-10-06T01:21:40.827851+0000","last_clean":"2023-10-06T01:21:40.827851+0000","last_became_active":"2023-10-06T01:21:36.824575+0000","last_became_peered":"2023-10-06T01:21:36.824575+0000","last_unstale":"2023-10-06T01:21:40.827851+0000","last_undegraded":"2023-10-06T01:21:40.827851+0000","last_fullsized":"2023-10-06T01:21:40.827851+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:21:36.268170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:21:36.268170+0000","last_clean_scrub_stamp":"2023-10-06T01:21:36.268170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:27:54.680295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T01:21:40.850673+0000","last_change":"2023-10-06T01:21:40.844715+0000","last_active":"2023-10-06T01:21:40.850673+0000","last_peered":"2023-10-06T01:21:40.850673+0000","last_clean":"2023-10-06T01:21:40.850673+0000","last_became_active":"2023-10-06T01:21:40.843713+0000","last_became_peered":"2023-10-06T01:21:40.843713+0000","last_unstale":"2023-10-06T01:21:40.850673+0000","last_undegraded":"2023-10-06T01:21:40.850673+0000","last_fullsized":"2023-10-06T01:21:40.850673+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:21:39.809888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:21:39.809888+0000","last_clean_scrub_stamp":"2023-10-06T01:21:39.809888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:59:32.714013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,5],"acting":[2,0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"20'2","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T01:21:40.831428+0000","last_change":"2023-10-06T01:21:36.307165+0000","last_active":"2023-10-06T01:21:40.831428+0000","last_peered":"2023-10-06T01:21:40.831428+0000","last_clean":"2023-10-06T01:21:40.831428+0000","last_became_active":"2023-10-06T01:21:36.306877+0000","last_became_peered":"2023-10-06T01:21:36.306877+0000","last_unstale":"2023-10-06T01:21:40.831428+0000","last_undegraded":"2023-10-06T01:21:40.831428+0000","last_fullsized":"2023-10-06T01:21:40.831428+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:21:35.260777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:21:35.260777+0000","last_clean_scrub_stamp":"2023-10-06T01:21:35.260777+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:38:56.761956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T01:21:40.827687+0000","last_change":"2023-10-06T01:21:36.840414+0000","last_active":"2023-10-06T01:21:40.827687+0000","last_peered":"2023-10-06T01:21:40.827687+0000","last_clean":"2023-10-06T01:21:40.827687+0000","last_became_active":"2023-10-06T01:21:36.840067+0000","last_became_peered":"2023-10-06T01:21:36.840067+0000","last_unstale":"2023-10-06T01:21:40.827687+0000","last_undegraded":"2023-10-06T01:21:40.827687+0000","last_fullsized":"2023-10-06T01:21:40.827687+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:21:36.268170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:21:36.268170+0000","last_clean_scrub_stamp":"2023-10-06T01:21:36.268170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:48:18.526486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T01:21:40.849984+0000","last_change":"2023-10-06T01:21:40.841506+0000","last_active":"2023-10-06T01:21:40.849984+0000","last_peered":"2023-10-06T01:21:40.849984+0000","last_clean":"2023-10-06T01:21:40.849984+0000","last_became_active":"2023-10-06T01:21:40.840966+0000","last_became_peered":"2023-10-06T01:21:40.840966+0000","last_unstale":"2023-10-06T01:21:40.849984+0000","last_undegraded":"2023-10-06T01:21:40.849984+0000","last_fullsized":"2023-10-06T01:21:40.849984+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:21:39.809888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:21:39.809888+0000","last_clean_scrub_stamp":"2023-10-06T01:21:39.809888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:48:17.365413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5,6],"acting":[2,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"20'1","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T01:21:40.831177+0000","last_change":"2023-10-06T01:21:36.296492+0000","last_active":"2023-10-06T01:21:40.831177+0000","last_peered":"2023-10-06T01:21:40.831177+0000","last_clean":"2023-10-06T01:21:40.831177+0000","last_became_active":"2023-10-06T01:21:36.296064+0000","last_became_peered":"2023-10-06T01:21:36.296064+0000","last_unstale":"2023-10-06T01:21:40.831177+0000","last_undegraded":"2023-10-06T01:21:40.831177+0000","last_fullsized":"2023-10-06T01:21:40.831177+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:21:35.260777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:21:35.260777+0000","last_clean_scrub_stamp":"2023-10-06T01:21:35.260777+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:53:26.082920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T01:21:40.820682+0000","last_change":"2023-10-06T01:21:36.833212+0000","last_active":"2023-10-06T01:21:40.820682+0000","last_peered":"2023-10-06T01:21:40.820682+0000","last_clean":"2023-10-06T01:21:40.820682+0000","last_became_active":"2023-10-06T01:21:36.832753+0000","last_became_peered":"2023-10-06T01:21:36.832753+0000","last_unstale":"2023-10-06T01:21:40.820682+0000","last_undegraded":"2023-10-06T01:21:40.820682+0000","last_fullsized":"2023-10-06T01:21:40.820682+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:21:36.268170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:21:36.268170+0000","last_clean_scrub_stamp":"2023-10-06T01:21:36.268170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:47:05.161793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T01:21:40.839046+0000","last_change":"2023-10-06T01:21:40.837287+0000","last_active":"2023-10-06T01:21:40.839046+0000","last_peered":"2023-10-06T01:21:40.839046+0000","last_clean":"2023-10-06T01:21:40.839046+0000","last_became_active":"2023-10-06T01:21:40.836599+0000","last_became_peered":"2023-10-06T01:21:40.836599+0000","last_unstale":"2023-10-06T01:21:40.839046+0000","last_undegraded":"2023-10-06T01:21:40.839046+0000","last_fullsized":"2023-10-06T01:21:40.839046+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:21:39.809888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:21:39.809888+0000","last_clean_scrub_stamp":"2023-10-06T01:21:39.809888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:51:20.064036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3,6],"acting":[2,4,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T01:21:40.829807+0000","last_change":"2023-10-06T01:21:36.304239+0000","last_active":"2023-10-06T01:21:40.829807+0000","last_peered":"2023-10-06T01:21:40.829807+0000","last_clean":"2023-10-06T01:21:40.829807+0000","last_became_active":"2023-10-06T01:21:36.303858+0000","last_became_peered":"2023-10-06T01:21:36.303858+0000","last_unstale":"2023-10-06T01:21:40.829807+0000","last_undegraded":"2023-10-06T01:21:40.829807+0000","last_fullsized":"2023-10-06T01:21:40.829807+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:21:35.260777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:21:35.260777+0000","last_clean_scrub_stamp":"2023-10-06T01:21:35.260777+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:54:55.305083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T01:21:40.844788+0000","last_change":"2023-10-06T01:21:36.835234+0000","last_active":"2023-10-06T01:21:40.844788+0000","last_peered":"2023-10-06T01:21:40.844788+0000","last_clean":"2023-10-06T01:21:40.844788+0000","last_became_active":"2023-10-06T01:21:36.834751+0000","last_became_peered":"2023-10-06T01:21:36.834751+0000","last_unstale":"2023-10-06T01:21:40.844788+0000","last_undegraded":"2023-10-06T01:21:40.844788+0000","last_fullsized":"2023-10-06T01:21:40.844788+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:21:36.268170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:21:36.268170+0000","last_clean_scrub_stamp":"2023-10-06T01:21:36.268170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:22:57.339224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T01:21:40.848598+0000","last_change":"2023-10-06T01:21:40.839486+0000","last_active":"2023-10-06T01:21:40.848598+0000","last_peered":"2023-10-06T01:21:40.848598+0000","last_clean":"2023-10-06T01:21:40.848598+0000","last_became_active":"2023-10-06T01:21:40.839013+0000","last_became_peered":"2023-10-06T01:21:40.839013+0000","last_unstale":"2023-10-06T01:21:40.848598+0000","last_undegraded":"2023-10-06T01:21:40.848598+0000","last_fullsized":"2023-10-06T01:21:40.848598+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:21:39.809888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:21:39.809888+0000","last_clean_scrub_stamp":"2023-10-06T01:21:39.809888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:44:19.565910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,5,6],"acting":[2,7,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"20'2","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T01:21:40.825787+0000","last_change":"2023-10-06T01:21:36.302862+0000","last_active":"2023-10-06T01:21:40.825787+0000","last_peered":"2023-10-06T01:21:40.825787+0000","last_clean":"2023-10-06T01:21:40.825787+0000","last_became_active":"2023-10-06T01:21:36.302568+0000","last_became_peered":"2023-10-06T01:21:36.302568+0000","last_unstale":"2023-10-06T01:21:40.825787+0000","last_undegraded":"2023-10-06T01:21:40.825787+0000","last_fullsized":"2023-10-06T01:21:40.825787+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:21:35.260777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:21:35.260777+0000","last_clean_scrub_stamp":"2023-10-06T01:21:35.260777+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:54:55.305083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T01:21:40.825801+0000","last_change":"2023-10-06T01:21:36.840041+0000","last_active":"2023-10-06T01:21:40.825801+0000","last_peered":"2023-10-06T01:21:40.825801+0000","last_clean":"2023-10-06T01:21:40.825801+0000","last_became_active":"2023-10-06T01:21:36.839757+0000","last_became_peered":"2023-10-06T01:21:36.839757+0000","last_unstale":"2023-10-06T01:21:40.825801+0000","last_undegraded":"2023-10-06T01:21:40.825801+0000","last_fullsized":"2023-10-06T01:21:40.825801+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:21:36.268170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:21:36.268170+0000","last_clean_scrub_stamp":"2023-10-06T01:21:36.268170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:32:46.966379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T01:21:40.858246+0000","last_change":"2023-10-06T01:21:40.855180+0000","last_active":"2023-10-06T01:21:40.858246+0000","last_peered":"2023-10-06T01:21:40.858246+0000","last_clean":"2023-10-06T01:21:40.858246+0000","last_became_active":"2023-10-06T01:21:40.854696+0000","last_became_peered":"2023-10-06T01:21:40.854696+0000","last_unstale":"2023-10-06T01:21:40.858246+0000","last_undegraded":"2023-10-06T01:21:40.858246+0000","last_fullsized":"2023-10-06T01:21:40.858246+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:21:39.809888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:21:39.809888+0000","last_clean_scrub_stamp":"2023-10-06T01:21:39.809888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:17:23.971056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0,6],"acting":[1,4,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T01:21:40.820767+0000","last_change":"2023-10-06T01:21:36.305613+0000","last_active":"2023-10-06T01:21:40.820767+0000","last_peered":"2023-10-06T01:21:40.820767+0000","last_clean":"2023-10-06T01:21:40.820767+0000","last_became_active":"2023-10-06T01:21:36.305297+0000","last_became_peered":"2023-10-06T01:21:36.305297+0000","last_unstale":"2023-10-06T01:21:40.820767+0000","last_undegraded":"2023-10-06T01:21:40.820767+0000","last_fullsized":"2023-10-06T01:21:40.820767+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:21:35.260777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:21:35.260777+0000","last_clean_scrub_stamp":"2023-10-06T01:21:35.260777+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:03:02.138728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T01:21:40.825239+0000","last_change":"2023-10-06T01:21:36.834711+0000","last_active":"2023-10-06T01:21:40.825239+0000","last_peered":"2023-10-06T01:21:40.825239+0000","last_clean":"2023-10-06T01:21:40.825239+0000","last_became_active":"2023-10-06T01:21:36.833708+0000","last_became_peered":"2023-10-06T01:21:36.833708+0000","last_unstale":"2023-10-06T01:21:40.825239+0000","last_undegraded":"2023-10-06T01:21:40.825239+0000","last_fullsized":"2023-10-06T01:21:40.825239+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:21:36.268170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:21:36.268170+0000","last_clean_scrub_stamp":"2023-10-06T01:21:36.268170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:30:56.051770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T01:21:40.849727+0000","last_change":"2023-10-06T01:21:40.847193+0000","last_active":"2023-10-06T01:21:40.849727+0000","last_peered":"2023-10-06T01:21:40.849727+0000","last_clean":"2023-10-06T01:21:40.849727+0000","last_became_active":"2023-10-06T01:21:40.846404+0000","last_became_peered":"2023-10-06T01:21:40.846404+0000","last_unstale":"2023-10-06T01:21:40.849727+0000","last_undegraded":"2023-10-06T01:21:40.849727+0000","last_fullsized":"2023-10-06T01:21:40.849727+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:21:39.809888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:21:39.809888+0000","last_clean_scrub_stamp":"2023-10-06T01:21:39.809888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:37:36.730320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6,2],"acting":[5,4,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T01:21:40.827525+0000","last_change":"2023-10-06T01:21:36.301030+0000","last_active":"2023-10-06T01:21:40.827525+0000","last_peered":"2023-10-06T01:21:40.827525+0000","last_clean":"2023-10-06T01:21:40.827525+0000","last_became_active":"2023-10-06T01:21:36.300725+0000","last_became_peered":"2023-10-06T01:21:36.300725+0000","last_unstale":"2023-10-06T01:21:40.827525+0000","last_undegraded":"2023-10-06T01:21:40.827525+0000","last_fullsized":"2023-10-06T01:21:40.827525+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:21:35.260777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:21:35.260777+0000","last_clean_scrub_stamp":"2023-10-06T01:21:35.260777+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:33:04.318590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T01:21:40.827164+0000","last_change":"2023-10-06T01:21:36.841950+0000","last_active":"2023-10-06T01:21:40.827164+0000","last_peered":"2023-10-06T01:21:40.827164+0000","last_clean":"2023-10-06T01:21:40.827164+0000","last_became_active":"2023-10-06T01:21:36.841666+0000","last_became_peered":"2023-10-06T01:21:36.841666+0000","last_unstale":"2023-10-06T01:21:40.827164+0000","last_undegraded":"2023-10-06T01:21:40.827164+0000","last_fullsized":"2023-10-06T01:21:40.827164+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:21:36.268170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:21:36.268170+0000","last_clean_scrub_stamp":"2023-10-06T01:21:36.268170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:48:35.151895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T01:21:40.851364+0000","last_change":"2023-10-06T01:21:40.843838+0000","last_active":"2023-10-06T01:21:40.851364+0000","last_peered":"2023-10-06T01:21:40.851364+0000","last_clean":"2023-10-06T01:21:40.851364+0000","last_became_active":"2023-10-06T01:21:40.843470+0000","last_became_peered":"2023-10-06T01:21:40.843470+0000","last_unstale":"2023-10-06T01:21:40.851364+0000","last_undegraded":"2023-10-06T01:21:40.851364+0000","last_fullsized":"2023-10-06T01:21:40.851364+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:21:39.809888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:21:39.809888+0000","last_clean_scrub_stamp":"2023-10-06T01:21:39.809888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:49:27.574363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,0,2],"acting":[4,5,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T01:21:40.825329+0000","last_change":"2023-10-06T01:21:36.306829+0000","last_active":"2023-10-06T01:21:40.825329+0000","last_peered":"2023-10-06T01:21:40.825329+0000","last_clean":"2023-10-06T01:21:40.825329+0000","last_became_active":"2023-10-06T01:21:36.306636+0000","last_became_peered":"2023-10-06T01:21:36.306636+0000","last_unstale":"2023-10-06T01:21:40.825329+0000","last_undegraded":"2023-10-06T01:21:40.825329+0000","last_fullsized":"2023-10-06T01:21:40.825329+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:21:35.260777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:21:35.260777+0000","last_clean_scrub_stamp":"2023-10-06T01:21:35.260777+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:13:12.787972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T01:21:40.825013+0000","last_change":"2023-10-06T01:21:36.827181+0000","last_active":"2023-10-06T01:21:40.825013+0000","last_peered":"2023-10-06T01:21:40.825013+0000","last_clean":"2023-10-06T01:21:40.825013+0000","last_became_active":"2023-10-06T01:21:36.826926+0000","last_became_peered":"2023-10-06T01:21:36.826926+0000","last_unstale":"2023-10-06T01:21:40.825013+0000","last_undegraded":"2023-10-06T01:21:40.825013+0000","last_fullsized":"2023-10-06T01:21:40.825013+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:21:36.268170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:21:36.268170+0000","last_clean_scrub_stamp":"2023-10-06T01:21:36.268170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:50:38.966977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T01:21:40.848984+0000","last_change":"2023-10-06T01:21:40.842824+0000","last_active":"2023-10-06T01:21:40.848984+0000","last_peered":"2023-10-06T01:21:40.848984+0000","last_clean":"2023-10-06T01:21:40.848984+0000","last_became_active":"2023-10-06T01:21:40.842426+0000","last_became_peered":"2023-10-06T01:21:40.842426+0000","last_unstale":"2023-10-06T01:21:40.848984+0000","last_undegraded":"2023-10-06T01:21:40.848984+0000","last_fullsized":"2023-10-06T01:21:40.848984+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:21:39.809888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:21:39.809888+0000","last_clean_scrub_stamp":"2023-10-06T01:21:39.809888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:12:51.722789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,7,0],"acting":[4,3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"20'2","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T01:21:40.824298+0000","last_change":"2023-10-06T01:21:36.302700+0000","last_active":"2023-10-06T01:21:40.824298+0000","last_peered":"2023-10-06T01:21:40.824298+0000","last_clean":"2023-10-06T01:21:40.824298+0000","last_became_active":"2023-10-06T01:21:36.302436+0000","last_became_peered":"2023-10-06T01:21:36.302436+0000","last_unstale":"2023-10-06T01:21:40.824298+0000","last_undegraded":"2023-10-06T01:21:40.824298+0000","last_fullsized":"2023-10-06T01:21:40.824298+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:21:35.260777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:21:35.260777+0000","last_clean_scrub_stamp":"2023-10-06T01:21:35.260777+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:28:28.246900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T01:21:40.825404+0000","last_change":"2023-10-06T01:21:30.601117+0000","last_active":"2023-10-06T01:21:40.825404+0000","last_peered":"2023-10-06T01:21:40.825404+0000","last_clean":"2023-10-06T01:21:40.825404+0000","last_became_active":"2023-10-06T01:21:30.600724+0000","last_became_peered":"2023-10-06T01:21:30.600724+0000","last_unstale":"2023-10-06T01:21:40.825404+0000","last_undegraded":"2023-10-06T01:21:40.825404+0000","last_fullsized":"2023-10-06T01:21:40.825404+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:21:29.586558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:21:29.586558+0000","last_clean_scrub_stamp":"2023-10-06T01:21:29.586558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:47:24.449013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T01:21:40.825234+0000","last_change":"2023-10-06T01:21:36.824653+0000","last_active":"2023-10-06T01:21:40.825234+0000","last_peered":"2023-10-06T01:21:40.825234+0000","last_clean":"2023-10-06T01:21:40.825234+0000","last_became_active":"2023-10-06T01:21:36.824411+0000","last_became_peered":"2023-10-06T01:21:36.824411+0000","last_unstale":"2023-10-06T01:21:40.825234+0000","last_undegraded":"2023-10-06T01:21:40.825234+0000","last_fullsized":"2023-10-06T01:21:40.825234+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:21:36.268170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:21:36.268170+0000","last_clean_scrub_stamp":"2023-10-06T01:21:36.268170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:22:57.339224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T01:21:40.863893+0000","last_change":"2023-10-06T01:21:40.862887+0000","last_active":"2023-10-06T01:21:40.863893+0000","last_peered":"2023-10-06T01:21:40.863893+0000","last_clean":"2023-10-06T01:21:40.863893+0000","last_became_active":"2023-10-06T01:21:40.862455+0000","last_became_peered":"2023-10-06T01:21:40.862455+0000","last_unstale":"2023-10-06T01:21:40.863893+0000","last_undegraded":"2023-10-06T01:21:40.863893+0000","last_fullsized":"2023-10-06T01:21:40.863893+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:21:39.809888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:21:39.809888+0000","last_clean_scrub_stamp":"2023-10-06T01:21:39.809888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:31:58.220361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,0],"acting":[3,1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T01:21:40.823254+0000","last_change":"2023-10-06T01:21:30.603434+0000","last_active":"2023-10-06T01:21:40.823254+0000","last_peered":"2023-10-06T01:21:40.823254+0000","last_clean":"2023-10-06T01:21:40.823254+0000","last_became_active":"2023-10-06T01:21:30.603215+0000","last_became_peered":"2023-10-06T01:21:30.603215+0000","last_unstale":"2023-10-06T01:21:40.823254+0000","last_undegraded":"2023-10-06T01:21:40.823254+0000","last_fullsized":"2023-10-06T01:21:40.823254+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:21:29.586558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:21:29.586558+0000","last_clean_scrub_stamp":"2023-10-06T01:21:29.586558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:47:24.449013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"23'1","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T01:21:40.840164+0000","last_change":"2023-10-06T01:21:36.314457+0000","last_active":"2023-10-06T01:21:40.840164+0000","last_peered":"2023-10-06T01:21:40.840164+0000","last_clean":"2023-10-06T01:21:40.840164+0000","last_became_active":"2023-10-06T01:21:36.314115+0000","last_became_peered":"2023-10-06T01:21:36.314115+0000","last_unstale":"2023-10-06T01:21:40.840164+0000","last_undegraded":"2023-10-06T01:21:40.840164+0000","last_fullsized":"2023-10-06T01:21:40.840164+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:21:35.260777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:21:35.260777+0000","last_clean_scrub_stamp":"2023-10-06T01:21:35.260777+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:54:55.305083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T01:21:40.827608+0000","last_change":"2023-10-06T01:21:36.834738+0000","last_active":"2023-10-06T01:21:40.827608+0000","last_peered":"2023-10-06T01:21:40.827608+0000","last_clean":"2023-10-06T01:21:40.827608+0000","last_became_active":"2023-10-06T01:21:36.830039+0000","last_became_peered":"2023-10-06T01:21:36.830039+0000","last_unstale":"2023-10-06T01:21:40.827608+0000","last_undegraded":"2023-10-06T01:21:40.827608+0000","last_fullsized":"2023-10-06T01:21:40.827608+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:21:36.268170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:21:36.268170+0000","last_clean_scrub_stamp":"2023-10-06T01:21:36.268170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:32:53.580584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T01:21:40.849746+0000","last_change":"2023-10-06T01:21:40.847419+0000","last_active":"2023-10-06T01:21:40.849746+0000","last_peered":"2023-10-06T01:21:40.849746+0000","last_clean":"2023-10-06T01:21:40.849746+0000","last_became_active":"2023-10-06T01:21:40.847033+0000","last_became_peered":"2023-10-06T01:21:40.847033+0000","last_unstale":"2023-10-06T01:21:40.849746+0000","last_undegraded":"2023-10-06T01:21:40.849746+0000","last_fullsized":"2023-10-06T01:21:40.849746+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:21:39.809888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:21:39.809888+0000","last_clean_scrub_stamp":"2023-10-06T01:21:39.809888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:48:34.766396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0,4],"acting":[5,1,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T01:21:40.824624+0000","last_change":"2023-10-06T01:21:30.604889+0000","last_active":"2023-10-06T01:21:40.824624+0000","last_peered":"2023-10-06T01:21:40.824624+0000","last_clean":"2023-10-06T01:21:40.824624+0000","last_became_active":"2023-10-06T01:21:30.604535+0000","last_became_peered":"2023-10-06T01:21:30.604535+0000","last_unstale":"2023-10-06T01:21:40.824624+0000","last_undegraded":"2023-10-06T01:21:40.824624+0000","last_fullsized":"2023-10-06T01:21:40.824624+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:21:29.586558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:21:29.586558+0000","last_clean_scrub_stamp":"2023-10-06T01:21:29.586558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:17:59.434982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"17'117","reported_seq":167,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T01:21:40.832005+0000","last_change":"2023-10-06T01:21:31.602437+0000","last_active":"2023-10-06T01:21:40.832005+0000","last_peered":"2023-10-06T01:21:40.832005+0000","last_clean":"2023-10-06T01:21:40.832005+0000","last_became_active":"2023-10-06T01:21:31.601431+0000","last_became_peered":"2023-10-06T01:21:31.601431+0000","last_unstale":"2023-10-06T01:21:40.832005+0000","last_undegraded":"2023-10-06T01:21:40.832005+0000","last_fullsized":"2023-10-06T01:21:40.832005+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:21:30.589171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:21:30.589171+0000","last_clean_scrub_stamp":"2023-10-06T01:21:30.589171+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T01:48:45.877807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T01:21:40.840247+0000","last_change":"2023-10-06T01:21:36.308132+0000","last_active":"2023-10-06T01:21:40.840247+0000","last_peered":"2023-10-06T01:21:40.840247+0000","last_clean":"2023-10-06T01:21:40.840247+0000","last_became_active":"2023-10-06T01:21:36.307806+0000","last_became_peered":"2023-10-06T01:21:36.307806+0000","last_unstale":"2023-10-06T01:21:40.840247+0000","last_undegraded":"2023-10-06T01:21:40.840247+0000","last_fullsized":"2023-10-06T01:21:40.840247+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:21:35.260777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:21:35.260777+0000","last_clean_scrub_stamp":"2023-10-06T01:21:35.260777+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:48:19.919262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T01:21:40.842645+0000","last_change":"2023-10-06T01:21:36.835445+0000","last_active":"2023-10-06T01:21:40.842645+0000","last_peered":"2023-10-06T01:21:40.842645+0000","last_clean":"2023-10-06T01:21:40.842645+0000","last_became_active":"2023-10-06T01:21:36.834925+0000","last_became_peered":"2023-10-06T01:21:36.834925+0000","last_unstale":"2023-10-06T01:21:40.842645+0000","last_undegraded":"2023-10-06T01:21:40.842645+0000","last_fullsized":"2023-10-06T01:21:40.842645+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:21:36.268170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:21:36.268170+0000","last_clean_scrub_stamp":"2023-10-06T01:21:36.268170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:48:35.151895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T01:21:40.840299+0000","last_change":"2023-10-06T01:21:40.838204+0000","last_active":"2023-10-06T01:21:40.840299+0000","last_peered":"2023-10-06T01:21:40.840299+0000","last_clean":"2023-10-06T01:21:40.840299+0000","last_became_active":"2023-10-06T01:21:40.837815+0000","last_became_peered":"2023-10-06T01:21:40.837815+0000","last_unstale":"2023-10-06T01:21:40.840299+0000","last_undegraded":"2023-10-06T01:21:40.840299+0000","last_fullsized":"2023-10-06T01:21:40.840299+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:21:39.809888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:21:39.809888+0000","last_clean_scrub_stamp":"2023-10-06T01:21:39.809888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:21:10.391252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,1,7],"acting":[2,5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T01:21:40.830958+0000","last_change":"2023-10-06T01:21:31.338236+0000","last_active":"2023-10-06T01:21:40.830958+0000","last_peered":"2023-10-06T01:21:40.830958+0000","last_clean":"2023-10-06T01:21:40.830958+0000","last_became_active":"2023-10-06T01:21:31.337918+0000","last_became_peered":"2023-10-06T01:21:31.337918+0000","last_unstale":"2023-10-06T01:21:40.830958+0000","last_undegraded":"2023-10-06T01:21:40.830958+0000","last_fullsized":"2023-10-06T01:21:40.830958+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:21:29.586558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:21:29.586558+0000","last_clean_scrub_stamp":"2023-10-06T01:21:29.586558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:02:13.010488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T01:21:40.826976+0000","last_change":"2023-10-06T01:21:36.309135+0000","last_active":"2023-10-06T01:21:40.826976+0000","last_peered":"2023-10-06T01:21:40.826976+0000","last_clean":"2023-10-06T01:21:40.826976+0000","last_became_active":"2023-10-06T01:21:36.300992+0000","last_became_peered":"2023-10-06T01:21:36.300992+0000","last_unstale":"2023-10-06T01:21:40.826976+0000","last_undegraded":"2023-10-06T01:21:40.826976+0000","last_fullsized":"2023-10-06T01:21:40.826976+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:21:35.260777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:21:35.260777+0000","last_clean_scrub_stamp":"2023-10-06T01:21:35.260777+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:33:04.318590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T01:21:40.824922+0000","last_change":"2023-10-06T01:21:36.825744+0000","last_active":"2023-10-06T01:21:40.824922+0000","last_peered":"2023-10-06T01:21:40.824922+0000","last_clean":"2023-10-06T01:21:40.824922+0000","last_became_active":"2023-10-06T01:21:36.825474+0000","last_became_peered":"2023-10-06T01:21:36.825474+0000","last_unstale":"2023-10-06T01:21:40.824922+0000","last_undegraded":"2023-10-06T01:21:40.824922+0000","last_fullsized":"2023-10-06T01:21:40.824922+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:21:36.268170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:21:36.268170+0000","last_clean_scrub_stamp":"2023-10-06T01:21:36.268170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:01:50.180814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T01:21:40.842542+0000","last_change":"2023-10-06T01:21:40.839804+0000","last_active":"2023-10-06T01:21:40.842542+0000","last_peered":"2023-10-06T01:21:40.842542+0000","last_clean":"2023-10-06T01:21:40.842542+0000","last_became_active":"2023-10-06T01:21:40.838895+0000","last_became_peered":"2023-10-06T01:21:40.838895+0000","last_unstale":"2023-10-06T01:21:40.842542+0000","last_undegraded":"2023-10-06T01:21:40.842542+0000","last_fullsized":"2023-10-06T01:21:40.842542+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:21:39.809888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:21:39.809888+0000","last_clean_scrub_stamp":"2023-10-06T01:21:39.809888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:37:36.730320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,5,3],"acting":[7,2,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T01:21:40.831878+0000","last_change":"2023-10-06T01:21:31.338209+0000","last_active":"2023-10-06T01:21:40.831878+0000","last_peered":"2023-10-06T01:21:40.831878+0000","last_clean":"2023-10-06T01:21:40.831878+0000","last_became_active":"2023-10-06T01:21:31.337870+0000","last_became_peered":"2023-10-06T01:21:31.337870+0000","last_unstale":"2023-10-06T01:21:40.831878+0000","last_undegraded":"2023-10-06T01:21:40.831878+0000","last_fullsized":"2023-10-06T01:21:40.831878+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:21:29.586558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:21:29.586558+0000","last_clean_scrub_stamp":"2023-10-06T01:21:29.586558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:53:47.117299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T01:21:40.823530+0000","last_change":"2023-10-06T01:21:36.300292+0000","last_active":"2023-10-06T01:21:40.823530+0000","last_peered":"2023-10-06T01:21:40.823530+0000","last_clean":"2023-10-06T01:21:40.823530+0000","last_became_active":"2023-10-06T01:21:36.299999+0000","last_became_peered":"2023-10-06T01:21:36.299999+0000","last_unstale":"2023-10-06T01:21:40.823530+0000","last_undegraded":"2023-10-06T01:21:40.823530+0000","last_fullsized":"2023-10-06T01:21:40.823530+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:21:35.260777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:21:35.260777+0000","last_clean_scrub_stamp":"2023-10-06T01:21:35.260777+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:46:13.974439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T01:21:40.820907+0000","last_change":"2023-10-06T01:21:36.839337+0000","last_active":"2023-10-06T01:21:40.820907+0000","last_peered":"2023-10-06T01:21:40.820907+0000","last_clean":"2023-10-06T01:21:40.820907+0000","last_became_active":"2023-10-06T01:21:36.831706+0000","last_became_peered":"2023-10-06T01:21:36.831706+0000","last_unstale":"2023-10-06T01:21:40.820907+0000","last_undegraded":"2023-10-06T01:21:40.820907+0000","last_fullsized":"2023-10-06T01:21:40.820907+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:21:36.268170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:21:36.268170+0000","last_clean_scrub_stamp":"2023-10-06T01:21:36.268170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:01:50.180814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T01:21:40.861012+0000","last_change":"2023-10-06T01:21:40.858510+0000","last_active":"2023-10-06T01:21:40.861012+0000","last_peered":"2023-10-06T01:21:40.861012+0000","last_clean":"2023-10-06T01:21:40.861012+0000","last_became_active":"2023-10-06T01:21:40.858081+0000","last_became_peered":"2023-10-06T01:21:40.858081+0000","last_unstale":"2023-10-06T01:21:40.861012+0000","last_undegraded":"2023-10-06T01:21:40.861012+0000","last_fullsized":"2023-10-06T01:21:40.861012+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:21:39.809888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:21:39.809888+0000","last_clean_scrub_stamp":"2023-10-06T01:21:39.809888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:37:36.730320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,6],"acting":[0,1,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T01:21:40.829308+0000","last_change":"2023-10-06T01:21:31.338177+0000","last_active":"2023-10-06T01:21:40.829308+0000","last_peered":"2023-10-06T01:21:40.829308+0000","last_clean":"2023-10-06T01:21:40.829308+0000","last_became_active":"2023-10-06T01:21:31.337872+0000","last_became_peered":"2023-10-06T01:21:31.337872+0000","last_unstale":"2023-10-06T01:21:40.829308+0000","last_undegraded":"2023-10-06T01:21:40.829308+0000","last_fullsized":"2023-10-06T01:21:40.829308+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:21:29.586558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:21:29.586558+0000","last_clean_scrub_stamp":"2023-10-06T01:21:29.586558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:17:59.434982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T01:21:40.826747+0000","last_change":"2023-10-06T01:21:36.304934+0000","last_active":"2023-10-06T01:21:40.826747+0000","last_peered":"2023-10-06T01:21:40.826747+0000","last_clean":"2023-10-06T01:21:40.826747+0000","last_became_active":"2023-10-06T01:21:36.304472+0000","last_became_peered":"2023-10-06T01:21:36.304472+0000","last_unstale":"2023-10-06T01:21:40.826747+0000","last_undegraded":"2023-10-06T01:21:40.826747+0000","last_fullsized":"2023-10-06T01:21:40.826747+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:21:35.260777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:21:35.260777+0000","last_clean_scrub_stamp":"2023-10-06T01:21:35.260777+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:54:55.305083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T01:21:40.825749+0000","last_change":"2023-10-06T01:21:36.814330+0000","last_active":"2023-10-06T01:21:40.825749+0000","last_peered":"2023-10-06T01:21:40.825749+0000","last_clean":"2023-10-06T01:21:40.825749+0000","last_became_active":"2023-10-06T01:21:36.814069+0000","last_became_peered":"2023-10-06T01:21:36.814069+0000","last_unstale":"2023-10-06T01:21:40.825749+0000","last_undegraded":"2023-10-06T01:21:40.825749+0000","last_fullsized":"2023-10-06T01:21:40.825749+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:21:36.268170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:21:36.268170+0000","last_clean_scrub_stamp":"2023-10-06T01:21:36.268170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:26:27.490800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T01:21:40.854566+0000","last_change":"2023-10-06T01:21:40.849926+0000","last_active":"2023-10-06T01:21:40.854566+0000","last_peered":"2023-10-06T01:21:40.854566+0000","last_clean":"2023-10-06T01:21:40.854566+0000","last_became_active":"2023-10-06T01:21:40.849188+0000","last_became_peered":"2023-10-06T01:21:40.849188+0000","last_unstale":"2023-10-06T01:21:40.854566+0000","last_undegraded":"2023-10-06T01:21:40.854566+0000","last_fullsized":"2023-10-06T01:21:40.854566+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:21:39.809888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:21:39.809888+0000","last_clean_scrub_stamp":"2023-10-06T01:21:39.809888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:21:10.391252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5,2],"acting":[6,0,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T01:21:40.820997+0000","last_change":"2023-10-06T01:21:31.338181+0000","last_active":"2023-10-06T01:21:40.820997+0000","last_peered":"2023-10-06T01:21:40.820997+0000","last_clean":"2023-10-06T01:21:40.820997+0000","last_became_active":"2023-10-06T01:21:31.337820+0000","last_became_peered":"2023-10-06T01:21:31.337820+0000","last_unstale":"2023-10-06T01:21:40.820997+0000","last_undegraded":"2023-10-06T01:21:40.820997+0000","last_fullsized":"2023-10-06T01:21:40.820997+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:21:29.586558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:21:29.586558+0000","last_clean_scrub_stamp":"2023-10-06T01:21:29.586558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:44:49.740873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T01:21:40.825927+0000","last_change":"2023-10-06T01:21:36.309352+0000","last_active":"2023-10-06T01:21:40.825927+0000","last_peered":"2023-10-06T01:21:40.825927+0000","last_clean":"2023-10-06T01:21:40.825927+0000","last_became_active":"2023-10-06T01:21:36.308864+0000","last_became_peered":"2023-10-06T01:21:36.308864+0000","last_unstale":"2023-10-06T01:21:40.825927+0000","last_undegraded":"2023-10-06T01:21:40.825927+0000","last_fullsized":"2023-10-06T01:21:40.825927+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:21:35.260777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:21:35.260777+0000","last_clean_scrub_stamp":"2023-10-06T01:21:35.260777+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:48:42.234958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T01:21:40.844152+0000","last_change":"2023-10-06T01:21:36.835013+0000","last_active":"2023-10-06T01:21:40.844152+0000","last_peered":"2023-10-06T01:21:40.844152+0000","last_clean":"2023-10-06T01:21:40.844152+0000","last_became_active":"2023-10-06T01:21:36.834427+0000","last_became_peered":"2023-10-06T01:21:36.834427+0000","last_unstale":"2023-10-06T01:21:40.844152+0000","last_undegraded":"2023-10-06T01:21:40.844152+0000","last_fullsized":"2023-10-06T01:21:40.844152+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:21:36.268170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:21:36.268170+0000","last_clean_scrub_stamp":"2023-10-06T01:21:36.268170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:28:15.885944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T01:21:40.858145+0000","last_change":"2023-10-06T01:21:40.857260+0000","last_active":"2023-10-06T01:21:40.858145+0000","last_peered":"2023-10-06T01:21:40.858145+0000","last_clean":"2023-10-06T01:21:40.858145+0000","last_became_active":"2023-10-06T01:21:40.856823+0000","last_became_peered":"2023-10-06T01:21:40.856823+0000","last_unstale":"2023-10-06T01:21:40.858145+0000","last_undegraded":"2023-10-06T01:21:40.858145+0000","last_fullsized":"2023-10-06T01:21:40.858145+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:21:39.809888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:21:39.809888+0000","last_clean_scrub_stamp":"2023-10-06T01:21:39.809888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:26:15.414115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,6,5],"acting":[0,1,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T01:21:40.821025+0000","last_change":"2023-10-06T01:21:30.604007+0000","last_active":"2023-10-06T01:21:40.821025+0000","last_peered":"2023-10-06T01:21:40.821025+0000","last_clean":"2023-10-06T01:21:40.821025+0000","last_became_active":"2023-10-06T01:21:30.603673+0000","last_became_peered":"2023-10-06T01:21:30.603673+0000","last_unstale":"2023-10-06T01:21:40.821025+0000","last_undegraded":"2023-10-06T01:21:40.821025+0000","last_fullsized":"2023-10-06T01:21:40.821025+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:21:29.586558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:21:29.586558+0000","last_clean_scrub_stamp":"2023-10-06T01:21:29.586558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:53:47.117299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T01:21:40.830136+0000","last_change":"2023-10-06T01:21:36.302956+0000","last_active":"2023-10-06T01:21:40.830136+0000","last_peered":"2023-10-06T01:21:40.830136+0000","last_clean":"2023-10-06T01:21:40.830136+0000","last_became_active":"2023-10-06T01:21:36.302668+0000","last_became_peered":"2023-10-06T01:21:36.302668+0000","last_unstale":"2023-10-06T01:21:40.830136+0000","last_undegraded":"2023-10-06T01:21:40.830136+0000","last_fullsized":"2023-10-06T01:21:40.830136+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:21:35.260777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:21:35.260777+0000","last_clean_scrub_stamp":"2023-10-06T01:21:35.260777+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:46:13.974439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T01:21:40.825330+0000","last_change":"2023-10-06T01:21:36.825472+0000","last_active":"2023-10-06T01:21:40.825330+0000","last_peered":"2023-10-06T01:21:40.825330+0000","last_clean":"2023-10-06T01:21:40.825330+0000","last_became_active":"2023-10-06T01:21:36.825199+0000","last_became_peered":"2023-10-06T01:21:36.825199+0000","last_unstale":"2023-10-06T01:21:40.825330+0000","last_undegraded":"2023-10-06T01:21:40.825330+0000","last_fullsized":"2023-10-06T01:21:40.825330+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:21:36.268170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:21:36.268170+0000","last_clean_scrub_stamp":"2023-10-06T01:21:36.268170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:53:27.090314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T01:21:40.858038+0000","last_change":"2023-10-06T01:21:40.855138+0000","last_active":"2023-10-06T01:21:40.858038+0000","last_peered":"2023-10-06T01:21:40.858038+0000","last_clean":"2023-10-06T01:21:40.858038+0000","last_became_active":"2023-10-06T01:21:40.854323+0000","last_became_peered":"2023-10-06T01:21:40.854323+0000","last_unstale":"2023-10-06T01:21:40.858038+0000","last_undegraded":"2023-10-06T01:21:40.858038+0000","last_fullsized":"2023-10-06T01:21:40.858038+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:21:39.809888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:21:39.809888+0000","last_clean_scrub_stamp":"2023-10-06T01:21:39.809888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:48:17.365413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,0],"acting":[1,3,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"20'1","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T01:21:40.844060+0000","last_change":"2023-10-06T01:21:36.308100+0000","last_active":"2023-10-06T01:21:40.844060+0000","last_peered":"2023-10-06T01:21:40.844060+0000","last_clean":"2023-10-06T01:21:40.844060+0000","last_became_active":"2023-10-06T01:21:36.307829+0000","last_became_peered":"2023-10-06T01:21:36.307829+0000","last_unstale":"2023-10-06T01:21:40.844060+0000","last_undegraded":"2023-10-06T01:21:40.844060+0000","last_fullsized":"2023-10-06T01:21:40.844060+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:21:35.260777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:21:35.260777+0000","last_clean_scrub_stamp":"2023-10-06T01:21:35.260777+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:46:13.974439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T01:21:40.817731+0000","last_change":"2023-10-06T01:21:36.820796+0000","last_active":"2023-10-06T01:21:40.817731+0000","last_peered":"2023-10-06T01:21:40.817731+0000","last_clean":"2023-10-06T01:21:40.817731+0000","last_became_active":"2023-10-06T01:21:36.820534+0000","last_became_peered":"2023-10-06T01:21:36.820534+0000","last_unstale":"2023-10-06T01:21:40.817731+0000","last_undegraded":"2023-10-06T01:21:40.817731+0000","last_fullsized":"2023-10-06T01:21:40.817731+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:21:36.268170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:21:36.268170+0000","last_clean_scrub_stamp":"2023-10-06T01:21:36.268170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:13:13.795366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T01:21:40.849961+0000","last_change":"2023-10-06T01:21:40.846085+0000","last_active":"2023-10-06T01:21:40.849961+0000","last_peered":"2023-10-06T01:21:40.849961+0000","last_clean":"2023-10-06T01:21:40.849961+0000","last_became_active":"2023-10-06T01:21:40.845695+0000","last_became_peered":"2023-10-06T01:21:40.845695+0000","last_unstale":"2023-10-06T01:21:40.849961+0000","last_undegraded":"2023-10-06T01:21:40.849961+0000","last_fullsized":"2023-10-06T01:21:40.849961+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:21:39.809888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:21:39.809888+0000","last_clean_scrub_stamp":"2023-10-06T01:21:39.809888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:05:45.908197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1,6],"acting":[7,4,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"20'2","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T01:21:40.829667+0000","last_change":"2023-10-06T01:21:36.307782+0000","last_active":"2023-10-06T01:21:40.829667+0000","last_peered":"2023-10-06T01:21:40.829667+0000","last_clean":"2023-10-06T01:21:40.829667+0000","last_became_active":"2023-10-06T01:21:36.307601+0000","last_became_peered":"2023-10-06T01:21:36.307601+0000","last_unstale":"2023-10-06T01:21:40.829667+0000","last_undegraded":"2023-10-06T01:21:40.829667+0000","last_fullsized":"2023-10-06T01:21:40.829667+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:21:35.260777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:21:35.260777+0000","last_clean_scrub_stamp":"2023-10-06T01:21:35.260777+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:03:02.138728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T01:21:40.826897+0000","last_change":"2023-10-06T01:21:36.840272+0000","last_active":"2023-10-06T01:21:40.826897+0000","last_peered":"2023-10-06T01:21:40.826897+0000","last_clean":"2023-10-06T01:21:40.826897+0000","last_became_active":"2023-10-06T01:21:36.839957+0000","last_became_peered":"2023-10-06T01:21:36.839957+0000","last_unstale":"2023-10-06T01:21:40.826897+0000","last_undegraded":"2023-10-06T01:21:40.826897+0000","last_fullsized":"2023-10-06T01:21:40.826897+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:21:36.268170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:21:36.268170+0000","last_clean_scrub_stamp":"2023-10-06T01:21:36.268170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:48:13.823695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T01:21:40.849688+0000","last_change":"2023-10-06T01:21:40.848222+0000","last_active":"2023-10-06T01:21:40.849688+0000","last_peered":"2023-10-06T01:21:40.849688+0000","last_clean":"2023-10-06T01:21:40.849688+0000","last_became_active":"2023-10-06T01:21:40.847832+0000","last_became_peered":"2023-10-06T01:21:40.847832+0000","last_unstale":"2023-10-06T01:21:40.849688+0000","last_undegraded":"2023-10-06T01:21:40.849688+0000","last_fullsized":"2023-10-06T01:21:40.849688+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:21:39.809888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:21:39.809888+0000","last_clean_scrub_stamp":"2023-10-06T01:21:39.809888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:06:39.429127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,7,4],"acting":[5,0,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1d","version":"20'2","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T01:21:40.830053+0000","last_change":"2023-10-06T01:21:36.307610+0000","last_active":"2023-10-06T01:21:40.830053+0000","last_peered":"2023-10-06T01:21:40.830053+0000","last_clean":"2023-10-06T01:21:40.830053+0000","last_became_active":"2023-10-06T01:21:36.306937+0000","last_became_peered":"2023-10-06T01:21:36.306937+0000","last_unstale":"2023-10-06T01:21:40.830053+0000","last_undegraded":"2023-10-06T01:21:40.830053+0000","last_fullsized":"2023-10-06T01:21:40.830053+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:21:35.260777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:21:35.260777+0000","last_clean_scrub_stamp":"2023-10-06T01:21:35.260777+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:48:19.919262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T01:21:40.824396+0000","last_change":"2023-10-06T01:21:36.840502+0000","last_active":"2023-10-06T01:21:40.824396+0000","last_peered":"2023-10-06T01:21:40.824396+0000","last_clean":"2023-10-06T01:21:40.824396+0000","last_became_active":"2023-10-06T01:21:36.840237+0000","last_became_peered":"2023-10-06T01:21:36.840237+0000","last_unstale":"2023-10-06T01:21:40.824396+0000","last_undegraded":"2023-10-06T01:21:40.824396+0000","last_fullsized":"2023-10-06T01:21:40.824396+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:21:36.268170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:21:36.268170+0000","last_clean_scrub_stamp":"2023-10-06T01:21:36.268170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:03:40.763134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T01:21:40.844533+0000","last_change":"2023-10-06T01:21:40.835338+0000","last_active":"2023-10-06T01:21:40.844533+0000","last_peered":"2023-10-06T01:21:40.844533+0000","last_clean":"2023-10-06T01:21:40.844533+0000","last_became_active":"2023-10-06T01:21:40.834902+0000","last_became_peered":"2023-10-06T01:21:40.834902+0000","last_unstale":"2023-10-06T01:21:40.844533+0000","last_undegraded":"2023-10-06T01:21:40.844533+0000","last_fullsized":"2023-10-06T01:21:40.844533+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:21:39.809888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:21:39.809888+0000","last_clean_scrub_stamp":"2023-10-06T01:21:39.809888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:04:16.001332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,2],"acting":[4,6,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"20'1","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T01:21:40.824449+0000","last_change":"2023-10-06T01:21:36.296572+0000","last_active":"2023-10-06T01:21:40.824449+0000","last_peered":"2023-10-06T01:21:40.824449+0000","last_clean":"2023-10-06T01:21:40.824449+0000","last_became_active":"2023-10-06T01:21:36.295666+0000","last_became_peered":"2023-10-06T01:21:36.295666+0000","last_unstale":"2023-10-06T01:21:40.824449+0000","last_undegraded":"2023-10-06T01:21:40.824449+0000","last_fullsized":"2023-10-06T01:21:40.824449+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:21:35.260777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:21:35.260777+0000","last_clean_scrub_stamp":"2023-10-06T01:21:35.260777+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:48:19.919262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T01:21:40.824070+0000","last_change":"2023-10-06T01:21:36.822907+0000","last_active":"2023-10-06T01:21:40.824070+0000","last_peered":"2023-10-06T01:21:40.824070+0000","last_clean":"2023-10-06T01:21:40.824070+0000","last_became_active":"2023-10-06T01:21:36.822537+0000","last_became_peered":"2023-10-06T01:21:36.822537+0000","last_unstale":"2023-10-06T01:21:40.824070+0000","last_undegraded":"2023-10-06T01:21:40.824070+0000","last_fullsized":"2023-10-06T01:21:40.824070+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:21:36.268170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:21:36.268170+0000","last_clean_scrub_stamp":"2023-10-06T01:21:36.268170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:53:49.542750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T01:21:40.856008+0000","last_change":"2023-10-06T01:21:40.845375+0000","last_active":"2023-10-06T01:21:40.856008+0000","last_peered":"2023-10-06T01:21:40.856008+0000","last_clean":"2023-10-06T01:21:40.856008+0000","last_became_active":"2023-10-06T01:21:40.845079+0000","last_became_peered":"2023-10-06T01:21:40.845079+0000","last_unstale":"2023-10-06T01:21:40.856008+0000","last_undegraded":"2023-10-06T01:21:40.856008+0000","last_fullsized":"2023-10-06T01:21:40.856008+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:21:39.809888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:21:39.809888+0000","last_clean_scrub_stamp":"2023-10-06T01:21:39.809888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:32:57.122301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,7,2],"acting":[1,5,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1f","version":"20'4","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T01:21:40.843463+0000","last_change":"2023-10-06T01:21:36.299553+0000","last_active":"2023-10-06T01:21:40.843463+0000","last_peered":"2023-10-06T01:21:40.843463+0000","last_clean":"2023-10-06T01:21:40.843463+0000","last_became_active":"2023-10-06T01:21:36.298968+0000","last_became_peered":"2023-10-06T01:21:36.298968+0000","last_unstale":"2023-10-06T01:21:40.843463+0000","last_undegraded":"2023-10-06T01:21:40.843463+0000","last_fullsized":"2023-10-06T01:21:40.843463+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:21:35.260777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:21:35.260777+0000","last_clean_scrub_stamp":"2023-10-06T01:21:35.260777+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:33:04.318590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T01:21:40.824895+0000","last_change":"2023-10-06T01:21:36.844505+0000","last_active":"2023-10-06T01:21:40.824895+0000","last_peered":"2023-10-06T01:21:40.824895+0000","last_clean":"2023-10-06T01:21:40.824895+0000","last_became_active":"2023-10-06T01:21:36.843624+0000","last_became_peered":"2023-10-06T01:21:36.843624+0000","last_unstale":"2023-10-06T01:21:40.824895+0000","last_undegraded":"2023-10-06T01:21:40.824895+0000","last_fullsized":"2023-10-06T01:21:40.824895+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:21:36.268170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:21:36.268170+0000","last_clean_scrub_stamp":"2023-10-06T01:21:36.268170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:59:29.172295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T01:21:40.820462+0000","last_change":"2023-10-06T01:21:36.832253+0000","last_active":"2023-10-06T01:21:40.820462+0000","last_peered":"2023-10-06T01:21:40.820462+0000","last_clean":"2023-10-06T01:21:40.820462+0000","last_became_active":"2023-10-06T01:21:36.824011+0000","last_became_peered":"2023-10-06T01:21:36.824011+0000","last_unstale":"2023-10-06T01:21:40.820462+0000","last_undegraded":"2023-10-06T01:21:40.820462+0000","last_fullsized":"2023-10-06T01:21:40.820462+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:21:36.268170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:21:36.268170+0000","last_clean_scrub_stamp":"2023-10-06T01:21:36.268170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:50:38.966977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T01:21:40.823808+0000","last_change":"2023-10-06T01:21:36.826465+0000","last_active":"2023-10-06T01:21:40.823808+0000","last_peered":"2023-10-06T01:21:40.823808+0000","last_clean":"2023-10-06T01:21:40.823808+0000","last_became_active":"2023-10-06T01:21:36.826146+0000","last_became_peered":"2023-10-06T01:21:36.826146+0000","last_unstale":"2023-10-06T01:21:40.823808+0000","last_undegraded":"2023-10-06T01:21:40.823808+0000","last_fullsized":"2023-10-06T01:21:40.823808+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:21:36.268170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:21:36.268170+0000","last_clean_scrub_stamp":"2023-10-06T01:21:36.268170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:28:15.885944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T01:21:40.824625+0000","last_change":"2023-10-06T01:21:36.834310+0000","last_active":"2023-10-06T01:21:40.824625+0000","last_peered":"2023-10-06T01:21:40.824625+0000","last_clean":"2023-10-06T01:21:40.824625+0000","last_became_active":"2023-10-06T01:21:36.834048+0000","last_became_peered":"2023-10-06T01:21:36.834048+0000","last_unstale":"2023-10-06T01:21:40.824625+0000","last_undegraded":"2023-10-06T01:21:40.824625+0000","last_fullsized":"2023-10-06T01:21:40.824625+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:21:36.268170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:21:36.268170+0000","last_clean_scrub_stamp":"2023-10-06T01:21:36.268170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:25:42.902143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T01:21:40.826182+0000","last_change":"2023-10-06T01:21:36.830563+0000","last_active":"2023-10-06T01:21:40.826182+0000","last_peered":"2023-10-06T01:21:40.826182+0000","last_clean":"2023-10-06T01:21:40.826182+0000","last_became_active":"2023-10-06T01:21:36.830334+0000","last_became_peered":"2023-10-06T01:21:36.830334+0000","last_unstale":"2023-10-06T01:21:40.826182+0000","last_undegraded":"2023-10-06T01:21:40.826182+0000","last_fullsized":"2023-10-06T01:21:40.826182+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:21:36.268170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:21:36.268170+0000","last_clean_scrub_stamp":"2023-10-06T01:21:36.268170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:26:07.073491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T01:21:40.825831+0000","last_change":"2023-10-06T01:21:36.828863+0000","last_active":"2023-10-06T01:21:40.825831+0000","last_peered":"2023-10-06T01:21:40.825831+0000","last_clean":"2023-10-06T01:21:40.825831+0000","last_became_active":"2023-10-06T01:21:36.828318+0000","last_became_peered":"2023-10-06T01:21:36.828318+0000","last_unstale":"2023-10-06T01:21:40.825831+0000","last_undegraded":"2023-10-06T01:21:40.825831+0000","last_fullsized":"2023-10-06T01:21:40.825831+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:21:36.268170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:21:36.268170+0000","last_clean_scrub_stamp":"2023-10-06T01:21:36.268170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:27:54.680295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":4484,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":8968,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574859,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298156,"kb_used_data":868,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073684,"statfs":{"total":96636764160,"available":96331452416,"internally_reserved":0,"allocated":888832,"data_stored":703756,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73399999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.625}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.751}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90600000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56999999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64800000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69999999999999996}]}]},{"osd":6,"up_from":13,"seq":55834574859,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297548,"kb_used_data":260,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074292,"statfs":{"total":96636764160,"available":96332075008,"internally_reserved":0,"allocated":266240,"data_stored":109458,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53900000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64200000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67700000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58299999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49199999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45700000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79000000000000004}]}]},{"osd":1,"up_from":13,"seq":55834574857,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302220,"kb_used_data":836,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069620,"statfs":{"total":96636764160,"available":96327290880,"internally_reserved":0,"allocated":856064,"data_stored":698848,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.433}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.376}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48099999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77700000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.623}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78700000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65800000000000003}]}]},{"osd":0,"up_from":13,"seq":55834574858,"num_pgs":47,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301644,"kb_used_data":260,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94070196,"statfs":{"total":96636764160,"available":96327880704,"internally_reserved":0,"allocated":266240,"data_stored":109034,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.9079999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.9410000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.728}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79700000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81999999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.8740000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86699999999999999}]}]},{"osd":2,"up_from":13,"seq":55834574857,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301644,"kb_used_data":260,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94070196,"statfs":{"total":96636764160,"available":96327880704,"internally_reserved":0,"allocated":266240,"data_stored":109458,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96599999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1830000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2210000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.748}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0229999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.8360000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0680000000000001}]}]},{"osd":3,"up_from":13,"seq":55834574857,"num_pgs":48,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301648,"kb_used_data":264,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94070192,"statfs":{"total":96636764160,"available":96327876608,"internally_reserved":0,"allocated":270336,"data_stored":109548,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.433}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48599999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60099999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98599999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.02}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94899999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0720000000000001}]}]},{"osd":4,"up_from":13,"seq":55834574857,"num_pgs":50,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297568,"kb_used_data":280,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074272,"statfs":{"total":96636764160,"available":96332054528,"internally_reserved":0,"allocated":286720,"data_stored":113228,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42199999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51500000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54900000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56000000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44500000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53300000000000003}]}]},{"osd":5,"up_from":13,"seq":55834574859,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297552,"kb_used_data":264,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074288,"statfs":{"total":96636764160,"available":96332070912,"internally_reserved":0,"allocated":270336,"data_stored":109104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72999999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58999999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70699999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96999999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67000000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75700000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85499999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":3770,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":624,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":3930,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-06T01:22:05.873 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-06T01:22:06.092 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:06.090+0000 7f5795d9d700 1 Processor -- start 2023-10-06T01:22:06.092 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:06.091+0000 7f5795d9d700 1 -- start start 2023-10-06T01:22:06.096 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:06.092+0000 7f5795d9d700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f579006a9a0 0x7f579006e6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:06.096 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:06.092+0000 7f5795d9d700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f57900c9d00 con 0x7f5790153e40 2023-10-06T01:22:06.096 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:06.092+0000 7f5795d9d700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f57900c6750 con 0x7f579006a5d0 2023-10-06T01:22:06.096 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:06.092+0000 7f5795d9d700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f579006f5a0 con 0x7f579006a9a0 2023-10-06T01:22:06.096 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:06.092+0000 7f578ffff700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f5790153e40 0x7f579006df90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:56652/0 (socket says 172.21.15.50:56652) 2023-10-06T01:22:06.097 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:06.092+0000 7f578ffff700 1 -- 172.21.15.50:0/3182417606 learned_addr learned my addr 172.21.15.50:0/3182417606 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-10-06T01:22:06.097 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:06.093+0000 7f579559c700 1 --2- 172.21.15.50:0/3182417606 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f579006a9a0 0x7f579006e6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:06.097 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:06.093+0000 7f578f7fe700 1 -- 172.21.15.50:0/3182417606 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1353759427 0 0) 0x7f57900c9d00 con 0x7f5790153e40 2023-10-06T01:22:06.097 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:06.093+0000 7f578f7fe700 1 -- 172.21.15.50:0/3182417606 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5780003570 con 0x7f5790153e40 2023-10-06T01:22:06.097 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:06.093+0000 7f578f7fe700 1 -- 172.21.15.50:0/3182417606 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2389438812 0 0) 0x7f57900c6750 con 0x7f579006a5d0 2023-10-06T01:22:06.097 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:06.093+0000 7f578f7fe700 1 -- 172.21.15.50:0/3182417606 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f57900c9d00 con 0x7f579006a5d0 2023-10-06T01:22:06.097 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:06.093+0000 7f578f7fe700 1 -- 172.21.15.50:0/3182417606 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2782841460 0 0) 0x7f5780003570 con 0x7f5790153e40 2023-10-06T01:22:06.097 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:06.093+0000 7f578f7fe700 1 -- 172.21.15.50:0/3182417606 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f579006a9a0 msgr2=0x7f579006e6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:22:06.097 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:06.093+0000 7f578f7fe700 1 --2- 172.21.15.50:0/3182417606 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f579006a9a0 0x7f579006e6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:06.097 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:06.093+0000 7f578f7fe700 1 -- 172.21.15.50:0/3182417606 >> v1:172.21.15.155:6789/0 conn(0x7f579006a5d0 legacy=0x7f5790153730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:06.097 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:06.093+0000 7f578f7fe700 1 -- 172.21.15.50:0/3182417606 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f579006ed00 con 0x7f5790153e40 2023-10-06T01:22:06.098 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:06.093+0000 7f578f7fe700 1 -- 172.21.15.50:0/3182417606 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 347519148 0 0) 0x7f577c001470 con 0x7f5790153e40 2023-10-06T01:22:06.098 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:06.093+0000 7f578f7fe700 1 -- 172.21.15.50:0/3182417606 >> v1:172.21.15.50:6789/0 conn(0x7f5790153e40 legacy=0x7f579006df90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:06.098 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:06.093+0000 7f578f7fe700 1 --2- 172.21.15.50:0/3182417606 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f579006a9a0 0x7f5780003c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:06.098 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:06.093+0000 7f578f7fe700 1 --2- 172.21.15.50:0/3182417606 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5780004180 0x7f5780004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:06.098 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:06.093+0000 7f578f7fe700 1 --2- 172.21.15.50:0/3182417606 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5780004d50 0x7f57800051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:06.098 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:06.093+0000 7f578f7fe700 1 -- 172.21.15.50:0/3182417606 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f579006f5a0 con 0x7f5780004180 2023-10-06T01:22:06.098 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:06.093+0000 7f578f7fe700 1 -- 172.21.15.50:0/3182417606 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f578000bba0 con 0x7f5780004d50 2023-10-06T01:22:06.098 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:06.093+0000 7f578f7fe700 1 -- 172.21.15.50:0/3182417606 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f578000bd60 con 0x7f579006a9a0 2023-10-06T01:22:06.098 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:06.093+0000 7f578ffff700 1 --2- 172.21.15.50:0/3182417606 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5780004180 0x7f5780004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:06.098 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:06.094+0000 7f579559c700 1 --2- 172.21.15.50:0/3182417606 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5780004d50 0x7f57800051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:06.098 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:06.093+0000 7f5794d9b700 1 --2- 172.21.15.50:0/3182417606 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f579006a9a0 0x7f5780003c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:06.099 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:06.094+0000 7f578ffff700 1 -- 172.21.15.50:0/3182417606 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f579006a9a0 msgr2=0x7f5780003c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:22:06.099 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:06.094+0000 7f578ffff700 1 --2- 172.21.15.50:0/3182417606 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f579006a9a0 0x7f5780003c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:06.099 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:06.094+0000 7f578ffff700 1 -- 172.21.15.50:0/3182417606 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5780004d50 msgr2=0x7f57800051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:22:06.099 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:06.094+0000 7f578ffff700 1 --2- 172.21.15.50:0/3182417606 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5780004d50 0x7f57800051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:06.099 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:06.094+0000 7f578ffff700 1 -- 172.21.15.50:0/3182417606 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5780003570 con 0x7f5780004180 2023-10-06T01:22:06.099 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:06.094+0000 7f578ffff700 1 --2- 172.21.15.50:0/3182417606 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5780004180 0x7f5780004810 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f577c00c2d0 tx=0x7f577c001e10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=76a0975af7e1133b server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:22:06.099 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:06.094+0000 7f578f7fe700 1 -- 172.21.15.50:0/3182417606 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f577c00cbc0 con 0x7f5780004180 2023-10-06T01:22:06.099 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:06.095+0000 7f578f7fe700 1 -- 172.21.15.50:0/3182417606 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f577c00cd20 con 0x7f5780004180 2023-10-06T01:22:06.099 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:06.095+0000 7f578f7fe700 1 -- 172.21.15.50:0/3182417606 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f577c005b70 con 0x7f5780004180 2023-10-06T01:22:06.099 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:06.095+0000 7f5795d9d700 1 -- 172.21.15.50:0/3182417606 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5780004180 msgr2=0x7f5780004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:06.099 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:06.095+0000 7f5795d9d700 1 --2- 172.21.15.50:0/3182417606 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5780004180 0x7f5780004810 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f577c00c2d0 tx=0x7f577c001e10 comp rx=0 tx=0).stop 2023-10-06T01:22:06.099 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:06.095+0000 7f579559c700 1 -- 172.21.15.50:0/3182417606 reap_dead start 2023-10-06T01:22:06.100 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:06.095+0000 7f5795d9d700 1 -- 172.21.15.50:0/3182417606 shutdown_connections 2023-10-06T01:22:06.100 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:06.095+0000 7f5795d9d700 1 -- 172.21.15.50:0/3182417606 >> 172.21.15.50:0/3182417606 conn(0x7f57900680c0 msgr2=0x7f57900cbf00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:22:06.100 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:06.095+0000 7f5795d9d700 1 -- 172.21.15.50:0/3182417606 shutdown_connections 2023-10-06T01:22:06.100 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:06.095+0000 7f5795d9d700 1 -- 172.21.15.50:0/3182417606 wait complete. 2023-10-06T01:22:06.102 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:06.097+0000 7f5795d9d700 1 Processor -- start 2023-10-06T01:22:06.102 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:06.097+0000 7f5795d9d700 1 -- start start 2023-10-06T01:22:06.102 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:06.098+0000 7f5795d9d700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5780004180 0x7f57900af0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:06.102 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:06.098+0000 7f5795d9d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f57900b1320 0x7f5790168130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:06.102 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:06.098+0000 7f5795d9d700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f57900c5980 0x7f57900cb060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:06.102 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:06.098+0000 7f5795d9d700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57900b1ac0 con 0x7f57900b1320 2023-10-06T01:22:06.102 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:06.098+0000 7f5795d9d700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57900b17e0 con 0x7f5780004180 2023-10-06T01:22:06.103 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:06.098+0000 7f5795d9d700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57900af7e0 con 0x7f57900c5980 2023-10-06T01:22:06.103 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:06.098+0000 7f578ffff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f57900b1320 0x7f5790168130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:06.103 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:06.098+0000 7f578ffff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f57900b1320 0x7f5790168130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:37122/0 (socket says 172.21.15.50:37122) 2023-10-06T01:22:06.103 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:06.098+0000 7f578ffff700 1 -- 172.21.15.50:0/443877313 learned_addr learned my addr 172.21.15.50:0/443877313 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-06T01:22:06.103 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:06.098+0000 7f5794d9b700 1 --2- 172.21.15.50:0/443877313 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5780004180 0x7f57900af0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:06.103 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:06.098+0000 7f579559c700 1 --2- 172.21.15.50:0/443877313 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f57900c5980 0x7f57900cb060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:06.103 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:06.098+0000 7f578ffff700 1 -- 172.21.15.50:0/443877313 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f57900c5980 msgr2=0x7f57900cb060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:06.103 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:06.098+0000 7f578ffff700 1 --2- 172.21.15.50:0/443877313 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f57900c5980 0x7f57900cb060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:06.103 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:06.098+0000 7f578ffff700 1 -- 172.21.15.50:0/443877313 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5780004180 msgr2=0x7f57900af0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:06.103 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:06.098+0000 7f578ffff700 1 --2- 172.21.15.50:0/443877313 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5780004180 0x7f57900af0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:06.103 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:06.098+0000 7f578ffff700 1 -- 172.21.15.50:0/443877313 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57900afac0 con 0x7f57900b1320 2023-10-06T01:22:06.104 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:06.098+0000 7f579559c700 1 --2- 172.21.15.50:0/443877313 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f57900c5980 0x7f57900cb060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T01:22:06.104 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:06.099+0000 7f578ffff700 1 --2- 172.21.15.50:0/443877313 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f57900b1320 0x7f5790168130 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f577c011000 tx=0x7f577c015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:22:06.104 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:06.099+0000 7f578cff9700 1 -- 172.21.15.50:0/443877313 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f577c001710 con 0x7f57900b1320 2023-10-06T01:22:06.104 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:06.099+0000 7f578cff9700 1 -- 172.21.15.50:0/443877313 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f577c0070d0 con 0x7f57900b1320 2023-10-06T01:22:06.104 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:06.099+0000 7f578cff9700 1 -- 172.21.15.50:0/443877313 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f577c007490 con 0x7f57900b1320 2023-10-06T01:22:06.104 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:06.099+0000 7f5795d9d700 1 -- 172.21.15.50:0/443877313 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5790168670 con 0x7f57900b1320 2023-10-06T01:22:06.104 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:06.099+0000 7f5795d9d700 1 -- 172.21.15.50:0/443877313 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f57900cb5a0 con 0x7f57900b1320 2023-10-06T01:22:06.104 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:06.100+0000 7f5795d9d700 1 -- 172.21.15.50:0/443877313 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f579005f270 con 0x7f57900b1320 2023-10-06T01:22:06.104 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:06.101+0000 7f578cff9700 1 -- 172.21.15.50:0/443877313 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f577c019030 con 0x7f57900b1320 2023-10-06T01:22:06.105 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:06.102+0000 7f578cff9700 1 --2- 172.21.15.50:0/443877313 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f5774066f30 0x7f57740693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:06.105 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:06.102+0000 7f578cff9700 1 -- 172.21.15.50:0/443877313 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f577c086000 con 0x7f57900b1320 2023-10-06T01:22:06.105 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:06.102+0000 7f5794d9b700 1 --2- 172.21.15.50:0/443877313 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f5774066f30 0x7f57740693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:06.105 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:06.103+0000 7f5794d9b700 1 --2- 172.21.15.50:0/443877313 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f5774066f30 0x7f57740693e0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f57840010e0 tx=0x7f5784007d30 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:22:06.107 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:06.106+0000 7f578cff9700 1 -- 172.21.15.50:0/443877313 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f577c052d80 con 0x7f57900b1320 2023-10-06T01:22:06.306 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:06.305+0000 7f5795d9d700 1 -- 172.21.15.50:0/443877313 --> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f57900b1ac0 con 0x7f5774066f30 2023-10-06T01:22:06.316 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:06.316+0000 7f578cff9700 1 -- 172.21.15.50:0/443877313 <== mgr.4099 v2:172.21.15.155:6832/85215 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+367527 (secure 0 0 0) 0x7f57900b1ac0 con 0x7f5774066f30 2023-10-06T01:22:06.321 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-10-06T01:22:06.324 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:06.320+0000 7f5795d9d700 1 -- 172.21.15.50:0/443877313 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f5774066f30 msgr2=0x7f57740693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:06.324 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:06.320+0000 7f5795d9d700 1 --2- 172.21.15.50:0/443877313 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f5774066f30 0x7f57740693e0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f57840010e0 tx=0x7f5784007d30 comp rx=0 tx=0).stop 2023-10-06T01:22:06.325 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:06.320+0000 7f5795d9d700 1 -- 172.21.15.50:0/443877313 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f57900b1320 msgr2=0x7f5790168130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:06.325 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:06.320+0000 7f5795d9d700 1 --2- 172.21.15.50:0/443877313 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f57900b1320 0x7f5790168130 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f577c011000 tx=0x7f577c015000 comp rx=0 tx=0).stop 2023-10-06T01:22:06.325 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:06.320+0000 7f5795d9d700 1 -- 172.21.15.50:0/443877313 shutdown_connections 2023-10-06T01:22:06.325 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:06.320+0000 7f5795d9d700 1 --2- 172.21.15.50:0/443877313 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f57900c5980 0x7f57900cb060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:06.325 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:06.320+0000 7f5795d9d700 1 --2- 172.21.15.50:0/443877313 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f5774066f30 0x7f57740693e0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:06.325 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:06.320+0000 7f5795d9d700 1 --2- 172.21.15.50:0/443877313 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5780004180 0x7f57900af0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:06.325 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:06.320+0000 7f5795d9d700 1 --2- 172.21.15.50:0/443877313 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f57900b1320 0x7f5790168130 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:06.325 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:06.320+0000 7f5795d9d700 1 -- 172.21.15.50:0/443877313 >> 172.21.15.50:0/443877313 conn(0x7f57900680c0 msgr2=0x7f57901548d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:22:06.325 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:06.321+0000 7f5795d9d700 1 -- 172.21.15.50:0/443877313 shutdown_connections 2023-10-06T01:22:06.325 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:06.321+0000 7f5795d9d700 1 -- 172.21.15.50:0/443877313 wait complete. 2023-10-06T01:22:06.325 INFO:teuthology.orchestra.run.smithi050.stderr:dumped all 2023-10-06T01:22:06.341 INFO:teuthology.orchestra.run.smithi050.stdout:{"pg_ready":true,"pg_map":{"version":37,"stamp":"2023-10-06T01:22:05.777311+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":594852,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":207,"num_write_kb":2433,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":159,"ondisk_log_size":159,"up":338,"acting":338,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":338,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2397980,"kb_used_data":3292,"kb_used_omap":0,"kb_used_meta":2394624,"kb_avail":752576740,"statfs":{"total":773094113280,"available":770638581760,"internally_reserved":0,"allocated":3371008,"data_stored":2062434,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2452094976},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1725,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003597"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T01:21:40.818033+0000","last_change":"2023-10-06T01:21:36.824186+0000","last_active":"2023-10-06T01:21:40.818033+0000","last_peered":"2023-10-06T01:21:40.818033+0000","last_clean":"2023-10-06T01:21:40.818033+0000","last_became_active":"2023-10-06T01:21:36.823943+0000","last_became_peered":"2023-10-06T01:21:36.823943+0000","last_unstale":"2023-10-06T01:21:40.818033+0000","last_undegraded":"2023-10-06T01:21:40.818033+0000","last_fullsized":"2023-10-06T01:21:40.818033+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:21:36.268170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:21:36.268170+0000","last_clean_scrub_stamp":"2023-10-06T01:21:36.268170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:03:03.146121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T01:21:40.829968+0000","last_change":"2023-10-06T01:21:36.827051+0000","last_active":"2023-10-06T01:21:40.829968+0000","last_peered":"2023-10-06T01:21:40.829968+0000","last_clean":"2023-10-06T01:21:40.829968+0000","last_became_active":"2023-10-06T01:21:36.826789+0000","last_became_peered":"2023-10-06T01:21:36.826789+0000","last_unstale":"2023-10-06T01:21:40.829968+0000","last_undegraded":"2023-10-06T01:21:40.829968+0000","last_fullsized":"2023-10-06T01:21:40.829968+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:21:36.268170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:21:36.268170+0000","last_clean_scrub_stamp":"2023-10-06T01:21:36.268170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:53:49.542750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T01:21:40.825569+0000","last_change":"2023-10-06T01:21:36.841714+0000","last_active":"2023-10-06T01:21:40.825569+0000","last_peered":"2023-10-06T01:21:40.825569+0000","last_clean":"2023-10-06T01:21:40.825569+0000","last_became_active":"2023-10-06T01:21:36.841309+0000","last_became_peered":"2023-10-06T01:21:36.841309+0000","last_unstale":"2023-10-06T01:21:40.825569+0000","last_undegraded":"2023-10-06T01:21:40.825569+0000","last_fullsized":"2023-10-06T01:21:40.825569+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:21:36.268170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:21:36.268170+0000","last_clean_scrub_stamp":"2023-10-06T01:21:36.268170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:21:06.849534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T01:21:40.820783+0000","last_change":"2023-10-06T01:21:36.839886+0000","last_active":"2023-10-06T01:21:40.820783+0000","last_peered":"2023-10-06T01:21:40.820783+0000","last_clean":"2023-10-06T01:21:40.820783+0000","last_became_active":"2023-10-06T01:21:36.839587+0000","last_became_peered":"2023-10-06T01:21:36.839587+0000","last_unstale":"2023-10-06T01:21:40.820783+0000","last_undegraded":"2023-10-06T01:21:40.820783+0000","last_fullsized":"2023-10-06T01:21:40.820783+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:21:36.268170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:21:36.268170+0000","last_clean_scrub_stamp":"2023-10-06T01:21:36.268170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:28:29.254293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T01:21:40.844272+0000","last_change":"2023-10-06T01:21:36.836485+0000","last_active":"2023-10-06T01:21:40.844272+0000","last_peered":"2023-10-06T01:21:40.844272+0000","last_clean":"2023-10-06T01:21:40.844272+0000","last_became_active":"2023-10-06T01:21:36.836212+0000","last_became_peered":"2023-10-06T01:21:36.836212+0000","last_unstale":"2023-10-06T01:21:40.844272+0000","last_undegraded":"2023-10-06T01:21:40.844272+0000","last_fullsized":"2023-10-06T01:21:40.844272+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:21:36.268170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:21:36.268170+0000","last_clean_scrub_stamp":"2023-10-06T01:21:36.268170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:03:40.763134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T01:21:40.824705+0000","last_change":"2023-10-06T01:21:36.842364+0000","last_active":"2023-10-06T01:21:40.824705+0000","last_peered":"2023-10-06T01:21:40.824705+0000","last_clean":"2023-10-06T01:21:40.824705+0000","last_became_active":"2023-10-06T01:21:36.842065+0000","last_became_peered":"2023-10-06T01:21:36.842065+0000","last_unstale":"2023-10-06T01:21:40.824705+0000","last_undegraded":"2023-10-06T01:21:40.824705+0000","last_fullsized":"2023-10-06T01:21:40.824705+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:21:36.268170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:21:36.268170+0000","last_clean_scrub_stamp":"2023-10-06T01:21:36.268170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:28:15.885944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T01:21:40.830001+0000","last_change":"2023-10-06T01:21:36.835095+0000","last_active":"2023-10-06T01:21:40.830001+0000","last_peered":"2023-10-06T01:21:40.830001+0000","last_clean":"2023-10-06T01:21:40.830001+0000","last_became_active":"2023-10-06T01:21:36.834833+0000","last_became_peered":"2023-10-06T01:21:36.834833+0000","last_unstale":"2023-10-06T01:21:40.830001+0000","last_undegraded":"2023-10-06T01:21:40.830001+0000","last_fullsized":"2023-10-06T01:21:40.830001+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:21:36.268170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:21:36.268170+0000","last_clean_scrub_stamp":"2023-10-06T01:21:36.268170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:26:07.073491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T01:21:40.827937+0000","last_change":"2023-10-06T01:21:36.841569+0000","last_active":"2023-10-06T01:21:40.827937+0000","last_peered":"2023-10-06T01:21:40.827937+0000","last_clean":"2023-10-06T01:21:40.827937+0000","last_became_active":"2023-10-06T01:21:36.841279+0000","last_became_peered":"2023-10-06T01:21:36.841279+0000","last_unstale":"2023-10-06T01:21:40.827937+0000","last_undegraded":"2023-10-06T01:21:40.827937+0000","last_fullsized":"2023-10-06T01:21:40.827937+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:21:36.268170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:21:36.268170+0000","last_clean_scrub_stamp":"2023-10-06T01:21:36.268170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:22:57.339224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T01:21:40.843139+0000","last_change":"2023-10-06T01:21:36.840627+0000","last_active":"2023-10-06T01:21:40.843139+0000","last_peered":"2023-10-06T01:21:40.843139+0000","last_clean":"2023-10-06T01:21:40.843139+0000","last_became_active":"2023-10-06T01:21:36.840352+0000","last_became_peered":"2023-10-06T01:21:36.840352+0000","last_unstale":"2023-10-06T01:21:40.843139+0000","last_undegraded":"2023-10-06T01:21:40.843139+0000","last_fullsized":"2023-10-06T01:21:40.843139+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:21:36.268170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:21:36.268170+0000","last_clean_scrub_stamp":"2023-10-06T01:21:36.268170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:53:49.542750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T01:21:40.830823+0000","last_change":"2023-10-06T01:21:36.836461+0000","last_active":"2023-10-06T01:21:40.830823+0000","last_peered":"2023-10-06T01:21:40.830823+0000","last_clean":"2023-10-06T01:21:40.830823+0000","last_became_active":"2023-10-06T01:21:36.836153+0000","last_became_peered":"2023-10-06T01:21:36.836153+0000","last_unstale":"2023-10-06T01:21:40.830823+0000","last_undegraded":"2023-10-06T01:21:40.830823+0000","last_fullsized":"2023-10-06T01:21:40.830823+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:21:36.268170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:21:36.268170+0000","last_clean_scrub_stamp":"2023-10-06T01:21:36.268170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:48:35.151895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T01:21:40.825486+0000","last_change":"2023-10-06T01:21:36.829914+0000","last_active":"2023-10-06T01:21:40.825486+0000","last_peered":"2023-10-06T01:21:40.825486+0000","last_clean":"2023-10-06T01:21:40.825486+0000","last_became_active":"2023-10-06T01:21:36.829628+0000","last_became_peered":"2023-10-06T01:21:36.829628+0000","last_unstale":"2023-10-06T01:21:40.825486+0000","last_undegraded":"2023-10-06T01:21:40.825486+0000","last_fullsized":"2023-10-06T01:21:40.825486+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:21:36.268170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:21:36.268170+0000","last_clean_scrub_stamp":"2023-10-06T01:21:36.268170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:08:14.866921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T01:21:40.817667+0000","last_change":"2023-10-06T01:21:36.835080+0000","last_active":"2023-10-06T01:21:40.817667+0000","last_peered":"2023-10-06T01:21:40.817667+0000","last_clean":"2023-10-06T01:21:40.817667+0000","last_became_active":"2023-10-06T01:21:36.834739+0000","last_became_peered":"2023-10-06T01:21:36.834739+0000","last_unstale":"2023-10-06T01:21:40.817667+0000","last_undegraded":"2023-10-06T01:21:40.817667+0000","last_fullsized":"2023-10-06T01:21:40.817667+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:21:36.268170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:21:36.268170+0000","last_clean_scrub_stamp":"2023-10-06T01:21:36.268170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:48:20.926655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T01:21:40.817292+0000","last_change":"2023-10-06T01:21:36.827097+0000","last_active":"2023-10-06T01:21:40.817292+0000","last_peered":"2023-10-06T01:21:40.817292+0000","last_clean":"2023-10-06T01:21:40.817292+0000","last_became_active":"2023-10-06T01:21:36.826834+0000","last_became_peered":"2023-10-06T01:21:36.826834+0000","last_unstale":"2023-10-06T01:21:40.817292+0000","last_undegraded":"2023-10-06T01:21:40.817292+0000","last_fullsized":"2023-10-06T01:21:40.817292+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:21:36.268170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:21:36.268170+0000","last_clean_scrub_stamp":"2023-10-06T01:21:36.268170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:54:56.312476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T01:21:40.829936+0000","last_change":"2023-10-06T01:21:36.821926+0000","last_active":"2023-10-06T01:21:40.829936+0000","last_peered":"2023-10-06T01:21:40.829936+0000","last_clean":"2023-10-06T01:21:40.829936+0000","last_became_active":"2023-10-06T01:21:36.821634+0000","last_became_peered":"2023-10-06T01:21:36.821634+0000","last_unstale":"2023-10-06T01:21:40.829936+0000","last_undegraded":"2023-10-06T01:21:40.829936+0000","last_fullsized":"2023-10-06T01:21:40.829936+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:21:36.268170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:21:36.268170+0000","last_clean_scrub_stamp":"2023-10-06T01:21:36.268170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:25:14.997580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T01:21:40.829788+0000","last_change":"2023-10-06T01:21:36.835675+0000","last_active":"2023-10-06T01:21:40.829788+0000","last_peered":"2023-10-06T01:21:40.829788+0000","last_clean":"2023-10-06T01:21:40.829788+0000","last_became_active":"2023-10-06T01:21:36.835263+0000","last_became_peered":"2023-10-06T01:21:36.835263+0000","last_unstale":"2023-10-06T01:21:40.829788+0000","last_undegraded":"2023-10-06T01:21:40.829788+0000","last_fullsized":"2023-10-06T01:21:40.829788+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:21:36.268170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:21:36.268170+0000","last_clean_scrub_stamp":"2023-10-06T01:21:36.268170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:48:35.151895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T01:21:40.824974+0000","last_change":"2023-10-06T01:21:36.844306+0000","last_active":"2023-10-06T01:21:40.824974+0000","last_peered":"2023-10-06T01:21:40.824974+0000","last_clean":"2023-10-06T01:21:40.824974+0000","last_became_active":"2023-10-06T01:21:36.843273+0000","last_became_peered":"2023-10-06T01:21:36.843273+0000","last_unstale":"2023-10-06T01:21:40.824974+0000","last_undegraded":"2023-10-06T01:21:40.824974+0000","last_fullsized":"2023-10-06T01:21:40.824974+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:21:36.268170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:21:36.268170+0000","last_clean_scrub_stamp":"2023-10-06T01:21:36.268170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:26:07.073491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T01:21:40.843241+0000","last_change":"2023-10-06T01:21:36.836865+0000","last_active":"2023-10-06T01:21:40.843241+0000","last_peered":"2023-10-06T01:21:40.843241+0000","last_clean":"2023-10-06T01:21:40.843241+0000","last_became_active":"2023-10-06T01:21:36.836583+0000","last_became_peered":"2023-10-06T01:21:36.836583+0000","last_unstale":"2023-10-06T01:21:40.843241+0000","last_undegraded":"2023-10-06T01:21:40.843241+0000","last_fullsized":"2023-10-06T01:21:40.843241+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:21:36.268170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:21:36.268170+0000","last_clean_scrub_stamp":"2023-10-06T01:21:36.268170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:25:14.997580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T01:21:40.827081+0000","last_change":"2023-10-06T01:21:36.833429+0000","last_active":"2023-10-06T01:21:40.827081+0000","last_peered":"2023-10-06T01:21:40.827081+0000","last_clean":"2023-10-06T01:21:40.827081+0000","last_became_active":"2023-10-06T01:21:36.833139+0000","last_became_peered":"2023-10-06T01:21:36.833139+0000","last_unstale":"2023-10-06T01:21:40.827081+0000","last_undegraded":"2023-10-06T01:21:40.827081+0000","last_fullsized":"2023-10-06T01:21:40.827081+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:21:36.268170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:21:36.268170+0000","last_clean_scrub_stamp":"2023-10-06T01:21:36.268170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:51:16.522318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T01:21:40.817681+0000","last_change":"2023-10-06T01:21:36.822258+0000","last_active":"2023-10-06T01:21:40.817681+0000","last_peered":"2023-10-06T01:21:40.817681+0000","last_clean":"2023-10-06T01:21:40.817681+0000","last_became_active":"2023-10-06T01:21:36.822002+0000","last_became_peered":"2023-10-06T01:21:36.822002+0000","last_unstale":"2023-10-06T01:21:40.817681+0000","last_undegraded":"2023-10-06T01:21:40.817681+0000","last_fullsized":"2023-10-06T01:21:40.817681+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:21:36.268170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:21:36.268170+0000","last_clean_scrub_stamp":"2023-10-06T01:21:36.268170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:46:14.981833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T01:21:40.825982+0000","last_change":"2023-10-06T01:21:36.841868+0000","last_active":"2023-10-06T01:21:40.825982+0000","last_peered":"2023-10-06T01:21:40.825982+0000","last_clean":"2023-10-06T01:21:40.825982+0000","last_became_active":"2023-10-06T01:21:36.841579+0000","last_became_peered":"2023-10-06T01:21:36.841579+0000","last_unstale":"2023-10-06T01:21:40.825982+0000","last_undegraded":"2023-10-06T01:21:40.825982+0000","last_fullsized":"2023-10-06T01:21:40.825982+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:21:36.268170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:21:36.268170+0000","last_clean_scrub_stamp":"2023-10-06T01:21:36.268170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:44:16.024192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T01:21:40.830265+0000","last_change":"2023-10-06T01:21:36.836541+0000","last_active":"2023-10-06T01:21:40.830265+0000","last_peered":"2023-10-06T01:21:40.830265+0000","last_clean":"2023-10-06T01:21:40.830265+0000","last_became_active":"2023-10-06T01:21:36.836230+0000","last_became_peered":"2023-10-06T01:21:36.836230+0000","last_unstale":"2023-10-06T01:21:40.830265+0000","last_undegraded":"2023-10-06T01:21:40.830265+0000","last_fullsized":"2023-10-06T01:21:40.830265+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:21:36.268170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:21:36.268170+0000","last_clean_scrub_stamp":"2023-10-06T01:21:36.268170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:22:57.339224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T01:21:40.842277+0000","last_change":"2023-10-06T01:21:36.835952+0000","last_active":"2023-10-06T01:21:40.842277+0000","last_peered":"2023-10-06T01:21:40.842277+0000","last_clean":"2023-10-06T01:21:40.842277+0000","last_became_active":"2023-10-06T01:21:36.835674+0000","last_became_peered":"2023-10-06T01:21:36.835674+0000","last_unstale":"2023-10-06T01:21:40.842277+0000","last_undegraded":"2023-10-06T01:21:40.842277+0000","last_fullsized":"2023-10-06T01:21:40.842277+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:21:36.268170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:21:36.268170+0000","last_clean_scrub_stamp":"2023-10-06T01:21:36.268170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:51:16.522318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T01:21:40.823914+0000","last_change":"2023-10-06T01:21:36.837170+0000","last_active":"2023-10-06T01:21:40.823914+0000","last_peered":"2023-10-06T01:21:40.823914+0000","last_clean":"2023-10-06T01:21:40.823914+0000","last_became_active":"2023-10-06T01:21:36.836919+0000","last_became_peered":"2023-10-06T01:21:36.836919+0000","last_unstale":"2023-10-06T01:21:40.823914+0000","last_undegraded":"2023-10-06T01:21:40.823914+0000","last_fullsized":"2023-10-06T01:21:40.823914+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:21:36.268170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:21:36.268170+0000","last_clean_scrub_stamp":"2023-10-06T01:21:36.268170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:32:46.966379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T01:21:40.832089+0000","last_change":"2023-10-06T01:21:36.836732+0000","last_active":"2023-10-06T01:21:40.832089+0000","last_peered":"2023-10-06T01:21:40.832089+0000","last_clean":"2023-10-06T01:21:40.832089+0000","last_became_active":"2023-10-06T01:21:36.835547+0000","last_became_peered":"2023-10-06T01:21:36.835547+0000","last_unstale":"2023-10-06T01:21:40.832089+0000","last_undegraded":"2023-10-06T01:21:40.832089+0000","last_fullsized":"2023-10-06T01:21:40.832089+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:21:36.268170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:21:36.268170+0000","last_clean_scrub_stamp":"2023-10-06T01:21:36.268170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:53:49.542750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T01:21:40.824805+0000","last_change":"2023-10-06T01:21:36.825216+0000","last_active":"2023-10-06T01:21:40.824805+0000","last_peered":"2023-10-06T01:21:40.824805+0000","last_clean":"2023-10-06T01:21:40.824805+0000","last_became_active":"2023-10-06T01:21:36.824966+0000","last_became_peered":"2023-10-06T01:21:36.824966+0000","last_unstale":"2023-10-06T01:21:40.824805+0000","last_undegraded":"2023-10-06T01:21:40.824805+0000","last_fullsized":"2023-10-06T01:21:40.824805+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:21:36.268170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:21:36.268170+0000","last_clean_scrub_stamp":"2023-10-06T01:21:36.268170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:47:05.161793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T01:21:40.825009+0000","last_change":"2023-10-06T01:21:36.814942+0000","last_active":"2023-10-06T01:21:40.825009+0000","last_peered":"2023-10-06T01:21:40.825009+0000","last_clean":"2023-10-06T01:21:40.825009+0000","last_became_active":"2023-10-06T01:21:36.814669+0000","last_became_peered":"2023-10-06T01:21:36.814669+0000","last_unstale":"2023-10-06T01:21:40.825009+0000","last_undegraded":"2023-10-06T01:21:40.825009+0000","last_fullsized":"2023-10-06T01:21:40.825009+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:21:36.268170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:21:36.268170+0000","last_clean_scrub_stamp":"2023-10-06T01:21:36.268170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:25:14.997580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T01:21:40.830312+0000","last_change":"2023-10-06T01:21:36.830638+0000","last_active":"2023-10-06T01:21:40.830312+0000","last_peered":"2023-10-06T01:21:40.830312+0000","last_clean":"2023-10-06T01:21:40.830312+0000","last_became_active":"2023-10-06T01:21:36.830451+0000","last_became_peered":"2023-10-06T01:21:36.830451+0000","last_unstale":"2023-10-06T01:21:40.830312+0000","last_undegraded":"2023-10-06T01:21:40.830312+0000","last_fullsized":"2023-10-06T01:21:40.830312+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:21:36.268170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:21:36.268170+0000","last_clean_scrub_stamp":"2023-10-06T01:21:36.268170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:26:27.490800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T01:21:40.845528+0000","last_change":"2023-10-06T01:21:40.841583+0000","last_active":"2023-10-06T01:21:40.845528+0000","last_peered":"2023-10-06T01:21:40.845528+0000","last_clean":"2023-10-06T01:21:40.845528+0000","last_became_active":"2023-10-06T01:21:40.841186+0000","last_became_peered":"2023-10-06T01:21:40.841186+0000","last_unstale":"2023-10-06T01:21:40.845528+0000","last_undegraded":"2023-10-06T01:21:40.845528+0000","last_fullsized":"2023-10-06T01:21:40.845528+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:21:39.809888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:21:39.809888+0000","last_clean_scrub_stamp":"2023-10-06T01:21:39.809888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:32:16.087643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,2,0],"acting":[4,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1a","version":"20'1","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T01:21:40.824542+0000","last_change":"2023-10-06T01:21:36.304872+0000","last_active":"2023-10-06T01:21:40.824542+0000","last_peered":"2023-10-06T01:21:40.824542+0000","last_clean":"2023-10-06T01:21:40.824542+0000","last_became_active":"2023-10-06T01:21:36.304341+0000","last_became_peered":"2023-10-06T01:21:36.304341+0000","last_unstale":"2023-10-06T01:21:40.824542+0000","last_undegraded":"2023-10-06T01:21:40.824542+0000","last_fullsized":"2023-10-06T01:21:40.824542+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:21:35.260777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:21:35.260777+0000","last_clean_scrub_stamp":"2023-10-06T01:21:35.260777+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:30:20.955423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T01:21:40.824330+0000","last_change":"2023-10-06T01:21:36.829886+0000","last_active":"2023-10-06T01:21:40.824330+0000","last_peered":"2023-10-06T01:21:40.824330+0000","last_clean":"2023-10-06T01:21:40.824330+0000","last_became_active":"2023-10-06T01:21:36.829585+0000","last_became_peered":"2023-10-06T01:21:36.829585+0000","last_unstale":"2023-10-06T01:21:40.824330+0000","last_undegraded":"2023-10-06T01:21:40.824330+0000","last_fullsized":"2023-10-06T01:21:40.824330+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:21:36.268170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:21:36.268170+0000","last_clean_scrub_stamp":"2023-10-06T01:21:36.268170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:51:16.522318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T01:21:40.844382+0000","last_change":"2023-10-06T01:21:40.837198+0000","last_active":"2023-10-06T01:21:40.844382+0000","last_peered":"2023-10-06T01:21:40.844382+0000","last_clean":"2023-10-06T01:21:40.844382+0000","last_became_active":"2023-10-06T01:21:40.836811+0000","last_became_peered":"2023-10-06T01:21:40.836811+0000","last_unstale":"2023-10-06T01:21:40.844382+0000","last_undegraded":"2023-10-06T01:21:40.844382+0000","last_fullsized":"2023-10-06T01:21:40.844382+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:21:39.809888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:21:39.809888+0000","last_clean_scrub_stamp":"2023-10-06T01:21:39.809888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:48:17.365413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,3,7],"acting":[6,4,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T01:21:40.826208+0000","last_change":"2023-10-06T01:21:36.306212+0000","last_active":"2023-10-06T01:21:40.826208+0000","last_peered":"2023-10-06T01:21:40.826208+0000","last_clean":"2023-10-06T01:21:40.826208+0000","last_became_active":"2023-10-06T01:21:36.305708+0000","last_became_peered":"2023-10-06T01:21:36.305708+0000","last_unstale":"2023-10-06T01:21:40.826208+0000","last_undegraded":"2023-10-06T01:21:40.826208+0000","last_fullsized":"2023-10-06T01:21:40.826208+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:21:35.260777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:21:35.260777+0000","last_clean_scrub_stamp":"2023-10-06T01:21:35.260777+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:30:20.955423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T01:21:40.842466+0000","last_change":"2023-10-06T01:21:36.835259+0000","last_active":"2023-10-06T01:21:40.842466+0000","last_peered":"2023-10-06T01:21:40.842466+0000","last_clean":"2023-10-06T01:21:40.842466+0000","last_became_active":"2023-10-06T01:21:36.834601+0000","last_became_peered":"2023-10-06T01:21:36.834601+0000","last_unstale":"2023-10-06T01:21:40.842466+0000","last_undegraded":"2023-10-06T01:21:40.842466+0000","last_fullsized":"2023-10-06T01:21:40.842466+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:21:36.268170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:21:36.268170+0000","last_clean_scrub_stamp":"2023-10-06T01:21:36.268170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:26:27.490800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T01:21:40.861034+0000","last_change":"2023-10-06T01:21:40.859811+0000","last_active":"2023-10-06T01:21:40.861034+0000","last_peered":"2023-10-06T01:21:40.861034+0000","last_clean":"2023-10-06T01:21:40.861034+0000","last_became_active":"2023-10-06T01:21:40.859403+0000","last_became_peered":"2023-10-06T01:21:40.859403+0000","last_unstale":"2023-10-06T01:21:40.861034+0000","last_undegraded":"2023-10-06T01:21:40.861034+0000","last_fullsized":"2023-10-06T01:21:40.861034+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:21:39.809888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:21:39.809888+0000","last_clean_scrub_stamp":"2023-10-06T01:21:39.809888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:57:11.609623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,1,2],"acting":[0,7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T01:21:40.825496+0000","last_change":"2023-10-06T01:21:36.293850+0000","last_active":"2023-10-06T01:21:40.825496+0000","last_peered":"2023-10-06T01:21:40.825496+0000","last_clean":"2023-10-06T01:21:40.825496+0000","last_became_active":"2023-10-06T01:21:36.293488+0000","last_became_peered":"2023-10-06T01:21:36.293488+0000","last_unstale":"2023-10-06T01:21:40.825496+0000","last_undegraded":"2023-10-06T01:21:40.825496+0000","last_fullsized":"2023-10-06T01:21:40.825496+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:21:35.260777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:21:35.260777+0000","last_clean_scrub_stamp":"2023-10-06T01:21:35.260777+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:03:02.138728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T01:21:40.821094+0000","last_change":"2023-10-06T01:21:36.828340+0000","last_active":"2023-10-06T01:21:40.821094+0000","last_peered":"2023-10-06T01:21:40.821094+0000","last_clean":"2023-10-06T01:21:40.821094+0000","last_became_active":"2023-10-06T01:21:36.827891+0000","last_became_peered":"2023-10-06T01:21:36.827891+0000","last_unstale":"2023-10-06T01:21:40.821094+0000","last_undegraded":"2023-10-06T01:21:40.821094+0000","last_fullsized":"2023-10-06T01:21:40.821094+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:21:36.268170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:21:36.268170+0000","last_clean_scrub_stamp":"2023-10-06T01:21:36.268170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:12:59.424963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T01:21:40.844982+0000","last_change":"2023-10-06T01:21:40.837490+0000","last_active":"2023-10-06T01:21:40.844982+0000","last_peered":"2023-10-06T01:21:40.844982+0000","last_clean":"2023-10-06T01:21:40.844982+0000","last_became_active":"2023-10-06T01:21:40.836992+0000","last_became_peered":"2023-10-06T01:21:40.836992+0000","last_unstale":"2023-10-06T01:21:40.844982+0000","last_undegraded":"2023-10-06T01:21:40.844982+0000","last_fullsized":"2023-10-06T01:21:40.844982+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:21:39.809888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:21:39.809888+0000","last_clean_scrub_stamp":"2023-10-06T01:21:39.809888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:08:18.408639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7,1],"acting":[6,4,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T01:21:40.843338+0000","last_change":"2023-10-06T01:21:36.299763+0000","last_active":"2023-10-06T01:21:40.843338+0000","last_peered":"2023-10-06T01:21:40.843338+0000","last_clean":"2023-10-06T01:21:40.843338+0000","last_became_active":"2023-10-06T01:21:36.299294+0000","last_became_peered":"2023-10-06T01:21:36.299294+0000","last_unstale":"2023-10-06T01:21:40.843338+0000","last_undegraded":"2023-10-06T01:21:40.843338+0000","last_fullsized":"2023-10-06T01:21:40.843338+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:21:35.260777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:21:35.260777+0000","last_clean_scrub_stamp":"2023-10-06T01:21:35.260777+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:48:42.234958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T01:21:40.825416+0000","last_change":"2023-10-06T01:21:36.827009+0000","last_active":"2023-10-06T01:21:40.825416+0000","last_peered":"2023-10-06T01:21:40.825416+0000","last_clean":"2023-10-06T01:21:40.825416+0000","last_became_active":"2023-10-06T01:21:36.826543+0000","last_became_peered":"2023-10-06T01:21:36.826543+0000","last_unstale":"2023-10-06T01:21:40.825416+0000","last_undegraded":"2023-10-06T01:21:40.825416+0000","last_fullsized":"2023-10-06T01:21:40.825416+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:21:36.268170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:21:36.268170+0000","last_clean_scrub_stamp":"2023-10-06T01:21:36.268170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:21:06.849534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T01:21:40.852806+0000","last_change":"2023-10-06T01:21:40.847656+0000","last_active":"2023-10-06T01:21:40.852806+0000","last_peered":"2023-10-06T01:21:40.852806+0000","last_clean":"2023-10-06T01:21:40.852806+0000","last_became_active":"2023-10-06T01:21:40.847177+0000","last_became_peered":"2023-10-06T01:21:40.847177+0000","last_unstale":"2023-10-06T01:21:40.852806+0000","last_undegraded":"2023-10-06T01:21:40.852806+0000","last_fullsized":"2023-10-06T01:21:40.852806+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:21:39.809888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:21:39.809888+0000","last_clean_scrub_stamp":"2023-10-06T01:21:39.809888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:57:11.609623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6,0],"acting":[7,4,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T01:21:40.830754+0000","last_change":"2023-10-06T01:21:36.296695+0000","last_active":"2023-10-06T01:21:40.830754+0000","last_peered":"2023-10-06T01:21:40.830754+0000","last_clean":"2023-10-06T01:21:40.830754+0000","last_became_active":"2023-10-06T01:21:36.296338+0000","last_became_peered":"2023-10-06T01:21:36.296338+0000","last_unstale":"2023-10-06T01:21:40.830754+0000","last_undegraded":"2023-10-06T01:21:40.830754+0000","last_fullsized":"2023-10-06T01:21:40.830754+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:21:35.260777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:21:35.260777+0000","last_clean_scrub_stamp":"2023-10-06T01:21:35.260777+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:13:12.787972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T01:21:40.823710+0000","last_change":"2023-10-06T01:21:36.830617+0000","last_active":"2023-10-06T01:21:40.823710+0000","last_peered":"2023-10-06T01:21:40.823710+0000","last_clean":"2023-10-06T01:21:40.823710+0000","last_became_active":"2023-10-06T01:21:36.830336+0000","last_became_peered":"2023-10-06T01:21:36.830336+0000","last_unstale":"2023-10-06T01:21:40.823710+0000","last_undegraded":"2023-10-06T01:21:40.823710+0000","last_fullsized":"2023-10-06T01:21:40.823710+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:21:36.268170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:21:36.268170+0000","last_clean_scrub_stamp":"2023-10-06T01:21:36.268170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:48:35.151895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T01:21:40.860402+0000","last_change":"2023-10-06T01:21:40.848992+0000","last_active":"2023-10-06T01:21:40.860402+0000","last_peered":"2023-10-06T01:21:40.860402+0000","last_clean":"2023-10-06T01:21:40.860402+0000","last_became_active":"2023-10-06T01:21:40.848631+0000","last_became_peered":"2023-10-06T01:21:40.848631+0000","last_unstale":"2023-10-06T01:21:40.860402+0000","last_undegraded":"2023-10-06T01:21:40.860402+0000","last_fullsized":"2023-10-06T01:21:40.860402+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:21:39.809888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:21:39.809888+0000","last_clean_scrub_stamp":"2023-10-06T01:21:39.809888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:11:30.651756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,5],"acting":[3,0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"20'3","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T01:21:40.831260+0000","last_change":"2023-10-06T01:21:36.302987+0000","last_active":"2023-10-06T01:21:40.831260+0000","last_peered":"2023-10-06T01:21:40.831260+0000","last_clean":"2023-10-06T01:21:40.831260+0000","last_became_active":"2023-10-06T01:21:36.302712+0000","last_became_peered":"2023-10-06T01:21:36.302712+0000","last_unstale":"2023-10-06T01:21:40.831260+0000","last_undegraded":"2023-10-06T01:21:40.831260+0000","last_fullsized":"2023-10-06T01:21:40.831260+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:21:35.260777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:21:35.260777+0000","last_clean_scrub_stamp":"2023-10-06T01:21:35.260777+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:47:04.154399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T01:21:40.825424+0000","last_change":"2023-10-06T01:21:36.829217+0000","last_active":"2023-10-06T01:21:40.825424+0000","last_peered":"2023-10-06T01:21:40.825424+0000","last_clean":"2023-10-06T01:21:40.825424+0000","last_became_active":"2023-10-06T01:21:36.828005+0000","last_became_peered":"2023-10-06T01:21:36.828005+0000","last_unstale":"2023-10-06T01:21:40.825424+0000","last_undegraded":"2023-10-06T01:21:40.825424+0000","last_fullsized":"2023-10-06T01:21:40.825424+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:21:36.268170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:21:36.268170+0000","last_clean_scrub_stamp":"2023-10-06T01:21:36.268170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:12:59.424963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T01:21:40.844125+0000","last_change":"2023-10-06T01:21:40.838989+0000","last_active":"2023-10-06T01:21:40.844125+0000","last_peered":"2023-10-06T01:21:40.844125+0000","last_clean":"2023-10-06T01:21:40.844125+0000","last_became_active":"2023-10-06T01:21:40.837659+0000","last_became_peered":"2023-10-06T01:21:40.837659+0000","last_unstale":"2023-10-06T01:21:40.844125+0000","last_undegraded":"2023-10-06T01:21:40.844125+0000","last_fullsized":"2023-10-06T01:21:40.844125+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:21:39.809888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:21:39.809888+0000","last_clean_scrub_stamp":"2023-10-06T01:21:39.809888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:39:50.108444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,3,7],"acting":[1,5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"25'9","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-06T01:21:49.958650+0000","last_change":"2023-10-06T01:21:36.301140+0000","last_active":"2023-10-06T01:21:49.958650+0000","last_peered":"2023-10-06T01:21:49.958650+0000","last_clean":"2023-10-06T01:21:49.958650+0000","last_became_active":"2023-10-06T01:21:36.296099+0000","last_became_peered":"2023-10-06T01:21:36.296099+0000","last_unstale":"2023-10-06T01:21:49.958650+0000","last_undegraded":"2023-10-06T01:21:49.958650+0000","last_fullsized":"2023-10-06T01:21:49.958650+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:21:35.260777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:21:35.260777+0000","last_clean_scrub_stamp":"2023-10-06T01:21:35.260777+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:03:02.138728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3714,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T01:21:40.826661+0000","last_change":"2023-10-06T01:21:36.842618+0000","last_active":"2023-10-06T01:21:40.826661+0000","last_peered":"2023-10-06T01:21:40.826661+0000","last_clean":"2023-10-06T01:21:40.826661+0000","last_became_active":"2023-10-06T01:21:36.842343+0000","last_became_peered":"2023-10-06T01:21:36.842343+0000","last_unstale":"2023-10-06T01:21:40.826661+0000","last_undegraded":"2023-10-06T01:21:40.826661+0000","last_fullsized":"2023-10-06T01:21:40.826661+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:21:36.268170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:21:36.268170+0000","last_clean_scrub_stamp":"2023-10-06T01:21:36.268170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:21:33.868021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T01:21:40.851721+0000","last_change":"2023-10-06T01:21:40.849230+0000","last_active":"2023-10-06T01:21:40.851721+0000","last_peered":"2023-10-06T01:21:40.851721+0000","last_clean":"2023-10-06T01:21:40.851721+0000","last_became_active":"2023-10-06T01:21:40.848850+0000","last_became_peered":"2023-10-06T01:21:40.848850+0000","last_unstale":"2023-10-06T01:21:40.851721+0000","last_undegraded":"2023-10-06T01:21:40.851721+0000","last_fullsized":"2023-10-06T01:21:40.851721+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:21:39.809888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:21:39.809888+0000","last_clean_scrub_stamp":"2023-10-06T01:21:39.809888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:31:58.220361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,3,0],"acting":[5,1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"20'2","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T01:21:40.830178+0000","last_change":"2023-10-06T01:21:36.307193+0000","last_active":"2023-10-06T01:21:40.830178+0000","last_peered":"2023-10-06T01:21:40.830178+0000","last_clean":"2023-10-06T01:21:40.830178+0000","last_became_active":"2023-10-06T01:21:36.306908+0000","last_became_peered":"2023-10-06T01:21:36.306908+0000","last_unstale":"2023-10-06T01:21:40.830178+0000","last_undegraded":"2023-10-06T01:21:40.830178+0000","last_fullsized":"2023-10-06T01:21:40.830178+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:21:35.260777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:21:35.260777+0000","last_clean_scrub_stamp":"2023-10-06T01:21:35.260777+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:38:59.100770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T01:21:40.823389+0000","last_change":"2023-10-06T01:21:36.826306+0000","last_active":"2023-10-06T01:21:40.823389+0000","last_peered":"2023-10-06T01:21:40.823389+0000","last_clean":"2023-10-06T01:21:40.823389+0000","last_became_active":"2023-10-06T01:21:36.826052+0000","last_became_peered":"2023-10-06T01:21:36.826052+0000","last_unstale":"2023-10-06T01:21:40.823389+0000","last_undegraded":"2023-10-06T01:21:40.823389+0000","last_fullsized":"2023-10-06T01:21:40.823389+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:21:36.268170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:21:36.268170+0000","last_clean_scrub_stamp":"2023-10-06T01:21:36.268170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:30:56.051770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T01:21:40.848294+0000","last_change":"2023-10-06T01:21:40.843226+0000","last_active":"2023-10-06T01:21:40.848294+0000","last_peered":"2023-10-06T01:21:40.848294+0000","last_clean":"2023-10-06T01:21:40.848294+0000","last_became_active":"2023-10-06T01:21:40.841607+0000","last_became_peered":"2023-10-06T01:21:40.841607+0000","last_unstale":"2023-10-06T01:21:40.848294+0000","last_undegraded":"2023-10-06T01:21:40.848294+0000","last_fullsized":"2023-10-06T01:21:40.848294+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:21:39.809888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:21:39.809888+0000","last_clean_scrub_stamp":"2023-10-06T01:21:39.809888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:54:53.178521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,2,1],"acting":[3,7,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T01:21:40.842017+0000","last_change":"2023-10-06T01:21:36.301285+0000","last_active":"2023-10-06T01:21:40.842017+0000","last_peered":"2023-10-06T01:21:40.842017+0000","last_clean":"2023-10-06T01:21:40.842017+0000","last_became_active":"2023-10-06T01:21:36.300676+0000","last_became_peered":"2023-10-06T01:21:36.300676+0000","last_unstale":"2023-10-06T01:21:40.842017+0000","last_undegraded":"2023-10-06T01:21:40.842017+0000","last_fullsized":"2023-10-06T01:21:40.842017+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:21:35.260777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:21:35.260777+0000","last_clean_scrub_stamp":"2023-10-06T01:21:35.260777+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:13:12.787972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T01:21:40.830219+0000","last_change":"2023-10-06T01:21:36.826226+0000","last_active":"2023-10-06T01:21:40.830219+0000","last_peered":"2023-10-06T01:21:40.830219+0000","last_clean":"2023-10-06T01:21:40.830219+0000","last_became_active":"2023-10-06T01:21:36.825921+0000","last_became_peered":"2023-10-06T01:21:36.825921+0000","last_unstale":"2023-10-06T01:21:40.830219+0000","last_undegraded":"2023-10-06T01:21:40.830219+0000","last_fullsized":"2023-10-06T01:21:40.830219+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:21:36.268170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:21:36.268170+0000","last_clean_scrub_stamp":"2023-10-06T01:21:36.268170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:01:50.180814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T01:21:40.859960+0000","last_change":"2023-10-06T01:21:40.845788+0000","last_active":"2023-10-06T01:21:40.859960+0000","last_peered":"2023-10-06T01:21:40.859960+0000","last_clean":"2023-10-06T01:21:40.859960+0000","last_became_active":"2023-10-06T01:21:40.845410+0000","last_became_peered":"2023-10-06T01:21:40.845410+0000","last_unstale":"2023-10-06T01:21:40.859960+0000","last_undegraded":"2023-10-06T01:21:40.859960+0000","last_fullsized":"2023-10-06T01:21:40.859960+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:21:39.809888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:21:39.809888+0000","last_clean_scrub_stamp":"2023-10-06T01:21:39.809888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:35:36.949771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,0],"acting":[3,1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T01:21:40.829873+0000","last_change":"2023-10-06T01:21:36.307137+0000","last_active":"2023-10-06T01:21:40.829873+0000","last_peered":"2023-10-06T01:21:40.829873+0000","last_clean":"2023-10-06T01:21:40.829873+0000","last_became_active":"2023-10-06T01:21:36.306781+0000","last_became_peered":"2023-10-06T01:21:36.306781+0000","last_unstale":"2023-10-06T01:21:40.829873+0000","last_undegraded":"2023-10-06T01:21:40.829873+0000","last_fullsized":"2023-10-06T01:21:40.829873+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:21:35.260777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:21:35.260777+0000","last_clean_scrub_stamp":"2023-10-06T01:21:35.260777+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:13:12.787972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T01:21:40.842737+0000","last_change":"2023-10-06T01:21:36.838019+0000","last_active":"2023-10-06T01:21:40.842737+0000","last_peered":"2023-10-06T01:21:40.842737+0000","last_clean":"2023-10-06T01:21:40.842737+0000","last_became_active":"2023-10-06T01:21:36.837484+0000","last_became_peered":"2023-10-06T01:21:36.837484+0000","last_unstale":"2023-10-06T01:21:40.842737+0000","last_undegraded":"2023-10-06T01:21:40.842737+0000","last_fullsized":"2023-10-06T01:21:40.842737+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:21:36.268170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:21:36.268170+0000","last_clean_scrub_stamp":"2023-10-06T01:21:36.268170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:26:07.073491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T01:21:40.849782+0000","last_change":"2023-10-06T01:21:40.846902+0000","last_active":"2023-10-06T01:21:40.849782+0000","last_peered":"2023-10-06T01:21:40.849782+0000","last_clean":"2023-10-06T01:21:40.849782+0000","last_became_active":"2023-10-06T01:21:40.846515+0000","last_became_peered":"2023-10-06T01:21:40.846515+0000","last_unstale":"2023-10-06T01:21:40.849782+0000","last_undegraded":"2023-10-06T01:21:40.849782+0000","last_fullsized":"2023-10-06T01:21:40.849782+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:21:39.809888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:21:39.809888+0000","last_clean_scrub_stamp":"2023-10-06T01:21:39.809888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:17:23.971056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,1,6],"acting":[5,3,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"20'8","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T01:21:40.820366+0000","last_change":"2023-10-06T01:21:36.314508+0000","last_active":"2023-10-06T01:21:40.820366+0000","last_peered":"2023-10-06T01:21:40.820366+0000","last_clean":"2023-10-06T01:21:40.820366+0000","last_became_active":"2023-10-06T01:21:36.314195+0000","last_became_peered":"2023-10-06T01:21:36.314195+0000","last_unstale":"2023-10-06T01:21:40.820366+0000","last_undegraded":"2023-10-06T01:21:40.820366+0000","last_fullsized":"2023-10-06T01:21:40.820366+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:21:35.260777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:21:35.260777+0000","last_clean_scrub_stamp":"2023-10-06T01:21:35.260777+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:54:55.305083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T01:21:40.824505+0000","last_change":"2023-10-06T01:21:36.831875+0000","last_active":"2023-10-06T01:21:40.824505+0000","last_peered":"2023-10-06T01:21:40.824505+0000","last_clean":"2023-10-06T01:21:40.824505+0000","last_became_active":"2023-10-06T01:21:36.831328+0000","last_became_peered":"2023-10-06T01:21:36.831328+0000","last_unstale":"2023-10-06T01:21:40.824505+0000","last_undegraded":"2023-10-06T01:21:40.824505+0000","last_fullsized":"2023-10-06T01:21:40.824505+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:21:36.268170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:21:36.268170+0000","last_clean_scrub_stamp":"2023-10-06T01:21:36.268170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:03:40.763134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T01:21:40.851310+0000","last_change":"2023-10-06T01:21:40.846661+0000","last_active":"2023-10-06T01:21:40.851310+0000","last_peered":"2023-10-06T01:21:40.851310+0000","last_clean":"2023-10-06T01:21:40.851310+0000","last_became_active":"2023-10-06T01:21:40.845846+0000","last_became_peered":"2023-10-06T01:21:40.845846+0000","last_unstale":"2023-10-06T01:21:40.851310+0000","last_undegraded":"2023-10-06T01:21:40.851310+0000","last_fullsized":"2023-10-06T01:21:40.851310+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:21:39.809888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:21:39.809888+0000","last_clean_scrub_stamp":"2023-10-06T01:21:39.809888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:26:15.414115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,3,4],"acting":[7,6,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.f","version":"20'1","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T01:21:40.831539+0000","last_change":"2023-10-06T01:21:36.307931+0000","last_active":"2023-10-06T01:21:40.831539+0000","last_peered":"2023-10-06T01:21:40.831539+0000","last_clean":"2023-10-06T01:21:40.831539+0000","last_became_active":"2023-10-06T01:21:36.307539+0000","last_became_peered":"2023-10-06T01:21:36.307539+0000","last_unstale":"2023-10-06T01:21:40.831539+0000","last_undegraded":"2023-10-06T01:21:40.831539+0000","last_fullsized":"2023-10-06T01:21:40.831539+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:21:35.260777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:21:35.260777+0000","last_clean_scrub_stamp":"2023-10-06T01:21:35.260777+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:28:28.246900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T01:21:40.827851+0000","last_change":"2023-10-06T01:21:36.824841+0000","last_active":"2023-10-06T01:21:40.827851+0000","last_peered":"2023-10-06T01:21:40.827851+0000","last_clean":"2023-10-06T01:21:40.827851+0000","last_became_active":"2023-10-06T01:21:36.824575+0000","last_became_peered":"2023-10-06T01:21:36.824575+0000","last_unstale":"2023-10-06T01:21:40.827851+0000","last_undegraded":"2023-10-06T01:21:40.827851+0000","last_fullsized":"2023-10-06T01:21:40.827851+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:21:36.268170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:21:36.268170+0000","last_clean_scrub_stamp":"2023-10-06T01:21:36.268170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:27:54.680295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T01:21:40.850673+0000","last_change":"2023-10-06T01:21:40.844715+0000","last_active":"2023-10-06T01:21:40.850673+0000","last_peered":"2023-10-06T01:21:40.850673+0000","last_clean":"2023-10-06T01:21:40.850673+0000","last_became_active":"2023-10-06T01:21:40.843713+0000","last_became_peered":"2023-10-06T01:21:40.843713+0000","last_unstale":"2023-10-06T01:21:40.850673+0000","last_undegraded":"2023-10-06T01:21:40.850673+0000","last_fullsized":"2023-10-06T01:21:40.850673+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:21:39.809888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:21:39.809888+0000","last_clean_scrub_stamp":"2023-10-06T01:21:39.809888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:59:32.714013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,5],"acting":[2,0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"20'2","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T01:21:40.831428+0000","last_change":"2023-10-06T01:21:36.307165+0000","last_active":"2023-10-06T01:21:40.831428+0000","last_peered":"2023-10-06T01:21:40.831428+0000","last_clean":"2023-10-06T01:21:40.831428+0000","last_became_active":"2023-10-06T01:21:36.306877+0000","last_became_peered":"2023-10-06T01:21:36.306877+0000","last_unstale":"2023-10-06T01:21:40.831428+0000","last_undegraded":"2023-10-06T01:21:40.831428+0000","last_fullsized":"2023-10-06T01:21:40.831428+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:21:35.260777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:21:35.260777+0000","last_clean_scrub_stamp":"2023-10-06T01:21:35.260777+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:38:56.761956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T01:21:40.827687+0000","last_change":"2023-10-06T01:21:36.840414+0000","last_active":"2023-10-06T01:21:40.827687+0000","last_peered":"2023-10-06T01:21:40.827687+0000","last_clean":"2023-10-06T01:21:40.827687+0000","last_became_active":"2023-10-06T01:21:36.840067+0000","last_became_peered":"2023-10-06T01:21:36.840067+0000","last_unstale":"2023-10-06T01:21:40.827687+0000","last_undegraded":"2023-10-06T01:21:40.827687+0000","last_fullsized":"2023-10-06T01:21:40.827687+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:21:36.268170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:21:36.268170+0000","last_clean_scrub_stamp":"2023-10-06T01:21:36.268170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:48:18.526486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T01:21:40.849984+0000","last_change":"2023-10-06T01:21:40.841506+0000","last_active":"2023-10-06T01:21:40.849984+0000","last_peered":"2023-10-06T01:21:40.849984+0000","last_clean":"2023-10-06T01:21:40.849984+0000","last_became_active":"2023-10-06T01:21:40.840966+0000","last_became_peered":"2023-10-06T01:21:40.840966+0000","last_unstale":"2023-10-06T01:21:40.849984+0000","last_undegraded":"2023-10-06T01:21:40.849984+0000","last_fullsized":"2023-10-06T01:21:40.849984+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:21:39.809888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:21:39.809888+0000","last_clean_scrub_stamp":"2023-10-06T01:21:39.809888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:48:17.365413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5,6],"acting":[2,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"20'1","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T01:21:40.831177+0000","last_change":"2023-10-06T01:21:36.296492+0000","last_active":"2023-10-06T01:21:40.831177+0000","last_peered":"2023-10-06T01:21:40.831177+0000","last_clean":"2023-10-06T01:21:40.831177+0000","last_became_active":"2023-10-06T01:21:36.296064+0000","last_became_peered":"2023-10-06T01:21:36.296064+0000","last_unstale":"2023-10-06T01:21:40.831177+0000","last_undegraded":"2023-10-06T01:21:40.831177+0000","last_fullsized":"2023-10-06T01:21:40.831177+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:21:35.260777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:21:35.260777+0000","last_clean_scrub_stamp":"2023-10-06T01:21:35.260777+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:53:26.082920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T01:21:40.820682+0000","last_change":"2023-10-06T01:21:36.833212+0000","last_active":"2023-10-06T01:21:40.820682+0000","last_peered":"2023-10-06T01:21:40.820682+0000","last_clean":"2023-10-06T01:21:40.820682+0000","last_became_active":"2023-10-06T01:21:36.832753+0000","last_became_peered":"2023-10-06T01:21:36.832753+0000","last_unstale":"2023-10-06T01:21:40.820682+0000","last_undegraded":"2023-10-06T01:21:40.820682+0000","last_fullsized":"2023-10-06T01:21:40.820682+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:21:36.268170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:21:36.268170+0000","last_clean_scrub_stamp":"2023-10-06T01:21:36.268170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:47:05.161793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T01:21:40.839046+0000","last_change":"2023-10-06T01:21:40.837287+0000","last_active":"2023-10-06T01:21:40.839046+0000","last_peered":"2023-10-06T01:21:40.839046+0000","last_clean":"2023-10-06T01:21:40.839046+0000","last_became_active":"2023-10-06T01:21:40.836599+0000","last_became_peered":"2023-10-06T01:21:40.836599+0000","last_unstale":"2023-10-06T01:21:40.839046+0000","last_undegraded":"2023-10-06T01:21:40.839046+0000","last_fullsized":"2023-10-06T01:21:40.839046+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:21:39.809888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:21:39.809888+0000","last_clean_scrub_stamp":"2023-10-06T01:21:39.809888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:51:20.064036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3,6],"acting":[2,4,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T01:21:40.829807+0000","last_change":"2023-10-06T01:21:36.304239+0000","last_active":"2023-10-06T01:21:40.829807+0000","last_peered":"2023-10-06T01:21:40.829807+0000","last_clean":"2023-10-06T01:21:40.829807+0000","last_became_active":"2023-10-06T01:21:36.303858+0000","last_became_peered":"2023-10-06T01:21:36.303858+0000","last_unstale":"2023-10-06T01:21:40.829807+0000","last_undegraded":"2023-10-06T01:21:40.829807+0000","last_fullsized":"2023-10-06T01:21:40.829807+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:21:35.260777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:21:35.260777+0000","last_clean_scrub_stamp":"2023-10-06T01:21:35.260777+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:54:55.305083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T01:21:40.844788+0000","last_change":"2023-10-06T01:21:36.835234+0000","last_active":"2023-10-06T01:21:40.844788+0000","last_peered":"2023-10-06T01:21:40.844788+0000","last_clean":"2023-10-06T01:21:40.844788+0000","last_became_active":"2023-10-06T01:21:36.834751+0000","last_became_peered":"2023-10-06T01:21:36.834751+0000","last_unstale":"2023-10-06T01:21:40.844788+0000","last_undegraded":"2023-10-06T01:21:40.844788+0000","last_fullsized":"2023-10-06T01:21:40.844788+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:21:36.268170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:21:36.268170+0000","last_clean_scrub_stamp":"2023-10-06T01:21:36.268170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:22:57.339224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T01:21:40.848598+0000","last_change":"2023-10-06T01:21:40.839486+0000","last_active":"2023-10-06T01:21:40.848598+0000","last_peered":"2023-10-06T01:21:40.848598+0000","last_clean":"2023-10-06T01:21:40.848598+0000","last_became_active":"2023-10-06T01:21:40.839013+0000","last_became_peered":"2023-10-06T01:21:40.839013+0000","last_unstale":"2023-10-06T01:21:40.848598+0000","last_undegraded":"2023-10-06T01:21:40.848598+0000","last_fullsized":"2023-10-06T01:21:40.848598+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:21:39.809888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:21:39.809888+0000","last_clean_scrub_stamp":"2023-10-06T01:21:39.809888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:44:19.565910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,5,6],"acting":[2,7,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"20'2","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T01:21:40.825787+0000","last_change":"2023-10-06T01:21:36.302862+0000","last_active":"2023-10-06T01:21:40.825787+0000","last_peered":"2023-10-06T01:21:40.825787+0000","last_clean":"2023-10-06T01:21:40.825787+0000","last_became_active":"2023-10-06T01:21:36.302568+0000","last_became_peered":"2023-10-06T01:21:36.302568+0000","last_unstale":"2023-10-06T01:21:40.825787+0000","last_undegraded":"2023-10-06T01:21:40.825787+0000","last_fullsized":"2023-10-06T01:21:40.825787+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:21:35.260777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:21:35.260777+0000","last_clean_scrub_stamp":"2023-10-06T01:21:35.260777+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:54:55.305083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T01:21:40.825801+0000","last_change":"2023-10-06T01:21:36.840041+0000","last_active":"2023-10-06T01:21:40.825801+0000","last_peered":"2023-10-06T01:21:40.825801+0000","last_clean":"2023-10-06T01:21:40.825801+0000","last_became_active":"2023-10-06T01:21:36.839757+0000","last_became_peered":"2023-10-06T01:21:36.839757+0000","last_unstale":"2023-10-06T01:21:40.825801+0000","last_undegraded":"2023-10-06T01:21:40.825801+0000","last_fullsized":"2023-10-06T01:21:40.825801+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:21:36.268170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:21:36.268170+0000","last_clean_scrub_stamp":"2023-10-06T01:21:36.268170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:32:46.966379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T01:21:40.858246+0000","last_change":"2023-10-06T01:21:40.855180+0000","last_active":"2023-10-06T01:21:40.858246+0000","last_peered":"2023-10-06T01:21:40.858246+0000","last_clean":"2023-10-06T01:21:40.858246+0000","last_became_active":"2023-10-06T01:21:40.854696+0000","last_became_peered":"2023-10-06T01:21:40.854696+0000","last_unstale":"2023-10-06T01:21:40.858246+0000","last_undegraded":"2023-10-06T01:21:40.858246+0000","last_fullsized":"2023-10-06T01:21:40.858246+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:21:39.809888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:21:39.809888+0000","last_clean_scrub_stamp":"2023-10-06T01:21:39.809888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:17:23.971056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0,6],"acting":[1,4,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T01:21:40.820767+0000","last_change":"2023-10-06T01:21:36.305613+0000","last_active":"2023-10-06T01:21:40.820767+0000","last_peered":"2023-10-06T01:21:40.820767+0000","last_clean":"2023-10-06T01:21:40.820767+0000","last_became_active":"2023-10-06T01:21:36.305297+0000","last_became_peered":"2023-10-06T01:21:36.305297+0000","last_unstale":"2023-10-06T01:21:40.820767+0000","last_undegraded":"2023-10-06T01:21:40.820767+0000","last_fullsized":"2023-10-06T01:21:40.820767+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:21:35.260777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:21:35.260777+0000","last_clean_scrub_stamp":"2023-10-06T01:21:35.260777+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:03:02.138728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T01:21:40.825239+0000","last_change":"2023-10-06T01:21:36.834711+0000","last_active":"2023-10-06T01:21:40.825239+0000","last_peered":"2023-10-06T01:21:40.825239+0000","last_clean":"2023-10-06T01:21:40.825239+0000","last_became_active":"2023-10-06T01:21:36.833708+0000","last_became_peered":"2023-10-06T01:21:36.833708+0000","last_unstale":"2023-10-06T01:21:40.825239+0000","last_undegraded":"2023-10-06T01:21:40.825239+0000","last_fullsized":"2023-10-06T01:21:40.825239+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:21:36.268170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:21:36.268170+0000","last_clean_scrub_stamp":"2023-10-06T01:21:36.268170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:30:56.051770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T01:21:40.849727+0000","last_change":"2023-10-06T01:21:40.847193+0000","last_active":"2023-10-06T01:21:40.849727+0000","last_peered":"2023-10-06T01:21:40.849727+0000","last_clean":"2023-10-06T01:21:40.849727+0000","last_became_active":"2023-10-06T01:21:40.846404+0000","last_became_peered":"2023-10-06T01:21:40.846404+0000","last_unstale":"2023-10-06T01:21:40.849727+0000","last_undegraded":"2023-10-06T01:21:40.849727+0000","last_fullsized":"2023-10-06T01:21:40.849727+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:21:39.809888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:21:39.809888+0000","last_clean_scrub_stamp":"2023-10-06T01:21:39.809888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:37:36.730320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6,2],"acting":[5,4,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T01:21:40.827525+0000","last_change":"2023-10-06T01:21:36.301030+0000","last_active":"2023-10-06T01:21:40.827525+0000","last_peered":"2023-10-06T01:21:40.827525+0000","last_clean":"2023-10-06T01:21:40.827525+0000","last_became_active":"2023-10-06T01:21:36.300725+0000","last_became_peered":"2023-10-06T01:21:36.300725+0000","last_unstale":"2023-10-06T01:21:40.827525+0000","last_undegraded":"2023-10-06T01:21:40.827525+0000","last_fullsized":"2023-10-06T01:21:40.827525+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:21:35.260777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:21:35.260777+0000","last_clean_scrub_stamp":"2023-10-06T01:21:35.260777+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:33:04.318590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T01:21:40.827164+0000","last_change":"2023-10-06T01:21:36.841950+0000","last_active":"2023-10-06T01:21:40.827164+0000","last_peered":"2023-10-06T01:21:40.827164+0000","last_clean":"2023-10-06T01:21:40.827164+0000","last_became_active":"2023-10-06T01:21:36.841666+0000","last_became_peered":"2023-10-06T01:21:36.841666+0000","last_unstale":"2023-10-06T01:21:40.827164+0000","last_undegraded":"2023-10-06T01:21:40.827164+0000","last_fullsized":"2023-10-06T01:21:40.827164+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:21:36.268170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:21:36.268170+0000","last_clean_scrub_stamp":"2023-10-06T01:21:36.268170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:48:35.151895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T01:21:40.851364+0000","last_change":"2023-10-06T01:21:40.843838+0000","last_active":"2023-10-06T01:21:40.851364+0000","last_peered":"2023-10-06T01:21:40.851364+0000","last_clean":"2023-10-06T01:21:40.851364+0000","last_became_active":"2023-10-06T01:21:40.843470+0000","last_became_peered":"2023-10-06T01:21:40.843470+0000","last_unstale":"2023-10-06T01:21:40.851364+0000","last_undegraded":"2023-10-06T01:21:40.851364+0000","last_fullsized":"2023-10-06T01:21:40.851364+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:21:39.809888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:21:39.809888+0000","last_clean_scrub_stamp":"2023-10-06T01:21:39.809888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:49:27.574363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,0,2],"acting":[4,5,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T01:21:40.825329+0000","last_change":"2023-10-06T01:21:36.306829+0000","last_active":"2023-10-06T01:21:40.825329+0000","last_peered":"2023-10-06T01:21:40.825329+0000","last_clean":"2023-10-06T01:21:40.825329+0000","last_became_active":"2023-10-06T01:21:36.306636+0000","last_became_peered":"2023-10-06T01:21:36.306636+0000","last_unstale":"2023-10-06T01:21:40.825329+0000","last_undegraded":"2023-10-06T01:21:40.825329+0000","last_fullsized":"2023-10-06T01:21:40.825329+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:21:35.260777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:21:35.260777+0000","last_clean_scrub_stamp":"2023-10-06T01:21:35.260777+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:13:12.787972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T01:21:40.825013+0000","last_change":"2023-10-06T01:21:36.827181+0000","last_active":"2023-10-06T01:21:40.825013+0000","last_peered":"2023-10-06T01:21:40.825013+0000","last_clean":"2023-10-06T01:21:40.825013+0000","last_became_active":"2023-10-06T01:21:36.826926+0000","last_became_peered":"2023-10-06T01:21:36.826926+0000","last_unstale":"2023-10-06T01:21:40.825013+0000","last_undegraded":"2023-10-06T01:21:40.825013+0000","last_fullsized":"2023-10-06T01:21:40.825013+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:21:36.268170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:21:36.268170+0000","last_clean_scrub_stamp":"2023-10-06T01:21:36.268170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:50:38.966977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T01:21:40.848984+0000","last_change":"2023-10-06T01:21:40.842824+0000","last_active":"2023-10-06T01:21:40.848984+0000","last_peered":"2023-10-06T01:21:40.848984+0000","last_clean":"2023-10-06T01:21:40.848984+0000","last_became_active":"2023-10-06T01:21:40.842426+0000","last_became_peered":"2023-10-06T01:21:40.842426+0000","last_unstale":"2023-10-06T01:21:40.848984+0000","last_undegraded":"2023-10-06T01:21:40.848984+0000","last_fullsized":"2023-10-06T01:21:40.848984+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:21:39.809888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:21:39.809888+0000","last_clean_scrub_stamp":"2023-10-06T01:21:39.809888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:12:51.722789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,7,0],"acting":[4,3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"20'2","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T01:21:40.824298+0000","last_change":"2023-10-06T01:21:36.302700+0000","last_active":"2023-10-06T01:21:40.824298+0000","last_peered":"2023-10-06T01:21:40.824298+0000","last_clean":"2023-10-06T01:21:40.824298+0000","last_became_active":"2023-10-06T01:21:36.302436+0000","last_became_peered":"2023-10-06T01:21:36.302436+0000","last_unstale":"2023-10-06T01:21:40.824298+0000","last_undegraded":"2023-10-06T01:21:40.824298+0000","last_fullsized":"2023-10-06T01:21:40.824298+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:21:35.260777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:21:35.260777+0000","last_clean_scrub_stamp":"2023-10-06T01:21:35.260777+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:28:28.246900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T01:21:40.825404+0000","last_change":"2023-10-06T01:21:30.601117+0000","last_active":"2023-10-06T01:21:40.825404+0000","last_peered":"2023-10-06T01:21:40.825404+0000","last_clean":"2023-10-06T01:21:40.825404+0000","last_became_active":"2023-10-06T01:21:30.600724+0000","last_became_peered":"2023-10-06T01:21:30.600724+0000","last_unstale":"2023-10-06T01:21:40.825404+0000","last_undegraded":"2023-10-06T01:21:40.825404+0000","last_fullsized":"2023-10-06T01:21:40.825404+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:21:29.586558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:21:29.586558+0000","last_clean_scrub_stamp":"2023-10-06T01:21:29.586558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:47:24.449013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T01:21:40.825234+0000","last_change":"2023-10-06T01:21:36.824653+0000","last_active":"2023-10-06T01:21:40.825234+0000","last_peered":"2023-10-06T01:21:40.825234+0000","last_clean":"2023-10-06T01:21:40.825234+0000","last_became_active":"2023-10-06T01:21:36.824411+0000","last_became_peered":"2023-10-06T01:21:36.824411+0000","last_unstale":"2023-10-06T01:21:40.825234+0000","last_undegraded":"2023-10-06T01:21:40.825234+0000","last_fullsized":"2023-10-06T01:21:40.825234+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:21:36.268170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:21:36.268170+0000","last_clean_scrub_stamp":"2023-10-06T01:21:36.268170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:22:57.339224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T01:21:40.863893+0000","last_change":"2023-10-06T01:21:40.862887+0000","last_active":"2023-10-06T01:21:40.863893+0000","last_peered":"2023-10-06T01:21:40.863893+0000","last_clean":"2023-10-06T01:21:40.863893+0000","last_became_active":"2023-10-06T01:21:40.862455+0000","last_became_peered":"2023-10-06T01:21:40.862455+0000","last_unstale":"2023-10-06T01:21:40.863893+0000","last_undegraded":"2023-10-06T01:21:40.863893+0000","last_fullsized":"2023-10-06T01:21:40.863893+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:21:39.809888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:21:39.809888+0000","last_clean_scrub_stamp":"2023-10-06T01:21:39.809888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:31:58.220361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,0],"acting":[3,1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T01:21:40.823254+0000","last_change":"2023-10-06T01:21:30.603434+0000","last_active":"2023-10-06T01:21:40.823254+0000","last_peered":"2023-10-06T01:21:40.823254+0000","last_clean":"2023-10-06T01:21:40.823254+0000","last_became_active":"2023-10-06T01:21:30.603215+0000","last_became_peered":"2023-10-06T01:21:30.603215+0000","last_unstale":"2023-10-06T01:21:40.823254+0000","last_undegraded":"2023-10-06T01:21:40.823254+0000","last_fullsized":"2023-10-06T01:21:40.823254+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:21:29.586558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:21:29.586558+0000","last_clean_scrub_stamp":"2023-10-06T01:21:29.586558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:47:24.449013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"23'1","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T01:21:40.840164+0000","last_change":"2023-10-06T01:21:36.314457+0000","last_active":"2023-10-06T01:21:40.840164+0000","last_peered":"2023-10-06T01:21:40.840164+0000","last_clean":"2023-10-06T01:21:40.840164+0000","last_became_active":"2023-10-06T01:21:36.314115+0000","last_became_peered":"2023-10-06T01:21:36.314115+0000","last_unstale":"2023-10-06T01:21:40.840164+0000","last_undegraded":"2023-10-06T01:21:40.840164+0000","last_fullsized":"2023-10-06T01:21:40.840164+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:21:35.260777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:21:35.260777+0000","last_clean_scrub_stamp":"2023-10-06T01:21:35.260777+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:54:55.305083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T01:21:40.827608+0000","last_change":"2023-10-06T01:21:36.834738+0000","last_active":"2023-10-06T01:21:40.827608+0000","last_peered":"2023-10-06T01:21:40.827608+0000","last_clean":"2023-10-06T01:21:40.827608+0000","last_became_active":"2023-10-06T01:21:36.830039+0000","last_became_peered":"2023-10-06T01:21:36.830039+0000","last_unstale":"2023-10-06T01:21:40.827608+0000","last_undegraded":"2023-10-06T01:21:40.827608+0000","last_fullsized":"2023-10-06T01:21:40.827608+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:21:36.268170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:21:36.268170+0000","last_clean_scrub_stamp":"2023-10-06T01:21:36.268170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:32:53.580584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T01:21:40.849746+0000","last_change":"2023-10-06T01:21:40.847419+0000","last_active":"2023-10-06T01:21:40.849746+0000","last_peered":"2023-10-06T01:21:40.849746+0000","last_clean":"2023-10-06T01:21:40.849746+0000","last_became_active":"2023-10-06T01:21:40.847033+0000","last_became_peered":"2023-10-06T01:21:40.847033+0000","last_unstale":"2023-10-06T01:21:40.849746+0000","last_undegraded":"2023-10-06T01:21:40.849746+0000","last_fullsized":"2023-10-06T01:21:40.849746+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:21:39.809888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:21:39.809888+0000","last_clean_scrub_stamp":"2023-10-06T01:21:39.809888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:48:34.766396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0,4],"acting":[5,1,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T01:21:40.824624+0000","last_change":"2023-10-06T01:21:30.604889+0000","last_active":"2023-10-06T01:21:40.824624+0000","last_peered":"2023-10-06T01:21:40.824624+0000","last_clean":"2023-10-06T01:21:40.824624+0000","last_became_active":"2023-10-06T01:21:30.604535+0000","last_became_peered":"2023-10-06T01:21:30.604535+0000","last_unstale":"2023-10-06T01:21:40.824624+0000","last_undegraded":"2023-10-06T01:21:40.824624+0000","last_fullsized":"2023-10-06T01:21:40.824624+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:21:29.586558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:21:29.586558+0000","last_clean_scrub_stamp":"2023-10-06T01:21:29.586558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:17:59.434982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"17'117","reported_seq":167,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T01:21:40.832005+0000","last_change":"2023-10-06T01:21:31.602437+0000","last_active":"2023-10-06T01:21:40.832005+0000","last_peered":"2023-10-06T01:21:40.832005+0000","last_clean":"2023-10-06T01:21:40.832005+0000","last_became_active":"2023-10-06T01:21:31.601431+0000","last_became_peered":"2023-10-06T01:21:31.601431+0000","last_unstale":"2023-10-06T01:21:40.832005+0000","last_undegraded":"2023-10-06T01:21:40.832005+0000","last_fullsized":"2023-10-06T01:21:40.832005+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:21:30.589171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:21:30.589171+0000","last_clean_scrub_stamp":"2023-10-06T01:21:30.589171+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T01:48:45.877807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T01:21:40.840247+0000","last_change":"2023-10-06T01:21:36.308132+0000","last_active":"2023-10-06T01:21:40.840247+0000","last_peered":"2023-10-06T01:21:40.840247+0000","last_clean":"2023-10-06T01:21:40.840247+0000","last_became_active":"2023-10-06T01:21:36.307806+0000","last_became_peered":"2023-10-06T01:21:36.307806+0000","last_unstale":"2023-10-06T01:21:40.840247+0000","last_undegraded":"2023-10-06T01:21:40.840247+0000","last_fullsized":"2023-10-06T01:21:40.840247+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:21:35.260777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:21:35.260777+0000","last_clean_scrub_stamp":"2023-10-06T01:21:35.260777+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:48:19.919262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T01:21:40.842645+0000","last_change":"2023-10-06T01:21:36.835445+0000","last_active":"2023-10-06T01:21:40.842645+0000","last_peered":"2023-10-06T01:21:40.842645+0000","last_clean":"2023-10-06T01:21:40.842645+0000","last_became_active":"2023-10-06T01:21:36.834925+0000","last_became_peered":"2023-10-06T01:21:36.834925+0000","last_unstale":"2023-10-06T01:21:40.842645+0000","last_undegraded":"2023-10-06T01:21:40.842645+0000","last_fullsized":"2023-10-06T01:21:40.842645+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:21:36.268170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:21:36.268170+0000","last_clean_scrub_stamp":"2023-10-06T01:21:36.268170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:48:35.151895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T01:21:40.840299+0000","last_change":"2023-10-06T01:21:40.838204+0000","last_active":"2023-10-06T01:21:40.840299+0000","last_peered":"2023-10-06T01:21:40.840299+0000","last_clean":"2023-10-06T01:21:40.840299+0000","last_became_active":"2023-10-06T01:21:40.837815+0000","last_became_peered":"2023-10-06T01:21:40.837815+0000","last_unstale":"2023-10-06T01:21:40.840299+0000","last_undegraded":"2023-10-06T01:21:40.840299+0000","last_fullsized":"2023-10-06T01:21:40.840299+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:21:39.809888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:21:39.809888+0000","last_clean_scrub_stamp":"2023-10-06T01:21:39.809888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:21:10.391252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,1,7],"acting":[2,5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T01:21:40.830958+0000","last_change":"2023-10-06T01:21:31.338236+0000","last_active":"2023-10-06T01:21:40.830958+0000","last_peered":"2023-10-06T01:21:40.830958+0000","last_clean":"2023-10-06T01:21:40.830958+0000","last_became_active":"2023-10-06T01:21:31.337918+0000","last_became_peered":"2023-10-06T01:21:31.337918+0000","last_unstale":"2023-10-06T01:21:40.830958+0000","last_undegraded":"2023-10-06T01:21:40.830958+0000","last_fullsized":"2023-10-06T01:21:40.830958+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:21:29.586558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:21:29.586558+0000","last_clean_scrub_stamp":"2023-10-06T01:21:29.586558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:02:13.010488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T01:21:40.826976+0000","last_change":"2023-10-06T01:21:36.309135+0000","last_active":"2023-10-06T01:21:40.826976+0000","last_peered":"2023-10-06T01:21:40.826976+0000","last_clean":"2023-10-06T01:21:40.826976+0000","last_became_active":"2023-10-06T01:21:36.300992+0000","last_became_peered":"2023-10-06T01:21:36.300992+0000","last_unstale":"2023-10-06T01:21:40.826976+0000","last_undegraded":"2023-10-06T01:21:40.826976+0000","last_fullsized":"2023-10-06T01:21:40.826976+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:21:35.260777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:21:35.260777+0000","last_clean_scrub_stamp":"2023-10-06T01:21:35.260777+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:33:04.318590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T01:21:40.824922+0000","last_change":"2023-10-06T01:21:36.825744+0000","last_active":"2023-10-06T01:21:40.824922+0000","last_peered":"2023-10-06T01:21:40.824922+0000","last_clean":"2023-10-06T01:21:40.824922+0000","last_became_active":"2023-10-06T01:21:36.825474+0000","last_became_peered":"2023-10-06T01:21:36.825474+0000","last_unstale":"2023-10-06T01:21:40.824922+0000","last_undegraded":"2023-10-06T01:21:40.824922+0000","last_fullsized":"2023-10-06T01:21:40.824922+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:21:36.268170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:21:36.268170+0000","last_clean_scrub_stamp":"2023-10-06T01:21:36.268170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:01:50.180814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T01:21:40.842542+0000","last_change":"2023-10-06T01:21:40.839804+0000","last_active":"2023-10-06T01:21:40.842542+0000","last_peered":"2023-10-06T01:21:40.842542+0000","last_clean":"2023-10-06T01:21:40.842542+0000","last_became_active":"2023-10-06T01:21:40.838895+0000","last_became_peered":"2023-10-06T01:21:40.838895+0000","last_unstale":"2023-10-06T01:21:40.842542+0000","last_undegraded":"2023-10-06T01:21:40.842542+0000","last_fullsized":"2023-10-06T01:21:40.842542+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:21:39.809888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:21:39.809888+0000","last_clean_scrub_stamp":"2023-10-06T01:21:39.809888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:37:36.730320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,5,3],"acting":[7,2,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T01:21:40.831878+0000","last_change":"2023-10-06T01:21:31.338209+0000","last_active":"2023-10-06T01:21:40.831878+0000","last_peered":"2023-10-06T01:21:40.831878+0000","last_clean":"2023-10-06T01:21:40.831878+0000","last_became_active":"2023-10-06T01:21:31.337870+0000","last_became_peered":"2023-10-06T01:21:31.337870+0000","last_unstale":"2023-10-06T01:21:40.831878+0000","last_undegraded":"2023-10-06T01:21:40.831878+0000","last_fullsized":"2023-10-06T01:21:40.831878+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:21:29.586558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:21:29.586558+0000","last_clean_scrub_stamp":"2023-10-06T01:21:29.586558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:53:47.117299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T01:21:40.823530+0000","last_change":"2023-10-06T01:21:36.300292+0000","last_active":"2023-10-06T01:21:40.823530+0000","last_peered":"2023-10-06T01:21:40.823530+0000","last_clean":"2023-10-06T01:21:40.823530+0000","last_became_active":"2023-10-06T01:21:36.299999+0000","last_became_peered":"2023-10-06T01:21:36.299999+0000","last_unstale":"2023-10-06T01:21:40.823530+0000","last_undegraded":"2023-10-06T01:21:40.823530+0000","last_fullsized":"2023-10-06T01:21:40.823530+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:21:35.260777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:21:35.260777+0000","last_clean_scrub_stamp":"2023-10-06T01:21:35.260777+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:46:13.974439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T01:21:40.820907+0000","last_change":"2023-10-06T01:21:36.839337+0000","last_active":"2023-10-06T01:21:40.820907+0000","last_peered":"2023-10-06T01:21:40.820907+0000","last_clean":"2023-10-06T01:21:40.820907+0000","last_became_active":"2023-10-06T01:21:36.831706+0000","last_became_peered":"2023-10-06T01:21:36.831706+0000","last_unstale":"2023-10-06T01:21:40.820907+0000","last_undegraded":"2023-10-06T01:21:40.820907+0000","last_fullsized":"2023-10-06T01:21:40.820907+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:21:36.268170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:21:36.268170+0000","last_clean_scrub_stamp":"2023-10-06T01:21:36.268170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:01:50.180814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T01:21:40.861012+0000","last_change":"2023-10-06T01:21:40.858510+0000","last_active":"2023-10-06T01:21:40.861012+0000","last_peered":"2023-10-06T01:21:40.861012+0000","last_clean":"2023-10-06T01:21:40.861012+0000","last_became_active":"2023-10-06T01:21:40.858081+0000","last_became_peered":"2023-10-06T01:21:40.858081+0000","last_unstale":"2023-10-06T01:21:40.861012+0000","last_undegraded":"2023-10-06T01:21:40.861012+0000","last_fullsized":"2023-10-06T01:21:40.861012+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:21:39.809888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:21:39.809888+0000","last_clean_scrub_stamp":"2023-10-06T01:21:39.809888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:37:36.730320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,6],"acting":[0,1,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T01:21:40.829308+0000","last_change":"2023-10-06T01:21:31.338177+0000","last_active":"2023-10-06T01:21:40.829308+0000","last_peered":"2023-10-06T01:21:40.829308+0000","last_clean":"2023-10-06T01:21:40.829308+0000","last_became_active":"2023-10-06T01:21:31.337872+0000","last_became_peered":"2023-10-06T01:21:31.337872+0000","last_unstale":"2023-10-06T01:21:40.829308+0000","last_undegraded":"2023-10-06T01:21:40.829308+0000","last_fullsized":"2023-10-06T01:21:40.829308+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:21:29.586558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:21:29.586558+0000","last_clean_scrub_stamp":"2023-10-06T01:21:29.586558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:17:59.434982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T01:21:40.826747+0000","last_change":"2023-10-06T01:21:36.304934+0000","last_active":"2023-10-06T01:21:40.826747+0000","last_peered":"2023-10-06T01:21:40.826747+0000","last_clean":"2023-10-06T01:21:40.826747+0000","last_became_active":"2023-10-06T01:21:36.304472+0000","last_became_peered":"2023-10-06T01:21:36.304472+0000","last_unstale":"2023-10-06T01:21:40.826747+0000","last_undegraded":"2023-10-06T01:21:40.826747+0000","last_fullsized":"2023-10-06T01:21:40.826747+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:21:35.260777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:21:35.260777+0000","last_clean_scrub_stamp":"2023-10-06T01:21:35.260777+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:54:55.305083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T01:21:40.825749+0000","last_change":"2023-10-06T01:21:36.814330+0000","last_active":"2023-10-06T01:21:40.825749+0000","last_peered":"2023-10-06T01:21:40.825749+0000","last_clean":"2023-10-06T01:21:40.825749+0000","last_became_active":"2023-10-06T01:21:36.814069+0000","last_became_peered":"2023-10-06T01:21:36.814069+0000","last_unstale":"2023-10-06T01:21:40.825749+0000","last_undegraded":"2023-10-06T01:21:40.825749+0000","last_fullsized":"2023-10-06T01:21:40.825749+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:21:36.268170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:21:36.268170+0000","last_clean_scrub_stamp":"2023-10-06T01:21:36.268170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:26:27.490800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T01:21:40.854566+0000","last_change":"2023-10-06T01:21:40.849926+0000","last_active":"2023-10-06T01:21:40.854566+0000","last_peered":"2023-10-06T01:21:40.854566+0000","last_clean":"2023-10-06T01:21:40.854566+0000","last_became_active":"2023-10-06T01:21:40.849188+0000","last_became_peered":"2023-10-06T01:21:40.849188+0000","last_unstale":"2023-10-06T01:21:40.854566+0000","last_undegraded":"2023-10-06T01:21:40.854566+0000","last_fullsized":"2023-10-06T01:21:40.854566+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:21:39.809888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:21:39.809888+0000","last_clean_scrub_stamp":"2023-10-06T01:21:39.809888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:21:10.391252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5,2],"acting":[6,0,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T01:21:40.820997+0000","last_change":"2023-10-06T01:21:31.338181+0000","last_active":"2023-10-06T01:21:40.820997+0000","last_peered":"2023-10-06T01:21:40.820997+0000","last_clean":"2023-10-06T01:21:40.820997+0000","last_became_active":"2023-10-06T01:21:31.337820+0000","last_became_peered":"2023-10-06T01:21:31.337820+0000","last_unstale":"2023-10-06T01:21:40.820997+0000","last_undegraded":"2023-10-06T01:21:40.820997+0000","last_fullsized":"2023-10-06T01:21:40.820997+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:21:29.586558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:21:29.586558+0000","last_clean_scrub_stamp":"2023-10-06T01:21:29.586558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:44:49.740873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T01:21:40.825927+0000","last_change":"2023-10-06T01:21:36.309352+0000","last_active":"2023-10-06T01:21:40.825927+0000","last_peered":"2023-10-06T01:21:40.825927+0000","last_clean":"2023-10-06T01:21:40.825927+0000","last_became_active":"2023-10-06T01:21:36.308864+0000","last_became_peered":"2023-10-06T01:21:36.308864+0000","last_unstale":"2023-10-06T01:21:40.825927+0000","last_undegraded":"2023-10-06T01:21:40.825927+0000","last_fullsized":"2023-10-06T01:21:40.825927+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:21:35.260777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:21:35.260777+0000","last_clean_scrub_stamp":"2023-10-06T01:21:35.260777+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:48:42.234958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T01:21:40.844152+0000","last_change":"2023-10-06T01:21:36.835013+0000","last_active":"2023-10-06T01:21:40.844152+0000","last_peered":"2023-10-06T01:21:40.844152+0000","last_clean":"2023-10-06T01:21:40.844152+0000","last_became_active":"2023-10-06T01:21:36.834427+0000","last_became_peered":"2023-10-06T01:21:36.834427+0000","last_unstale":"2023-10-06T01:21:40.844152+0000","last_undegraded":"2023-10-06T01:21:40.844152+0000","last_fullsized":"2023-10-06T01:21:40.844152+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:21:36.268170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:21:36.268170+0000","last_clean_scrub_stamp":"2023-10-06T01:21:36.268170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:28:15.885944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T01:21:40.858145+0000","last_change":"2023-10-06T01:21:40.857260+0000","last_active":"2023-10-06T01:21:40.858145+0000","last_peered":"2023-10-06T01:21:40.858145+0000","last_clean":"2023-10-06T01:21:40.858145+0000","last_became_active":"2023-10-06T01:21:40.856823+0000","last_became_peered":"2023-10-06T01:21:40.856823+0000","last_unstale":"2023-10-06T01:21:40.858145+0000","last_undegraded":"2023-10-06T01:21:40.858145+0000","last_fullsized":"2023-10-06T01:21:40.858145+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:21:39.809888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:21:39.809888+0000","last_clean_scrub_stamp":"2023-10-06T01:21:39.809888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:26:15.414115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,6,5],"acting":[0,1,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T01:21:40.821025+0000","last_change":"2023-10-06T01:21:30.604007+0000","last_active":"2023-10-06T01:21:40.821025+0000","last_peered":"2023-10-06T01:21:40.821025+0000","last_clean":"2023-10-06T01:21:40.821025+0000","last_became_active":"2023-10-06T01:21:30.603673+0000","last_became_peered":"2023-10-06T01:21:30.603673+0000","last_unstale":"2023-10-06T01:21:40.821025+0000","last_undegraded":"2023-10-06T01:21:40.821025+0000","last_fullsized":"2023-10-06T01:21:40.821025+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:21:29.586558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:21:29.586558+0000","last_clean_scrub_stamp":"2023-10-06T01:21:29.586558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:53:47.117299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T01:21:40.830136+0000","last_change":"2023-10-06T01:21:36.302956+0000","last_active":"2023-10-06T01:21:40.830136+0000","last_peered":"2023-10-06T01:21:40.830136+0000","last_clean":"2023-10-06T01:21:40.830136+0000","last_became_active":"2023-10-06T01:21:36.302668+0000","last_became_peered":"2023-10-06T01:21:36.302668+0000","last_unstale":"2023-10-06T01:21:40.830136+0000","last_undegraded":"2023-10-06T01:21:40.830136+0000","last_fullsized":"2023-10-06T01:21:40.830136+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:21:35.260777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:21:35.260777+0000","last_clean_scrub_stamp":"2023-10-06T01:21:35.260777+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:46:13.974439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T01:21:40.825330+0000","last_change":"2023-10-06T01:21:36.825472+0000","last_active":"2023-10-06T01:21:40.825330+0000","last_peered":"2023-10-06T01:21:40.825330+0000","last_clean":"2023-10-06T01:21:40.825330+0000","last_became_active":"2023-10-06T01:21:36.825199+0000","last_became_peered":"2023-10-06T01:21:36.825199+0000","last_unstale":"2023-10-06T01:21:40.825330+0000","last_undegraded":"2023-10-06T01:21:40.825330+0000","last_fullsized":"2023-10-06T01:21:40.825330+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:21:36.268170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:21:36.268170+0000","last_clean_scrub_stamp":"2023-10-06T01:21:36.268170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:53:27.090314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T01:21:40.858038+0000","last_change":"2023-10-06T01:21:40.855138+0000","last_active":"2023-10-06T01:21:40.858038+0000","last_peered":"2023-10-06T01:21:40.858038+0000","last_clean":"2023-10-06T01:21:40.858038+0000","last_became_active":"2023-10-06T01:21:40.854323+0000","last_became_peered":"2023-10-06T01:21:40.854323+0000","last_unstale":"2023-10-06T01:21:40.858038+0000","last_undegraded":"2023-10-06T01:21:40.858038+0000","last_fullsized":"2023-10-06T01:21:40.858038+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:21:39.809888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:21:39.809888+0000","last_clean_scrub_stamp":"2023-10-06T01:21:39.809888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:48:17.365413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,0],"acting":[1,3,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"20'1","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T01:21:40.844060+0000","last_change":"2023-10-06T01:21:36.308100+0000","last_active":"2023-10-06T01:21:40.844060+0000","last_peered":"2023-10-06T01:21:40.844060+0000","last_clean":"2023-10-06T01:21:40.844060+0000","last_became_active":"2023-10-06T01:21:36.307829+0000","last_became_peered":"2023-10-06T01:21:36.307829+0000","last_unstale":"2023-10-06T01:21:40.844060+0000","last_undegraded":"2023-10-06T01:21:40.844060+0000","last_fullsized":"2023-10-06T01:21:40.844060+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:21:35.260777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:21:35.260777+0000","last_clean_scrub_stamp":"2023-10-06T01:21:35.260777+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:46:13.974439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T01:21:40.817731+0000","last_change":"2023-10-06T01:21:36.820796+0000","last_active":"2023-10-06T01:21:40.817731+0000","last_peered":"2023-10-06T01:21:40.817731+0000","last_clean":"2023-10-06T01:21:40.817731+0000","last_became_active":"2023-10-06T01:21:36.820534+0000","last_became_peered":"2023-10-06T01:21:36.820534+0000","last_unstale":"2023-10-06T01:21:40.817731+0000","last_undegraded":"2023-10-06T01:21:40.817731+0000","last_fullsized":"2023-10-06T01:21:40.817731+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:21:36.268170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:21:36.268170+0000","last_clean_scrub_stamp":"2023-10-06T01:21:36.268170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:13:13.795366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T01:21:40.849961+0000","last_change":"2023-10-06T01:21:40.846085+0000","last_active":"2023-10-06T01:21:40.849961+0000","last_peered":"2023-10-06T01:21:40.849961+0000","last_clean":"2023-10-06T01:21:40.849961+0000","last_became_active":"2023-10-06T01:21:40.845695+0000","last_became_peered":"2023-10-06T01:21:40.845695+0000","last_unstale":"2023-10-06T01:21:40.849961+0000","last_undegraded":"2023-10-06T01:21:40.849961+0000","last_fullsized":"2023-10-06T01:21:40.849961+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:21:39.809888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:21:39.809888+0000","last_clean_scrub_stamp":"2023-10-06T01:21:39.809888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:05:45.908197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1,6],"acting":[7,4,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"20'2","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T01:21:40.829667+0000","last_change":"2023-10-06T01:21:36.307782+0000","last_active":"2023-10-06T01:21:40.829667+0000","last_peered":"2023-10-06T01:21:40.829667+0000","last_clean":"2023-10-06T01:21:40.829667+0000","last_became_active":"2023-10-06T01:21:36.307601+0000","last_became_peered":"2023-10-06T01:21:36.307601+0000","last_unstale":"2023-10-06T01:21:40.829667+0000","last_undegraded":"2023-10-06T01:21:40.829667+0000","last_fullsized":"2023-10-06T01:21:40.829667+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:21:35.260777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:21:35.260777+0000","last_clean_scrub_stamp":"2023-10-06T01:21:35.260777+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:03:02.138728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T01:21:40.826897+0000","last_change":"2023-10-06T01:21:36.840272+0000","last_active":"2023-10-06T01:21:40.826897+0000","last_peered":"2023-10-06T01:21:40.826897+0000","last_clean":"2023-10-06T01:21:40.826897+0000","last_became_active":"2023-10-06T01:21:36.839957+0000","last_became_peered":"2023-10-06T01:21:36.839957+0000","last_unstale":"2023-10-06T01:21:40.826897+0000","last_undegraded":"2023-10-06T01:21:40.826897+0000","last_fullsized":"2023-10-06T01:21:40.826897+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:21:36.268170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:21:36.268170+0000","last_clean_scrub_stamp":"2023-10-06T01:21:36.268170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:48:13.823695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T01:21:40.849688+0000","last_change":"2023-10-06T01:21:40.848222+0000","last_active":"2023-10-06T01:21:40.849688+0000","last_peered":"2023-10-06T01:21:40.849688+0000","last_clean":"2023-10-06T01:21:40.849688+0000","last_became_active":"2023-10-06T01:21:40.847832+0000","last_became_peered":"2023-10-06T01:21:40.847832+0000","last_unstale":"2023-10-06T01:21:40.849688+0000","last_undegraded":"2023-10-06T01:21:40.849688+0000","last_fullsized":"2023-10-06T01:21:40.849688+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:21:39.809888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:21:39.809888+0000","last_clean_scrub_stamp":"2023-10-06T01:21:39.809888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:06:39.429127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,7,4],"acting":[5,0,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1d","version":"20'2","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T01:21:40.830053+0000","last_change":"2023-10-06T01:21:36.307610+0000","last_active":"2023-10-06T01:21:40.830053+0000","last_peered":"2023-10-06T01:21:40.830053+0000","last_clean":"2023-10-06T01:21:40.830053+0000","last_became_active":"2023-10-06T01:21:36.306937+0000","last_became_peered":"2023-10-06T01:21:36.306937+0000","last_unstale":"2023-10-06T01:21:40.830053+0000","last_undegraded":"2023-10-06T01:21:40.830053+0000","last_fullsized":"2023-10-06T01:21:40.830053+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:21:35.260777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:21:35.260777+0000","last_clean_scrub_stamp":"2023-10-06T01:21:35.260777+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:48:19.919262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T01:21:40.824396+0000","last_change":"2023-10-06T01:21:36.840502+0000","last_active":"2023-10-06T01:21:40.824396+0000","last_peered":"2023-10-06T01:21:40.824396+0000","last_clean":"2023-10-06T01:21:40.824396+0000","last_became_active":"2023-10-06T01:21:36.840237+0000","last_became_peered":"2023-10-06T01:21:36.840237+0000","last_unstale":"2023-10-06T01:21:40.824396+0000","last_undegraded":"2023-10-06T01:21:40.824396+0000","last_fullsized":"2023-10-06T01:21:40.824396+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:21:36.268170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:21:36.268170+0000","last_clean_scrub_stamp":"2023-10-06T01:21:36.268170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:03:40.763134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T01:21:40.844533+0000","last_change":"2023-10-06T01:21:40.835338+0000","last_active":"2023-10-06T01:21:40.844533+0000","last_peered":"2023-10-06T01:21:40.844533+0000","last_clean":"2023-10-06T01:21:40.844533+0000","last_became_active":"2023-10-06T01:21:40.834902+0000","last_became_peered":"2023-10-06T01:21:40.834902+0000","last_unstale":"2023-10-06T01:21:40.844533+0000","last_undegraded":"2023-10-06T01:21:40.844533+0000","last_fullsized":"2023-10-06T01:21:40.844533+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:21:39.809888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:21:39.809888+0000","last_clean_scrub_stamp":"2023-10-06T01:21:39.809888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:04:16.001332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,2],"acting":[4,6,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"20'1","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T01:21:40.824449+0000","last_change":"2023-10-06T01:21:36.296572+0000","last_active":"2023-10-06T01:21:40.824449+0000","last_peered":"2023-10-06T01:21:40.824449+0000","last_clean":"2023-10-06T01:21:40.824449+0000","last_became_active":"2023-10-06T01:21:36.295666+0000","last_became_peered":"2023-10-06T01:21:36.295666+0000","last_unstale":"2023-10-06T01:21:40.824449+0000","last_undegraded":"2023-10-06T01:21:40.824449+0000","last_fullsized":"2023-10-06T01:21:40.824449+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:21:35.260777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:21:35.260777+0000","last_clean_scrub_stamp":"2023-10-06T01:21:35.260777+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:48:19.919262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T01:21:40.824070+0000","last_change":"2023-10-06T01:21:36.822907+0000","last_active":"2023-10-06T01:21:40.824070+0000","last_peered":"2023-10-06T01:21:40.824070+0000","last_clean":"2023-10-06T01:21:40.824070+0000","last_became_active":"2023-10-06T01:21:36.822537+0000","last_became_peered":"2023-10-06T01:21:36.822537+0000","last_unstale":"2023-10-06T01:21:40.824070+0000","last_undegraded":"2023-10-06T01:21:40.824070+0000","last_fullsized":"2023-10-06T01:21:40.824070+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:21:36.268170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:21:36.268170+0000","last_clean_scrub_stamp":"2023-10-06T01:21:36.268170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:53:49.542750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T01:21:40.856008+0000","last_change":"2023-10-06T01:21:40.845375+0000","last_active":"2023-10-06T01:21:40.856008+0000","last_peered":"2023-10-06T01:21:40.856008+0000","last_clean":"2023-10-06T01:21:40.856008+0000","last_became_active":"2023-10-06T01:21:40.845079+0000","last_became_peered":"2023-10-06T01:21:40.845079+0000","last_unstale":"2023-10-06T01:21:40.856008+0000","last_undegraded":"2023-10-06T01:21:40.856008+0000","last_fullsized":"2023-10-06T01:21:40.856008+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:21:39.809888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:21:39.809888+0000","last_clean_scrub_stamp":"2023-10-06T01:21:39.809888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:32:57.122301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,7,2],"acting":[1,5,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1f","version":"20'4","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T01:21:40.843463+0000","last_change":"2023-10-06T01:21:36.299553+0000","last_active":"2023-10-06T01:21:40.843463+0000","last_peered":"2023-10-06T01:21:40.843463+0000","last_clean":"2023-10-06T01:21:40.843463+0000","last_became_active":"2023-10-06T01:21:36.298968+0000","last_became_peered":"2023-10-06T01:21:36.298968+0000","last_unstale":"2023-10-06T01:21:40.843463+0000","last_undegraded":"2023-10-06T01:21:40.843463+0000","last_fullsized":"2023-10-06T01:21:40.843463+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:21:35.260777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:21:35.260777+0000","last_clean_scrub_stamp":"2023-10-06T01:21:35.260777+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:33:04.318590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T01:21:40.824895+0000","last_change":"2023-10-06T01:21:36.844505+0000","last_active":"2023-10-06T01:21:40.824895+0000","last_peered":"2023-10-06T01:21:40.824895+0000","last_clean":"2023-10-06T01:21:40.824895+0000","last_became_active":"2023-10-06T01:21:36.843624+0000","last_became_peered":"2023-10-06T01:21:36.843624+0000","last_unstale":"2023-10-06T01:21:40.824895+0000","last_undegraded":"2023-10-06T01:21:40.824895+0000","last_fullsized":"2023-10-06T01:21:40.824895+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:21:36.268170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:21:36.268170+0000","last_clean_scrub_stamp":"2023-10-06T01:21:36.268170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:59:29.172295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T01:21:40.820462+0000","last_change":"2023-10-06T01:21:36.832253+0000","last_active":"2023-10-06T01:21:40.820462+0000","last_peered":"2023-10-06T01:21:40.820462+0000","last_clean":"2023-10-06T01:21:40.820462+0000","last_became_active":"2023-10-06T01:21:36.824011+0000","last_became_peered":"2023-10-06T01:21:36.824011+0000","last_unstale":"2023-10-06T01:21:40.820462+0000","last_undegraded":"2023-10-06T01:21:40.820462+0000","last_fullsized":"2023-10-06T01:21:40.820462+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:21:36.268170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:21:36.268170+0000","last_clean_scrub_stamp":"2023-10-06T01:21:36.268170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:50:38.966977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T01:21:40.823808+0000","last_change":"2023-10-06T01:21:36.826465+0000","last_active":"2023-10-06T01:21:40.823808+0000","last_peered":"2023-10-06T01:21:40.823808+0000","last_clean":"2023-10-06T01:21:40.823808+0000","last_became_active":"2023-10-06T01:21:36.826146+0000","last_became_peered":"2023-10-06T01:21:36.826146+0000","last_unstale":"2023-10-06T01:21:40.823808+0000","last_undegraded":"2023-10-06T01:21:40.823808+0000","last_fullsized":"2023-10-06T01:21:40.823808+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:21:36.268170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:21:36.268170+0000","last_clean_scrub_stamp":"2023-10-06T01:21:36.268170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:28:15.885944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T01:21:40.824625+0000","last_change":"2023-10-06T01:21:36.834310+0000","last_active":"2023-10-06T01:21:40.824625+0000","last_peered":"2023-10-06T01:21:40.824625+0000","last_clean":"2023-10-06T01:21:40.824625+0000","last_became_active":"2023-10-06T01:21:36.834048+0000","last_became_peered":"2023-10-06T01:21:36.834048+0000","last_unstale":"2023-10-06T01:21:40.824625+0000","last_undegraded":"2023-10-06T01:21:40.824625+0000","last_fullsized":"2023-10-06T01:21:40.824625+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:21:36.268170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:21:36.268170+0000","last_clean_scrub_stamp":"2023-10-06T01:21:36.268170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:25:42.902143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T01:21:40.826182+0000","last_change":"2023-10-06T01:21:36.830563+0000","last_active":"2023-10-06T01:21:40.826182+0000","last_peered":"2023-10-06T01:21:40.826182+0000","last_clean":"2023-10-06T01:21:40.826182+0000","last_became_active":"2023-10-06T01:21:36.830334+0000","last_became_peered":"2023-10-06T01:21:36.830334+0000","last_unstale":"2023-10-06T01:21:40.826182+0000","last_undegraded":"2023-10-06T01:21:40.826182+0000","last_fullsized":"2023-10-06T01:21:40.826182+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:21:36.268170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:21:36.268170+0000","last_clean_scrub_stamp":"2023-10-06T01:21:36.268170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:26:07.073491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T01:21:40.825831+0000","last_change":"2023-10-06T01:21:36.828863+0000","last_active":"2023-10-06T01:21:40.825831+0000","last_peered":"2023-10-06T01:21:40.825831+0000","last_clean":"2023-10-06T01:21:40.825831+0000","last_became_active":"2023-10-06T01:21:36.828318+0000","last_became_peered":"2023-10-06T01:21:36.828318+0000","last_unstale":"2023-10-06T01:21:40.825831+0000","last_undegraded":"2023-10-06T01:21:40.825831+0000","last_fullsized":"2023-10-06T01:21:40.825831+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:21:36.268170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:21:36.268170+0000","last_clean_scrub_stamp":"2023-10-06T01:21:36.268170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:27:54.680295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":4484,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":8968,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574859,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298156,"kb_used_data":868,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073684,"statfs":{"total":96636764160,"available":96331452416,"internally_reserved":0,"allocated":888832,"data_stored":703756,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73399999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.625}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.751}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90600000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56999999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64800000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69999999999999996}]}]},{"osd":6,"up_from":13,"seq":55834574859,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297548,"kb_used_data":260,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074292,"statfs":{"total":96636764160,"available":96332075008,"internally_reserved":0,"allocated":266240,"data_stored":109458,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53900000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64200000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67700000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58299999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49199999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45700000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79000000000000004}]}]},{"osd":1,"up_from":13,"seq":55834574857,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302220,"kb_used_data":836,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069620,"statfs":{"total":96636764160,"available":96327290880,"internally_reserved":0,"allocated":856064,"data_stored":698848,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.433}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.376}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48099999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77700000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.623}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78700000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65800000000000003}]}]},{"osd":0,"up_from":13,"seq":55834574858,"num_pgs":47,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301644,"kb_used_data":260,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94070196,"statfs":{"total":96636764160,"available":96327880704,"internally_reserved":0,"allocated":266240,"data_stored":109034,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.9079999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.9410000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.728}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79700000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81999999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.8740000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86699999999999999}]}]},{"osd":2,"up_from":13,"seq":55834574857,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301644,"kb_used_data":260,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94070196,"statfs":{"total":96636764160,"available":96327880704,"internally_reserved":0,"allocated":266240,"data_stored":109458,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96599999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1830000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2210000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.748}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0229999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.8360000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0680000000000001}]}]},{"osd":3,"up_from":13,"seq":55834574857,"num_pgs":48,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301648,"kb_used_data":264,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94070192,"statfs":{"total":96636764160,"available":96327876608,"internally_reserved":0,"allocated":270336,"data_stored":109548,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.433}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48599999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60099999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98599999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.02}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94899999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0720000000000001}]}]},{"osd":4,"up_from":13,"seq":55834574857,"num_pgs":50,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297568,"kb_used_data":280,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074272,"statfs":{"total":96636764160,"available":96332054528,"internally_reserved":0,"allocated":286720,"data_stored":113228,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42199999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51500000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54900000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56000000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44500000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53300000000000003}]}]},{"osd":5,"up_from":13,"seq":55834574859,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297552,"kb_used_data":264,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074288,"statfs":{"total":96636764160,"available":96332070912,"internally_reserved":0,"allocated":270336,"data_stored":109104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72999999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58999999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70699999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96999999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67000000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75700000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85499999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":3770,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":624,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":3930,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-06T01:22:06.350 INFO:tasks.ceph.ceph_manager.ceph:clean! 2023-10-06T01:22:06.350 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2023-10-06T01:22:06.350 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2023-10-06T01:22:06.351 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-10-06T01:22:06.567 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:06.566+0000 7fa0c3fff700 1 Processor -- start 2023-10-06T01:22:06.567 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:06.566+0000 7fa0c3fff700 1 -- start start 2023-10-06T01:22:06.569 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:06.568+0000 7fa0c3fff700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fa0c4153e40 0x7fa0c406df90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:06.569 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:06.568+0000 7fa0c3fff700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fa0c406a9a0 0x7fa0c406e4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:06.569 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:06.568+0000 7fa0c3fff700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa0c40c9d00 con 0x7fa0c406a5d0 2023-10-06T01:22:06.569 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:06.568+0000 7fa0c3fff700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa0c406f5a0 con 0x7fa0c406a9a0 2023-10-06T01:22:06.569 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:06.568+0000 7fa0c3fff700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa0c40c6750 con 0x7fa0c4153e40 2023-10-06T01:22:06.569 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:06.568+0000 7fa0c37fe700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fa0c406a9a0 0x7fa0c406e4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:06.569 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:06.568+0000 7fa0c2ffd700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fa0c406a5d0 0x7fa0c4153730 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:56656/0 (socket says 172.21.15.50:56656) 2023-10-06T01:22:06.569 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:06.568+0000 7fa0c2ffd700 1 -- 172.21.15.50:0/2279236711 learned_addr learned my addr 172.21.15.50:0/2279236711 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-10-06T01:22:06.570 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:06.568+0000 7fa0c27fc700 1 --2- 172.21.15.50:0/2279236711 >> v2:172.21.15.155:3300/0 conn(0x7fa0c4153e40 0x7fa0c406df90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:06.571 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:06.568+0000 7fa0c37fe700 1 -- 172.21.15.50:0/2279236711 >> v2:172.21.15.155:3300/0 conn(0x7fa0c4153e40 msgr2=0x7fa0c406df90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:22:06.571 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:06.568+0000 7fa0c37fe700 1 --2- 172.21.15.50:0/2279236711 >> v2:172.21.15.155:3300/0 conn(0x7fa0c4153e40 0x7fa0c406df90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:06.571 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:06.568+0000 7fa0c37fe700 1 -- 172.21.15.50:0/2279236711 >> v1:172.21.15.50:6789/0 conn(0x7fa0c406a5d0 legacy=0x7fa0c4153730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:06.571 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:06.569+0000 7fa0c37fe700 1 -- 172.21.15.50:0/2279236711 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0c406ed00 con 0x7fa0c406a9a0 2023-10-06T01:22:06.571 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:06.568+0000 7fa0c1ffb700 1 -- 172.21.15.50:0/2279236711 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1218041994 0 0) 0x7fa0c40c9d00 con 0x7fa0c406a5d0 2023-10-06T01:22:06.572 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:06.569+0000 7fa0c37fe700 1 --2- 172.21.15.50:0/2279236711 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa0c406a9a0 0x7fa0c406e4d0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fa0c40b1f00 tx=0x7fa0bc009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=83ab0dcd178436dc server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:22:06.572 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:06.569+0000 7fa0c1ffb700 1 -- 172.21.15.50:0/2279236711 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0bc00e070 con 0x7fa0c406a9a0 2023-10-06T01:22:06.572 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:06.569+0000 7fa0c1ffb700 1 -- 172.21.15.50:0/2279236711 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa0bc00bb60 con 0x7fa0c406a9a0 2023-10-06T01:22:06.572 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:06.569+0000 7fa0c1ffb700 1 -- 172.21.15.50:0/2279236711 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0bc012430 con 0x7fa0c406a9a0 2023-10-06T01:22:06.572 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:06.569+0000 7fa0c3fff700 1 -- 172.21.15.50:0/2279236711 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa0c406a9a0 msgr2=0x7fa0c406e4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:06.572 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:06.569+0000 7fa0c3fff700 1 --2- 172.21.15.50:0/2279236711 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa0c406a9a0 0x7fa0c406e4d0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fa0c40b1f00 tx=0x7fa0bc009780 comp rx=0 tx=0).stop 2023-10-06T01:22:06.572 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:06.570+0000 7fa0c3fff700 1 -- 172.21.15.50:0/2279236711 shutdown_connections 2023-10-06T01:22:06.572 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:06.570+0000 7fa0c3fff700 1 --2- 172.21.15.50:0/2279236711 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa0c406a9a0 0x7fa0c406e4d0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:06.572 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:06.570+0000 7fa0c3fff700 1 --2- 172.21.15.50:0/2279236711 >> v2:172.21.15.155:3300/0 conn(0x7fa0c4153e40 0x7fa0c406df90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:06.572 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:06.570+0000 7fa0c3fff700 1 -- 172.21.15.50:0/2279236711 >> 172.21.15.50:0/2279236711 conn(0x7fa0c40680c0 msgr2=0x7fa0c40cbf00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:22:06.572 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:06.570+0000 7fa0c3fff700 1 -- 172.21.15.50:0/2279236711 shutdown_connections 2023-10-06T01:22:06.573 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:06.570+0000 7fa0c3fff700 1 -- 172.21.15.50:0/2279236711 wait complete. 2023-10-06T01:22:06.575 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:06.571+0000 7fa0c3fff700 1 Processor -- start 2023-10-06T01:22:06.575 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:06.571+0000 7fa0c3fff700 1 -- start start 2023-10-06T01:22:06.575 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:06.572+0000 7fa0c3fff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa0c406a5d0 0x7fa0c4147c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:06.575 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:06.572+0000 7fa0c3fff700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa0c406a9a0 0x7fa0c40c2fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:06.575 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:06.572+0000 7fa0c3fff700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa0c4153e40 0x7fa0c40c34f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:06.576 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:06.572+0000 7fa0c3fff700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0c40aedd0 con 0x7fa0c406a5d0 2023-10-06T01:22:06.576 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:06.572+0000 7fa0c3fff700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0c4148150 con 0x7fa0c4153e40 2023-10-06T01:22:06.576 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:06.572+0000 7fa0c3fff700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0c415ba10 con 0x7fa0c406a9a0 2023-10-06T01:22:06.576 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:06.572+0000 7fa0c2ffd700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa0c406a5d0 0x7fa0c4147c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:06.576 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:06.572+0000 7fa0c2ffd700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa0c406a5d0 0x7fa0c4147c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:37144/0 (socket says 172.21.15.50:37144) 2023-10-06T01:22:06.576 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:06.572+0000 7fa0c2ffd700 1 -- 172.21.15.50:0/229967296 learned_addr learned my addr 172.21.15.50:0/229967296 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-06T01:22:06.576 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:06.573+0000 7fa0c27fc700 1 --2- 172.21.15.50:0/229967296 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa0c406a9a0 0x7fa0c40c2fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:06.576 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:06.573+0000 7fa0c37fe700 1 --2- 172.21.15.50:0/229967296 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa0c4153e40 0x7fa0c40c34f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:06.576 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:06.573+0000 7fa0c2ffd700 1 -- 172.21.15.50:0/229967296 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa0c406a9a0 msgr2=0x7fa0c40c2fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:06.576 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:06.573+0000 7fa0c2ffd700 1 --2- 172.21.15.50:0/229967296 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa0c406a9a0 0x7fa0c40c2fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:06.576 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:06.573+0000 7fa0c2ffd700 1 -- 172.21.15.50:0/229967296 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa0c4153e40 msgr2=0x7fa0c40c34f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:06.576 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:06.573+0000 7fa0c2ffd700 1 --2- 172.21.15.50:0/229967296 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa0c4153e40 0x7fa0c40c34f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:06.577 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:06.573+0000 7fa0c2ffd700 1 -- 172.21.15.50:0/229967296 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0bc009a20 con 0x7fa0c406a5d0 2023-10-06T01:22:06.577 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:06.573+0000 7fa0c2ffd700 1 --2- 172.21.15.50:0/229967296 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa0c406a5d0 0x7fa0c4147c10 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fa0b400c7e0 tx=0x7fa0b4007df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:22:06.577 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:06.573+0000 7fa0aaffd700 1 -- 172.21.15.50:0/229967296 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0b4005b30 con 0x7fa0c406a5d0 2023-10-06T01:22:06.577 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:06.573+0000 7fa0aaffd700 1 -- 172.21.15.50:0/229967296 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa0b4005c90 con 0x7fa0c406a5d0 2023-10-06T01:22:06.577 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:06.573+0000 7fa0c3fff700 1 -- 172.21.15.50:0/229967296 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa0c415bcb0 con 0x7fa0c406a5d0 2023-10-06T01:22:06.577 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:06.573+0000 7fa0aaffd700 1 -- 172.21.15.50:0/229967296 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0b4007300 con 0x7fa0c406a5d0 2023-10-06T01:22:06.577 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:06.573+0000 7fa0c3fff700 1 -- 172.21.15.50:0/229967296 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa0c415c270 con 0x7fa0c406a5d0 2023-10-06T01:22:06.577 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:06.574+0000 7fa0c3fff700 1 -- 172.21.15.50:0/229967296 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa0c405f270 con 0x7fa0c406a5d0 2023-10-06T01:22:06.578 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:06.575+0000 7fa0aaffd700 1 -- 172.21.15.50:0/229967296 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fa0b401b400 con 0x7fa0c406a5d0 2023-10-06T01:22:06.578 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:06.576+0000 7fa0aaffd700 1 --2- 172.21.15.50:0/229967296 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7fa0b0066f30 0x7fa0b00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:06.578 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:06.576+0000 7fa0aaffd700 1 -- 172.21.15.50:0/229967296 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6809+0+0 (secure 0 0 0) 0x7fa0b4084540 con 0x7fa0c406a5d0 2023-10-06T01:22:06.578 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:06.577+0000 7fa0c27fc700 1 --2- 172.21.15.50:0/229967296 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7fa0b0066f30 0x7fa0b00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:06.578 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:06.577+0000 7fa0c27fc700 1 --2- 172.21.15.50:0/229967296 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7fa0b0066f30 0x7fa0b00693e0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fa0c416af20 tx=0x7fa0b8008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:22:06.581 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:06.580+0000 7fa0aaffd700 1 -- 172.21.15.50:0/229967296 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fa0b4051340 con 0x7fa0c406a5d0 2023-10-06T01:22:06.828 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:06.827+0000 7fa0c3fff700 1 -- 172.21.15.50:0/229967296 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7fa0c406efe0 con 0x7fa0c406a5d0 2023-10-06T01:22:06.828 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:06.827+0000 7fa0aaffd700 1 -- 172.21.15.50:0/229967296 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+46 (secure 0 0 0) 0x7fa0b4054960 con 0x7fa0c406a5d0 2023-10-06T01:22:06.828 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-10-06T01:22:06.829 INFO:teuthology.orchestra.run.smithi050.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2023-10-06T01:22:06.831 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:06.830+0000 7fa0c3fff700 1 -- 172.21.15.50:0/229967296 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7fa0b0066f30 msgr2=0x7fa0b00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:06.831 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:06.830+0000 7fa0c3fff700 1 --2- 172.21.15.50:0/229967296 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7fa0b0066f30 0x7fa0b00693e0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fa0c416af20 tx=0x7fa0b8008040 comp rx=0 tx=0).stop 2023-10-06T01:22:06.831 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:06.830+0000 7fa0c3fff700 1 -- 172.21.15.50:0/229967296 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa0c406a5d0 msgr2=0x7fa0c4147c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:06.831 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:06.830+0000 7fa0c3fff700 1 --2- 172.21.15.50:0/229967296 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa0c406a5d0 0x7fa0c4147c10 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fa0b400c7e0 tx=0x7fa0b4007df0 comp rx=0 tx=0).stop 2023-10-06T01:22:06.831 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:06.830+0000 7fa0c3fff700 1 -- 172.21.15.50:0/229967296 shutdown_connections 2023-10-06T01:22:06.831 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:06.830+0000 7fa0c3fff700 1 --2- 172.21.15.50:0/229967296 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7fa0b0066f30 0x7fa0b00693e0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:06.831 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:06.830+0000 7fa0c3fff700 1 --2- 172.21.15.50:0/229967296 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa0c4153e40 0x7fa0c40c34f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:06.832 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:06.830+0000 7fa0c3fff700 1 --2- 172.21.15.50:0/229967296 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa0c406a5d0 0x7fa0c4147c10 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:06.832 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:06.830+0000 7fa0c3fff700 1 --2- 172.21.15.50:0/229967296 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa0c406a9a0 0x7fa0c40c2fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:06.832 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:06.830+0000 7fa0c3fff700 1 -- 172.21.15.50:0/229967296 >> 172.21.15.50:0/229967296 conn(0x7fa0c40680c0 msgr2=0x7fa0c41499b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:22:06.832 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:06.830+0000 7fa0c3fff700 1 -- 172.21.15.50:0/229967296 shutdown_connections 2023-10-06T01:22:06.832 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:06.830+0000 7fa0c3fff700 1 -- 172.21.15.50:0/229967296 wait complete. 2023-10-06T01:22:06.848 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2023-10-06T01:22:06.848 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T01:22:07.036 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:07.035+0000 7fd3789fe700 1 Processor -- start 2023-10-06T01:22:07.036 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:07.035+0000 7fd3789fe700 1 -- start start 2023-10-06T01:22:07.039 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:07.036+0000 7fd3789fe700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fd374159480 0x7fd3740b30d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:07.039 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:07.036+0000 7fd3789fe700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fd3740b3610 0x7fd3740cbc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:07.039 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:07.036+0000 7fd3789fe700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd3740cc1b0 0x7fd3740b2140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:07.040 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:07.036+0000 7fd3789fe700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd3740cb7e0 con 0x7fd374159480 2023-10-06T01:22:07.040 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:07.036+0000 7fd3789fe700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd3740b08a0 con 0x7fd3740b3610 2023-10-06T01:22:07.040 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:07.036+0000 7fd3789fe700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3740cb190 con 0x7fd3740cc1b0 2023-10-06T01:22:07.040 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:07.036+0000 7fd372d9d700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fd374159480 0x7fd3740b30d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:07.040 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:07.037+0000 7fd372d9d700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fd374159480 0x7fd3740b30d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:37154/0 (socket says 172.21.15.50:37154) 2023-10-06T01:22:07.040 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:07.037+0000 7fd372d9d700 1 -- 172.21.15.50:0/2123555241 learned_addr learned my addr 172.21.15.50:0/2123555241 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-06T01:22:07.040 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:07.037+0000 7fd37259c700 1 --2- 172.21.15.50:0/2123555241 >> v2:172.21.15.155:3300/0 conn(0x7fd3740b3610 0x7fd3740cbc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:07.040 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:07.037+0000 7fd372d9d700 1 -- 172.21.15.50:0/2123555241 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd3740cc1b0 msgr2=0x7fd3740b2140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:22:07.040 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:07.037+0000 7fd37359e700 1 --2- 172.21.15.50:0/2123555241 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd3740cc1b0 0x7fd3740b2140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:07.040 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:07.037+0000 7fd372d9d700 1 --2- 172.21.15.50:0/2123555241 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd3740cc1b0 0x7fd3740b2140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:07.041 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:07.037+0000 7fd372d9d700 1 -- 172.21.15.50:0/2123555241 >> v2:172.21.15.155:3300/0 conn(0x7fd3740b3610 msgr2=0x7fd3740cbc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:22:07.041 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:07.037+0000 7fd372d9d700 1 --2- 172.21.15.50:0/2123555241 >> v2:172.21.15.155:3300/0 conn(0x7fd3740b3610 0x7fd3740cbc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:07.041 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:07.037+0000 7fd372d9d700 1 -- 172.21.15.50:0/2123555241 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3740cb470 con 0x7fd374159480 2023-10-06T01:22:07.041 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:07.037+0000 7fd37259c700 1 --2- 172.21.15.50:0/2123555241 >> v2:172.21.15.155:3300/0 conn(0x7fd3740b3610 0x7fd3740cbc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T01:22:07.041 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:07.037+0000 7fd37359e700 1 --2- 172.21.15.50:0/2123555241 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd3740cc1b0 0x7fd3740b2140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T01:22:07.041 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:07.037+0000 7fd372d9d700 1 --2- 172.21.15.50:0/2123555241 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd374159480 0x7fd3740b30d0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fd3740d0260 tx=0x7fd364009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=50b9043882a57b3b server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:22:07.041 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:07.038+0000 7fd371d9b700 1 -- 172.21.15.50:0/2123555241 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd36400b860 con 0x7fd374159480 2023-10-06T01:22:07.041 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:07.038+0000 7fd371d9b700 1 -- 172.21.15.50:0/2123555241 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd36400b9c0 con 0x7fd374159480 2023-10-06T01:22:07.041 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:07.038+0000 7fd371d9b700 1 -- 172.21.15.50:0/2123555241 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd36400bd60 con 0x7fd374159480 2023-10-06T01:22:07.041 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:07.038+0000 7fd3789fe700 1 -- 172.21.15.50:0/2123555241 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd374159480 msgr2=0x7fd3740b30d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:07.041 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:07.038+0000 7fd3789fe700 1 --2- 172.21.15.50:0/2123555241 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd374159480 0x7fd3740b30d0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fd3740d0260 tx=0x7fd364009250 comp rx=0 tx=0).stop 2023-10-06T01:22:07.041 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:07.038+0000 7fd3789fe700 1 -- 172.21.15.50:0/2123555241 shutdown_connections 2023-10-06T01:22:07.042 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:07.038+0000 7fd3789fe700 1 --2- 172.21.15.50:0/2123555241 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd3740cc1b0 0x7fd3740b2140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:07.042 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:07.038+0000 7fd3789fe700 1 --2- 172.21.15.50:0/2123555241 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd374159480 0x7fd3740b30d0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:07.042 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:07.038+0000 7fd3789fe700 1 --2- 172.21.15.50:0/2123555241 >> v2:172.21.15.155:3300/0 conn(0x7fd3740b3610 0x7fd3740cbc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:07.042 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:07.038+0000 7fd3789fe700 1 -- 172.21.15.50:0/2123555241 >> 172.21.15.50:0/2123555241 conn(0x7fd37406ed20 msgr2=0x7fd37406f120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:22:07.042 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:07.038+0000 7fd3789fe700 1 -- 172.21.15.50:0/2123555241 shutdown_connections 2023-10-06T01:22:07.042 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:07.038+0000 7fd3789fe700 1 -- 172.21.15.50:0/2123555241 wait complete. 2023-10-06T01:22:07.044 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:07.040+0000 7fd3789fe700 1 Processor -- start 2023-10-06T01:22:07.044 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:07.040+0000 7fd3789fe700 1 -- start start 2023-10-06T01:22:07.044 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:07.041+0000 7fd3789fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd3740b3610 0x7fd37415f920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:07.044 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:07.041+0000 7fd3789fe700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd3740cc1b0 0x7fd3740c55c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:07.045 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:07.041+0000 7fd3789fe700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd374159480 0x7fd3740cdfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:07.045 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:07.041+0000 7fd3789fe700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd37415ba40 con 0x7fd3740b3610 2023-10-06T01:22:07.045 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:07.041+0000 7fd3789fe700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd37415ab90 con 0x7fd374159480 2023-10-06T01:22:07.045 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:07.041+0000 7fd3789fe700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd37415ae30 con 0x7fd3740cc1b0 2023-10-06T01:22:07.045 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:07.041+0000 7fd372d9d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd3740b3610 0x7fd37415f920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:07.045 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:07.041+0000 7fd372d9d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd3740b3610 0x7fd37415f920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:37160/0 (socket says 172.21.15.50:37160) 2023-10-06T01:22:07.045 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:07.041+0000 7fd372d9d700 1 -- 172.21.15.50:0/1113906666 learned_addr learned my addr 172.21.15.50:0/1113906666 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-06T01:22:07.045 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:07.041+0000 7fd37259c700 1 --2- 172.21.15.50:0/1113906666 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd3740cc1b0 0x7fd3740c55c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:07.045 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:07.041+0000 7fd37359e700 1 --2- 172.21.15.50:0/1113906666 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd374159480 0x7fd3740cdfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:07.045 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:07.041+0000 7fd372d9d700 1 -- 172.21.15.50:0/1113906666 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd3740cc1b0 msgr2=0x7fd3740c55c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:07.045 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:07.041+0000 7fd372d9d700 1 --2- 172.21.15.50:0/1113906666 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd3740cc1b0 0x7fd3740c55c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:07.046 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:07.041+0000 7fd372d9d700 1 -- 172.21.15.50:0/1113906666 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd374159480 msgr2=0x7fd3740cdfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:07.046 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:07.041+0000 7fd372d9d700 1 --2- 172.21.15.50:0/1113906666 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd374159480 0x7fd3740cdfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:07.046 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:07.041+0000 7fd372d9d700 1 -- 172.21.15.50:0/1113906666 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3640094f0 con 0x7fd3740b3610 2023-10-06T01:22:07.046 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:07.042+0000 7fd37259c700 1 --2- 172.21.15.50:0/1113906666 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd3740cc1b0 0x7fd3740c55c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T01:22:07.046 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:07.042+0000 7fd37359e700 1 --2- 172.21.15.50:0/1113906666 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd374159480 0x7fd3740cdfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T01:22:07.046 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:07.042+0000 7fd372d9d700 1 --2- 172.21.15.50:0/1113906666 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd3740b3610 0x7fd37415f920 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fd374069190 tx=0x7fd364017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:22:07.046 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:07.042+0000 7fd35affd700 1 -- 172.21.15.50:0/1113906666 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd364024440 con 0x7fd3740b3610 2023-10-06T01:22:07.046 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:07.042+0000 7fd35affd700 1 -- 172.21.15.50:0/1113906666 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd3640245a0 con 0x7fd3740b3610 2023-10-06T01:22:07.046 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:07.042+0000 7fd35affd700 1 -- 172.21.15.50:0/1113906666 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd364024960 con 0x7fd3740b3610 2023-10-06T01:22:07.046 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:07.042+0000 7fd3789fe700 1 -- 172.21.15.50:0/1113906666 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd37415b110 con 0x7fd3740b3610 2023-10-06T01:22:07.047 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:07.042+0000 7fd3789fe700 1 -- 172.21.15.50:0/1113906666 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd37415b6d0 con 0x7fd3740b3610 2023-10-06T01:22:07.047 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:07.043+0000 7fd3789fe700 1 -- 172.21.15.50:0/1113906666 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd37415b860 con 0x7fd3740b3610 2023-10-06T01:22:07.047 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:07.044+0000 7fd35affd700 1 -- 172.21.15.50:0/1113906666 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fd36401a420 con 0x7fd3740b3610 2023-10-06T01:22:07.047 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:07.045+0000 7fd35affd700 1 --2- 172.21.15.50:0/1113906666 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7fd360066f30 0x7fd3600693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:07.048 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:07.045+0000 7fd35affd700 1 -- 172.21.15.50:0/1113906666 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6809+0+0 (secure 0 0 0) 0x7fd3640867f0 con 0x7fd3740b3610 2023-10-06T01:22:07.048 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:07.045+0000 7fd37259c700 1 --2- 172.21.15.50:0/1113906666 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7fd360066f30 0x7fd3600693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:07.048 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:07.046+0000 7fd37259c700 1 --2- 172.21.15.50:0/1113906666 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7fd360066f30 0x7fd3600693e0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fd3740affe0 tx=0x7fd368008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:22:07.050 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:07.049+0000 7fd35affd700 1 -- 172.21.15.50:0/1113906666 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd364053610 con 0x7fd3740b3610 2023-10-06T01:22:07.254 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:07.254+0000 7fd3789fe700 1 -- 172.21.15.50:0/1113906666 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd37405f270 con 0x7fd3740b3610 2023-10-06T01:22:07.255 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:07.255+0000 7fd35affd700 1 -- 172.21.15.50:0/1113906666 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+18707 (secure 0 0 0) 0x7fd364056c30 con 0x7fd3740b3610 2023-10-06T01:22:07.256 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-10-06T01:22:07.256 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":25,"fsid":"0bfd9a6b-1587-4fe4-a89e-e43c00286b4e","created":"2023-10-06T01:21:16.828801+0000","modified":"2023-10-06T01:21:41.329781+0000","last_up_change":"2023-10-06T01:21:28.584523+0000","last_in_change":"2023-10-06T01:21:20.179863+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-10-06T01:21:29.304225+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":".mgr","create_time":"2023-10-06T01:21:29.835490+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-06T01:21:34.675315+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-06T01:21:35.753991+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-10-06T01:21:38.853108+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"9060727a-3959-4de3-8363-c5c5d7826c9a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":87837},{"type":"v1","addr":"172.21.15.50:6801","nonce":87837}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":87837},{"type":"v1","addr":"172.21.15.50:6803","nonce":87837}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":87837},{"type":"v1","addr":"172.21.15.50:6807","nonce":87837}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":87837},{"type":"v1","addr":"172.21.15.50:6805","nonce":87837}]},"public_addr":"172.21.15.50:6801/87837","cluster_addr":"172.21.15.50:6803/87837","heartbeat_back_addr":"172.21.15.50:6807/87837","heartbeat_front_addr":"172.21.15.50:6805/87837","state":["exists","up"]},{"osd":1,"uuid":"5ad9ef12-b579-47ea-b690-90ba887e2cef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":87853},{"type":"v1","addr":"172.21.15.50:6809","nonce":87853}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":87853},{"type":"v1","addr":"172.21.15.50:6811","nonce":87853}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":87853},{"type":"v1","addr":"172.21.15.50:6815","nonce":87853}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":87853},{"type":"v1","addr":"172.21.15.50:6813","nonce":87853}]},"public_addr":"172.21.15.50:6809/87853","cluster_addr":"172.21.15.50:6811/87853","heartbeat_back_addr":"172.21.15.50:6815/87853","heartbeat_front_addr":"172.21.15.50:6813/87853","state":["exists","up"]},{"osd":2,"uuid":"c7aee044-6f75-436f-90e1-ba42a57359bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6821","nonce":87855},{"type":"v1","addr":"172.21.15.50:6822","nonce":87855}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6824","nonce":87855},{"type":"v1","addr":"172.21.15.50:6826","nonce":87855}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":87855},{"type":"v1","addr":"172.21.15.50:6831","nonce":87855}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":87855},{"type":"v1","addr":"172.21.15.50:6829","nonce":87855}]},"public_addr":"172.21.15.50:6822/87855","cluster_addr":"172.21.15.50:6826/87855","heartbeat_back_addr":"172.21.15.50:6831/87855","heartbeat_front_addr":"172.21.15.50:6829/87855","state":["exists","up"]},{"osd":3,"uuid":"d9b901c8-e8b2-44af-9508-f453120a96c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":87856},{"type":"v1","addr":"172.21.15.50:6817","nonce":87856}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":87856},{"type":"v1","addr":"172.21.15.50:6819","nonce":87856}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6825","nonce":87856},{"type":"v1","addr":"172.21.15.50:6827","nonce":87856}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6820","nonce":87856},{"type":"v1","addr":"172.21.15.50:6823","nonce":87856}]},"public_addr":"172.21.15.50:6817/87856","cluster_addr":"172.21.15.50:6819/87856","heartbeat_back_addr":"172.21.15.50:6827/87856","heartbeat_front_addr":"172.21.15.50:6823/87856","state":["exists","up"]},{"osd":4,"uuid":"2b3c6b38-e3e9-4301-9445-60fd3fe8ce03","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":85805},{"type":"v1","addr":"172.21.15.155:6801","nonce":85805}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":85805},{"type":"v1","addr":"172.21.15.155:6803","nonce":85805}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6806","nonce":85805},{"type":"v1","addr":"172.21.15.155:6807","nonce":85805}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6804","nonce":85805},{"type":"v1","addr":"172.21.15.155:6805","nonce":85805}]},"public_addr":"172.21.15.155:6801/85805","cluster_addr":"172.21.15.155:6803/85805","heartbeat_back_addr":"172.21.15.155:6807/85805","heartbeat_front_addr":"172.21.15.155:6805/85805","state":["exists","up"]},{"osd":5,"uuid":"417b5f8f-65f1-4c94-91a7-a6ce03fe1679","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6816","nonce":85807},{"type":"v1","addr":"172.21.15.155:6818","nonce":85807}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6820","nonce":85807},{"type":"v1","addr":"172.21.15.155:6822","nonce":85807}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6828","nonce":85807},{"type":"v1","addr":"172.21.15.155:6830","nonce":85807}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6824","nonce":85807},{"type":"v1","addr":"172.21.15.155:6826","nonce":85807}]},"public_addr":"172.21.15.155:6818/85807","cluster_addr":"172.21.15.155:6822/85807","heartbeat_back_addr":"172.21.15.155:6830/85807","heartbeat_front_addr":"172.21.15.155:6826/85807","state":["exists","up"]},{"osd":6,"uuid":"c150cff3-aee4-4714-9c08-d182b1ba9ffd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6808","nonce":85806},{"type":"v1","addr":"172.21.15.155:6809","nonce":85806}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6810","nonce":85806},{"type":"v1","addr":"172.21.15.155:6811","nonce":85806}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6814","nonce":85806},{"type":"v1","addr":"172.21.15.155:6815","nonce":85806}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6812","nonce":85806},{"type":"v1","addr":"172.21.15.155:6813","nonce":85806}]},"public_addr":"172.21.15.155:6809/85806","cluster_addr":"172.21.15.155:6811/85806","heartbeat_back_addr":"172.21.15.155:6815/85806","heartbeat_front_addr":"172.21.15.155:6813/85806","state":["exists","up"]},{"osd":7,"uuid":"71107f0e-04d1-4e72-a0ec-0faf6af003e7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6817","nonce":85832},{"type":"v1","addr":"172.21.15.155:6819","nonce":85832}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6821","nonce":85832},{"type":"v1","addr":"172.21.15.155:6823","nonce":85832}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6829","nonce":85832},{"type":"v1","addr":"172.21.15.155:6831","nonce":85832}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6825","nonce":85832},{"type":"v1","addr":"172.21.15.155:6827","nonce":85832}]},"public_addr":"172.21.15.155:6819/85832","cluster_addr":"172.21.15.155:6823/85832","heartbeat_back_addr":"172.21.15.155:6831/85832","heartbeat_front_addr":"172.21.15.155:6827/85832","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:21:25.423389+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:21:25.472661+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:21:25.817562+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:21:25.551257+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:21:25.407818+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:21:25.557976+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:21:25.747299+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:21:25.827576+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T01:22:07.258 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:07.257+0000 7fd3789fe700 1 -- 172.21.15.50:0/1113906666 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7fd360066f30 msgr2=0x7fd3600693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:07.258 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:07.257+0000 7fd3789fe700 1 --2- 172.21.15.50:0/1113906666 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7fd360066f30 0x7fd3600693e0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fd3740affe0 tx=0x7fd368008040 comp rx=0 tx=0).stop 2023-10-06T01:22:07.258 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:07.257+0000 7fd3789fe700 1 -- 172.21.15.50:0/1113906666 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd3740b3610 msgr2=0x7fd37415f920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:07.258 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:07.257+0000 7fd3789fe700 1 --2- 172.21.15.50:0/1113906666 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd3740b3610 0x7fd37415f920 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fd374069190 tx=0x7fd364017000 comp rx=0 tx=0).stop 2023-10-06T01:22:07.259 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:07.257+0000 7fd3789fe700 1 -- 172.21.15.50:0/1113906666 shutdown_connections 2023-10-06T01:22:07.259 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:07.257+0000 7fd3789fe700 1 --2- 172.21.15.50:0/1113906666 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7fd360066f30 0x7fd3600693e0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:07.259 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:07.257+0000 7fd3789fe700 1 --2- 172.21.15.50:0/1113906666 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd374159480 0x7fd3740cdfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:07.259 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:07.257+0000 7fd3789fe700 1 --2- 172.21.15.50:0/1113906666 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd3740b3610 0x7fd37415f920 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:07.259 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:07.257+0000 7fd3789fe700 1 --2- 172.21.15.50:0/1113906666 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd3740cc1b0 0x7fd3740c55c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:07.259 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:07.257+0000 7fd3789fe700 1 -- 172.21.15.50:0/1113906666 >> 172.21.15.50:0/1113906666 conn(0x7fd37406ed20 msgr2=0x7fd3741550f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:22:07.259 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:07.257+0000 7fd3789fe700 1 -- 172.21.15.50:0/1113906666 shutdown_connections 2023-10-06T01:22:07.259 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:07.257+0000 7fd3789fe700 1 -- 172.21.15.50:0/1113906666 wait complete. 2023-10-06T01:22:07.276 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-10-06T01:21:29.304225+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-10-06T01:21:29.835490+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-06T01:21:34.675315+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-10-06T01:21:35.753991+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-10-06T01:21:38.853108+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-06T01:22:07.276 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-10-06T01:22:07.466 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:07.465+0000 7f0a4299d700 1 Processor -- start 2023-10-06T01:22:07.466 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:07.465+0000 7f0a4299d700 1 -- start start 2023-10-06T01:22:07.468 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:07.467+0000 7f0a4299d700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f0a3c13c470 0x7f0a3c0ca990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:07.468 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:07.467+0000 7f0a4299d700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0a3c15a250 0x7f0a3c0c8730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:07.468 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:07.467+0000 7f0a4299d700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0a3c06d470 con 0x7f0a3c0caed0 2023-10-06T01:22:07.468 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:07.467+0000 7f0a4299d700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0a3c15a6d0 con 0x7f0a3c13c470 2023-10-06T01:22:07.468 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:07.467+0000 7f0a4299d700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a3c0cb370 con 0x7f0a3c15a250 2023-10-06T01:22:07.468 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:07.467+0000 7f0a4199b700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f0a3c13c470 0x7f0a3c0ca990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:07.468 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:07.467+0000 7f0a4219c700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0a3c15a250 0x7f0a3c0c8730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:07.469 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:07.467+0000 7f0a4119a700 1 --1- >> v1:172.21.15.155:6789/0 conn(0x7f0a3c0caed0 0x7f0a3c159b40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.155:6789/0 says I am v1:172.21.15.50:44352/0 (socket says 172.21.15.50:44352) 2023-10-06T01:22:07.469 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:07.467+0000 7f0a4119a700 1 -- 172.21.15.50:0/2689597769 learned_addr learned my addr 172.21.15.50:0/2689597769 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-10-06T01:22:07.470 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:07.468+0000 7f0a40999700 1 -- 172.21.15.50:0/2689597769 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 595832473 0 0) 0x7f0a3c06d470 con 0x7f0a3c0caed0 2023-10-06T01:22:07.470 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:07.468+0000 7f0a40999700 1 -- 172.21.15.50:0/2689597769 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0a28003570 con 0x7f0a3c0caed0 2023-10-06T01:22:07.470 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:07.468+0000 7f0a4219c700 1 -- 172.21.15.50:0/2689597769 >> v2:172.21.15.155:3300/0 conn(0x7f0a3c13c470 msgr2=0x7f0a3c0ca990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:22:07.471 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:07.468+0000 7f0a4219c700 1 --2- 172.21.15.50:0/2689597769 >> v2:172.21.15.155:3300/0 conn(0x7f0a3c13c470 0x7f0a3c0ca990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:07.471 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:07.468+0000 7f0a4219c700 1 -- 172.21.15.50:0/2689597769 >> v1:172.21.15.155:6789/0 conn(0x7f0a3c0caed0 legacy=0x7f0a3c159b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:07.471 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:07.468+0000 7f0a4219c700 1 -- 172.21.15.50:0/2689597769 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a3c06cb80 con 0x7f0a3c15a250 2023-10-06T01:22:07.471 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:07.468+0000 7f0a4199b700 1 --2- 172.21.15.50:0/2689597769 >> v2:172.21.15.155:3300/0 conn(0x7f0a3c13c470 0x7f0a3c0ca990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T01:22:07.471 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:07.468+0000 7f0a4219c700 1 --2- 172.21.15.50:0/2689597769 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0a3c15a250 0x7f0a3c0c8730 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f0a34009e60 tx=0x7f0a34009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=23676a81a765b58c server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:22:07.471 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:07.468+0000 7f0a40999700 1 -- 172.21.15.50:0/2689597769 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a3400e070 con 0x7f0a3c15a250 2023-10-06T01:22:07.471 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:07.468+0000 7f0a40999700 1 -- 172.21.15.50:0/2689597769 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a3400bab0 con 0x7f0a3c15a250 2023-10-06T01:22:07.471 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:07.468+0000 7f0a40999700 1 -- 172.21.15.50:0/2689597769 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a3400be70 con 0x7f0a3c15a250 2023-10-06T01:22:07.471 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:07.469+0000 7f0a4299d700 1 -- 172.21.15.50:0/2689597769 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0a3c15a250 msgr2=0x7f0a3c0c8730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:07.471 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:07.469+0000 7f0a4299d700 1 --2- 172.21.15.50:0/2689597769 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0a3c15a250 0x7f0a3c0c8730 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f0a34009e60 tx=0x7f0a34009780 comp rx=0 tx=0).stop 2023-10-06T01:22:07.471 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:07.469+0000 7f0a4299d700 1 -- 172.21.15.50:0/2689597769 shutdown_connections 2023-10-06T01:22:07.471 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:07.469+0000 7f0a4299d700 1 --2- 172.21.15.50:0/2689597769 >> v2:172.21.15.155:3300/0 conn(0x7f0a3c13c470 0x7f0a3c0ca990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:07.472 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:07.469+0000 7f0a4299d700 1 --2- 172.21.15.50:0/2689597769 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0a3c15a250 0x7f0a3c0c8730 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:07.472 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:07.469+0000 7f0a4299d700 1 -- 172.21.15.50:0/2689597769 >> 172.21.15.50:0/2689597769 conn(0x7f0a3c06b370 msgr2=0x7f0a3c06b770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:22:07.472 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:07.469+0000 7f0a4299d700 1 -- 172.21.15.50:0/2689597769 shutdown_connections 2023-10-06T01:22:07.472 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:07.469+0000 7f0a4299d700 1 -- 172.21.15.50:0/2689597769 wait complete. 2023-10-06T01:22:07.474 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:07.471+0000 7f0a4299d700 1 Processor -- start 2023-10-06T01:22:07.474 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:07.471+0000 7f0a4299d700 1 -- start start 2023-10-06T01:22:07.474 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:07.472+0000 7f0a4299d700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0a3c0caed0 0x7f0a3c0b3980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:07.474 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:07.472+0000 7f0a4299d700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0a3c13c470 0x7f0a3c155630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:07.474 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:07.472+0000 7f0a4299d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0a3c15a250 0x7f0a3c0c6b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:07.474 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:07.472+0000 7f0a4299d700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a3c0b1830 con 0x7f0a3c15a250 2023-10-06T01:22:07.474 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:07.472+0000 7f0a4299d700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a3c0b1f90 con 0x7f0a3c13c470 2023-10-06T01:22:07.474 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:07.472+0000 7f0a4299d700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a3c0b3ec0 con 0x7f0a3c0caed0 2023-10-06T01:22:07.475 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:07.472+0000 7f0a4219c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0a3c15a250 0x7f0a3c0c6b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:07.475 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:07.472+0000 7f0a4219c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0a3c15a250 0x7f0a3c0c6b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:37176/0 (socket says 172.21.15.50:37176) 2023-10-06T01:22:07.475 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:07.472+0000 7f0a4219c700 1 -- 172.21.15.50:0/3287905479 learned_addr learned my addr 172.21.15.50:0/3287905479 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-06T01:22:07.475 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:07.472+0000 7f0a4119a700 1 --2- 172.21.15.50:0/3287905479 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0a3c13c470 0x7f0a3c155630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:07.475 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:07.472+0000 7f0a4199b700 1 --2- 172.21.15.50:0/3287905479 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0a3c0caed0 0x7f0a3c0b3980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:07.475 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:07.472+0000 7f0a4219c700 1 -- 172.21.15.50:0/3287905479 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0a3c0caed0 msgr2=0x7f0a3c0b3980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:07.475 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:07.472+0000 7f0a4219c700 1 --2- 172.21.15.50:0/3287905479 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0a3c0caed0 0x7f0a3c0b3980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:07.475 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:07.472+0000 7f0a4219c700 1 -- 172.21.15.50:0/3287905479 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0a3c13c470 msgr2=0x7f0a3c155630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:07.475 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:07.472+0000 7f0a4219c700 1 --2- 172.21.15.50:0/3287905479 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0a3c13c470 0x7f0a3c155630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:07.475 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:07.472+0000 7f0a4219c700 1 -- 172.21.15.50:0/3287905479 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a38009420 con 0x7f0a3c15a250 2023-10-06T01:22:07.475 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:07.473+0000 7f0a4219c700 1 --2- 172.21.15.50:0/3287905479 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0a3c15a250 0x7f0a3c0c6b00 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f0a3c06c430 tx=0x7f0a34019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:22:07.476 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:07.473+0000 7f0a31ffb700 1 -- 172.21.15.50:0/3287905479 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a34012e10 con 0x7f0a3c15a250 2023-10-06T01:22:07.476 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:07.473+0000 7f0a4299d700 1 -- 172.21.15.50:0/3287905479 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0a34009a20 con 0x7f0a3c15a250 2023-10-06T01:22:07.476 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:07.473+0000 7f0a31ffb700 1 -- 172.21.15.50:0/3287905479 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a34027470 con 0x7f0a3c15a250 2023-10-06T01:22:07.476 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:07.473+0000 7f0a31ffb700 1 -- 172.21.15.50:0/3287905479 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a34027830 con 0x7f0a3c15a250 2023-10-06T01:22:07.476 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:07.473+0000 7f0a4299d700 1 -- 172.21.15.50:0/3287905479 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0a3c0b1550 con 0x7f0a3c15a250 2023-10-06T01:22:07.477 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:07.474+0000 7f0a4299d700 1 -- 172.21.15.50:0/3287905479 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0a3c0b2120 con 0x7f0a3c15a250 2023-10-06T01:22:07.477 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:07.475+0000 7f0a31ffb700 1 -- 172.21.15.50:0/3287905479 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f0a34024070 con 0x7f0a3c15a250 2023-10-06T01:22:07.477 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:07.476+0000 7f0a31ffb700 1 --2- 172.21.15.50:0/3287905479 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f0a20066f30 0x7f0a200693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:07.477 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:07.476+0000 7f0a31ffb700 1 -- 172.21.15.50:0/3287905479 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f0a34087420 con 0x7f0a3c15a250 2023-10-06T01:22:07.477 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:07.476+0000 7f0a4199b700 1 --2- 172.21.15.50:0/3287905479 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f0a20066f30 0x7f0a200693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:07.477 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:07.477+0000 7f0a4199b700 1 --2- 172.21.15.50:0/3287905479 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f0a20066f30 0x7f0a200693e0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f0a38009f40 tx=0x7f0a380091a0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:22:07.481 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:07.480+0000 7f0a31ffb700 1 -- 172.21.15.50:0/3287905479 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f0a340541a0 con 0x7f0a3c15a250 2023-10-06T01:22:07.681 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:07.680+0000 7f0a4299d700 1 -- 172.21.15.50:0/3287905479 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f0a3c05f270 con 0x7f0a3c15a250 2023-10-06T01:22:07.681 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:07.680+0000 7f0a31ffb700 1 -- 172.21.15.50:0/3287905479 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v25) v1 ==== 92+0+10 (secure 0 0 0) 0x7f0a340577c0 con 0x7f0a3c15a250 2023-10-06T01:22:07.681 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 8 2023-10-06T01:22:07.684 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:07.683+0000 7f0a4299d700 1 -- 172.21.15.50:0/3287905479 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f0a20066f30 msgr2=0x7f0a200693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:07.684 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:07.683+0000 7f0a4299d700 1 --2- 172.21.15.50:0/3287905479 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f0a20066f30 0x7f0a200693e0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f0a38009f40 tx=0x7f0a380091a0 comp rx=0 tx=0).stop 2023-10-06T01:22:07.684 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:07.683+0000 7f0a4299d700 1 -- 172.21.15.50:0/3287905479 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0a3c15a250 msgr2=0x7f0a3c0c6b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:07.684 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:07.683+0000 7f0a4299d700 1 --2- 172.21.15.50:0/3287905479 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0a3c15a250 0x7f0a3c0c6b00 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f0a3c06c430 tx=0x7f0a34019000 comp rx=0 tx=0).stop 2023-10-06T01:22:07.684 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:07.683+0000 7f0a4299d700 1 -- 172.21.15.50:0/3287905479 shutdown_connections 2023-10-06T01:22:07.685 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:07.683+0000 7f0a4299d700 1 --2- 172.21.15.50:0/3287905479 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0a3c15a250 0x7f0a3c0c6b00 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:07.685 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:07.683+0000 7f0a4299d700 1 --2- 172.21.15.50:0/3287905479 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0a3c0caed0 0x7f0a3c0b3980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:07.685 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:07.683+0000 7f0a4299d700 1 --2- 172.21.15.50:0/3287905479 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f0a20066f30 0x7f0a200693e0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:07.685 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:07.683+0000 7f0a4299d700 1 --2- 172.21.15.50:0/3287905479 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0a3c13c470 0x7f0a3c155630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:07.685 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:07.683+0000 7f0a4299d700 1 -- 172.21.15.50:0/3287905479 >> 172.21.15.50:0/3287905479 conn(0x7f0a3c06b370 msgr2=0x7f0a3c0c9490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:22:07.685 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:07.683+0000 7f0a4299d700 1 -- 172.21.15.50:0/3287905479 shutdown_connections 2023-10-06T01:22:07.685 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:07.683+0000 7f0a4299d700 1 -- 172.21.15.50:0/3287905479 wait complete. 2023-10-06T01:22:07.701 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-06T01:22:07.893 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:07.892+0000 7ff9bb19d700 1 Processor -- start 2023-10-06T01:22:07.893 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:07.892+0000 7ff9bb19d700 1 -- start start 2023-10-06T01:22:07.901 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:07.893+0000 7ff9bb19d700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff9b4154ad0 0x7ff9b40b15d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:07.901 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:07.893+0000 7ff9bb19d700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7ff9b40ae1f0 0x7ff9b40ab7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:07.902 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:07.893+0000 7ff9bb19d700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff9b406ef50 con 0x7ff9b4154ea0 2023-10-06T01:22:07.902 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:07.893+0000 7ff9bb19d700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff9b406e340 con 0x7ff9b40ae1f0 2023-10-06T01:22:07.902 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:07.893+0000 7ff9bb19d700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9b406e620 con 0x7ff9b4154ad0 2023-10-06T01:22:07.902 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:07.893+0000 7ff9ba99c700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7ff9b40ae1f0 0x7ff9b40ab7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:07.902 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:07.894+0000 7ff9b999a700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7ff9b4154ea0 0x7ff9b40adae0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:56664/0 (socket says 172.21.15.50:56664) 2023-10-06T01:22:07.902 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:07.894+0000 7ff9ba99c700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7ff9b40ae1f0 0x7ff9b40ab7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:37190/0 (socket says 172.21.15.50:37190) 2023-10-06T01:22:07.903 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:07.894+0000 7ff9b999a700 1 -- 172.21.15.50:0/1497725262 learned_addr learned my addr 172.21.15.50:0/1497725262 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-10-06T01:22:07.903 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:07.894+0000 7ff9ba19b700 1 --2- 172.21.15.50:0/1497725262 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff9b4154ad0 0x7ff9b40b15d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:07.903 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:07.894+0000 7ff9ba99c700 1 -- 172.21.15.50:0/1497725262 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff9b4154ad0 msgr2=0x7ff9b40b15d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:22:07.903 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:07.894+0000 7ff9ba99c700 1 --2- 172.21.15.50:0/1497725262 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff9b4154ad0 0x7ff9b40b15d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:07.903 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:07.894+0000 7ff9ba99c700 1 -- 172.21.15.50:0/1497725262 >> v1:172.21.15.50:6789/0 conn(0x7ff9b4154ea0 legacy=0x7ff9b40adae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:07.903 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:07.894+0000 7ff9ba99c700 1 -- 172.21.15.50:0/1497725262 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9b406e900 con 0x7ff9b40ae1f0 2023-10-06T01:22:07.903 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:07.894+0000 7ff9b9199700 1 -- 172.21.15.50:0/1497725262 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 64563503 0 0) 0x7ff9b406ef50 con 0x7ff9b4154ea0 2023-10-06T01:22:07.903 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:07.894+0000 7ff9ba99c700 1 --2- 172.21.15.50:0/1497725262 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff9b40ae1f0 0x7ff9b40ab7d0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7ff9ac009e60 tx=0x7ff9ac009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e444a05a99e865f1 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:22:07.904 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:07.895+0000 7ff9b9199700 1 -- 172.21.15.50:0/1497725262 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9ac00e070 con 0x7ff9b40ae1f0 2023-10-06T01:22:07.904 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:07.895+0000 7ff9b9199700 1 -- 172.21.15.50:0/1497725262 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff9ac00bb60 con 0x7ff9b40ae1f0 2023-10-06T01:22:07.904 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:07.895+0000 7ff9b9199700 1 -- 172.21.15.50:0/1497725262 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9ac012430 con 0x7ff9b40ae1f0 2023-10-06T01:22:07.904 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:07.895+0000 7ff9bb19d700 1 -- 172.21.15.50:0/1497725262 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff9b40ae1f0 msgr2=0x7ff9b40ab7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:07.904 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:07.895+0000 7ff9bb19d700 1 --2- 172.21.15.50:0/1497725262 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff9b40ae1f0 0x7ff9b40ab7d0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7ff9ac009e60 tx=0x7ff9ac009780 comp rx=0 tx=0).stop 2023-10-06T01:22:07.904 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:07.895+0000 7ff9bb19d700 1 -- 172.21.15.50:0/1497725262 shutdown_connections 2023-10-06T01:22:07.904 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:07.895+0000 7ff9bb19d700 1 --2- 172.21.15.50:0/1497725262 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff9b40ae1f0 0x7ff9b40ab7d0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:07.904 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:07.895+0000 7ff9bb19d700 1 --2- 172.21.15.50:0/1497725262 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff9b4154ad0 0x7ff9b40b15d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:07.905 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:07.895+0000 7ff9bb19d700 1 -- 172.21.15.50:0/1497725262 >> 172.21.15.50:0/1497725262 conn(0x7ff9b40cbf10 msgr2=0x7ff9b40cc310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:22:07.905 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:07.895+0000 7ff9bb19d700 1 -- 172.21.15.50:0/1497725262 shutdown_connections 2023-10-06T01:22:07.905 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:07.895+0000 7ff9bb19d700 1 -- 172.21.15.50:0/1497725262 wait complete. 2023-10-06T01:22:07.905 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:07.897+0000 7ff9bb19d700 1 Processor -- start 2023-10-06T01:22:07.905 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:07.897+0000 7ff9bb19d700 1 -- start start 2023-10-06T01:22:07.905 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:07.898+0000 7ff9bb19d700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff9b40ae1f0 0x7ff9b40af8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:07.905 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:07.898+0000 7ff9bb19d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff9b4154ad0 0x7ff9b40b01f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:07.906 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:07.898+0000 7ff9bb19d700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff9b4154ea0 0x7ff9b414d9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:07.906 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:07.898+0000 7ff9bb19d700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9b414ffa0 con 0x7ff9b4154ad0 2023-10-06T01:22:07.906 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:07.898+0000 7ff9bb19d700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9b414f970 con 0x7ff9b40ae1f0 2023-10-06T01:22:07.906 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:07.898+0000 7ff9bb19d700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9b40b0730 con 0x7ff9b4154ea0 2023-10-06T01:22:07.906 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:07.898+0000 7ff9b999a700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff9b4154ad0 0x7ff9b40b01f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:07.906 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:07.898+0000 7ff9b999a700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff9b4154ad0 0x7ff9b40b01f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:37196/0 (socket says 172.21.15.50:37196) 2023-10-06T01:22:07.907 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:07.898+0000 7ff9b999a700 1 -- 172.21.15.50:0/1282256760 learned_addr learned my addr 172.21.15.50:0/1282256760 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-06T01:22:07.907 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:07.898+0000 7ff9ba99c700 1 --2- 172.21.15.50:0/1282256760 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff9b4154ea0 0x7ff9b414d9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:07.907 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:07.898+0000 7ff9ba19b700 1 --2- 172.21.15.50:0/1282256760 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff9b40ae1f0 0x7ff9b40af8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:07.907 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:07.898+0000 7ff9b999a700 1 -- 172.21.15.50:0/1282256760 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff9b4154ea0 msgr2=0x7ff9b414d9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:07.907 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:07.898+0000 7ff9b999a700 1 --2- 172.21.15.50:0/1282256760 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff9b4154ea0 0x7ff9b414d9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:07.907 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:07.898+0000 7ff9b999a700 1 -- 172.21.15.50:0/1282256760 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff9b40ae1f0 msgr2=0x7ff9b40af8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:07.907 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:07.898+0000 7ff9b999a700 1 --2- 172.21.15.50:0/1282256760 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff9b40ae1f0 0x7ff9b40af8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:07.907 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:07.898+0000 7ff9b999a700 1 -- 172.21.15.50:0/1282256760 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9ac009a20 con 0x7ff9b4154ad0 2023-10-06T01:22:07.908 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:07.899+0000 7ff9b999a700 1 --2- 172.21.15.50:0/1282256760 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff9b4154ad0 0x7ff9b40b01f0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7ff9a400c5b0 tx=0x7ff9a4001070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:22:07.908 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:07.899+0000 7ff9aa7fc700 1 -- 172.21.15.50:0/1282256760 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9a4005b30 con 0x7ff9b4154ad0 2023-10-06T01:22:07.908 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:07.899+0000 7ff9aa7fc700 1 -- 172.21.15.50:0/1282256760 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff9a4005c90 con 0x7ff9b4154ad0 2023-10-06T01:22:07.908 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:07.899+0000 7ff9aa7fc700 1 -- 172.21.15.50:0/1282256760 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9a4007300 con 0x7ff9b4154ad0 2023-10-06T01:22:07.908 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:07.899+0000 7ff9bb19d700 1 -- 172.21.15.50:0/1282256760 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff9b40b0a00 con 0x7ff9b4154ad0 2023-10-06T01:22:07.908 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:07.899+0000 7ff9bb19d700 1 -- 172.21.15.50:0/1282256760 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff9b414fc30 con 0x7ff9b4154ad0 2023-10-06T01:22:07.908 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:07.900+0000 7ff9bb19d700 1 -- 172.21.15.50:0/1282256760 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff9b4150150 con 0x7ff9b4154ad0 2023-10-06T01:22:07.909 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:07.901+0000 7ff9aa7fc700 1 -- 172.21.15.50:0/1282256760 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7ff9a401b3b0 con 0x7ff9b4154ad0 2023-10-06T01:22:07.909 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:07.902+0000 7ff9aa7fc700 1 --2- 172.21.15.50:0/1282256760 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7ff998066f30 0x7ff9980693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:07.910 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:07.902+0000 7ff9aa7fc700 1 -- 172.21.15.50:0/1282256760 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6809+0+0 (secure 0 0 0) 0x7ff9a4083ec0 con 0x7ff9b4154ad0 2023-10-06T01:22:07.910 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:07.903+0000 7ff9ba19b700 1 --2- 172.21.15.50:0/1282256760 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7ff998066f30 0x7ff9980693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:07.910 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:07.903+0000 7ff9ba19b700 1 --2- 172.21.15.50:0/1282256760 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7ff998066f30 0x7ff9980693e0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7ff9b0009d40 tx=0x7ff9b0008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:22:07.910 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:07.907+0000 7ff9aa7fc700 1 -- 172.21.15.50:0/1282256760 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff9b4150150 con 0x7ff9b4154ad0 2023-10-06T01:22:08.111 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:08.110+0000 7ff9bb19d700 1 -- 172.21.15.50:0/1282256760 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7ff9b405f270 con 0x7ff9b4154ad0 2023-10-06T01:22:08.112 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:08.110+0000 7ff9aa7fc700 1 -- 172.21.15.50:0/1282256760 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v25) v1 ==== 93+0+10 (secure 0 0 0) 0x7ff9a40170a0 con 0x7ff9b4154ad0 2023-10-06T01:22:08.112 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 1 2023-10-06T01:22:08.114 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:08.113+0000 7ff9bb19d700 1 -- 172.21.15.50:0/1282256760 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7ff998066f30 msgr2=0x7ff9980693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:08.115 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:08.113+0000 7ff9bb19d700 1 --2- 172.21.15.50:0/1282256760 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7ff998066f30 0x7ff9980693e0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7ff9b0009d40 tx=0x7ff9b0008040 comp rx=0 tx=0).stop 2023-10-06T01:22:08.115 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:08.113+0000 7ff9bb19d700 1 -- 172.21.15.50:0/1282256760 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff9b4154ad0 msgr2=0x7ff9b40b01f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:08.115 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:08.113+0000 7ff9bb19d700 1 --2- 172.21.15.50:0/1282256760 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff9b4154ad0 0x7ff9b40b01f0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7ff9a400c5b0 tx=0x7ff9a4001070 comp rx=0 tx=0).stop 2023-10-06T01:22:08.115 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:08.113+0000 7ff9bb19d700 1 -- 172.21.15.50:0/1282256760 shutdown_connections 2023-10-06T01:22:08.115 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:08.113+0000 7ff9bb19d700 1 --2- 172.21.15.50:0/1282256760 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff9b4154ea0 0x7ff9b414d9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:08.116 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:08.113+0000 7ff9bb19d700 1 --2- 172.21.15.50:0/1282256760 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7ff998066f30 0x7ff9980693e0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:08.116 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:08.113+0000 7ff9bb19d700 1 --2- 172.21.15.50:0/1282256760 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff9b40ae1f0 0x7ff9b40af8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:08.116 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:08.113+0000 7ff9bb19d700 1 --2- 172.21.15.50:0/1282256760 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff9b4154ad0 0x7ff9b40b01f0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:08.116 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:08.113+0000 7ff9bb19d700 1 -- 172.21.15.50:0/1282256760 >> 172.21.15.50:0/1282256760 conn(0x7ff9b40cbf10 msgr2=0x7ff9b40ca5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:22:08.116 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:08.113+0000 7ff9bb19d700 1 -- 172.21.15.50:0/1282256760 shutdown_connections 2023-10-06T01:22:08.116 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:08.113+0000 7ff9bb19d700 1 -- 172.21.15.50:0/1282256760 wait complete. 2023-10-06T01:22:08.132 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-06T01:22:08.323 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:08.322+0000 7f6f6b59e700 1 Processor -- start 2023-10-06T01:22:08.323 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:08.322+0000 7f6f6b59e700 1 -- start start 2023-10-06T01:22:08.325 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:08.323+0000 7f6f6b59e700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f6f6c0b2660 0x7f6f6c0cccf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:08.325 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:08.323+0000 7f6f6b59e700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f6f6c0cf1f0 0x7f6f6c0cd230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:08.325 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:08.323+0000 7f6f6b59e700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6f6c0cc9b0 con 0x7f6f6c0b2a30 2023-10-06T01:22:08.325 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:08.323+0000 7f6f6b59e700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6f6c0cbda0 con 0x7f6f6c0cf1f0 2023-10-06T01:22:08.325 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:08.323+0000 7f6f6b59e700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6f6c0cc080 con 0x7f6f6c0b2660 2023-10-06T01:22:08.325 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:08.324+0000 7f6f6ad9d700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f6f6c0cf1f0 0x7f6f6c0cd230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:08.325 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:08.324+0000 7f6f6ad9d700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f6f6c0cf1f0 0x7f6f6c0cd230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:37208/0 (socket says 172.21.15.50:37208) 2023-10-06T01:22:08.325 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:08.324+0000 7f6f6ad9d700 1 -- 172.21.15.50:0/614055649 learned_addr learned my addr 172.21.15.50:0/614055649 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-06T01:22:08.326 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:08.324+0000 7f6f69d9b700 1 --1- 172.21.15.50:0/614055649 >> v1:172.21.15.50:6789/0 conn(0x7f6f6c0b2a30 0x7f6f6c0ceae0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:56674/0 (socket says 172.21.15.50:56674) 2023-10-06T01:22:08.326 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:08.324+0000 7f6f6a59c700 1 --2- 172.21.15.50:0/614055649 >> v2:172.21.15.155:3300/0 conn(0x7f6f6c0b2660 0x7f6f6c0cccf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:08.326 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:08.324+0000 7f6f6ad9d700 1 -- 172.21.15.50:0/614055649 >> v2:172.21.15.155:3300/0 conn(0x7f6f6c0b2660 msgr2=0x7f6f6c0cccf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:22:08.326 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:08.324+0000 7f6f6ad9d700 1 --2- 172.21.15.50:0/614055649 >> v2:172.21.15.155:3300/0 conn(0x7f6f6c0b2660 0x7f6f6c0cccf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:08.326 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:08.324+0000 7f6f6ad9d700 1 -- 172.21.15.50:0/614055649 >> v1:172.21.15.50:6789/0 conn(0x7f6f6c0b2a30 legacy=0x7f6f6c0ceae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:08.326 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:08.324+0000 7f6f6ad9d700 1 -- 172.21.15.50:0/614055649 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f6c0cc360 con 0x7f6f6c0cf1f0 2023-10-06T01:22:08.326 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:08.324+0000 7f6f6ad9d700 1 --2- 172.21.15.50:0/614055649 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6f6c0cf1f0 0x7f6f6c0cd230 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f6f6c089500 tx=0x7f6f64009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=43ac7161cddef6b2 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:22:08.327 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:08.324+0000 7f6f6959a700 1 -- 172.21.15.50:0/614055649 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f6400e070 con 0x7f6f6c0cf1f0 2023-10-06T01:22:08.328 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:08.325+0000 7f6f6959a700 1 -- 172.21.15.50:0/614055649 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f6400ba50 con 0x7f6f6c0cf1f0 2023-10-06T01:22:08.328 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:08.325+0000 7f6f6959a700 1 -- 172.21.15.50:0/614055649 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f640092e0 con 0x7f6f6c0cf1f0 2023-10-06T01:22:08.328 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:08.325+0000 7f6f6b59e700 1 -- 172.21.15.50:0/614055649 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6f6c0cf1f0 msgr2=0x7f6f6c0cd230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:08.328 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:08.325+0000 7f6f6b59e700 1 --2- 172.21.15.50:0/614055649 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6f6c0cf1f0 0x7f6f6c0cd230 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f6f6c089500 tx=0x7f6f64009840 comp rx=0 tx=0).stop 2023-10-06T01:22:08.328 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:08.325+0000 7f6f6b59e700 1 -- 172.21.15.50:0/614055649 shutdown_connections 2023-10-06T01:22:08.328 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:08.325+0000 7f6f6b59e700 1 --2- 172.21.15.50:0/614055649 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6f6c0cf1f0 0x7f6f6c0cd230 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:08.328 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:08.325+0000 7f6f6b59e700 1 --2- 172.21.15.50:0/614055649 >> v2:172.21.15.155:3300/0 conn(0x7f6f6c0b2660 0x7f6f6c0cccf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:08.328 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:08.325+0000 7f6f6b59e700 1 -- 172.21.15.50:0/614055649 >> 172.21.15.50:0/614055649 conn(0x7f6f6c099560 msgr2=0x7f6f6c06f500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:22:08.329 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:08.325+0000 7f6f6b59e700 1 -- 172.21.15.50:0/614055649 shutdown_connections 2023-10-06T01:22:08.329 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:08.325+0000 7f6f6b59e700 1 -- 172.21.15.50:0/614055649 wait complete. 2023-10-06T01:22:08.329 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:08.327+0000 7f6f6b59e700 1 Processor -- start 2023-10-06T01:22:08.329 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:08.327+0000 7f6f6b59e700 1 -- start start 2023-10-06T01:22:08.331 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:08.328+0000 7f6f6b59e700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6f6c0b2660 0x7f6f6c0c9e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:08.331 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:08.328+0000 7f6f6b59e700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6f6c0b2a30 0x7f6f6c13f5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:08.331 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:08.328+0000 7f6f6b59e700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6f6c0cf1f0 0x7f6f6c13efb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:08.332 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:08.328+0000 7f6f6b59e700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f6c13fe70 con 0x7f6f6c0cf1f0 2023-10-06T01:22:08.332 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:08.328+0000 7f6f6b59e700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f6c0b3480 con 0x7f6f6c0b2a30 2023-10-06T01:22:08.332 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:08.328+0000 7f6f6b59e700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f6c0b3760 con 0x7f6f6c0b2660 2023-10-06T01:22:08.332 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:08.328+0000 7f6f6ad9d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6f6c0cf1f0 0x7f6f6c13efb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:08.332 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:08.328+0000 7f6f6ad9d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6f6c0cf1f0 0x7f6f6c13efb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:37222/0 (socket says 172.21.15.50:37222) 2023-10-06T01:22:08.333 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:08.328+0000 7f6f6ad9d700 1 -- 172.21.15.50:0/1520155012 learned_addr learned my addr 172.21.15.50:0/1520155012 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-06T01:22:08.333 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:08.328+0000 7f6f69d9b700 1 --2- 172.21.15.50:0/1520155012 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6f6c0b2a30 0x7f6f6c13f5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:08.333 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:08.328+0000 7f6f6a59c700 1 --2- 172.21.15.50:0/1520155012 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6f6c0b2660 0x7f6f6c0c9e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:08.333 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:08.328+0000 7f6f6ad9d700 1 -- 172.21.15.50:0/1520155012 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6f6c0b2660 msgr2=0x7f6f6c0c9e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:08.333 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:08.328+0000 7f6f6ad9d700 1 --2- 172.21.15.50:0/1520155012 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6f6c0b2660 0x7f6f6c0c9e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:08.334 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:08.328+0000 7f6f6ad9d700 1 -- 172.21.15.50:0/1520155012 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6f6c0b2a30 msgr2=0x7f6f6c13f5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:08.334 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:08.328+0000 7f6f6ad9d700 1 --2- 172.21.15.50:0/1520155012 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6f6c0b2a30 0x7f6f6c13f5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:08.334 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:08.328+0000 7f6f6ad9d700 1 -- 172.21.15.50:0/1520155012 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f64009ae0 con 0x7f6f6c0cf1f0 2023-10-06T01:22:08.334 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:08.328+0000 7f6f6a59c700 1 --2- 172.21.15.50:0/1520155012 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6f6c0b2660 0x7f6f6c0c9e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T01:22:08.334 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:08.329+0000 7f6f6ad9d700 1 --2- 172.21.15.50:0/1520155012 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6f6c0cf1f0 0x7f6f6c13efb0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f6f64009880 tx=0x7f6f64018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:22:08.335 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:08.329+0000 7f6f5a7fc700 1 -- 172.21.15.50:0/1520155012 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f64008e80 con 0x7f6f6c0cf1f0 2023-10-06T01:22:08.335 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:08.329+0000 7f6f5a7fc700 1 -- 172.21.15.50:0/1520155012 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f6400be60 con 0x7f6f6c0cf1f0 2023-10-06T01:22:08.335 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:08.329+0000 7f6f5a7fc700 1 -- 172.21.15.50:0/1520155012 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f640266b0 con 0x7f6f6c0cf1f0 2023-10-06T01:22:08.335 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:08.329+0000 7f6f6b59e700 1 -- 172.21.15.50:0/1520155012 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6f6c0b3a40 con 0x7f6f6c0cf1f0 2023-10-06T01:22:08.335 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:08.329+0000 7f6f6b59e700 1 -- 172.21.15.50:0/1520155012 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6f6c0b4090 con 0x7f6f6c0cf1f0 2023-10-06T01:22:08.335 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:08.330+0000 7f6f6b59e700 1 -- 172.21.15.50:0/1520155012 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6f6c0c7ee0 con 0x7f6f6c0cf1f0 2023-10-06T01:22:08.336 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:08.331+0000 7f6f5a7fc700 1 -- 172.21.15.50:0/1520155012 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f6f64003040 con 0x7f6f6c0cf1f0 2023-10-06T01:22:08.336 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:08.332+0000 7f6f5a7fc700 1 --2- 172.21.15.50:0/1520155012 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f6f4c066f30 0x7f6f4c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:08.336 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:08.333+0000 7f6f5a7fc700 1 -- 172.21.15.50:0/1520155012 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f6f640864f0 con 0x7f6f6c0cf1f0 2023-10-06T01:22:08.336 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:08.333+0000 7f6f6a59c700 1 --2- 172.21.15.50:0/1520155012 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f6f4c066f30 0x7f6f4c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:08.337 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:08.333+0000 7f6f6a59c700 1 --2- 172.21.15.50:0/1520155012 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f6f4c066f30 0x7f6f4c0693e0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f6f5c006fd0 tx=0x7f6f5c008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:22:08.337 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:08.337+0000 7f6f5a7fc700 1 -- 172.21.15.50:0/1520155012 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f6f6c0c7ee0 con 0x7f6f6c0cf1f0 2023-10-06T01:22:08.538 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:08.538+0000 7f6f6b59e700 1 -- 172.21.15.50:0/1520155012 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f6f6c0c7ee0 con 0x7f6f6c0cf1f0 2023-10-06T01:22:08.539 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:08.538+0000 7f6f5a7fc700 1 -- 172.21.15.50:0/1520155012 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v25) v1 ==== 104+0+11 (secure 0 0 0) 0x7f6f6c0c7ee0 con 0x7f6f6c0cf1f0 2023-10-06T01:22:08.539 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 32 2023-10-06T01:22:08.541 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:08.540+0000 7f6f6b59e700 1 -- 172.21.15.50:0/1520155012 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f6f4c066f30 msgr2=0x7f6f4c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:08.542 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:08.540+0000 7f6f6b59e700 1 --2- 172.21.15.50:0/1520155012 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f6f4c066f30 0x7f6f4c0693e0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f6f5c006fd0 tx=0x7f6f5c008040 comp rx=0 tx=0).stop 2023-10-06T01:22:08.542 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:08.540+0000 7f6f6b59e700 1 -- 172.21.15.50:0/1520155012 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6f6c0cf1f0 msgr2=0x7f6f6c13efb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:08.542 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:08.540+0000 7f6f6b59e700 1 --2- 172.21.15.50:0/1520155012 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6f6c0cf1f0 0x7f6f6c13efb0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f6f64009880 tx=0x7f6f64018000 comp rx=0 tx=0).stop 2023-10-06T01:22:08.542 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:08.540+0000 7f6f6b59e700 1 -- 172.21.15.50:0/1520155012 shutdown_connections 2023-10-06T01:22:08.542 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:08.540+0000 7f6f6b59e700 1 --2- 172.21.15.50:0/1520155012 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6f6c0cf1f0 0x7f6f6c13efb0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:08.542 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:08.540+0000 7f6f6b59e700 1 --2- 172.21.15.50:0/1520155012 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6f6c0b2660 0x7f6f6c0c9e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:08.542 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:08.540+0000 7f6f6b59e700 1 --2- 172.21.15.50:0/1520155012 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f6f4c066f30 0x7f6f4c0693e0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:08.542 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:08.540+0000 7f6f6b59e700 1 --2- 172.21.15.50:0/1520155012 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6f6c0b2a30 0x7f6f6c13f5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:08.542 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:08.540+0000 7f6f6b59e700 1 -- 172.21.15.50:0/1520155012 >> 172.21.15.50:0/1520155012 conn(0x7f6f6c099560 msgr2=0x7f6f6c158b70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:22:08.542 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:08.540+0000 7f6f6b59e700 1 -- 172.21.15.50:0/1520155012 shutdown_connections 2023-10-06T01:22:08.543 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:08.541+0000 7f6f6b59e700 1 -- 172.21.15.50:0/1520155012 wait complete. 2023-10-06T01:22:08.559 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-06T01:22:08.749 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:08.748+0000 7f09cb59e700 1 Processor -- start 2023-10-06T01:22:08.749 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:08.748+0000 7f09cb59e700 1 -- start start 2023-10-06T01:22:08.751 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:08.749+0000 7f09cb59e700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f09cc0b2660 0x7f09cc0cccf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:08.751 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:08.749+0000 7f09cb59e700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f09cc0b2a30 0x7f09cc0cd230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:08.751 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:08.749+0000 7f09cb59e700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f09cc0cc9b0 con 0x7f09cc0ceae0 2023-10-06T01:22:08.751 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:08.749+0000 7f09cb59e700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f09cc0cbda0 con 0x7f09cc0b2a30 2023-10-06T01:22:08.751 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:08.749+0000 7f09cb59e700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09cc0cc080 con 0x7f09cc0b2660 2023-10-06T01:22:08.751 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:08.750+0000 7f09ca59c700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f09cc0b2660 0x7f09cc0cccf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:08.751 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:08.750+0000 7f09c9d9b700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f09cc0b2a30 0x7f09cc0cd230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:08.751 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:08.750+0000 7f09ca59c700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f09cc0b2660 0x7f09cc0cccf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3301/0 says I am v2:172.21.15.50:57798/0 (socket says 172.21.15.50:57798) 2023-10-06T01:22:08.751 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:08.750+0000 7f09ca59c700 1 -- 172.21.15.50:0/1309460780 learned_addr learned my addr 172.21.15.50:0/1309460780 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-06T01:22:08.751 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:08.750+0000 7f09c9d9b700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f09cc0b2a30 0x7f09cc0cd230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.50:48572/0 (socket says 172.21.15.50:48572) 2023-10-06T01:22:08.753 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:08.750+0000 7f09ca59c700 1 -- 172.21.15.50:0/1309460780 >> v2:172.21.15.155:3300/0 conn(0x7f09cc0b2a30 msgr2=0x7f09cc0cd230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:22:08.753 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:08.750+0000 7f09ca59c700 1 --2- 172.21.15.50:0/1309460780 >> v2:172.21.15.155:3300/0 conn(0x7f09cc0b2a30 0x7f09cc0cd230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:08.753 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:08.750+0000 7f09ca59c700 1 -- 172.21.15.50:0/1309460780 >> v1:172.21.15.155:6789/0 conn(0x7f09cc0ceae0 legacy=0x7f09cc0cef80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:08.753 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:08.750+0000 7f09ca59c700 1 -- 172.21.15.50:0/1309460780 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09cc0cc360 con 0x7f09cc0b2660 2023-10-06T01:22:08.753 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:08.751+0000 7f09ca59c700 1 --2- 172.21.15.50:0/1309460780 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f09cc0b2660 0x7f09cc0cccf0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f09bc009990 tx=0x7f09bc009220 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5fb6d8c43bc89f14 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:22:08.753 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:08.751+0000 7f09c959a700 1 -- 172.21.15.50:0/1309460780 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09bc009e80 con 0x7f09cc0b2660 2023-10-06T01:22:08.753 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:08.751+0000 7f09c959a700 1 -- 172.21.15.50:0/1309460780 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f09bc005c10 con 0x7f09cc0b2660 2023-10-06T01:22:08.754 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:08.751+0000 7f09c959a700 1 -- 172.21.15.50:0/1309460780 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09bc00b650 con 0x7f09cc0b2660 2023-10-06T01:22:08.754 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:08.751+0000 7f09cb59e700 1 -- 172.21.15.50:0/1309460780 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f09cc0b2660 msgr2=0x7f09cc0cccf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:08.754 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:08.751+0000 7f09cb59e700 1 --2- 172.21.15.50:0/1309460780 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f09cc0b2660 0x7f09cc0cccf0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f09bc009990 tx=0x7f09bc009220 comp rx=0 tx=0).stop 2023-10-06T01:22:08.754 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:08.752+0000 7f09cb59e700 1 -- 172.21.15.50:0/1309460780 shutdown_connections 2023-10-06T01:22:08.754 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:08.752+0000 7f09cb59e700 1 --2- 172.21.15.50:0/1309460780 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f09cc0b2660 0x7f09cc0cccf0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:08.754 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:08.752+0000 7f09cb59e700 1 --2- 172.21.15.50:0/1309460780 >> v2:172.21.15.155:3300/0 conn(0x7f09cc0b2a30 0x7f09cc0cd230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:08.754 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:08.752+0000 7f09cb59e700 1 -- 172.21.15.50:0/1309460780 >> 172.21.15.50:0/1309460780 conn(0x7f09cc099560 msgr2=0x7f09cc06f500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:22:08.754 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:08.752+0000 7f09cb59e700 1 -- 172.21.15.50:0/1309460780 shutdown_connections 2023-10-06T01:22:08.754 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:08.752+0000 7f09cb59e700 1 -- 172.21.15.50:0/1309460780 wait complete. 2023-10-06T01:22:08.755 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:08.753+0000 7f09cb59e700 1 Processor -- start 2023-10-06T01:22:08.756 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:08.753+0000 7f09cb59e700 1 -- start start 2023-10-06T01:22:08.756 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:08.754+0000 7f09cb59e700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f09cc0b2660 0x7f09cc0c8bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:08.756 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:08.754+0000 7f09cb59e700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f09cc0b2a30 0x7f09cc155aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:08.756 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:08.754+0000 7f09cb59e700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f09cc0ceae0 0x7f09cc14ef40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:08.756 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:08.754+0000 7f09cb59e700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09cc0c9e50 con 0x7f09cc0ceae0 2023-10-06T01:22:08.756 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:08.754+0000 7f09cb59e700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09cc0c9240 con 0x7f09cc0b2660 2023-10-06T01:22:08.756 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:08.754+0000 7f09cb59e700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09cc0c9520 con 0x7f09cc0b2a30 2023-10-06T01:22:08.756 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:08.754+0000 7f09ca59c700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f09cc0b2660 0x7f09cc0c8bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:08.756 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:08.754+0000 7f09ca59c700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f09cc0b2660 0x7f09cc0c8bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.50:48576/0 (socket says 172.21.15.50:48576) 2023-10-06T01:22:08.756 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:08.754+0000 7f09ca59c700 1 -- 172.21.15.50:0/134107958 learned_addr learned my addr 172.21.15.50:0/134107958 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-06T01:22:08.756 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:08.754+0000 7f09cad9d700 1 --2- 172.21.15.50:0/134107958 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f09cc0ceae0 0x7f09cc14ef40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:08.757 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:08.754+0000 7f09c9d9b700 1 --2- 172.21.15.50:0/134107958 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f09cc0b2a30 0x7f09cc155aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:08.757 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:08.755+0000 7f09ca59c700 1 -- 172.21.15.50:0/134107958 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f09cc0b2a30 msgr2=0x7f09cc155aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:08.757 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:08.755+0000 7f09ca59c700 1 --2- 172.21.15.50:0/134107958 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f09cc0b2a30 0x7f09cc155aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:08.757 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:08.755+0000 7f09ca59c700 1 -- 172.21.15.50:0/134107958 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f09cc0ceae0 msgr2=0x7f09cc14ef40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:08.757 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:08.755+0000 7f09ca59c700 1 --2- 172.21.15.50:0/134107958 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f09cc0ceae0 0x7f09cc14ef40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:08.757 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:08.755+0000 7f09ca59c700 1 -- 172.21.15.50:0/134107958 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09bc009480 con 0x7f09cc0b2660 2023-10-06T01:22:08.758 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:08.755+0000 7f09ca59c700 1 --2- 172.21.15.50:0/134107958 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f09cc0b2660 0x7f09cc0c8bb0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f09bc00b3c0 tx=0x7f09bc016000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:22:08.761 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:08.755+0000 7f09ba7fc700 1 -- 172.21.15.50:0/134107958 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09bc011980 con 0x7f09cc0b2660 2023-10-06T01:22:08.761 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:08.755+0000 7f09ba7fc700 1 -- 172.21.15.50:0/134107958 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f09bc020070 con 0x7f09cc0b2660 2023-10-06T01:22:08.761 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:08.756+0000 7f09ba7fc700 1 -- 172.21.15.50:0/134107958 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09bc011d30 con 0x7f09cc0b2660 2023-10-06T01:22:08.762 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:08.756+0000 7f09cb59e700 1 -- 172.21.15.50:0/134107958 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f09cc0c9800 con 0x7f09cc0b2660 2023-10-06T01:22:08.762 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:08.756+0000 7f09cb59e700 1 -- 172.21.15.50:0/134107958 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f09cc14f480 con 0x7f09cc0b2660 2023-10-06T01:22:08.762 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:08.756+0000 7f09cb59e700 1 -- 172.21.15.50:0/134107958 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f09cc05f270 con 0x7f09cc0b2660 2023-10-06T01:22:08.762 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:08.758+0000 7f09ba7fc700 1 -- 172.21.15.50:0/134107958 <== mon.1 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f09bc022030 con 0x7f09cc0b2660 2023-10-06T01:22:08.763 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:08.759+0000 7f09ba7fc700 1 --2- 172.21.15.50:0/134107958 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f09ac066f30 0x7f09ac0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:08.763 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:08.759+0000 7f09ba7fc700 1 -- 172.21.15.50:0/134107958 <== mon.1 v2:172.21.15.155:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f09bc0865b0 con 0x7f09cc0b2660 2023-10-06T01:22:08.763 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:08.759+0000 7f09c9d9b700 1 --2- 172.21.15.50:0/134107958 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f09ac066f30 0x7f09ac0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:08.763 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:08.760+0000 7f09c9d9b700 1 --2- 172.21.15.50:0/134107958 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f09ac066f30 0x7f09ac0693e0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f09cc16cbb0 tx=0x7f09c00091a0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:22:08.763 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:08.762+0000 7f09ba7fc700 1 -- 172.21.15.50:0/134107958 <== mon.1 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f09bc0533b0 con 0x7f09cc0b2660 2023-10-06T01:22:08.969 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:08.968+0000 7f09cb59e700 1 -- 172.21.15.50:0/134107958 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f09cc0cc640 con 0x7f09cc0b2660 2023-10-06T01:22:08.970 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:08.969+0000 7f09ba7fc700 1 -- 172.21.15.50:0/134107958 <== mon.1 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v25) v1 ==== 100+0+11 (secure 0 0 0) 0x7f09bc0569d0 con 0x7f09cc0b2660 2023-10-06T01:22:08.970 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 64 2023-10-06T01:22:08.973 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:08.972+0000 7f09cb59e700 1 -- 172.21.15.50:0/134107958 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f09ac066f30 msgr2=0x7f09ac0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:08.973 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:08.972+0000 7f09cb59e700 1 --2- 172.21.15.50:0/134107958 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f09ac066f30 0x7f09ac0693e0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f09cc16cbb0 tx=0x7f09c00091a0 comp rx=0 tx=0).stop 2023-10-06T01:22:08.973 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:08.972+0000 7f09cb59e700 1 -- 172.21.15.50:0/134107958 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f09cc0b2660 msgr2=0x7f09cc0c8bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:08.973 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:08.972+0000 7f09cb59e700 1 --2- 172.21.15.50:0/134107958 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f09cc0b2660 0x7f09cc0c8bb0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f09bc00b3c0 tx=0x7f09bc016000 comp rx=0 tx=0).stop 2023-10-06T01:22:08.973 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:08.972+0000 7f09cb59e700 1 -- 172.21.15.50:0/134107958 shutdown_connections 2023-10-06T01:22:08.973 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:08.972+0000 7f09cb59e700 1 --2- 172.21.15.50:0/134107958 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f09cc0ceae0 0x7f09cc14ef40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:08.974 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:08.972+0000 7f09cb59e700 1 --2- 172.21.15.50:0/134107958 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f09ac066f30 0x7f09ac0693e0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:08.974 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:08.972+0000 7f09cb59e700 1 --2- 172.21.15.50:0/134107958 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f09cc0b2660 0x7f09cc0c8bb0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:08.974 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:08.972+0000 7f09cb59e700 1 --2- 172.21.15.50:0/134107958 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f09cc0b2a30 0x7f09cc155aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:08.974 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:08.972+0000 7f09cb59e700 1 -- 172.21.15.50:0/134107958 >> 172.21.15.50:0/134107958 conn(0x7f09cc099560 msgr2=0x7f09cc158ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:22:08.974 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:08.972+0000 7f09cb59e700 1 -- 172.21.15.50:0/134107958 shutdown_connections 2023-10-06T01:22:08.974 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:08.972+0000 7f09cb59e700 1 -- 172.21.15.50:0/134107958 wait complete. 2023-10-06T01:22:08.990 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-10-06T01:22:09.181 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:09.180+0000 7fadc499d700 1 Processor -- start 2023-10-06T01:22:09.182 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:09.181+0000 7fadc499d700 1 -- start start 2023-10-06T01:22:09.183 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:09.182+0000 7fadc499d700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fadc00cb0a0 0x7fadc0159b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:09.183 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:09.182+0000 7fadc499d700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fadc006d470 con 0x7fadc013c470 2023-10-06T01:22:09.183 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:09.182+0000 7fadc499d700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fadc006cb80 con 0x7fadc015a080 2023-10-06T01:22:09.183 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:09.182+0000 7fadc499d700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fadc013c840 con 0x7fadc00cb0a0 2023-10-06T01:22:09.183 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:09.182+0000 7fadbf7fe700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fadc013c470 0x7fadc00ca990 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:56690/0 (socket says 172.21.15.50:56690) 2023-10-06T01:22:09.183 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:09.182+0000 7fadbf7fe700 1 -- 172.21.15.50:0/89023852 learned_addr learned my addr 172.21.15.50:0/89023852 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-10-06T01:22:09.184 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:09.182+0000 7fadbeffd700 1 --2- 172.21.15.50:0/89023852 >> v2:172.21.15.50:3300/0 conn(0x7fadc00cb0a0 0x7fadc0159b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:09.185 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:09.183+0000 7fadbe7fc700 1 -- 172.21.15.50:0/89023852 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3269965782 0 0) 0x7fadc006d470 con 0x7fadc013c470 2023-10-06T01:22:09.185 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:09.183+0000 7fadbeffd700 1 -- 172.21.15.50:0/89023852 >> v1:172.21.15.155:6789/0 conn(0x7fadc015a080 legacy=0x7fadc00c8730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:09.185 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:09.183+0000 7fadbeffd700 1 -- 172.21.15.50:0/89023852 >> v1:172.21.15.50:6789/0 conn(0x7fadc013c470 legacy=0x7fadc00ca990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:09.185 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:09.183+0000 7fadbeffd700 1 -- 172.21.15.50:0/89023852 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fadc006ce20 con 0x7fadc00cb0a0 2023-10-06T01:22:09.185 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:09.183+0000 7fadbeffd700 1 --2- 172.21.15.50:0/89023852 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fadc00cb0a0 0x7fadc0159b40 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fadb40098e0 tx=0x7fadb40091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2ac75e4762e08659 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:22:09.185 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:09.183+0000 7fadbe7fc700 1 -- 172.21.15.50:0/89023852 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadb4009e80 con 0x7fadc00cb0a0 2023-10-06T01:22:09.185 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:09.183+0000 7fadbe7fc700 1 -- 172.21.15.50:0/89023852 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fadb400b860 con 0x7fadc00cb0a0 2023-10-06T01:22:09.185 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:09.183+0000 7fadbe7fc700 1 -- 172.21.15.50:0/89023852 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadb400bbe0 con 0x7fadc00cb0a0 2023-10-06T01:22:09.185 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:09.184+0000 7fadc499d700 1 -- 172.21.15.50:0/89023852 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fadc00cb0a0 msgr2=0x7fadc0159b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:09.186 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:09.184+0000 7fadc499d700 1 --2- 172.21.15.50:0/89023852 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fadc00cb0a0 0x7fadc0159b40 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fadb40098e0 tx=0x7fadb40091a0 comp rx=0 tx=0).stop 2023-10-06T01:22:09.186 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:09.184+0000 7fadc499d700 1 -- 172.21.15.50:0/89023852 shutdown_connections 2023-10-06T01:22:09.186 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:09.184+0000 7fadc499d700 1 --2- 172.21.15.50:0/89023852 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fadc00cb0a0 0x7fadc0159b40 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:09.186 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:09.184+0000 7fadc499d700 1 -- 172.21.15.50:0/89023852 >> 172.21.15.50:0/89023852 conn(0x7fadc006b370 msgr2=0x7fadc006b770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:22:09.186 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:09.184+0000 7fadc499d700 1 -- 172.21.15.50:0/89023852 shutdown_connections 2023-10-06T01:22:09.186 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:09.184+0000 7fadc499d700 1 -- 172.21.15.50:0/89023852 wait complete. 2023-10-06T01:22:09.186 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:09.185+0000 7fadc499d700 1 Processor -- start 2023-10-06T01:22:09.187 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:09.186+0000 7fadc499d700 1 -- start start 2023-10-06T01:22:09.188 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:09.187+0000 7fadc499d700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fadc00cb0a0 0x7fadc00c7420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:09.188 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:09.187+0000 7fadc499d700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fadc013c470 0x7fadc013eb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:09.188 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:09.187+0000 7fadc499d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fadc015a080 0x7fadc013f090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:09.188 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:09.187+0000 7fadc499d700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fadc00c6f90 con 0x7fadc015a080 2023-10-06T01:22:09.188 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:09.187+0000 7fadc499d700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fadc013f5d0 con 0x7fadc00cb0a0 2023-10-06T01:22:09.189 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:09.187+0000 7fadc499d700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fadc00c6380 con 0x7fadc013c470 2023-10-06T01:22:09.189 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:09.187+0000 7fadbffff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fadc015a080 0x7fadc013f090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:09.189 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:09.187+0000 7fadbffff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fadc015a080 0x7fadc013f090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:37244/0 (socket says 172.21.15.50:37244) 2023-10-06T01:22:09.189 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:09.187+0000 7fadbffff700 1 -- 172.21.15.50:0/1326925072 learned_addr learned my addr 172.21.15.50:0/1326925072 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-06T01:22:09.189 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:09.187+0000 7fadbeffd700 1 --2- 172.21.15.50:0/1326925072 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fadc013c470 0x7fadc013eb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:09.189 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:09.187+0000 7fadbf7fe700 1 --2- 172.21.15.50:0/1326925072 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fadc00cb0a0 0x7fadc00c7420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:09.189 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:09.187+0000 7fadbffff700 1 -- 172.21.15.50:0/1326925072 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fadc013c470 msgr2=0x7fadc013eb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:09.189 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:09.187+0000 7fadbffff700 1 --2- 172.21.15.50:0/1326925072 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fadc013c470 0x7fadc013eb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:09.189 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:09.187+0000 7fadbffff700 1 -- 172.21.15.50:0/1326925072 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fadc00cb0a0 msgr2=0x7fadc00c7420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:09.189 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:09.187+0000 7fadbffff700 1 --2- 172.21.15.50:0/1326925072 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fadc00cb0a0 0x7fadc00c7420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:09.189 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:09.187+0000 7fadbffff700 1 -- 172.21.15.50:0/1326925072 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fadb4009420 con 0x7fadc015a080 2023-10-06T01:22:09.190 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:09.188+0000 7fadbffff700 1 --2- 172.21.15.50:0/1326925072 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fadc015a080 0x7fadc013f090 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fadb800c840 tx=0x7fadb8001670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:22:09.190 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:09.188+0000 7fada77fe700 1 -- 172.21.15.50:0/1326925072 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadb8012630 con 0x7fadc015a080 2023-10-06T01:22:09.190 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:09.188+0000 7fada77fe700 1 -- 172.21.15.50:0/1326925072 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fadb80127b0 con 0x7fadc015a080 2023-10-06T01:22:09.191 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:09.188+0000 7fada77fe700 1 -- 172.21.15.50:0/1326925072 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadb8012b70 con 0x7fadc015a080 2023-10-06T01:22:09.191 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:09.188+0000 7fadc499d700 1 -- 172.21.15.50:0/1326925072 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fadc00c6660 con 0x7fadc015a080 2023-10-06T01:22:09.191 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:09.188+0000 7fadc499d700 1 -- 172.21.15.50:0/1326925072 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fadc00c6c20 con 0x7fadc015a080 2023-10-06T01:22:09.191 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:09.189+0000 7fadc499d700 1 -- 172.21.15.50:0/1326925072 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fadc005f270 con 0x7fadc015a080 2023-10-06T01:22:09.191 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:09.190+0000 7fada77fe700 1 -- 172.21.15.50:0/1326925072 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fadb801a3a0 con 0x7fadc015a080 2023-10-06T01:22:09.192 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:09.191+0000 7fada77fe700 1 --2- 172.21.15.50:0/1326925072 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7fadac066f30 0x7fadac0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:09.192 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:09.191+0000 7fada77fe700 1 -- 172.21.15.50:0/1326925072 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6809+0+0 (secure 0 0 0) 0x7fadb8084b50 con 0x7fadc015a080 2023-10-06T01:22:09.192 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:09.192+0000 7fadbf7fe700 1 --2- 172.21.15.50:0/1326925072 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7fadac066f30 0x7fadac0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:09.193 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:09.192+0000 7fadbf7fe700 1 --2- 172.21.15.50:0/1326925072 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7fadac066f30 0x7fadac0693e0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fadb0007fd0 tx=0x7fadb0007d10 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:22:09.196 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:09.195+0000 7fada77fe700 1 -- 172.21.15.50:0/1326925072 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fadb80518d0 con 0x7fadc015a080 2023-10-06T01:22:09.398 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:09.398+0000 7fadc499d700 1 -- 172.21.15.50:0/1326925072 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7fadc006d100 con 0x7fadc015a080 2023-10-06T01:22:09.399 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:09.398+0000 7fada77fe700 1 -- 172.21.15.50:0/1326925072 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v25) v1 ==== 103+0+11 (secure 0 0 0) 0x7fadb8054ef0 con 0x7fadc015a080 2023-10-06T01:22:09.399 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 32 2023-10-06T01:22:09.401 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:09.400+0000 7fadc499d700 1 -- 172.21.15.50:0/1326925072 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7fadac066f30 msgr2=0x7fadac0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:09.401 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:09.400+0000 7fadc499d700 1 --2- 172.21.15.50:0/1326925072 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7fadac066f30 0x7fadac0693e0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fadb0007fd0 tx=0x7fadb0007d10 comp rx=0 tx=0).stop 2023-10-06T01:22:09.401 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:09.400+0000 7fadc499d700 1 -- 172.21.15.50:0/1326925072 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fadc015a080 msgr2=0x7fadc013f090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:09.401 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:09.400+0000 7fadc499d700 1 --2- 172.21.15.50:0/1326925072 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fadc015a080 0x7fadc013f090 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fadb800c840 tx=0x7fadb8001670 comp rx=0 tx=0).stop 2023-10-06T01:22:09.402 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:09.400+0000 7fadc499d700 1 -- 172.21.15.50:0/1326925072 shutdown_connections 2023-10-06T01:22:09.402 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:09.400+0000 7fadc499d700 1 --2- 172.21.15.50:0/1326925072 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fadc015a080 0x7fadc013f090 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:09.402 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:09.400+0000 7fadc499d700 1 --2- 172.21.15.50:0/1326925072 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7fadac066f30 0x7fadac0693e0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:09.402 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:09.400+0000 7fadc499d700 1 --2- 172.21.15.50:0/1326925072 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fadc00cb0a0 0x7fadc00c7420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:09.402 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:09.400+0000 7fadc499d700 1 --2- 172.21.15.50:0/1326925072 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fadc013c470 0x7fadc013eb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:09.402 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:09.400+0000 7fadc499d700 1 -- 172.21.15.50:0/1326925072 >> 172.21.15.50:0/1326925072 conn(0x7fadc006b370 msgr2=0x7fadc01544c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:22:09.402 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:09.400+0000 7fadc499d700 1 -- 172.21.15.50:0/1326925072 shutdown_connections 2023-10-06T01:22:09.402 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:09.400+0000 7fadc499d700 1 -- 172.21.15.50:0/1326925072 wait complete. 2023-10-06T01:22:09.419 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T01:22:09.606 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:09.605+0000 7f8b4cd9d700 1 Processor -- start 2023-10-06T01:22:09.607 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:09.606+0000 7f8b4cd9d700 1 -- start start 2023-10-06T01:22:09.608 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:09.607+0000 7f8b4cd9d700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8b48153e40 0x7f8b4806df90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:09.609 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:09.607+0000 7f8b4cd9d700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f8b4806a9a0 0x7f8b4806e4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:09.609 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:09.607+0000 7f8b4cd9d700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8b480c9d00 con 0x7f8b4806a5d0 2023-10-06T01:22:09.609 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:09.607+0000 7f8b4cd9d700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8b4806f5a0 con 0x7f8b4806a9a0 2023-10-06T01:22:09.609 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:09.607+0000 7f8b4cd9d700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b480c6750 con 0x7f8b48153e40 2023-10-06T01:22:09.609 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:09.607+0000 7f8b47fff700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f8b4806a9a0 0x7f8b4806e4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:09.609 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:09.607+0000 7f8b477fe700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f8b4806a5d0 0x7f8b48153730 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:56704/0 (socket says 172.21.15.50:56704) 2023-10-06T01:22:09.609 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:09.607+0000 7f8b47fff700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f8b4806a9a0 0x7f8b4806e4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:37252/0 (socket says 172.21.15.50:37252) 2023-10-06T01:22:09.609 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:09.607+0000 7f8b477fe700 1 -- 172.21.15.50:0/463838582 learned_addr learned my addr 172.21.15.50:0/463838582 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-10-06T01:22:09.609 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:09.607+0000 7f8b46ffd700 1 --2- 172.21.15.50:0/463838582 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8b48153e40 0x7f8b4806df90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:09.609 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:09.608+0000 7f8b47fff700 1 -- 172.21.15.50:0/463838582 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8b48153e40 msgr2=0x7f8b4806df90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:22:09.610 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:09.608+0000 7f8b47fff700 1 --2- 172.21.15.50:0/463838582 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8b48153e40 0x7f8b4806df90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:09.610 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:09.608+0000 7f8b47fff700 1 -- 172.21.15.50:0/463838582 >> v1:172.21.15.50:6789/0 conn(0x7f8b4806a5d0 legacy=0x7f8b48153730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:09.610 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:09.608+0000 7f8b47fff700 1 -- 172.21.15.50:0/463838582 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b4806ed00 con 0x7f8b4806a9a0 2023-10-06T01:22:09.610 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:09.608+0000 7f8b46ffd700 1 --2- 172.21.15.50:0/463838582 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8b48153e40 0x7f8b4806df90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T01:22:09.610 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:09.608+0000 7f8b467fc700 1 -- 172.21.15.50:0/463838582 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2430036913 0 0) 0x7f8b480c9d00 con 0x7f8b4806a5d0 2023-10-06T01:22:09.610 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:09.608+0000 7f8b47fff700 1 --2- 172.21.15.50:0/463838582 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8b4806a9a0 0x7f8b4806e4d0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f8b40009e90 tx=0x7f8b40009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bc3799f05bdb5f46 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:22:09.611 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:09.608+0000 7f8b467fc700 1 -- 172.21.15.50:0/463838582 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b4000e070 con 0x7f8b4806a9a0 2023-10-06T01:22:09.611 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:09.608+0000 7f8b467fc700 1 -- 172.21.15.50:0/463838582 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b4000bbf0 con 0x7f8b4806a9a0 2023-10-06T01:22:09.612 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:09.608+0000 7f8b467fc700 1 -- 172.21.15.50:0/463838582 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b40012430 con 0x7f8b4806a9a0 2023-10-06T01:22:09.612 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:09.609+0000 7f8b4cd9d700 1 -- 172.21.15.50:0/463838582 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8b4806a9a0 msgr2=0x7f8b4806e4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:09.612 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:09.609+0000 7f8b4cd9d700 1 --2- 172.21.15.50:0/463838582 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8b4806a9a0 0x7f8b4806e4d0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f8b40009e90 tx=0x7f8b40009780 comp rx=0 tx=0).stop 2023-10-06T01:22:09.612 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:09.609+0000 7f8b4cd9d700 1 -- 172.21.15.50:0/463838582 shutdown_connections 2023-10-06T01:22:09.612 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:09.609+0000 7f8b4cd9d700 1 --2- 172.21.15.50:0/463838582 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8b4806a9a0 0x7f8b4806e4d0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:09.612 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:09.609+0000 7f8b4cd9d700 1 --2- 172.21.15.50:0/463838582 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8b48153e40 0x7f8b4806df90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:09.612 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:09.609+0000 7f8b4cd9d700 1 -- 172.21.15.50:0/463838582 >> 172.21.15.50:0/463838582 conn(0x7f8b480680c0 msgr2=0x7f8b480cbf00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:22:09.612 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:09.609+0000 7f8b4cd9d700 1 -- 172.21.15.50:0/463838582 shutdown_connections 2023-10-06T01:22:09.612 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:09.609+0000 7f8b4cd9d700 1 -- 172.21.15.50:0/463838582 wait complete. 2023-10-06T01:22:09.612 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:09.610+0000 7f8b4cd9d700 1 Processor -- start 2023-10-06T01:22:09.612 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:09.611+0000 7f8b4cd9d700 1 -- start start 2023-10-06T01:22:09.614 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:09.611+0000 7f8b4cd9d700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8b4806a5d0 0x7f8b48159030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:09.614 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:09.611+0000 7f8b4cd9d700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8b4806a9a0 0x7f8b480c56b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:09.615 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:09.611+0000 7f8b4cd9d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8b48153e40 0x7f8b481557e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:09.615 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:09.611+0000 7f8b4cd9d700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b48158c10 con 0x7f8b48153e40 2023-10-06T01:22:09.615 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:09.611+0000 7f8b4cd9d700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b48157f90 con 0x7f8b4806a9a0 2023-10-06T01:22:09.615 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:09.611+0000 7f8b4cd9d700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b48158270 con 0x7f8b4806a5d0 2023-10-06T01:22:09.615 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:09.612+0000 7f8b47fff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8b48153e40 0x7f8b481557e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:09.615 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:09.612+0000 7f8b47fff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8b48153e40 0x7f8b481557e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:37266/0 (socket says 172.21.15.50:37266) 2023-10-06T01:22:09.615 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:09.612+0000 7f8b47fff700 1 -- 172.21.15.50:0/3575485987 learned_addr learned my addr 172.21.15.50:0/3575485987 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-06T01:22:09.615 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:09.612+0000 7f8b477fe700 1 --2- 172.21.15.50:0/3575485987 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8b4806a5d0 0x7f8b48159030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:09.615 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:09.612+0000 7f8b46ffd700 1 --2- 172.21.15.50:0/3575485987 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8b4806a9a0 0x7f8b480c56b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:09.615 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:09.612+0000 7f8b47fff700 1 -- 172.21.15.50:0/3575485987 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8b4806a5d0 msgr2=0x7f8b48159030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:09.615 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:09.612+0000 7f8b47fff700 1 --2- 172.21.15.50:0/3575485987 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8b4806a5d0 0x7f8b48159030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:09.616 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:09.612+0000 7f8b47fff700 1 -- 172.21.15.50:0/3575485987 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8b4806a9a0 msgr2=0x7f8b480c56b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:09.616 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:09.612+0000 7f8b47fff700 1 --2- 172.21.15.50:0/3575485987 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8b4806a9a0 0x7f8b480c56b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:09.616 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:09.612+0000 7f8b47fff700 1 -- 172.21.15.50:0/3575485987 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b40009a20 con 0x7f8b48153e40 2023-10-06T01:22:09.616 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:09.612+0000 7f8b477fe700 1 --2- 172.21.15.50:0/3575485987 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8b4806a5d0 0x7f8b48159030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T01:22:09.616 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:09.612+0000 7f8b47fff700 1 --2- 172.21.15.50:0/3575485987 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8b48153e40 0x7f8b481557e0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f8b4806c7c0 tx=0x7f8b40019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:22:09.616 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:09.613+0000 7f8b2f7fe700 1 -- 172.21.15.50:0/3575485987 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b40012e30 con 0x7f8b48153e40 2023-10-06T01:22:09.616 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:09.613+0000 7f8b2f7fe700 1 -- 172.21.15.50:0/3575485987 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b4001d630 con 0x7f8b48153e40 2023-10-06T01:22:09.616 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:09.613+0000 7f8b2f7fe700 1 -- 172.21.15.50:0/3575485987 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b4001d9f0 con 0x7f8b48153e40 2023-10-06T01:22:09.616 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:09.613+0000 7f8b4cd9d700 1 -- 172.21.15.50:0/3575485987 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8b48158550 con 0x7f8b48153e40 2023-10-06T01:22:09.616 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:09.613+0000 7f8b4cd9d700 1 -- 172.21.15.50:0/3575485987 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8b48159570 con 0x7f8b48153e40 2023-10-06T01:22:09.616 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:09.614+0000 7f8b4cd9d700 1 -- 172.21.15.50:0/3575485987 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8b4805f270 con 0x7f8b48153e40 2023-10-06T01:22:09.617 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:09.615+0000 7f8b2f7fe700 1 -- 172.21.15.50:0/3575485987 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f8b40024070 con 0x7f8b48153e40 2023-10-06T01:22:09.617 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:09.615+0000 7f8b2f7fe700 1 --2- 172.21.15.50:0/3575485987 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f8b34066f30 0x7f8b340693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:09.617 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:09.616+0000 7f8b2f7fe700 1 -- 172.21.15.50:0/3575485987 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f8b40087250 con 0x7f8b48153e40 2023-10-06T01:22:09.617 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:09.616+0000 7f8b477fe700 1 --2- 172.21.15.50:0/3575485987 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f8b34066f30 0x7f8b340693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:09.618 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:09.617+0000 7f8b477fe700 1 --2- 172.21.15.50:0/3575485987 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f8b34066f30 0x7f8b340693e0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f8b480b11f0 tx=0x7f8b38009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:22:09.620 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:09.620+0000 7f8b2f7fe700 1 -- 172.21.15.50:0/3575485987 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f8b40053fd0 con 0x7f8b48153e40 2023-10-06T01:22:09.869 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:09.868+0000 7f8b4cd9d700 1 -- 172.21.15.50:0/3575485987 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f8b4806efe0 con 0x7f8b48153e40 2023-10-06T01:22:09.870 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:09.869+0000 7f8b2f7fe700 1 -- 172.21.15.50:0/3575485987 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4593 (secure 0 0 0) 0x7f8b400575f0 con 0x7f8b48153e40 2023-10-06T01:22:09.870 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-10-06T01:22:09.870 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4214,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6835/33654067","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6833","nonce":33654067},{"type":"v1","addr":"172.21.15.50:6835","nonce":33654067}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4279,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6836/2571345069","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":2571345069},{"type":"v1","addr":"172.21.15.155:6836","nonce":2571345069}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4290,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6834/4140731341","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6832","nonce":4140731341},{"type":"v1","addr":"172.21.15.50:6834","nonce":4140731341}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T01:21:36.779774+0000","modified":"2023-10-06T01:21:58.876370+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4302},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4302":{"gid":4302,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.155:6837/3434423585","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6835","nonce":3434423585},{"type":"v1","addr":"172.21.15.155:6837","nonce":3434423585}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2023-10-06T01:22:09.872 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:09.871+0000 7f8b4cd9d700 1 -- 172.21.15.50:0/3575485987 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f8b34066f30 msgr2=0x7f8b340693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:09.872 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:09.871+0000 7f8b4cd9d700 1 --2- 172.21.15.50:0/3575485987 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f8b34066f30 0x7f8b340693e0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f8b480b11f0 tx=0x7f8b38009040 comp rx=0 tx=0).stop 2023-10-06T01:22:09.873 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:09.871+0000 7f8b4cd9d700 1 -- 172.21.15.50:0/3575485987 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8b48153e40 msgr2=0x7f8b481557e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:09.873 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:09.871+0000 7f8b4cd9d700 1 --2- 172.21.15.50:0/3575485987 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8b48153e40 0x7f8b481557e0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f8b4806c7c0 tx=0x7f8b40019000 comp rx=0 tx=0).stop 2023-10-06T01:22:09.873 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:09.871+0000 7f8b4cd9d700 1 -- 172.21.15.50:0/3575485987 shutdown_connections 2023-10-06T01:22:09.873 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:09.871+0000 7f8b4cd9d700 1 --2- 172.21.15.50:0/3575485987 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8b48153e40 0x7f8b481557e0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:09.873 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:09.871+0000 7f8b4cd9d700 1 --2- 172.21.15.50:0/3575485987 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8b4806a5d0 0x7f8b48159030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:09.873 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:09.871+0000 7f8b4cd9d700 1 --2- 172.21.15.50:0/3575485987 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f8b34066f30 0x7f8b340693e0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:09.873 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:09.871+0000 7f8b4cd9d700 1 --2- 172.21.15.50:0/3575485987 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8b4806a9a0 0x7f8b480c56b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:09.873 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:09.871+0000 7f8b4cd9d700 1 -- 172.21.15.50:0/3575485987 >> 172.21.15.50:0/3575485987 conn(0x7f8b480680c0 msgr2=0x7f8b4814d200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:22:09.873 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:09.871+0000 7f8b4cd9d700 1 -- 172.21.15.50:0/3575485987 shutdown_connections 2023-10-06T01:22:09.873 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:09.872+0000 7f8b4cd9d700 1 -- 172.21.15.50:0/3575485987 wait complete. 2023-10-06T01:22:09.874 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 9 2023-10-06T01:22:09.890 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T01:22:10.077 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:10.076+0000 7f6d4b59d700 1 Processor -- start 2023-10-06T01:22:10.077 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:10.076+0000 7f6d4b59d700 1 -- start start 2023-10-06T01:22:10.079 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:10.078+0000 7f6d4b59d700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6d4406a9a0 0x7f6d4406e6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:10.079 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:10.078+0000 7f6d4b59d700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6d440c9d00 con 0x7f6d4406a5d0 2023-10-06T01:22:10.079 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:10.078+0000 7f6d4b59d700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6d440c6750 con 0x7f6d44153e40 2023-10-06T01:22:10.079 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:10.078+0000 7f6d4b59d700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d4406f5a0 con 0x7f6d4406a9a0 2023-10-06T01:22:10.079 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:10.078+0000 7f6d4a59b700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f6d4406a5d0 0x7f6d44153730 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:56718/0 (socket says 172.21.15.50:56718) 2023-10-06T01:22:10.079 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:10.078+0000 7f6d4a59b700 1 -- 172.21.15.50:0/588502077 learned_addr learned my addr 172.21.15.50:0/588502077 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-10-06T01:22:10.079 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:10.078+0000 7f6d4ad9c700 1 --2- 172.21.15.50:0/588502077 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6d4406a9a0 0x7f6d4406e6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:10.081 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:10.079+0000 7f6d49599700 1 -- 172.21.15.50:0/588502077 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1641789401 0 0) 0x7f6d440c9d00 con 0x7f6d4406a5d0 2023-10-06T01:22:10.082 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:10.079+0000 7f6d49599700 1 -- 172.21.15.50:0/588502077 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6d30003570 con 0x7f6d4406a5d0 2023-10-06T01:22:10.082 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:10.079+0000 7f6d49599700 1 -- 172.21.15.50:0/588502077 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1070210420 0 0) 0x7f6d440c6750 con 0x7f6d44153e40 2023-10-06T01:22:10.082 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:10.079+0000 7f6d49599700 1 -- 172.21.15.50:0/588502077 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6d440c9d00 con 0x7f6d44153e40 2023-10-06T01:22:10.082 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:10.079+0000 7f6d4ad9c700 1 -- 172.21.15.50:0/588502077 >> v1:172.21.15.155:6789/0 conn(0x7f6d44153e40 legacy=0x7f6d4406df90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:10.082 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:10.079+0000 7f6d4ad9c700 1 -- 172.21.15.50:0/588502077 >> v1:172.21.15.50:6789/0 conn(0x7f6d4406a5d0 legacy=0x7f6d44153730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:10.083 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:10.079+0000 7f6d4ad9c700 1 -- 172.21.15.50:0/588502077 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d4406ed00 con 0x7f6d4406a9a0 2023-10-06T01:22:10.083 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:10.079+0000 7f6d4ad9c700 1 --2- 172.21.15.50:0/588502077 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6d4406a9a0 0x7f6d4406e6a0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f6d3c00d100 tx=0x7f6d3c00b990 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b0214bb0735df460 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:22:10.083 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:10.079+0000 7f6d49599700 1 -- 172.21.15.50:0/588502077 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d3c010070 con 0x7f6d4406a9a0 2023-10-06T01:22:10.084 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:10.079+0000 7f6d49599700 1 -- 172.21.15.50:0/588502077 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d3c00b2e0 con 0x7f6d4406a9a0 2023-10-06T01:22:10.085 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:10.079+0000 7f6d49599700 1 -- 172.21.15.50:0/588502077 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d3c00dd00 con 0x7f6d4406a9a0 2023-10-06T01:22:10.085 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:10.080+0000 7f6d4b59d700 1 -- 172.21.15.50:0/588502077 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6d4406a9a0 msgr2=0x7f6d4406e6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:10.085 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:10.080+0000 7f6d4b59d700 1 --2- 172.21.15.50:0/588502077 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6d4406a9a0 0x7f6d4406e6a0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f6d3c00d100 tx=0x7f6d3c00b990 comp rx=0 tx=0).stop 2023-10-06T01:22:10.085 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:10.080+0000 7f6d4b59d700 1 -- 172.21.15.50:0/588502077 shutdown_connections 2023-10-06T01:22:10.085 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:10.080+0000 7f6d4b59d700 1 --2- 172.21.15.50:0/588502077 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6d4406a9a0 0x7f6d4406e6a0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:10.085 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:10.080+0000 7f6d4b59d700 1 -- 172.21.15.50:0/588502077 >> 172.21.15.50:0/588502077 conn(0x7f6d440680c0 msgr2=0x7f6d440cbf00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:22:10.085 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:10.080+0000 7f6d4b59d700 1 -- 172.21.15.50:0/588502077 shutdown_connections 2023-10-06T01:22:10.085 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:10.080+0000 7f6d4b59d700 1 -- 172.21.15.50:0/588502077 wait complete. 2023-10-06T01:22:10.090 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:10.081+0000 7f6d4b59d700 1 Processor -- start 2023-10-06T01:22:10.090 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:10.082+0000 7f6d4b59d700 1 -- start start 2023-10-06T01:22:10.090 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:10.082+0000 7f6d4b59d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6d4406a5d0 0x7f6d44146340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:10.090 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:10.082+0000 7f6d4b59d700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6d4406a9a0 0x7f6d44158670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:10.091 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:10.082+0000 7f6d4b59d700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6d44153e40 0x7f6d44158bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:10.091 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:10.082+0000 7f6d4b59d700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d440c4700 con 0x7f6d4406a5d0 2023-10-06T01:22:10.091 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:10.083+0000 7f6d4b59d700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d4414f020 con 0x7f6d4406a9a0 2023-10-06T01:22:10.091 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:10.083+0000 7f6d4b59d700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d4414fb60 con 0x7f6d44153e40 2023-10-06T01:22:10.091 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:10.083+0000 7f6d4a59b700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6d4406a5d0 0x7f6d44146340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:10.091 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:10.083+0000 7f6d4a59b700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6d4406a5d0 0x7f6d44146340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:37272/0 (socket says 172.21.15.50:37272) 2023-10-06T01:22:10.091 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:10.083+0000 7f6d4a59b700 1 -- 172.21.15.50:0/3741588575 learned_addr learned my addr 172.21.15.50:0/3741588575 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-06T01:22:10.091 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:10.083+0000 7f6d4ad9c700 1 --2- 172.21.15.50:0/3741588575 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6d44153e40 0x7f6d44158bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:10.092 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:10.083+0000 7f6d49d9a700 1 --2- 172.21.15.50:0/3741588575 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6d4406a9a0 0x7f6d44158670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:10.092 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:10.083+0000 7f6d4a59b700 1 -- 172.21.15.50:0/3741588575 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6d44153e40 msgr2=0x7f6d44158bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:10.092 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:10.083+0000 7f6d4a59b700 1 --2- 172.21.15.50:0/3741588575 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6d44153e40 0x7f6d44158bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:10.092 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:10.083+0000 7f6d4a59b700 1 -- 172.21.15.50:0/3741588575 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6d4406a9a0 msgr2=0x7f6d44158670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:10.092 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:10.083+0000 7f6d4a59b700 1 --2- 172.21.15.50:0/3741588575 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6d4406a9a0 0x7f6d44158670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:10.092 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:10.083+0000 7f6d4a59b700 1 -- 172.21.15.50:0/3741588575 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d3c00bc30 con 0x7f6d4406a5d0 2023-10-06T01:22:10.092 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:10.083+0000 7f6d4ad9c700 1 --2- 172.21.15.50:0/3741588575 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6d44153e40 0x7f6d44158bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T01:22:10.093 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:10.083+0000 7f6d49d9a700 1 --2- 172.21.15.50:0/3741588575 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6d4406a9a0 0x7f6d44158670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T01:22:10.093 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:10.084+0000 7f6d4a59b700 1 --2- 172.21.15.50:0/3741588575 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6d4406a5d0 0x7f6d44146340 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f6d4000c790 tx=0x7f6d40007ea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:22:10.093 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:10.084+0000 7f6d3a7fc700 1 -- 172.21.15.50:0/3741588575 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d40005b30 con 0x7f6d4406a5d0 2023-10-06T01:22:10.093 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:10.084+0000 7f6d3a7fc700 1 -- 172.21.15.50:0/3741588575 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d40005c90 con 0x7f6d4406a5d0 2023-10-06T01:22:10.093 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:10.084+0000 7f6d3a7fc700 1 -- 172.21.15.50:0/3741588575 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d40007320 con 0x7f6d4406a5d0 2023-10-06T01:22:10.093 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:10.084+0000 7f6d4b59d700 1 -- 172.21.15.50:0/3741588575 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6d44169710 con 0x7f6d4406a5d0 2023-10-06T01:22:10.093 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:10.084+0000 7f6d4b59d700 1 -- 172.21.15.50:0/3741588575 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6d4414f510 con 0x7f6d4406a5d0 2023-10-06T01:22:10.094 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:10.085+0000 7f6d4b59d700 1 -- 172.21.15.50:0/3741588575 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6d4405f270 con 0x7f6d4406a5d0 2023-10-06T01:22:10.094 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:10.086+0000 7f6d3a7fc700 1 -- 172.21.15.50:0/3741588575 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f6d4001b400 con 0x7f6d4406a5d0 2023-10-06T01:22:10.094 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:10.087+0000 7f6d3a7fc700 1 --2- 172.21.15.50:0/3741588575 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f6d28066f30 0x7f6d280693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:10.094 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:10.087+0000 7f6d3a7fc700 1 -- 172.21.15.50:0/3741588575 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f6d400844b0 con 0x7f6d4406a5d0 2023-10-06T01:22:10.094 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:10.088+0000 7f6d49d9a700 1 --2- 172.21.15.50:0/3741588575 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f6d28066f30 0x7f6d280693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:10.094 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:10.088+0000 7f6d49d9a700 1 --2- 172.21.15.50:0/3741588575 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f6d28066f30 0x7f6d280693e0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f6d34007fd0 tx=0x7f6d34009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:22:10.095 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:10.091+0000 7f6d3a7fc700 1 -- 172.21.15.50:0/3741588575 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f6d400512b0 con 0x7f6d4406a5d0 2023-10-06T01:22:10.297 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:10.296+0000 7f6d4b59d700 1 -- 172.21.15.50:0/3741588575 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6d4406efe0 con 0x7f6d4406a5d0 2023-10-06T01:22:10.298 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:10.297+0000 7f6d3a7fc700 1 -- 172.21.15.50:0/3741588575 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+18707 (secure 0 0 0) 0x7f6d400548d0 con 0x7f6d4406a5d0 2023-10-06T01:22:10.298 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-10-06T01:22:10.299 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":25,"fsid":"0bfd9a6b-1587-4fe4-a89e-e43c00286b4e","created":"2023-10-06T01:21:16.828801+0000","modified":"2023-10-06T01:21:41.329781+0000","last_up_change":"2023-10-06T01:21:28.584523+0000","last_in_change":"2023-10-06T01:21:20.179863+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-10-06T01:21:29.304225+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":".mgr","create_time":"2023-10-06T01:21:29.835490+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-06T01:21:34.675315+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-06T01:21:35.753991+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-10-06T01:21:38.853108+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"9060727a-3959-4de3-8363-c5c5d7826c9a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":87837},{"type":"v1","addr":"172.21.15.50:6801","nonce":87837}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":87837},{"type":"v1","addr":"172.21.15.50:6803","nonce":87837}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":87837},{"type":"v1","addr":"172.21.15.50:6807","nonce":87837}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":87837},{"type":"v1","addr":"172.21.15.50:6805","nonce":87837}]},"public_addr":"172.21.15.50:6801/87837","cluster_addr":"172.21.15.50:6803/87837","heartbeat_back_addr":"172.21.15.50:6807/87837","heartbeat_front_addr":"172.21.15.50:6805/87837","state":["exists","up"]},{"osd":1,"uuid":"5ad9ef12-b579-47ea-b690-90ba887e2cef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":87853},{"type":"v1","addr":"172.21.15.50:6809","nonce":87853}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":87853},{"type":"v1","addr":"172.21.15.50:6811","nonce":87853}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":87853},{"type":"v1","addr":"172.21.15.50:6815","nonce":87853}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":87853},{"type":"v1","addr":"172.21.15.50:6813","nonce":87853}]},"public_addr":"172.21.15.50:6809/87853","cluster_addr":"172.21.15.50:6811/87853","heartbeat_back_addr":"172.21.15.50:6815/87853","heartbeat_front_addr":"172.21.15.50:6813/87853","state":["exists","up"]},{"osd":2,"uuid":"c7aee044-6f75-436f-90e1-ba42a57359bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6821","nonce":87855},{"type":"v1","addr":"172.21.15.50:6822","nonce":87855}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6824","nonce":87855},{"type":"v1","addr":"172.21.15.50:6826","nonce":87855}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":87855},{"type":"v1","addr":"172.21.15.50:6831","nonce":87855}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":87855},{"type":"v1","addr":"172.21.15.50:6829","nonce":87855}]},"public_addr":"172.21.15.50:6822/87855","cluster_addr":"172.21.15.50:6826/87855","heartbeat_back_addr":"172.21.15.50:6831/87855","heartbeat_front_addr":"172.21.15.50:6829/87855","state":["exists","up"]},{"osd":3,"uuid":"d9b901c8-e8b2-44af-9508-f453120a96c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":87856},{"type":"v1","addr":"172.21.15.50:6817","nonce":87856}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":87856},{"type":"v1","addr":"172.21.15.50:6819","nonce":87856}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6825","nonce":87856},{"type":"v1","addr":"172.21.15.50:6827","nonce":87856}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6820","nonce":87856},{"type":"v1","addr":"172.21.15.50:6823","nonce":87856}]},"public_addr":"172.21.15.50:6817/87856","cluster_addr":"172.21.15.50:6819/87856","heartbeat_back_addr":"172.21.15.50:6827/87856","heartbeat_front_addr":"172.21.15.50:6823/87856","state":["exists","up"]},{"osd":4,"uuid":"2b3c6b38-e3e9-4301-9445-60fd3fe8ce03","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":85805},{"type":"v1","addr":"172.21.15.155:6801","nonce":85805}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":85805},{"type":"v1","addr":"172.21.15.155:6803","nonce":85805}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6806","nonce":85805},{"type":"v1","addr":"172.21.15.155:6807","nonce":85805}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6804","nonce":85805},{"type":"v1","addr":"172.21.15.155:6805","nonce":85805}]},"public_addr":"172.21.15.155:6801/85805","cluster_addr":"172.21.15.155:6803/85805","heartbeat_back_addr":"172.21.15.155:6807/85805","heartbeat_front_addr":"172.21.15.155:6805/85805","state":["exists","up"]},{"osd":5,"uuid":"417b5f8f-65f1-4c94-91a7-a6ce03fe1679","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6816","nonce":85807},{"type":"v1","addr":"172.21.15.155:6818","nonce":85807}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6820","nonce":85807},{"type":"v1","addr":"172.21.15.155:6822","nonce":85807}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6828","nonce":85807},{"type":"v1","addr":"172.21.15.155:6830","nonce":85807}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6824","nonce":85807},{"type":"v1","addr":"172.21.15.155:6826","nonce":85807}]},"public_addr":"172.21.15.155:6818/85807","cluster_addr":"172.21.15.155:6822/85807","heartbeat_back_addr":"172.21.15.155:6830/85807","heartbeat_front_addr":"172.21.15.155:6826/85807","state":["exists","up"]},{"osd":6,"uuid":"c150cff3-aee4-4714-9c08-d182b1ba9ffd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6808","nonce":85806},{"type":"v1","addr":"172.21.15.155:6809","nonce":85806}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6810","nonce":85806},{"type":"v1","addr":"172.21.15.155:6811","nonce":85806}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6814","nonce":85806},{"type":"v1","addr":"172.21.15.155:6815","nonce":85806}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6812","nonce":85806},{"type":"v1","addr":"172.21.15.155:6813","nonce":85806}]},"public_addr":"172.21.15.155:6809/85806","cluster_addr":"172.21.15.155:6811/85806","heartbeat_back_addr":"172.21.15.155:6815/85806","heartbeat_front_addr":"172.21.15.155:6813/85806","state":["exists","up"]},{"osd":7,"uuid":"71107f0e-04d1-4e72-a0ec-0faf6af003e7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6817","nonce":85832},{"type":"v1","addr":"172.21.15.155:6819","nonce":85832}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6821","nonce":85832},{"type":"v1","addr":"172.21.15.155:6823","nonce":85832}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6829","nonce":85832},{"type":"v1","addr":"172.21.15.155:6831","nonce":85832}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6825","nonce":85832},{"type":"v1","addr":"172.21.15.155:6827","nonce":85832}]},"public_addr":"172.21.15.155:6819/85832","cluster_addr":"172.21.15.155:6823/85832","heartbeat_back_addr":"172.21.15.155:6831/85832","heartbeat_front_addr":"172.21.15.155:6827/85832","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:21:25.423389+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:21:25.472661+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:21:25.817562+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:21:25.551257+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:21:25.407818+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:21:25.557976+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:21:25.747299+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:21:25.827576+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T01:22:10.301 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:10.299+0000 7f6d4b59d700 1 -- 172.21.15.50:0/3741588575 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f6d28066f30 msgr2=0x7f6d280693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:10.301 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:10.299+0000 7f6d4b59d700 1 --2- 172.21.15.50:0/3741588575 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f6d28066f30 0x7f6d280693e0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f6d34007fd0 tx=0x7f6d34009040 comp rx=0 tx=0).stop 2023-10-06T01:22:10.301 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:10.299+0000 7f6d4b59d700 1 -- 172.21.15.50:0/3741588575 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6d4406a5d0 msgr2=0x7f6d44146340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:10.301 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:10.299+0000 7f6d4b59d700 1 --2- 172.21.15.50:0/3741588575 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6d4406a5d0 0x7f6d44146340 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f6d4000c790 tx=0x7f6d40007ea0 comp rx=0 tx=0).stop 2023-10-06T01:22:10.301 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:10.300+0000 7f6d4b59d700 1 -- 172.21.15.50:0/3741588575 shutdown_connections 2023-10-06T01:22:10.301 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:10.300+0000 7f6d4b59d700 1 --2- 172.21.15.50:0/3741588575 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6d44153e40 0x7f6d44158bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:10.301 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:10.300+0000 7f6d4b59d700 1 --2- 172.21.15.50:0/3741588575 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6d4406a5d0 0x7f6d44146340 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:10.301 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:10.300+0000 7f6d4b59d700 1 --2- 172.21.15.50:0/3741588575 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f6d28066f30 0x7f6d280693e0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:10.301 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:10.300+0000 7f6d4b59d700 1 --2- 172.21.15.50:0/3741588575 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6d4406a9a0 0x7f6d44158670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:10.301 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:10.300+0000 7f6d4b59d700 1 -- 172.21.15.50:0/3741588575 >> 172.21.15.50:0/3741588575 conn(0x7f6d440680c0 msgr2=0x7f6d440ca190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:22:10.302 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:10.300+0000 7f6d4b59d700 1 -- 172.21.15.50:0/3741588575 shutdown_connections 2023-10-06T01:22:10.302 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:10.300+0000 7f6d4b59d700 1 -- 172.21.15.50:0/3741588575 wait complete. 2023-10-06T01:22:10.318 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-10-06T01:21:29.304225+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-10-06T01:21:29.835490+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-06T01:21:34.675315+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-10-06T01:21:35.753991+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-10-06T01:21:38.853108+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-06T01:22:10.319 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-10-06T01:22:10.508 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:10.507+0000 7f27de99d700 1 Processor -- start 2023-10-06T01:22:10.508 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:10.507+0000 7f27de99d700 1 -- start start 2023-10-06T01:22:10.509 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:10.508+0000 7f27de99d700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f27d8155df0 0x7f27d8156270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:10.510 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:10.509+0000 7f27de99d700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f27d80ad830 con 0x7f27d8156fc0 2023-10-06T01:22:10.510 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:10.509+0000 7f27de99d700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f27d8156b90 con 0x7f27d80adcc0 2023-10-06T01:22:10.510 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:10.509+0000 7f27de99d700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f27d8150360 con 0x7f27d8155df0 2023-10-06T01:22:10.510 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:10.509+0000 7f27dd99b700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f27d8156fc0 0x7f27d80cb7b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:56732/0 (socket says 172.21.15.50:56732) 2023-10-06T01:22:10.510 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:10.509+0000 7f27dd99b700 1 -- 172.21.15.50:0/785676626 learned_addr learned my addr 172.21.15.50:0/785676626 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-10-06T01:22:10.512 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:10.509+0000 7f27dd19a700 1 --2- 172.21.15.50:0/785676626 >> v2:172.21.15.155:3300/0 conn(0x7f27d8155df0 0x7f27d8156270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:10.512 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:10.509+0000 7f27dc999700 1 -- 172.21.15.50:0/785676626 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2786987956 0 0) 0x7f27d80ad830 con 0x7f27d8156fc0 2023-10-06T01:22:10.512 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:10.509+0000 7f27dc999700 1 -- 172.21.15.50:0/785676626 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f27c4003570 con 0x7f27d8156fc0 2023-10-06T01:22:10.512 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:10.509+0000 7f27dc999700 1 -- 172.21.15.50:0/785676626 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2748016494 0 0) 0x7f27d8156b90 con 0x7f27d80adcc0 2023-10-06T01:22:10.512 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:10.509+0000 7f27dc999700 1 -- 172.21.15.50:0/785676626 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f27d80ad830 con 0x7f27d80adcc0 2023-10-06T01:22:10.512 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:10.510+0000 7f27dc999700 1 -- 172.21.15.50:0/785676626 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3901588180 0 0) 0x7f27c4003570 con 0x7f27d8156fc0 2023-10-06T01:22:10.512 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:10.510+0000 7f27dd19a700 1 -- 172.21.15.50:0/785676626 >> v1:172.21.15.155:6789/0 conn(0x7f27d80adcc0 legacy=0x7f27d80ae0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:10.512 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:10.510+0000 7f27dd19a700 1 -- 172.21.15.50:0/785676626 >> v1:172.21.15.50:6789/0 conn(0x7f27d8156fc0 legacy=0x7f27d80cb7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:10.513 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:10.510+0000 7f27dd19a700 1 -- 172.21.15.50:0/785676626 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27d80ad1e0 con 0x7f27d8155df0 2023-10-06T01:22:10.513 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:10.510+0000 7f27dd19a700 1 --2- 172.21.15.50:0/785676626 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f27d8155df0 0x7f27d8156270 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f27c80098e0 tx=0x7f27c80091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d457b0f140e8249c server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:22:10.513 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:10.510+0000 7f27dc999700 1 -- 172.21.15.50:0/785676626 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27d4001470 con 0x7f27d8155df0 2023-10-06T01:22:10.513 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:10.510+0000 7f27dc999700 1 -- 172.21.15.50:0/785676626 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27c8011420 con 0x7f27d8155df0 2023-10-06T01:22:10.513 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:10.510+0000 7f27dc999700 1 -- 172.21.15.50:0/785676626 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27c80117c0 con 0x7f27d8155df0 2023-10-06T01:22:10.513 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:10.511+0000 7f27de99d700 1 -- 172.21.15.50:0/785676626 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f27d8155df0 msgr2=0x7f27d8156270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:10.513 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:10.511+0000 7f27de99d700 1 --2- 172.21.15.50:0/785676626 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f27d8155df0 0x7f27d8156270 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f27c80098e0 tx=0x7f27c80091a0 comp rx=0 tx=0).stop 2023-10-06T01:22:10.513 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:10.511+0000 7f27de99d700 1 -- 172.21.15.50:0/785676626 shutdown_connections 2023-10-06T01:22:10.513 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:10.511+0000 7f27de99d700 1 --2- 172.21.15.50:0/785676626 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f27d8155df0 0x7f27d8156270 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:10.513 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:10.511+0000 7f27de99d700 1 -- 172.21.15.50:0/785676626 >> 172.21.15.50:0/785676626 conn(0x7f27d80cbf10 msgr2=0x7f27d80cc310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:22:10.513 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:10.511+0000 7f27de99d700 1 -- 172.21.15.50:0/785676626 shutdown_connections 2023-10-06T01:22:10.513 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:10.511+0000 7f27de99d700 1 -- 172.21.15.50:0/785676626 wait complete. 2023-10-06T01:22:10.516 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:10.512+0000 7f27de99d700 1 Processor -- start 2023-10-06T01:22:10.516 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:10.513+0000 7f27de99d700 1 -- start start 2023-10-06T01:22:10.516 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:10.513+0000 7f27de99d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f27d80adcc0 0x7f27d8164fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:10.516 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:10.513+0000 7f27de99d700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f27d8155df0 0x7f27d8154940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:10.516 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:10.514+0000 7f27de99d700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f27d8156fc0 0x7f27d80a74e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:10.516 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:10.514+0000 7f27de99d700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27d81535b0 con 0x7f27d80adcc0 2023-10-06T01:22:10.516 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:10.514+0000 7f27de99d700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27d8154e80 con 0x7f27d8155df0 2023-10-06T01:22:10.516 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:10.514+0000 7f27de99d700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27d81656d0 con 0x7f27d8156fc0 2023-10-06T01:22:10.516 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:10.514+0000 7f27dd99b700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f27d80adcc0 0x7f27d8164fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:10.516 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:10.514+0000 7f27dd99b700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f27d80adcc0 0x7f27d8164fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:37274/0 (socket says 172.21.15.50:37274) 2023-10-06T01:22:10.517 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:10.514+0000 7f27dd99b700 1 -- 172.21.15.50:0/3152075669 learned_addr learned my addr 172.21.15.50:0/3152075669 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-06T01:22:10.517 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:10.514+0000 7f27dd19a700 1 --2- 172.21.15.50:0/3152075669 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f27d8155df0 0x7f27d8154940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:10.517 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:10.514+0000 7f27de19c700 1 --2- 172.21.15.50:0/3152075669 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f27d8156fc0 0x7f27d80a74e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:10.517 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:10.514+0000 7f27dd99b700 1 -- 172.21.15.50:0/3152075669 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f27d8156fc0 msgr2=0x7f27d80a74e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:10.517 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:10.514+0000 7f27dd99b700 1 --2- 172.21.15.50:0/3152075669 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f27d8156fc0 0x7f27d80a74e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:10.517 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:10.514+0000 7f27dd99b700 1 -- 172.21.15.50:0/3152075669 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f27d8155df0 msgr2=0x7f27d8154940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:10.517 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:10.514+0000 7f27dd99b700 1 --2- 172.21.15.50:0/3152075669 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f27d8155df0 0x7f27d8154940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:10.517 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:10.514+0000 7f27dd99b700 1 -- 172.21.15.50:0/3152075669 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27c8009420 con 0x7f27d80adcc0 2023-10-06T01:22:10.517 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:10.514+0000 7f27de19c700 1 --2- 172.21.15.50:0/3152075669 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f27d8156fc0 0x7f27d80a74e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T01:22:10.517 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:10.515+0000 7f27dd99b700 1 --2- 172.21.15.50:0/3152075669 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f27d80adcc0 0x7f27d8164fe0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f27d400c810 tx=0x7f27d4001a10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:22:10.518 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:10.515+0000 7f27cdffb700 1 -- 172.21.15.50:0/3152075669 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27d4007360 con 0x7f27d80adcc0 2023-10-06T01:22:10.518 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:10.515+0000 7f27cdffb700 1 -- 172.21.15.50:0/3152075669 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27d4007500 con 0x7f27d80adcc0 2023-10-06T01:22:10.518 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:10.515+0000 7f27de99d700 1 -- 172.21.15.50:0/3152075669 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f27d81659b0 con 0x7f27d80adcc0 2023-10-06T01:22:10.518 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:10.515+0000 7f27cdffb700 1 -- 172.21.15.50:0/3152075669 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27d4004a80 con 0x7f27d80adcc0 2023-10-06T01:22:10.518 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:10.515+0000 7f27de99d700 1 -- 172.21.15.50:0/3152075669 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f27d8165f70 con 0x7f27d80adcc0 2023-10-06T01:22:10.519 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:10.516+0000 7f27de99d700 1 -- 172.21.15.50:0/3152075669 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f27d8155020 con 0x7f27d80adcc0 2023-10-06T01:22:10.519 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:10.517+0000 7f27cdffb700 1 -- 172.21.15.50:0/3152075669 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f27d401c3b0 con 0x7f27d80adcc0 2023-10-06T01:22:10.519 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:10.518+0000 7f27cdffb700 1 --2- 172.21.15.50:0/3152075669 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f27bc066f30 0x7f27bc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:10.519 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:10.518+0000 7f27cdffb700 1 -- 172.21.15.50:0/3152075669 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f27d40840f0 con 0x7f27d80adcc0 2023-10-06T01:22:10.519 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:10.518+0000 7f27dd19a700 1 --2- 172.21.15.50:0/3152075669 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f27bc066f30 0x7f27bc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:10.520 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:10.519+0000 7f27dd19a700 1 --2- 172.21.15.50:0/3152075669 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f27bc066f30 0x7f27bc0693e0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f27c80093f0 tx=0x7f27c8016000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:22:10.522 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:10.522+0000 7f27cdffb700 1 -- 172.21.15.50:0/3152075669 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f27d404c5a0 con 0x7f27d80adcc0 2023-10-06T01:22:10.724 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:10.723+0000 7f27de99d700 1 -- 172.21.15.50:0/3152075669 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f27d805f270 con 0x7f27d80adcc0 2023-10-06T01:22:10.725 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:10.724+0000 7f27cdffb700 1 -- 172.21.15.50:0/3152075669 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v25) v1 ==== 92+0+10 (secure 0 0 0) 0x7f27d4050fa0 con 0x7f27d80adcc0 2023-10-06T01:22:10.725 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 8 2023-10-06T01:22:10.727 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:10.726+0000 7f27de99d700 1 -- 172.21.15.50:0/3152075669 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f27bc066f30 msgr2=0x7f27bc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:10.727 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:10.726+0000 7f27de99d700 1 --2- 172.21.15.50:0/3152075669 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f27bc066f30 0x7f27bc0693e0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f27c80093f0 tx=0x7f27c8016000 comp rx=0 tx=0).stop 2023-10-06T01:22:10.727 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:10.726+0000 7f27de99d700 1 -- 172.21.15.50:0/3152075669 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f27d80adcc0 msgr2=0x7f27d8164fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:10.727 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:10.726+0000 7f27de99d700 1 --2- 172.21.15.50:0/3152075669 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f27d80adcc0 0x7f27d8164fe0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f27d400c810 tx=0x7f27d4001a10 comp rx=0 tx=0).stop 2023-10-06T01:22:10.728 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:10.726+0000 7f27de99d700 1 -- 172.21.15.50:0/3152075669 shutdown_connections 2023-10-06T01:22:10.728 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:10.726+0000 7f27de99d700 1 --2- 172.21.15.50:0/3152075669 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f27d8156fc0 0x7f27d80a74e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:10.728 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:10.726+0000 7f27de99d700 1 --2- 172.21.15.50:0/3152075669 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f27d80adcc0 0x7f27d8164fe0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:10.728 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:10.726+0000 7f27de99d700 1 --2- 172.21.15.50:0/3152075669 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f27bc066f30 0x7f27bc0693e0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:10.728 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:10.726+0000 7f27de99d700 1 --2- 172.21.15.50:0/3152075669 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f27d8155df0 0x7f27d8154940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:10.728 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:10.726+0000 7f27de99d700 1 -- 172.21.15.50:0/3152075669 >> 172.21.15.50:0/3152075669 conn(0x7f27d80cbf10 msgr2=0x7f27d80ae090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:22:10.728 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:10.726+0000 7f27de99d700 1 -- 172.21.15.50:0/3152075669 shutdown_connections 2023-10-06T01:22:10.728 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:10.726+0000 7f27de99d700 1 -- 172.21.15.50:0/3152075669 wait complete. 2023-10-06T01:22:10.744 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-06T01:22:10.934 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:10.933+0000 7f54d3fff700 1 Processor -- start 2023-10-06T01:22:10.934 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:10.933+0000 7f54d3fff700 1 -- start start 2023-10-06T01:22:10.936 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:10.935+0000 7f54d3fff700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f54d4159ca0 0x7f54d40c8a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:10.936 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:10.935+0000 7f54d3fff700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f54d40c8f70 0x7f54d406e1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:10.936 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:10.935+0000 7f54d3fff700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f54d40acb10 con 0x7f54d4156130 2023-10-06T01:22:10.936 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:10.935+0000 7f54d3fff700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f54d415a120 con 0x7f54d4159ca0 2023-10-06T01:22:10.936 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:10.935+0000 7f54d3fff700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f54d4156500 con 0x7f54d40c8f70 2023-10-06T01:22:10.937 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:10.935+0000 7f54d27fc700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f54d4159ca0 0x7f54d40c8a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:10.937 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:10.935+0000 7f54d27fc700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f54d4159ca0 0x7f54d40c8a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:37280/0 (socket says 172.21.15.50:37280) 2023-10-06T01:22:10.937 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:10.935+0000 7f54d27fc700 1 -- 172.21.15.50:0/964818953 learned_addr learned my addr 172.21.15.50:0/964818953 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-06T01:22:10.937 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:10.935+0000 7f54d37fe700 1 --2- 172.21.15.50:0/964818953 >> v2:172.21.15.155:3300/0 conn(0x7f54d40c8f70 0x7f54d406e1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:10.937 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:10.935+0000 7f54d27fc700 1 -- 172.21.15.50:0/964818953 >> v2:172.21.15.155:3300/0 conn(0x7f54d40c8f70 msgr2=0x7f54d406e1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:22:10.937 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:10.935+0000 7f54d27fc700 1 --2- 172.21.15.50:0/964818953 >> v2:172.21.15.155:3300/0 conn(0x7f54d40c8f70 0x7f54d406e1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:10.937 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:10.935+0000 7f54d27fc700 1 -- 172.21.15.50:0/964818953 >> v1:172.21.15.155:6789/0 conn(0x7f54d4156130 legacy=0x7f54d40ae0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:10.937 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:10.935+0000 7f54d27fc700 1 -- 172.21.15.50:0/964818953 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54d415a310 con 0x7f54d4159ca0 2023-10-06T01:22:10.939 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:10.936+0000 7f54d27fc700 1 --2- 172.21.15.50:0/964818953 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f54d4159ca0 0x7f54d40c8a30 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f54d406fe20 tx=0x7f54c8009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bd5c70838a4e9ff0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:22:10.939 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:10.936+0000 7f54d1ffb700 1 -- 172.21.15.50:0/964818953 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54c8009e70 con 0x7f54d4159ca0 2023-10-06T01:22:10.939 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:10.936+0000 7f54d1ffb700 1 -- 172.21.15.50:0/964818953 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f54c800b8f0 con 0x7f54d4159ca0 2023-10-06T01:22:10.939 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:10.936+0000 7f54d1ffb700 1 -- 172.21.15.50:0/964818953 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54c800bc90 con 0x7f54d4159ca0 2023-10-06T01:22:10.939 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:10.936+0000 7f54d3fff700 1 -- 172.21.15.50:0/964818953 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f54d4159ca0 msgr2=0x7f54d40c8a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:10.939 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:10.936+0000 7f54d3fff700 1 --2- 172.21.15.50:0/964818953 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f54d4159ca0 0x7f54d40c8a30 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f54d406fe20 tx=0x7f54c8009250 comp rx=0 tx=0).stop 2023-10-06T01:22:10.939 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:10.937+0000 7f54d3fff700 1 -- 172.21.15.50:0/964818953 shutdown_connections 2023-10-06T01:22:10.939 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:10.937+0000 7f54d3fff700 1 --2- 172.21.15.50:0/964818953 >> v2:172.21.15.155:3300/0 conn(0x7f54d40c8f70 0x7f54d406e1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:10.940 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:10.937+0000 7f54d3fff700 1 --2- 172.21.15.50:0/964818953 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f54d4159ca0 0x7f54d40c8a30 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:10.940 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:10.937+0000 7f54d3fff700 1 -- 172.21.15.50:0/964818953 >> 172.21.15.50:0/964818953 conn(0x7f54d40cbf10 msgr2=0x7f54d40cc310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:22:10.940 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:10.937+0000 7f54d3fff700 1 -- 172.21.15.50:0/964818953 shutdown_connections 2023-10-06T01:22:10.940 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:10.937+0000 7f54d3fff700 1 -- 172.21.15.50:0/964818953 wait complete. 2023-10-06T01:22:10.940 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:10.938+0000 7f54d3fff700 1 Processor -- start 2023-10-06T01:22:10.940 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:10.938+0000 7f54d3fff700 1 -- start start 2023-10-06T01:22:10.942 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:10.939+0000 7f54d3fff700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f54d40c8f70 0x7f54d41566d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:10.942 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:10.939+0000 7f54d3fff700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f54d4156130 0x7f54d41581f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:10.942 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:10.939+0000 7f54d3fff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f54d4159ca0 0x7f54d4158730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:10.942 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:10.939+0000 7f54d3fff700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54d40c50c0 con 0x7f54d4159ca0 2023-10-06T01:22:10.942 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:10.939+0000 7f54d3fff700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54d40ca2e0 con 0x7f54d4156130 2023-10-06T01:22:10.942 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:10.939+0000 7f54d3fff700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54d40ca5c0 con 0x7f54d40c8f70 2023-10-06T01:22:10.942 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:10.939+0000 7f54d37fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f54d4159ca0 0x7f54d4158730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:10.942 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:10.939+0000 7f54d37fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f54d4159ca0 0x7f54d4158730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:37282/0 (socket says 172.21.15.50:37282) 2023-10-06T01:22:10.943 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:10.939+0000 7f54d37fe700 1 -- 172.21.15.50:0/2760346281 learned_addr learned my addr 172.21.15.50:0/2760346281 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-06T01:22:10.943 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:10.940+0000 7f54d27fc700 1 --2- 172.21.15.50:0/2760346281 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f54d4156130 0x7f54d41581f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:10.943 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:10.940+0000 7f54d2ffd700 1 --2- 172.21.15.50:0/2760346281 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f54d40c8f70 0x7f54d41566d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:10.943 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:10.940+0000 7f54d37fe700 1 -- 172.21.15.50:0/2760346281 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f54d40c8f70 msgr2=0x7f54d41566d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:10.943 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:10.940+0000 7f54d37fe700 1 --2- 172.21.15.50:0/2760346281 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f54d40c8f70 0x7f54d41566d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:10.943 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:10.940+0000 7f54d37fe700 1 -- 172.21.15.50:0/2760346281 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f54d4156130 msgr2=0x7f54d41581f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:10.943 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:10.940+0000 7f54d37fe700 1 --2- 172.21.15.50:0/2760346281 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f54d4156130 0x7f54d41581f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:10.943 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:10.940+0000 7f54d37fe700 1 -- 172.21.15.50:0/2760346281 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54c80094f0 con 0x7f54d4159ca0 2023-10-06T01:22:10.943 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:10.940+0000 7f54d37fe700 1 --2- 172.21.15.50:0/2760346281 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f54d4159ca0 0x7f54d4158730 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f54cc009ef0 tx=0x7f54cc00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:22:10.943 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:10.940+0000 7f54baffd700 1 -- 172.21.15.50:0/2760346281 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54cc00cb70 con 0x7f54d4159ca0 2023-10-06T01:22:10.943 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:10.940+0000 7f54baffd700 1 -- 172.21.15.50:0/2760346281 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f54cc00f040 con 0x7f54d4159ca0 2023-10-06T01:22:10.943 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:10.940+0000 7f54d3fff700 1 -- 172.21.15.50:0/2760346281 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f54d40ca8a0 con 0x7f54d4159ca0 2023-10-06T01:22:10.944 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:10.941+0000 7f54baffd700 1 -- 172.21.15.50:0/2760346281 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54cc014480 con 0x7f54d4159ca0 2023-10-06T01:22:10.944 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:10.941+0000 7f54d3fff700 1 -- 172.21.15.50:0/2760346281 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f54d4156c10 con 0x7f54d4159ca0 2023-10-06T01:22:10.944 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:10.942+0000 7f54d3fff700 1 -- 172.21.15.50:0/2760346281 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f54d40c5230 con 0x7f54d4159ca0 2023-10-06T01:22:10.944 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:10.943+0000 7f54baffd700 1 -- 172.21.15.50:0/2760346281 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f54cc014830 con 0x7f54d4159ca0 2023-10-06T01:22:10.945 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:10.944+0000 7f54baffd700 1 --2- 172.21.15.50:0/2760346281 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f54c0066f30 0x7f54c00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:10.945 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:10.944+0000 7f54baffd700 1 -- 172.21.15.50:0/2760346281 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f54cc0856b0 con 0x7f54d4159ca0 2023-10-06T01:22:10.945 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:10.944+0000 7f54d2ffd700 1 --2- 172.21.15.50:0/2760346281 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f54c0066f30 0x7f54c00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:10.945 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:10.945+0000 7f54d2ffd700 1 --2- 172.21.15.50:0/2760346281 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f54c0066f30 0x7f54c00693e0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f54c40039f0 tx=0x7f54c4007ec0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:22:10.948 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:10.947+0000 7f54baffd700 1 -- 172.21.15.50:0/2760346281 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f54d40c5230 con 0x7f54d4159ca0 2023-10-06T01:22:11.148 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:11.147+0000 7f54d3fff700 1 -- 172.21.15.50:0/2760346281 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f54d40c5200 con 0x7f54d4159ca0 2023-10-06T01:22:11.149 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:11.148+0000 7f54baffd700 1 -- 172.21.15.50:0/2760346281 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v25) v1 ==== 93+0+10 (secure 0 0 0) 0x7f54cc052430 con 0x7f54d4159ca0 2023-10-06T01:22:11.149 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 1 2023-10-06T01:22:11.152 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:11.150+0000 7f54d3fff700 1 -- 172.21.15.50:0/2760346281 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f54c0066f30 msgr2=0x7f54c00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:11.152 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:11.150+0000 7f54d3fff700 1 --2- 172.21.15.50:0/2760346281 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f54c0066f30 0x7f54c00693e0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f54c40039f0 tx=0x7f54c4007ec0 comp rx=0 tx=0).stop 2023-10-06T01:22:11.152 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:11.150+0000 7f54d3fff700 1 -- 172.21.15.50:0/2760346281 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f54d4159ca0 msgr2=0x7f54d4158730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:11.152 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:11.150+0000 7f54d3fff700 1 --2- 172.21.15.50:0/2760346281 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f54d4159ca0 0x7f54d4158730 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f54cc009ef0 tx=0x7f54cc00b040 comp rx=0 tx=0).stop 2023-10-06T01:22:11.152 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:11.150+0000 7f54d3fff700 1 -- 172.21.15.50:0/2760346281 shutdown_connections 2023-10-06T01:22:11.152 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:11.150+0000 7f54d3fff700 1 --2- 172.21.15.50:0/2760346281 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f54d4159ca0 0x7f54d4158730 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:11.152 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:11.150+0000 7f54d3fff700 1 --2- 172.21.15.50:0/2760346281 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f54d40c8f70 0x7f54d41566d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:11.152 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:11.150+0000 7f54d3fff700 1 --2- 172.21.15.50:0/2760346281 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f54c0066f30 0x7f54c00693e0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:11.152 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:11.150+0000 7f54d3fff700 1 --2- 172.21.15.50:0/2760346281 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f54d4156130 0x7f54d41581f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:11.153 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:11.150+0000 7f54d3fff700 1 -- 172.21.15.50:0/2760346281 >> 172.21.15.50:0/2760346281 conn(0x7f54d40cbf10 msgr2=0x7f54d406d190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:22:11.153 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:11.150+0000 7f54d3fff700 1 -- 172.21.15.50:0/2760346281 shutdown_connections 2023-10-06T01:22:11.153 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:11.151+0000 7f54d3fff700 1 -- 172.21.15.50:0/2760346281 wait complete. 2023-10-06T01:22:11.169 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-06T01:22:11.359 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:11.358+0000 7f22c719d700 1 Processor -- start 2023-10-06T01:22:11.359 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:11.358+0000 7f22c719d700 1 -- start start 2023-10-06T01:22:11.360 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:11.359+0000 7f22c719d700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f22c00cd400 0x7f22c00ceae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:11.361 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:11.359+0000 7f22c719d700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f22c00cc9b0 con 0x7f22c00b2a30 2023-10-06T01:22:11.361 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:11.359+0000 7f22c719d700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f22c00cbda0 con 0x7f22c00b2660 2023-10-06T01:22:11.361 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:11.359+0000 7f22c719d700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22c00cc080 con 0x7f22c00cd400 2023-10-06T01:22:11.361 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:11.360+0000 7f22c699c700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f22c00b2a30 0x7f22c00c5390 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:56734/0 (socket says 172.21.15.50:56734) 2023-10-06T01:22:11.361 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:11.360+0000 7f22c699c700 1 -- 172.21.15.50:0/4093819604 learned_addr learned my addr 172.21.15.50:0/4093819604 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-10-06T01:22:11.361 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:11.360+0000 7f22c599a700 1 --2- 172.21.15.50:0/4093819604 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f22c00cd400 0x7f22c00ceae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:11.363 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:11.360+0000 7f22c5199700 1 -- 172.21.15.50:0/4093819604 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 842773684 0 0) 0x7f22c00cc9b0 con 0x7f22c00b2a30 2023-10-06T01:22:11.363 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:11.360+0000 7f22c5199700 1 -- 172.21.15.50:0/4093819604 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f22ac003570 con 0x7f22c00b2a30 2023-10-06T01:22:11.363 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:11.360+0000 7f22c5199700 1 -- 172.21.15.50:0/4093819604 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3904148034 0 0) 0x7f22c00cbda0 con 0x7f22c00b2660 2023-10-06T01:22:11.363 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:11.360+0000 7f22c5199700 1 -- 172.21.15.50:0/4093819604 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f22c00cc9b0 con 0x7f22c00b2660 2023-10-06T01:22:11.363 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:11.360+0000 7f22c599a700 1 -- 172.21.15.50:0/4093819604 >> v1:172.21.15.155:6789/0 conn(0x7f22c00b2660 legacy=0x7f22c00cccf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:11.363 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:11.360+0000 7f22c599a700 1 -- 172.21.15.50:0/4093819604 >> v1:172.21.15.50:6789/0 conn(0x7f22c00b2a30 legacy=0x7f22c00c5390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:11.364 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:11.360+0000 7f22c599a700 1 -- 172.21.15.50:0/4093819604 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22c00cc360 con 0x7f22c00cd400 2023-10-06T01:22:11.364 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:11.361+0000 7f22c599a700 1 --2- 172.21.15.50:0/4093819604 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f22c00cd400 0x7f22c00ceae0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f22b0009910 tx=0x7f22b00091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d937c9bcd65f76ef server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:22:11.364 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:11.361+0000 7f22c5199700 1 -- 172.21.15.50:0/4093819604 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22b0011630 con 0x7f22c00cd400 2023-10-06T01:22:11.364 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:11.361+0000 7f22c5199700 1 -- 172.21.15.50:0/4093819604 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22b0011790 con 0x7f22c00cd400 2023-10-06T01:22:11.364 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:11.361+0000 7f22c5199700 1 -- 172.21.15.50:0/4093819604 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22b0011b30 con 0x7f22c00cd400 2023-10-06T01:22:11.364 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:11.361+0000 7f22c719d700 1 -- 172.21.15.50:0/4093819604 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f22c00cd400 msgr2=0x7f22c00ceae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:11.364 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:11.361+0000 7f22c719d700 1 --2- 172.21.15.50:0/4093819604 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f22c00cd400 0x7f22c00ceae0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f22b0009910 tx=0x7f22b00091a0 comp rx=0 tx=0).stop 2023-10-06T01:22:11.364 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:11.362+0000 7f22c719d700 1 -- 172.21.15.50:0/4093819604 shutdown_connections 2023-10-06T01:22:11.364 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:11.362+0000 7f22c719d700 1 --2- 172.21.15.50:0/4093819604 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f22c00cd400 0x7f22c00ceae0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:11.364 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:11.362+0000 7f22c719d700 1 -- 172.21.15.50:0/4093819604 >> 172.21.15.50:0/4093819604 conn(0x7f22c0099560 msgr2=0x7f22c006f500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:22:11.364 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:11.362+0000 7f22c719d700 1 -- 172.21.15.50:0/4093819604 shutdown_connections 2023-10-06T01:22:11.365 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:11.362+0000 7f22c719d700 1 -- 172.21.15.50:0/4093819604 wait complete. 2023-10-06T01:22:11.367 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:11.363+0000 7f22c719d700 1 Processor -- start 2023-10-06T01:22:11.367 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:11.363+0000 7f22c719d700 1 -- start start 2023-10-06T01:22:11.367 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:11.364+0000 7f22c719d700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f22c00b2660 0x7f22c01696b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:11.367 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:11.364+0000 7f22c719d700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f22c00b2a30 0x7f22c0150e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:11.367 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:11.364+0000 7f22c719d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f22c00cd400 0x7f22c00b5360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:11.367 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:11.364+0000 7f22c719d700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22c016a8a0 con 0x7f22c00cd400 2023-10-06T01:22:11.367 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:11.364+0000 7f22c719d700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22c0169c90 con 0x7f22c00b2660 2023-10-06T01:22:11.367 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:11.364+0000 7f22c719d700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22c0169f70 con 0x7f22c00b2a30 2023-10-06T01:22:11.368 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:11.364+0000 7f22c699c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f22c00cd400 0x7f22c00b5360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:11.368 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:11.364+0000 7f22c699c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f22c00cd400 0x7f22c00b5360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:37294/0 (socket says 172.21.15.50:37294) 2023-10-06T01:22:11.368 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:11.364+0000 7f22c699c700 1 -- 172.21.15.50:0/1191173768 learned_addr learned my addr 172.21.15.50:0/1191173768 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-06T01:22:11.368 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:11.364+0000 7f22c619b700 1 --2- 172.21.15.50:0/1191173768 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f22c00b2660 0x7f22c01696b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:11.368 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:11.365+0000 7f22c599a700 1 --2- 172.21.15.50:0/1191173768 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f22c00b2a30 0x7f22c0150e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:11.368 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:11.365+0000 7f22c699c700 1 -- 172.21.15.50:0/1191173768 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f22c00b2a30 msgr2=0x7f22c0150e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:11.368 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:11.365+0000 7f22c699c700 1 --2- 172.21.15.50:0/1191173768 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f22c00b2a30 0x7f22c0150e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:11.368 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:11.365+0000 7f22c699c700 1 -- 172.21.15.50:0/1191173768 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f22c00b2660 msgr2=0x7f22c01696b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:11.368 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:11.365+0000 7f22c699c700 1 --2- 172.21.15.50:0/1191173768 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f22c00b2660 0x7f22c01696b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:11.368 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:11.365+0000 7f22c699c700 1 -- 172.21.15.50:0/1191173768 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22b0009420 con 0x7f22c00cd400 2023-10-06T01:22:11.369 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:11.365+0000 7f22c699c700 1 --2- 172.21.15.50:0/1191173768 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f22c00cd400 0x7f22c00b5360 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f22b8001460 tx=0x7f22b8001ac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:22:11.369 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:11.365+0000 7f22b67fc700 1 -- 172.21.15.50:0/1191173768 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22b800a8b0 con 0x7f22c00cd400 2023-10-06T01:22:11.369 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:11.365+0000 7f22b67fc700 1 -- 172.21.15.50:0/1191173768 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22b800aa30 con 0x7f22c00cd400 2023-10-06T01:22:11.369 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:11.365+0000 7f22b67fc700 1 -- 172.21.15.50:0/1191173768 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22b800adf0 con 0x7f22c00cd400 2023-10-06T01:22:11.369 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:11.365+0000 7f22c719d700 1 -- 172.21.15.50:0/1191173768 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f22c016a250 con 0x7f22c00cd400 2023-10-06T01:22:11.369 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:11.366+0000 7f22c719d700 1 -- 172.21.15.50:0/1191173768 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f22c015c8b0 con 0x7f22c00cd400 2023-10-06T01:22:11.370 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:11.366+0000 7f22c719d700 1 -- 172.21.15.50:0/1191173768 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f22c015a830 con 0x7f22c00cd400 2023-10-06T01:22:11.370 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:11.367+0000 7f22b67fc700 1 -- 172.21.15.50:0/1191173768 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f22b8007300 con 0x7f22c00cd400 2023-10-06T01:22:11.370 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:11.368+0000 7f22b67fc700 1 --2- 172.21.15.50:0/1191173768 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f22a4066f30 0x7f22a40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:11.370 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:11.368+0000 7f22b67fc700 1 -- 172.21.15.50:0/1191173768 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f22b8084cf0 con 0x7f22c00cd400 2023-10-06T01:22:11.370 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:11.369+0000 7f22c619b700 1 --2- 172.21.15.50:0/1191173768 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f22a4066f30 0x7f22a40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:11.370 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:11.369+0000 7f22c619b700 1 --2- 172.21.15.50:0/1191173768 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f22a4066f30 0x7f22a40693e0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f22bc003a40 tx=0x7f22bc007d40 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:22:11.373 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:11.372+0000 7f22b67fc700 1 -- 172.21.15.50:0/1191173768 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f22b8051af0 con 0x7f22c00cd400 2023-10-06T01:22:11.573 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:11.572+0000 7f22c719d700 1 -- 172.21.15.50:0/1191173768 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f22c005f270 con 0x7f22c00cd400 2023-10-06T01:22:11.574 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:11.573+0000 7f22b67fc700 1 -- 172.21.15.50:0/1191173768 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v25) v1 ==== 104+0+11 (secure 0 0 0) 0x7f22b8055110 con 0x7f22c00cd400 2023-10-06T01:22:11.574 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 32 2023-10-06T01:22:11.576 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:11.575+0000 7f22c719d700 1 -- 172.21.15.50:0/1191173768 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f22a4066f30 msgr2=0x7f22a40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:11.576 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:11.575+0000 7f22c719d700 1 --2- 172.21.15.50:0/1191173768 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f22a4066f30 0x7f22a40693e0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f22bc003a40 tx=0x7f22bc007d40 comp rx=0 tx=0).stop 2023-10-06T01:22:11.577 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:11.575+0000 7f22c719d700 1 -- 172.21.15.50:0/1191173768 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f22c00cd400 msgr2=0x7f22c00b5360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:11.577 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:11.575+0000 7f22c719d700 1 --2- 172.21.15.50:0/1191173768 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f22c00cd400 0x7f22c00b5360 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f22b8001460 tx=0x7f22b8001ac0 comp rx=0 tx=0).stop 2023-10-06T01:22:11.577 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:11.575+0000 7f22c719d700 1 -- 172.21.15.50:0/1191173768 shutdown_connections 2023-10-06T01:22:11.577 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:11.575+0000 7f22c719d700 1 --2- 172.21.15.50:0/1191173768 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f22c00cd400 0x7f22c00b5360 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:11.577 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:11.575+0000 7f22c719d700 1 --2- 172.21.15.50:0/1191173768 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f22a4066f30 0x7f22a40693e0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:11.577 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:11.575+0000 7f22c719d700 1 --2- 172.21.15.50:0/1191173768 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f22c00b2660 0x7f22c01696b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:11.577 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:11.575+0000 7f22c719d700 1 --2- 172.21.15.50:0/1191173768 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f22c00b2a30 0x7f22c0150e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:11.577 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:11.575+0000 7f22c719d700 1 -- 172.21.15.50:0/1191173768 >> 172.21.15.50:0/1191173768 conn(0x7f22c0099560 msgr2=0x7f22c0068dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:22:11.577 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:11.575+0000 7f22c719d700 1 -- 172.21.15.50:0/1191173768 shutdown_connections 2023-10-06T01:22:11.577 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:11.575+0000 7f22c719d700 1 -- 172.21.15.50:0/1191173768 wait complete. 2023-10-06T01:22:11.594 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-06T01:22:11.785 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:11.784+0000 7fe28b59e700 1 Processor -- start 2023-10-06T01:22:11.785 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:11.784+0000 7fe28b59e700 1 -- start start 2023-10-06T01:22:11.786 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:11.785+0000 7fe28b59e700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fe28c154ad0 0x7fe28c0b15d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:11.786 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:11.785+0000 7fe28b59e700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe28c154ea0 0x7fe28c0adae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:11.786 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:11.785+0000 7fe28b59e700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe28c0ae480 con 0x7fe28c0ae020 2023-10-06T01:22:11.786 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:11.785+0000 7fe28b59e700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe28c06ef50 con 0x7fe28c154ad0 2023-10-06T01:22:11.786 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:11.785+0000 7fe28b59e700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe28c06e340 con 0x7fe28c154ea0 2023-10-06T01:22:11.787 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:11.786+0000 7fe289d9b700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe28c154ea0 0x7fe28c0adae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:11.787 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:11.786+0000 7fe28a59c700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fe28c154ad0 0x7fe28c0b15d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:11.788 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:11.786+0000 7fe28ad9d700 1 --1- >> v1:172.21.15.155:6789/0 conn(0x7fe28c0ae020 0x7fe28c15ad50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.155:6789/0 says I am v1:172.21.15.50:44410/0 (socket says 172.21.15.50:44410) 2023-10-06T01:22:11.788 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:11.786+0000 7fe28ad9d700 1 -- 172.21.15.50:0/632821934 learned_addr learned my addr 172.21.15.50:0/632821934 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-10-06T01:22:11.788 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:11.786+0000 7fe28959a700 1 -- 172.21.15.50:0/632821934 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3825917112 0 0) 0x7fe284001490 con 0x7fe28c0ae020 2023-10-06T01:22:11.788 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:11.786+0000 7fe289d9b700 1 -- 172.21.15.50:0/632821934 >> v2:172.21.15.155:3300/0 conn(0x7fe28c154ad0 msgr2=0x7fe28c0b15d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:22:11.788 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:11.786+0000 7fe289d9b700 1 --2- 172.21.15.50:0/632821934 >> v2:172.21.15.155:3300/0 conn(0x7fe28c154ad0 0x7fe28c0b15d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:11.788 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:11.786+0000 7fe289d9b700 1 -- 172.21.15.50:0/632821934 >> v1:172.21.15.155:6789/0 conn(0x7fe28c0ae020 legacy=0x7fe28c15ad50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:11.788 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:11.786+0000 7fe289d9b700 1 -- 172.21.15.50:0/632821934 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe28c06e620 con 0x7fe28c154ea0 2023-10-06T01:22:11.788 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:11.786+0000 7fe289d9b700 1 --2- 172.21.15.50:0/632821934 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe28c154ea0 0x7fe28c0adae0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fe2800098e0 tx=0x7fe2800091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=80fa574de30c34be server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:22:11.788 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:11.787+0000 7fe28959a700 1 -- 172.21.15.50:0/632821934 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe28000b640 con 0x7fe28c154ea0 2023-10-06T01:22:11.788 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:11.787+0000 7fe28959a700 1 -- 172.21.15.50:0/632821934 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe28000b7a0 con 0x7fe28c154ea0 2023-10-06T01:22:11.788 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:11.787+0000 7fe28959a700 1 -- 172.21.15.50:0/632821934 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe28000bb40 con 0x7fe28c154ea0 2023-10-06T01:22:11.789 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:11.787+0000 7fe28b59e700 1 -- 172.21.15.50:0/632821934 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe28c154ea0 msgr2=0x7fe28c0adae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:11.790 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:11.787+0000 7fe28b59e700 1 --2- 172.21.15.50:0/632821934 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe28c154ea0 0x7fe28c0adae0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fe2800098e0 tx=0x7fe2800091a0 comp rx=0 tx=0).stop 2023-10-06T01:22:11.790 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:11.787+0000 7fe28b59e700 1 -- 172.21.15.50:0/632821934 shutdown_connections 2023-10-06T01:22:11.790 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:11.787+0000 7fe28b59e700 1 --2- 172.21.15.50:0/632821934 >> v2:172.21.15.155:3300/0 conn(0x7fe28c154ad0 0x7fe28c0b15d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:11.790 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:11.787+0000 7fe28b59e700 1 --2- 172.21.15.50:0/632821934 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe28c154ea0 0x7fe28c0adae0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:11.790 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:11.787+0000 7fe28b59e700 1 -- 172.21.15.50:0/632821934 >> 172.21.15.50:0/632821934 conn(0x7fe28c0cbf10 msgr2=0x7fe28c0cc310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:22:11.790 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:11.787+0000 7fe28b59e700 1 -- 172.21.15.50:0/632821934 shutdown_connections 2023-10-06T01:22:11.790 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:11.787+0000 7fe28b59e700 1 -- 172.21.15.50:0/632821934 wait complete. 2023-10-06T01:22:11.790 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:11.789+0000 7fe28b59e700 1 Processor -- start 2023-10-06T01:22:11.790 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:11.789+0000 7fe28b59e700 1 -- start start 2023-10-06T01:22:11.792 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:11.790+0000 7fe28b59e700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe28c0ae020 0x7fe28c16d8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:11.792 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:11.790+0000 7fe28b59e700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe28c154ad0 0x7fe28c1489e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:11.792 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:11.790+0000 7fe28b59e700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe28c154ea0 0x7fe28c14d830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:11.792 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:11.790+0000 7fe28b59e700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe28c1496e0 con 0x7fe28c0ae020 2023-10-06T01:22:11.792 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:11.790+0000 7fe28b59e700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe28c1574b0 con 0x7fe28c154ad0 2023-10-06T01:22:11.792 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:11.790+0000 7fe28b59e700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe28c1566f0 con 0x7fe28c154ea0 2023-10-06T01:22:11.792 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:11.790+0000 7fe28a59c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe28c0ae020 0x7fe28c16d8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:11.793 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:11.790+0000 7fe28a59c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe28c0ae020 0x7fe28c16d8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:37304/0 (socket says 172.21.15.50:37304) 2023-10-06T01:22:11.793 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:11.790+0000 7fe28a59c700 1 -- 172.21.15.50:0/1618514496 learned_addr learned my addr 172.21.15.50:0/1618514496 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-06T01:22:11.793 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:11.790+0000 7fe289d9b700 1 --2- 172.21.15.50:0/1618514496 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe28c154ad0 0x7fe28c1489e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:11.793 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:11.790+0000 7fe28ad9d700 1 --2- 172.21.15.50:0/1618514496 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe28c154ea0 0x7fe28c14d830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:11.793 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:11.790+0000 7fe28a59c700 1 -- 172.21.15.50:0/1618514496 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe28c154ea0 msgr2=0x7fe28c14d830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:11.793 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:11.790+0000 7fe28a59c700 1 --2- 172.21.15.50:0/1618514496 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe28c154ea0 0x7fe28c14d830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:11.793 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:11.790+0000 7fe28a59c700 1 -- 172.21.15.50:0/1618514496 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe28c154ad0 msgr2=0x7fe28c1489e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:11.793 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:11.790+0000 7fe28a59c700 1 --2- 172.21.15.50:0/1618514496 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe28c154ad0 0x7fe28c1489e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:11.793 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:11.790+0000 7fe28a59c700 1 -- 172.21.15.50:0/1618514496 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe280009420 con 0x7fe28c0ae020 2023-10-06T01:22:11.793 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:11.790+0000 7fe28ad9d700 1 --2- 172.21.15.50:0/1618514496 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe28c154ea0 0x7fe28c14d830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T01:22:11.793 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:11.791+0000 7fe28a59c700 1 --2- 172.21.15.50:0/1618514496 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe28c0ae020 0x7fe28c16d8f0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fe27c00ec80 tx=0x7fe27c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:22:11.794 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:11.791+0000 7fe27a7fc700 1 -- 172.21.15.50:0/1618514496 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe27c00c850 con 0x7fe28c0ae020 2023-10-06T01:22:11.794 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:11.791+0000 7fe27a7fc700 1 -- 172.21.15.50:0/1618514496 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe27c00c9b0 con 0x7fe28c0ae020 2023-10-06T01:22:11.794 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:11.791+0000 7fe27a7fc700 1 -- 172.21.15.50:0/1618514496 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe27c00cd50 con 0x7fe28c0ae020 2023-10-06T01:22:11.794 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:11.791+0000 7fe28b59e700 1 -- 172.21.15.50:0/1618514496 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe28c1569d0 con 0x7fe28c0ae020 2023-10-06T01:22:11.794 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:11.791+0000 7fe28b59e700 1 -- 172.21.15.50:0/1618514496 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe28c156f90 con 0x7fe28c0ae020 2023-10-06T01:22:11.794 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:11.792+0000 7fe28b59e700 1 -- 172.21.15.50:0/1618514496 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe28c05f270 con 0x7fe28c0ae020 2023-10-06T01:22:11.794 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:11.793+0000 7fe27a7fc700 1 -- 172.21.15.50:0/1618514496 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fe27c013680 con 0x7fe28c0ae020 2023-10-06T01:22:11.795 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:11.794+0000 7fe27a7fc700 1 --2- 172.21.15.50:0/1618514496 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7fe26c066f30 0x7fe26c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:11.795 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:11.794+0000 7fe27a7fc700 1 -- 172.21.15.50:0/1618514496 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6809+0+0 (secure 0 0 0) 0x7fe27c084ce0 con 0x7fe28c0ae020 2023-10-06T01:22:11.795 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:11.794+0000 7fe289d9b700 1 --2- 172.21.15.50:0/1618514496 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7fe26c066f30 0x7fe26c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:11.796 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:11.795+0000 7fe289d9b700 1 --2- 172.21.15.50:0/1618514496 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7fe26c066f30 0x7fe26c0693e0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fe2800093f0 tx=0x7fe280017000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:22:11.798 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:11.798+0000 7fe27a7fc700 1 -- 172.21.15.50:0/1618514496 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe27c051a60 con 0x7fe28c0ae020 2023-10-06T01:22:12.000 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:11.999+0000 7fe28b59e700 1 -- 172.21.15.50:0/1618514496 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fe28c06e900 con 0x7fe28c0ae020 2023-10-06T01:22:12.000 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:11.999+0000 7fe27a7fc700 1 -- 172.21.15.50:0/1618514496 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v25) v1 ==== 100+0+11 (secure 0 0 0) 0x7fe27c055080 con 0x7fe28c0ae020 2023-10-06T01:22:12.000 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 64 2023-10-06T01:22:12.002 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:12.001+0000 7fe28b59e700 1 -- 172.21.15.50:0/1618514496 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7fe26c066f30 msgr2=0x7fe26c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:12.003 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:12.001+0000 7fe28b59e700 1 --2- 172.21.15.50:0/1618514496 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7fe26c066f30 0x7fe26c0693e0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fe2800093f0 tx=0x7fe280017000 comp rx=0 tx=0).stop 2023-10-06T01:22:12.003 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:12.001+0000 7fe28b59e700 1 -- 172.21.15.50:0/1618514496 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe28c0ae020 msgr2=0x7fe28c16d8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:12.003 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:12.001+0000 7fe28b59e700 1 --2- 172.21.15.50:0/1618514496 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe28c0ae020 0x7fe28c16d8f0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fe27c00ec80 tx=0x7fe27c0091a0 comp rx=0 tx=0).stop 2023-10-06T01:22:12.003 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:12.001+0000 7fe28b59e700 1 -- 172.21.15.50:0/1618514496 shutdown_connections 2023-10-06T01:22:12.003 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:12.001+0000 7fe28b59e700 1 --2- 172.21.15.50:0/1618514496 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe28c154ea0 0x7fe28c14d830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:12.003 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:12.001+0000 7fe28b59e700 1 --2- 172.21.15.50:0/1618514496 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe28c0ae020 0x7fe28c16d8f0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:12.003 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:12.001+0000 7fe28b59e700 1 --2- 172.21.15.50:0/1618514496 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7fe26c066f30 0x7fe26c0693e0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:12.003 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:12.001+0000 7fe28b59e700 1 --2- 172.21.15.50:0/1618514496 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe28c154ad0 0x7fe28c1489e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:12.003 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:12.001+0000 7fe28b59e700 1 -- 172.21.15.50:0/1618514496 >> 172.21.15.50:0/1618514496 conn(0x7fe28c0cbf10 msgr2=0x7fe28c0ad2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:22:12.003 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:12.001+0000 7fe28b59e700 1 -- 172.21.15.50:0/1618514496 shutdown_connections 2023-10-06T01:22:12.004 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:12.001+0000 7fe28b59e700 1 -- 172.21.15.50:0/1618514496 wait complete. 2023-10-06T01:22:12.020 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-10-06T01:22:12.209 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:12.208+0000 7ff7a9b9d700 1 Processor -- start 2023-10-06T01:22:12.209 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:12.209+0000 7ff7a9b9d700 1 -- start start 2023-10-06T01:22:12.211 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:12.210+0000 7ff7a9b9d700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7ff7a413c470 0x7ff7a40ca990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:12.211 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:12.210+0000 7ff7a9b9d700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff7a406d470 con 0x7ff7a40caed0 2023-10-06T01:22:12.211 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:12.210+0000 7ff7a9b9d700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff7a406cb80 con 0x7ff7a415a250 2023-10-06T01:22:12.211 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:12.210+0000 7ff7a9b9d700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff7a40cb370 con 0x7ff7a413c470 2023-10-06T01:22:12.211 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:12.210+0000 7ff7a3fff700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7ff7a40caed0 0x7ff7a4159b40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:56740/0 (socket says 172.21.15.50:56740) 2023-10-06T01:22:12.211 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:12.210+0000 7ff7a3fff700 1 -- 172.21.15.50:0/327500736 learned_addr learned my addr 172.21.15.50:0/327500736 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-10-06T01:22:12.213 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:12.210+0000 7ff7a8b9b700 1 --2- 172.21.15.50:0/327500736 >> v2:172.21.15.155:3300/0 conn(0x7ff7a413c470 0x7ff7a40ca990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:12.213 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:12.210+0000 7ff7a37fe700 1 -- 172.21.15.50:0/327500736 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1388818817 0 0) 0x7ff7a406d470 con 0x7ff7a40caed0 2023-10-06T01:22:12.213 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:12.211+0000 7ff7a37fe700 1 -- 172.21.15.50:0/327500736 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff794003570 con 0x7ff7a40caed0 2023-10-06T01:22:12.214 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:12.211+0000 7ff7a37fe700 1 -- 172.21.15.50:0/327500736 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2471650232 0 0) 0x7ff7a406cb80 con 0x7ff7a415a250 2023-10-06T01:22:12.214 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:12.211+0000 7ff7a37fe700 1 -- 172.21.15.50:0/327500736 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff7a406d470 con 0x7ff7a415a250 2023-10-06T01:22:12.214 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:12.211+0000 7ff7a8b9b700 1 -- 172.21.15.50:0/327500736 >> v1:172.21.15.155:6789/0 conn(0x7ff7a415a250 legacy=0x7ff7a40c8730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:12.214 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:12.211+0000 7ff7a8b9b700 1 -- 172.21.15.50:0/327500736 >> v1:172.21.15.50:6789/0 conn(0x7ff7a40caed0 legacy=0x7ff7a4159b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:12.214 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:12.211+0000 7ff7a8b9b700 1 -- 172.21.15.50:0/327500736 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7a413c840 con 0x7ff7a413c470 2023-10-06T01:22:12.214 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:12.211+0000 7ff7a8b9b700 1 --2- 172.21.15.50:0/327500736 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff7a413c470 0x7ff7a40ca990 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7ff7980098e0 tx=0x7ff7980091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=549c958e95cc8414 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:22:12.215 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:12.211+0000 7ff7a37fe700 1 -- 172.21.15.50:0/327500736 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff798011630 con 0x7ff7a413c470 2023-10-06T01:22:12.215 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:12.211+0000 7ff7a37fe700 1 -- 172.21.15.50:0/327500736 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff798011790 con 0x7ff7a413c470 2023-10-06T01:22:12.215 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:12.211+0000 7ff7a37fe700 1 -- 172.21.15.50:0/327500736 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff798011b30 con 0x7ff7a413c470 2023-10-06T01:22:12.215 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:12.212+0000 7ff7a9b9d700 1 -- 172.21.15.50:0/327500736 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff7a413c470 msgr2=0x7ff7a40ca990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:12.215 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:12.212+0000 7ff7a9b9d700 1 --2- 172.21.15.50:0/327500736 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff7a413c470 0x7ff7a40ca990 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7ff7980098e0 tx=0x7ff7980091a0 comp rx=0 tx=0).stop 2023-10-06T01:22:12.215 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:12.212+0000 7ff7a9b9d700 1 -- 172.21.15.50:0/327500736 shutdown_connections 2023-10-06T01:22:12.216 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:12.212+0000 7ff7a9b9d700 1 --2- 172.21.15.50:0/327500736 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff7a413c470 0x7ff7a40ca990 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:12.216 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:12.212+0000 7ff7a9b9d700 1 -- 172.21.15.50:0/327500736 >> 172.21.15.50:0/327500736 conn(0x7ff7a406b370 msgr2=0x7ff7a406b770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:22:12.216 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:12.212+0000 7ff7a9b9d700 1 -- 172.21.15.50:0/327500736 shutdown_connections 2023-10-06T01:22:12.216 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:12.212+0000 7ff7a9b9d700 1 -- 172.21.15.50:0/327500736 wait complete. 2023-10-06T01:22:12.220 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:12.214+0000 7ff7a9b9d700 1 Processor -- start 2023-10-06T01:22:12.220 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:12.214+0000 7ff7a9b9d700 1 -- start start 2023-10-06T01:22:12.220 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:12.215+0000 7ff7a9b9d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff7a40caed0 0x7ff7a4169a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:12.220 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:12.215+0000 7ff7a9b9d700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff7a413c470 0x7ff7a4166f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:12.220 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:12.215+0000 7ff7a9b9d700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff7a415a250 0x7ff7a40c7790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:12.220 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:12.215+0000 7ff7a9b9d700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7a40c68c0 con 0x7ff7a40caed0 2023-10-06T01:22:12.221 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:12.215+0000 7ff7a9b9d700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7a4167460 con 0x7ff7a413c470 2023-10-06T01:22:12.221 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:12.215+0000 7ff7a9b9d700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7a40c5cb0 con 0x7ff7a415a250 2023-10-06T01:22:12.221 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:12.215+0000 7ff7a8b9b700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff7a40caed0 0x7ff7a4169a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:12.221 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:12.215+0000 7ff7a8b9b700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff7a40caed0 0x7ff7a4169a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:37312/0 (socket says 172.21.15.50:37312) 2023-10-06T01:22:12.221 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:12.215+0000 7ff7a8b9b700 1 -- 172.21.15.50:0/2236603758 learned_addr learned my addr 172.21.15.50:0/2236603758 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-06T01:22:12.221 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:12.215+0000 7ff7a3fff700 1 --2- 172.21.15.50:0/2236603758 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff7a413c470 0x7ff7a4166f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:12.221 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:12.215+0000 7ff7a939c700 1 --2- 172.21.15.50:0/2236603758 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff7a415a250 0x7ff7a40c7790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:12.222 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:12.215+0000 7ff7a8b9b700 1 -- 172.21.15.50:0/2236603758 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff7a415a250 msgr2=0x7ff7a40c7790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:12.222 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:12.215+0000 7ff7a8b9b700 1 --2- 172.21.15.50:0/2236603758 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff7a415a250 0x7ff7a40c7790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:12.222 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:12.215+0000 7ff7a8b9b700 1 -- 172.21.15.50:0/2236603758 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff7a413c470 msgr2=0x7ff7a4166f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:12.222 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:12.215+0000 7ff7a8b9b700 1 --2- 172.21.15.50:0/2236603758 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff7a413c470 0x7ff7a4166f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:12.222 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:12.215+0000 7ff7a8b9b700 1 -- 172.21.15.50:0/2236603758 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff798009420 con 0x7ff7a40caed0 2023-10-06T01:22:12.222 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:12.215+0000 7ff7a939c700 1 --2- 172.21.15.50:0/2236603758 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff7a415a250 0x7ff7a40c7790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T01:22:12.222 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:12.216+0000 7ff7a8b9b700 1 --2- 172.21.15.50:0/2236603758 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff7a40caed0 0x7ff7a4169a90 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7ff7a4071320 tx=0x7ff798017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:22:12.222 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:12.216+0000 7ff7a0ff9700 1 -- 172.21.15.50:0/2236603758 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff79801f070 con 0x7ff7a40caed0 2023-10-06T01:22:12.223 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:12.216+0000 7ff7a0ff9700 1 -- 172.21.15.50:0/2236603758 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff798000c90 con 0x7ff7a40caed0 2023-10-06T01:22:12.223 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:12.216+0000 7ff7a0ff9700 1 -- 172.21.15.50:0/2236603758 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff798025420 con 0x7ff7a40caed0 2023-10-06T01:22:12.223 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:12.216+0000 7ff7a9b9d700 1 -- 172.21.15.50:0/2236603758 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff7a40c5f90 con 0x7ff7a40caed0 2023-10-06T01:22:12.223 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:12.216+0000 7ff7a9b9d700 1 -- 172.21.15.50:0/2236603758 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff7a40c6550 con 0x7ff7a40caed0 2023-10-06T01:22:12.223 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:12.217+0000 7ff7a9b9d700 1 -- 172.21.15.50:0/2236603758 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff7a40c6ba0 con 0x7ff7a40caed0 2023-10-06T01:22:12.223 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:12.218+0000 7ff7a0ff9700 1 -- 172.21.15.50:0/2236603758 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7ff798023070 con 0x7ff7a40caed0 2023-10-06T01:22:12.223 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:12.219+0000 7ff7a0ff9700 1 --2- 172.21.15.50:0/2236603758 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7ff788066f30 0x7ff7880693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:12.224 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:12.219+0000 7ff7a0ff9700 1 -- 172.21.15.50:0/2236603758 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6809+0+0 (secure 0 0 0) 0x7ff798085e50 con 0x7ff7a40caed0 2023-10-06T01:22:12.224 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:12.219+0000 7ff7a3fff700 1 --2- 172.21.15.50:0/2236603758 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7ff788066f30 0x7ff7880693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:12.224 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:12.220+0000 7ff7a3fff700 1 --2- 172.21.15.50:0/2236603758 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7ff788066f30 0x7ff7880693e0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7ff7a40c7470 tx=0x7ff790009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:22:12.225 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:12.223+0000 7ff7a0ff9700 1 -- 172.21.15.50:0/2236603758 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff798052bd0 con 0x7ff7a40caed0 2023-10-06T01:22:12.427 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:12.426+0000 7ff7a9b9d700 1 -- 172.21.15.50:0/2236603758 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7ff7a40cb9c0 con 0x7ff7a40caed0 2023-10-06T01:22:12.427 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:12.426+0000 7ff7a0ff9700 1 -- 172.21.15.50:0/2236603758 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v25) v1 ==== 103+0+11 (secure 0 0 0) 0x7ff79802a020 con 0x7ff7a40caed0 2023-10-06T01:22:12.427 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 32 2023-10-06T01:22:12.429 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:12.428+0000 7ff7a9b9d700 1 -- 172.21.15.50:0/2236603758 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7ff788066f30 msgr2=0x7ff7880693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:12.430 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:12.428+0000 7ff7a9b9d700 1 --2- 172.21.15.50:0/2236603758 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7ff788066f30 0x7ff7880693e0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7ff7a40c7470 tx=0x7ff790009040 comp rx=0 tx=0).stop 2023-10-06T01:22:12.430 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:12.428+0000 7ff7a9b9d700 1 -- 172.21.15.50:0/2236603758 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff7a40caed0 msgr2=0x7ff7a4169a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:12.430 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:12.428+0000 7ff7a9b9d700 1 --2- 172.21.15.50:0/2236603758 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff7a40caed0 0x7ff7a4169a90 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7ff7a4071320 tx=0x7ff798017000 comp rx=0 tx=0).stop 2023-10-06T01:22:12.430 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:12.428+0000 7ff7a9b9d700 1 -- 172.21.15.50:0/2236603758 shutdown_connections 2023-10-06T01:22:12.430 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:12.428+0000 7ff7a9b9d700 1 --2- 172.21.15.50:0/2236603758 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff7a415a250 0x7ff7a40c7790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:12.430 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:12.428+0000 7ff7a9b9d700 1 --2- 172.21.15.50:0/2236603758 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff7a40caed0 0x7ff7a4169a90 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:12.430 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:12.428+0000 7ff7a9b9d700 1 --2- 172.21.15.50:0/2236603758 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7ff788066f30 0x7ff7880693e0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:12.430 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:12.428+0000 7ff7a9b9d700 1 --2- 172.21.15.50:0/2236603758 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff7a413c470 0x7ff7a4166f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:12.430 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:12.428+0000 7ff7a9b9d700 1 -- 172.21.15.50:0/2236603758 >> 172.21.15.50:0/2236603758 conn(0x7ff7a406b370 msgr2=0x7ff7a40c4700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:22:12.431 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:12.428+0000 7ff7a9b9d700 1 -- 172.21.15.50:0/2236603758 shutdown_connections 2023-10-06T01:22:12.431 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:12.428+0000 7ff7a9b9d700 1 -- 172.21.15.50:0/2236603758 wait complete. 2023-10-06T01:22:12.447 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T01:22:12.634 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:12.633+0000 7f9e3d99d700 1 Processor -- start 2023-10-06T01:22:12.634 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:12.633+0000 7f9e3d99d700 1 -- start start 2023-10-06T01:22:12.635 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:12.634+0000 7f9e3d99d700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9e381591f0 0x7f9e380afb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:12.635 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:12.634+0000 7f9e3d99d700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f9e380b0060 0x7f9e380b1930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:12.636 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:12.634+0000 7f9e3d99d700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9e380b04c0 con 0x7f9e381595c0 2023-10-06T01:22:12.636 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:12.634+0000 7f9e3d99d700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9e3815dcd0 con 0x7f9e380b0060 2023-10-06T01:22:12.636 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:12.634+0000 7f9e3d99d700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e380b1e70 con 0x7f9e381591f0 2023-10-06T01:22:12.636 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:12.635+0000 7f9e37fff700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f9e381595c0 0x7f9e380b1220 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:56742/0 (socket says 172.21.15.50:56742) 2023-10-06T01:22:12.636 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:12.635+0000 7f9e3d19c700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f9e380b0060 0x7f9e380b1930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:12.636 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:12.635+0000 7f9e37fff700 1 -- 172.21.15.50:0/1377546605 learned_addr learned my addr 172.21.15.50:0/1377546605 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-10-06T01:22:12.638 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:12.635+0000 7f9e3c99b700 1 --2- 172.21.15.50:0/1377546605 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9e381591f0 0x7f9e380afb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:12.639 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:12.635+0000 7f9e377fe700 1 -- 172.21.15.50:0/1377546605 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1573006145 0 0) 0x7f9e24001110 con 0x7f9e381595c0 2023-10-06T01:22:12.639 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:12.635+0000 7f9e3d19c700 1 -- 172.21.15.50:0/1377546605 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9e381591f0 msgr2=0x7f9e380afb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:22:12.639 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:12.635+0000 7f9e3d19c700 1 --2- 172.21.15.50:0/1377546605 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9e381591f0 0x7f9e380afb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:12.639 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:12.635+0000 7f9e3d19c700 1 -- 172.21.15.50:0/1377546605 >> v1:172.21.15.50:6789/0 conn(0x7f9e381595c0 legacy=0x7f9e380b1220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:12.639 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:12.635+0000 7f9e3d19c700 1 -- 172.21.15.50:0/1377546605 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e3815d050 con 0x7f9e380b0060 2023-10-06T01:22:12.639 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:12.635+0000 7f9e3d19c700 1 --2- 172.21.15.50:0/1377546605 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9e380b0060 0x7f9e380b1930 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f9e30009e90 tx=0x7f9e30009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8cd17f14e898d70f server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:22:12.639 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:12.636+0000 7f9e377fe700 1 -- 172.21.15.50:0/1377546605 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e3000e070 con 0x7f9e380b0060 2023-10-06T01:22:12.639 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:12.636+0000 7f9e377fe700 1 -- 172.21.15.50:0/1377546605 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e3000bbf0 con 0x7f9e380b0060 2023-10-06T01:22:12.640 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:12.636+0000 7f9e377fe700 1 -- 172.21.15.50:0/1377546605 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e30012430 con 0x7f9e380b0060 2023-10-06T01:22:12.640 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:12.636+0000 7f9e3d99d700 1 -- 172.21.15.50:0/1377546605 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9e380b0060 msgr2=0x7f9e380b1930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:12.640 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:12.636+0000 7f9e3d99d700 1 --2- 172.21.15.50:0/1377546605 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9e380b0060 0x7f9e380b1930 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f9e30009e90 tx=0x7f9e30009780 comp rx=0 tx=0).stop 2023-10-06T01:22:12.640 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:12.636+0000 7f9e3d99d700 1 -- 172.21.15.50:0/1377546605 shutdown_connections 2023-10-06T01:22:12.640 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:12.636+0000 7f9e3d99d700 1 --2- 172.21.15.50:0/1377546605 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9e380b0060 0x7f9e380b1930 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:12.640 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:12.636+0000 7f9e3d99d700 1 --2- 172.21.15.50:0/1377546605 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9e381591f0 0x7f9e380afb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:12.640 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:12.636+0000 7f9e3d99d700 1 -- 172.21.15.50:0/1377546605 >> 172.21.15.50:0/1377546605 conn(0x7f9e380675f0 msgr2=0x7f9e380679f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:22:12.640 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:12.636+0000 7f9e3d99d700 1 -- 172.21.15.50:0/1377546605 shutdown_connections 2023-10-06T01:22:12.640 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:12.636+0000 7f9e3d99d700 1 -- 172.21.15.50:0/1377546605 wait complete. 2023-10-06T01:22:12.641 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:12.638+0000 7f9e3d99d700 1 Processor -- start 2023-10-06T01:22:12.641 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:12.638+0000 7f9e3d99d700 1 -- start start 2023-10-06T01:22:12.643 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:12.639+0000 7f9e3d99d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9e380b0060 0x7f9e3815a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:12.643 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:12.639+0000 7f9e3d99d700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9e381591f0 0x7f9e380c9220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:12.643 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:12.639+0000 7f9e3d99d700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9e381595c0 0x7f9e38151af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:12.643 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:12.639+0000 7f9e3d99d700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e38169430 con 0x7f9e380b0060 2023-10-06T01:22:12.643 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:12.639+0000 7f9e3d99d700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e3815aa10 con 0x7f9e381591f0 2023-10-06T01:22:12.643 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:12.639+0000 7f9e3d99d700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e3815acf0 con 0x7f9e381595c0 2023-10-06T01:22:12.643 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:12.639+0000 7f9e3c99b700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9e380b0060 0x7f9e3815a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:12.643 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:12.639+0000 7f9e3c99b700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9e380b0060 0x7f9e3815a430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:37338/0 (socket says 172.21.15.50:37338) 2023-10-06T01:22:12.644 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:12.639+0000 7f9e3c99b700 1 -- 172.21.15.50:0/1618442356 learned_addr learned my addr 172.21.15.50:0/1618442356 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-06T01:22:12.644 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:12.639+0000 7f9e37fff700 1 --2- 172.21.15.50:0/1618442356 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9e381591f0 0x7f9e380c9220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:12.644 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:12.639+0000 7f9e3d19c700 1 --2- 172.21.15.50:0/1618442356 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9e381595c0 0x7f9e38151af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:12.644 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:12.639+0000 7f9e3c99b700 1 -- 172.21.15.50:0/1618442356 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9e381595c0 msgr2=0x7f9e38151af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:12.644 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:12.639+0000 7f9e3c99b700 1 --2- 172.21.15.50:0/1618442356 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9e381595c0 0x7f9e38151af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:12.644 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:12.639+0000 7f9e3c99b700 1 -- 172.21.15.50:0/1618442356 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9e381591f0 msgr2=0x7f9e380c9220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:12.644 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:12.639+0000 7f9e3c99b700 1 --2- 172.21.15.50:0/1618442356 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9e381591f0 0x7f9e380c9220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:12.644 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:12.639+0000 7f9e3c99b700 1 -- 172.21.15.50:0/1618442356 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e30009a20 con 0x7f9e380b0060 2023-10-06T01:22:12.644 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:12.639+0000 7f9e3d19c700 1 --2- 172.21.15.50:0/1618442356 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9e381595c0 0x7f9e38151af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T01:22:12.644 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:12.639+0000 7f9e37fff700 1 --2- 172.21.15.50:0/1618442356 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9e381591f0 0x7f9e380c9220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T01:22:12.645 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:12.640+0000 7f9e3c99b700 1 --2- 172.21.15.50:0/1618442356 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9e380b0060 0x7f9e3815a430 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f9e2c00d890 tx=0x7f9e2c008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:22:12.645 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:12.640+0000 7f9e34ff9700 1 -- 172.21.15.50:0/1618442356 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e2c00b600 con 0x7f9e380b0060 2023-10-06T01:22:12.645 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:12.640+0000 7f9e34ff9700 1 -- 172.21.15.50:0/1618442356 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e2c00b760 con 0x7f9e380b0060 2023-10-06T01:22:12.645 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:12.640+0000 7f9e34ff9700 1 -- 172.21.15.50:0/1618442356 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e2c00bae0 con 0x7f9e380b0060 2023-10-06T01:22:12.645 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:12.640+0000 7f9e3d99d700 1 -- 172.21.15.50:0/1618442356 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9e3815afd0 con 0x7f9e380b0060 2023-10-06T01:22:12.645 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:12.640+0000 7f9e3d99d700 1 -- 172.21.15.50:0/1618442356 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9e380c9760 con 0x7f9e380b0060 2023-10-06T01:22:12.645 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:12.641+0000 7f9e3d99d700 1 -- 172.21.15.50:0/1618442356 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9e38169570 con 0x7f9e380b0060 2023-10-06T01:22:12.645 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:12.642+0000 7f9e34ff9700 1 -- 172.21.15.50:0/1618442356 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f9e2c01e460 con 0x7f9e380b0060 2023-10-06T01:22:12.646 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:12.643+0000 7f9e34ff9700 1 --2- 172.21.15.50:0/1618442356 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f9e1c066f30 0x7f9e1c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:12.646 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:12.643+0000 7f9e34ff9700 1 -- 172.21.15.50:0/1618442356 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f9e2c085030 con 0x7f9e380b0060 2023-10-06T01:22:12.646 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:12.643+0000 7f9e37fff700 1 --2- 172.21.15.50:0/1618442356 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f9e1c066f30 0x7f9e1c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:12.646 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:12.644+0000 7f9e37fff700 1 --2- 172.21.15.50:0/1618442356 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f9e1c066f30 0x7f9e1c0693e0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f9e381599f0 tx=0x7f9e24009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:22:12.649 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:12.647+0000 7f9e34ff9700 1 -- 172.21.15.50:0/1618442356 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f9e2c051e50 con 0x7f9e380b0060 2023-10-06T01:22:12.901 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:12.900+0000 7f9e3d99d700 1 -- 172.21.15.50:0/1618442356 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f9e38169780 con 0x7f9e380b0060 2023-10-06T01:22:12.901 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:12.901+0000 7f9e34ff9700 1 -- 172.21.15.50:0/1618442356 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4593 (secure 0 0 0) 0x7f9e2c055470 con 0x7f9e380b0060 2023-10-06T01:22:12.902 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-10-06T01:22:12.902 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4214,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6835/33654067","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6833","nonce":33654067},{"type":"v1","addr":"172.21.15.50:6835","nonce":33654067}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4279,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6836/2571345069","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":2571345069},{"type":"v1","addr":"172.21.15.155:6836","nonce":2571345069}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4290,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6834/4140731341","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6832","nonce":4140731341},{"type":"v1","addr":"172.21.15.50:6834","nonce":4140731341}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T01:21:36.779774+0000","modified":"2023-10-06T01:21:58.876370+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4302},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4302":{"gid":4302,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.155:6837/3434423585","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6835","nonce":3434423585},{"type":"v1","addr":"172.21.15.155:6837","nonce":3434423585}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2023-10-06T01:22:12.904 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:12.903+0000 7f9e3d99d700 1 -- 172.21.15.50:0/1618442356 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f9e1c066f30 msgr2=0x7f9e1c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:12.904 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:12.903+0000 7f9e3d99d700 1 --2- 172.21.15.50:0/1618442356 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f9e1c066f30 0x7f9e1c0693e0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f9e381599f0 tx=0x7f9e24009040 comp rx=0 tx=0).stop 2023-10-06T01:22:12.904 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:12.903+0000 7f9e3d99d700 1 -- 172.21.15.50:0/1618442356 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9e380b0060 msgr2=0x7f9e3815a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:12.905 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:12.903+0000 7f9e3d99d700 1 --2- 172.21.15.50:0/1618442356 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9e380b0060 0x7f9e3815a430 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f9e2c00d890 tx=0x7f9e2c008040 comp rx=0 tx=0).stop 2023-10-06T01:22:12.905 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:12.903+0000 7f9e3d99d700 1 -- 172.21.15.50:0/1618442356 shutdown_connections 2023-10-06T01:22:12.905 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:12.903+0000 7f9e3d99d700 1 --2- 172.21.15.50:0/1618442356 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9e381595c0 0x7f9e38151af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:12.905 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:12.903+0000 7f9e3d99d700 1 --2- 172.21.15.50:0/1618442356 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9e380b0060 0x7f9e3815a430 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:12.905 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:12.903+0000 7f9e3d99d700 1 --2- 172.21.15.50:0/1618442356 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f9e1c066f30 0x7f9e1c0693e0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:12.905 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:12.903+0000 7f9e3d99d700 1 --2- 172.21.15.50:0/1618442356 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9e381591f0 0x7f9e380c9220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:12.905 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:12.903+0000 7f9e3d99d700 1 -- 172.21.15.50:0/1618442356 >> 172.21.15.50:0/1618442356 conn(0x7f9e380675f0 msgr2=0x7f9e380af7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:22:12.905 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:12.903+0000 7f9e3d99d700 1 -- 172.21.15.50:0/1618442356 shutdown_connections 2023-10-06T01:22:12.905 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:12.903+0000 7f9e3d99d700 1 -- 172.21.15.50:0/1618442356 wait complete. 2023-10-06T01:22:12.906 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 9 2023-10-06T01:22:12.921 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T01:22:13.108 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:13.107+0000 7f719319d700 1 Processor -- start 2023-10-06T01:22:13.108 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:13.107+0000 7f719319d700 1 -- start start 2023-10-06T01:22:13.112 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:13.108+0000 7f719319d700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f718c06a5d0 0x7f718c153730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:13.112 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:13.108+0000 7f719319d700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f718c06a9a0 0x7f718c153c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:13.112 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:13.108+0000 7f719319d700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f718c0c9d00 con 0x7f718c06df90 2023-10-06T01:22:13.112 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:13.108+0000 7f719319d700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f718c06f5a0 con 0x7f718c06a5d0 2023-10-06T01:22:13.112 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:13.108+0000 7f719319d700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f718c06eb00 con 0x7f718c06a9a0 2023-10-06T01:22:13.112 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:13.109+0000 7f719299c700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f718c06df90 0x7f718c06e3f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:56750/0 (socket says 172.21.15.50:56750) 2023-10-06T01:22:13.112 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:13.109+0000 7f719299c700 1 -- 172.21.15.50:0/3061830447 learned_addr learned my addr 172.21.15.50:0/3061830447 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-10-06T01:22:13.113 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:13.109+0000 7f719219b700 1 --2- 172.21.15.50:0/3061830447 >> v2:172.21.15.155:3300/0 conn(0x7f718c06a5d0 0x7f718c153730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:13.113 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:13.109+0000 7f719199a700 1 --2- 172.21.15.50:0/3061830447 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f718c06a9a0 0x7f718c153c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:13.113 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:13.109+0000 7f7191199700 1 -- 172.21.15.50:0/3061830447 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 363521475 0 0) 0x7f718c0c9d00 con 0x7f718c06df90 2023-10-06T01:22:13.113 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:13.109+0000 7f7191199700 1 -- 172.21.15.50:0/3061830447 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7178003570 con 0x7f718c06df90 2023-10-06T01:22:13.113 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:13.109+0000 7f7191199700 1 -- 172.21.15.50:0/3061830447 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3669857640 0 0) 0x7f7178003570 con 0x7f718c06df90 2023-10-06T01:22:13.113 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:13.109+0000 7f7191199700 1 -- 172.21.15.50:0/3061830447 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f718c06a9a0 msgr2=0x7f718c153c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:22:13.113 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:13.109+0000 7f7191199700 1 --2- 172.21.15.50:0/3061830447 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f718c06a9a0 0x7f718c153c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:13.113 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:13.109+0000 7f7191199700 1 -- 172.21.15.50:0/3061830447 >> v2:172.21.15.155:3300/0 conn(0x7f718c06a5d0 msgr2=0x7f718c153730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:22:13.114 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:13.109+0000 7f7191199700 1 --2- 172.21.15.50:0/3061830447 >> v2:172.21.15.155:3300/0 conn(0x7f718c06a5d0 0x7f718c153730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:13.114 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:13.109+0000 7f7191199700 1 -- 172.21.15.50:0/3061830447 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f718c0c6750 con 0x7f718c06df90 2023-10-06T01:22:13.114 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:13.109+0000 7f7191199700 1 -- 172.21.15.50:0/3061830447 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 347519148 0 0) 0x7f71840017f0 con 0x7f718c06df90 2023-10-06T01:22:13.114 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:13.109+0000 7f7191199700 1 -- 172.21.15.50:0/3061830447 >> v1:172.21.15.50:6789/0 conn(0x7f718c06df90 legacy=0x7f718c06e3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:13.114 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:13.110+0000 7f7191199700 1 --2- 172.21.15.50:0/3061830447 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7178003a90 0x7f7178003ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:13.114 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:13.110+0000 7f7191199700 1 --2- 172.21.15.50:0/3061830447 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7178004810 0x7f7178004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:13.114 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:13.110+0000 7f7191199700 1 --2- 172.21.15.50:0/3061830447 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f718c06a9a0 0x7f71780051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:13.114 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:13.110+0000 7f7191199700 1 -- 172.21.15.50:0/3061830447 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f718c06f5a0 con 0x7f7178003a90 2023-10-06T01:22:13.114 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:13.110+0000 7f7191199700 1 -- 172.21.15.50:0/3061830447 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f718c06eb00 con 0x7f7178004810 2023-10-06T01:22:13.114 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:13.110+0000 7f7191199700 1 -- 172.21.15.50:0/3061830447 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f717800ba60 con 0x7f718c06a9a0 2023-10-06T01:22:13.115 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:13.110+0000 7f719219b700 1 --2- 172.21.15.50:0/3061830447 >> v2:172.21.15.155:3300/0 conn(0x7f718c06a5d0 0x7f718c153730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T01:22:13.115 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:13.110+0000 7f719219b700 1 --2- 172.21.15.50:0/3061830447 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7178003a90 0x7f7178003ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:13.115 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:13.110+0000 7f719299c700 1 --2- 172.21.15.50:0/3061830447 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f718c06a9a0 0x7f71780051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:13.115 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:13.110+0000 7f719199a700 1 --2- 172.21.15.50:0/3061830447 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7178004810 0x7f7178004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:13.115 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:13.110+0000 7f719219b700 1 -- 172.21.15.50:0/3061830447 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f718c06a9a0 msgr2=0x7f71780051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:22:13.115 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:13.110+0000 7f719219b700 1 --2- 172.21.15.50:0/3061830447 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f718c06a9a0 0x7f71780051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:13.115 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:13.110+0000 7f719219b700 1 -- 172.21.15.50:0/3061830447 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7178004810 msgr2=0x7f7178004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:22:13.116 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:13.110+0000 7f719219b700 1 --2- 172.21.15.50:0/3061830447 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7178004810 0x7f7178004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:13.116 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:13.110+0000 7f719219b700 1 -- 172.21.15.50:0/3061830447 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7178003570 con 0x7f7178003a90 2023-10-06T01:22:13.116 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:13.111+0000 7f719219b700 1 --2- 172.21.15.50:0/3061830447 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7178003a90 0x7f7178003ea0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f7188009de0 tx=0x7f71880091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=35547639a2ed255 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:22:13.116 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:13.111+0000 7f7191199700 1 -- 172.21.15.50:0/3061830447 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f718800e920 con 0x7f7178003a90 2023-10-06T01:22:13.116 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:13.111+0000 7f7191199700 1 -- 172.21.15.50:0/3061830447 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f718800ea80 con 0x7f7178003a90 2023-10-06T01:22:13.116 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:13.111+0000 7f7191199700 1 -- 172.21.15.50:0/3061830447 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f718800ee20 con 0x7f7178003a90 2023-10-06T01:22:13.120 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:13.111+0000 7f719319d700 1 -- 172.21.15.50:0/3061830447 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7178003a90 msgr2=0x7f7178003ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:13.120 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:13.111+0000 7f719319d700 1 --2- 172.21.15.50:0/3061830447 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7178003a90 0x7f7178003ea0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f7188009de0 tx=0x7f71880091a0 comp rx=0 tx=0).stop 2023-10-06T01:22:13.121 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:13.111+0000 7f719299c700 1 -- 172.21.15.50:0/3061830447 reap_dead start 2023-10-06T01:22:13.121 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:13.112+0000 7f719319d700 1 -- 172.21.15.50:0/3061830447 shutdown_connections 2023-10-06T01:22:13.121 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:13.112+0000 7f719319d700 1 -- 172.21.15.50:0/3061830447 >> 172.21.15.50:0/3061830447 conn(0x7f718c0680c0 msgr2=0x7f718c0cbf00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:22:13.121 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:13.112+0000 7f719319d700 1 -- 172.21.15.50:0/3061830447 shutdown_connections 2023-10-06T01:22:13.121 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:13.112+0000 7f719319d700 1 -- 172.21.15.50:0/3061830447 wait complete. 2023-10-06T01:22:13.121 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:13.113+0000 7f719319d700 1 Processor -- start 2023-10-06T01:22:13.121 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:13.113+0000 7f719319d700 1 -- start start 2023-10-06T01:22:13.122 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:13.114+0000 7f719319d700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7178003a90 0x7f718c15bf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:13.122 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:13.114+0000 7f719319d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f718c158c80 0x7f718c14d160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:13.122 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:13.114+0000 7f719319d700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f718c167700 0x7f718c159ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:13.122 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:13.114+0000 7f719319d700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f718c1566f0 con 0x7f718c158c80 2023-10-06T01:22:13.122 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:13.114+0000 7f719319d700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f718c157270 con 0x7f7178003a90 2023-10-06T01:22:13.122 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:13.114+0000 7f719319d700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f718c156940 con 0x7f718c167700 2023-10-06T01:22:13.122 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:13.114+0000 7f719199a700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f718c158c80 0x7f718c14d160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:13.122 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:13.114+0000 7f719199a700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f718c158c80 0x7f718c14d160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:37352/0 (socket says 172.21.15.50:37352) 2023-10-06T01:22:13.123 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:13.114+0000 7f719199a700 1 -- 172.21.15.50:0/1934425279 learned_addr learned my addr 172.21.15.50:0/1934425279 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-06T01:22:13.123 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:13.115+0000 7f719219b700 1 --2- 172.21.15.50:0/1934425279 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7178003a90 0x7f718c15bf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:13.123 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:13.115+0000 7f719299c700 1 --2- 172.21.15.50:0/1934425279 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f718c167700 0x7f718c159ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:13.123 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:13.115+0000 7f719199a700 1 -- 172.21.15.50:0/1934425279 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f718c167700 msgr2=0x7f718c159ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:13.123 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:13.115+0000 7f719199a700 1 --2- 172.21.15.50:0/1934425279 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f718c167700 0x7f718c159ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:13.123 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:13.115+0000 7f719199a700 1 -- 172.21.15.50:0/1934425279 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7178003a90 msgr2=0x7f718c15bf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:13.124 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:13.115+0000 7f719199a700 1 --2- 172.21.15.50:0/1934425279 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7178003a90 0x7f718c15bf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:13.124 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:13.115+0000 7f719199a700 1 -- 172.21.15.50:0/1934425279 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f718c156c20 con 0x7f718c158c80 2023-10-06T01:22:13.124 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:13.115+0000 7f719299c700 1 --2- 172.21.15.50:0/1934425279 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f718c167700 0x7f718c159ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T01:22:13.124 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:13.115+0000 7f719219b700 1 --2- 172.21.15.50:0/1934425279 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7178003a90 0x7f718c15bf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T01:22:13.124 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:13.115+0000 7f719199a700 1 --2- 172.21.15.50:0/1934425279 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f718c158c80 0x7f718c14d160 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f717c011d40 tx=0x7f717c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:22:13.124 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:13.115+0000 7f71827fc700 1 -- 172.21.15.50:0/1934425279 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f717c00fac0 con 0x7f718c158c80 2023-10-06T01:22:13.124 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:13.115+0000 7f71827fc700 1 -- 172.21.15.50:0/1934425279 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f717c00fc20 con 0x7f718c158c80 2023-10-06T01:22:13.125 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:13.115+0000 7f71827fc700 1 -- 172.21.15.50:0/1934425279 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f717c014440 con 0x7f718c158c80 2023-10-06T01:22:13.125 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:13.115+0000 7f719319d700 1 -- 172.21.15.50:0/1934425279 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f718c156f00 con 0x7f718c158c80 2023-10-06T01:22:13.125 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:13.115+0000 7f719319d700 1 -- 172.21.15.50:0/1934425279 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f718c1590f0 con 0x7f718c158c80 2023-10-06T01:22:13.125 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:13.116+0000 7f719319d700 1 -- 172.21.15.50:0/1934425279 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f718c1573e0 con 0x7f718c158c80 2023-10-06T01:22:13.125 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:13.117+0000 7f71827fc700 1 -- 172.21.15.50:0/1934425279 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f717c014870 con 0x7f718c158c80 2023-10-06T01:22:13.125 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:13.118+0000 7f71827fc700 1 --2- 172.21.15.50:0/1934425279 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f7170066f30 0x7f71700693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:13.126 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:13.118+0000 7f71827fc700 1 -- 172.21.15.50:0/1934425279 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f717c018030 con 0x7f718c158c80 2023-10-06T01:22:13.126 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:13.118+0000 7f719219b700 1 --2- 172.21.15.50:0/1934425279 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f7170066f30 0x7f71700693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:13.126 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:13.119+0000 7f719219b700 1 --2- 172.21.15.50:0/1934425279 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f7170066f30 0x7f71700693e0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f718c16abe0 tx=0x7f7188019000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:22:13.127 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:13.122+0000 7f71827fc700 1 -- 172.21.15.50:0/1934425279 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f717c052350 con 0x7f718c158c80 2023-10-06T01:22:13.327 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:13.326+0000 7f719319d700 1 -- 172.21.15.50:0/1934425279 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f718c05f270 con 0x7f718c158c80 2023-10-06T01:22:13.328 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:13.327+0000 7f71827fc700 1 -- 172.21.15.50:0/1934425279 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+18707 (secure 0 0 0) 0x7f717c055970 con 0x7f718c158c80 2023-10-06T01:22:13.329 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-10-06T01:22:13.329 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":25,"fsid":"0bfd9a6b-1587-4fe4-a89e-e43c00286b4e","created":"2023-10-06T01:21:16.828801+0000","modified":"2023-10-06T01:21:41.329781+0000","last_up_change":"2023-10-06T01:21:28.584523+0000","last_in_change":"2023-10-06T01:21:20.179863+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-10-06T01:21:29.304225+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":".mgr","create_time":"2023-10-06T01:21:29.835490+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-06T01:21:34.675315+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-06T01:21:35.753991+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-10-06T01:21:38.853108+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"9060727a-3959-4de3-8363-c5c5d7826c9a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":87837},{"type":"v1","addr":"172.21.15.50:6801","nonce":87837}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":87837},{"type":"v1","addr":"172.21.15.50:6803","nonce":87837}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":87837},{"type":"v1","addr":"172.21.15.50:6807","nonce":87837}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":87837},{"type":"v1","addr":"172.21.15.50:6805","nonce":87837}]},"public_addr":"172.21.15.50:6801/87837","cluster_addr":"172.21.15.50:6803/87837","heartbeat_back_addr":"172.21.15.50:6807/87837","heartbeat_front_addr":"172.21.15.50:6805/87837","state":["exists","up"]},{"osd":1,"uuid":"5ad9ef12-b579-47ea-b690-90ba887e2cef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":87853},{"type":"v1","addr":"172.21.15.50:6809","nonce":87853}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":87853},{"type":"v1","addr":"172.21.15.50:6811","nonce":87853}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":87853},{"type":"v1","addr":"172.21.15.50:6815","nonce":87853}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":87853},{"type":"v1","addr":"172.21.15.50:6813","nonce":87853}]},"public_addr":"172.21.15.50:6809/87853","cluster_addr":"172.21.15.50:6811/87853","heartbeat_back_addr":"172.21.15.50:6815/87853","heartbeat_front_addr":"172.21.15.50:6813/87853","state":["exists","up"]},{"osd":2,"uuid":"c7aee044-6f75-436f-90e1-ba42a57359bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6821","nonce":87855},{"type":"v1","addr":"172.21.15.50:6822","nonce":87855}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6824","nonce":87855},{"type":"v1","addr":"172.21.15.50:6826","nonce":87855}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":87855},{"type":"v1","addr":"172.21.15.50:6831","nonce":87855}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":87855},{"type":"v1","addr":"172.21.15.50:6829","nonce":87855}]},"public_addr":"172.21.15.50:6822/87855","cluster_addr":"172.21.15.50:6826/87855","heartbeat_back_addr":"172.21.15.50:6831/87855","heartbeat_front_addr":"172.21.15.50:6829/87855","state":["exists","up"]},{"osd":3,"uuid":"d9b901c8-e8b2-44af-9508-f453120a96c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":87856},{"type":"v1","addr":"172.21.15.50:6817","nonce":87856}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":87856},{"type":"v1","addr":"172.21.15.50:6819","nonce":87856}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6825","nonce":87856},{"type":"v1","addr":"172.21.15.50:6827","nonce":87856}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6820","nonce":87856},{"type":"v1","addr":"172.21.15.50:6823","nonce":87856}]},"public_addr":"172.21.15.50:6817/87856","cluster_addr":"172.21.15.50:6819/87856","heartbeat_back_addr":"172.21.15.50:6827/87856","heartbeat_front_addr":"172.21.15.50:6823/87856","state":["exists","up"]},{"osd":4,"uuid":"2b3c6b38-e3e9-4301-9445-60fd3fe8ce03","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":85805},{"type":"v1","addr":"172.21.15.155:6801","nonce":85805}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":85805},{"type":"v1","addr":"172.21.15.155:6803","nonce":85805}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6806","nonce":85805},{"type":"v1","addr":"172.21.15.155:6807","nonce":85805}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6804","nonce":85805},{"type":"v1","addr":"172.21.15.155:6805","nonce":85805}]},"public_addr":"172.21.15.155:6801/85805","cluster_addr":"172.21.15.155:6803/85805","heartbeat_back_addr":"172.21.15.155:6807/85805","heartbeat_front_addr":"172.21.15.155:6805/85805","state":["exists","up"]},{"osd":5,"uuid":"417b5f8f-65f1-4c94-91a7-a6ce03fe1679","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6816","nonce":85807},{"type":"v1","addr":"172.21.15.155:6818","nonce":85807}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6820","nonce":85807},{"type":"v1","addr":"172.21.15.155:6822","nonce":85807}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6828","nonce":85807},{"type":"v1","addr":"172.21.15.155:6830","nonce":85807}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6824","nonce":85807},{"type":"v1","addr":"172.21.15.155:6826","nonce":85807}]},"public_addr":"172.21.15.155:6818/85807","cluster_addr":"172.21.15.155:6822/85807","heartbeat_back_addr":"172.21.15.155:6830/85807","heartbeat_front_addr":"172.21.15.155:6826/85807","state":["exists","up"]},{"osd":6,"uuid":"c150cff3-aee4-4714-9c08-d182b1ba9ffd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6808","nonce":85806},{"type":"v1","addr":"172.21.15.155:6809","nonce":85806}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6810","nonce":85806},{"type":"v1","addr":"172.21.15.155:6811","nonce":85806}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6814","nonce":85806},{"type":"v1","addr":"172.21.15.155:6815","nonce":85806}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6812","nonce":85806},{"type":"v1","addr":"172.21.15.155:6813","nonce":85806}]},"public_addr":"172.21.15.155:6809/85806","cluster_addr":"172.21.15.155:6811/85806","heartbeat_back_addr":"172.21.15.155:6815/85806","heartbeat_front_addr":"172.21.15.155:6813/85806","state":["exists","up"]},{"osd":7,"uuid":"71107f0e-04d1-4e72-a0ec-0faf6af003e7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6817","nonce":85832},{"type":"v1","addr":"172.21.15.155:6819","nonce":85832}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6821","nonce":85832},{"type":"v1","addr":"172.21.15.155:6823","nonce":85832}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6829","nonce":85832},{"type":"v1","addr":"172.21.15.155:6831","nonce":85832}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6825","nonce":85832},{"type":"v1","addr":"172.21.15.155:6827","nonce":85832}]},"public_addr":"172.21.15.155:6819/85832","cluster_addr":"172.21.15.155:6823/85832","heartbeat_back_addr":"172.21.15.155:6831/85832","heartbeat_front_addr":"172.21.15.155:6827/85832","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:21:25.423389+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:21:25.472661+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:21:25.817562+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:21:25.551257+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:21:25.407818+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:21:25.557976+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:21:25.747299+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:21:25.827576+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T01:22:13.331 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:13.330+0000 7f719319d700 1 -- 172.21.15.50:0/1934425279 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f7170066f30 msgr2=0x7f71700693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:13.331 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:13.330+0000 7f719319d700 1 --2- 172.21.15.50:0/1934425279 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f7170066f30 0x7f71700693e0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f718c16abe0 tx=0x7f7188019000 comp rx=0 tx=0).stop 2023-10-06T01:22:13.331 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:13.330+0000 7f719319d700 1 -- 172.21.15.50:0/1934425279 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f718c158c80 msgr2=0x7f718c14d160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:13.331 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:13.330+0000 7f719319d700 1 --2- 172.21.15.50:0/1934425279 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f718c158c80 0x7f718c14d160 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f717c011d40 tx=0x7f717c0091a0 comp rx=0 tx=0).stop 2023-10-06T01:22:13.331 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:13.330+0000 7f719319d700 1 -- 172.21.15.50:0/1934425279 shutdown_connections 2023-10-06T01:22:13.331 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:13.330+0000 7f719319d700 1 --2- 172.21.15.50:0/1934425279 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f718c167700 0x7f718c159ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:13.332 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:13.330+0000 7f719319d700 1 --2- 172.21.15.50:0/1934425279 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f7170066f30 0x7f71700693e0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:13.332 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:13.330+0000 7f719319d700 1 --2- 172.21.15.50:0/1934425279 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7178003a90 0x7f718c15bf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:13.332 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:13.330+0000 7f719319d700 1 --2- 172.21.15.50:0/1934425279 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f718c158c80 0x7f718c14d160 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:13.332 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:13.330+0000 7f719319d700 1 -- 172.21.15.50:0/1934425279 >> 172.21.15.50:0/1934425279 conn(0x7f718c0680c0 msgr2=0x7f718c0afdc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:22:13.332 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:13.330+0000 7f719319d700 1 -- 172.21.15.50:0/1934425279 shutdown_connections 2023-10-06T01:22:13.332 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:13.330+0000 7f719319d700 1 -- 172.21.15.50:0/1934425279 wait complete. 2023-10-06T01:22:13.349 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T01:22:13.536 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:13.535+0000 7f85e959d700 1 Processor -- start 2023-10-06T01:22:13.537 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:13.536+0000 7f85e959d700 1 -- start start 2023-10-06T01:22:13.538 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:13.537+0000 7f85e959d700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f85e41407b0 0x7f85e406d250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:13.538 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:13.537+0000 7f85e959d700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f85e4140b80 0x7f85e40aecc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:13.539 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:13.537+0000 7f85e959d700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f85e40af200 0x7f85e415adf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:13.539 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:13.537+0000 7f85e959d700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f85e40c6540 con 0x7f85e41407b0 2023-10-06T01:22:13.539 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:13.537+0000 7f85e959d700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f85e40c6820 con 0x7f85e40af200 2023-10-06T01:22:13.539 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:13.537+0000 7f85e959d700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85e40c6b00 con 0x7f85e4140b80 2023-10-06T01:22:13.539 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:13.537+0000 7f85e3fff700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f85e41407b0 0x7f85e406d250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:13.539 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:13.537+0000 7f85e3fff700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f85e41407b0 0x7f85e406d250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:37362/0 (socket says 172.21.15.50:37362) 2023-10-06T01:22:13.539 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:13.537+0000 7f85e3fff700 1 -- 172.21.15.50:0/2444650189 learned_addr learned my addr 172.21.15.50:0/2444650189 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-06T01:22:13.539 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:13.537+0000 7f85e37fe700 1 --2- 172.21.15.50:0/2444650189 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f85e4140b80 0x7f85e40aecc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:13.539 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:13.537+0000 7f85e8d9c700 1 --2- 172.21.15.50:0/2444650189 >> v2:172.21.15.155:3300/0 conn(0x7f85e40af200 0x7f85e415adf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:13.539 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:13.538+0000 7f85e3fff700 1 -- 172.21.15.50:0/2444650189 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f85e4140b80 msgr2=0x7f85e40aecc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:22:13.539 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:13.538+0000 7f85e3fff700 1 --2- 172.21.15.50:0/2444650189 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f85e4140b80 0x7f85e40aecc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:13.540 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:13.538+0000 7f85e3fff700 1 -- 172.21.15.50:0/2444650189 >> v2:172.21.15.155:3300/0 conn(0x7f85e40af200 msgr2=0x7f85e415adf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:22:13.540 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:13.538+0000 7f85e3fff700 1 --2- 172.21.15.50:0/2444650189 >> v2:172.21.15.155:3300/0 conn(0x7f85e40af200 0x7f85e415adf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:13.540 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:13.538+0000 7f85e3fff700 1 -- 172.21.15.50:0/2444650189 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85e40c6de0 con 0x7f85e41407b0 2023-10-06T01:22:13.540 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:13.538+0000 7f85e8d9c700 1 --2- 172.21.15.50:0/2444650189 >> v2:172.21.15.155:3300/0 conn(0x7f85e40af200 0x7f85e415adf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T01:22:13.540 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:13.538+0000 7f85e3fff700 1 --2- 172.21.15.50:0/2444650189 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f85e41407b0 0x7f85e406d250 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f85e40c8920 tx=0x7f85d4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7d171dd67cf52c0f server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:22:13.541 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:13.538+0000 7f85e2ffd700 1 -- 172.21.15.50:0/2444650189 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85d400b860 con 0x7f85e41407b0 2023-10-06T01:22:13.541 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:13.538+0000 7f85e2ffd700 1 -- 172.21.15.50:0/2444650189 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f85d400b9c0 con 0x7f85e41407b0 2023-10-06T01:22:13.541 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:13.538+0000 7f85e2ffd700 1 -- 172.21.15.50:0/2444650189 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85d400bd60 con 0x7f85e41407b0 2023-10-06T01:22:13.541 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:13.539+0000 7f85e959d700 1 -- 172.21.15.50:0/2444650189 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f85e41407b0 msgr2=0x7f85e406d250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:13.542 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:13.539+0000 7f85e959d700 1 --2- 172.21.15.50:0/2444650189 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f85e41407b0 0x7f85e406d250 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f85e40c8920 tx=0x7f85d4009250 comp rx=0 tx=0).stop 2023-10-06T01:22:13.542 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:13.539+0000 7f85e959d700 1 -- 172.21.15.50:0/2444650189 shutdown_connections 2023-10-06T01:22:13.542 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:13.539+0000 7f85e959d700 1 --2- 172.21.15.50:0/2444650189 >> v2:172.21.15.155:3300/0 conn(0x7f85e40af200 0x7f85e415adf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:13.542 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:13.539+0000 7f85e959d700 1 --2- 172.21.15.50:0/2444650189 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f85e41407b0 0x7f85e406d250 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:13.542 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:13.539+0000 7f85e959d700 1 --2- 172.21.15.50:0/2444650189 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f85e4140b80 0x7f85e40aecc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:13.542 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:13.539+0000 7f85e959d700 1 -- 172.21.15.50:0/2444650189 >> 172.21.15.50:0/2444650189 conn(0x7f85e40680c0 msgr2=0x7f85e40cbf00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:22:13.542 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:13.539+0000 7f85e959d700 1 -- 172.21.15.50:0/2444650189 shutdown_connections 2023-10-06T01:22:13.542 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:13.539+0000 7f85e959d700 1 -- 172.21.15.50:0/2444650189 wait complete. 2023-10-06T01:22:13.542 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:13.540+0000 7f85e959d700 1 Processor -- start 2023-10-06T01:22:13.542 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:13.540+0000 7f85e959d700 1 -- start start 2023-10-06T01:22:13.544 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:13.541+0000 7f85e959d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f85e40af200 0x7f85e4159990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:13.544 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:13.541+0000 7f85e959d700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f85e41407b0 0x7f85e40c1380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:13.544 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:13.541+0000 7f85e959d700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f85e40c2fb0 0x7f85e4169f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:13.544 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:13.541+0000 7f85e959d700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85e40c40c0 con 0x7f85e40af200 2023-10-06T01:22:13.544 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:13.541+0000 7f85e959d700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85e40c34b0 con 0x7f85e41407b0 2023-10-06T01:22:13.544 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:13.541+0000 7f85e959d700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85e40c3790 con 0x7f85e40c2fb0 2023-10-06T01:22:13.545 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:13.541+0000 7f85e3fff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f85e40af200 0x7f85e4159990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:13.545 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:13.541+0000 7f85e3fff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f85e40af200 0x7f85e4159990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:37368/0 (socket says 172.21.15.50:37368) 2023-10-06T01:22:13.545 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:13.541+0000 7f85e3fff700 1 -- 172.21.15.50:0/3058567799 learned_addr learned my addr 172.21.15.50:0/3058567799 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-06T01:22:13.545 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:13.542+0000 7f85e3fff700 1 -- 172.21.15.50:0/3058567799 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f85e40c2fb0 msgr2=0x7f85e4169f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:13.545 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:13.542+0000 7f85e3fff700 1 --2- 172.21.15.50:0/3058567799 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f85e40c2fb0 0x7f85e4169f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:13.545 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:13.542+0000 7f85e3fff700 1 -- 172.21.15.50:0/3058567799 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f85e41407b0 msgr2=0x7f85e40c1380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:13.545 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:13.542+0000 7f85e37fe700 1 --2- 172.21.15.50:0/3058567799 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f85e41407b0 0x7f85e40c1380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:13.545 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:13.542+0000 7f85e3fff700 1 --2- 172.21.15.50:0/3058567799 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f85e41407b0 0x7f85e40c1380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:13.545 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:13.542+0000 7f85e3fff700 1 -- 172.21.15.50:0/3058567799 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85d40094f0 con 0x7f85e40af200 2023-10-06T01:22:13.545 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:13.542+0000 7f85e3fff700 1 --2- 172.21.15.50:0/3058567799 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f85e40af200 0x7f85e4159990 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f85d4009290 tx=0x7f85d4017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:22:13.545 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:13.542+0000 7f85cbfff700 1 -- 172.21.15.50:0/3058567799 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85d4026480 con 0x7f85e40af200 2023-10-06T01:22:13.545 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:13.542+0000 7f85cbfff700 1 -- 172.21.15.50:0/3058567799 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f85d401f070 con 0x7f85e40af200 2023-10-06T01:22:13.546 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:13.542+0000 7f85cbfff700 1 -- 172.21.15.50:0/3058567799 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85d4026830 con 0x7f85e40af200 2023-10-06T01:22:13.546 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:13.543+0000 7f85e959d700 1 -- 172.21.15.50:0/3058567799 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f85e40c3a70 con 0x7f85e40af200 2023-10-06T01:22:13.546 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:13.543+0000 7f85e959d700 1 -- 172.21.15.50:0/3058567799 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f85e4159ed0 con 0x7f85e40af200 2023-10-06T01:22:13.547 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:13.544+0000 7f85e959d700 1 -- 172.21.15.50:0/3058567799 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f85e405f270 con 0x7f85e40af200 2023-10-06T01:22:13.547 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:13.545+0000 7f85cbfff700 1 -- 172.21.15.50:0/3058567799 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f85d4026ba0 con 0x7f85e40af200 2023-10-06T01:22:13.547 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:13.545+0000 7f85cbfff700 1 --2- 172.21.15.50:0/3058567799 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f85d0066f30 0x7f85d00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:13.547 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:13.546+0000 7f85cbfff700 1 -- 172.21.15.50:0/3058567799 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f85d4021070 con 0x7f85e40af200 2023-10-06T01:22:13.547 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:13.546+0000 7f85e37fe700 1 --2- 172.21.15.50:0/3058567799 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f85d0066f30 0x7f85d00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:13.547 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:13.547+0000 7f85e37fe700 1 --2- 172.21.15.50:0/3058567799 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f85d0066f30 0x7f85d00693e0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f85e406aed0 tx=0x7f85d8008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:22:13.551 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:13.550+0000 7f85cbfff700 1 -- 172.21.15.50:0/3058567799 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f85d4053730 con 0x7f85e40af200 2023-10-06T01:22:13.802 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:13.801+0000 7f85e959d700 1 -- 172.21.15.50:0/3058567799 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f85e40c70c0 con 0x7f85e40af200 2023-10-06T01:22:13.803 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:13.802+0000 7f85cbfff700 1 -- 172.21.15.50:0/3058567799 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4593 (secure 0 0 0) 0x7f85d4056d50 con 0x7f85e40af200 2023-10-06T01:22:13.803 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-10-06T01:22:13.803 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4214,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6835/33654067","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6833","nonce":33654067},{"type":"v1","addr":"172.21.15.50:6835","nonce":33654067}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4279,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6836/2571345069","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":2571345069},{"type":"v1","addr":"172.21.15.155:6836","nonce":2571345069}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4290,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6834/4140731341","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6832","nonce":4140731341},{"type":"v1","addr":"172.21.15.50:6834","nonce":4140731341}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T01:21:36.779774+0000","modified":"2023-10-06T01:21:58.876370+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4302},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4302":{"gid":4302,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.155:6837/3434423585","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6835","nonce":3434423585},{"type":"v1","addr":"172.21.15.155:6837","nonce":3434423585}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2023-10-06T01:22:13.805 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:13.804+0000 7f85e959d700 1 -- 172.21.15.50:0/3058567799 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f85d0066f30 msgr2=0x7f85d00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:13.806 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:13.804+0000 7f85e959d700 1 --2- 172.21.15.50:0/3058567799 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f85d0066f30 0x7f85d00693e0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f85e406aed0 tx=0x7f85d8008040 comp rx=0 tx=0).stop 2023-10-06T01:22:13.806 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:13.804+0000 7f85e959d700 1 -- 172.21.15.50:0/3058567799 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f85e40af200 msgr2=0x7f85e4159990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:13.806 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:13.804+0000 7f85e959d700 1 --2- 172.21.15.50:0/3058567799 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f85e40af200 0x7f85e4159990 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f85d4009290 tx=0x7f85d4017000 comp rx=0 tx=0).stop 2023-10-06T01:22:13.806 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:13.804+0000 7f85e959d700 1 -- 172.21.15.50:0/3058567799 shutdown_connections 2023-10-06T01:22:13.806 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:13.804+0000 7f85e959d700 1 --2- 172.21.15.50:0/3058567799 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f85e40c2fb0 0x7f85e4169f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:13.806 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:13.804+0000 7f85e959d700 1 --2- 172.21.15.50:0/3058567799 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f85e40af200 0x7f85e4159990 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:13.806 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:13.804+0000 7f85e959d700 1 --2- 172.21.15.50:0/3058567799 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f85d0066f30 0x7f85d00693e0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:13.806 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:13.804+0000 7f85e959d700 1 --2- 172.21.15.50:0/3058567799 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f85e41407b0 0x7f85e40c1380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:13.806 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:13.804+0000 7f85e959d700 1 -- 172.21.15.50:0/3058567799 >> 172.21.15.50:0/3058567799 conn(0x7f85e40680c0 msgr2=0x7f85e40b1600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:22:13.806 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:13.804+0000 7f85e959d700 1 -- 172.21.15.50:0/3058567799 shutdown_connections 2023-10-06T01:22:13.807 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:13.804+0000 7f85e959d700 1 -- 172.21.15.50:0/3058567799 wait complete. 2023-10-06T01:22:13.807 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 9 2023-10-06T01:22:14.225 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 9, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-10-06T01:21:36.779774+0000', 'modified': '2023-10-06T01:21:58.876370+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4302}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4302': {'gid': 4302, 'name': 'd', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.155:6837/3434423585', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.155:6835', 'nonce': 3434423585}, {'type': 'v1', 'addr': '172.21.15.155:6837', 'nonce': 3434423585}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138320759226367, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [4, 5], 'metadata_pool': 3, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2023-10-06T01:22:14.225 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-10-06T01:22:14.225 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.d status 2023-10-06T01:22:14.415 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:14.414+0000 7f6e53fff700 1 Processor -- start 2023-10-06T01:22:14.415 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:14.414+0000 7f6e53fff700 1 -- start start 2023-10-06T01:22:14.417 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:14.415+0000 7f6e53fff700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f6e54159480 0x7f6e540b30d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:14.417 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:14.415+0000 7f6e53fff700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f6e540b3610 0x7f6e540cbc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:14.418 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:14.415+0000 7f6e53fff700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6e540cb7e0 con 0x7f6e540cc1b0 2023-10-06T01:22:14.418 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:14.415+0000 7f6e53fff700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6e540b08a0 con 0x7f6e540b3610 2023-10-06T01:22:14.418 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:14.415+0000 7f6e53fff700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6e540cb190 con 0x7f6e54159480 2023-10-06T01:22:14.418 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:14.415+0000 7f6e527fc700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f6e540b3610 0x7f6e540cbc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:14.418 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:14.416+0000 7f6e537fe700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f6e540cc1b0 0x7f6e540b2140 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:56756/0 (socket says 172.21.15.50:56756) 2023-10-06T01:22:14.418 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:14.416+0000 7f6e527fc700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f6e540b3610 0x7f6e540cbc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:37382/0 (socket says 172.21.15.50:37382) 2023-10-06T01:22:14.418 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:14.416+0000 7f6e537fe700 1 -- 172.21.15.50:0/2550429212 learned_addr learned my addr 172.21.15.50:0/2550429212 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-10-06T01:22:14.418 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:14.416+0000 7f6e52ffd700 1 --2- 172.21.15.50:0/2550429212 >> v2:172.21.15.155:3300/0 conn(0x7f6e54159480 0x7f6e540b30d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:14.418 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:14.416+0000 7f6e527fc700 1 -- 172.21.15.50:0/2550429212 >> v2:172.21.15.155:3300/0 conn(0x7f6e54159480 msgr2=0x7f6e540b30d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:22:14.418 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:14.416+0000 7f6e527fc700 1 --2- 172.21.15.50:0/2550429212 >> v2:172.21.15.155:3300/0 conn(0x7f6e54159480 0x7f6e540b30d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:14.419 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:14.416+0000 7f6e527fc700 1 -- 172.21.15.50:0/2550429212 >> v1:172.21.15.50:6789/0 conn(0x7f6e540cc1b0 legacy=0x7f6e540b2140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:14.419 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:14.416+0000 7f6e527fc700 1 -- 172.21.15.50:0/2550429212 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e540cb470 con 0x7f6e540b3610 2023-10-06T01:22:14.419 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:14.416+0000 7f6e51ffb700 1 -- 172.21.15.50:0/2550429212 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1539385119 0 0) 0x7f6e540cb7e0 con 0x7f6e540cc1b0 2023-10-06T01:22:14.419 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:14.416+0000 7f6e527fc700 1 --2- 172.21.15.50:0/2550429212 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6e540b3610 0x7f6e540cbc70 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f6e5406fa30 tx=0x7f6e480091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b769de46b15b5eda server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:22:14.419 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:14.416+0000 7f6e51ffb700 1 -- 172.21.15.50:0/2550429212 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e4800b6b0 con 0x7f6e540b3610 2023-10-06T01:22:14.419 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:14.417+0000 7f6e51ffb700 1 -- 172.21.15.50:0/2550429212 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e4800b810 con 0x7f6e540b3610 2023-10-06T01:22:14.419 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:14.417+0000 7f6e51ffb700 1 -- 172.21.15.50:0/2550429212 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e4800bbb0 con 0x7f6e540b3610 2023-10-06T01:22:14.422 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:14.417+0000 7f6e53fff700 1 -- 172.21.15.50:0/2550429212 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6e540b3610 msgr2=0x7f6e540cbc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:14.422 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:14.417+0000 7f6e53fff700 1 --2- 172.21.15.50:0/2550429212 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6e540b3610 0x7f6e540cbc70 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f6e5406fa30 tx=0x7f6e480091a0 comp rx=0 tx=0).stop 2023-10-06T01:22:14.422 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:14.417+0000 7f6e53fff700 1 -- 172.21.15.50:0/2550429212 shutdown_connections 2023-10-06T01:22:14.422 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:14.417+0000 7f6e53fff700 1 --2- 172.21.15.50:0/2550429212 >> v2:172.21.15.155:3300/0 conn(0x7f6e54159480 0x7f6e540b30d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:14.422 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:14.417+0000 7f6e53fff700 1 --2- 172.21.15.50:0/2550429212 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6e540b3610 0x7f6e540cbc70 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:14.422 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:14.417+0000 7f6e53fff700 1 -- 172.21.15.50:0/2550429212 >> 172.21.15.50:0/2550429212 conn(0x7f6e5406ed20 msgr2=0x7f6e5406f120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:22:14.423 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:14.417+0000 7f6e53fff700 1 -- 172.21.15.50:0/2550429212 shutdown_connections 2023-10-06T01:22:14.423 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:14.417+0000 7f6e53fff700 1 -- 172.21.15.50:0/2550429212 wait complete. 2023-10-06T01:22:14.423 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:14.419+0000 7f6e53fff700 1 Processor -- start 2023-10-06T01:22:14.423 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:14.419+0000 7f6e53fff700 1 -- start start 2023-10-06T01:22:14.423 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:14.420+0000 7f6e53fff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6e540b3610 0x7f6e54169a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:14.423 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:14.420+0000 7f6e53fff700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6e540cc1b0 0x7f6e540cec60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:14.423 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:14.420+0000 7f6e53fff700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6e54159480 0x7f6e540cf1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:14.423 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:14.420+0000 7f6e53fff700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e5416a640 con 0x7f6e540b3610 2023-10-06T01:22:14.424 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:14.420+0000 7f6e53fff700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e5416a940 con 0x7f6e540cc1b0 2023-10-06T01:22:14.424 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:14.420+0000 7f6e53fff700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e5415b750 con 0x7f6e54159480 2023-10-06T01:22:14.424 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:14.420+0000 7f6e52ffd700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6e540b3610 0x7f6e54169a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:14.424 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:14.420+0000 7f6e52ffd700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6e540b3610 0x7f6e54169a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:37396/0 (socket says 172.21.15.50:37396) 2023-10-06T01:22:14.424 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:14.420+0000 7f6e52ffd700 1 -- 172.21.15.50:0/2642259087 learned_addr learned my addr 172.21.15.50:0/2642259087 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-06T01:22:14.424 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:14.420+0000 7f6e527fc700 1 --2- 172.21.15.50:0/2642259087 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6e540cc1b0 0x7f6e540cec60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:14.424 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:14.420+0000 7f6e537fe700 1 --2- 172.21.15.50:0/2642259087 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6e54159480 0x7f6e540cf1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:14.424 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:14.420+0000 7f6e52ffd700 1 -- 172.21.15.50:0/2642259087 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6e54159480 msgr2=0x7f6e540cf1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:14.424 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:14.420+0000 7f6e52ffd700 1 --2- 172.21.15.50:0/2642259087 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6e54159480 0x7f6e540cf1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:14.425 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:14.420+0000 7f6e52ffd700 1 -- 172.21.15.50:0/2642259087 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6e540cc1b0 msgr2=0x7f6e540cec60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:14.425 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:14.420+0000 7f6e52ffd700 1 --2- 172.21.15.50:0/2642259087 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6e540cc1b0 0x7f6e540cec60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:14.425 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:14.420+0000 7f6e52ffd700 1 -- 172.21.15.50:0/2642259087 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e48009420 con 0x7f6e540b3610 2023-10-06T01:22:14.425 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:14.420+0000 7f6e537fe700 1 --2- 172.21.15.50:0/2642259087 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6e54159480 0x7f6e540cf1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T01:22:14.425 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:14.420+0000 7f6e52ffd700 1 --2- 172.21.15.50:0/2642259087 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6e540b3610 0x7f6e54169a50 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f6e4400d860 tx=0x7f6e44008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:22:14.425 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:14.421+0000 7f6e3affd700 1 -- 172.21.15.50:0/2642259087 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e440125f0 con 0x7f6e540b3610 2023-10-06T01:22:14.425 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:14.421+0000 7f6e3affd700 1 -- 172.21.15.50:0/2642259087 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e44012750 con 0x7f6e540b3610 2023-10-06T01:22:14.425 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:14.421+0000 7f6e3affd700 1 -- 172.21.15.50:0/2642259087 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e44012b10 con 0x7f6e540b3610 2023-10-06T01:22:14.425 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:14.421+0000 7f6e53fff700 1 -- 172.21.15.50:0/2642259087 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6e5415b160 con 0x7f6e540b3610 2023-10-06T01:22:14.425 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:14.421+0000 7f6e53fff700 1 -- 172.21.15.50:0/2642259087 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6e540cfb10 con 0x7f6e540b3610 2023-10-06T01:22:14.426 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:14.423+0000 7f6e3affd700 1 -- 172.21.15.50:0/2642259087 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f6e4401e460 con 0x7f6e540b3610 2023-10-06T01:22:14.426 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:14.425+0000 7f6e3affd700 1 --2- 172.21.15.50:0/2642259087 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f6e40066f30 0x7f6e400693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:14.426 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:14.425+0000 7f6e3affd700 1 -- 172.21.15.50:0/2642259087 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f6e44084fc0 con 0x7f6e540b3610 2023-10-06T01:22:14.426 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:14.425+0000 7f6e527fc700 1 --2- 172.21.15.50:0/2642259087 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f6e40066f30 0x7f6e400693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:14.427 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:14.426+0000 7f6e527fc700 1 --2- 172.21.15.50:0/2642259087 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f6e40066f30 0x7f6e400693e0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f6e480093f0 tx=0x7f6e48017000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:22:14.427 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:14.427+0000 7f6e67ec7b80 1 Processor -- start 2023-10-06T01:22:14.427 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:14.427+0000 7f6e67ec7b80 1 -- start start 2023-10-06T01:22:14.429 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:14.428+0000 7f6e67ec7b80 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5610d0a0be50 0x5610d09e6cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:14.429 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:14.428+0000 7f6e67ec7b80 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x5610d09ec2c0 0x5610d09e7200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:14.430 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:14.428+0000 7f6e67ec7b80 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5610d09eda10 0x5610d09e7740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:14.430 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:14.428+0000 7f6e67ec7b80 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x5610d0941a70 con 0x5610d0a0be50 2023-10-06T01:22:14.430 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:14.428+0000 7f6e67ec7b80 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x5610d093f270 con 0x5610d09eda10 2023-10-06T01:22:14.430 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:14.428+0000 7f6e67ec7b80 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x5610d093b060 con 0x5610d09ec2c0 2023-10-06T01:22:14.430 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:14.428+0000 7f6e52ffd700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5610d0a0be50 0x5610d09e6cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:14.430 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:14.428+0000 7f6e52ffd700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5610d0a0be50 0x5610d09e6cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:37400/0 (socket says 172.21.15.50:37400) 2023-10-06T01:22:14.430 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:14.428+0000 7f6e52ffd700 1 -- 172.21.15.50:0/2258117120 learned_addr learned my addr 172.21.15.50:0/2258117120 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-06T01:22:14.430 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:14.428+0000 7f6e527fc700 1 --2- 172.21.15.50:0/2258117120 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x5610d09ec2c0 0x5610d09e7200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:14.430 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:14.428+0000 7f6e537fe700 1 --2- 172.21.15.50:0/2258117120 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5610d09eda10 0x5610d09e7740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:14.430 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:14.428+0000 7f6e52ffd700 1 -- 172.21.15.50:0/2258117120 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x5610d09ec2c0 msgr2=0x5610d09e7200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:22:14.431 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:14.428+0000 7f6e52ffd700 1 --2- 172.21.15.50:0/2258117120 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x5610d09ec2c0 0x5610d09e7200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:14.431 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:14.428+0000 7f6e52ffd700 1 -- 172.21.15.50:0/2258117120 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5610d09eda10 msgr2=0x5610d09e7740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:22:14.431 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:14.428+0000 7f6e52ffd700 1 --2- 172.21.15.50:0/2258117120 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5610d09eda10 0x5610d09e7740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:14.431 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:14.428+0000 7f6e52ffd700 1 -- 172.21.15.50:0/2258117120 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5610d07d5270 con 0x5610d0a0be50 2023-10-06T01:22:14.431 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:14.428+0000 7f6e537fe700 1 --2- 172.21.15.50:0/2258117120 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5610d09eda10 0x5610d09e7740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T01:22:14.431 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:14.428+0000 7f6e527fc700 1 --2- 172.21.15.50:0/2258117120 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x5610d09ec2c0 0x5610d09e7200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T01:22:14.431 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:14.428+0000 7f6e52ffd700 1 --2- 172.21.15.50:0/2258117120 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5610d0a0be50 0x5610d09e6cc0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f6e44055700 tx=0x7f6e44082f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=36aa22d6dd02d285 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:22:14.431 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:14.429+0000 7f6e33fff700 1 -- 172.21.15.50:0/2258117120 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e44055540 con 0x5610d0a0be50 2023-10-06T01:22:14.431 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:14.429+0000 7f6e33fff700 1 -- 172.21.15.50:0/2258117120 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e4405c9a0 con 0x5610d0a0be50 2023-10-06T01:22:14.431 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:14.429+0000 7f6e33fff700 1 -- 172.21.15.50:0/2258117120 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e44012e80 con 0x5610d0a0be50 2023-10-06T01:22:14.435 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:14.429+0000 7f6e67ec7b80 1 -- 172.21.15.50:0/2258117120 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5610d0a0be50 msgr2=0x5610d09e6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:14.435 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:14.429+0000 7f6e67ec7b80 1 --2- 172.21.15.50:0/2258117120 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5610d0a0be50 0x5610d09e6cc0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f6e44055700 tx=0x7f6e44082f50 comp rx=0 tx=0).stop 2023-10-06T01:22:14.435 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:14.429+0000 7f6e67ec7b80 1 -- 172.21.15.50:0/2258117120 shutdown_connections 2023-10-06T01:22:14.436 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:14.429+0000 7f6e67ec7b80 1 --2- 172.21.15.50:0/2258117120 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5610d09eda10 0x5610d09e7740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:14.436 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:14.429+0000 7f6e67ec7b80 1 --2- 172.21.15.50:0/2258117120 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5610d0a0be50 0x5610d09e6cc0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:14.436 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:14.429+0000 7f6e67ec7b80 1 --2- 172.21.15.50:0/2258117120 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x5610d09ec2c0 0x5610d09e7200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:14.436 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:14.429+0000 7f6e67ec7b80 1 -- 172.21.15.50:0/2258117120 >> 172.21.15.50:0/2258117120 conn(0x5610d09ebe80 msgr2=0x5610d09ec6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:22:14.436 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:14.429+0000 7f6e67ec7b80 1 -- 172.21.15.50:0/2258117120 shutdown_connections 2023-10-06T01:22:14.436 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:14.429+0000 7f6e67ec7b80 1 -- 172.21.15.50:0/2258117120 wait complete. 2023-10-06T01:22:14.436 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:14.430+0000 7f6e67ec7b80 1 -- start start 2023-10-06T01:22:14.436 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:14.430+0000 7f6e67ec7b80 1 Processor -- start 2023-10-06T01:22:14.436 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:14.431+0000 7f6e67ec7b80 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5610d09ec2c0 0x5610d0a13b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:14.436 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:14.431+0000 7f6e67ec7b80 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5610d09eda10 0x5610d09fafd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:14.437 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:14.431+0000 7f6e67ec7b80 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x5610d0a0be50 0x5610d0a0c6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:14.437 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:14.431+0000 7f6e67ec7b80 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x5610d08e6890 con 0x5610d09ec2c0 2023-10-06T01:22:14.437 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:14.431+0000 7f6e67ec7b80 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x5610d0901ea0 con 0x5610d09eda10 2023-10-06T01:22:14.437 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:14.431+0000 7f6e67ec7b80 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x5610d07bde30 con 0x5610d0a0be50 2023-10-06T01:22:14.437 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:14.431+0000 7f6e67ec7b80 10 client.0 _ll_register_callbacks cb 0x5610d09ae020 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T01:22:14.437 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:14.432+0000 7f6e52ffd700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5610d09ec2c0 0x5610d0a13b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:14.437 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:14.432+0000 7f6e52ffd700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5610d09ec2c0 0x5610d0a13b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:37414/0 (socket says 172.21.15.50:37414) 2023-10-06T01:22:14.437 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:14.432+0000 7f6e52ffd700 1 -- 172.21.15.50:0/3222320400 learned_addr learned my addr 172.21.15.50:0/3222320400 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-06T01:22:14.437 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:14.432+0000 7f6e527fc700 1 --2- 172.21.15.50:0/3222320400 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5610d09eda10 0x5610d09fafd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:14.438 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:14.432+0000 7f6e537fe700 1 --2- 172.21.15.50:0/3222320400 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x5610d0a0be50 0x5610d0a0c6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:14.438 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:14.432+0000 7f6e52ffd700 1 -- 172.21.15.50:0/3222320400 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x5610d0a0be50 msgr2=0x5610d0a0c6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:22:14.438 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:14.432+0000 7f6e52ffd700 1 --2- 172.21.15.50:0/3222320400 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x5610d0a0be50 0x5610d0a0c6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:14.438 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:14.432+0000 7f6e52ffd700 1 -- 172.21.15.50:0/3222320400 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5610d09eda10 msgr2=0x5610d09fafd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:22:14.438 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:14.432+0000 7f6e52ffd700 1 --2- 172.21.15.50:0/3222320400 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5610d09eda10 0x5610d09fafd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:14.438 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:14.432+0000 7f6e52ffd700 1 -- 172.21.15.50:0/3222320400 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6e540cfb10 con 0x5610d09ec2c0 2023-10-06T01:22:14.438 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:14.432+0000 7f6e527fc700 1 --2- 172.21.15.50:0/3222320400 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5610d09eda10 0x5610d09fafd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T01:22:14.438 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:14.432+0000 7f6e537fe700 1 --2- 172.21.15.50:0/3222320400 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x5610d0a0be50 0x5610d0a0c6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T01:22:14.438 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:14.432+0000 7f6e52ffd700 1 --2- 172.21.15.50:0/3222320400 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5610d09ec2c0 0x5610d0a13b10 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f6e44055700 tx=0x7f6e4406b000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=139f4dc7b0d9e7f2 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:22:14.438 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:14.432+0000 7f6e317fa700 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2023-10-06T01:22:14.438 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:14.432+0000 7f6e317fa700 1 -- 172.21.15.50:0/3222320400 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e44055e70 con 0x5610d09ec2c0 2023-10-06T01:22:14.438 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:14.432+0000 7f6e317fa700 1 -- 172.21.15.50:0/3222320400 <== mon.0 v2:172.21.15.50:3300/0 2 ==== osd_map(25..25 src has 1..25) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f6e44054ef0 con 0x5610d09ec2c0 2023-10-06T01:22:14.439 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:14.432+0000 7f6e67ec7b80 1 -- 172.21.15.50:0/3222320400 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5610d09df940 con 0x5610d09ec2c0 2023-10-06T01:22:14.439 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:14.433+0000 7f6e317fa700 1 -- 172.21.15.50:0/3222320400 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6e4405c510 con 0x5610d09ec2c0 2023-10-06T01:22:14.439 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:14.433+0000 7f6e67ec7b80 10 client.4791 fetch_fsmap learned FSMap version 9 2023-10-06T01:22:14.439 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:14.433+0000 7f6e67ec7b80 1 -- 172.21.15.50:0/3222320400 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) v3 -- 0x5610d0777fe0 con 0x5610d09ec2c0 2023-10-06T01:22:14.439 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:14.433+0000 7f6e317fa700 1 -- 172.21.15.50:0/3222320400 <== mon.0 v2:172.21.15.50:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5610d09df940 con 0x5610d09ec2c0 2023-10-06T01:22:14.439 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:14.433+0000 7f6e317fa700 1 -- 172.21.15.50:0/3222320400 <== mon.0 v2:172.21.15.50:3300/0 5 ==== fsmap(e 9) v1 ==== 3108+0+0 (secure 0 0 0) 0x7f6e440517f0 con 0x5610d09ec2c0 2023-10-06T01:22:14.439 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:14.433+0000 7f6e67ec7b80 10 client.4791 fetch_fsmap finished waiting for FSMap version 9 2023-10-06T01:22:14.439 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:14.433+0000 7f6e67ec7b80 10 client.4791 resolve_mds: resolved name 'd' to daemon mds.d 2023-10-06T01:22:14.439 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:14.433+0000 7f6e67ec7b80 20 client.4791 populate_metadata read hostname 'smithi050' 2023-10-06T01:22:14.439 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:14.433+0000 7f6e67ec7b80 1 --2- 172.21.15.50:0/3222320400 >> [v2:172.21.15.155:6835/3434423585,v1:172.21.15.155:6837/3434423585] conn(0x5610d0a35e20 0x5610d0a196f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:14.439 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:14.433+0000 7f6e67ec7b80 4 client.4791 mds_command: new command op to 4302 tid=0[{"prefix": "get_command_descriptions"}] 2023-10-06T01:22:14.439 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:14.433+0000 7f6e67ec7b80 1 -- 172.21.15.50:0/3222320400 --> [v2:172.21.15.155:6835/3434423585,v1:172.21.15.155:6837/3434423585] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5610d09bc870 con 0x5610d0a35e20 2023-10-06T01:22:14.440 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:14.434+0000 7f6e527fc700 1 --2- 172.21.15.50:0/3222320400 >> [v2:172.21.15.155:6835/3434423585,v1:172.21.15.155:6837/3434423585] conn(0x5610d0a35e20 0x5610d0a196f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:14.440 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:14.434+0000 7f6e527fc700 1 --2- 172.21.15.50:0/3222320400 >> [v2:172.21.15.155:6835/3434423585,v1:172.21.15.155:6837/3434423585] conn(0x5610d0a35e20 0x5610d0a196f0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c3ec83a7a9c01e60 server_cookie=95bcde796e72e0c2 in_seq=0 out_seq=0 2023-10-06T01:22:14.440 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:14.434+0000 7f6e317fa700 10 client.4791 ms_handle_connect on v2:172.21.15.155:6835/3434423585 2023-10-06T01:22:14.440 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:14.435+0000 7f6e317fa700 1 -- 172.21.15.50:0/3222320400 <== mds.0 v2:172.21.15.155:6835/3434423585 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+16954 (crc 0 0 0) 0x5610d09bc870 con 0x5610d0a35e20 2023-10-06T01:22:14.440 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:14.435+0000 7f6e317fa700 10 client.4791 handle_command_reply: tid=0 2023-10-06T01:22:14.440 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:14.435+0000 7f6e67ec7b80 1 client.4791 shutdown 2023-10-06T01:22:14.441 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:14.435+0000 7f6e67ec7b80 1 -- 172.21.15.50:0/3222320400 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5610d09ec2c0 msgr2=0x5610d0a13b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:14.441 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:14.435+0000 7f6e67ec7b80 1 --2- 172.21.15.50:0/3222320400 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5610d09ec2c0 0x5610d0a13b10 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f6e44055700 tx=0x7f6e4406b000 comp rx=0 tx=0).stop 2023-10-06T01:22:14.441 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:14.435+0000 7f6e67ec7b80 1 -- 172.21.15.50:0/3222320400 shutdown_connections 2023-10-06T01:22:14.441 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:14.435+0000 7f6e67ec7b80 1 --2- 172.21.15.50:0/3222320400 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x5610d0a0be50 0x5610d0a0c6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:14.441 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:14.435+0000 7f6e67ec7b80 1 --2- 172.21.15.50:0/3222320400 >> [v2:172.21.15.155:6835/3434423585,v1:172.21.15.155:6837/3434423585] conn(0x5610d0a35e20 0x5610d0a196f0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:14.442 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:14.435+0000 7f6e67ec7b80 1 --2- 172.21.15.50:0/3222320400 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5610d09ec2c0 0x5610d0a13b10 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:14.442 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:14.435+0000 7f6e67ec7b80 1 --2- 172.21.15.50:0/3222320400 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5610d09eda10 0x5610d09fafd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:14.442 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:14.435+0000 7f6e67ec7b80 1 -- 172.21.15.50:0/3222320400 >> 172.21.15.50:0/3222320400 conn(0x5610d09ebe80 msgr2=0x5610d09ead70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:22:14.442 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:14.435+0000 7f6e317fa700 0 client.4791 ms_handle_reset on v2:172.21.15.155:6835/3434423585 2023-10-06T01:22:14.442 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:14.435+0000 7f6e67ec7b80 1 -- 172.21.15.50:0/3222320400 shutdown_connections 2023-10-06T01:22:14.442 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:14.435+0000 7f6e67ec7b80 1 -- 172.21.15.50:0/3222320400 wait complete. 2023-10-06T01:22:14.442 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:14.436+0000 7f6e67ec7b80 20 client.4791 trim_cache size 0 max 16384 2023-10-06T01:22:14.454 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:14.453+0000 7f6e67ec7b80 1 Processor -- start 2023-10-06T01:22:14.454 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:14.453+0000 7f6e67ec7b80 1 -- start start 2023-10-06T01:22:14.455 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:14.454+0000 7f6e67ec7b80 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5610d09ec2c0 0x5610d0a19630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:14.456 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:14.454+0000 7f6e67ec7b80 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5610d09eda10 0x5610d0a19b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:14.456 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:14.454+0000 7f6e67ec7b80 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x5610d0a0be50 0x5610d09ead70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:14.456 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:14.454+0000 7f6e67ec7b80 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x5610d0a0bb40 con 0x5610d09eda10 2023-10-06T01:22:14.456 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:14.454+0000 7f6e67ec7b80 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x5610d09ed490 con 0x5610d09ec2c0 2023-10-06T01:22:14.456 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:14.454+0000 7f6e67ec7b80 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x5610d09e90c0 con 0x5610d0a0be50 2023-10-06T01:22:14.456 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:14.454+0000 7f6e527fc700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5610d09eda10 0x5610d0a19b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:14.456 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:14.454+0000 7f6e527fc700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5610d09eda10 0x5610d0a19b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:37422/0 (socket says 172.21.15.50:37422) 2023-10-06T01:22:14.456 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:14.454+0000 7f6e527fc700 1 -- 172.21.15.50:0/1698256665 learned_addr learned my addr 172.21.15.50:0/1698256665 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-06T01:22:14.456 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:14.455+0000 7f6e527fc700 1 -- 172.21.15.50:0/1698256665 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x5610d0a0be50 msgr2=0x5610d09ead70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:22:14.457 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:14.455+0000 7f6e527fc700 1 --2- 172.21.15.50:0/1698256665 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x5610d0a0be50 0x5610d09ead70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:14.457 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:14.455+0000 7f6e527fc700 1 -- 172.21.15.50:0/1698256665 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5610d09ec2c0 msgr2=0x5610d0a19630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:22:14.457 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:14.455+0000 7f6e527fc700 1 --2- 172.21.15.50:0/1698256665 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5610d09ec2c0 0x5610d0a19630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:14.457 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:14.455+0000 7f6e527fc700 1 -- 172.21.15.50:0/1698256665 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5610d0909780 con 0x5610d09eda10 2023-10-06T01:22:14.457 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:14.455+0000 7f6e527fc700 1 --2- 172.21.15.50:0/1698256665 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5610d09eda10 0x5610d0a19b70 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f6e54069190 tx=0x7f6e48014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f69bb2877560c0c3 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:22:14.460 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:14.455+0000 7f6e38ff9700 1 -- 172.21.15.50:0/1698256665 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e48021070 con 0x5610d09eda10 2023-10-06T01:22:14.460 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:14.455+0000 7f6e38ff9700 1 -- 172.21.15.50:0/1698256665 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e48034890 con 0x5610d09eda10 2023-10-06T01:22:14.460 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:14.455+0000 7f6e38ff9700 1 -- 172.21.15.50:0/1698256665 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e48034a00 con 0x5610d09eda10 2023-10-06T01:22:14.460 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:14.456+0000 7f6e67ec7b80 1 -- 172.21.15.50:0/1698256665 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5610d09eda10 msgr2=0x5610d0a19b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:14.460 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:14.456+0000 7f6e67ec7b80 1 --2- 172.21.15.50:0/1698256665 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5610d09eda10 0x5610d0a19b70 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f6e54069190 tx=0x7f6e48014000 comp rx=0 tx=0).stop 2023-10-06T01:22:14.460 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:14.456+0000 7f6e67ec7b80 1 -- 172.21.15.50:0/1698256665 shutdown_connections 2023-10-06T01:22:14.460 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:14.456+0000 7f6e67ec7b80 1 --2- 172.21.15.50:0/1698256665 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x5610d0a0be50 0x5610d09ead70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:14.460 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:14.456+0000 7f6e67ec7b80 1 --2- 172.21.15.50:0/1698256665 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5610d09ec2c0 0x5610d0a19630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:14.460 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:14.456+0000 7f6e67ec7b80 1 --2- 172.21.15.50:0/1698256665 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5610d09eda10 0x5610d0a19b70 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:14.460 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:14.456+0000 7f6e67ec7b80 1 -- 172.21.15.50:0/1698256665 >> 172.21.15.50:0/1698256665 conn(0x5610d09ebe80 msgr2=0x5610d0a09920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:22:14.460 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:14.456+0000 7f6e67ec7b80 1 -- 172.21.15.50:0/1698256665 shutdown_connections 2023-10-06T01:22:14.461 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:14.456+0000 7f6e67ec7b80 1 -- 172.21.15.50:0/1698256665 wait complete. 2023-10-06T01:22:14.461 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:14.457+0000 7f6e67ec7b80 1 -- start start 2023-10-06T01:22:14.461 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:14.457+0000 7f6e67ec7b80 1 Processor -- start 2023-10-06T01:22:14.461 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:14.458+0000 7f6e67ec7b80 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5610d09ec2c0 0x5610d0a95f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:14.461 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:14.458+0000 7f6e67ec7b80 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5610d09eda10 0x5610d0a19630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:14.461 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:14.458+0000 7f6e67ec7b80 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x5610d0a0be50 0x5610d0a19b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:14.461 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:14.458+0000 7f6e67ec7b80 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x5610d0a97cb0 con 0x5610d09ec2c0 2023-10-06T01:22:14.461 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:14.458+0000 7f6e67ec7b80 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x5610d0a964c0 con 0x5610d09eda10 2023-10-06T01:22:14.461 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:14.458+0000 7f6e67ec7b80 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x5610d0a0aba0 con 0x5610d0a0be50 2023-10-06T01:22:14.461 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:14.458+0000 7f6e67ec7b80 10 client.0 _ll_register_callbacks cb 0x5610d09ae020 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T01:22:14.461 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:14.458+0000 7f6e52ffd700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5610d09ec2c0 0x5610d0a95f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:14.461 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:14.458+0000 7f6e52ffd700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5610d09ec2c0 0x5610d0a95f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:37430/0 (socket says 172.21.15.50:37430) 2023-10-06T01:22:14.462 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:14.458+0000 7f6e52ffd700 1 -- 172.21.15.50:0/462845146 learned_addr learned my addr 172.21.15.50:0/462845146 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-06T01:22:14.462 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:14.458+0000 7f6e537fe700 1 --2- 172.21.15.50:0/462845146 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x5610d0a0be50 0x5610d0a19b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:14.462 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:14.458+0000 7f6e527fc700 1 --2- 172.21.15.50:0/462845146 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5610d09eda10 0x5610d0a19630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:14.462 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:14.458+0000 7f6e52ffd700 1 -- 172.21.15.50:0/462845146 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x5610d0a0be50 msgr2=0x5610d0a19b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:22:14.462 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:14.458+0000 7f6e52ffd700 1 --2- 172.21.15.50:0/462845146 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x5610d0a0be50 0x5610d0a19b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:14.462 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:14.458+0000 7f6e52ffd700 1 -- 172.21.15.50:0/462845146 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5610d09eda10 msgr2=0x5610d0a19630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:22:14.462 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:14.458+0000 7f6e52ffd700 1 --2- 172.21.15.50:0/462845146 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5610d09eda10 0x5610d0a19630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:14.462 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:14.458+0000 7f6e52ffd700 1 -- 172.21.15.50:0/462845146 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6e540cb470 con 0x5610d09ec2c0 2023-10-06T01:22:14.462 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:14.458+0000 7f6e527fc700 1 --2- 172.21.15.50:0/462845146 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5610d09eda10 0x5610d0a19630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T01:22:14.462 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:14.459+0000 7f6e52ffd700 1 --2- 172.21.15.50:0/462845146 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5610d09ec2c0 0x5610d0a95f80 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f6e4400df00 tx=0x7f6e4407e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b3acfa3ff411dbfe server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:22:14.462 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:14.459+0000 7f6e317fa700 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2023-10-06T01:22:14.463 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:14.459+0000 7f6e317fa700 1 -- 172.21.15.50:0/462845146 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e44055e70 con 0x5610d09ec2c0 2023-10-06T01:22:14.463 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:14.459+0000 7f6e67ec7b80 1 -- 172.21.15.50:0/462845146 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f6e4405c9a0 con 0x5610d09ec2c0 2023-10-06T01:22:14.463 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:14.459+0000 7f6e317fa700 1 -- 172.21.15.50:0/462845146 <== mon.0 v2:172.21.15.50:3300/0 2 ==== osd_map(25..25 src has 1..25) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f6e44065020 con 0x5610d09ec2c0 2023-10-06T01:22:14.463 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:14.459+0000 7f6e317fa700 1 -- 172.21.15.50:0/462845146 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6e44054ef0 con 0x5610d09ec2c0 2023-10-06T01:22:14.463 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:14.459+0000 7f6e67ec7b80 10 client.4797 fetch_fsmap learned FSMap version 9 2023-10-06T01:22:14.463 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:14.459+0000 7f6e67ec7b80 1 -- 172.21.15.50:0/462845146 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) v3 -- 0x5610d08f0470 con 0x5610d09ec2c0 2023-10-06T01:22:14.465 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:14.459+0000 7f6e317fa700 1 -- 172.21.15.50:0/462845146 <== mon.0 v2:172.21.15.50:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e4405c9a0 con 0x5610d09ec2c0 2023-10-06T01:22:14.465 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:14.459+0000 7f6e317fa700 1 -- 172.21.15.50:0/462845146 <== mon.0 v2:172.21.15.50:3300/0 5 ==== fsmap(e 9) v1 ==== 3108+0+0 (secure 0 0 0) 0x7f6e440517f0 con 0x5610d09ec2c0 2023-10-06T01:22:14.465 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:14.459+0000 7f6e67ec7b80 10 client.4797 fetch_fsmap finished waiting for FSMap version 9 2023-10-06T01:22:14.465 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:14.459+0000 7f6e67ec7b80 10 client.4797 resolve_mds: resolved name 'd' to daemon mds.d 2023-10-06T01:22:14.465 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:14.459+0000 7f6e67ec7b80 20 client.4797 populate_metadata read hostname 'smithi050' 2023-10-06T01:22:14.465 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:14.459+0000 7f6e67ec7b80 1 --2- 172.21.15.50:0/462845146 >> [v2:172.21.15.155:6835/3434423585,v1:172.21.15.155:6837/3434423585] conn(0x5610d0a164c0 0x5610d0a16890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:14.465 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:14.459+0000 7f6e67ec7b80 4 client.4797 mds_command: new command op to 4302 tid=0[{"prefix": "status"}] 2023-10-06T01:22:14.465 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:14.459+0000 7f6e67ec7b80 1 -- 172.21.15.50:0/462845146 --> [v2:172.21.15.155:6835/3434423585,v1:172.21.15.155:6837/3434423585] -- command(tid 0: {"prefix": "status"}) v1 -- 0x5610d08dde00 con 0x5610d0a164c0 2023-10-06T01:22:14.466 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:14.460+0000 7f6e527fc700 1 --2- 172.21.15.50:0/462845146 >> [v2:172.21.15.155:6835/3434423585,v1:172.21.15.155:6837/3434423585] conn(0x5610d0a164c0 0x5610d0a16890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:14.466 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:14.460+0000 7f6e527fc700 1 --2- 172.21.15.50:0/462845146 >> [v2:172.21.15.155:6835/3434423585,v1:172.21.15.155:6837/3434423585] conn(0x5610d0a164c0 0x5610d0a16890 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a312bb07b9219b21 server_cookie=af141907e4a11517 in_seq=0 out_seq=0 2023-10-06T01:22:14.466 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:14.460+0000 7f6e317fa700 10 client.4797 ms_handle_connect on v2:172.21.15.155:6835/3434423585 2023-10-06T01:22:14.466 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:14.461+0000 7f6e317fa700 1 -- 172.21.15.50:0/462845146 <== mds.0 v2:172.21.15.155:6835/3434423585 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+330 (crc 0 0 0) 0x5610d08dde00 con 0x5610d0a164c0 2023-10-06T01:22:14.466 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:14.461+0000 7f6e317fa700 10 client.4797 handle_command_reply: tid=0 2023-10-06T01:22:14.466 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:14.461+0000 7f6e67ec7b80 1 client.4797 shutdown 2023-10-06T01:22:14.466 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:14.461+0000 7f6e67ec7b80 1 -- 172.21.15.50:0/462845146 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5610d09ec2c0 msgr2=0x5610d0a95f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:14.466 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:14.461+0000 7f6e67ec7b80 1 --2- 172.21.15.50:0/462845146 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5610d09ec2c0 0x5610d0a95f80 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f6e4400df00 tx=0x7f6e4407e000 comp rx=0 tx=0).stop 2023-10-06T01:22:14.466 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:14.461+0000 7f6e67ec7b80 1 -- 172.21.15.50:0/462845146 shutdown_connections 2023-10-06T01:22:14.466 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:14.461+0000 7f6e67ec7b80 1 --2- 172.21.15.50:0/462845146 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x5610d0a0be50 0x5610d0a19b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:14.466 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:14.461+0000 7f6e67ec7b80 1 --2- 172.21.15.50:0/462845146 >> [v2:172.21.15.155:6835/3434423585,v1:172.21.15.155:6837/3434423585] conn(0x5610d0a164c0 0x5610d0a16890 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:14.466 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:14.461+0000 7f6e67ec7b80 1 --2- 172.21.15.50:0/462845146 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5610d09ec2c0 0x5610d0a95f80 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:14.467 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:14.461+0000 7f6e67ec7b80 1 --2- 172.21.15.50:0/462845146 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5610d09eda10 0x5610d0a19630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:14.467 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:14.461+0000 7f6e317fa700 0 client.4797 ms_handle_reset on v2:172.21.15.155:6835/3434423585 2023-10-06T01:22:14.467 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:14.461+0000 7f6e67ec7b80 1 -- 172.21.15.50:0/462845146 >> 172.21.15.50:0/462845146 conn(0x5610d09ebe80 msgr2=0x5610d09e14a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:22:14.467 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:14.461+0000 7f6e67ec7b80 1 -- 172.21.15.50:0/462845146 shutdown_connections 2023-10-06T01:22:14.467 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:14.461+0000 7f6e67ec7b80 1 -- 172.21.15.50:0/462845146 wait complete. 2023-10-06T01:22:14.467 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:14.461+0000 7f6e67ec7b80 20 client.4797 trim_cache size 0 max 16384 2023-10-06T01:22:14.467 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2023-10-06T01:22:14.467 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_fsid": "0bfd9a6b-1587-4fe4-a89e-e43c00286b4e", 2023-10-06T01:22:14.467 INFO:teuthology.orchestra.run.smithi050.stdout: "whoami": 0, 2023-10-06T01:22:14.468 INFO:teuthology.orchestra.run.smithi050.stdout: "id": 4302, 2023-10-06T01:22:14.468 INFO:teuthology.orchestra.run.smithi050.stdout: "want_state": "up:active", 2023-10-06T01:22:14.468 INFO:teuthology.orchestra.run.smithi050.stdout: "state": "up:active", 2023-10-06T01:22:14.468 INFO:teuthology.orchestra.run.smithi050.stdout: "fs_name": "cephfs", 2023-10-06T01:22:14.468 INFO:teuthology.orchestra.run.smithi050.stdout: "rank_uptime": 37.185517392999998, 2023-10-06T01:22:14.468 INFO:teuthology.orchestra.run.smithi050.stdout: "mdsmap_epoch": 9, 2023-10-06T01:22:14.468 INFO:teuthology.orchestra.run.smithi050.stdout: "osdmap_epoch": 25, 2023-10-06T01:22:14.468 INFO:teuthology.orchestra.run.smithi050.stdout: "osdmap_epoch_barrier": 25, 2023-10-06T01:22:14.468 INFO:teuthology.orchestra.run.smithi050.stdout: "uptime": 43.677938085999997 2023-10-06T01:22:14.468 INFO:teuthology.orchestra.run.smithi050.stdout:} 2023-10-06T01:22:14.469 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:14.462+0000 7f6e53fff700 1 -- 172.21.15.50:0/2642259087 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f6e40066f30 msgr2=0x7f6e400693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:14.469 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:14.462+0000 7f6e53fff700 1 --2- 172.21.15.50:0/2642259087 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f6e40066f30 0x7f6e400693e0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f6e480093f0 tx=0x7f6e48017000 comp rx=0 tx=0).stop 2023-10-06T01:22:14.469 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:14.462+0000 7f6e53fff700 1 -- 172.21.15.50:0/2642259087 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6e540b3610 msgr2=0x7f6e54169a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:14.469 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:14.462+0000 7f6e53fff700 1 --2- 172.21.15.50:0/2642259087 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6e540b3610 0x7f6e54169a50 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f6e4400d860 tx=0x7f6e44008040 comp rx=0 tx=0).stop 2023-10-06T01:22:14.470 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:14.462+0000 7f6e53fff700 1 -- 172.21.15.50:0/2642259087 shutdown_connections 2023-10-06T01:22:14.470 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:14.462+0000 7f6e53fff700 1 --2- 172.21.15.50:0/2642259087 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6e54159480 0x7f6e540cf1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:14.470 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:14.462+0000 7f6e53fff700 1 --2- 172.21.15.50:0/2642259087 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6e540b3610 0x7f6e54169a50 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:14.470 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:14.462+0000 7f6e53fff700 1 --2- 172.21.15.50:0/2642259087 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f6e40066f30 0x7f6e400693e0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:14.470 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:14.462+0000 7f6e53fff700 1 --2- 172.21.15.50:0/2642259087 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6e540cc1b0 0x7f6e540cec60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:14.470 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:14.462+0000 7f6e53fff700 1 -- 172.21.15.50:0/2642259087 >> 172.21.15.50:0/2642259087 conn(0x7f6e5406ed20 msgr2=0x7f6e54156870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:22:14.470 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:14.462+0000 7f6e53fff700 1 -- 172.21.15.50:0/2642259087 shutdown_connections 2023-10-06T01:22:14.470 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:14.462+0000 7f6e53fff700 1 -- 172.21.15.50:0/2642259087 wait complete. 2023-10-06T01:22:14.480 INFO:teuthology.run_tasks:Running task kclient... 2023-10-06T01:22:14.498 INFO:tasks.kclient:Mounting kernel clients... 2023-10-06T01:22:14.499 INFO:tasks.kclient:config is {'client.0': {}, 'client.2': {}, 'client.1': {}, 'client.3': {}} 2023-10-06T01:22:14.499 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T01:22:14.499 DEBUG:teuthology.orchestra.run.smithi050:> ip netns list 2023-10-06T01:22:14.536 INFO:teuthology.orchestra.run.smithi050.stdout:ceph-ns--home-ubuntu-cephtest-mnt.admin (id: 0) 2023-10-06T01:22:14.537 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T01:22:14.537 DEBUG:teuthology.orchestra.run.smithi050:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.admin 2023-10-06T01:22:14.639 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T01:22:14.640 DEBUG:teuthology.orchestra.run.smithi050:> sudo ip link delete ceph-brx 2023-10-06T01:22:14.741 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T01:22:14.742 DEBUG:teuthology.orchestra.run.smithi050:> ip netns list 2023-10-06T01:22:14.781 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T01:22:14.781 DEBUG:teuthology.orchestra.run.smithi050:> sudo ip link delete ceph-brx 2023-10-06T01:22:14.889 INFO:teuthology.orchestra.run.smithi050.stderr:Cannot find device "ceph-brx" 2023-10-06T01:22:14.892 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-06T01:22:14.893 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T01:22:14.893 DEBUG:teuthology.orchestra.run.smithi155:> ip netns list 2023-10-06T01:22:14.934 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T01:22:14.934 DEBUG:teuthology.orchestra.run.smithi155:> sudo ip link delete ceph-brx 2023-10-06T01:22:15.044 INFO:teuthology.orchestra.run.smithi155.stderr:Cannot find device "ceph-brx" 2023-10-06T01:22:15.047 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-06T01:22:15.047 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T01:22:15.047 DEBUG:teuthology.orchestra.run.smithi155:> ip netns list 2023-10-06T01:22:15.084 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T01:22:15.084 DEBUG:teuthology.orchestra.run.smithi155:> sudo ip link delete ceph-brx 2023-10-06T01:22:15.188 INFO:teuthology.orchestra.run.smithi155.stderr:Cannot find device "ceph-brx" 2023-10-06T01:22:15.190 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-06T01:22:15.190 INFO:tasks.kclient:client.0 config is {'syntax': 'v1'} 2023-10-06T01:22:15.191 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-06T01:22:15.380 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:15.379+0000 7f874259d700 1 Processor -- start 2023-10-06T01:22:15.380 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:15.379+0000 7f874259d700 1 -- start start 2023-10-06T01:22:15.381 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:15.380+0000 7f874259d700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f873c0cbc70 0x7f873c0cc0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:15.381 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:15.380+0000 7f874259d700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f873c0b2140 0x7f873c0b2560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:15.381 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:15.380+0000 7f874259d700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f873c0cb7e0 con 0x7f873c159480 2023-10-06T01:22:15.382 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:15.380+0000 7f874259d700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f873c0b08a0 con 0x7f873c0cbc70 2023-10-06T01:22:15.382 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:15.380+0000 7f874259d700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f873c0cb190 con 0x7f873c0b2140 2023-10-06T01:22:15.382 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:15.381+0000 7f8740d9a700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f873c0cbc70 0x7f873c0cc0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:15.382 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:15.381+0000 7f874159b700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f873c159480 0x7f873c0b30d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:53202/0 (socket says 172.21.15.50:53202) 2023-10-06T01:22:15.382 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:15.381+0000 7f874159b700 1 -- 172.21.15.50:0/799320089 learned_addr learned my addr 172.21.15.50:0/799320089 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-10-06T01:22:15.382 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:15.381+0000 7f8741d9c700 1 --2- 172.21.15.50:0/799320089 >> v2:172.21.15.155:3300/0 conn(0x7f873c0b2140 0x7f873c0b2560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:15.383 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:15.381+0000 7f8740d9a700 1 -- 172.21.15.50:0/799320089 >> v2:172.21.15.155:3300/0 conn(0x7f873c0b2140 msgr2=0x7f873c0b2560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:22:15.384 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:15.381+0000 7f8740d9a700 1 --2- 172.21.15.50:0/799320089 >> v2:172.21.15.155:3300/0 conn(0x7f873c0b2140 0x7f873c0b2560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:15.384 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:15.381+0000 7f8740d9a700 1 -- 172.21.15.50:0/799320089 >> v1:172.21.15.50:6789/0 conn(0x7f873c159480 legacy=0x7f873c0b30d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:15.384 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:15.381+0000 7f8740d9a700 1 -- 172.21.15.50:0/799320089 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f873c0cb470 con 0x7f873c0cbc70 2023-10-06T01:22:15.384 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:15.381+0000 7f8733fff700 1 -- 172.21.15.50:0/799320089 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 916530605 0 0) 0x7f873c0cb7e0 con 0x7f873c159480 2023-10-06T01:22:15.384 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:15.381+0000 7f8740d9a700 1 --2- 172.21.15.50:0/799320089 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f873c0cbc70 0x7f873c0cc0c0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f873c0ca830 tx=0x7f872c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7de1e4c6fb5fbfe4 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:22:15.384 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:15.382+0000 7f8733fff700 1 -- 172.21.15.50:0/799320089 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f872c011630 con 0x7f873c0cbc70 2023-10-06T01:22:15.384 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:15.382+0000 7f8733fff700 1 -- 172.21.15.50:0/799320089 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f872c011790 con 0x7f873c0cbc70 2023-10-06T01:22:15.384 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:15.382+0000 7f8733fff700 1 -- 172.21.15.50:0/799320089 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f872c011b30 con 0x7f873c0cbc70 2023-10-06T01:22:15.384 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:15.382+0000 7f874259d700 1 -- 172.21.15.50:0/799320089 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f873c0cbc70 msgr2=0x7f873c0cc0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:15.384 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:15.382+0000 7f874259d700 1 --2- 172.21.15.50:0/799320089 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f873c0cbc70 0x7f873c0cc0c0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f873c0ca830 tx=0x7f872c0091a0 comp rx=0 tx=0).stop 2023-10-06T01:22:15.385 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:15.382+0000 7f874259d700 1 -- 172.21.15.50:0/799320089 shutdown_connections 2023-10-06T01:22:15.385 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:15.382+0000 7f874259d700 1 --2- 172.21.15.50:0/799320089 >> v2:172.21.15.155:3300/0 conn(0x7f873c0b2140 0x7f873c0b2560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:15.385 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:15.382+0000 7f874259d700 1 --2- 172.21.15.50:0/799320089 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f873c0cbc70 0x7f873c0cc0c0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:15.385 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:15.382+0000 7f874259d700 1 -- 172.21.15.50:0/799320089 >> 172.21.15.50:0/799320089 conn(0x7f873c06ed20 msgr2=0x7f873c06f120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:22:15.385 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:15.382+0000 7f874259d700 1 -- 172.21.15.50:0/799320089 shutdown_connections 2023-10-06T01:22:15.385 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:15.382+0000 7f874259d700 1 -- 172.21.15.50:0/799320089 wait complete. 2023-10-06T01:22:15.387 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:15.384+0000 7f874259d700 1 Processor -- start 2023-10-06T01:22:15.387 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:15.384+0000 7f874259d700 1 -- start start 2023-10-06T01:22:15.387 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:15.385+0000 7f874259d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f873c0b2140 0x7f873c16a490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:15.387 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:15.385+0000 7f874259d700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f873c0cbc70 0x7f873c0cfaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:15.387 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:15.385+0000 7f874259d700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f873c159480 0x7f873c0c9e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:15.387 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:15.385+0000 7f874259d700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f873c0d12b0 con 0x7f873c0b2140 2023-10-06T01:22:15.387 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:15.385+0000 7f874259d700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f873c0cffe0 con 0x7f873c159480 2023-10-06T01:22:15.387 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:15.385+0000 7f874259d700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f873c0d0210 con 0x7f873c0cbc70 2023-10-06T01:22:15.388 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:15.385+0000 7f874159b700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f873c0b2140 0x7f873c16a490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:15.388 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:15.385+0000 7f874159b700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f873c0b2140 0x7f873c16a490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:48014/0 (socket says 172.21.15.50:48014) 2023-10-06T01:22:15.388 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:15.385+0000 7f874159b700 1 -- 172.21.15.50:0/3348023135 learned_addr learned my addr 172.21.15.50:0/3348023135 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-06T01:22:15.388 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:15.385+0000 7f8741d9c700 1 --2- 172.21.15.50:0/3348023135 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f873c159480 0x7f873c0c9e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:15.388 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:15.385+0000 7f8740d9a700 1 --2- 172.21.15.50:0/3348023135 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f873c0cbc70 0x7f873c0cfaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:15.388 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:15.385+0000 7f874159b700 1 -- 172.21.15.50:0/3348023135 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f873c0cbc70 msgr2=0x7f873c0cfaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:15.388 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:15.385+0000 7f874159b700 1 --2- 172.21.15.50:0/3348023135 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f873c0cbc70 0x7f873c0cfaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:15.388 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:15.385+0000 7f874159b700 1 -- 172.21.15.50:0/3348023135 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f873c159480 msgr2=0x7f873c0c9e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:15.388 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:15.385+0000 7f874159b700 1 --2- 172.21.15.50:0/3348023135 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f873c159480 0x7f873c0c9e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:15.388 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:15.385+0000 7f874159b700 1 -- 172.21.15.50:0/3348023135 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f872c009420 con 0x7f873c0b2140 2023-10-06T01:22:15.388 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:15.386+0000 7f874159b700 1 --2- 172.21.15.50:0/3348023135 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f873c0b2140 0x7f873c16a490 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f873800c5b0 tx=0x7f8738001070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:22:15.388 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:15.386+0000 7f87317fa700 1 -- 172.21.15.50:0/3348023135 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8738005b30 con 0x7f873c0b2140 2023-10-06T01:22:15.388 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:15.386+0000 7f87317fa700 1 -- 172.21.15.50:0/3348023135 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8738005c90 con 0x7f873c0b2140 2023-10-06T01:22:15.389 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:15.386+0000 7f874259d700 1 -- 172.21.15.50:0/3348023135 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f873c0d04f0 con 0x7f873c0b2140 2023-10-06T01:22:15.389 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:15.386+0000 7f87317fa700 1 -- 172.21.15.50:0/3348023135 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8738007300 con 0x7f873c0b2140 2023-10-06T01:22:15.389 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:15.386+0000 7f874259d700 1 -- 172.21.15.50:0/3348023135 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f873c0d0ab0 con 0x7f873c0b2140 2023-10-06T01:22:15.389 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:15.387+0000 7f874259d700 1 -- 172.21.15.50:0/3348023135 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f873c05f270 con 0x7f873c0b2140 2023-10-06T01:22:15.389 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:15.388+0000 7f87317fa700 1 -- 172.21.15.50:0/3348023135 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f87380076b0 con 0x7f873c0b2140 2023-10-06T01:22:15.390 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:15.389+0000 7f87317fa700 1 --2- 172.21.15.50:0/3348023135 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f8720067000 0x7f87200694b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:15.390 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:15.389+0000 7f87317fa700 1 -- 172.21.15.50:0/3348023135 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f8738083f10 con 0x7f873c0b2140 2023-10-06T01:22:15.390 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:15.389+0000 7f8740d9a700 1 --2- 172.21.15.50:0/3348023135 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f8720067000 0x7f87200694b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:15.390 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:15.390+0000 7f8740d9a700 1 --2- 172.21.15.50:0/3348023135 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f8720067000 0x7f87200694b0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f872c0093f0 tx=0x7f872c017000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:22:15.393 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:15.393+0000 7f87317fa700 1 -- 172.21.15.50:0/3348023135 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f8738050d10 con 0x7f873c0b2140 2023-10-06T01:22:15.645 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:15.644+0000 7f874259d700 1 -- 172.21.15.50:0/3348023135 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f873c159850 con 0x7f873c0b2140 2023-10-06T01:22:15.645 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:15.644+0000 7f87317fa700 1 -- 172.21.15.50:0/3348023135 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v9) v1 ==== 53+0+88 (secure 0 0 0) 0x7f8738017070 con 0x7f873c0b2140 2023-10-06T01:22:15.645 INFO:teuthology.orchestra.run.smithi050.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2023-10-06T01:22:15.647 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:15.646+0000 7f874259d700 1 -- 172.21.15.50:0/3348023135 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f8720067000 msgr2=0x7f87200694b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:15.648 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:15.646+0000 7f874259d700 1 --2- 172.21.15.50:0/3348023135 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f8720067000 0x7f87200694b0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f872c0093f0 tx=0x7f872c017000 comp rx=0 tx=0).stop 2023-10-06T01:22:15.648 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:15.646+0000 7f874259d700 1 -- 172.21.15.50:0/3348023135 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f873c0b2140 msgr2=0x7f873c16a490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:15.648 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:15.646+0000 7f874259d700 1 --2- 172.21.15.50:0/3348023135 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f873c0b2140 0x7f873c16a490 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f873800c5b0 tx=0x7f8738001070 comp rx=0 tx=0).stop 2023-10-06T01:22:15.648 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:15.646+0000 7f874259d700 1 -- 172.21.15.50:0/3348023135 shutdown_connections 2023-10-06T01:22:15.648 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:15.646+0000 7f874259d700 1 --2- 172.21.15.50:0/3348023135 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f8720067000 0x7f87200694b0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:15.648 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:15.646+0000 7f874259d700 1 --2- 172.21.15.50:0/3348023135 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f873c159480 0x7f873c0c9e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:15.648 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:15.646+0000 7f874259d700 1 --2- 172.21.15.50:0/3348023135 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f873c0b2140 0x7f873c16a490 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:15.648 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:15.646+0000 7f874259d700 1 --2- 172.21.15.50:0/3348023135 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f873c0cbc70 0x7f873c0cfaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:15.648 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:15.646+0000 7f874259d700 1 -- 172.21.15.50:0/3348023135 >> 172.21.15.50:0/3348023135 conn(0x7f873c06ed20 msgr2=0x7f873c158760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:22:15.648 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:15.647+0000 7f874259d700 1 -- 172.21.15.50:0/3348023135 shutdown_connections 2023-10-06T01:22:15.648 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:15.647+0000 7f874259d700 1 -- 172.21.15.50:0/3348023135 wait complete. 2023-10-06T01:22:15.665 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-10-06T01:22:15.665 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-06T01:22:15.665 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi050.front.sepia.ceph.com 2023-10-06T01:22:15.666 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-10-06T01:22:15.666 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-10-06T01:22:15.666 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-10-06T01:22:15.666 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-10-06T01:22:15.666 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-06T01:22:15.666 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-06T01:22:15.666 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T01:22:15.666 DEBUG:teuthology.orchestra.run.smithi050:> ip addr 2023-10-06T01:22:15.703 INFO:teuthology.orchestra.run.smithi050.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-06T01:22:15.703 INFO:teuthology.orchestra.run.smithi050.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-06T01:22:15.703 INFO:teuthology.orchestra.run.smithi050.stdout: inet 127.0.0.1/8 scope host lo 2023-10-06T01:22:15.704 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft forever preferred_lft forever 2023-10-06T01:22:15.704 INFO:teuthology.orchestra.run.smithi050.stdout: inet6 ::1/128 scope host 2023-10-06T01:22:15.704 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft forever preferred_lft forever 2023-10-06T01:22:15.704 INFO:teuthology.orchestra.run.smithi050.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T01:22:15.705 INFO:teuthology.orchestra.run.smithi050.stdout: link/ether 0c:c4:7a:6b:fd:f8 brd ff:ff:ff:ff:ff:ff 2023-10-06T01:22:15.705 INFO:teuthology.orchestra.run.smithi050.stdout: altname enp7s0f0 2023-10-06T01:22:15.705 INFO:teuthology.orchestra.run.smithi050.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T01:22:15.705 INFO:teuthology.orchestra.run.smithi050.stdout: link/ether 0c:c4:7a:6b:fd:f9 brd ff:ff:ff:ff:ff:ff 2023-10-06T01:22:15.705 INFO:teuthology.orchestra.run.smithi050.stdout: altname enp7s0f1 2023-10-06T01:22:15.705 INFO:teuthology.orchestra.run.smithi050.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-06T01:22:15.705 INFO:teuthology.orchestra.run.smithi050.stdout: link/ether 0c:c4:7a:bd:15:84 brd ff:ff:ff:ff:ff:ff 2023-10-06T01:22:15.705 INFO:teuthology.orchestra.run.smithi050.stdout: altname enp1s0f0 2023-10-06T01:22:15.705 INFO:teuthology.orchestra.run.smithi050.stdout: inet 172.21.15.50/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2023-10-06T01:22:15.705 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft 42218sec preferred_lft 42218sec 2023-10-06T01:22:15.706 INFO:teuthology.orchestra.run.smithi050.stdout: inet6 fe80::ec4:7aff:febd:1584/64 scope link 2023-10-06T01:22:15.706 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft forever preferred_lft forever 2023-10-06T01:22:15.706 INFO:teuthology.orchestra.run.smithi050.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T01:22:15.706 INFO:teuthology.orchestra.run.smithi050.stdout: link/ether 0c:c4:7a:bd:15:85 brd ff:ff:ff:ff:ff:ff 2023-10-06T01:22:15.706 INFO:teuthology.orchestra.run.smithi050.stdout: altname enp1s0f1 2023-10-06T01:22:15.706 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-10-06T01:22:15.706 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T01:22:15.707 DEBUG:teuthology.orchestra.run.smithi050:> (cd / && exec bash -c ' 2023-10-06T01:22:15.707 DEBUG:teuthology.orchestra.run.smithi050:> set -e 2023-10-06T01:22:15.707 DEBUG:teuthology.orchestra.run.smithi050:> sudo ip link add name ceph-brx type bridge 2023-10-06T01:22:15.707 DEBUG:teuthology.orchestra.run.smithi050:> sudo ip addr flush dev ceph-brx 2023-10-06T01:22:15.707 DEBUG:teuthology.orchestra.run.smithi050:> sudo ip link set ceph-brx up 2023-10-06T01:22:15.707 DEBUG:teuthology.orchestra.run.smithi050:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-10-06T01:22:15.707 DEBUG:teuthology.orchestra.run.smithi050:> ') 2023-10-06T01:22:15.934 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T01:22:15.934 DEBUG:teuthology.orchestra.run.smithi050:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-06T01:22:15.996 INFO:teuthology.orchestra.run.smithi050.stdout:1 2023-10-06T01:22:15.999 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T01:22:15.999 DEBUG:teuthology.orchestra.run.smithi050:> route 2023-10-06T01:22:16.038 INFO:teuthology.orchestra.run.smithi050.stdout:Kernel IP routing table 2023-10-06T01:22:16.039 INFO:teuthology.orchestra.run.smithi050.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-06T01:22:16.039 INFO:teuthology.orchestra.run.smithi050.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2023-10-06T01:22:16.039 INFO:teuthology.orchestra.run.smithi050.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2023-10-06T01:22:16.039 INFO:teuthology.orchestra.run.smithi050.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-06T01:22:16.039 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T01:22:16.039 DEBUG:teuthology.orchestra.run.smithi050:> (cd / && exec bash -c ' 2023-10-06T01:22:16.039 DEBUG:teuthology.orchestra.run.smithi050:> set -e 2023-10-06T01:22:16.040 DEBUG:teuthology.orchestra.run.smithi050:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-10-06T01:22:16.040 DEBUG:teuthology.orchestra.run.smithi050:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-10-06T01:22:16.040 DEBUG:teuthology.orchestra.run.smithi050:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-10-06T01:22:16.040 DEBUG:teuthology.orchestra.run.smithi050:> ') 2023-10-06T01:22:16.239 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T01:22:16.239 DEBUG:teuthology.orchestra.run.smithi050:> ip netns list 2023-10-06T01:22:16.276 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T01:22:16.276 DEBUG:teuthology.orchestra.run.smithi050:> ip netns list-id 2023-10-06T01:22:16.354 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T01:22:16.354 DEBUG:teuthology.orchestra.run.smithi050:> (cd / && exec bash -c ' 2023-10-06T01:22:16.354 DEBUG:teuthology.orchestra.run.smithi050:> set -e 2023-10-06T01:22:16.354 DEBUG:teuthology.orchestra.run.smithi050:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-06T01:22:16.354 DEBUG:teuthology.orchestra.run.smithi050:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2023-10-06T01:22:16.354 DEBUG:teuthology.orchestra.run.smithi050:> ') 2023-10-06T01:22:16.524 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2023-10-06T01:22:16.524 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T01:22:16.525 DEBUG:teuthology.orchestra.run.smithi050:> (cd / && exec bash -c ' 2023-10-06T01:22:16.525 DEBUG:teuthology.orchestra.run.smithi050:> set -e 2023-10-06T01:22:16.525 DEBUG:teuthology.orchestra.run.smithi050:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2023-10-06T01:22:16.525 DEBUG:teuthology.orchestra.run.smithi050:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-10-06T01:22:16.525 DEBUG:teuthology.orchestra.run.smithi050:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2023-10-06T01:22:16.525 DEBUG:teuthology.orchestra.run.smithi050:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2023-10-06T01:22:16.525 DEBUG:teuthology.orchestra.run.smithi050:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2023-10-06T01:22:16.525 DEBUG:teuthology.orchestra.run.smithi050:> ') 2023-10-06T01:22:16.761 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T01:22:16.761 DEBUG:teuthology.orchestra.run.smithi050:> (cd / && exec bash -c ' 2023-10-06T01:22:16.761 DEBUG:teuthology.orchestra.run.smithi050:> set -e 2023-10-06T01:22:16.762 DEBUG:teuthology.orchestra.run.smithi050:> sudo ip link set brx.0 up 2023-10-06T01:22:16.762 DEBUG:teuthology.orchestra.run.smithi050:> sudo ip link set dev brx.0 master ceph-brx 2023-10-06T01:22:16.762 DEBUG:teuthology.orchestra.run.smithi050:> ') 2023-10-06T01:22:16.924 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-06T01:22:16.924 DEBUG:teuthology.orchestra.run.smithi050:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-10-06T01:22:16.961 INFO:teuthology.orchestra.run.smithi050.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-10-06T01:22:16.962 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-06T01:22:16.962 DEBUG:teuthology.orchestra.run.smithi050:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-10-06T01:22:17.037 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2023-10-06T01:22:17.037 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-10-06T01:22:17.037 DEBUG:teuthology.orchestra.run.smithi050:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-10-06T01:22:17.171 INFO:teuthology.orchestra.run.smithi050.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-10-06T01:22:17.171 INFO:teuthology.orchestra.run.smithi050.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-10-06T01:22:17.171 INFO:teuthology.orchestra.run.smithi050.stdout:invalid new device string format 2023-10-06T01:22:17.650 INFO:teuthology.orchestra.run.smithi050.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-10-06T01:22:17.650 INFO:teuthology.orchestra.run.smithi050.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-10-06T01:22:17.650 INFO:teuthology.orchestra.run.smithi050.stdout:invalid new device string format 2023-10-06T01:22:17.650 INFO:teuthology.orchestra.run.smithi050.stdout:mount.ceph: resolved to: "172.21.15.50:3300,172.21.15.155:3300,172.21.15.155:3301" 2023-10-06T01:22:17.651 INFO:teuthology.orchestra.run.smithi050.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-06T01:22:17.674 INFO:teuthology.orchestra.run.smithi050.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-10-06T01:22:17.674 INFO:teuthology.orchestra.run.smithi050.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-10-06T01:22:17.674 INFO:teuthology.orchestra.run.smithi050.stdout:invalid new device string format 2023-10-06T01:22:17.675 INFO:teuthology.orchestra.run.smithi050.stdout:mount.ceph: resolved to: "172.21.15.50:3300,172.21.15.155:3300,172.21.15.155:3301" 2023-10-06T01:22:17.675 INFO:teuthology.orchestra.run.smithi050.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-06T01:22:17.675 INFO:teuthology.orchestra.run.smithi050.stdout:mount.ceph: resolved to: "172.21.15.50:6789,172.21.15.155:6789,172.21.15.155:6790" 2023-10-06T01:22:17.675 INFO:teuthology.orchestra.run.smithi050.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.50:6789,172.21.15.155:6789,172.21.15.155:6790:/ 2023-10-06T01:22:17.675 INFO:teuthology.orchestra.run.smithi050.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=0bfd9a6b-1587-4fe4-a89e-e43c00286b4e" will pass to kernel 2023-10-06T01:22:17.679 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-10-06T01:22:17.679 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T01:22:17.679 DEBUG:teuthology.orchestra.run.smithi050:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-10-06T01:22:17.741 INFO:tasks.kclient:client.2 config is {'syntax': 'v1'} 2023-10-06T01:22:17.741 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-06T01:22:17.931 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:17.930+0000 7fa2b359d700 1 Processor -- start 2023-10-06T01:22:17.931 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:17.930+0000 7fa2b359d700 1 -- start start 2023-10-06T01:22:17.933 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:17.931+0000 7fa2b359d700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa2ac06a5d0 0x7fa2ac153730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:17.934 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:17.931+0000 7fa2b359d700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fa2ac06a9a0 0x7fa2ac153c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:17.934 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:17.931+0000 7fa2b359d700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fa2ac06df90 0x7fa2ac06e3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:17.934 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:17.931+0000 7fa2b359d700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa2ac06f5a0 con 0x7fa2ac06a9a0 2023-10-06T01:22:17.934 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:17.931+0000 7fa2b359d700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa2ac0c9d00 con 0x7fa2ac06df90 2023-10-06T01:22:17.934 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:17.931+0000 7fa2b359d700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2ac0c6750 con 0x7fa2ac06a5d0 2023-10-06T01:22:17.934 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:17.932+0000 7fa2b1d9a700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fa2ac06a9a0 0x7fa2ac153c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:17.934 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:17.932+0000 7fa2b1d9a700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fa2ac06a9a0 0x7fa2ac153c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:48028/0 (socket says 172.21.15.50:48028) 2023-10-06T01:22:17.934 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:17.932+0000 7fa2b1d9a700 1 -- 172.21.15.50:0/22329002 learned_addr learned my addr 172.21.15.50:0/22329002 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-06T01:22:17.934 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:17.932+0000 7fa2b2d9c700 1 --2- 172.21.15.50:0/22329002 >> v2:172.21.15.155:3300/0 conn(0x7fa2ac06df90 0x7fa2ac06e3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:17.934 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:17.932+0000 7fa2b259b700 1 --2- 172.21.15.50:0/22329002 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa2ac06a5d0 0x7fa2ac153730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:17.935 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:17.932+0000 7fa2b1d9a700 1 -- 172.21.15.50:0/22329002 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa2ac06a5d0 msgr2=0x7fa2ac153730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:22:17.935 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:17.932+0000 7fa2b1d9a700 1 --2- 172.21.15.50:0/22329002 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa2ac06a5d0 0x7fa2ac153730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:17.935 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:17.932+0000 7fa2b1d9a700 1 -- 172.21.15.50:0/22329002 >> v2:172.21.15.155:3300/0 conn(0x7fa2ac06df90 msgr2=0x7fa2ac06e3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:22:17.935 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:17.932+0000 7fa2b1d9a700 1 --2- 172.21.15.50:0/22329002 >> v2:172.21.15.155:3300/0 conn(0x7fa2ac06df90 0x7fa2ac06e3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:17.935 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:17.932+0000 7fa2b1d9a700 1 -- 172.21.15.50:0/22329002 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2ac06ed00 con 0x7fa2ac06a9a0 2023-10-06T01:22:17.935 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:17.932+0000 7fa2b2d9c700 1 --2- 172.21.15.50:0/22329002 >> v2:172.21.15.155:3300/0 conn(0x7fa2ac06df90 0x7fa2ac06e3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T01:22:17.935 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:17.932+0000 7fa2b1d9a700 1 --2- 172.21.15.50:0/22329002 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa2ac06a9a0 0x7fa2ac153c70 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fa2ac06c960 tx=0x7fa29c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6a88530a8de9a00 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:22:17.935 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:17.933+0000 7fa2b1599700 1 -- 172.21.15.50:0/22329002 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa29c00b820 con 0x7fa2ac06a9a0 2023-10-06T01:22:17.935 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:17.933+0000 7fa2b1599700 1 -- 172.21.15.50:0/22329002 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa29c00b980 con 0x7fa2ac06a9a0 2023-10-06T01:22:17.935 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:17.933+0000 7fa2b1599700 1 -- 172.21.15.50:0/22329002 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa29c00bd20 con 0x7fa2ac06a9a0 2023-10-06T01:22:17.936 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:17.933+0000 7fa2b359d700 1 -- 172.21.15.50:0/22329002 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa2ac06a9a0 msgr2=0x7fa2ac153c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:17.936 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:17.933+0000 7fa2b359d700 1 --2- 172.21.15.50:0/22329002 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa2ac06a9a0 0x7fa2ac153c70 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fa2ac06c960 tx=0x7fa29c009250 comp rx=0 tx=0).stop 2023-10-06T01:22:17.936 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:17.933+0000 7fa2b359d700 1 -- 172.21.15.50:0/22329002 shutdown_connections 2023-10-06T01:22:17.937 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:17.933+0000 7fa2b359d700 1 --2- 172.21.15.50:0/22329002 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa2ac06a5d0 0x7fa2ac153730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:17.937 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:17.933+0000 7fa2b359d700 1 --2- 172.21.15.50:0/22329002 >> v2:172.21.15.155:3300/0 conn(0x7fa2ac06df90 0x7fa2ac06e3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:17.937 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:17.933+0000 7fa2b359d700 1 --2- 172.21.15.50:0/22329002 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa2ac06a9a0 0x7fa2ac153c70 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:17.937 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:17.933+0000 7fa2b359d700 1 -- 172.21.15.50:0/22329002 >> 172.21.15.50:0/22329002 conn(0x7fa2ac0680c0 msgr2=0x7fa2ac0cbf00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:22:17.937 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:17.933+0000 7fa2b359d700 1 -- 172.21.15.50:0/22329002 shutdown_connections 2023-10-06T01:22:17.937 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:17.933+0000 7fa2b359d700 1 -- 172.21.15.50:0/22329002 wait complete. 2023-10-06T01:22:17.937 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:17.935+0000 7fa2b359d700 1 Processor -- start 2023-10-06T01:22:17.937 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:17.935+0000 7fa2b359d700 1 -- start start 2023-10-06T01:22:17.939 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:17.936+0000 7fa2b359d700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa2ac06a5d0 0x7fa2ac0c5010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:17.939 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:17.936+0000 7fa2b359d700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa2ac06a9a0 0x7fa2ac0af870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:17.939 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:17.936+0000 7fa2b359d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa2ac06df90 0x7fa2ac154940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:17.939 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:17.936+0000 7fa2b359d700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2ac0afdb0 con 0x7fa2ac06df90 2023-10-06T01:22:17.939 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:17.936+0000 7fa2b359d700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2ac0c4b80 con 0x7fa2ac06a9a0 2023-10-06T01:22:17.940 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:17.936+0000 7fa2b359d700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2ac0c3f70 con 0x7fa2ac06a5d0 2023-10-06T01:22:17.940 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:17.936+0000 7fa2b2d9c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa2ac06df90 0x7fa2ac154940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:17.940 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:17.936+0000 7fa2b2d9c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa2ac06df90 0x7fa2ac154940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:48036/0 (socket says 172.21.15.50:48036) 2023-10-06T01:22:17.940 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:17.936+0000 7fa2b2d9c700 1 -- 172.21.15.50:0/465728237 learned_addr learned my addr 172.21.15.50:0/465728237 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-06T01:22:17.940 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:17.937+0000 7fa2b259b700 1 --2- 172.21.15.50:0/465728237 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa2ac06a5d0 0x7fa2ac0c5010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:17.940 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:17.937+0000 7fa2b1d9a700 1 --2- 172.21.15.50:0/465728237 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa2ac06a9a0 0x7fa2ac0af870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:17.940 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:17.937+0000 7fa2b2d9c700 1 -- 172.21.15.50:0/465728237 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa2ac06a5d0 msgr2=0x7fa2ac0c5010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:17.940 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:17.937+0000 7fa2b2d9c700 1 --2- 172.21.15.50:0/465728237 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa2ac06a5d0 0x7fa2ac0c5010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:17.940 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:17.937+0000 7fa2b2d9c700 1 -- 172.21.15.50:0/465728237 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa2ac06a9a0 msgr2=0x7fa2ac0af870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:17.940 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:17.937+0000 7fa2b2d9c700 1 --2- 172.21.15.50:0/465728237 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa2ac06a9a0 0x7fa2ac0af870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:17.940 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:17.937+0000 7fa2b2d9c700 1 -- 172.21.15.50:0/465728237 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa29c0094f0 con 0x7fa2ac06df90 2023-10-06T01:22:17.941 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:17.937+0000 7fa2b2d9c700 1 --2- 172.21.15.50:0/465728237 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa2ac06df90 0x7fa2ac154940 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fa2a400d180 tx=0x7fa2a4009a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:22:17.941 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:17.937+0000 7fa2a27fc700 1 -- 172.21.15.50:0/465728237 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2a400dc60 con 0x7fa2ac06df90 2023-10-06T01:22:17.941 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:17.937+0000 7fa2a27fc700 1 -- 172.21.15.50:0/465728237 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2a400f040 con 0x7fa2ac06df90 2023-10-06T01:22:17.941 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:17.937+0000 7fa2a27fc700 1 -- 172.21.15.50:0/465728237 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2a4015440 con 0x7fa2ac06df90 2023-10-06T01:22:17.941 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:17.937+0000 7fa2b359d700 1 -- 172.21.15.50:0/465728237 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa2ac0c4250 con 0x7fa2ac06df90 2023-10-06T01:22:17.941 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:17.938+0000 7fa2b359d700 1 -- 172.21.15.50:0/465728237 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa2ac0c4810 con 0x7fa2ac06df90 2023-10-06T01:22:17.941 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:17.939+0000 7fa2b359d700 1 -- 172.21.15.50:0/465728237 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa2ac05f270 con 0x7fa2ac06df90 2023-10-06T01:22:17.942 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:17.939+0000 7fa2a27fc700 1 -- 172.21.15.50:0/465728237 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fa2a40143a0 con 0x7fa2ac06df90 2023-10-06T01:22:17.942 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:17.940+0000 7fa2a27fc700 1 --2- 172.21.15.50:0/465728237 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7fa290066f30 0x7fa2900693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:17.942 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:17.940+0000 7fa2a27fc700 1 -- 172.21.15.50:0/465728237 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6809+0+0 (secure 0 0 0) 0x7fa2a4084e40 con 0x7fa2ac06df90 2023-10-06T01:22:17.942 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:17.941+0000 7fa2b259b700 1 --2- 172.21.15.50:0/465728237 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7fa290066f30 0x7fa2900693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:17.942 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:17.942+0000 7fa2b259b700 1 --2- 172.21.15.50:0/465728237 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7fa290066f30 0x7fa2900693e0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fa2a8006fd0 tx=0x7fa2a8008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:22:17.945 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:17.945+0000 7fa2a27fc700 1 -- 172.21.15.50:0/465728237 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fa2a4051bc0 con 0x7fa2ac06df90 2023-10-06T01:22:18.195 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:18.194+0000 7fa2b359d700 1 -- 172.21.15.50:0/465728237 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fa2ac0c4cc0 con 0x7fa2ac06df90 2023-10-06T01:22:18.195 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:18.194+0000 7fa2a27fc700 1 -- 172.21.15.50:0/465728237 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v9) v1 ==== 53+0+88 (secure 0 0 0) 0x7fa2a401a070 con 0x7fa2ac06df90 2023-10-06T01:22:18.196 INFO:teuthology.orchestra.run.smithi050.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2023-10-06T01:22:18.198 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:18.197+0000 7fa2b359d700 1 -- 172.21.15.50:0/465728237 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7fa290066f30 msgr2=0x7fa2900693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:18.198 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:18.197+0000 7fa2b359d700 1 --2- 172.21.15.50:0/465728237 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7fa290066f30 0x7fa2900693e0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fa2a8006fd0 tx=0x7fa2a8008040 comp rx=0 tx=0).stop 2023-10-06T01:22:18.198 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:18.197+0000 7fa2b359d700 1 -- 172.21.15.50:0/465728237 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa2ac06df90 msgr2=0x7fa2ac154940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:18.198 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:18.197+0000 7fa2b359d700 1 --2- 172.21.15.50:0/465728237 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa2ac06df90 0x7fa2ac154940 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fa2a400d180 tx=0x7fa2a4009a50 comp rx=0 tx=0).stop 2023-10-06T01:22:18.199 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:18.197+0000 7fa2b359d700 1 -- 172.21.15.50:0/465728237 shutdown_connections 2023-10-06T01:22:18.199 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:18.197+0000 7fa2b359d700 1 --2- 172.21.15.50:0/465728237 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa2ac06df90 0x7fa2ac154940 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:18.199 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:18.197+0000 7fa2b359d700 1 --2- 172.21.15.50:0/465728237 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa2ac06a5d0 0x7fa2ac0c5010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:18.199 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:18.197+0000 7fa2b359d700 1 --2- 172.21.15.50:0/465728237 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7fa290066f30 0x7fa2900693e0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:18.199 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:18.197+0000 7fa2b359d700 1 --2- 172.21.15.50:0/465728237 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa2ac06a9a0 0x7fa2ac0af870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:18.199 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:18.197+0000 7fa2b359d700 1 -- 172.21.15.50:0/465728237 >> 172.21.15.50:0/465728237 conn(0x7fa2ac0680c0 msgr2=0x7fa2ac145ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:22:18.199 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:18.197+0000 7fa2b359d700 1 -- 172.21.15.50:0/465728237 shutdown_connections 2023-10-06T01:22:18.199 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:18.197+0000 7fa2b359d700 1 -- 172.21.15.50:0/465728237 wait complete. 2023-10-06T01:22:18.216 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-10-06T01:22:18.216 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-06T01:22:18.216 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi050.front.sepia.ceph.com 2023-10-06T01:22:18.216 INFO:tasks.cephfs.mount:self.client.name = client.2 2023-10-06T01:22:18.216 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2023-10-06T01:22:18.216 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-10-06T01:22:18.216 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-10-06T01:22:18.216 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-06T01:22:18.216 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.2' 2023-10-06T01:22:18.217 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T01:22:18.217 DEBUG:teuthology.orchestra.run.smithi050:> ip addr 2023-10-06T01:22:18.254 INFO:teuthology.orchestra.run.smithi050.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-06T01:22:18.254 INFO:teuthology.orchestra.run.smithi050.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-06T01:22:18.254 INFO:teuthology.orchestra.run.smithi050.stdout: inet 127.0.0.1/8 scope host lo 2023-10-06T01:22:18.254 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft forever preferred_lft forever 2023-10-06T01:22:18.254 INFO:teuthology.orchestra.run.smithi050.stdout: inet6 ::1/128 scope host 2023-10-06T01:22:18.254 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft forever preferred_lft forever 2023-10-06T01:22:18.254 INFO:teuthology.orchestra.run.smithi050.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T01:22:18.255 INFO:teuthology.orchestra.run.smithi050.stdout: link/ether 0c:c4:7a:6b:fd:f8 brd ff:ff:ff:ff:ff:ff 2023-10-06T01:22:18.255 INFO:teuthology.orchestra.run.smithi050.stdout: altname enp7s0f0 2023-10-06T01:22:18.255 INFO:teuthology.orchestra.run.smithi050.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T01:22:18.255 INFO:teuthology.orchestra.run.smithi050.stdout: link/ether 0c:c4:7a:6b:fd:f9 brd ff:ff:ff:ff:ff:ff 2023-10-06T01:22:18.255 INFO:teuthology.orchestra.run.smithi050.stdout: altname enp7s0f1 2023-10-06T01:22:18.255 INFO:teuthology.orchestra.run.smithi050.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-06T01:22:18.255 INFO:teuthology.orchestra.run.smithi050.stdout: link/ether 0c:c4:7a:bd:15:84 brd ff:ff:ff:ff:ff:ff 2023-10-06T01:22:18.255 INFO:teuthology.orchestra.run.smithi050.stdout: altname enp1s0f0 2023-10-06T01:22:18.255 INFO:teuthology.orchestra.run.smithi050.stdout: inet 172.21.15.50/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2023-10-06T01:22:18.255 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft 42215sec preferred_lft 42215sec 2023-10-06T01:22:18.256 INFO:teuthology.orchestra.run.smithi050.stdout: inet6 fe80::ec4:7aff:febd:1584/64 scope link 2023-10-06T01:22:18.256 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft forever preferred_lft forever 2023-10-06T01:22:18.256 INFO:teuthology.orchestra.run.smithi050.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T01:22:18.256 INFO:teuthology.orchestra.run.smithi050.stdout: link/ether 0c:c4:7a:bd:15:85 brd ff:ff:ff:ff:ff:ff 2023-10-06T01:22:18.256 INFO:teuthology.orchestra.run.smithi050.stdout: altname enp1s0f1 2023-10-06T01:22:18.256 INFO:teuthology.orchestra.run.smithi050.stdout:8: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-06T01:22:18.256 INFO:teuthology.orchestra.run.smithi050.stdout: link/ether 6e:d9:e7:45:0d:b7 brd ff:ff:ff:ff:ff:ff 2023-10-06T01:22:18.256 INFO:teuthology.orchestra.run.smithi050.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-10-06T01:22:18.256 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft forever preferred_lft forever 2023-10-06T01:22:18.256 INFO:teuthology.orchestra.run.smithi050.stdout: inet6 fe80::f0e9:6fff:fe2b:7f30/64 scope link 2023-10-06T01:22:18.256 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft forever preferred_lft forever 2023-10-06T01:22:18.257 INFO:teuthology.orchestra.run.smithi050.stdout:9: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-06T01:22:18.257 INFO:teuthology.orchestra.run.smithi050.stdout: link/ether 6e:d9:e7:45:0d:b7 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-06T01:22:18.257 INFO:teuthology.orchestra.run.smithi050.stdout: inet6 fe80::6cd9:e7ff:fe45:db7/64 scope link tentative 2023-10-06T01:22:18.257 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft forever preferred_lft forever 2023-10-06T01:22:18.257 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T01:22:18.257 DEBUG:teuthology.orchestra.run.smithi050:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-06T01:22:18.353 INFO:teuthology.orchestra.run.smithi050.stdout:1 2023-10-06T01:22:18.357 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T01:22:18.357 DEBUG:teuthology.orchestra.run.smithi050:> route 2023-10-06T01:22:18.396 INFO:teuthology.orchestra.run.smithi050.stdout:Kernel IP routing table 2023-10-06T01:22:18.396 INFO:teuthology.orchestra.run.smithi050.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-06T01:22:18.396 INFO:teuthology.orchestra.run.smithi050.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2023-10-06T01:22:18.396 INFO:teuthology.orchestra.run.smithi050.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2023-10-06T01:22:18.396 INFO:teuthology.orchestra.run.smithi050.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-06T01:22:18.396 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T01:22:18.397 DEBUG:teuthology.orchestra.run.smithi050:> (cd / && exec bash -c ' 2023-10-06T01:22:18.397 DEBUG:teuthology.orchestra.run.smithi050:> set -e 2023-10-06T01:22:18.397 DEBUG:teuthology.orchestra.run.smithi050:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-10-06T01:22:18.397 DEBUG:teuthology.orchestra.run.smithi050:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-10-06T01:22:18.397 DEBUG:teuthology.orchestra.run.smithi050:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-10-06T01:22:18.397 DEBUG:teuthology.orchestra.run.smithi050:> ') 2023-10-06T01:22:18.595 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T01:22:18.595 DEBUG:teuthology.orchestra.run.smithi050:> ip netns list 2023-10-06T01:22:18.631 INFO:teuthology.orchestra.run.smithi050.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-10-06T01:22:18.632 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T01:22:18.632 DEBUG:teuthology.orchestra.run.smithi050:> ip netns list-id 2023-10-06T01:22:18.708 INFO:teuthology.orchestra.run.smithi050.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.0) 2023-10-06T01:22:18.709 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T01:22:18.709 DEBUG:teuthology.orchestra.run.smithi050:> (cd / && exec bash -c ' 2023-10-06T01:22:18.709 DEBUG:teuthology.orchestra.run.smithi050:> set -e 2023-10-06T01:22:18.709 DEBUG:teuthology.orchestra.run.smithi050:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.2 2023-10-06T01:22:18.709 DEBUG:teuthology.orchestra.run.smithi050:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.2 1 2023-10-06T01:22:18.709 DEBUG:teuthology.orchestra.run.smithi050:> ') 2023-10-06T01:22:18.880 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T01:22:18.880 DEBUG:teuthology.orchestra.run.smithi050:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2023-10-06T01:22:18.942 INFO:teuthology.orchestra.run.smithi050.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-06T01:22:18.942 INFO:teuthology.orchestra.run.smithi050.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-06T01:22:18.942 INFO:teuthology.orchestra.run.smithi050.stdout: inet 127.0.0.1/8 scope host lo 2023-10-06T01:22:18.942 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft forever preferred_lft forever 2023-10-06T01:22:18.942 INFO:teuthology.orchestra.run.smithi050.stdout: inet6 ::1/128 scope host 2023-10-06T01:22:18.943 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft forever preferred_lft forever 2023-10-06T01:22:18.943 INFO:teuthology.orchestra.run.smithi050.stdout:2: veth0@if9: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-06T01:22:18.943 INFO:teuthology.orchestra.run.smithi050.stdout: link/ether 76:f7:ad:7c:a7:36 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-10-06T01:22:18.943 INFO:teuthology.orchestra.run.smithi050.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-10-06T01:22:18.943 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft forever preferred_lft forever 2023-10-06T01:22:18.943 INFO:teuthology.orchestra.run.smithi050.stdout: inet6 fe80::74f7:adff:fe7c:a736/64 scope link 2023-10-06T01:22:18.943 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft forever preferred_lft forever 2023-10-06T01:22:18.945 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T01:22:18.945 DEBUG:teuthology.orchestra.run.smithi050:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2023-10-06T01:22:19.010 INFO:teuthology.orchestra.run.smithi050.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-06T01:22:19.010 INFO:teuthology.orchestra.run.smithi050.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-06T01:22:19.010 INFO:teuthology.orchestra.run.smithi050.stdout: inet 127.0.0.1/8 scope host lo 2023-10-06T01:22:19.010 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft forever preferred_lft forever 2023-10-06T01:22:19.010 INFO:teuthology.orchestra.run.smithi050.stdout: inet6 ::1/128 scope host 2023-10-06T01:22:19.010 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft forever preferred_lft forever 2023-10-06T01:22:19.010 INFO:teuthology.orchestra.run.smithi050.stdout:2: veth0@if9: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-06T01:22:19.010 INFO:teuthology.orchestra.run.smithi050.stdout: link/ether 76:f7:ad:7c:a7:36 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-10-06T01:22:19.011 INFO:teuthology.orchestra.run.smithi050.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-10-06T01:22:19.011 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft forever preferred_lft forever 2023-10-06T01:22:19.011 INFO:teuthology.orchestra.run.smithi050.stdout: inet6 fe80::74f7:adff:fe7c:a736/64 scope link 2023-10-06T01:22:19.011 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft forever preferred_lft forever 2023-10-06T01:22:19.011 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.2' with 192.168.0.2/16 2023-10-06T01:22:19.011 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T01:22:19.012 DEBUG:teuthology.orchestra.run.smithi050:> (cd / && exec bash -c ' 2023-10-06T01:22:19.012 DEBUG:teuthology.orchestra.run.smithi050:> set -e 2023-10-06T01:22:19.012 DEBUG:teuthology.orchestra.run.smithi050:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.2 type veth peer name brx.1 2023-10-06T01:22:19.012 DEBUG:teuthology.orchestra.run.smithi050:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2023-10-06T01:22:19.012 DEBUG:teuthology.orchestra.run.smithi050:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set veth0 up 2023-10-06T01:22:19.012 DEBUG:teuthology.orchestra.run.smithi050:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set lo up 2023-10-06T01:22:19.012 DEBUG:teuthology.orchestra.run.smithi050:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip route add default via 192.168.255.254 2023-10-06T01:22:19.012 DEBUG:teuthology.orchestra.run.smithi050:> ') 2023-10-06T01:22:19.249 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T01:22:19.249 DEBUG:teuthology.orchestra.run.smithi050:> (cd / && exec bash -c ' 2023-10-06T01:22:19.249 DEBUG:teuthology.orchestra.run.smithi050:> set -e 2023-10-06T01:22:19.249 DEBUG:teuthology.orchestra.run.smithi050:> sudo ip link set brx.1 up 2023-10-06T01:22:19.249 DEBUG:teuthology.orchestra.run.smithi050:> sudo ip link set dev brx.1 master ceph-brx 2023-10-06T01:22:19.249 DEBUG:teuthology.orchestra.run.smithi050:> ') 2023-10-06T01:22:19.407 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-06T01:22:19.407 DEBUG:teuthology.orchestra.run.smithi050:> mkdir -p -v /home/ubuntu/cephtest/mnt.2 2023-10-06T01:22:19.444 INFO:teuthology.orchestra.run.smithi050.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.2' 2023-10-06T01:22:19.445 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-06T01:22:19.445 DEBUG:teuthology.orchestra.run.smithi050:> chmod 0000 /home/ubuntu/cephtest/mnt.2 2023-10-06T01:22:19.521 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2023-10-06T01:22:19.521 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-10-06T01:22:19.521 DEBUG:teuthology.orchestra.run.smithi050:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.2 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=2,mds_namespace=cephfs 2023-10-06T01:22:19.653 INFO:teuthology.orchestra.run.smithi050.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=2,mds_namespace=cephfs 2023-10-06T01:22:19.654 INFO:teuthology.orchestra.run.smithi050.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,mds_namespace=cephfs". 2023-10-06T01:22:19.654 INFO:teuthology.orchestra.run.smithi050.stdout:invalid new device string format 2023-10-06T01:22:19.670 INFO:teuthology.orchestra.run.smithi050.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=2,mds_namespace=cephfs 2023-10-06T01:22:19.670 INFO:teuthology.orchestra.run.smithi050.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,mds_namespace=cephfs". 2023-10-06T01:22:19.670 INFO:teuthology.orchestra.run.smithi050.stdout:invalid new device string format 2023-10-06T01:22:19.670 INFO:teuthology.orchestra.run.smithi050.stdout:mount.ceph: resolved to: "172.21.15.50:3300,172.21.15.155:3300,172.21.15.155:3301" 2023-10-06T01:22:19.670 INFO:teuthology.orchestra.run.smithi050.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-06T01:22:19.691 INFO:teuthology.orchestra.run.smithi050.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=2,mds_namespace=cephfs 2023-10-06T01:22:19.691 INFO:teuthology.orchestra.run.smithi050.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,mds_namespace=cephfs". 2023-10-06T01:22:19.692 INFO:teuthology.orchestra.run.smithi050.stdout:invalid new device string format 2023-10-06T01:22:19.692 INFO:teuthology.orchestra.run.smithi050.stdout:mount.ceph: resolved to: "172.21.15.50:3300,172.21.15.155:3300,172.21.15.155:3301" 2023-10-06T01:22:19.692 INFO:teuthology.orchestra.run.smithi050.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-06T01:22:19.692 INFO:teuthology.orchestra.run.smithi050.stdout:mount.ceph: resolved to: "172.21.15.50:6789,172.21.15.155:6789,172.21.15.155:6790" 2023-10-06T01:22:19.692 INFO:teuthology.orchestra.run.smithi050.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.50:6789,172.21.15.155:6789,172.21.15.155:6790:/ 2023-10-06T01:22:19.692 INFO:teuthology.orchestra.run.smithi050.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,mds_namespace=cephfs,key=2,fsid=0bfd9a6b-1587-4fe4-a89e-e43c00286b4e" will pass to kernel 2023-10-06T01:22:19.698 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-10-06T01:22:19.698 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T01:22:19.698 DEBUG:teuthology.orchestra.run.smithi050:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.2 2023-10-06T01:22:19.760 INFO:tasks.kclient:client.1 config is {'syntax': 'v1'} 2023-10-06T01:22:19.761 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-06T01:22:19.948 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:19.947+0000 7f0bb359e700 1 Processor -- start 2023-10-06T01:22:19.949 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:19.948+0000 7f0bb359e700 1 -- start start 2023-10-06T01:22:19.950 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:19.949+0000 7f0bb359e700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f0bb40cadf0 0x7f0bb40cc620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:19.950 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:19.949+0000 7f0bb359e700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0bb40cdc60 con 0x7f0bb40ccb60 2023-10-06T01:22:19.950 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:19.949+0000 7f0bb359e700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0bb40cd050 con 0x7f0bb415dca0 2023-10-06T01:22:19.950 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:19.949+0000 7f0bb359e700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0bb40cd330 con 0x7f0bb40cadf0 2023-10-06T01:22:19.950 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:19.949+0000 7f0bb259c700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f0bb40cadf0 0x7f0bb40cc620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:19.950 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:19.949+0000 7f0bb1d9b700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f0bb40ccb60 0x7f0bb4158f30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:53204/0 (socket says 172.21.15.50:53204) 2023-10-06T01:22:19.950 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:19.949+0000 7f0bb1d9b700 1 -- 172.21.15.50:0/2721622477 learned_addr learned my addr 172.21.15.50:0/2721622477 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-10-06T01:22:19.952 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:19.949+0000 7f0bb259c700 1 -- 172.21.15.50:0/2721622477 >> v1:172.21.15.155:6789/0 conn(0x7f0bb415dca0 legacy=0x7f0bb4068940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:19.952 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:19.949+0000 7f0bb259c700 1 -- 172.21.15.50:0/2721622477 >> v1:172.21.15.50:6789/0 conn(0x7f0bb40ccb60 legacy=0x7f0bb4158f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:19.952 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:19.950+0000 7f0bb259c700 1 -- 172.21.15.50:0/2721622477 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0bb40cd610 con 0x7f0bb40cadf0 2023-10-06T01:22:19.952 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:19.949+0000 7f0bb159a700 1 -- 172.21.15.50:0/2721622477 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1714267084 0 0) 0x7f0bb40cdc60 con 0x7f0bb40ccb60 2023-10-06T01:22:19.952 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:19.950+0000 7f0bb259c700 1 --2- 172.21.15.50:0/2721622477 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0bb40cadf0 0x7f0bb40cc620 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f0ba40098d0 tx=0x7f0ba4009120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=368d2e5a038abfd server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:22:19.952 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:19.950+0000 7f0bb159a700 1 -- 172.21.15.50:0/2721622477 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ba4009e70 con 0x7f0bb40cadf0 2023-10-06T01:22:19.952 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:19.950+0000 7f0bb159a700 1 -- 172.21.15.50:0/2721622477 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ba4005c10 con 0x7f0bb40cadf0 2023-10-06T01:22:19.952 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:19.950+0000 7f0bb159a700 1 -- 172.21.15.50:0/2721622477 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ba400b650 con 0x7f0bb40cadf0 2023-10-06T01:22:19.953 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:19.950+0000 7f0bb359e700 1 -- 172.21.15.50:0/2721622477 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0bb40cadf0 msgr2=0x7f0bb40cc620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:19.953 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:19.950+0000 7f0bb359e700 1 --2- 172.21.15.50:0/2721622477 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0bb40cadf0 0x7f0bb40cc620 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f0ba40098d0 tx=0x7f0ba4009120 comp rx=0 tx=0).stop 2023-10-06T01:22:19.953 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:19.951+0000 7f0bb359e700 1 -- 172.21.15.50:0/2721622477 shutdown_connections 2023-10-06T01:22:19.953 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:19.951+0000 7f0bb359e700 1 --2- 172.21.15.50:0/2721622477 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0bb40cadf0 0x7f0bb40cc620 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:19.953 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:19.951+0000 7f0bb359e700 1 -- 172.21.15.50:0/2721622477 >> 172.21.15.50:0/2721622477 conn(0x7f0bb4088000 msgr2=0x7f0bb4097470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:22:19.953 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:19.951+0000 7f0bb359e700 1 -- 172.21.15.50:0/2721622477 shutdown_connections 2023-10-06T01:22:19.953 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:19.951+0000 7f0bb359e700 1 -- 172.21.15.50:0/2721622477 wait complete. 2023-10-06T01:22:19.953 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:19.952+0000 7f0bb359e700 1 Processor -- start 2023-10-06T01:22:19.954 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:19.952+0000 7f0bb359e700 1 -- start start 2023-10-06T01:22:19.955 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:19.953+0000 7f0bb359e700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0bb40cadf0 0x7f0bb40994a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:19.955 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:19.953+0000 7f0bb359e700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0bb40ccb60 0x7f0bb4155370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:19.956 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:19.953+0000 7f0bb359e700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0bb415dca0 0x7f0bb40b2fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:19.956 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:19.953+0000 7f0bb359e700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0bb415a8e0 con 0x7f0bb40ccb60 2023-10-06T01:22:19.956 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:19.953+0000 7f0bb359e700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0bb4099010 con 0x7f0bb415dca0 2023-10-06T01:22:19.956 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:19.953+0000 7f0bb359e700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0bb41558b0 con 0x7f0bb40cadf0 2023-10-06T01:22:19.956 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:19.954+0000 7f0bb1d9b700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0bb40ccb60 0x7f0bb4155370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:19.956 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:19.954+0000 7f0bb1d9b700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0bb40ccb60 0x7f0bb4155370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:48060/0 (socket says 172.21.15.50:48060) 2023-10-06T01:22:19.956 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:19.954+0000 7f0bb1d9b700 1 -- 172.21.15.50:0/103841359 learned_addr learned my addr 172.21.15.50:0/103841359 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-06T01:22:19.956 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:19.954+0000 7f0bb2d9d700 1 --2- 172.21.15.50:0/103841359 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0bb415dca0 0x7f0bb40b2fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:19.956 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:19.954+0000 7f0bb259c700 1 --2- 172.21.15.50:0/103841359 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0bb40cadf0 0x7f0bb40994a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:19.956 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:19.954+0000 7f0bb1d9b700 1 -- 172.21.15.50:0/103841359 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0bb40cadf0 msgr2=0x7f0bb40994a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:19.956 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:19.954+0000 7f0bb1d9b700 1 --2- 172.21.15.50:0/103841359 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0bb40cadf0 0x7f0bb40994a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:19.957 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:19.954+0000 7f0bb1d9b700 1 -- 172.21.15.50:0/103841359 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0bb415dca0 msgr2=0x7f0bb40b2fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:19.957 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:19.954+0000 7f0bb1d9b700 1 --2- 172.21.15.50:0/103841359 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0bb415dca0 0x7f0bb40b2fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:19.957 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:19.954+0000 7f0bb1d9b700 1 -- 172.21.15.50:0/103841359 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ba40093c0 con 0x7f0bb40ccb60 2023-10-06T01:22:19.957 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:19.954+0000 7f0bb1d9b700 1 --2- 172.21.15.50:0/103841359 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0bb40ccb60 0x7f0bb4155370 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f0ba800c7e0 tx=0x7f0ba8007d70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:22:19.957 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:19.954+0000 7f0ba27fc700 1 -- 172.21.15.50:0/103841359 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ba8005c00 con 0x7f0bb40ccb60 2023-10-06T01:22:19.957 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:19.954+0000 7f0ba27fc700 1 -- 172.21.15.50:0/103841359 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ba8005d80 con 0x7f0bb40ccb60 2023-10-06T01:22:19.957 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:19.954+0000 7f0ba27fc700 1 -- 172.21.15.50:0/103841359 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ba8007320 con 0x7f0bb40ccb60 2023-10-06T01:22:19.957 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:19.954+0000 7f0bb359e700 1 -- 172.21.15.50:0/103841359 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0bb415a600 con 0x7f0bb40ccb60 2023-10-06T01:22:19.957 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:19.955+0000 7f0bb359e700 1 -- 172.21.15.50:0/103841359 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0bb4098ca0 con 0x7f0bb40ccb60 2023-10-06T01:22:19.958 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:19.956+0000 7f0bb359e700 1 -- 172.21.15.50:0/103841359 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0bb4098820 con 0x7f0bb40ccb60 2023-10-06T01:22:19.958 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:19.956+0000 7f0ba27fc700 1 -- 172.21.15.50:0/103841359 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f0ba801b3b0 con 0x7f0bb40ccb60 2023-10-06T01:22:19.958 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:19.957+0000 7f0ba27fc700 1 --2- 172.21.15.50:0/103841359 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f0b94066f30 0x7f0b940693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:19.958 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:19.958+0000 7f0ba27fc700 1 -- 172.21.15.50:0/103841359 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f0ba8083fc0 con 0x7f0bb40ccb60 2023-10-06T01:22:19.959 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:19.958+0000 7f0bb259c700 1 --2- 172.21.15.50:0/103841359 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f0b94066f30 0x7f0b940693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:19.959 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:19.959+0000 7f0bb259c700 1 --2- 172.21.15.50:0/103841359 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f0b94066f30 0x7f0b940693e0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f0ba4009390 tx=0x7f0ba4016000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:22:19.962 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:19.961+0000 7f0ba27fc700 1 -- 172.21.15.50:0/103841359 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f0bb4098820 con 0x7f0bb40ccb60 2023-10-06T01:22:20.211 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:20.210+0000 7f0bb359e700 1 -- 172.21.15.50:0/103841359 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f0bb4098820 con 0x7f0bb40ccb60 2023-10-06T01:22:20.211 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:20.210+0000 7f0ba27fc700 1 -- 172.21.15.50:0/103841359 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v9) v1 ==== 53+0+88 (secure 0 0 0) 0x7f0bb4098820 con 0x7f0bb40ccb60 2023-10-06T01:22:20.211 INFO:teuthology.orchestra.run.smithi050.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2023-10-06T01:22:20.213 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:20.212+0000 7f0bb359e700 1 -- 172.21.15.50:0/103841359 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f0b94066f30 msgr2=0x7f0b940693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:20.214 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:20.212+0000 7f0bb359e700 1 --2- 172.21.15.50:0/103841359 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f0b94066f30 0x7f0b940693e0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f0ba4009390 tx=0x7f0ba4016000 comp rx=0 tx=0).stop 2023-10-06T01:22:20.214 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:20.212+0000 7f0bb359e700 1 -- 172.21.15.50:0/103841359 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0bb40ccb60 msgr2=0x7f0bb4155370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:20.214 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:20.212+0000 7f0bb359e700 1 --2- 172.21.15.50:0/103841359 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0bb40ccb60 0x7f0bb4155370 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f0ba800c7e0 tx=0x7f0ba8007d70 comp rx=0 tx=0).stop 2023-10-06T01:22:20.214 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:20.212+0000 7f0bb359e700 1 -- 172.21.15.50:0/103841359 shutdown_connections 2023-10-06T01:22:20.214 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:20.212+0000 7f0bb359e700 1 --2- 172.21.15.50:0/103841359 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f0b94066f30 0x7f0b940693e0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:20.214 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:20.212+0000 7f0bb359e700 1 --2- 172.21.15.50:0/103841359 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0bb415dca0 0x7f0bb40b2fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:20.214 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:20.212+0000 7f0bb359e700 1 --2- 172.21.15.50:0/103841359 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0bb40cadf0 0x7f0bb40994a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:20.214 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:20.212+0000 7f0bb359e700 1 --2- 172.21.15.50:0/103841359 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0bb40ccb60 0x7f0bb4155370 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:20.214 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:20.212+0000 7f0bb359e700 1 -- 172.21.15.50:0/103841359 >> 172.21.15.50:0/103841359 conn(0x7f0bb4088000 msgr2=0x7f0bb40c3c10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:22:20.214 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:20.212+0000 7f0bb359e700 1 -- 172.21.15.50:0/103841359 shutdown_connections 2023-10-06T01:22:20.214 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:20.212+0000 7f0bb359e700 1 -- 172.21.15.50:0/103841359 wait complete. 2023-10-06T01:22:20.230 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-10-06T01:22:20.231 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-06T01:22:20.231 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi155.front.sepia.ceph.com 2023-10-06T01:22:20.231 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-10-06T01:22:20.231 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-10-06T01:22:20.231 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-10-06T01:22:20.231 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-10-06T01:22:20.231 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-06T01:22:20.231 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.1' 2023-10-06T01:22:20.231 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T01:22:20.231 DEBUG:teuthology.orchestra.run.smithi155:> ip addr 2023-10-06T01:22:20.272 INFO:teuthology.orchestra.run.smithi155.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-06T01:22:20.272 INFO:teuthology.orchestra.run.smithi155.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-06T01:22:20.272 INFO:teuthology.orchestra.run.smithi155.stdout: inet 127.0.0.1/8 scope host lo 2023-10-06T01:22:20.272 INFO:teuthology.orchestra.run.smithi155.stdout: valid_lft forever preferred_lft forever 2023-10-06T01:22:20.273 INFO:teuthology.orchestra.run.smithi155.stdout: inet6 ::1/128 scope host 2023-10-06T01:22:20.273 INFO:teuthology.orchestra.run.smithi155.stdout: valid_lft forever preferred_lft forever 2023-10-06T01:22:20.273 INFO:teuthology.orchestra.run.smithi155.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T01:22:20.273 INFO:teuthology.orchestra.run.smithi155.stdout: link/ether 0c:c4:7a:d9:a0:fa brd ff:ff:ff:ff:ff:ff 2023-10-06T01:22:20.273 INFO:teuthology.orchestra.run.smithi155.stdout: altname enp7s0f0 2023-10-06T01:22:20.273 INFO:teuthology.orchestra.run.smithi155.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T01:22:20.273 INFO:teuthology.orchestra.run.smithi155.stdout: link/ether 0c:c4:7a:d9:a0:fb brd ff:ff:ff:ff:ff:ff 2023-10-06T01:22:20.273 INFO:teuthology.orchestra.run.smithi155.stdout: altname enp7s0f1 2023-10-06T01:22:20.273 INFO:teuthology.orchestra.run.smithi155.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T01:22:20.273 INFO:teuthology.orchestra.run.smithi155.stdout: link/ether 0c:c4:7a:88:6d:ec brd ff:ff:ff:ff:ff:ff 2023-10-06T01:22:20.273 INFO:teuthology.orchestra.run.smithi155.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-06T01:22:20.273 INFO:teuthology.orchestra.run.smithi155.stdout: link/ether 0c:c4:7a:88:6d:ed brd ff:ff:ff:ff:ff:ff 2023-10-06T01:22:20.273 INFO:teuthology.orchestra.run.smithi155.stdout: inet 172.21.15.155/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-10-06T01:22:20.274 INFO:teuthology.orchestra.run.smithi155.stdout: valid_lft 42238sec preferred_lft 42238sec 2023-10-06T01:22:20.274 INFO:teuthology.orchestra.run.smithi155.stdout: inet6 fe80::ec4:7aff:fe88:6ded/64 scope link 2023-10-06T01:22:20.274 INFO:teuthology.orchestra.run.smithi155.stdout: valid_lft forever preferred_lft forever 2023-10-06T01:22:20.274 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-10-06T01:22:20.274 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T01:22:20.274 DEBUG:teuthology.orchestra.run.smithi155:> (cd / && exec bash -c ' 2023-10-06T01:22:20.274 DEBUG:teuthology.orchestra.run.smithi155:> set -e 2023-10-06T01:22:20.274 DEBUG:teuthology.orchestra.run.smithi155:> sudo ip link add name ceph-brx type bridge 2023-10-06T01:22:20.275 DEBUG:teuthology.orchestra.run.smithi155:> sudo ip addr flush dev ceph-brx 2023-10-06T01:22:20.275 DEBUG:teuthology.orchestra.run.smithi155:> sudo ip link set ceph-brx up 2023-10-06T01:22:20.275 DEBUG:teuthology.orchestra.run.smithi155:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-10-06T01:22:20.275 DEBUG:teuthology.orchestra.run.smithi155:> ') 2023-10-06T01:22:20.740 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T01:22:20.740 DEBUG:teuthology.orchestra.run.smithi155:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-06T01:22:20.804 INFO:teuthology.orchestra.run.smithi155.stdout:1 2023-10-06T01:22:20.807 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T01:22:20.807 DEBUG:teuthology.orchestra.run.smithi155:> route 2023-10-06T01:22:20.865 INFO:teuthology.orchestra.run.smithi155.stdout:Kernel IP routing table 2023-10-06T01:22:20.865 INFO:teuthology.orchestra.run.smithi155.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-06T01:22:20.865 INFO:teuthology.orchestra.run.smithi155.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-10-06T01:22:20.865 INFO:teuthology.orchestra.run.smithi155.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-10-06T01:22:20.865 INFO:teuthology.orchestra.run.smithi155.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-06T01:22:20.866 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T01:22:20.866 DEBUG:teuthology.orchestra.run.smithi155:> (cd / && exec bash -c ' 2023-10-06T01:22:20.866 DEBUG:teuthology.orchestra.run.smithi155:> set -e 2023-10-06T01:22:20.867 DEBUG:teuthology.orchestra.run.smithi155:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-10-06T01:22:20.867 DEBUG:teuthology.orchestra.run.smithi155:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-10-06T01:22:20.867 DEBUG:teuthology.orchestra.run.smithi155:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-10-06T01:22:20.867 DEBUG:teuthology.orchestra.run.smithi155:> ') 2023-10-06T01:22:21.587 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T01:22:21.587 DEBUG:teuthology.orchestra.run.smithi155:> ip netns list 2023-10-06T01:22:21.624 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T01:22:21.624 DEBUG:teuthology.orchestra.run.smithi155:> ip netns list-id 2023-10-06T01:22:21.700 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T01:22:21.701 DEBUG:teuthology.orchestra.run.smithi155:> (cd / && exec bash -c ' 2023-10-06T01:22:21.701 DEBUG:teuthology.orchestra.run.smithi155:> set -e 2023-10-06T01:22:21.701 DEBUG:teuthology.orchestra.run.smithi155:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.1 2023-10-06T01:22:21.701 DEBUG:teuthology.orchestra.run.smithi155:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.1 0 2023-10-06T01:22:21.701 DEBUG:teuthology.orchestra.run.smithi155:> ') 2023-10-06T01:22:21.869 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.1' with 192.168.0.1/16 2023-10-06T01:22:21.870 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T01:22:21.870 DEBUG:teuthology.orchestra.run.smithi155:> (cd / && exec bash -c ' 2023-10-06T01:22:21.870 DEBUG:teuthology.orchestra.run.smithi155:> set -e 2023-10-06T01:22:21.870 DEBUG:teuthology.orchestra.run.smithi155:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.1 type veth peer name brx.0 2023-10-06T01:22:21.870 DEBUG:teuthology.orchestra.run.smithi155:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-10-06T01:22:21.870 DEBUG:teuthology.orchestra.run.smithi155:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set veth0 up 2023-10-06T01:22:21.870 DEBUG:teuthology.orchestra.run.smithi155:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set lo up 2023-10-06T01:22:21.870 DEBUG:teuthology.orchestra.run.smithi155:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip route add default via 192.168.255.254 2023-10-06T01:22:21.871 DEBUG:teuthology.orchestra.run.smithi155:> ') 2023-10-06T01:22:22.123 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T01:22:22.123 DEBUG:teuthology.orchestra.run.smithi155:> (cd / && exec bash -c ' 2023-10-06T01:22:22.123 DEBUG:teuthology.orchestra.run.smithi155:> set -e 2023-10-06T01:22:22.124 DEBUG:teuthology.orchestra.run.smithi155:> sudo ip link set brx.0 up 2023-10-06T01:22:22.124 DEBUG:teuthology.orchestra.run.smithi155:> sudo ip link set dev brx.0 master ceph-brx 2023-10-06T01:22:22.124 DEBUG:teuthology.orchestra.run.smithi155:> ') 2023-10-06T01:22:22.281 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-06T01:22:22.281 DEBUG:teuthology.orchestra.run.smithi155:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-10-06T01:22:22.317 INFO:teuthology.orchestra.run.smithi155.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-10-06T01:22:22.318 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-06T01:22:22.318 DEBUG:teuthology.orchestra.run.smithi155:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-10-06T01:22:22.394 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2023-10-06T01:22:22.394 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-10-06T01:22:22.394 DEBUG:teuthology.orchestra.run.smithi155:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-10-06T01:22:22.540 INFO:teuthology.orchestra.run.smithi155.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-10-06T01:22:22.540 INFO:teuthology.orchestra.run.smithi155.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2023-10-06T01:22:22.540 INFO:teuthology.orchestra.run.smithi155.stdout:invalid new device string format 2023-10-06T01:22:22.984 INFO:teuthology.orchestra.run.smithi155.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-10-06T01:22:22.984 INFO:teuthology.orchestra.run.smithi155.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2023-10-06T01:22:22.984 INFO:teuthology.orchestra.run.smithi155.stdout:invalid new device string format 2023-10-06T01:22:22.984 INFO:teuthology.orchestra.run.smithi155.stdout:mount.ceph: resolved to: "172.21.15.50:3300,172.21.15.155:3300,172.21.15.155:3301" 2023-10-06T01:22:22.984 INFO:teuthology.orchestra.run.smithi155.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-06T01:22:23.007 INFO:teuthology.orchestra.run.smithi155.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-10-06T01:22:23.007 INFO:teuthology.orchestra.run.smithi155.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2023-10-06T01:22:23.007 INFO:teuthology.orchestra.run.smithi155.stdout:invalid new device string format 2023-10-06T01:22:23.007 INFO:teuthology.orchestra.run.smithi155.stdout:mount.ceph: resolved to: "172.21.15.50:3300,172.21.15.155:3300,172.21.15.155:3301" 2023-10-06T01:22:23.008 INFO:teuthology.orchestra.run.smithi155.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-06T01:22:23.008 INFO:teuthology.orchestra.run.smithi155.stdout:mount.ceph: resolved to: "172.21.15.50:6789,172.21.15.155:6789,172.21.15.155:6790" 2023-10-06T01:22:23.008 INFO:teuthology.orchestra.run.smithi155.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.50:6789,172.21.15.155:6789,172.21.15.155:6790:/ 2023-10-06T01:22:23.008 INFO:teuthology.orchestra.run.smithi155.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs,key=1,fsid=0bfd9a6b-1587-4fe4-a89e-e43c00286b4e" will pass to kernel 2023-10-06T01:22:23.012 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-10-06T01:22:23.012 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T01:22:23.012 DEBUG:teuthology.orchestra.run.smithi155:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-10-06T01:22:23.074 INFO:tasks.kclient:client.3 config is {'syntax': 'v1'} 2023-10-06T01:22:23.074 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-06T01:22:23.273 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:23.272+0000 7fb01dd9d700 1 Processor -- start 2023-10-06T01:22:23.273 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:23.272+0000 7fb01dd9d700 1 -- start start 2023-10-06T01:22:23.275 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:23.273+0000 7fb01dd9d700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fb0180689b0 0x7fb01815d9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:23.275 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:23.273+0000 7fb01dd9d700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb018068d80 0x7fb0180c6d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:23.275 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:23.273+0000 7fb01dd9d700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb01815a860 con 0x7fb0180cb0f0 2023-10-06T01:22:23.275 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:23.273+0000 7fb01dd9d700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb0180cac60 con 0x7fb0180689b0 2023-10-06T01:22:23.275 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:23.273+0000 7fb01dd9d700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0180cb590 con 0x7fb018068d80 2023-10-06T01:22:23.275 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:23.273+0000 7fb01d59c700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fb0180cb0f0 0x7fb0180cb9c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:53216/0 (socket says 172.21.15.50:53216) 2023-10-06T01:22:23.275 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:23.273+0000 7fb01d59c700 1 -- 172.21.15.50:0/3946337958 learned_addr learned my addr 172.21.15.50:0/3946337958 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-10-06T01:22:23.276 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:23.273+0000 7fb01cd9b700 1 --2- 172.21.15.50:0/3946337958 >> v2:172.21.15.155:3300/0 conn(0x7fb0180689b0 0x7fb01815d9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:23.276 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:23.273+0000 7fb017fff700 1 --2- 172.21.15.50:0/3946337958 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb018068d80 0x7fb0180c6d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:23.276 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:23.274+0000 7fb0177fe700 1 -- 172.21.15.50:0/3946337958 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1013365853 0 0) 0x7fb01815a860 con 0x7fb0180cb0f0 2023-10-06T01:22:23.276 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:23.274+0000 7fb0177fe700 1 -- 172.21.15.50:0/3946337958 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb008003570 con 0x7fb0180cb0f0 2023-10-06T01:22:23.276 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:23.274+0000 7fb017fff700 1 -- 172.21.15.50:0/3946337958 >> v2:172.21.15.155:3300/0 conn(0x7fb0180689b0 msgr2=0x7fb01815d9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:22:23.276 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:23.274+0000 7fb017fff700 1 --2- 172.21.15.50:0/3946337958 >> v2:172.21.15.155:3300/0 conn(0x7fb0180689b0 0x7fb01815d9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:23.276 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:23.274+0000 7fb017fff700 1 -- 172.21.15.50:0/3946337958 >> v1:172.21.15.50:6789/0 conn(0x7fb0180cb0f0 legacy=0x7fb0180cb9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:23.276 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:23.274+0000 7fb017fff700 1 -- 172.21.15.50:0/3946337958 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0180c7400 con 0x7fb018068d80 2023-10-06T01:22:23.276 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:23.274+0000 7fb01cd9b700 1 --2- 172.21.15.50:0/3946337958 >> v2:172.21.15.155:3300/0 conn(0x7fb0180689b0 0x7fb01815d9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T01:22:23.276 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:23.274+0000 7fb017fff700 1 --2- 172.21.15.50:0/3946337958 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb018068d80 0x7fb0180c6d00 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fb0040098e0 tx=0x7fb0040091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6290a4e48232c84 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:22:23.278 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:23.275+0000 7fb0177fe700 1 -- 172.21.15.50:0/3946337958 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb004011630 con 0x7fb018068d80 2023-10-06T01:22:23.278 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:23.275+0000 7fb0177fe700 1 -- 172.21.15.50:0/3946337958 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb004011790 con 0x7fb018068d80 2023-10-06T01:22:23.278 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:23.275+0000 7fb0177fe700 1 -- 172.21.15.50:0/3946337958 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb004011b30 con 0x7fb018068d80 2023-10-06T01:22:23.278 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:23.275+0000 7fb01dd9d700 1 -- 172.21.15.50:0/3946337958 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb018068d80 msgr2=0x7fb0180c6d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:23.278 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:23.275+0000 7fb01dd9d700 1 --2- 172.21.15.50:0/3946337958 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb018068d80 0x7fb0180c6d00 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fb0040098e0 tx=0x7fb0040091a0 comp rx=0 tx=0).stop 2023-10-06T01:22:23.278 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:23.275+0000 7fb01dd9d700 1 -- 172.21.15.50:0/3946337958 shutdown_connections 2023-10-06T01:22:23.278 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:23.275+0000 7fb01dd9d700 1 --2- 172.21.15.50:0/3946337958 >> v2:172.21.15.155:3300/0 conn(0x7fb0180689b0 0x7fb01815d9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:23.278 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:23.275+0000 7fb01dd9d700 1 --2- 172.21.15.50:0/3946337958 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb018068d80 0x7fb0180c6d00 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:23.278 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:23.275+0000 7fb01dd9d700 1 -- 172.21.15.50:0/3946337958 >> 172.21.15.50:0/3946337958 conn(0x7fb0180cd230 msgr2=0x7fb0180c91d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:22:23.278 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:23.275+0000 7fb01dd9d700 1 -- 172.21.15.50:0/3946337958 shutdown_connections 2023-10-06T01:22:23.279 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:23.275+0000 7fb01dd9d700 1 -- 172.21.15.50:0/3946337958 wait complete. 2023-10-06T01:22:23.279 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:23.277+0000 7fb01dd9d700 1 Processor -- start 2023-10-06T01:22:23.279 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:23.277+0000 7fb01dd9d700 1 -- start start 2023-10-06T01:22:23.280 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:23.278+0000 7fb01dd9d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb0180689b0 0x7fb018157170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:23.281 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:23.278+0000 7fb01dd9d700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb018068d80 0x7fb0180adc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:23.281 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:23.278+0000 7fb01dd9d700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb0180cb0f0 0x7fb01815bc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:23.281 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:23.278+0000 7fb01dd9d700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0180ace90 con 0x7fb0180689b0 2023-10-06T01:22:23.281 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:23.278+0000 7fb01dd9d700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0180aeb20 con 0x7fb0180cb0f0 2023-10-06T01:22:23.281 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:23.278+0000 7fb01dd9d700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0180ac210 con 0x7fb018068d80 2023-10-06T01:22:23.281 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:23.278+0000 7fb01cd9b700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb0180689b0 0x7fb018157170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:23.281 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:23.278+0000 7fb01cd9b700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb0180689b0 0x7fb018157170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:48072/0 (socket says 172.21.15.50:48072) 2023-10-06T01:22:23.281 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:23.278+0000 7fb01cd9b700 1 -- 172.21.15.50:0/4151989908 learned_addr learned my addr 172.21.15.50:0/4151989908 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-06T01:22:23.281 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:23.278+0000 7fb017fff700 1 --2- 172.21.15.50:0/4151989908 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb018068d80 0x7fb0180adc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:23.281 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:23.278+0000 7fb01d59c700 1 --2- 172.21.15.50:0/4151989908 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb0180cb0f0 0x7fb01815bc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:23.281 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:23.278+0000 7fb01cd9b700 1 -- 172.21.15.50:0/4151989908 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb018068d80 msgr2=0x7fb0180adc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:23.282 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:23.278+0000 7fb01cd9b700 1 --2- 172.21.15.50:0/4151989908 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb018068d80 0x7fb0180adc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:23.282 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:23.278+0000 7fb01cd9b700 1 -- 172.21.15.50:0/4151989908 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb0180cb0f0 msgr2=0x7fb01815bc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:23.282 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:23.278+0000 7fb01cd9b700 1 --2- 172.21.15.50:0/4151989908 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb0180cb0f0 0x7fb01815bc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:23.282 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:23.278+0000 7fb01cd9b700 1 -- 172.21.15.50:0/4151989908 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb00c009a20 con 0x7fb0180689b0 2023-10-06T01:22:23.282 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:23.279+0000 7fb01cd9b700 1 --2- 172.21.15.50:0/4151989908 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb0180689b0 0x7fb018157170 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fb00c00c0c0 tx=0x7fb00c00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:22:23.282 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:23.279+0000 7fb014ff9700 1 -- 172.21.15.50:0/4151989908 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb00c00cc00 con 0x7fb0180689b0 2023-10-06T01:22:23.282 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:23.279+0000 7fb014ff9700 1 -- 172.21.15.50:0/4151989908 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb00c00f040 con 0x7fb0180689b0 2023-10-06T01:22:23.282 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:23.279+0000 7fb01dd9d700 1 -- 172.21.15.50:0/4151989908 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb004009420 con 0x7fb0180689b0 2023-10-06T01:22:23.282 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:23.279+0000 7fb014ff9700 1 -- 172.21.15.50:0/4151989908 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb00c014480 con 0x7fb0180689b0 2023-10-06T01:22:23.282 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:23.279+0000 7fb01dd9d700 1 -- 172.21.15.50:0/4151989908 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb0180ac7d0 con 0x7fb0180689b0 2023-10-06T01:22:23.283 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:23.280+0000 7fb01dd9d700 1 -- 172.21.15.50:0/4151989908 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb01805f270 con 0x7fb0180689b0 2023-10-06T01:22:23.283 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:23.281+0000 7fb014ff9700 1 -- 172.21.15.50:0/4151989908 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fb00c0147f0 con 0x7fb0180689b0 2023-10-06T01:22:23.283 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:23.282+0000 7fb014ff9700 1 --2- 172.21.15.50:0/4151989908 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7faffc066f30 0x7faffc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:23.283 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:23.282+0000 7fb014ff9700 1 -- 172.21.15.50:0/4151989908 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6809+0+0 (secure 0 0 0) 0x7fb00c085720 con 0x7fb0180689b0 2023-10-06T01:22:23.283 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:23.282+0000 7fb017fff700 1 --2- 172.21.15.50:0/4151989908 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7faffc066f30 0x7faffc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:23.284 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:23.283+0000 7fb017fff700 1 --2- 172.21.15.50:0/4151989908 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7faffc066f30 0x7faffc0693e0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fb0040091e0 tx=0x7fb004017000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:22:23.287 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:23.287+0000 7fb014ff9700 1 -- 172.21.15.50:0/4151989908 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb00c0524a0 con 0x7fb0180689b0 2023-10-06T01:22:23.539 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:23.538+0000 7fb01dd9d700 1 -- 172.21.15.50:0/4151989908 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fb0180c9bf0 con 0x7fb0180689b0 2023-10-06T01:22:23.540 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:23.538+0000 7fb014ff9700 1 -- 172.21.15.50:0/4151989908 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v9) v1 ==== 53+0+88 (secure 0 0 0) 0x7fb00c055ac0 con 0x7fb0180689b0 2023-10-06T01:22:23.540 INFO:teuthology.orchestra.run.smithi050.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2023-10-06T01:22:23.542 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:23.540+0000 7fb01dd9d700 1 -- 172.21.15.50:0/4151989908 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7faffc066f30 msgr2=0x7faffc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:23.542 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:23.540+0000 7fb01dd9d700 1 --2- 172.21.15.50:0/4151989908 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7faffc066f30 0x7faffc0693e0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fb0040091e0 tx=0x7fb004017000 comp rx=0 tx=0).stop 2023-10-06T01:22:23.542 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:23.540+0000 7fb01dd9d700 1 -- 172.21.15.50:0/4151989908 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb0180689b0 msgr2=0x7fb018157170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:23.542 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:23.540+0000 7fb01dd9d700 1 --2- 172.21.15.50:0/4151989908 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb0180689b0 0x7fb018157170 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fb00c00c0c0 tx=0x7fb00c00b040 comp rx=0 tx=0).stop 2023-10-06T01:22:23.542 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:23.541+0000 7fb01dd9d700 1 -- 172.21.15.50:0/4151989908 shutdown_connections 2023-10-06T01:22:23.542 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:23.541+0000 7fb01dd9d700 1 --2- 172.21.15.50:0/4151989908 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7faffc066f30 0x7faffc0693e0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:23.542 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:23.541+0000 7fb01dd9d700 1 --2- 172.21.15.50:0/4151989908 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb0180cb0f0 0x7fb01815bc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:23.542 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:23.541+0000 7fb01dd9d700 1 --2- 172.21.15.50:0/4151989908 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb0180689b0 0x7fb018157170 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:23.543 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:23.541+0000 7fb01dd9d700 1 --2- 172.21.15.50:0/4151989908 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb018068d80 0x7fb0180adc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:23.543 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:23.541+0000 7fb01dd9d700 1 -- 172.21.15.50:0/4151989908 >> 172.21.15.50:0/4151989908 conn(0x7fb0180cd230 msgr2=0x7fb018157c90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:22:23.543 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:23.541+0000 7fb01dd9d700 1 -- 172.21.15.50:0/4151989908 shutdown_connections 2023-10-06T01:22:23.543 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:23.541+0000 7fb01dd9d700 1 -- 172.21.15.50:0/4151989908 wait complete. 2023-10-06T01:22:23.559 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-10-06T01:22:23.559 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-06T01:22:23.559 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi155.front.sepia.ceph.com 2023-10-06T01:22:23.559 INFO:tasks.cephfs.mount:self.client.name = client.3 2023-10-06T01:22:23.559 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2023-10-06T01:22:23.559 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-10-06T01:22:23.559 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-10-06T01:22:23.559 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-06T01:22:23.559 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.3' 2023-10-06T01:22:23.560 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T01:22:23.560 DEBUG:teuthology.orchestra.run.smithi155:> ip addr 2023-10-06T01:22:23.597 INFO:teuthology.orchestra.run.smithi155.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-06T01:22:23.597 INFO:teuthology.orchestra.run.smithi155.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-06T01:22:23.597 INFO:teuthology.orchestra.run.smithi155.stdout: inet 127.0.0.1/8 scope host lo 2023-10-06T01:22:23.597 INFO:teuthology.orchestra.run.smithi155.stdout: valid_lft forever preferred_lft forever 2023-10-06T01:22:23.597 INFO:teuthology.orchestra.run.smithi155.stdout: inet6 ::1/128 scope host 2023-10-06T01:22:23.598 INFO:teuthology.orchestra.run.smithi155.stdout: valid_lft forever preferred_lft forever 2023-10-06T01:22:23.598 INFO:teuthology.orchestra.run.smithi155.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T01:22:23.598 INFO:teuthology.orchestra.run.smithi155.stdout: link/ether 0c:c4:7a:d9:a0:fa brd ff:ff:ff:ff:ff:ff 2023-10-06T01:22:23.598 INFO:teuthology.orchestra.run.smithi155.stdout: altname enp7s0f0 2023-10-06T01:22:23.598 INFO:teuthology.orchestra.run.smithi155.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T01:22:23.598 INFO:teuthology.orchestra.run.smithi155.stdout: link/ether 0c:c4:7a:d9:a0:fb brd ff:ff:ff:ff:ff:ff 2023-10-06T01:22:23.598 INFO:teuthology.orchestra.run.smithi155.stdout: altname enp7s0f1 2023-10-06T01:22:23.598 INFO:teuthology.orchestra.run.smithi155.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T01:22:23.598 INFO:teuthology.orchestra.run.smithi155.stdout: link/ether 0c:c4:7a:88:6d:ec brd ff:ff:ff:ff:ff:ff 2023-10-06T01:22:23.598 INFO:teuthology.orchestra.run.smithi155.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-06T01:22:23.598 INFO:teuthology.orchestra.run.smithi155.stdout: link/ether 0c:c4:7a:88:6d:ed brd ff:ff:ff:ff:ff:ff 2023-10-06T01:22:23.599 INFO:teuthology.orchestra.run.smithi155.stdout: inet 172.21.15.155/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-10-06T01:22:23.599 INFO:teuthology.orchestra.run.smithi155.stdout: valid_lft 42235sec preferred_lft 42235sec 2023-10-06T01:22:23.599 INFO:teuthology.orchestra.run.smithi155.stdout: inet6 fe80::ec4:7aff:fe88:6ded/64 scope link 2023-10-06T01:22:23.599 INFO:teuthology.orchestra.run.smithi155.stdout: valid_lft forever preferred_lft forever 2023-10-06T01:22:23.599 INFO:teuthology.orchestra.run.smithi155.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-06T01:22:23.599 INFO:teuthology.orchestra.run.smithi155.stdout: link/ether 6e:7c:09:56:66:57 brd ff:ff:ff:ff:ff:ff 2023-10-06T01:22:23.599 INFO:teuthology.orchestra.run.smithi155.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-10-06T01:22:23.599 INFO:teuthology.orchestra.run.smithi155.stdout: valid_lft forever preferred_lft forever 2023-10-06T01:22:23.599 INFO:teuthology.orchestra.run.smithi155.stdout: inet6 fe80::881a:e7ff:feaa:b51a/64 scope link 2023-10-06T01:22:23.599 INFO:teuthology.orchestra.run.smithi155.stdout: valid_lft forever preferred_lft forever 2023-10-06T01:22:23.599 INFO:teuthology.orchestra.run.smithi155.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-06T01:22:23.599 INFO:teuthology.orchestra.run.smithi155.stdout: link/ether 6e:7c:09:56:66:57 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-10-06T01:22:23.600 INFO:teuthology.orchestra.run.smithi155.stdout: inet6 fe80::6c7c:9ff:fe56:6657/64 scope link tentative 2023-10-06T01:22:23.600 INFO:teuthology.orchestra.run.smithi155.stdout: valid_lft forever preferred_lft forever 2023-10-06T01:22:23.600 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T01:22:23.600 DEBUG:teuthology.orchestra.run.smithi155:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-06T01:22:23.696 INFO:teuthology.orchestra.run.smithi155.stdout:1 2023-10-06T01:22:23.699 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T01:22:23.700 DEBUG:teuthology.orchestra.run.smithi155:> route 2023-10-06T01:22:23.737 INFO:teuthology.orchestra.run.smithi155.stdout:Kernel IP routing table 2023-10-06T01:22:23.738 INFO:teuthology.orchestra.run.smithi155.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-06T01:22:23.738 INFO:teuthology.orchestra.run.smithi155.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-10-06T01:22:23.738 INFO:teuthology.orchestra.run.smithi155.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-10-06T01:22:23.738 INFO:teuthology.orchestra.run.smithi155.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-06T01:22:23.739 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T01:22:23.740 DEBUG:teuthology.orchestra.run.smithi155:> (cd / && exec bash -c ' 2023-10-06T01:22:23.740 DEBUG:teuthology.orchestra.run.smithi155:> set -e 2023-10-06T01:22:23.740 DEBUG:teuthology.orchestra.run.smithi155:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-10-06T01:22:23.740 DEBUG:teuthology.orchestra.run.smithi155:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-10-06T01:22:23.740 DEBUG:teuthology.orchestra.run.smithi155:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-10-06T01:22:23.740 DEBUG:teuthology.orchestra.run.smithi155:> ') 2023-10-06T01:22:23.942 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T01:22:23.943 DEBUG:teuthology.orchestra.run.smithi155:> ip netns list 2023-10-06T01:22:23.980 INFO:teuthology.orchestra.run.smithi155.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-10-06T01:22:23.980 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T01:22:23.981 DEBUG:teuthology.orchestra.run.smithi155:> ip netns list-id 2023-10-06T01:22:24.056 INFO:teuthology.orchestra.run.smithi155.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.1) 2023-10-06T01:22:24.057 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T01:22:24.057 DEBUG:teuthology.orchestra.run.smithi155:> (cd / && exec bash -c ' 2023-10-06T01:22:24.057 DEBUG:teuthology.orchestra.run.smithi155:> set -e 2023-10-06T01:22:24.057 DEBUG:teuthology.orchestra.run.smithi155:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.3 2023-10-06T01:22:24.057 DEBUG:teuthology.orchestra.run.smithi155:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.3 1 2023-10-06T01:22:24.057 DEBUG:teuthology.orchestra.run.smithi155:> ') 2023-10-06T01:22:24.223 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T01:22:24.223 DEBUG:teuthology.orchestra.run.smithi155:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2023-10-06T01:22:24.284 INFO:teuthology.orchestra.run.smithi155.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-06T01:22:24.285 INFO:teuthology.orchestra.run.smithi155.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-06T01:22:24.285 INFO:teuthology.orchestra.run.smithi155.stdout: inet 127.0.0.1/8 scope host lo 2023-10-06T01:22:24.285 INFO:teuthology.orchestra.run.smithi155.stdout: valid_lft forever preferred_lft forever 2023-10-06T01:22:24.285 INFO:teuthology.orchestra.run.smithi155.stdout: inet6 ::1/128 scope host 2023-10-06T01:22:24.285 INFO:teuthology.orchestra.run.smithi155.stdout: valid_lft forever preferred_lft forever 2023-10-06T01:22:24.285 INFO:teuthology.orchestra.run.smithi155.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-06T01:22:24.285 INFO:teuthology.orchestra.run.smithi155.stdout: link/ether ba:23:3c:9e:a8:18 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-10-06T01:22:24.285 INFO:teuthology.orchestra.run.smithi155.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-10-06T01:22:24.285 INFO:teuthology.orchestra.run.smithi155.stdout: valid_lft forever preferred_lft forever 2023-10-06T01:22:24.285 INFO:teuthology.orchestra.run.smithi155.stdout: inet6 fe80::b823:3cff:fe9e:a818/64 scope link 2023-10-06T01:22:24.285 INFO:teuthology.orchestra.run.smithi155.stdout: valid_lft forever preferred_lft forever 2023-10-06T01:22:24.287 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T01:22:24.287 DEBUG:teuthology.orchestra.run.smithi155:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2023-10-06T01:22:24.349 INFO:teuthology.orchestra.run.smithi155.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-06T01:22:24.350 INFO:teuthology.orchestra.run.smithi155.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-06T01:22:24.350 INFO:teuthology.orchestra.run.smithi155.stdout: inet 127.0.0.1/8 scope host lo 2023-10-06T01:22:24.350 INFO:teuthology.orchestra.run.smithi155.stdout: valid_lft forever preferred_lft forever 2023-10-06T01:22:24.350 INFO:teuthology.orchestra.run.smithi155.stdout: inet6 ::1/128 scope host 2023-10-06T01:22:24.350 INFO:teuthology.orchestra.run.smithi155.stdout: valid_lft forever preferred_lft forever 2023-10-06T01:22:24.350 INFO:teuthology.orchestra.run.smithi155.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-06T01:22:24.350 INFO:teuthology.orchestra.run.smithi155.stdout: link/ether ba:23:3c:9e:a8:18 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-10-06T01:22:24.350 INFO:teuthology.orchestra.run.smithi155.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-10-06T01:22:24.350 INFO:teuthology.orchestra.run.smithi155.stdout: valid_lft forever preferred_lft forever 2023-10-06T01:22:24.351 INFO:teuthology.orchestra.run.smithi155.stdout: inet6 fe80::b823:3cff:fe9e:a818/64 scope link 2023-10-06T01:22:24.351 INFO:teuthology.orchestra.run.smithi155.stdout: valid_lft forever preferred_lft forever 2023-10-06T01:22:24.352 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.3' with 192.168.0.2/16 2023-10-06T01:22:24.352 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T01:22:24.353 DEBUG:teuthology.orchestra.run.smithi155:> (cd / && exec bash -c ' 2023-10-06T01:22:24.353 DEBUG:teuthology.orchestra.run.smithi155:> set -e 2023-10-06T01:22:24.353 DEBUG:teuthology.orchestra.run.smithi155:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.3 type veth peer name brx.1 2023-10-06T01:22:24.353 DEBUG:teuthology.orchestra.run.smithi155:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2023-10-06T01:22:24.353 DEBUG:teuthology.orchestra.run.smithi155:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set veth0 up 2023-10-06T01:22:24.353 DEBUG:teuthology.orchestra.run.smithi155:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set lo up 2023-10-06T01:22:24.353 DEBUG:teuthology.orchestra.run.smithi155:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip route add default via 192.168.255.254 2023-10-06T01:22:24.353 DEBUG:teuthology.orchestra.run.smithi155:> ') 2023-10-06T01:22:24.587 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T01:22:24.587 DEBUG:teuthology.orchestra.run.smithi155:> (cd / && exec bash -c ' 2023-10-06T01:22:24.587 DEBUG:teuthology.orchestra.run.smithi155:> set -e 2023-10-06T01:22:24.587 DEBUG:teuthology.orchestra.run.smithi155:> sudo ip link set brx.1 up 2023-10-06T01:22:24.587 DEBUG:teuthology.orchestra.run.smithi155:> sudo ip link set dev brx.1 master ceph-brx 2023-10-06T01:22:24.587 DEBUG:teuthology.orchestra.run.smithi155:> ') 2023-10-06T01:22:24.744 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-06T01:22:24.744 DEBUG:teuthology.orchestra.run.smithi155:> mkdir -p -v /home/ubuntu/cephtest/mnt.3 2023-10-06T01:22:24.780 INFO:teuthology.orchestra.run.smithi155.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.3' 2023-10-06T01:22:24.780 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-06T01:22:24.780 DEBUG:teuthology.orchestra.run.smithi155:> chmod 0000 /home/ubuntu/cephtest/mnt.3 2023-10-06T01:22:24.858 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2023-10-06T01:22:24.858 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-10-06T01:22:24.858 DEBUG:teuthology.orchestra.run.smithi155:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.3 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=3,mds_namespace=cephfs 2023-10-06T01:22:24.989 INFO:teuthology.orchestra.run.smithi155.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=3,mds_namespace=cephfs 2023-10-06T01:22:24.989 INFO:teuthology.orchestra.run.smithi155.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,mds_namespace=cephfs". 2023-10-06T01:22:24.989 INFO:teuthology.orchestra.run.smithi155.stdout:invalid new device string format 2023-10-06T01:22:25.005 INFO:teuthology.orchestra.run.smithi155.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=3,mds_namespace=cephfs 2023-10-06T01:22:25.006 INFO:teuthology.orchestra.run.smithi155.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,mds_namespace=cephfs". 2023-10-06T01:22:25.006 INFO:teuthology.orchestra.run.smithi155.stdout:invalid new device string format 2023-10-06T01:22:25.006 INFO:teuthology.orchestra.run.smithi155.stdout:mount.ceph: resolved to: "172.21.15.50:3300,172.21.15.155:3300,172.21.15.155:3301" 2023-10-06T01:22:25.006 INFO:teuthology.orchestra.run.smithi155.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-06T01:22:25.027 INFO:teuthology.orchestra.run.smithi155.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=3,mds_namespace=cephfs 2023-10-06T01:22:25.027 INFO:teuthology.orchestra.run.smithi155.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,mds_namespace=cephfs". 2023-10-06T01:22:25.027 INFO:teuthology.orchestra.run.smithi155.stdout:invalid new device string format 2023-10-06T01:22:25.027 INFO:teuthology.orchestra.run.smithi155.stdout:mount.ceph: resolved to: "172.21.15.50:3300,172.21.15.155:3300,172.21.15.155:3301" 2023-10-06T01:22:25.027 INFO:teuthology.orchestra.run.smithi155.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-06T01:22:25.028 INFO:teuthology.orchestra.run.smithi155.stdout:mount.ceph: resolved to: "172.21.15.50:6789,172.21.15.155:6789,172.21.15.155:6790" 2023-10-06T01:22:25.028 INFO:teuthology.orchestra.run.smithi155.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.50:6789,172.21.15.155:6789,172.21.15.155:6790:/ 2023-10-06T01:22:25.028 INFO:teuthology.orchestra.run.smithi155.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,mds_namespace=cephfs,key=3,fsid=0bfd9a6b-1587-4fe4-a89e-e43c00286b4e" will pass to kernel 2023-10-06T01:22:25.032 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-10-06T01:22:25.032 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T01:22:25.032 DEBUG:teuthology.orchestra.run.smithi155:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.3 2023-10-06T01:22:25.093 INFO:teuthology.run_tasks:Running task cephfs_test_runner... 2023-10-06T01:22:25.113 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T01:22:25.312 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:25.311+0000 7f75a7fff700 1 Processor -- start 2023-10-06T01:22:25.312 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:25.311+0000 7f75a7fff700 1 -- start start 2023-10-06T01:22:25.314 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:25.312+0000 7f75a7fff700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f75a80cc0d0 0x7f75a815d9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:25.314 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:25.312+0000 7f75a7fff700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f75a8068d80 0x7f75a80c6d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:25.314 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:25.312+0000 7f75a7fff700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f75a815a860 con 0x7f75a80689b0 2023-10-06T01:22:25.314 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:25.312+0000 7f75a7fff700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f75a80cac60 con 0x7f75a8068d80 2023-10-06T01:22:25.314 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:25.312+0000 7f75a7fff700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75a80c7400 con 0x7f75a80cc0d0 2023-10-06T01:22:25.314 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:25.312+0000 7f75a6ffd700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f75a80689b0 0x7f75a80cb9c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:54394/0 (socket says 172.21.15.50:54394) 2023-10-06T01:22:25.314 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:25.312+0000 7f75a6ffd700 1 -- 172.21.15.50:0/1586592476 learned_addr learned my addr 172.21.15.50:0/1586592476 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-10-06T01:22:25.314 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:25.312+0000 7f75a77fe700 1 --2- 172.21.15.50:0/1586592476 >> v2:172.21.15.50:3300/0 conn(0x7f75a8068d80 0x7f75a80c6d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:25.315 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:25.313+0000 7f75a67fc700 1 --2- 172.21.15.50:0/1586592476 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f75a80cc0d0 0x7f75a815d9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:25.315 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:25.313+0000 7f75a5ffb700 1 -- 172.21.15.50:0/1586592476 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2570970423 0 0) 0x7f75a815a860 con 0x7f75a80689b0 2023-10-06T01:22:25.315 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:25.313+0000 7f75a5ffb700 1 -- 172.21.15.50:0/1586592476 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7590003570 con 0x7f75a80689b0 2023-10-06T01:22:25.315 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:25.313+0000 7f75a77fe700 1 -- 172.21.15.50:0/1586592476 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f75a80cc0d0 msgr2=0x7f75a815d9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:22:25.315 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:25.313+0000 7f75a77fe700 1 --2- 172.21.15.50:0/1586592476 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f75a80cc0d0 0x7f75a815d9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:25.315 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:25.313+0000 7f75a77fe700 1 -- 172.21.15.50:0/1586592476 >> v1:172.21.15.50:6789/0 conn(0x7f75a80689b0 legacy=0x7f75a80cb9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:25.315 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:25.313+0000 7f75a77fe700 1 -- 172.21.15.50:0/1586592476 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75a80ca330 con 0x7f75a8068d80 2023-10-06T01:22:25.315 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:25.313+0000 7f75a77fe700 1 --2- 172.21.15.50:0/1586592476 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f75a8068d80 0x7f75a80c6d00 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f75a0009e60 tx=0x7f75a0009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=423c717b938c4abd server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:22:25.316 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:25.313+0000 7f75a5ffb700 1 -- 172.21.15.50:0/1586592476 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75a000e070 con 0x7f75a8068d80 2023-10-06T01:22:25.317 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:25.314+0000 7f75a5ffb700 1 -- 172.21.15.50:0/1586592476 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75a000bab0 con 0x7f75a8068d80 2023-10-06T01:22:25.317 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:25.314+0000 7f75a5ffb700 1 -- 172.21.15.50:0/1586592476 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75a000be70 con 0x7f75a8068d80 2023-10-06T01:22:25.317 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:25.314+0000 7f75a7fff700 1 -- 172.21.15.50:0/1586592476 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f75a8068d80 msgr2=0x7f75a80c6d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:25.317 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:25.314+0000 7f75a7fff700 1 --2- 172.21.15.50:0/1586592476 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f75a8068d80 0x7f75a80c6d00 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f75a0009e60 tx=0x7f75a0009780 comp rx=0 tx=0).stop 2023-10-06T01:22:25.317 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:25.314+0000 7f75a7fff700 1 -- 172.21.15.50:0/1586592476 shutdown_connections 2023-10-06T01:22:25.317 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:25.314+0000 7f75a7fff700 1 --2- 172.21.15.50:0/1586592476 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f75a8068d80 0x7f75a80c6d00 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:25.317 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:25.314+0000 7f75a7fff700 1 --2- 172.21.15.50:0/1586592476 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f75a80cc0d0 0x7f75a815d9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:25.317 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:25.314+0000 7f75a7fff700 1 -- 172.21.15.50:0/1586592476 >> 172.21.15.50:0/1586592476 conn(0x7f75a80cd230 msgr2=0x7f75a80c91d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:22:25.317 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:25.314+0000 7f75a7fff700 1 -- 172.21.15.50:0/1586592476 shutdown_connections 2023-10-06T01:22:25.317 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:25.314+0000 7f75a7fff700 1 -- 172.21.15.50:0/1586592476 wait complete. 2023-10-06T01:22:25.317 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:25.316+0000 7f75a7fff700 1 Processor -- start 2023-10-06T01:22:25.318 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:25.316+0000 7f75a7fff700 1 -- start start 2023-10-06T01:22:25.319 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:25.317+0000 7f75a7fff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f75a80689b0 0x7f75a80c0b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:25.320 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:25.317+0000 7f75a7fff700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f75a8068d80 0x7f75a80c2800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:25.320 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:25.317+0000 7f75a7fff700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f75a80cc0d0 0x7f75a8159b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:25.320 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:25.317+0000 7f75a7fff700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75a80c1050 con 0x7f75a80689b0 2023-10-06T01:22:25.320 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:25.317+0000 7f75a7fff700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75a80a9cd0 con 0x7f75a80cc0d0 2023-10-06T01:22:25.320 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:25.317+0000 7f75a7fff700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75a80a9fb0 con 0x7f75a8068d80 2023-10-06T01:22:25.320 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:25.317+0000 7f75a6ffd700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f75a80689b0 0x7f75a80c0b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:25.320 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:25.317+0000 7f75a6ffd700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f75a80689b0 0x7f75a80c0b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:48480/0 (socket says 172.21.15.50:48480) 2023-10-06T01:22:25.320 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:25.317+0000 7f75a6ffd700 1 -- 172.21.15.50:0/3144221660 learned_addr learned my addr 172.21.15.50:0/3144221660 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-06T01:22:25.320 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:25.317+0000 7f75a67fc700 1 --2- 172.21.15.50:0/3144221660 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f75a8068d80 0x7f75a80c2800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:25.320 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:25.317+0000 7f75a77fe700 1 --2- 172.21.15.50:0/3144221660 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f75a80cc0d0 0x7f75a8159b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:25.321 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:25.317+0000 7f75a6ffd700 1 -- 172.21.15.50:0/3144221660 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f75a8068d80 msgr2=0x7f75a80c2800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:25.321 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:25.317+0000 7f75a6ffd700 1 --2- 172.21.15.50:0/3144221660 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f75a8068d80 0x7f75a80c2800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:25.321 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:25.317+0000 7f75a6ffd700 1 -- 172.21.15.50:0/3144221660 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f75a80cc0d0 msgr2=0x7f75a8159b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:25.321 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:25.317+0000 7f75a6ffd700 1 --2- 172.21.15.50:0/3144221660 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f75a80cc0d0 0x7f75a8159b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:25.321 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:25.317+0000 7f75a6ffd700 1 -- 172.21.15.50:0/3144221660 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75a0009a20 con 0x7f75a80689b0 2023-10-06T01:22:25.321 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:25.317+0000 7f75a67fc700 1 --2- 172.21.15.50:0/3144221660 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f75a8068d80 0x7f75a80c2800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T01:22:25.321 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:25.317+0000 7f75a77fe700 1 --2- 172.21.15.50:0/3144221660 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f75a80cc0d0 0x7f75a8159b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T01:22:25.321 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:25.318+0000 7f75a6ffd700 1 --2- 172.21.15.50:0/3144221660 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f75a80689b0 0x7f75a80c0b10 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f759800c590 tx=0x7f7598007e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:22:25.321 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:25.318+0000 7f758effd700 1 -- 172.21.15.50:0/3144221660 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7598005b30 con 0x7f75a80689b0 2023-10-06T01:22:25.321 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:25.318+0000 7f758effd700 1 -- 172.21.15.50:0/3144221660 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7598005cb0 con 0x7f75a80689b0 2023-10-06T01:22:25.321 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:25.318+0000 7f758effd700 1 -- 172.21.15.50:0/3144221660 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7598007320 con 0x7f75a80689b0 2023-10-06T01:22:25.321 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:25.318+0000 7f75a7fff700 1 -- 172.21.15.50:0/3144221660 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f75a80aa290 con 0x7f75a80689b0 2023-10-06T01:22:25.322 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:25.318+0000 7f75a7fff700 1 -- 172.21.15.50:0/3144221660 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f75a80aa850 con 0x7f75a80689b0 2023-10-06T01:22:25.322 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:25.319+0000 7f75a7fff700 1 -- 172.21.15.50:0/3144221660 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f75a80aaa70 con 0x7f75a80689b0 2023-10-06T01:22:25.322 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:25.320+0000 7f758effd700 1 -- 172.21.15.50:0/3144221660 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f759801b3b0 con 0x7f75a80689b0 2023-10-06T01:22:25.322 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:25.322+0000 7f758effd700 1 --2- 172.21.15.50:0/3144221660 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f7594066f30 0x7f75940693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:25.323 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:25.322+0000 7f758effd700 1 -- 172.21.15.50:0/3144221660 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6867+0+0 (secure 0 0 0) 0x7f7598083fe0 con 0x7f75a80689b0 2023-10-06T01:22:25.323 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:25.323+0000 7f75a67fc700 1 --2- 172.21.15.50:0/3144221660 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f7594066f30 0x7f75940693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:25.324 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:25.323+0000 7f75a67fc700 1 --2- 172.21.15.50:0/3144221660 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f7594066f30 0x7f75940693e0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f759c006f00 tx=0x7f759c008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:22:25.326 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:25.326+0000 7f758effd700 1 -- 172.21.15.50:0/3144221660 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f7598050d60 con 0x7f75a80689b0 2023-10-06T01:22:25.528 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:25.527+0000 7f75a7fff700 1 -- 172.21.15.50:0/3144221660 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f75a805f270 con 0x7f75a80689b0 2023-10-06T01:22:25.529 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:25.528+0000 7f758effd700 1 -- 172.21.15.50:0/3144221660 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+18803 (secure 0 0 0) 0x7f7598017020 con 0x7f75a80689b0 2023-10-06T01:22:25.529 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-10-06T01:22:25.529 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":27,"fsid":"0bfd9a6b-1587-4fe4-a89e-e43c00286b4e","created":"2023-10-06T01:21:16.828801+0000","modified":"2023-10-06T01:22:24.863940+0000","last_up_change":"2023-10-06T01:21:28.584523+0000","last_in_change":"2023-10-06T01:21:20.179863+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-10-06T01:21:29.304225+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":".mgr","create_time":"2023-10-06T01:21:29.835490+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-06T01:21:34.675315+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-06T01:21:35.753991+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-10-06T01:21:38.853108+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"9060727a-3959-4de3-8363-c5c5d7826c9a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":87837},{"type":"v1","addr":"172.21.15.50:6801","nonce":87837}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":87837},{"type":"v1","addr":"172.21.15.50:6803","nonce":87837}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":87837},{"type":"v1","addr":"172.21.15.50:6807","nonce":87837}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":87837},{"type":"v1","addr":"172.21.15.50:6805","nonce":87837}]},"public_addr":"172.21.15.50:6801/87837","cluster_addr":"172.21.15.50:6803/87837","heartbeat_back_addr":"172.21.15.50:6807/87837","heartbeat_front_addr":"172.21.15.50:6805/87837","state":["exists","up"]},{"osd":1,"uuid":"5ad9ef12-b579-47ea-b690-90ba887e2cef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":87853},{"type":"v1","addr":"172.21.15.50:6809","nonce":87853}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":87853},{"type":"v1","addr":"172.21.15.50:6811","nonce":87853}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":87853},{"type":"v1","addr":"172.21.15.50:6815","nonce":87853}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":87853},{"type":"v1","addr":"172.21.15.50:6813","nonce":87853}]},"public_addr":"172.21.15.50:6809/87853","cluster_addr":"172.21.15.50:6811/87853","heartbeat_back_addr":"172.21.15.50:6815/87853","heartbeat_front_addr":"172.21.15.50:6813/87853","state":["exists","up"]},{"osd":2,"uuid":"c7aee044-6f75-436f-90e1-ba42a57359bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6821","nonce":87855},{"type":"v1","addr":"172.21.15.50:6822","nonce":87855}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6824","nonce":87855},{"type":"v1","addr":"172.21.15.50:6826","nonce":87855}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":87855},{"type":"v1","addr":"172.21.15.50:6831","nonce":87855}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":87855},{"type":"v1","addr":"172.21.15.50:6829","nonce":87855}]},"public_addr":"172.21.15.50:6822/87855","cluster_addr":"172.21.15.50:6826/87855","heartbeat_back_addr":"172.21.15.50:6831/87855","heartbeat_front_addr":"172.21.15.50:6829/87855","state":["exists","up"]},{"osd":3,"uuid":"d9b901c8-e8b2-44af-9508-f453120a96c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":87856},{"type":"v1","addr":"172.21.15.50:6817","nonce":87856}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":87856},{"type":"v1","addr":"172.21.15.50:6819","nonce":87856}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6825","nonce":87856},{"type":"v1","addr":"172.21.15.50:6827","nonce":87856}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6820","nonce":87856},{"type":"v1","addr":"172.21.15.50:6823","nonce":87856}]},"public_addr":"172.21.15.50:6817/87856","cluster_addr":"172.21.15.50:6819/87856","heartbeat_back_addr":"172.21.15.50:6827/87856","heartbeat_front_addr":"172.21.15.50:6823/87856","state":["exists","up"]},{"osd":4,"uuid":"2b3c6b38-e3e9-4301-9445-60fd3fe8ce03","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":85805},{"type":"v1","addr":"172.21.15.155:6801","nonce":85805}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":85805},{"type":"v1","addr":"172.21.15.155:6803","nonce":85805}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6806","nonce":85805},{"type":"v1","addr":"172.21.15.155:6807","nonce":85805}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6804","nonce":85805},{"type":"v1","addr":"172.21.15.155:6805","nonce":85805}]},"public_addr":"172.21.15.155:6801/85805","cluster_addr":"172.21.15.155:6803/85805","heartbeat_back_addr":"172.21.15.155:6807/85805","heartbeat_front_addr":"172.21.15.155:6805/85805","state":["exists","up"]},{"osd":5,"uuid":"417b5f8f-65f1-4c94-91a7-a6ce03fe1679","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6816","nonce":85807},{"type":"v1","addr":"172.21.15.155:6818","nonce":85807}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6820","nonce":85807},{"type":"v1","addr":"172.21.15.155:6822","nonce":85807}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6828","nonce":85807},{"type":"v1","addr":"172.21.15.155:6830","nonce":85807}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6824","nonce":85807},{"type":"v1","addr":"172.21.15.155:6826","nonce":85807}]},"public_addr":"172.21.15.155:6818/85807","cluster_addr":"172.21.15.155:6822/85807","heartbeat_back_addr":"172.21.15.155:6830/85807","heartbeat_front_addr":"172.21.15.155:6826/85807","state":["exists","up"]},{"osd":6,"uuid":"c150cff3-aee4-4714-9c08-d182b1ba9ffd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6808","nonce":85806},{"type":"v1","addr":"172.21.15.155:6809","nonce":85806}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6810","nonce":85806},{"type":"v1","addr":"172.21.15.155:6811","nonce":85806}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6814","nonce":85806},{"type":"v1","addr":"172.21.15.155:6815","nonce":85806}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6812","nonce":85806},{"type":"v1","addr":"172.21.15.155:6813","nonce":85806}]},"public_addr":"172.21.15.155:6809/85806","cluster_addr":"172.21.15.155:6811/85806","heartbeat_back_addr":"172.21.15.155:6815/85806","heartbeat_front_addr":"172.21.15.155:6813/85806","state":["exists","up"]},{"osd":7,"uuid":"71107f0e-04d1-4e72-a0ec-0faf6af003e7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6817","nonce":85832},{"type":"v1","addr":"172.21.15.155:6819","nonce":85832}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6821","nonce":85832},{"type":"v1","addr":"172.21.15.155:6823","nonce":85832}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6829","nonce":85832},{"type":"v1","addr":"172.21.15.155:6831","nonce":85832}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6825","nonce":85832},{"type":"v1","addr":"172.21.15.155:6827","nonce":85832}]},"public_addr":"172.21.15.155:6819/85832","cluster_addr":"172.21.15.155:6823/85832","heartbeat_back_addr":"172.21.15.155:6831/85832","heartbeat_front_addr":"172.21.15.155:6827/85832","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:21:25.423389+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:21:25.472661+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:21:25.817562+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:21:25.551257+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:21:25.407818+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:21:25.557976+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:21:25.747299+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:21:25.827576+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.19","mappings":[{"from":3,"to":5}]},{"pgid":"4.31","mappings":[{"from":1,"to":2}]}],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T01:22:25.531 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:25.530+0000 7f75a7fff700 1 -- 172.21.15.50:0/3144221660 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f7594066f30 msgr2=0x7f75940693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:25.532 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:25.530+0000 7f75a7fff700 1 --2- 172.21.15.50:0/3144221660 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f7594066f30 0x7f75940693e0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f759c006f00 tx=0x7f759c008040 comp rx=0 tx=0).stop 2023-10-06T01:22:25.532 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:25.530+0000 7f75a7fff700 1 -- 172.21.15.50:0/3144221660 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f75a80689b0 msgr2=0x7f75a80c0b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:25.532 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:25.530+0000 7f75a7fff700 1 --2- 172.21.15.50:0/3144221660 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f75a80689b0 0x7f75a80c0b10 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f759800c590 tx=0x7f7598007e00 comp rx=0 tx=0).stop 2023-10-06T01:22:25.532 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:25.531+0000 7f75a7fff700 1 -- 172.21.15.50:0/3144221660 shutdown_connections 2023-10-06T01:22:25.532 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:25.531+0000 7f75a7fff700 1 --2- 172.21.15.50:0/3144221660 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f7594066f30 0x7f75940693e0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:25.532 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:25.531+0000 7f75a7fff700 1 --2- 172.21.15.50:0/3144221660 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f75a80cc0d0 0x7f75a8159b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:25.532 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:25.531+0000 7f75a7fff700 1 --2- 172.21.15.50:0/3144221660 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f75a80689b0 0x7f75a80c0b10 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:25.532 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:25.531+0000 7f75a7fff700 1 --2- 172.21.15.50:0/3144221660 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f75a8068d80 0x7f75a80c2800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:25.532 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:25.531+0000 7f75a7fff700 1 -- 172.21.15.50:0/3144221660 >> 172.21.15.50:0/3144221660 conn(0x7f75a80cd230 msgr2=0x7f75a8153ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:22:25.532 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:25.531+0000 7f75a7fff700 1 -- 172.21.15.50:0/3144221660 shutdown_connections 2023-10-06T01:22:25.533 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:25.531+0000 7f75a7fff700 1 -- 172.21.15.50:0/3144221660 wait complete. 2023-10-06T01:22:25.549 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-10-06T01:21:29.304225+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-10-06T01:21:29.835490+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-06T01:21:34.675315+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-10-06T01:21:35.753991+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-10-06T01:21:38.853108+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-06T01:22:25.550 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-10-06T01:22:25.739 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:25.738+0000 7f3fce79d700 1 Processor -- start 2023-10-06T01:22:25.739 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:25.738+0000 7f3fce79d700 1 -- start start 2023-10-06T01:22:25.741 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:25.740+0000 7f3fce79d700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f3fc8156130 0x7f3fc8159ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:25.741 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:25.740+0000 7f3fce79d700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3fc80acb10 con 0x7f3fc806e1a0 2023-10-06T01:22:25.741 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:25.740+0000 7f3fce79d700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3fc8156500 con 0x7f3fc80ae0f0 2023-10-06T01:22:25.741 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:25.740+0000 7f3fce79d700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3fc815a310 con 0x7f3fc8156130 2023-10-06T01:22:25.741 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:25.740+0000 7f3fcd79b700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f3fc8156130 0x7f3fc8159ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:25.741 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:25.740+0000 7f3fcdf9c700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f3fc806e1a0 0x7f3fc806e5c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:54398/0 (socket says 172.21.15.50:54398) 2023-10-06T01:22:25.741 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:25.740+0000 7f3fcdf9c700 1 -- 172.21.15.50:0/129978028 learned_addr learned my addr 172.21.15.50:0/129978028 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-10-06T01:22:25.743 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:25.740+0000 7f3fcd79b700 1 -- 172.21.15.50:0/129978028 >> v1:172.21.15.155:6789/0 conn(0x7f3fc80ae0f0 legacy=0x7f3fc80c8a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:25.743 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:25.740+0000 7f3fcd79b700 1 -- 172.21.15.50:0/129978028 >> v1:172.21.15.50:6789/0 conn(0x7f3fc806e1a0 legacy=0x7f3fc806e5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:25.743 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:25.741+0000 7f3fcd79b700 1 -- 172.21.15.50:0/129978028 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3fc815a5f0 con 0x7f3fc8156130 2023-10-06T01:22:25.743 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:25.741+0000 7f3fbffff700 1 -- 172.21.15.50:0/129978028 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2182579703 0 0) 0x7f3fc80acb10 con 0x7f3fc806e1a0 2023-10-06T01:22:25.743 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:25.741+0000 7f3fcd79b700 1 --2- 172.21.15.50:0/129978028 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3fc8156130 0x7f3fc8159ca0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f3fc40098e0 tx=0x7f3fc40091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=570b7acb0928bf90 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:22:25.743 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:25.741+0000 7f3fbffff700 1 -- 172.21.15.50:0/129978028 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fc4009e80 con 0x7f3fc8156130 2023-10-06T01:22:25.743 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:25.741+0000 7f3fbffff700 1 -- 172.21.15.50:0/129978028 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3fc400b860 con 0x7f3fc8156130 2023-10-06T01:22:25.743 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:25.741+0000 7f3fbffff700 1 -- 172.21.15.50:0/129978028 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fc400bbe0 con 0x7f3fc8156130 2023-10-06T01:22:25.743 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:25.742+0000 7f3fce79d700 1 -- 172.21.15.50:0/129978028 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3fc8156130 msgr2=0x7f3fc8159ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:25.744 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:25.742+0000 7f3fce79d700 1 --2- 172.21.15.50:0/129978028 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3fc8156130 0x7f3fc8159ca0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f3fc40098e0 tx=0x7f3fc40091a0 comp rx=0 tx=0).stop 2023-10-06T01:22:25.744 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:25.742+0000 7f3fce79d700 1 -- 172.21.15.50:0/129978028 shutdown_connections 2023-10-06T01:22:25.744 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:25.742+0000 7f3fce79d700 1 --2- 172.21.15.50:0/129978028 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3fc8156130 0x7f3fc8159ca0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:25.744 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:25.742+0000 7f3fce79d700 1 -- 172.21.15.50:0/129978028 >> 172.21.15.50:0/129978028 conn(0x7f3fc80cbf10 msgr2=0x7f3fc80cc310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:22:25.744 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:25.742+0000 7f3fce79d700 1 -- 172.21.15.50:0/129978028 shutdown_connections 2023-10-06T01:22:25.744 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:25.742+0000 7f3fce79d700 1 -- 172.21.15.50:0/129978028 wait complete. 2023-10-06T01:22:25.744 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:25.743+0000 7f3fce79d700 1 Processor -- start 2023-10-06T01:22:25.744 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:25.743+0000 7f3fce79d700 1 -- start start 2023-10-06T01:22:25.746 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:25.744+0000 7f3fce79d700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3fc806e1a0 0x7f3fc81566f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:25.746 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:25.744+0000 7f3fce79d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3fc80ae0f0 0x7f3fc81540f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:25.746 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:25.744+0000 7f3fce79d700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3fc8156130 0x7f3fc8154630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:25.747 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:25.744+0000 7f3fce79d700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3fc8157b50 con 0x7f3fc80ae0f0 2023-10-06T01:22:25.747 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:25.744+0000 7f3fce79d700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3fc813d470 con 0x7f3fc8156130 2023-10-06T01:22:25.747 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:25.744+0000 7f3fce79d700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3fc8156c30 con 0x7f3fc806e1a0 2023-10-06T01:22:25.747 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:25.745+0000 7f3fccf9a700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3fc80ae0f0 0x7f3fc81540f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:25.747 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:25.745+0000 7f3fccf9a700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3fc80ae0f0 0x7f3fc81540f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:48504/0 (socket says 172.21.15.50:48504) 2023-10-06T01:22:25.747 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:25.745+0000 7f3fccf9a700 1 -- 172.21.15.50:0/4133405991 learned_addr learned my addr 172.21.15.50:0/4133405991 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-06T01:22:25.747 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:25.745+0000 7f3fcdf9c700 1 --2- 172.21.15.50:0/4133405991 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3fc8156130 0x7f3fc8154630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:25.747 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:25.745+0000 7f3fcd79b700 1 --2- 172.21.15.50:0/4133405991 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3fc806e1a0 0x7f3fc81566f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:25.747 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:25.745+0000 7f3fccf9a700 1 -- 172.21.15.50:0/4133405991 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3fc806e1a0 msgr2=0x7f3fc81566f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:25.747 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:25.745+0000 7f3fccf9a700 1 --2- 172.21.15.50:0/4133405991 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3fc806e1a0 0x7f3fc81566f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:25.747 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:25.745+0000 7f3fccf9a700 1 -- 172.21.15.50:0/4133405991 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3fc8156130 msgr2=0x7f3fc8154630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:25.748 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:25.745+0000 7f3fccf9a700 1 --2- 172.21.15.50:0/4133405991 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3fc8156130 0x7f3fc8154630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:25.748 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:25.745+0000 7f3fccf9a700 1 -- 172.21.15.50:0/4133405991 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3fc4009420 con 0x7f3fc80ae0f0 2023-10-06T01:22:25.748 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:25.745+0000 7f3fcdf9c700 1 --2- 172.21.15.50:0/4133405991 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3fc8156130 0x7f3fc8154630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T01:22:25.748 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:25.745+0000 7f3fcd79b700 1 --2- 172.21.15.50:0/4133405991 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3fc806e1a0 0x7f3fc81566f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T01:22:25.748 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:25.745+0000 7f3fccf9a700 1 --2- 172.21.15.50:0/4133405991 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3fc80ae0f0 0x7f3fc81540f0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f3fb800c590 tx=0x7f3fb800c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:22:25.748 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:25.745+0000 7f3fbd7fa700 1 -- 172.21.15.50:0/4133405991 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fb8011590 con 0x7f3fc80ae0f0 2023-10-06T01:22:25.748 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:25.746+0000 7f3fbd7fa700 1 -- 172.21.15.50:0/4133405991 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3fb80116f0 con 0x7f3fc80ae0f0 2023-10-06T01:22:25.748 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:25.746+0000 7f3fbd7fa700 1 -- 172.21.15.50:0/4133405991 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fb8011ab0 con 0x7f3fc80ae0f0 2023-10-06T01:22:25.748 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:25.746+0000 7f3fce79d700 1 -- 172.21.15.50:0/4133405991 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3fc8156ed0 con 0x7f3fc80ae0f0 2023-10-06T01:22:25.748 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:25.746+0000 7f3fce79d700 1 -- 172.21.15.50:0/4133405991 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3fc8157490 con 0x7f3fc80ae0f0 2023-10-06T01:22:25.749 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:25.747+0000 7f3fce79d700 1 -- 172.21.15.50:0/4133405991 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3fc805f270 con 0x7f3fc80ae0f0 2023-10-06T01:22:25.749 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:25.747+0000 7f3fbd7fa700 1 -- 172.21.15.50:0/4133405991 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f3fb801b3b0 con 0x7f3fc80ae0f0 2023-10-06T01:22:25.749 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:25.748+0000 7f3fbd7fa700 1 --2- 172.21.15.50:0/4133405991 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f3fac066f30 0x7f3fac0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:25.749 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:25.748+0000 7f3fbd7fa700 1 -- 172.21.15.50:0/4133405991 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6867+0+0 (secure 0 0 0) 0x7f3fb8083fc0 con 0x7f3fc80ae0f0 2023-10-06T01:22:25.750 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:25.749+0000 7f3fcd79b700 1 --2- 172.21.15.50:0/4133405991 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f3fac066f30 0x7f3fac0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:25.750 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:25.749+0000 7f3fcd79b700 1 --2- 172.21.15.50:0/4133405991 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f3fac066f30 0x7f3fac0693e0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f3fc4003080 tx=0x7f3fc4017000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:22:25.753 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:25.753+0000 7f3fbd7fa700 1 -- 172.21.15.50:0/4133405991 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f3fb8050d00 con 0x7f3fc80ae0f0 2023-10-06T01:22:25.958 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:25.957+0000 7f3fce79d700 1 -- 172.21.15.50:0/4133405991 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f3fc815a8d0 con 0x7f3fc80ae0f0 2023-10-06T01:22:25.959 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:25.958+0000 7f3fbd7fa700 1 -- 172.21.15.50:0/4133405991 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v27) v1 ==== 92+0+10 (secure 0 0 0) 0x7f3fb8017020 con 0x7f3fc80ae0f0 2023-10-06T01:22:25.959 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 8 2023-10-06T01:22:25.961 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:25.960+0000 7f3fce79d700 1 -- 172.21.15.50:0/4133405991 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f3fac066f30 msgr2=0x7f3fac0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:25.962 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:25.960+0000 7f3fce79d700 1 --2- 172.21.15.50:0/4133405991 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f3fac066f30 0x7f3fac0693e0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f3fc4003080 tx=0x7f3fc4017000 comp rx=0 tx=0).stop 2023-10-06T01:22:25.962 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:25.960+0000 7f3fce79d700 1 -- 172.21.15.50:0/4133405991 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3fc80ae0f0 msgr2=0x7f3fc81540f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:25.962 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:25.960+0000 7f3fce79d700 1 --2- 172.21.15.50:0/4133405991 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3fc80ae0f0 0x7f3fc81540f0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f3fb800c590 tx=0x7f3fb800c950 comp rx=0 tx=0).stop 2023-10-06T01:22:25.962 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:25.960+0000 7f3fce79d700 1 -- 172.21.15.50:0/4133405991 shutdown_connections 2023-10-06T01:22:25.962 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:25.960+0000 7f3fce79d700 1 --2- 172.21.15.50:0/4133405991 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f3fac066f30 0x7f3fac0693e0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:25.962 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:25.960+0000 7f3fce79d700 1 --2- 172.21.15.50:0/4133405991 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3fc8156130 0x7f3fc8154630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:25.962 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:25.960+0000 7f3fce79d700 1 --2- 172.21.15.50:0/4133405991 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3fc806e1a0 0x7f3fc81566f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:25.963 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:25.960+0000 7f3fce79d700 1 --2- 172.21.15.50:0/4133405991 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3fc80ae0f0 0x7f3fc81540f0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:25.963 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:25.960+0000 7f3fce79d700 1 -- 172.21.15.50:0/4133405991 >> 172.21.15.50:0/4133405991 conn(0x7f3fc80cbf10 msgr2=0x7f3fc80b04e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:22:25.963 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:25.960+0000 7f3fce79d700 1 -- 172.21.15.50:0/4133405991 shutdown_connections 2023-10-06T01:22:25.963 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:25.960+0000 7f3fce79d700 1 -- 172.21.15.50:0/4133405991 wait complete. 2023-10-06T01:22:25.981 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-06T01:22:26.171 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:26.170+0000 7f678f19d700 1 Processor -- start 2023-10-06T01:22:26.172 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:26.170+0000 7f678f19d700 1 -- start start 2023-10-06T01:22:26.173 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:26.172+0000 7f678f19d700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f67880ad4a0 0x7f678806e1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:26.173 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:26.172+0000 7f678f19d700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f678806e6e0 0x7f67880a98e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:26.173 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:26.172+0000 7f678f19d700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f67880ac450 con 0x7f6788156fc0 2023-10-06T01:22:26.173 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:26.172+0000 7f678f19d700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6788157390 con 0x7f67880ad4a0 2023-10-06T01:22:26.173 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:26.172+0000 7f678f19d700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f678806eb00 con 0x7f678806e6e0 2023-10-06T01:22:26.173 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:26.172+0000 7f678e19b700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f6788156fc0 0x7f67880acd90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:54408/0 (socket says 172.21.15.50:54408) 2023-10-06T01:22:26.173 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:26.172+0000 7f678e19b700 1 -- 172.21.15.50:0/264327648 learned_addr learned my addr 172.21.15.50:0/264327648 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-10-06T01:22:26.176 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:26.172+0000 7f678d99a700 1 --2- 172.21.15.50:0/264327648 >> v2:172.21.15.155:3300/0 conn(0x7f67880ad4a0 0x7f678806e1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:26.176 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:26.172+0000 7f678e99c700 1 --2- 172.21.15.50:0/264327648 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f678806e6e0 0x7f67880a98e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:26.176 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:26.172+0000 7f678d199700 1 -- 172.21.15.50:0/264327648 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1706176991 0 0) 0x7f67880ac450 con 0x7f6788156fc0 2023-10-06T01:22:26.177 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:26.173+0000 7f678d199700 1 -- 172.21.15.50:0/264327648 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6774003570 con 0x7f6788156fc0 2023-10-06T01:22:26.177 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:26.173+0000 7f678d199700 1 -- 172.21.15.50:0/264327648 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1705130998 0 0) 0x7f6774003570 con 0x7f6788156fc0 2023-10-06T01:22:26.177 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:26.173+0000 7f678d199700 1 -- 172.21.15.50:0/264327648 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f678806e6e0 msgr2=0x7f67880a98e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:22:26.177 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:26.173+0000 7f678d199700 1 --2- 172.21.15.50:0/264327648 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f678806e6e0 0x7f67880a98e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:26.177 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:26.173+0000 7f678d199700 1 -- 172.21.15.50:0/264327648 >> v2:172.21.15.155:3300/0 conn(0x7f67880ad4a0 msgr2=0x7f678806e1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:22:26.177 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:26.173+0000 7f678d199700 1 --2- 172.21.15.50:0/264327648 >> v2:172.21.15.155:3300/0 conn(0x7f67880ad4a0 0x7f678806e1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:26.177 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:26.173+0000 7f678d199700 1 -- 172.21.15.50:0/264327648 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67880ab840 con 0x7f6788156fc0 2023-10-06T01:22:26.177 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:26.173+0000 7f678d199700 1 -- 172.21.15.50:0/264327648 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 347519148 0 0) 0x7f6784001470 con 0x7f6788156fc0 2023-10-06T01:22:26.177 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:26.173+0000 7f678d199700 1 -- 172.21.15.50:0/264327648 >> v1:172.21.15.50:6789/0 conn(0x7f6788156fc0 legacy=0x7f67880acd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:26.177 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:26.173+0000 7f678d199700 1 --2- 172.21.15.50:0/264327648 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6774003ae0 0x7f6774003ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:26.178 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:26.173+0000 7f678d199700 1 --2- 172.21.15.50:0/264327648 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f678806e6e0 0x7f6774004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:26.178 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:26.173+0000 7f678d199700 1 --2- 172.21.15.50:0/264327648 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6774004d50 0x7f67740051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:26.178 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:26.173+0000 7f678d199700 1 -- 172.21.15.50:0/264327648 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6788157390 con 0x7f6774003ae0 2023-10-06T01:22:26.178 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:26.173+0000 7f678d199700 1 -- 172.21.15.50:0/264327648 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f678806eb00 con 0x7f6774004d50 2023-10-06T01:22:26.178 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:26.173+0000 7f678d199700 1 -- 172.21.15.50:0/264327648 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f677400bb10 con 0x7f678806e6e0 2023-10-06T01:22:26.178 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:26.173+0000 7f678e19b700 1 --2- 172.21.15.50:0/264327648 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6774003ae0 0x7f6774003ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:26.178 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:26.173+0000 7f678d99a700 1 --2- 172.21.15.50:0/264327648 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f678806e6e0 0x7f6774004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:26.178 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:26.173+0000 7f678e99c700 1 --2- 172.21.15.50:0/264327648 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6774004d50 0x7f67740051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:26.178 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:26.174+0000 7f678e19b700 1 -- 172.21.15.50:0/264327648 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f678806e6e0 msgr2=0x7f6774004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:22:26.178 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:26.174+0000 7f678e19b700 1 --2- 172.21.15.50:0/264327648 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f678806e6e0 0x7f6774004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:26.178 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:26.174+0000 7f678e19b700 1 -- 172.21.15.50:0/264327648 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6774004d50 msgr2=0x7f67740051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:22:26.179 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:26.174+0000 7f678e19b700 1 --2- 172.21.15.50:0/264327648 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6774004d50 0x7f67740051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:26.179 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:26.174+0000 7f678e19b700 1 -- 172.21.15.50:0/264327648 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6774003570 con 0x7f6774003ae0 2023-10-06T01:22:26.179 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:26.174+0000 7f678e19b700 1 --2- 172.21.15.50:0/264327648 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6774003ae0 0x7f6774003ef0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f678400c300 tx=0x7f6784001dc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9e51c3e81ae508a6 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:22:26.179 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:26.174+0000 7f678d199700 1 -- 172.21.15.50:0/264327648 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f678400cb90 con 0x7f6774003ae0 2023-10-06T01:22:26.179 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:26.174+0000 7f678d199700 1 -- 172.21.15.50:0/264327648 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f678400ccf0 con 0x7f6774003ae0 2023-10-06T01:22:26.179 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:26.174+0000 7f678d199700 1 -- 172.21.15.50:0/264327648 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6784005b70 con 0x7f6774003ae0 2023-10-06T01:22:26.179 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:26.175+0000 7f678f19d700 1 -- 172.21.15.50:0/264327648 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6774003ae0 msgr2=0x7f6774003ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:26.179 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:26.175+0000 7f678f19d700 1 --2- 172.21.15.50:0/264327648 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6774003ae0 0x7f6774003ef0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f678400c300 tx=0x7f6784001dc0 comp rx=0 tx=0).stop 2023-10-06T01:22:26.179 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:26.175+0000 7f678e99c700 1 -- 172.21.15.50:0/264327648 reap_dead start 2023-10-06T01:22:26.179 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:26.175+0000 7f678f19d700 1 -- 172.21.15.50:0/264327648 shutdown_connections 2023-10-06T01:22:26.180 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:26.175+0000 7f678f19d700 1 -- 172.21.15.50:0/264327648 >> 172.21.15.50:0/264327648 conn(0x7f67880cbf10 msgr2=0x7f67880cc310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:22:26.180 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:26.175+0000 7f678f19d700 1 -- 172.21.15.50:0/264327648 shutdown_connections 2023-10-06T01:22:26.180 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:26.175+0000 7f678f19d700 1 -- 172.21.15.50:0/264327648 wait complete. 2023-10-06T01:22:26.182 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:26.176+0000 7f678f19d700 1 Processor -- start 2023-10-06T01:22:26.182 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:26.176+0000 7f678f19d700 1 -- start start 2023-10-06T01:22:26.182 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:26.177+0000 7f678f19d700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6774003ae0 0x7f6788154bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:26.182 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:26.177+0000 7f678f19d700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6788147db0 0x7f6788156230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:26.182 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:26.177+0000 7f678f19d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f67880af0b0 0x7f67880af510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:26.182 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:26.177+0000 7f678f19d700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6788155da0 con 0x7f67880af0b0 2023-10-06T01:22:26.182 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:26.177+0000 7f678f19d700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6788155190 con 0x7f6774003ae0 2023-10-06T01:22:26.182 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:26.177+0000 7f678f19d700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6788155470 con 0x7f6788147db0 2023-10-06T01:22:26.182 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:26.178+0000 7f678e99c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f67880af0b0 0x7f67880af510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:26.182 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:26.178+0000 7f678e19b700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6774003ae0 0x7f6788154bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:26.183 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:26.178+0000 7f678e99c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f67880af0b0 0x7f67880af510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:48524/0 (socket says 172.21.15.50:48524) 2023-10-06T01:22:26.183 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:26.178+0000 7f678e99c700 1 -- 172.21.15.50:0/1737799916 learned_addr learned my addr 172.21.15.50:0/1737799916 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-06T01:22:26.183 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:26.178+0000 7f678d99a700 1 --2- 172.21.15.50:0/1737799916 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6788147db0 0x7f6788156230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:26.183 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:26.178+0000 7f678e99c700 1 -- 172.21.15.50:0/1737799916 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6788147db0 msgr2=0x7f6788156230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:26.183 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:26.178+0000 7f678e99c700 1 --2- 172.21.15.50:0/1737799916 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6788147db0 0x7f6788156230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:26.183 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:26.178+0000 7f678e99c700 1 -- 172.21.15.50:0/1737799916 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6774003ae0 msgr2=0x7f6788154bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:26.183 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:26.178+0000 7f678e99c700 1 --2- 172.21.15.50:0/1737799916 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6774003ae0 0x7f6788154bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:26.183 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:26.178+0000 7f678e99c700 1 -- 172.21.15.50:0/1737799916 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6788155750 con 0x7f67880af0b0 2023-10-06T01:22:26.183 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:26.178+0000 7f678e99c700 1 --2- 172.21.15.50:0/1737799916 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f67880af0b0 0x7f67880af510 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f67880b1d70 tx=0x7f678000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:22:26.183 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:26.179+0000 7f677e7fc700 1 -- 172.21.15.50:0/1737799916 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f678000e070 con 0x7f67880af0b0 2023-10-06T01:22:26.183 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:26.179+0000 7f677e7fc700 1 -- 172.21.15.50:0/1737799916 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6780011b80 con 0x7f67880af0b0 2023-10-06T01:22:26.183 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:26.179+0000 7f677e7fc700 1 -- 172.21.15.50:0/1737799916 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6780016470 con 0x7f67880af0b0 2023-10-06T01:22:26.183 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:26.179+0000 7f678f19d700 1 -- 172.21.15.50:0/1737799916 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6788155a30 con 0x7f67880af0b0 2023-10-06T01:22:26.183 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:26.179+0000 7f678f19d700 1 -- 172.21.15.50:0/1737799916 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f67880afc10 con 0x7f67880af0b0 2023-10-06T01:22:26.185 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:26.180+0000 7f678f19d700 1 -- 172.21.15.50:0/1737799916 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f67880afe30 con 0x7f67880af0b0 2023-10-06T01:22:26.185 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:26.180+0000 7f677e7fc700 1 -- 172.21.15.50:0/1737799916 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f67800168a0 con 0x7f67880af0b0 2023-10-06T01:22:26.186 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:26.181+0000 7f677e7fc700 1 --2- 172.21.15.50:0/1737799916 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f676c066f60 0x7f676c069410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:26.186 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:26.181+0000 7f677e7fc700 1 -- 172.21.15.50:0/1737799916 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6867+0+0 (secure 0 0 0) 0x7f6780085400 con 0x7f67880af0b0 2023-10-06T01:22:26.186 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:26.182+0000 7f678e19b700 1 --2- 172.21.15.50:0/1737799916 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f676c066f60 0x7f676c069410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:26.186 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:26.182+0000 7f678e19b700 1 --2- 172.21.15.50:0/1737799916 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f676c066f60 0x7f676c069410 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f6784015040 tx=0x7f6784012000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:22:26.186 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:26.185+0000 7f677e7fc700 1 -- 172.21.15.50:0/1737799916 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f67880afe30 con 0x7f67880af0b0 2023-10-06T01:22:26.387 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:26.386+0000 7f678f19d700 1 -- 172.21.15.50:0/1737799916 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f67880afe30 con 0x7f67880af0b0 2023-10-06T01:22:26.388 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:26.387+0000 7f677e7fc700 1 -- 172.21.15.50:0/1737799916 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v27) v1 ==== 93+0+10 (secure 0 0 0) 0x7f67880afe30 con 0x7f67880af0b0 2023-10-06T01:22:26.388 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 1 2023-10-06T01:22:26.390 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:26.389+0000 7f678f19d700 1 -- 172.21.15.50:0/1737799916 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f676c066f60 msgr2=0x7f676c069410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:26.390 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:26.389+0000 7f678f19d700 1 --2- 172.21.15.50:0/1737799916 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f676c066f60 0x7f676c069410 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f6784015040 tx=0x7f6784012000 comp rx=0 tx=0).stop 2023-10-06T01:22:26.390 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:26.389+0000 7f678f19d700 1 -- 172.21.15.50:0/1737799916 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f67880af0b0 msgr2=0x7f67880af510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:26.391 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:26.389+0000 7f678f19d700 1 --2- 172.21.15.50:0/1737799916 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f67880af0b0 0x7f67880af510 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f67880b1d70 tx=0x7f678000b040 comp rx=0 tx=0).stop 2023-10-06T01:22:26.391 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:26.389+0000 7f678f19d700 1 -- 172.21.15.50:0/1737799916 shutdown_connections 2023-10-06T01:22:26.391 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:26.389+0000 7f678f19d700 1 --2- 172.21.15.50:0/1737799916 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f67880af0b0 0x7f67880af510 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:26.391 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:26.389+0000 7f678f19d700 1 --2- 172.21.15.50:0/1737799916 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f676c066f60 0x7f676c069410 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:26.391 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:26.389+0000 7f678f19d700 1 --2- 172.21.15.50:0/1737799916 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6774003ae0 0x7f6788154bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:26.391 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:26.389+0000 7f678f19d700 1 --2- 172.21.15.50:0/1737799916 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6788147db0 0x7f6788156230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:26.391 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:26.389+0000 7f678f19d700 1 -- 172.21.15.50:0/1737799916 >> 172.21.15.50:0/1737799916 conn(0x7f67880cbf10 msgr2=0x7f67880b1650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:22:26.391 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:26.389+0000 7f678f19d700 1 -- 172.21.15.50:0/1737799916 shutdown_connections 2023-10-06T01:22:26.391 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:26.389+0000 7f678f19d700 1 -- 172.21.15.50:0/1737799916 wait complete. 2023-10-06T01:22:26.408 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-06T01:22:26.597 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:26.596+0000 7f739599d700 1 Processor -- start 2023-10-06T01:22:26.598 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:26.596+0000 7f739599d700 1 -- start start 2023-10-06T01:22:26.600 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:26.598+0000 7f739599d700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7390159ca0 0x7f73900c8a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:26.600 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:26.598+0000 7f739599d700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f73900acb10 con 0x7f73900c8f70 2023-10-06T01:22:26.600 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:26.598+0000 7f739599d700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7390156500 con 0x7f7390156130 2023-10-06T01:22:26.600 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:26.598+0000 7f739599d700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f739015a0f0 con 0x7f7390159ca0 2023-10-06T01:22:26.601 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:26.598+0000 7f739519c700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f73900c8f70 0x7f739006e1a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:54414/0 (socket says 172.21.15.50:54414) 2023-10-06T01:22:26.601 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:26.598+0000 7f739519c700 1 -- 172.21.15.50:0/734236741 learned_addr learned my addr 172.21.15.50:0/734236741 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-10-06T01:22:26.601 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:26.598+0000 7f738ffff700 1 --2- 172.21.15.50:0/734236741 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7390159ca0 0x7f73900c8a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:26.601 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:26.598+0000 7f738f7fe700 1 -- 172.21.15.50:0/734236741 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2231284578 0 0) 0x7f73900acb10 con 0x7f73900c8f70 2023-10-06T01:22:26.601 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:26.598+0000 7f738f7fe700 1 -- 172.21.15.50:0/734236741 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7380003570 con 0x7f73900c8f70 2023-10-06T01:22:26.601 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:26.599+0000 7f738f7fe700 1 -- 172.21.15.50:0/734236741 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 307401104 0 0) 0x7f7390156500 con 0x7f7390156130 2023-10-06T01:22:26.601 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:26.599+0000 7f738f7fe700 1 -- 172.21.15.50:0/734236741 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f73900acb10 con 0x7f7390156130 2023-10-06T01:22:26.601 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:26.599+0000 7f738ffff700 1 -- 172.21.15.50:0/734236741 >> v1:172.21.15.155:6789/0 conn(0x7f7390156130 legacy=0x7f73900ae0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:26.601 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:26.599+0000 7f738ffff700 1 -- 172.21.15.50:0/734236741 >> v1:172.21.15.50:6789/0 conn(0x7f73900c8f70 legacy=0x7f739006e1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:26.601 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:26.599+0000 7f738f7fe700 1 -- 172.21.15.50:0/734236741 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 111553222 0 0) 0x7f7380003570 con 0x7f73900c8f70 2023-10-06T01:22:26.601 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:26.599+0000 7f738ffff700 1 -- 172.21.15.50:0/734236741 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f739015a310 con 0x7f7390159ca0 2023-10-06T01:22:26.602 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:26.599+0000 7f738ffff700 1 --2- 172.21.15.50:0/734236741 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7390159ca0 0x7f73900c8a30 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f737c009910 tx=0x7f737c0091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=dd642936400e40d6 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:22:26.602 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:26.599+0000 7f738f7fe700 1 -- 172.21.15.50:0/734236741 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73880017f0 con 0x7f7390159ca0 2023-10-06T01:22:26.602 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:26.599+0000 7f738f7fe700 1 -- 172.21.15.50:0/734236741 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f737c011420 con 0x7f7390159ca0 2023-10-06T01:22:26.602 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:26.599+0000 7f738f7fe700 1 -- 172.21.15.50:0/734236741 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f737c0117c0 con 0x7f7390159ca0 2023-10-06T01:22:26.605 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:26.600+0000 7f739599d700 1 -- 172.21.15.50:0/734236741 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7390159ca0 msgr2=0x7f73900c8a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:26.605 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:26.600+0000 7f739599d700 1 --2- 172.21.15.50:0/734236741 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7390159ca0 0x7f73900c8a30 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f737c009910 tx=0x7f737c0091a0 comp rx=0 tx=0).stop 2023-10-06T01:22:26.605 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:26.600+0000 7f739599d700 1 -- 172.21.15.50:0/734236741 shutdown_connections 2023-10-06T01:22:26.605 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:26.600+0000 7f739599d700 1 --2- 172.21.15.50:0/734236741 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7390159ca0 0x7f73900c8a30 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:26.605 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:26.600+0000 7f739599d700 1 -- 172.21.15.50:0/734236741 >> 172.21.15.50:0/734236741 conn(0x7f73900cbf10 msgr2=0x7f73900cc310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:22:26.605 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:26.600+0000 7f739599d700 1 -- 172.21.15.50:0/734236741 shutdown_connections 2023-10-06T01:22:26.605 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:26.600+0000 7f739599d700 1 -- 172.21.15.50:0/734236741 wait complete. 2023-10-06T01:22:26.605 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:26.601+0000 7f739599d700 1 Processor -- start 2023-10-06T01:22:26.605 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:26.602+0000 7f739599d700 1 -- start start 2023-10-06T01:22:26.606 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:26.602+0000 7f739599d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f73900c8f70 0x7f73900c9d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:26.606 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:26.603+0000 7f739599d700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7390156130 0x7f73900ca2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:26.606 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:26.603+0000 7f739599d700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7390159ca0 0x7f739016d690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:26.606 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:26.603+0000 7f739599d700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73900c50c0 con 0x7f73900c8f70 2023-10-06T01:22:26.606 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:26.603+0000 7f739599d700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73900c5640 con 0x7f7390159ca0 2023-10-06T01:22:26.606 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:26.603+0000 7f739599d700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7390159360 con 0x7f7390156130 2023-10-06T01:22:26.606 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:26.603+0000 7f739499b700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f73900c8f70 0x7f73900c9d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:26.606 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:26.603+0000 7f739499b700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f73900c8f70 0x7f73900c9d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:48538/0 (socket says 172.21.15.50:48538) 2023-10-06T01:22:26.606 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:26.603+0000 7f739499b700 1 -- 172.21.15.50:0/3066320981 learned_addr learned my addr 172.21.15.50:0/3066320981 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-06T01:22:26.606 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:26.603+0000 7f739519c700 1 --2- 172.21.15.50:0/3066320981 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7390159ca0 0x7f739016d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:26.607 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:26.603+0000 7f738ffff700 1 --2- 172.21.15.50:0/3066320981 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7390156130 0x7f73900ca2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:26.607 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:26.603+0000 7f739499b700 1 -- 172.21.15.50:0/3066320981 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7390156130 msgr2=0x7f73900ca2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:26.607 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:26.603+0000 7f739499b700 1 --2- 172.21.15.50:0/3066320981 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7390156130 0x7f73900ca2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:26.607 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:26.603+0000 7f739499b700 1 -- 172.21.15.50:0/3066320981 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7390159ca0 msgr2=0x7f739016d690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:26.607 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:26.603+0000 7f739499b700 1 --2- 172.21.15.50:0/3066320981 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7390159ca0 0x7f739016d690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:26.607 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:26.603+0000 7f739499b700 1 -- 172.21.15.50:0/3066320981 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f737c009420 con 0x7f73900c8f70 2023-10-06T01:22:26.607 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:26.603+0000 7f738ffff700 1 --2- 172.21.15.50:0/3066320981 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7390156130 0x7f73900ca2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T01:22:26.607 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:26.604+0000 7f739499b700 1 --2- 172.21.15.50:0/3066320981 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f73900c8f70 0x7f73900c9d70 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f738400c790 tx=0x7f7384007e10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:22:26.607 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:26.604+0000 7f738cff9700 1 -- 172.21.15.50:0/3066320981 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7384010510 con 0x7f73900c8f70 2023-10-06T01:22:26.607 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:26.604+0000 7f738cff9700 1 -- 172.21.15.50:0/3066320981 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7384010670 con 0x7f73900c8f70 2023-10-06T01:22:26.607 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:26.604+0000 7f738cff9700 1 -- 172.21.15.50:0/3066320981 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7384010a30 con 0x7f73900c8f70 2023-10-06T01:22:26.608 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:26.604+0000 7f739599d700 1 -- 172.21.15.50:0/3066320981 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f73900ca940 con 0x7f73900c8f70 2023-10-06T01:22:26.608 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:26.604+0000 7f739599d700 1 -- 172.21.15.50:0/3066320981 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f73900c52d0 con 0x7f73900c8f70 2023-10-06T01:22:26.608 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:26.605+0000 7f737a7fc700 1 -- 172.21.15.50:0/3066320981 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f73680052b0 con 0x7f73900c8f70 2023-10-06T01:22:26.609 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:26.606+0000 7f738cff9700 1 -- 172.21.15.50:0/3066320981 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f738401b3b0 con 0x7f73900c8f70 2023-10-06T01:22:26.609 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:26.607+0000 7f738cff9700 1 --2- 172.21.15.50:0/3066320981 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f7374066f30 0x7f73740693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:26.609 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:26.607+0000 7f738cff9700 1 -- 172.21.15.50:0/3066320981 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6867+0+0 (secure 0 0 0) 0x7f7384084320 con 0x7f73900c8f70 2023-10-06T01:22:26.609 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:26.607+0000 7f738ffff700 1 --2- 172.21.15.50:0/3066320981 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f7374066f30 0x7f73740693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:26.609 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:26.608+0000 7f738ffff700 1 --2- 172.21.15.50:0/3066320981 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f7374066f30 0x7f73740693e0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f737c0030c0 tx=0x7f737c016000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:22:26.612 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:26.611+0000 7f738cff9700 1 -- 172.21.15.50:0/3066320981 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f7384051060 con 0x7f73900c8f70 2023-10-06T01:22:26.814 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:26.813+0000 7f737a7fc700 1 -- 172.21.15.50:0/3066320981 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f7368005ae0 con 0x7f73900c8f70 2023-10-06T01:22:26.814 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:26.813+0000 7f738cff9700 1 -- 172.21.15.50:0/3066320981 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v27) v1 ==== 104+0+11 (secure 0 0 0) 0x7f7384054680 con 0x7f73900c8f70 2023-10-06T01:22:26.815 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 32 2023-10-06T01:22:26.817 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:26.816+0000 7f737a7fc700 1 -- 172.21.15.50:0/3066320981 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f7374066f30 msgr2=0x7f73740693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:26.817 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:26.816+0000 7f737a7fc700 1 --2- 172.21.15.50:0/3066320981 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f7374066f30 0x7f73740693e0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f737c0030c0 tx=0x7f737c016000 comp rx=0 tx=0).stop 2023-10-06T01:22:26.817 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:26.816+0000 7f737a7fc700 1 -- 172.21.15.50:0/3066320981 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f73900c8f70 msgr2=0x7f73900c9d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:26.817 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:26.816+0000 7f737a7fc700 1 --2- 172.21.15.50:0/3066320981 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f73900c8f70 0x7f73900c9d70 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f738400c790 tx=0x7f7384007e10 comp rx=0 tx=0).stop 2023-10-06T01:22:26.817 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:26.816+0000 7f737a7fc700 1 -- 172.21.15.50:0/3066320981 shutdown_connections 2023-10-06T01:22:26.817 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:26.816+0000 7f737a7fc700 1 --2- 172.21.15.50:0/3066320981 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f7374066f30 0x7f73740693e0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:26.818 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:26.816+0000 7f737a7fc700 1 --2- 172.21.15.50:0/3066320981 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7390159ca0 0x7f739016d690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:26.818 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:26.816+0000 7f737a7fc700 1 --2- 172.21.15.50:0/3066320981 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f73900c8f70 0x7f73900c9d70 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:26.818 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:26.816+0000 7f737a7fc700 1 --2- 172.21.15.50:0/3066320981 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7390156130 0x7f73900ca2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:26.818 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:26.816+0000 7f737a7fc700 1 -- 172.21.15.50:0/3066320981 >> 172.21.15.50:0/3066320981 conn(0x7f73900cbf10 msgr2=0x7f73900aff20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:22:26.818 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:26.816+0000 7f737a7fc700 1 -- 172.21.15.50:0/3066320981 shutdown_connections 2023-10-06T01:22:26.818 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:26.816+0000 7f737a7fc700 1 -- 172.21.15.50:0/3066320981 wait complete. 2023-10-06T01:22:26.834 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-06T01:22:27.025 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:27.024+0000 7fba78b9d700 1 Processor -- start 2023-10-06T01:22:27.026 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:27.025+0000 7fba78b9d700 1 -- start start 2023-10-06T01:22:27.028 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:27.026+0000 7fba78b9d700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fba741593c0 0x7fba740675f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:27.028 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:27.026+0000 7fba78b9d700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fba740afde0 0x7fba74067b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:27.028 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:27.026+0000 7fba78b9d700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fba740ad6b0 0x7fba740adb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:27.028 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:27.026+0000 7fba78b9d700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fba740cdea0 con 0x7fba741593c0 2023-10-06T01:22:27.028 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:27.026+0000 7fba78b9d700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fba740b0310 con 0x7fba740afde0 2023-10-06T01:22:27.028 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:27.026+0000 7fba78b9d700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba740c9040 con 0x7fba740ad6b0 2023-10-06T01:22:27.028 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:27.026+0000 7fba737fe700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fba741593c0 0x7fba740675f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:27.028 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:27.026+0000 7fba737fe700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fba741593c0 0x7fba740675f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:48544/0 (socket says 172.21.15.50:48544) 2023-10-06T01:22:27.029 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:27.026+0000 7fba737fe700 1 -- 172.21.15.50:0/2014782782 learned_addr learned my addr 172.21.15.50:0/2014782782 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-06T01:22:27.029 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:27.026+0000 7fba72ffd700 1 --2- 172.21.15.50:0/2014782782 >> v2:172.21.15.155:3300/0 conn(0x7fba740afde0 0x7fba74067b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:27.029 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:27.026+0000 7fba73fff700 1 --2- 172.21.15.50:0/2014782782 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fba740ad6b0 0x7fba740adb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:27.029 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:27.027+0000 7fba737fe700 1 -- 172.21.15.50:0/2014782782 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fba740ad6b0 msgr2=0x7fba740adb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:22:27.029 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:27.027+0000 7fba737fe700 1 --2- 172.21.15.50:0/2014782782 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fba740ad6b0 0x7fba740adb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:27.029 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:27.027+0000 7fba737fe700 1 -- 172.21.15.50:0/2014782782 >> v2:172.21.15.155:3300/0 conn(0x7fba740afde0 msgr2=0x7fba74067b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:22:27.030 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:27.027+0000 7fba737fe700 1 --2- 172.21.15.50:0/2014782782 >> v2:172.21.15.155:3300/0 conn(0x7fba740afde0 0x7fba74067b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:27.030 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:27.027+0000 7fba737fe700 1 -- 172.21.15.50:0/2014782782 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba740c9320 con 0x7fba741593c0 2023-10-06T01:22:27.030 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:27.027+0000 7fba72ffd700 1 --2- 172.21.15.50:0/2014782782 >> v2:172.21.15.155:3300/0 conn(0x7fba740afde0 0x7fba74067b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T01:22:27.030 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:27.027+0000 7fba737fe700 1 --2- 172.21.15.50:0/2014782782 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fba741593c0 0x7fba740675f0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fba7415cfb0 tx=0x7fba64009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=67a9c1d0d5416a58 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:22:27.030 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:27.027+0000 7fba727fc700 1 -- 172.21.15.50:0/2014782782 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba6400b860 con 0x7fba741593c0 2023-10-06T01:22:27.031 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:27.027+0000 7fba727fc700 1 -- 172.21.15.50:0/2014782782 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba6400b9c0 con 0x7fba741593c0 2023-10-06T01:22:27.031 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:27.027+0000 7fba727fc700 1 -- 172.21.15.50:0/2014782782 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba6400bd60 con 0x7fba741593c0 2023-10-06T01:22:27.035 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:27.028+0000 7fba78b9d700 1 -- 172.21.15.50:0/2014782782 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fba741593c0 msgr2=0x7fba740675f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:27.035 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:27.028+0000 7fba78b9d700 1 --2- 172.21.15.50:0/2014782782 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fba741593c0 0x7fba740675f0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fba7415cfb0 tx=0x7fba64009250 comp rx=0 tx=0).stop 2023-10-06T01:22:27.035 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:27.028+0000 7fba78b9d700 1 -- 172.21.15.50:0/2014782782 shutdown_connections 2023-10-06T01:22:27.035 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:27.028+0000 7fba78b9d700 1 --2- 172.21.15.50:0/2014782782 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fba740ad6b0 0x7fba740adb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:27.036 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:27.028+0000 7fba78b9d700 1 --2- 172.21.15.50:0/2014782782 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fba741593c0 0x7fba740675f0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:27.036 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:27.028+0000 7fba78b9d700 1 --2- 172.21.15.50:0/2014782782 >> v2:172.21.15.155:3300/0 conn(0x7fba740afde0 0x7fba74067b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:27.036 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:27.028+0000 7fba78b9d700 1 -- 172.21.15.50:0/2014782782 >> 172.21.15.50:0/2014782782 conn(0x7fba740691d0 msgr2=0x7fba740cd020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:22:27.036 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:27.028+0000 7fba78b9d700 1 -- 172.21.15.50:0/2014782782 shutdown_connections 2023-10-06T01:22:27.036 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:27.028+0000 7fba78b9d700 1 -- 172.21.15.50:0/2014782782 wait complete. 2023-10-06T01:22:27.036 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:27.029+0000 7fba78b9d700 1 Processor -- start 2023-10-06T01:22:27.036 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:27.029+0000 7fba78b9d700 1 -- start start 2023-10-06T01:22:27.036 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:27.030+0000 7fba78b9d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fba740ad6b0 0x7fba74151a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:27.036 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:27.030+0000 7fba78b9d700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fba740afde0 0x7fba7415cfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:27.036 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:27.030+0000 7fba78b9d700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fba741593c0 0x7fba7416c780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:27.036 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:27.030+0000 7fba78b9d700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba740cc090 con 0x7fba740ad6b0 2023-10-06T01:22:27.037 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:27.030+0000 7fba78b9d700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba74151f60 con 0x7fba740afde0 2023-10-06T01:22:27.037 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:27.030+0000 7fba78b9d700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba740cb480 con 0x7fba741593c0 2023-10-06T01:22:27.037 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:27.030+0000 7fba737fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fba740ad6b0 0x7fba74151a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:27.037 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:27.031+0000 7fba737fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fba740ad6b0 0x7fba74151a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:48560/0 (socket says 172.21.15.50:48560) 2023-10-06T01:22:27.037 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:27.031+0000 7fba737fe700 1 -- 172.21.15.50:0/1791982437 learned_addr learned my addr 172.21.15.50:0/1791982437 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-06T01:22:27.037 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:27.031+0000 7fba72ffd700 1 --2- 172.21.15.50:0/1791982437 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fba740afde0 0x7fba7415cfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:27.037 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:27.031+0000 7fba73fff700 1 --2- 172.21.15.50:0/1791982437 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fba741593c0 0x7fba7416c780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:27.037 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:27.031+0000 7fba737fe700 1 -- 172.21.15.50:0/1791982437 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fba741593c0 msgr2=0x7fba7416c780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:27.037 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:27.031+0000 7fba737fe700 1 --2- 172.21.15.50:0/1791982437 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fba741593c0 0x7fba7416c780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:27.037 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:27.031+0000 7fba737fe700 1 -- 172.21.15.50:0/1791982437 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fba740afde0 msgr2=0x7fba7415cfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:27.037 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:27.031+0000 7fba737fe700 1 --2- 172.21.15.50:0/1791982437 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fba740afde0 0x7fba7415cfe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:27.037 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:27.031+0000 7fba737fe700 1 -- 172.21.15.50:0/1791982437 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba640094f0 con 0x7fba740ad6b0 2023-10-06T01:22:27.038 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:27.031+0000 7fba737fe700 1 --2- 172.21.15.50:0/1791982437 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fba740ad6b0 0x7fba74151a20 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fba64009290 tx=0x7fba64017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:22:27.038 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:27.031+0000 7fba5b7fe700 1 -- 172.21.15.50:0/1791982437 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba64011e40 con 0x7fba740ad6b0 2023-10-06T01:22:27.038 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:27.031+0000 7fba5b7fe700 1 -- 172.21.15.50:0/1791982437 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba6401a450 con 0x7fba740ad6b0 2023-10-06T01:22:27.038 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:27.032+0000 7fba5b7fe700 1 -- 172.21.15.50:0/1791982437 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba6401a810 con 0x7fba740ad6b0 2023-10-06T01:22:27.038 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:27.032+0000 7fba78b9d700 1 -- 172.21.15.50:0/1791982437 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fba740cb760 con 0x7fba740ad6b0 2023-10-06T01:22:27.038 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:27.032+0000 7fba78b9d700 1 -- 172.21.15.50:0/1791982437 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fba740cbd20 con 0x7fba740ad6b0 2023-10-06T01:22:27.038 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:27.033+0000 7fba78b9d700 1 -- 172.21.15.50:0/1791982437 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fba7405f270 con 0x7fba740ad6b0 2023-10-06T01:22:27.038 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:27.034+0000 7fba5b7fe700 1 -- 172.21.15.50:0/1791982437 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fba6401abc0 con 0x7fba740ad6b0 2023-10-06T01:22:27.039 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:27.035+0000 7fba5b7fe700 1 --2- 172.21.15.50:0/1791982437 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7fba60066f60 0x7fba60069410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:27.039 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:27.035+0000 7fba5b7fe700 1 -- 172.21.15.50:0/1791982437 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6867+0+0 (secure 0 0 0) 0x7fba64085ed0 con 0x7fba740ad6b0 2023-10-06T01:22:27.039 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:27.035+0000 7fba72ffd700 1 --2- 172.21.15.50:0/1791982437 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7fba60066f60 0x7fba60069410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:27.039 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:27.036+0000 7fba72ffd700 1 --2- 172.21.15.50:0/1791982437 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7fba60066f60 0x7fba60069410 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fba7416c6e0 tx=0x7fba68008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:22:27.040 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:27.040+0000 7fba5b7fe700 1 -- 172.21.15.50:0/1791982437 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fba64052cb0 con 0x7fba740ad6b0 2023-10-06T01:22:27.243 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:27.242+0000 7fba78b9d700 1 -- 172.21.15.50:0/1791982437 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fba740c9600 con 0x7fba740ad6b0 2023-10-06T01:22:27.243 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:27.242+0000 7fba5b7fe700 1 -- 172.21.15.50:0/1791982437 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v27) v1 ==== 100+0+11 (secure 0 0 0) 0x7fba640150a0 con 0x7fba740ad6b0 2023-10-06T01:22:27.243 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 64 2023-10-06T01:22:27.246 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:27.245+0000 7fba78b9d700 1 -- 172.21.15.50:0/1791982437 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7fba60066f60 msgr2=0x7fba60069410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:27.246 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:27.245+0000 7fba78b9d700 1 --2- 172.21.15.50:0/1791982437 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7fba60066f60 0x7fba60069410 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fba7416c6e0 tx=0x7fba68008040 comp rx=0 tx=0).stop 2023-10-06T01:22:27.246 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:27.245+0000 7fba78b9d700 1 -- 172.21.15.50:0/1791982437 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fba740ad6b0 msgr2=0x7fba74151a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:27.246 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:27.245+0000 7fba78b9d700 1 --2- 172.21.15.50:0/1791982437 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fba740ad6b0 0x7fba74151a20 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fba64009290 tx=0x7fba64017000 comp rx=0 tx=0).stop 2023-10-06T01:22:27.246 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:27.245+0000 7fba78b9d700 1 -- 172.21.15.50:0/1791982437 shutdown_connections 2023-10-06T01:22:27.247 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:27.245+0000 7fba78b9d700 1 --2- 172.21.15.50:0/1791982437 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fba741593c0 0x7fba7416c780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:27.247 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:27.245+0000 7fba78b9d700 1 --2- 172.21.15.50:0/1791982437 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fba740ad6b0 0x7fba74151a20 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:27.247 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:27.245+0000 7fba78b9d700 1 --2- 172.21.15.50:0/1791982437 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7fba60066f60 0x7fba60069410 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:27.247 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:27.245+0000 7fba78b9d700 1 --2- 172.21.15.50:0/1791982437 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fba740afde0 0x7fba7415cfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:27.247 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:27.245+0000 7fba78b9d700 1 -- 172.21.15.50:0/1791982437 >> 172.21.15.50:0/1791982437 conn(0x7fba740691d0 msgr2=0x7fba740aec00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:22:27.247 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:27.245+0000 7fba78b9d700 1 -- 172.21.15.50:0/1791982437 shutdown_connections 2023-10-06T01:22:27.247 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:27.245+0000 7fba78b9d700 1 -- 172.21.15.50:0/1791982437 wait complete. 2023-10-06T01:22:27.264 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-10-06T01:22:27.454 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:27.453+0000 7fdddbfff700 1 Processor -- start 2023-10-06T01:22:27.455 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:27.453+0000 7fdddbfff700 1 -- start start 2023-10-06T01:22:27.456 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:27.455+0000 7fdddbfff700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fdddc154ea0 0x7fdddc0adae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:27.456 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:27.455+0000 7fdddbfff700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdddc06ef50 con 0x7fdddc154ad0 2023-10-06T01:22:27.456 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:27.455+0000 7fdddbfff700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdddc06e340 con 0x7fdddc0ae020 2023-10-06T01:22:27.456 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:27.455+0000 7fdddbfff700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdddc0ae4a0 con 0x7fdddc154ea0 2023-10-06T01:22:27.456 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:27.455+0000 7fdddaffd700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fdddc154ad0 0x7fdddc0b15d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:54430/0 (socket says 172.21.15.50:54430) 2023-10-06T01:22:27.456 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:27.455+0000 7fdddaffd700 1 -- 172.21.15.50:0/913460795 learned_addr learned my addr 172.21.15.50:0/913460795 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-10-06T01:22:27.459 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:27.455+0000 7fddd9ffb700 1 -- 172.21.15.50:0/913460795 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2855643542 0 0) 0x7fdddc06ef50 con 0x7fdddc154ad0 2023-10-06T01:22:27.460 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:27.455+0000 7fddd9ffb700 1 -- 172.21.15.50:0/913460795 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fddc4003570 con 0x7fdddc154ad0 2023-10-06T01:22:27.460 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:27.455+0000 7fddda7fc700 1 --2- 172.21.15.50:0/913460795 >> v2:172.21.15.155:3300/0 conn(0x7fdddc154ea0 0x7fdddc0adae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:27.460 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:27.456+0000 7fddd9ffb700 1 -- 172.21.15.50:0/913460795 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3877012484 0 0) 0x7fddc4003570 con 0x7fdddc154ad0 2023-10-06T01:22:27.460 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:27.456+0000 7fddd9ffb700 1 -- 172.21.15.50:0/913460795 >> v2:172.21.15.155:3300/0 conn(0x7fdddc154ea0 msgr2=0x7fdddc0adae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:22:27.460 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:27.456+0000 7fddd9ffb700 1 --2- 172.21.15.50:0/913460795 >> v2:172.21.15.155:3300/0 conn(0x7fdddc154ea0 0x7fdddc0adae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:27.460 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:27.456+0000 7fddd9ffb700 1 -- 172.21.15.50:0/913460795 >> v1:172.21.15.155:6789/0 conn(0x7fdddc0ae020 legacy=0x7fdddc0ab7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:27.460 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:27.456+0000 7fddd9ffb700 1 -- 172.21.15.50:0/913460795 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdddc06e620 con 0x7fdddc154ad0 2023-10-06T01:22:27.461 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:27.456+0000 7fddd9ffb700 1 -- 172.21.15.50:0/913460795 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 347519148 0 0) 0x7fddcc001470 con 0x7fdddc154ad0 2023-10-06T01:22:27.461 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:27.456+0000 7fddd9ffb700 1 -- 172.21.15.50:0/913460795 >> v1:172.21.15.50:6789/0 conn(0x7fdddc154ad0 legacy=0x7fdddc0b15d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:27.461 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:27.456+0000 7fddd9ffb700 1 --2- 172.21.15.50:0/913460795 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fddc4003ab0 0x7fddc4003ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:27.461 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:27.456+0000 7fddd9ffb700 1 --2- 172.21.15.50:0/913460795 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fddc4004810 0x7fddc4004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:27.461 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:27.456+0000 7fddd9ffb700 1 --2- 172.21.15.50:0/913460795 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fddc40052e0 0x7fddc400ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:27.461 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:27.456+0000 7fddd9ffb700 1 -- 172.21.15.50:0/913460795 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdddc0ae4a0 con 0x7fddc4004810 2023-10-06T01:22:27.461 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:27.456+0000 7fddd9ffb700 1 -- 172.21.15.50:0/913460795 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fddc400c260 con 0x7fddc40052e0 2023-10-06T01:22:27.462 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:27.456+0000 7fddd9ffb700 1 -- 172.21.15.50:0/913460795 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fddc400c420 con 0x7fddc4003ab0 2023-10-06T01:22:27.462 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:27.456+0000 7fddda7fc700 1 --2- 172.21.15.50:0/913460795 >> v2:172.21.15.155:3300/0 conn(0x7fdddc154ea0 0x7fdddc0adae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T01:22:27.462 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:27.456+0000 7fddda7fc700 1 --2- 172.21.15.50:0/913460795 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fddc4004810 0x7fddc4004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:27.462 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:27.456+0000 7fdddaffd700 1 --2- 172.21.15.50:0/913460795 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fddc4003ab0 0x7fddc4003ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:27.462 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:27.456+0000 7fdddb7fe700 1 --2- 172.21.15.50:0/913460795 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fddc40052e0 0x7fddc400ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:27.462 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:27.457+0000 7fddda7fc700 1 -- 172.21.15.50:0/913460795 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fddc4003ab0 msgr2=0x7fddc4003ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:22:27.462 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:27.457+0000 7fddda7fc700 1 --2- 172.21.15.50:0/913460795 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fddc4003ab0 0x7fddc4003ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:27.462 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:27.457+0000 7fddda7fc700 1 -- 172.21.15.50:0/913460795 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fddc40052e0 msgr2=0x7fddc400ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:22:27.463 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:27.457+0000 7fddda7fc700 1 --2- 172.21.15.50:0/913460795 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fddc40052e0 0x7fddc400ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:27.463 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:27.457+0000 7fddda7fc700 1 -- 172.21.15.50:0/913460795 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fddc4003570 con 0x7fddc4004810 2023-10-06T01:22:27.463 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:27.457+0000 7fdddb7fe700 1 -- 172.21.15.50:0/913460795 reap_dead start 2023-10-06T01:22:27.463 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:27.457+0000 7fddda7fc700 1 --2- 172.21.15.50:0/913460795 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fddc4004810 0x7fddc4004c80 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fdddc155340 tx=0x7fddd0008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f5640b3a20adba9c server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:22:27.463 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:27.457+0000 7fddd9ffb700 1 -- 172.21.15.50:0/913460795 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddd000e5e0 con 0x7fddc4004810 2023-10-06T01:22:27.463 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:27.457+0000 7fddd9ffb700 1 -- 172.21.15.50:0/913460795 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fddd000e740 con 0x7fddc4004810 2023-10-06T01:22:27.463 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:27.457+0000 7fddd9ffb700 1 -- 172.21.15.50:0/913460795 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddd000e8f0 con 0x7fddc4004810 2023-10-06T01:22:27.463 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:27.458+0000 7fdddbfff700 1 -- 172.21.15.50:0/913460795 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fddc4004810 msgr2=0x7fddc4004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:27.463 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:27.458+0000 7fdddbfff700 1 --2- 172.21.15.50:0/913460795 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fddc4004810 0x7fddc4004c80 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fdddc155340 tx=0x7fddd0008040 comp rx=0 tx=0).stop 2023-10-06T01:22:27.463 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:27.458+0000 7fdddbfff700 1 -- 172.21.15.50:0/913460795 shutdown_connections 2023-10-06T01:22:27.464 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:27.458+0000 7fdddbfff700 1 --2- 172.21.15.50:0/913460795 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fddc4004810 0x7fddc4004c80 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:27.464 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:27.458+0000 7fdddbfff700 1 -- 172.21.15.50:0/913460795 >> 172.21.15.50:0/913460795 conn(0x7fdddc0cbf10 msgr2=0x7fdddc0cc310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:22:27.464 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:27.458+0000 7fdddbfff700 1 -- 172.21.15.50:0/913460795 shutdown_connections 2023-10-06T01:22:27.464 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:27.458+0000 7fdddbfff700 1 -- 172.21.15.50:0/913460795 wait complete. 2023-10-06T01:22:27.466 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:27.459+0000 7fdddbfff700 1 Processor -- start 2023-10-06T01:22:27.466 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:27.459+0000 7fdddbfff700 1 -- start start 2023-10-06T01:22:27.466 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:27.460+0000 7fdddbfff700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fddc4004810 0x7fdddc14f8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:27.466 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:27.460+0000 7fdddbfff700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fdddc15b200 0x7fdddc141860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:27.466 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:27.460+0000 7fdddbfff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdddc0afc80 0x7fdddc0b0100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:27.467 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:27.460+0000 7fdddbfff700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdddc0b0640 con 0x7fdddc0afc80 2023-10-06T01:22:27.467 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:27.460+0000 7fdddbfff700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdddc1666d0 con 0x7fddc4004810 2023-10-06T01:22:27.467 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:27.460+0000 7fdddbfff700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdddc1504f0 con 0x7fdddc15b200 2023-10-06T01:22:27.467 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:27.460+0000 7fdddb7fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdddc0afc80 0x7fdddc0b0100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:27.467 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:27.460+0000 7fdddb7fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdddc0afc80 0x7fdddc0b0100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:48584/0 (socket says 172.21.15.50:48584) 2023-10-06T01:22:27.467 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:27.460+0000 7fdddb7fe700 1 -- 172.21.15.50:0/3736689606 learned_addr learned my addr 172.21.15.50:0/3736689606 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-06T01:22:27.467 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:27.461+0000 7fdddaffd700 1 --2- 172.21.15.50:0/3736689606 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fddc4004810 0x7fdddc14f8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:27.467 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:27.461+0000 7fddda7fc700 1 --2- 172.21.15.50:0/3736689606 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fdddc15b200 0x7fdddc141860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:27.467 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:27.461+0000 7fdddb7fe700 1 -- 172.21.15.50:0/3736689606 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fdddc15b200 msgr2=0x7fdddc141860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:27.467 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:27.461+0000 7fdddb7fe700 1 --2- 172.21.15.50:0/3736689606 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fdddc15b200 0x7fdddc141860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:27.467 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:27.461+0000 7fdddb7fe700 1 -- 172.21.15.50:0/3736689606 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fddc4004810 msgr2=0x7fdddc14f8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:27.468 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:27.461+0000 7fdddb7fe700 1 --2- 172.21.15.50:0/3736689606 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fddc4004810 0x7fdddc14f8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:27.468 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:27.461+0000 7fdddb7fe700 1 -- 172.21.15.50:0/3736689606 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdddc1507d0 con 0x7fdddc0afc80 2023-10-06T01:22:27.468 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:27.461+0000 7fdddb7fe700 1 --2- 172.21.15.50:0/3736689606 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdddc0afc80 0x7fdddc0b0100 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fdddc15be80 tx=0x7fddd4001640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:22:27.468 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:27.461+0000 7fddc2ffd700 1 -- 172.21.15.50:0/3736689606 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddd400eec0 con 0x7fdddc0afc80 2023-10-06T01:22:27.468 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:27.461+0000 7fddc2ffd700 1 -- 172.21.15.50:0/3736689606 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fddd4006db0 con 0x7fdddc0afc80 2023-10-06T01:22:27.468 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:27.461+0000 7fddc2ffd700 1 -- 172.21.15.50:0/3736689606 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddd400c7d0 con 0x7fdddc0afc80 2023-10-06T01:22:27.468 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:27.461+0000 7fdddbfff700 1 -- 172.21.15.50:0/3736689606 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdddc150ab0 con 0x7fdddc0afc80 2023-10-06T01:22:27.468 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:27.462+0000 7fdddbfff700 1 -- 172.21.15.50:0/3736689606 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdddc14ff70 con 0x7fdddc0afc80 2023-10-06T01:22:27.468 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:27.463+0000 7fdddbfff700 1 -- 172.21.15.50:0/3736689606 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdddc166840 con 0x7fdddc0afc80 2023-10-06T01:22:27.468 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:27.463+0000 7fddc2ffd700 1 -- 172.21.15.50:0/3736689606 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fddd400cb80 con 0x7fdddc0afc80 2023-10-06T01:22:27.468 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:27.465+0000 7fddc2ffd700 1 --2- 172.21.15.50:0/3736689606 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7fddc8066f30 0x7fddc80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:27.469 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:27.465+0000 7fddc2ffd700 1 -- 172.21.15.50:0/3736689606 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6867+0+0 (secure 0 0 0) 0x7fddd4084770 con 0x7fdddc0afc80 2023-10-06T01:22:27.469 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:27.465+0000 7fdddaffd700 1 --2- 172.21.15.50:0/3736689606 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7fddc8066f30 0x7fddc80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:27.469 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:27.466+0000 7fdddaffd700 1 --2- 172.21.15.50:0/3736689606 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7fddc8066f30 0x7fddc80693e0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fdddc150f90 tx=0x7fddcc001d80 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:22:27.469 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:27.468+0000 7fddc2ffd700 1 -- 172.21.15.50:0/3736689606 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fddd40514b0 con 0x7fdddc0afc80 2023-10-06T01:22:27.670 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:27.669+0000 7fdddbfff700 1 -- 172.21.15.50:0/3736689606 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7fdddc05f270 con 0x7fdddc0afc80 2023-10-06T01:22:27.671 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:27.670+0000 7fddc2ffd700 1 -- 172.21.15.50:0/3736689606 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v27) v1 ==== 103+0+11 (secure 0 0 0) 0x7fddd4054ad0 con 0x7fdddc0afc80 2023-10-06T01:22:27.671 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 32 2023-10-06T01:22:27.673 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:27.672+0000 7fdddbfff700 1 -- 172.21.15.50:0/3736689606 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7fddc8066f30 msgr2=0x7fddc80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:27.673 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:27.672+0000 7fdddbfff700 1 --2- 172.21.15.50:0/3736689606 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7fddc8066f30 0x7fddc80693e0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fdddc150f90 tx=0x7fddcc001d80 comp rx=0 tx=0).stop 2023-10-06T01:22:27.674 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:27.672+0000 7fdddbfff700 1 -- 172.21.15.50:0/3736689606 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdddc0afc80 msgr2=0x7fdddc0b0100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:27.674 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:27.672+0000 7fdddbfff700 1 --2- 172.21.15.50:0/3736689606 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdddc0afc80 0x7fdddc0b0100 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fdddc15be80 tx=0x7fddd4001640 comp rx=0 tx=0).stop 2023-10-06T01:22:27.674 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:27.672+0000 7fdddbfff700 1 -- 172.21.15.50:0/3736689606 shutdown_connections 2023-10-06T01:22:27.674 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:27.672+0000 7fdddbfff700 1 --2- 172.21.15.50:0/3736689606 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdddc0afc80 0x7fdddc0b0100 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:27.674 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:27.672+0000 7fdddbfff700 1 --2- 172.21.15.50:0/3736689606 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7fddc8066f30 0x7fddc80693e0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:27.674 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:27.672+0000 7fdddbfff700 1 --2- 172.21.15.50:0/3736689606 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fddc4004810 0x7fdddc14f8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:27.674 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:27.672+0000 7fdddbfff700 1 --2- 172.21.15.50:0/3736689606 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fdddc15b200 0x7fdddc141860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:27.674 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:27.672+0000 7fdddbfff700 1 -- 172.21.15.50:0/3736689606 >> 172.21.15.50:0/3736689606 conn(0x7fdddc0cbf10 msgr2=0x7fdddc0cb110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:22:27.674 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:27.672+0000 7fdddbfff700 1 -- 172.21.15.50:0/3736689606 shutdown_connections 2023-10-06T01:22:27.674 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:27.672+0000 7fdddbfff700 1 -- 172.21.15.50:0/3736689606 wait complete. 2023-10-06T01:22:27.691 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T01:22:27.878 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:27.877+0000 7f300cb9d700 1 Processor -- start 2023-10-06T01:22:27.878 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:27.877+0000 7f300cb9d700 1 -- start start 2023-10-06T01:22:27.881 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:27.879+0000 7f300cb9d700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f3008159480 0x7f30080b30d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:27.881 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:27.879+0000 7f300cb9d700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f30080b3610 0x7f30080cbc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:27.881 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:27.879+0000 7f300cb9d700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f30080cc1b0 0x7f30080b2140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:27.881 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:27.879+0000 7f300cb9d700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f30080cb7e0 con 0x7f30080b3610 2023-10-06T01:22:27.882 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:27.879+0000 7f300cb9d700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f30080b08a0 con 0x7f3008159480 2023-10-06T01:22:27.882 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:27.879+0000 7f300cb9d700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f30080cb190 con 0x7f30080cc1b0 2023-10-06T01:22:27.882 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:27.879+0000 7f2ffeffd700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f30080b3610 0x7f30080cbc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:27.882 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:27.879+0000 7f2ffeffd700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f30080b3610 0x7f30080cbc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:48592/0 (socket says 172.21.15.50:48592) 2023-10-06T01:22:27.882 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:27.879+0000 7f2ffeffd700 1 -- 172.21.15.50:0/2674299771 learned_addr learned my addr 172.21.15.50:0/2674299771 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-06T01:22:27.882 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:27.879+0000 7f30077fe700 1 --2- 172.21.15.50:0/2674299771 >> v2:172.21.15.155:3300/0 conn(0x7f3008159480 0x7f30080b30d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:27.882 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:27.879+0000 7f3007fff700 1 --2- 172.21.15.50:0/2674299771 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f30080cc1b0 0x7f30080b2140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:27.882 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:27.879+0000 7f2ffeffd700 1 -- 172.21.15.50:0/2674299771 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f30080cc1b0 msgr2=0x7f30080b2140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:22:27.882 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:27.879+0000 7f2ffeffd700 1 --2- 172.21.15.50:0/2674299771 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f30080cc1b0 0x7f30080b2140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:27.882 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:27.880+0000 7f2ffeffd700 1 -- 172.21.15.50:0/2674299771 >> v2:172.21.15.155:3300/0 conn(0x7f3008159480 msgr2=0x7f30080b30d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:22:27.883 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:27.880+0000 7f2ffeffd700 1 --2- 172.21.15.50:0/2674299771 >> v2:172.21.15.155:3300/0 conn(0x7f3008159480 0x7f30080b30d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:27.883 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:27.880+0000 7f2ffeffd700 1 -- 172.21.15.50:0/2674299771 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30080cb470 con 0x7f30080b3610 2023-10-06T01:22:27.883 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:27.880+0000 7f3007fff700 1 --2- 172.21.15.50:0/2674299771 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f30080cc1b0 0x7f30080b2140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T01:22:27.883 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:27.880+0000 7f2ffeffd700 1 --2- 172.21.15.50:0/2674299771 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f30080b3610 0x7f30080cbc70 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f300806fa30 tx=0x7f2ff0009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=930867b7cd85d47 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:22:27.883 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:27.880+0000 7f3006ffd700 1 -- 172.21.15.50:0/2674299771 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ff0009e70 con 0x7f30080b3610 2023-10-06T01:22:27.883 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:27.880+0000 7f3006ffd700 1 -- 172.21.15.50:0/2674299771 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ff000b860 con 0x7f30080b3610 2023-10-06T01:22:27.883 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:27.880+0000 7f3006ffd700 1 -- 172.21.15.50:0/2674299771 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ff000bc00 con 0x7f30080b3610 2023-10-06T01:22:27.886 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:27.881+0000 7f300cb9d700 1 -- 172.21.15.50:0/2674299771 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f30080b3610 msgr2=0x7f30080cbc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:27.887 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:27.881+0000 7f300cb9d700 1 --2- 172.21.15.50:0/2674299771 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f30080b3610 0x7f30080cbc70 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f300806fa30 tx=0x7f2ff0009250 comp rx=0 tx=0).stop 2023-10-06T01:22:27.887 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:27.881+0000 7f300cb9d700 1 -- 172.21.15.50:0/2674299771 shutdown_connections 2023-10-06T01:22:27.887 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:27.881+0000 7f300cb9d700 1 --2- 172.21.15.50:0/2674299771 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f30080cc1b0 0x7f30080b2140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:27.887 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:27.881+0000 7f300cb9d700 1 --2- 172.21.15.50:0/2674299771 >> v2:172.21.15.155:3300/0 conn(0x7f3008159480 0x7f30080b30d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:27.887 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:27.881+0000 7f300cb9d700 1 --2- 172.21.15.50:0/2674299771 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f30080b3610 0x7f30080cbc70 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:27.887 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:27.881+0000 7f300cb9d700 1 -- 172.21.15.50:0/2674299771 >> 172.21.15.50:0/2674299771 conn(0x7f300806ed20 msgr2=0x7f300806f120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:22:27.887 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:27.881+0000 7f300cb9d700 1 -- 172.21.15.50:0/2674299771 shutdown_connections 2023-10-06T01:22:27.887 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:27.881+0000 7f300cb9d700 1 -- 172.21.15.50:0/2674299771 wait complete. 2023-10-06T01:22:27.887 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:27.882+0000 7f300cb9d700 1 Processor -- start 2023-10-06T01:22:27.887 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:27.883+0000 7f300cb9d700 1 -- start start 2023-10-06T01:22:27.888 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:27.883+0000 7f300cb9d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f30080b3610 0x7f300815a370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:27.888 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:27.884+0000 7f300cb9d700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f30080cc1b0 0x7f300815e280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:27.888 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:27.884+0000 7f300cb9d700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3008159480 0x7f3008155a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:27.888 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:27.884+0000 7f300cb9d700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3008169400 con 0x7f30080b3610 2023-10-06T01:22:27.888 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:27.884+0000 7f300cb9d700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f300815e7c0 con 0x7f3008159480 2023-10-06T01:22:27.888 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:27.884+0000 7f300cb9d700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f300815a9e0 con 0x7f30080cc1b0 2023-10-06T01:22:27.888 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:27.884+0000 7f30077fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f30080b3610 0x7f300815a370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:27.888 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:27.884+0000 7f30077fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f30080b3610 0x7f300815a370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:48596/0 (socket says 172.21.15.50:48596) 2023-10-06T01:22:27.888 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:27.884+0000 7f30077fe700 1 -- 172.21.15.50:0/1816218427 learned_addr learned my addr 172.21.15.50:0/1816218427 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-06T01:22:27.888 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:27.884+0000 7f2ffeffd700 1 --2- 172.21.15.50:0/1816218427 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f30080cc1b0 0x7f300815e280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:27.889 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:27.884+0000 7f3007fff700 1 --2- 172.21.15.50:0/1816218427 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3008159480 0x7f3008155a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:27.889 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:27.884+0000 7f30077fe700 1 -- 172.21.15.50:0/1816218427 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f30080cc1b0 msgr2=0x7f300815e280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:27.889 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:27.884+0000 7f30077fe700 1 --2- 172.21.15.50:0/1816218427 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f30080cc1b0 0x7f300815e280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:27.889 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:27.884+0000 7f30077fe700 1 -- 172.21.15.50:0/1816218427 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3008159480 msgr2=0x7f3008155a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:27.889 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:27.884+0000 7f30077fe700 1 --2- 172.21.15.50:0/1816218427 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3008159480 0x7f3008155a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:27.889 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:27.884+0000 7f30077fe700 1 -- 172.21.15.50:0/1816218427 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ff00094f0 con 0x7f30080b3610 2023-10-06T01:22:27.889 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:27.884+0000 7f30077fe700 1 --2- 172.21.15.50:0/1816218427 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f30080b3610 0x7f300815a370 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f2ff800e930 tx=0x7f2ff80091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:22:27.889 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:27.885+0000 7f2ffffff700 1 -- 172.21.15.50:0/1816218427 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ff8013680 con 0x7f30080b3610 2023-10-06T01:22:27.889 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:27.885+0000 7f2ffffff700 1 -- 172.21.15.50:0/1816218427 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ff80137e0 con 0x7f30080b3610 2023-10-06T01:22:27.889 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:27.885+0000 7f2ffffff700 1 -- 172.21.15.50:0/1816218427 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ff8013b80 con 0x7f30080b3610 2023-10-06T01:22:27.889 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:27.885+0000 7f300cb9d700 1 -- 172.21.15.50:0/1816218427 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f300815acc0 con 0x7f30080b3610 2023-10-06T01:22:27.890 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:27.885+0000 7f300cb9d700 1 -- 172.21.15.50:0/1816218427 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3008169930 con 0x7f30080b3610 2023-10-06T01:22:27.890 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:27.886+0000 7f300cb9d700 1 -- 172.21.15.50:0/1816218427 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f300815aeb0 con 0x7f30080b3610 2023-10-06T01:22:27.890 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:27.887+0000 7f2ffffff700 1 -- 172.21.15.50:0/1816218427 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f2ff800c460 con 0x7f30080b3610 2023-10-06T01:22:27.890 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:27.887+0000 7f2ffffff700 1 --2- 172.21.15.50:0/1816218427 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f2fe8066f30 0x7f2fe80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:27.891 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:27.888+0000 7f2ffffff700 1 -- 172.21.15.50:0/1816218427 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6867+0+0 (secure 0 0 0) 0x7f2ff8084bd0 con 0x7f30080b3610 2023-10-06T01:22:27.891 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:27.888+0000 7f2ffeffd700 1 --2- 172.21.15.50:0/1816218427 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f2fe8066f30 0x7f2fe80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:27.891 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:27.889+0000 7f2ffeffd700 1 --2- 172.21.15.50:0/1816218427 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f2fe8066f30 0x7f2fe80693e0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f300806fa30 tx=0x7f2ff0017000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:22:27.892 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:27.892+0000 7f2ffffff700 1 -- 172.21.15.50:0/1816218427 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f2ff8051910 con 0x7f30080b3610 2023-10-06T01:22:28.097 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:28.096+0000 7f300cb9d700 1 -- 172.21.15.50:0/1816218427 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f300805f270 con 0x7f30080b3610 2023-10-06T01:22:28.098 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:28.097+0000 7f2ffffff700 1 -- 172.21.15.50:0/1816218427 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+18803 (secure 0 0 0) 0x7f2ff8054f30 con 0x7f30080b3610 2023-10-06T01:22:28.098 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-10-06T01:22:28.098 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":27,"fsid":"0bfd9a6b-1587-4fe4-a89e-e43c00286b4e","created":"2023-10-06T01:21:16.828801+0000","modified":"2023-10-06T01:22:24.863940+0000","last_up_change":"2023-10-06T01:21:28.584523+0000","last_in_change":"2023-10-06T01:21:20.179863+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-10-06T01:21:29.304225+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":".mgr","create_time":"2023-10-06T01:21:29.835490+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-06T01:21:34.675315+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-06T01:21:35.753991+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-10-06T01:21:38.853108+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"9060727a-3959-4de3-8363-c5c5d7826c9a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":87837},{"type":"v1","addr":"172.21.15.50:6801","nonce":87837}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":87837},{"type":"v1","addr":"172.21.15.50:6803","nonce":87837}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":87837},{"type":"v1","addr":"172.21.15.50:6807","nonce":87837}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":87837},{"type":"v1","addr":"172.21.15.50:6805","nonce":87837}]},"public_addr":"172.21.15.50:6801/87837","cluster_addr":"172.21.15.50:6803/87837","heartbeat_back_addr":"172.21.15.50:6807/87837","heartbeat_front_addr":"172.21.15.50:6805/87837","state":["exists","up"]},{"osd":1,"uuid":"5ad9ef12-b579-47ea-b690-90ba887e2cef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":87853},{"type":"v1","addr":"172.21.15.50:6809","nonce":87853}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":87853},{"type":"v1","addr":"172.21.15.50:6811","nonce":87853}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":87853},{"type":"v1","addr":"172.21.15.50:6815","nonce":87853}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":87853},{"type":"v1","addr":"172.21.15.50:6813","nonce":87853}]},"public_addr":"172.21.15.50:6809/87853","cluster_addr":"172.21.15.50:6811/87853","heartbeat_back_addr":"172.21.15.50:6815/87853","heartbeat_front_addr":"172.21.15.50:6813/87853","state":["exists","up"]},{"osd":2,"uuid":"c7aee044-6f75-436f-90e1-ba42a57359bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6821","nonce":87855},{"type":"v1","addr":"172.21.15.50:6822","nonce":87855}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6824","nonce":87855},{"type":"v1","addr":"172.21.15.50:6826","nonce":87855}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":87855},{"type":"v1","addr":"172.21.15.50:6831","nonce":87855}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":87855},{"type":"v1","addr":"172.21.15.50:6829","nonce":87855}]},"public_addr":"172.21.15.50:6822/87855","cluster_addr":"172.21.15.50:6826/87855","heartbeat_back_addr":"172.21.15.50:6831/87855","heartbeat_front_addr":"172.21.15.50:6829/87855","state":["exists","up"]},{"osd":3,"uuid":"d9b901c8-e8b2-44af-9508-f453120a96c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":87856},{"type":"v1","addr":"172.21.15.50:6817","nonce":87856}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":87856},{"type":"v1","addr":"172.21.15.50:6819","nonce":87856}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6825","nonce":87856},{"type":"v1","addr":"172.21.15.50:6827","nonce":87856}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6820","nonce":87856},{"type":"v1","addr":"172.21.15.50:6823","nonce":87856}]},"public_addr":"172.21.15.50:6817/87856","cluster_addr":"172.21.15.50:6819/87856","heartbeat_back_addr":"172.21.15.50:6827/87856","heartbeat_front_addr":"172.21.15.50:6823/87856","state":["exists","up"]},{"osd":4,"uuid":"2b3c6b38-e3e9-4301-9445-60fd3fe8ce03","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":85805},{"type":"v1","addr":"172.21.15.155:6801","nonce":85805}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":85805},{"type":"v1","addr":"172.21.15.155:6803","nonce":85805}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6806","nonce":85805},{"type":"v1","addr":"172.21.15.155:6807","nonce":85805}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6804","nonce":85805},{"type":"v1","addr":"172.21.15.155:6805","nonce":85805}]},"public_addr":"172.21.15.155:6801/85805","cluster_addr":"172.21.15.155:6803/85805","heartbeat_back_addr":"172.21.15.155:6807/85805","heartbeat_front_addr":"172.21.15.155:6805/85805","state":["exists","up"]},{"osd":5,"uuid":"417b5f8f-65f1-4c94-91a7-a6ce03fe1679","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6816","nonce":85807},{"type":"v1","addr":"172.21.15.155:6818","nonce":85807}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6820","nonce":85807},{"type":"v1","addr":"172.21.15.155:6822","nonce":85807}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6828","nonce":85807},{"type":"v1","addr":"172.21.15.155:6830","nonce":85807}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6824","nonce":85807},{"type":"v1","addr":"172.21.15.155:6826","nonce":85807}]},"public_addr":"172.21.15.155:6818/85807","cluster_addr":"172.21.15.155:6822/85807","heartbeat_back_addr":"172.21.15.155:6830/85807","heartbeat_front_addr":"172.21.15.155:6826/85807","state":["exists","up"]},{"osd":6,"uuid":"c150cff3-aee4-4714-9c08-d182b1ba9ffd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6808","nonce":85806},{"type":"v1","addr":"172.21.15.155:6809","nonce":85806}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6810","nonce":85806},{"type":"v1","addr":"172.21.15.155:6811","nonce":85806}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6814","nonce":85806},{"type":"v1","addr":"172.21.15.155:6815","nonce":85806}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6812","nonce":85806},{"type":"v1","addr":"172.21.15.155:6813","nonce":85806}]},"public_addr":"172.21.15.155:6809/85806","cluster_addr":"172.21.15.155:6811/85806","heartbeat_back_addr":"172.21.15.155:6815/85806","heartbeat_front_addr":"172.21.15.155:6813/85806","state":["exists","up"]},{"osd":7,"uuid":"71107f0e-04d1-4e72-a0ec-0faf6af003e7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6817","nonce":85832},{"type":"v1","addr":"172.21.15.155:6819","nonce":85832}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6821","nonce":85832},{"type":"v1","addr":"172.21.15.155:6823","nonce":85832}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6829","nonce":85832},{"type":"v1","addr":"172.21.15.155:6831","nonce":85832}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6825","nonce":85832},{"type":"v1","addr":"172.21.15.155:6827","nonce":85832}]},"public_addr":"172.21.15.155:6819/85832","cluster_addr":"172.21.15.155:6823/85832","heartbeat_back_addr":"172.21.15.155:6831/85832","heartbeat_front_addr":"172.21.15.155:6827/85832","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:21:25.423389+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:21:25.472661+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:21:25.817562+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:21:25.551257+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:21:25.407818+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:21:25.557976+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:21:25.747299+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:21:25.827576+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.19","mappings":[{"from":3,"to":5}]},{"pgid":"4.31","mappings":[{"from":1,"to":2}]}],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T01:22:28.100 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:28.099+0000 7f300cb9d700 1 -- 172.21.15.50:0/1816218427 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f2fe8066f30 msgr2=0x7f2fe80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:28.100 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:28.099+0000 7f300cb9d700 1 --2- 172.21.15.50:0/1816218427 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f2fe8066f30 0x7f2fe80693e0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f300806fa30 tx=0x7f2ff0017000 comp rx=0 tx=0).stop 2023-10-06T01:22:28.100 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:28.099+0000 7f300cb9d700 1 -- 172.21.15.50:0/1816218427 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f30080b3610 msgr2=0x7f300815a370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:28.101 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:28.099+0000 7f300cb9d700 1 --2- 172.21.15.50:0/1816218427 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f30080b3610 0x7f300815a370 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f2ff800e930 tx=0x7f2ff80091a0 comp rx=0 tx=0).stop 2023-10-06T01:22:28.101 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:28.099+0000 7f300cb9d700 1 -- 172.21.15.50:0/1816218427 shutdown_connections 2023-10-06T01:22:28.101 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:28.099+0000 7f300cb9d700 1 --2- 172.21.15.50:0/1816218427 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f2fe8066f30 0x7f2fe80693e0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:28.101 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:28.099+0000 7f300cb9d700 1 --2- 172.21.15.50:0/1816218427 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3008159480 0x7f3008155a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:28.101 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:28.099+0000 7f300cb9d700 1 --2- 172.21.15.50:0/1816218427 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f30080b3610 0x7f300815a370 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:28.101 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:28.099+0000 7f300cb9d700 1 --2- 172.21.15.50:0/1816218427 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f30080cc1b0 0x7f300815e280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:28.101 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:28.099+0000 7f300cb9d700 1 -- 172.21.15.50:0/1816218427 >> 172.21.15.50:0/1816218427 conn(0x7f300806ed20 msgr2=0x7f30080b4b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:22:28.101 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:28.099+0000 7f300cb9d700 1 -- 172.21.15.50:0/1816218427 shutdown_connections 2023-10-06T01:22:28.101 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:28.099+0000 7f300cb9d700 1 -- 172.21.15.50:0/1816218427 wait complete. 2023-10-06T01:22:28.118 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-10-06T01:21:29.304225+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-10-06T01:21:29.835490+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-06T01:21:34.675315+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-10-06T01:21:35.753991+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-10-06T01:21:38.853108+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-06T01:22:28.119 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-10-06T01:22:28.309 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:28.308+0000 7fd54f59d700 1 Processor -- start 2023-10-06T01:22:28.309 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:28.308+0000 7fd54f59d700 1 -- start start 2023-10-06T01:22:28.311 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:28.309+0000 7fd54f59d700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fd5480b2660 0x7fd5480cccf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:28.311 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:28.309+0000 7fd54f59d700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd5480b2a30 0x7fd5480cd230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:28.311 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:28.309+0000 7fd54f59d700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fd5480ceae0 0x7fd5480cef80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:28.311 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:28.309+0000 7fd54f59d700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd5480cc9b0 con 0x7fd5480ceae0 2023-10-06T01:22:28.311 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:28.309+0000 7fd54f59d700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd5480cf4c0 con 0x7fd5480b2660 2023-10-06T01:22:28.311 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:28.309+0000 7fd54f59d700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5480cbda0 con 0x7fd5480b2a30 2023-10-06T01:22:28.312 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:28.310+0000 7fd54ed9c700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fd5480ceae0 0x7fd5480cef80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:28.312 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:28.310+0000 7fd54ed9c700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fd5480ceae0 0x7fd5480cef80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:48602/0 (socket says 172.21.15.50:48602) 2023-10-06T01:22:28.312 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:28.310+0000 7fd54ed9c700 1 -- 172.21.15.50:0/221680758 learned_addr learned my addr 172.21.15.50:0/221680758 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-06T01:22:28.312 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:28.310+0000 7fd54dd9a700 1 --2- 172.21.15.50:0/221680758 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd5480b2a30 0x7fd5480cd230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:28.312 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:28.310+0000 7fd54e59b700 1 --2- 172.21.15.50:0/221680758 >> v2:172.21.15.155:3300/0 conn(0x7fd5480b2660 0x7fd5480cccf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:28.312 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:28.310+0000 7fd54ed9c700 1 -- 172.21.15.50:0/221680758 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd5480b2a30 msgr2=0x7fd5480cd230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:22:28.312 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:28.310+0000 7fd54ed9c700 1 --2- 172.21.15.50:0/221680758 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd5480b2a30 0x7fd5480cd230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:28.312 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:28.310+0000 7fd54ed9c700 1 -- 172.21.15.50:0/221680758 >> v2:172.21.15.155:3300/0 conn(0x7fd5480b2660 msgr2=0x7fd5480cccf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:22:28.312 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:28.310+0000 7fd54ed9c700 1 --2- 172.21.15.50:0/221680758 >> v2:172.21.15.155:3300/0 conn(0x7fd5480b2660 0x7fd5480cccf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:28.312 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:28.310+0000 7fd54ed9c700 1 -- 172.21.15.50:0/221680758 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5480cc080 con 0x7fd5480ceae0 2023-10-06T01:22:28.312 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:28.310+0000 7fd54ed9c700 1 --2- 172.21.15.50:0/221680758 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd5480ceae0 0x7fd5480cef80 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fd548089500 tx=0x7fd540009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5cd240a9ebdf14f3 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:22:28.314 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:28.311+0000 7fd54d599700 1 -- 172.21.15.50:0/221680758 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd54000e070 con 0x7fd5480ceae0 2023-10-06T01:22:28.314 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:28.311+0000 7fd54d599700 1 -- 172.21.15.50:0/221680758 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd54000ba50 con 0x7fd5480ceae0 2023-10-06T01:22:28.314 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:28.311+0000 7fd54d599700 1 -- 172.21.15.50:0/221680758 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5400092e0 con 0x7fd5480ceae0 2023-10-06T01:22:28.314 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:28.311+0000 7fd54f59d700 1 -- 172.21.15.50:0/221680758 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd5480ceae0 msgr2=0x7fd5480cef80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:28.314 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:28.311+0000 7fd54f59d700 1 --2- 172.21.15.50:0/221680758 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd5480ceae0 0x7fd5480cef80 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fd548089500 tx=0x7fd540009840 comp rx=0 tx=0).stop 2023-10-06T01:22:28.314 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:28.311+0000 7fd54f59d700 1 -- 172.21.15.50:0/221680758 shutdown_connections 2023-10-06T01:22:28.314 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:28.311+0000 7fd54f59d700 1 --2- 172.21.15.50:0/221680758 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd5480ceae0 0x7fd5480cef80 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:28.314 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:28.311+0000 7fd54f59d700 1 --2- 172.21.15.50:0/221680758 >> v2:172.21.15.155:3300/0 conn(0x7fd5480b2660 0x7fd5480cccf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:28.315 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:28.311+0000 7fd54f59d700 1 --2- 172.21.15.50:0/221680758 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd5480b2a30 0x7fd5480cd230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:28.315 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:28.311+0000 7fd54f59d700 1 -- 172.21.15.50:0/221680758 >> 172.21.15.50:0/221680758 conn(0x7fd548099560 msgr2=0x7fd54806f500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:22:28.315 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:28.311+0000 7fd54f59d700 1 -- 172.21.15.50:0/221680758 shutdown_connections 2023-10-06T01:22:28.315 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:28.311+0000 7fd54f59d700 1 -- 172.21.15.50:0/221680758 wait complete. 2023-10-06T01:22:28.315 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:28.313+0000 7fd54f59d700 1 Processor -- start 2023-10-06T01:22:28.315 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:28.313+0000 7fd54f59d700 1 -- start start 2023-10-06T01:22:28.317 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:28.314+0000 7fd54f59d700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd5480b2660 0x7fd5480c8fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:28.317 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:28.314+0000 7fd54f59d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd5480b2a30 0x7fd5480c7ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:28.317 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:28.314+0000 7fd54f59d700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd5480ceae0 0x7fd548154220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:28.317 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:28.314+0000 7fd54f59d700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5480b4c90 con 0x7fd5480b2a30 2023-10-06T01:22:28.317 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:28.314+0000 7fd54f59d700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5480c8410 con 0x7fd5480ceae0 2023-10-06T01:22:28.318 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:28.314+0000 7fd54f59d700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5480b4ea0 con 0x7fd5480b2660 2023-10-06T01:22:28.318 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:28.314+0000 7fd54dd9a700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd5480b2a30 0x7fd5480c7ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:28.318 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:28.314+0000 7fd54dd9a700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd5480b2a30 0x7fd5480c7ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:48606/0 (socket says 172.21.15.50:48606) 2023-10-06T01:22:28.318 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:28.314+0000 7fd54dd9a700 1 -- 172.21.15.50:0/2183939270 learned_addr learned my addr 172.21.15.50:0/2183939270 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-06T01:22:28.318 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:28.314+0000 7fd54dd9a700 1 -- 172.21.15.50:0/2183939270 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd5480b2660 msgr2=0x7fd5480c8fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:28.318 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:28.314+0000 7fd54dd9a700 1 --2- 172.21.15.50:0/2183939270 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd5480b2660 0x7fd5480c8fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:28.318 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:28.314+0000 7fd54dd9a700 1 -- 172.21.15.50:0/2183939270 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd5480ceae0 msgr2=0x7fd548154220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:28.318 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:28.314+0000 7fd54dd9a700 1 --2- 172.21.15.50:0/2183939270 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd5480ceae0 0x7fd548154220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:28.318 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:28.314+0000 7fd54dd9a700 1 -- 172.21.15.50:0/2183939270 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd540009ae0 con 0x7fd5480b2a30 2023-10-06T01:22:28.318 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:28.315+0000 7fd54dd9a700 1 --2- 172.21.15.50:0/2183939270 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd5480b2a30 0x7fd5480c7ed0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fd53800d890 tx=0x7fd538008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:22:28.318 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:28.315+0000 7fd53e7fc700 1 -- 172.21.15.50:0/2183939270 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd53800b600 con 0x7fd5480b2a30 2023-10-06T01:22:28.319 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:28.315+0000 7fd53e7fc700 1 -- 172.21.15.50:0/2183939270 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd53800b760 con 0x7fd5480b2a30 2023-10-06T01:22:28.319 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:28.315+0000 7fd53e7fc700 1 -- 172.21.15.50:0/2183939270 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd53800bae0 con 0x7fd5480b2a30 2023-10-06T01:22:28.319 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:28.315+0000 7fd54f59d700 1 -- 172.21.15.50:0/2183939270 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd5480b5180 con 0x7fd5480b2a30 2023-10-06T01:22:28.319 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:28.315+0000 7fd54f59d700 1 -- 172.21.15.50:0/2183939270 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd5480b5740 con 0x7fd5480b2a30 2023-10-06T01:22:28.319 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:28.316+0000 7fd54f59d700 1 -- 172.21.15.50:0/2183939270 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd5480b5900 con 0x7fd5480b2a30 2023-10-06T01:22:28.319 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:28.317+0000 7fd53e7fc700 1 -- 172.21.15.50:0/2183939270 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fd53801e460 con 0x7fd5480b2a30 2023-10-06T01:22:28.320 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:28.318+0000 7fd53e7fc700 1 --2- 172.21.15.50:0/2183939270 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7fd52c066f30 0x7fd52c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:28.320 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:28.318+0000 7fd53e7fc700 1 -- 172.21.15.50:0/2183939270 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6867+0+0 (secure 0 0 0) 0x7fd538085110 con 0x7fd5480b2a30 2023-10-06T01:22:28.320 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:28.319+0000 7fd54e59b700 1 --2- 172.21.15.50:0/2183939270 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7fd52c066f30 0x7fd52c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:28.320 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:28.319+0000 7fd54e59b700 1 --2- 172.21.15.50:0/2183939270 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7fd52c066f30 0x7fd52c0693e0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fd544006fd0 tx=0x7fd544008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:22:28.323 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:28.322+0000 7fd53e7fc700 1 -- 172.21.15.50:0/2183939270 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd538051e50 con 0x7fd5480b2a30 2023-10-06T01:22:28.522 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:28.521+0000 7fd54f59d700 1 -- 172.21.15.50:0/2183939270 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fd54805f270 con 0x7fd5480b2a30 2023-10-06T01:22:28.523 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:28.522+0000 7fd53e7fc700 1 -- 172.21.15.50:0/2183939270 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v27) v1 ==== 92+0+10 (secure 0 0 0) 0x7fd538055470 con 0x7fd5480b2a30 2023-10-06T01:22:28.523 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 8 2023-10-06T01:22:28.525 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:28.524+0000 7fd54f59d700 1 -- 172.21.15.50:0/2183939270 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7fd52c066f30 msgr2=0x7fd52c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:28.525 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:28.524+0000 7fd54f59d700 1 --2- 172.21.15.50:0/2183939270 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7fd52c066f30 0x7fd52c0693e0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fd544006fd0 tx=0x7fd544008040 comp rx=0 tx=0).stop 2023-10-06T01:22:28.526 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:28.524+0000 7fd54f59d700 1 -- 172.21.15.50:0/2183939270 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd5480b2a30 msgr2=0x7fd5480c7ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:28.526 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:28.524+0000 7fd54f59d700 1 --2- 172.21.15.50:0/2183939270 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd5480b2a30 0x7fd5480c7ed0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fd53800d890 tx=0x7fd538008040 comp rx=0 tx=0).stop 2023-10-06T01:22:28.526 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:28.524+0000 7fd54f59d700 1 -- 172.21.15.50:0/2183939270 shutdown_connections 2023-10-06T01:22:28.526 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:28.524+0000 7fd54f59d700 1 --2- 172.21.15.50:0/2183939270 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7fd52c066f30 0x7fd52c0693e0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:28.526 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:28.524+0000 7fd54f59d700 1 --2- 172.21.15.50:0/2183939270 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd5480ceae0 0x7fd548154220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:28.526 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:28.524+0000 7fd54f59d700 1 --2- 172.21.15.50:0/2183939270 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd5480b2660 0x7fd5480c8fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:28.526 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:28.524+0000 7fd54f59d700 1 --2- 172.21.15.50:0/2183939270 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd5480b2a30 0x7fd5480c7ed0 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:28.526 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:28.524+0000 7fd54f59d700 1 -- 172.21.15.50:0/2183939270 >> 172.21.15.50:0/2183939270 conn(0x7fd548099560 msgr2=0x7fd548068350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:22:28.526 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:28.524+0000 7fd54f59d700 1 -- 172.21.15.50:0/2183939270 shutdown_connections 2023-10-06T01:22:28.526 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:28.524+0000 7fd54f59d700 1 -- 172.21.15.50:0/2183939270 wait complete. 2023-10-06T01:22:28.543 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-06T01:22:28.732 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:28.731+0000 7fdcabfff700 1 Processor -- start 2023-10-06T01:22:28.732 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:28.731+0000 7fdcabfff700 1 -- start start 2023-10-06T01:22:28.735 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:28.733+0000 7fdcabfff700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fdcac0cb7b0 0x7fdcac156fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:28.735 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:28.733+0000 7fdcabfff700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fdcac06ea30 0x7fdcac06eeb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:28.735 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:28.733+0000 7fdcabfff700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdcac0ad830 con 0x7fdcac155df0 2023-10-06T01:22:28.735 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:28.733+0000 7fdcabfff700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdcac150360 con 0x7fdcac0cb7b0 2023-10-06T01:22:28.735 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:28.733+0000 7fdcabfff700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdcac06f3f0 con 0x7fdcac06ea30 2023-10-06T01:22:28.735 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:28.733+0000 7fdcaaffd700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fdcac0cb7b0 0x7fdcac156fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:28.736 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:28.733+0000 7fdcab7fe700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fdcac155df0 0x7fdcac156230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:54438/0 (socket says 172.21.15.50:54438) 2023-10-06T01:22:28.736 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:28.733+0000 7fdcab7fe700 1 -- 172.21.15.50:0/430695597 learned_addr learned my addr 172.21.15.50:0/430695597 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-10-06T01:22:28.736 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:28.733+0000 7fdcaaffd700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fdcac0cb7b0 0x7fdcac156fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:48610/0 (socket says 172.21.15.50:48610) 2023-10-06T01:22:28.736 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:28.733+0000 7fdcaa7fc700 1 --2- 172.21.15.50:0/430695597 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fdcac06ea30 0x7fdcac06eeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:28.736 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:28.733+0000 7fdcaaffd700 1 -- 172.21.15.50:0/430695597 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fdcac06ea30 msgr2=0x7fdcac06eeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:22:28.736 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:28.733+0000 7fdcaaffd700 1 --2- 172.21.15.50:0/430695597 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fdcac06ea30 0x7fdcac06eeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:28.736 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:28.733+0000 7fdcaaffd700 1 -- 172.21.15.50:0/430695597 >> v1:172.21.15.50:6789/0 conn(0x7fdcac155df0 legacy=0x7fdcac156230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:28.736 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:28.733+0000 7fdcaaffd700 1 -- 172.21.15.50:0/430695597 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdcac156940 con 0x7fdcac0cb7b0 2023-10-06T01:22:28.736 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:28.734+0000 7fdcaaffd700 1 --2- 172.21.15.50:0/430695597 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdcac0cb7b0 0x7fdcac156fc0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fdc9c009910 tx=0x7fdc9c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c7b7d660cddab6be server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:22:28.736 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:28.734+0000 7fdca9ffb700 1 -- 172.21.15.50:0/430695597 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc9c00b820 con 0x7fdcac0cb7b0 2023-10-06T01:22:28.736 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:28.734+0000 7fdca9ffb700 1 -- 172.21.15.50:0/430695597 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc9c00b980 con 0x7fdcac0cb7b0 2023-10-06T01:22:28.736 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:28.734+0000 7fdca9ffb700 1 -- 172.21.15.50:0/430695597 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc9c00bd20 con 0x7fdcac0cb7b0 2023-10-06T01:22:28.737 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:28.734+0000 7fdcabfff700 1 -- 172.21.15.50:0/430695597 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdcac0cb7b0 msgr2=0x7fdcac156fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:28.737 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:28.734+0000 7fdcabfff700 1 --2- 172.21.15.50:0/430695597 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdcac0cb7b0 0x7fdcac156fc0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fdc9c009910 tx=0x7fdc9c0091a0 comp rx=0 tx=0).stop 2023-10-06T01:22:28.739 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:28.735+0000 7fdcabfff700 1 -- 172.21.15.50:0/430695597 shutdown_connections 2023-10-06T01:22:28.739 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:28.735+0000 7fdcabfff700 1 --2- 172.21.15.50:0/430695597 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdcac0cb7b0 0x7fdcac156fc0 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:28.739 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:28.735+0000 7fdcabfff700 1 --2- 172.21.15.50:0/430695597 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fdcac06ea30 0x7fdcac06eeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:28.739 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:28.735+0000 7fdcabfff700 1 -- 172.21.15.50:0/430695597 >> 172.21.15.50:0/430695597 conn(0x7fdcac0cbf10 msgr2=0x7fdcac0cc310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:22:28.740 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:28.735+0000 7fdcabfff700 1 -- 172.21.15.50:0/430695597 shutdown_connections 2023-10-06T01:22:28.740 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:28.735+0000 7fdcabfff700 1 -- 172.21.15.50:0/430695597 wait complete. 2023-10-06T01:22:28.740 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:28.736+0000 7fdcabfff700 1 Processor -- start 2023-10-06T01:22:28.740 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:28.736+0000 7fdcabfff700 1 -- start start 2023-10-06T01:22:28.740 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:28.737+0000 7fdcabfff700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fdcac06ea30 0x7fdcac145830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:28.740 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:28.737+0000 7fdcabfff700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdcac0cb7b0 0x7fdcac143e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:28.740 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:28.737+0000 7fdcabfff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdcac155df0 0x7fdcac1499e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:28.740 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:28.737+0000 7fdcabfff700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdcac1453a0 con 0x7fdcac155df0 2023-10-06T01:22:28.740 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:28.737+0000 7fdcabfff700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdcac144790 con 0x7fdcac0cb7b0 2023-10-06T01:22:28.740 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:28.737+0000 7fdcabfff700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdcac144a70 con 0x7fdcac06ea30 2023-10-06T01:22:28.740 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:28.737+0000 7fdcab7fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdcac155df0 0x7fdcac1499e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:28.741 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:28.737+0000 7fdcab7fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdcac155df0 0x7fdcac1499e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:48626/0 (socket says 172.21.15.50:48626) 2023-10-06T01:22:28.741 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:28.737+0000 7fdcab7fe700 1 -- 172.21.15.50:0/2980205648 learned_addr learned my addr 172.21.15.50:0/2980205648 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-06T01:22:28.741 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:28.737+0000 7fdcaaffd700 1 --2- 172.21.15.50:0/2980205648 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fdcac06ea30 0x7fdcac145830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:28.741 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:28.738+0000 7fdcaa7fc700 1 --2- 172.21.15.50:0/2980205648 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdcac0cb7b0 0x7fdcac143e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:28.741 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:28.738+0000 7fdcab7fe700 1 -- 172.21.15.50:0/2980205648 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fdcac06ea30 msgr2=0x7fdcac145830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:28.741 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:28.738+0000 7fdcab7fe700 1 --2- 172.21.15.50:0/2980205648 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fdcac06ea30 0x7fdcac145830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:28.741 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:28.738+0000 7fdcab7fe700 1 -- 172.21.15.50:0/2980205648 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdcac0cb7b0 msgr2=0x7fdcac143e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:28.741 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:28.738+0000 7fdcab7fe700 1 --2- 172.21.15.50:0/2980205648 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdcac0cb7b0 0x7fdcac143e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:28.741 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:28.738+0000 7fdcab7fe700 1 -- 172.21.15.50:0/2980205648 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc9c009420 con 0x7fdcac155df0 2023-10-06T01:22:28.741 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:28.738+0000 7fdcaa7fc700 1 --2- 172.21.15.50:0/2980205648 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdcac0cb7b0 0x7fdcac143e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T01:22:28.741 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:28.738+0000 7fdcab7fe700 1 --2- 172.21.15.50:0/2980205648 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdcac155df0 0x7fdcac1499e0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fdca400cbc0 tx=0x7fdca40019c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:22:28.741 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:28.738+0000 7fdc92ffd700 1 -- 172.21.15.50:0/2980205648 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdca400a890 con 0x7fdcac155df0 2023-10-06T01:22:28.742 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:28.738+0000 7fdc92ffd700 1 -- 172.21.15.50:0/2980205648 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdca400a9f0 con 0x7fdcac155df0 2023-10-06T01:22:28.742 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:28.738+0000 7fdcabfff700 1 -- 172.21.15.50:0/2980205648 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdcac144d50 con 0x7fdcac155df0 2023-10-06T01:22:28.742 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:28.738+0000 7fdc92ffd700 1 -- 172.21.15.50:0/2980205648 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdca400ad70 con 0x7fdcac155df0 2023-10-06T01:22:28.742 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:28.738+0000 7fdcabfff700 1 -- 172.21.15.50:0/2980205648 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdcac1443a0 con 0x7fdcac155df0 2023-10-06T01:22:28.743 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:28.739+0000 7fdcabfff700 1 -- 172.21.15.50:0/2980205648 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdcac05f270 con 0x7fdcac155df0 2023-10-06T01:22:28.743 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:28.740+0000 7fdc92ffd700 1 -- 172.21.15.50:0/2980205648 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fdca4007300 con 0x7fdcac155df0 2023-10-06T01:22:28.743 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:28.741+0000 7fdc92ffd700 1 --2- 172.21.15.50:0/2980205648 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7fdc98066f60 0x7fdc98069410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:28.743 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:28.741+0000 7fdc92ffd700 1 -- 172.21.15.50:0/2980205648 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6867+0+0 (secure 0 0 0) 0x7fdca4084d50 con 0x7fdcac155df0 2023-10-06T01:22:28.743 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:28.742+0000 7fdcaaffd700 1 --2- 172.21.15.50:0/2980205648 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7fdc98066f60 0x7fdc98069410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:28.743 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:28.742+0000 7fdcaaffd700 1 --2- 172.21.15.50:0/2980205648 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7fdc98066f60 0x7fdc98069410 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fdc9c0091e0 tx=0x7fdc9c017000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:22:28.745 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:28.745+0000 7fdc92ffd700 1 -- 172.21.15.50:0/2980205648 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fdca4051b10 con 0x7fdcac155df0 2023-10-06T01:22:28.957 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:28.956+0000 7fdcabfff700 1 -- 172.21.15.50:0/2980205648 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fdcac162490 con 0x7fdcac155df0 2023-10-06T01:22:28.957 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:28.956+0000 7fdc92ffd700 1 -- 172.21.15.50:0/2980205648 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v27) v1 ==== 93+0+10 (secure 0 0 0) 0x7fdca4055130 con 0x7fdcac155df0 2023-10-06T01:22:28.957 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 1 2023-10-06T01:22:28.960 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:28.959+0000 7fdcabfff700 1 -- 172.21.15.50:0/2980205648 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7fdc98066f60 msgr2=0x7fdc98069410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:28.960 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:28.959+0000 7fdcabfff700 1 --2- 172.21.15.50:0/2980205648 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7fdc98066f60 0x7fdc98069410 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fdc9c0091e0 tx=0x7fdc9c017000 comp rx=0 tx=0).stop 2023-10-06T01:22:28.960 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:28.959+0000 7fdcabfff700 1 -- 172.21.15.50:0/2980205648 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdcac155df0 msgr2=0x7fdcac1499e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:28.960 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:28.959+0000 7fdcabfff700 1 --2- 172.21.15.50:0/2980205648 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdcac155df0 0x7fdcac1499e0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fdca400cbc0 tx=0x7fdca40019c0 comp rx=0 tx=0).stop 2023-10-06T01:22:28.960 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:28.959+0000 7fdcabfff700 1 -- 172.21.15.50:0/2980205648 shutdown_connections 2023-10-06T01:22:28.960 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:28.959+0000 7fdcabfff700 1 --2- 172.21.15.50:0/2980205648 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdcac155df0 0x7fdcac1499e0 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:28.960 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:28.959+0000 7fdcabfff700 1 --2- 172.21.15.50:0/2980205648 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fdcac06ea30 0x7fdcac145830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:28.961 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:28.959+0000 7fdcabfff700 1 --2- 172.21.15.50:0/2980205648 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7fdc98066f60 0x7fdc98069410 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:28.961 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:28.959+0000 7fdcabfff700 1 --2- 172.21.15.50:0/2980205648 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdcac0cb7b0 0x7fdcac143e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:28.961 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:28.959+0000 7fdcabfff700 1 -- 172.21.15.50:0/2980205648 >> 172.21.15.50:0/2980205648 conn(0x7fdcac0cbf10 msgr2=0x7fdcac06d190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:22:28.961 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:28.959+0000 7fdcabfff700 1 -- 172.21.15.50:0/2980205648 shutdown_connections 2023-10-06T01:22:28.961 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:28.959+0000 7fdcabfff700 1 -- 172.21.15.50:0/2980205648 wait complete. 2023-10-06T01:22:28.977 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-06T01:22:29.168 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:29.167+0000 7fec4cd9d700 1 Processor -- start 2023-10-06T01:22:29.168 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:29.167+0000 7fec4cd9d700 1 -- start start 2023-10-06T01:22:29.169 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:29.168+0000 7fec4cd9d700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fec4813c470 0x7fec480ca990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:29.169 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:29.168+0000 7fec4cd9d700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fec4815a250 0x7fec480c8730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:29.169 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:29.168+0000 7fec4cd9d700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fec4806d470 con 0x7fec480caed0 2023-10-06T01:22:29.169 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:29.168+0000 7fec4cd9d700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fec4815a6d0 con 0x7fec4813c470 2023-10-06T01:22:29.169 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:29.168+0000 7fec4cd9d700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec480cb370 con 0x7fec4815a250 2023-10-06T01:22:29.170 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:29.169+0000 7fec477fe700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fec4813c470 0x7fec480ca990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:29.170 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:29.169+0000 7fec47fff700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fec4815a250 0x7fec480c8730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:29.170 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:29.169+0000 7fec477fe700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fec4813c470 0x7fec480ca990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.50:33786/0 (socket says 172.21.15.50:33786) 2023-10-06T01:22:29.171 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:29.169+0000 7fec477fe700 1 -- 172.21.15.50:0/2385067714 learned_addr learned my addr 172.21.15.50:0/2385067714 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-06T01:22:29.171 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:29.169+0000 7fec46ffd700 1 --1- 172.21.15.50:0/2385067714 >> v1:172.21.15.155:6789/0 conn(0x7fec480caed0 0x7fec48159b40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.155:6789/0 says I am v1:172.21.15.50:42132/0 (socket says 172.21.15.50:42132) 2023-10-06T01:22:29.171 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:29.169+0000 7fec47fff700 1 -- 172.21.15.50:0/2385067714 >> v2:172.21.15.155:3300/0 conn(0x7fec4813c470 msgr2=0x7fec480ca990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:22:29.171 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:29.169+0000 7fec47fff700 1 --2- 172.21.15.50:0/2385067714 >> v2:172.21.15.155:3300/0 conn(0x7fec4813c470 0x7fec480ca990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:29.171 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:29.169+0000 7fec47fff700 1 -- 172.21.15.50:0/2385067714 >> v1:172.21.15.155:6789/0 conn(0x7fec480caed0 legacy=0x7fec48159b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:29.171 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:29.169+0000 7fec47fff700 1 -- 172.21.15.50:0/2385067714 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec4806cb80 con 0x7fec4815a250 2023-10-06T01:22:29.171 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:29.169+0000 7fec477fe700 1 --2- 172.21.15.50:0/2385067714 >> v2:172.21.15.155:3300/0 conn(0x7fec4813c470 0x7fec480ca990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T01:22:29.171 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:29.170+0000 7fec47fff700 1 --2- 172.21.15.50:0/2385067714 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fec4815a250 0x7fec480c8730 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fec40009e60 tx=0x7fec40009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1e0123e341b437f server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:22:29.172 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:29.170+0000 7fec467fc700 1 -- 172.21.15.50:0/2385067714 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec4000e070 con 0x7fec4815a250 2023-10-06T01:22:29.172 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:29.170+0000 7fec467fc700 1 -- 172.21.15.50:0/2385067714 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec4000bb60 con 0x7fec4815a250 2023-10-06T01:22:29.172 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:29.170+0000 7fec467fc700 1 -- 172.21.15.50:0/2385067714 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec40012430 con 0x7fec4815a250 2023-10-06T01:22:29.172 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:29.170+0000 7fec4cd9d700 1 -- 172.21.15.50:0/2385067714 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fec4815a250 msgr2=0x7fec480c8730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:29.173 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:29.170+0000 7fec4cd9d700 1 --2- 172.21.15.50:0/2385067714 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fec4815a250 0x7fec480c8730 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fec40009e60 tx=0x7fec40009780 comp rx=0 tx=0).stop 2023-10-06T01:22:29.173 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:29.171+0000 7fec4cd9d700 1 -- 172.21.15.50:0/2385067714 shutdown_connections 2023-10-06T01:22:29.173 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:29.171+0000 7fec4cd9d700 1 --2- 172.21.15.50:0/2385067714 >> v2:172.21.15.155:3300/0 conn(0x7fec4813c470 0x7fec480ca990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:29.173 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:29.171+0000 7fec4cd9d700 1 --2- 172.21.15.50:0/2385067714 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fec4815a250 0x7fec480c8730 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:29.173 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:29.171+0000 7fec4cd9d700 1 -- 172.21.15.50:0/2385067714 >> 172.21.15.50:0/2385067714 conn(0x7fec4806b370 msgr2=0x7fec4806b770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:22:29.173 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:29.171+0000 7fec4cd9d700 1 -- 172.21.15.50:0/2385067714 shutdown_connections 2023-10-06T01:22:29.173 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:29.171+0000 7fec4cd9d700 1 -- 172.21.15.50:0/2385067714 wait complete. 2023-10-06T01:22:29.173 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:29.172+0000 7fec4cd9d700 1 Processor -- start 2023-10-06T01:22:29.174 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:29.172+0000 7fec4cd9d700 1 -- start start 2023-10-06T01:22:29.176 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:29.173+0000 7fec4cd9d700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fec480caed0 0x7fec480c6fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:29.176 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:29.173+0000 7fec4cd9d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fec4813c470 0x7fec4813bbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:29.176 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:29.173+0000 7fec4cd9d700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fec4815a250 0x7fec48069fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:29.176 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:29.173+0000 7fec4cd9d700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec480c8270 con 0x7fec4813c470 2023-10-06T01:22:29.176 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:29.173+0000 7fec4cd9d700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec480c7660 con 0x7fec480caed0 2023-10-06T01:22:29.176 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:29.173+0000 7fec4cd9d700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec480c7940 con 0x7fec4815a250 2023-10-06T01:22:29.176 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:29.174+0000 7fec46ffd700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fec4813c470 0x7fec4813bbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:29.176 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:29.174+0000 7fec46ffd700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fec4813c470 0x7fec4813bbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:48642/0 (socket says 172.21.15.50:48642) 2023-10-06T01:22:29.176 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:29.174+0000 7fec47fff700 1 --2- 172.21.15.50:0/343300020 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fec4815a250 0x7fec48069fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:29.176 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:29.174+0000 7fec477fe700 1 --2- 172.21.15.50:0/343300020 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fec480caed0 0x7fec480c6fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:29.176 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:29.174+0000 7fec46ffd700 1 -- 172.21.15.50:0/343300020 learned_addr learned my addr 172.21.15.50:0/343300020 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-06T01:22:29.177 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:29.174+0000 7fec46ffd700 1 -- 172.21.15.50:0/343300020 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fec4815a250 msgr2=0x7fec48069fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:29.177 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:29.174+0000 7fec46ffd700 1 --2- 172.21.15.50:0/343300020 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fec4815a250 0x7fec48069fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:29.177 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:29.174+0000 7fec46ffd700 1 -- 172.21.15.50:0/343300020 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fec480caed0 msgr2=0x7fec480c6fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:29.177 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:29.174+0000 7fec46ffd700 1 --2- 172.21.15.50:0/343300020 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fec480caed0 0x7fec480c6fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:29.177 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:29.174+0000 7fec46ffd700 1 -- 172.21.15.50:0/343300020 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec380094f0 con 0x7fec4813c470 2023-10-06T01:22:29.177 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:29.174+0000 7fec47fff700 1 --2- 172.21.15.50:0/343300020 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fec4815a250 0x7fec48069fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T01:22:29.177 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:29.174+0000 7fec477fe700 1 --2- 172.21.15.50:0/343300020 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fec480caed0 0x7fec480c6fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T01:22:29.177 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:29.175+0000 7fec46ffd700 1 --2- 172.21.15.50:0/343300020 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fec4813c470 0x7fec4813bbd0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fec3c00c7c0 tx=0x7fec3c007f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:22:29.177 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:29.175+0000 7fec2f7fe700 1 -- 172.21.15.50:0/343300020 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec3c005a70 con 0x7fec4813c470 2023-10-06T01:22:29.177 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:29.175+0000 7fec2f7fe700 1 -- 172.21.15.50:0/343300020 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec3c005bd0 con 0x7fec4813c470 2023-10-06T01:22:29.177 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:29.175+0000 7fec2f7fe700 1 -- 172.21.15.50:0/343300020 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec3c0070d0 con 0x7fec4813c470 2023-10-06T01:22:29.177 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:29.175+0000 7fec4cd9d700 1 -- 172.21.15.50:0/343300020 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fec40009a20 con 0x7fec4813c470 2023-10-06T01:22:29.178 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:29.175+0000 7fec4cd9d700 1 -- 172.21.15.50:0/343300020 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fec480c7f00 con 0x7fec4813c470 2023-10-06T01:22:29.178 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:29.176+0000 7fec4cd9d700 1 -- 172.21.15.50:0/343300020 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fec480c8090 con 0x7fec4813c470 2023-10-06T01:22:29.178 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:29.177+0000 7fec2f7fe700 1 -- 172.21.15.50:0/343300020 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fec3c007480 con 0x7fec4813c470 2023-10-06T01:22:29.179 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:29.178+0000 7fec2f7fe700 1 --2- 172.21.15.50:0/343300020 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7fec34066f60 0x7fec34069410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:29.179 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:29.178+0000 7fec2f7fe700 1 -- 172.21.15.50:0/343300020 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6867+0+0 (secure 0 0 0) 0x7fec3c083e70 con 0x7fec4813c470 2023-10-06T01:22:29.179 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:29.179+0000 7fec477fe700 1 --2- 172.21.15.50:0/343300020 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7fec34066f60 0x7fec34069410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:29.183 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:29.179+0000 7fec477fe700 1 --2- 172.21.15.50:0/343300020 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7fec34066f60 0x7fec34069410 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fec38006d20 tx=0x7fec38009250 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:22:29.183 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:29.182+0000 7fec2f7fe700 1 -- 172.21.15.50:0/343300020 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fec3c050bb0 con 0x7fec4813c470 2023-10-06T01:22:29.392 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:29.391+0000 7fec4cd9d700 1 -- 172.21.15.50:0/343300020 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fec4805f270 con 0x7fec4813c470 2023-10-06T01:22:29.393 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:29.391+0000 7fec2f7fe700 1 -- 172.21.15.50:0/343300020 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v27) v1 ==== 104+0+11 (secure 0 0 0) 0x7fec3c0170a0 con 0x7fec4813c470 2023-10-06T01:22:29.393 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 32 2023-10-06T01:22:29.395 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:29.394+0000 7fec4cd9d700 1 -- 172.21.15.50:0/343300020 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7fec34066f60 msgr2=0x7fec34069410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:29.396 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:29.394+0000 7fec4cd9d700 1 --2- 172.21.15.50:0/343300020 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7fec34066f60 0x7fec34069410 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fec38006d20 tx=0x7fec38009250 comp rx=0 tx=0).stop 2023-10-06T01:22:29.396 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:29.394+0000 7fec4cd9d700 1 -- 172.21.15.50:0/343300020 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fec4813c470 msgr2=0x7fec4813bbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:29.396 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:29.394+0000 7fec4cd9d700 1 --2- 172.21.15.50:0/343300020 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fec4813c470 0x7fec4813bbd0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fec3c00c7c0 tx=0x7fec3c007f70 comp rx=0 tx=0).stop 2023-10-06T01:22:29.396 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:29.394+0000 7fec4cd9d700 1 -- 172.21.15.50:0/343300020 shutdown_connections 2023-10-06T01:22:29.396 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:29.394+0000 7fec4cd9d700 1 --2- 172.21.15.50:0/343300020 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fec4815a250 0x7fec48069fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:29.396 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:29.394+0000 7fec4cd9d700 1 --2- 172.21.15.50:0/343300020 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7fec34066f60 0x7fec34069410 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:29.396 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:29.394+0000 7fec4cd9d700 1 --2- 172.21.15.50:0/343300020 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fec480caed0 0x7fec480c6fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:29.396 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:29.394+0000 7fec4cd9d700 1 --2- 172.21.15.50:0/343300020 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fec4813c470 0x7fec4813bbd0 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:29.397 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:29.394+0000 7fec4cd9d700 1 -- 172.21.15.50:0/343300020 >> 172.21.15.50:0/343300020 conn(0x7fec4806b370 msgr2=0x7fec48158b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:22:29.397 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:29.394+0000 7fec4cd9d700 1 -- 172.21.15.50:0/343300020 shutdown_connections 2023-10-06T01:22:29.397 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:29.394+0000 7fec4cd9d700 1 -- 172.21.15.50:0/343300020 wait complete. 2023-10-06T01:22:29.414 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-06T01:22:29.604 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:29.603+0000 7f78b3fff700 1 Processor -- start 2023-10-06T01:22:29.604 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:29.603+0000 7f78b3fff700 1 -- start start 2023-10-06T01:22:29.606 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:29.605+0000 7f78b3fff700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f78b4156130 0x7f78b4159ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:29.606 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:29.605+0000 7f78b3fff700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f78b40ae0f0 0x7f78b40c8a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:29.606 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:29.605+0000 7f78b3fff700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f78b40acb10 con 0x7f78b40c8f70 2023-10-06T01:22:29.606 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:29.605+0000 7f78b3fff700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f78b4156500 con 0x7f78b40ae0f0 2023-10-06T01:22:29.606 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:29.605+0000 7f78b3fff700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78b415a310 con 0x7f78b4156130 2023-10-06T01:22:29.606 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:29.605+0000 7f78b27fc700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f78b40ae0f0 0x7f78b40c8a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:29.606 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:29.605+0000 7f78b27fc700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f78b40ae0f0 0x7f78b40c8a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:48656/0 (socket says 172.21.15.50:48656) 2023-10-06T01:22:29.606 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:29.605+0000 7f78b27fc700 1 -- 172.21.15.50:0/1667055316 learned_addr learned my addr 172.21.15.50:0/1667055316 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-06T01:22:29.607 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:29.605+0000 7f78b2ffd700 1 --2- 172.21.15.50:0/1667055316 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f78b4156130 0x7f78b4159ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:29.608 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:29.605+0000 7f78b27fc700 1 -- 172.21.15.50:0/1667055316 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f78b4156130 msgr2=0x7f78b4159ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:22:29.608 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:29.605+0000 7f78b27fc700 1 --2- 172.21.15.50:0/1667055316 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f78b4156130 0x7f78b4159ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:29.608 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:29.605+0000 7f78b27fc700 1 -- 172.21.15.50:0/1667055316 >> v1:172.21.15.155:6789/0 conn(0x7f78b40c8f70 legacy=0x7f78b406e1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:29.608 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:29.606+0000 7f78b27fc700 1 -- 172.21.15.50:0/1667055316 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78b415a5f0 con 0x7f78b40ae0f0 2023-10-06T01:22:29.608 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:29.606+0000 7f78b27fc700 1 --2- 172.21.15.50:0/1667055316 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f78b40ae0f0 0x7f78b40c8a30 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f78a80099b0 tx=0x7f78a8009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=105c24d5617c38a6 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:22:29.608 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:29.606+0000 7f78b1ffb700 1 -- 172.21.15.50:0/1667055316 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78a8009ea0 con 0x7f78b40ae0f0 2023-10-06T01:22:29.609 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:29.606+0000 7f78b1ffb700 1 -- 172.21.15.50:0/1667055316 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f78a800b860 con 0x7f78b40ae0f0 2023-10-06T01:22:29.609 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:29.606+0000 7f78b1ffb700 1 -- 172.21.15.50:0/1667055316 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78a800bc00 con 0x7f78b40ae0f0 2023-10-06T01:22:29.609 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:29.607+0000 7f78b3fff700 1 -- 172.21.15.50:0/1667055316 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f78b40ae0f0 msgr2=0x7f78b40c8a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:29.609 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:29.607+0000 7f78b3fff700 1 --2- 172.21.15.50:0/1667055316 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f78b40ae0f0 0x7f78b40c8a30 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f78a80099b0 tx=0x7f78a8009250 comp rx=0 tx=0).stop 2023-10-06T01:22:29.609 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:29.607+0000 7f78b3fff700 1 -- 172.21.15.50:0/1667055316 shutdown_connections 2023-10-06T01:22:29.609 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:29.607+0000 7f78b3fff700 1 --2- 172.21.15.50:0/1667055316 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f78b4156130 0x7f78b4159ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:29.609 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:29.607+0000 7f78b3fff700 1 --2- 172.21.15.50:0/1667055316 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f78b40ae0f0 0x7f78b40c8a30 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:29.609 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:29.607+0000 7f78b3fff700 1 -- 172.21.15.50:0/1667055316 >> 172.21.15.50:0/1667055316 conn(0x7f78b40cbf10 msgr2=0x7f78b40cc310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:22:29.609 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:29.607+0000 7f78b3fff700 1 -- 172.21.15.50:0/1667055316 shutdown_connections 2023-10-06T01:22:29.609 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:29.607+0000 7f78b3fff700 1 -- 172.21.15.50:0/1667055316 wait complete. 2023-10-06T01:22:29.611 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:29.608+0000 7f78b3fff700 1 Processor -- start 2023-10-06T01:22:29.611 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:29.608+0000 7f78b3fff700 1 -- start start 2023-10-06T01:22:29.612 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:29.609+0000 7f78b3fff700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f78b40ae0f0 0x7f78b41592e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:29.612 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:29.609+0000 7f78b3fff700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f78b40c8f70 0x7f78b4169d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:29.612 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:29.609+0000 7f78b3fff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f78b4156130 0x7f78b40afec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:29.612 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:29.609+0000 7f78b3fff700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78b416d830 con 0x7f78b4156130 2023-10-06T01:22:29.612 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:29.609+0000 7f78b3fff700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78b416a770 con 0x7f78b40ae0f0 2023-10-06T01:22:29.612 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:29.609+0000 7f78b3fff700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78b416aa50 con 0x7f78b40c8f70 2023-10-06T01:22:29.612 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:29.609+0000 7f78b37fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f78b4156130 0x7f78b40afec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:29.612 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:29.609+0000 7f78b37fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f78b4156130 0x7f78b40afec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:48666/0 (socket says 172.21.15.50:48666) 2023-10-06T01:22:29.612 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:29.609+0000 7f78b37fe700 1 -- 172.21.15.50:0/2878173004 learned_addr learned my addr 172.21.15.50:0/2878173004 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-06T01:22:29.613 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:29.610+0000 7f78b27fc700 1 --2- 172.21.15.50:0/2878173004 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f78b40c8f70 0x7f78b4169d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:29.613 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:29.610+0000 7f78b2ffd700 1 --2- 172.21.15.50:0/2878173004 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f78b40ae0f0 0x7f78b41592e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:29.613 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:29.610+0000 7f78b37fe700 1 -- 172.21.15.50:0/2878173004 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f78b40c8f70 msgr2=0x7f78b4169d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:29.613 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:29.610+0000 7f78b37fe700 1 --2- 172.21.15.50:0/2878173004 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f78b40c8f70 0x7f78b4169d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:29.613 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:29.610+0000 7f78b37fe700 1 -- 172.21.15.50:0/2878173004 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f78b40ae0f0 msgr2=0x7f78b41592e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:29.613 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:29.610+0000 7f78b37fe700 1 --2- 172.21.15.50:0/2878173004 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f78b40ae0f0 0x7f78b41592e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:29.613 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:29.610+0000 7f78b37fe700 1 -- 172.21.15.50:0/2878173004 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78a80094f0 con 0x7f78b4156130 2023-10-06T01:22:29.613 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:29.610+0000 7f78b37fe700 1 --2- 172.21.15.50:0/2878173004 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f78b4156130 0x7f78b40afec0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f78ac00c910 tx=0x7f78ac0016b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:22:29.613 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:29.610+0000 7f789affd700 1 -- 172.21.15.50:0/2878173004 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78ac012630 con 0x7f78b4156130 2023-10-06T01:22:29.613 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:29.610+0000 7f789affd700 1 -- 172.21.15.50:0/2878173004 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f78ac0127b0 con 0x7f78b4156130 2023-10-06T01:22:29.613 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:29.610+0000 7f789affd700 1 -- 172.21.15.50:0/2878173004 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78ac012b70 con 0x7f78b4156130 2023-10-06T01:22:29.613 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:29.610+0000 7f78b3fff700 1 -- 172.21.15.50:0/2878173004 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f78b416d4c0 con 0x7f78b4156130 2023-10-06T01:22:29.614 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:29.611+0000 7f78b3fff700 1 -- 172.21.15.50:0/2878173004 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f78b41567f0 con 0x7f78b4156130 2023-10-06T01:22:29.614 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:29.612+0000 7f78b3fff700 1 -- 172.21.15.50:0/2878173004 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f78b416d320 con 0x7f78b4156130 2023-10-06T01:22:29.614 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:29.612+0000 7f789affd700 1 -- 172.21.15.50:0/2878173004 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f78ac01a3a0 con 0x7f78b4156130 2023-10-06T01:22:29.615 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:29.614+0000 7f789affd700 1 --2- 172.21.15.50:0/2878173004 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f78a0066f30 0x7f78a00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:29.615 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:29.614+0000 7f789affd700 1 -- 172.21.15.50:0/2878173004 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6867+0+0 (secure 0 0 0) 0x7f78ac084b50 con 0x7f78b4156130 2023-10-06T01:22:29.615 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:29.614+0000 7f78b2ffd700 1 --2- 172.21.15.50:0/2878173004 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f78a0066f30 0x7f78a00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:29.616 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:29.615+0000 7f78b2ffd700 1 --2- 172.21.15.50:0/2878173004 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f78a0066f30 0x7f78a00693e0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f78b40c7210 tx=0x7f78a40091a0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:22:29.618 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:29.618+0000 7f789affd700 1 -- 172.21.15.50:0/2878173004 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f78b416d320 con 0x7f78b4156130 2023-10-06T01:22:29.822 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:29.822+0000 7f78b3fff700 1 -- 172.21.15.50:0/2878173004 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f78b416d320 con 0x7f78b4156130 2023-10-06T01:22:29.823 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:29.822+0000 7f789affd700 1 -- 172.21.15.50:0/2878173004 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v27) v1 ==== 100+0+11 (secure 0 0 0) 0x7f78b416d320 con 0x7f78b4156130 2023-10-06T01:22:29.823 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 64 2023-10-06T01:22:29.826 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:29.825+0000 7f78b3fff700 1 -- 172.21.15.50:0/2878173004 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f78a0066f30 msgr2=0x7f78a00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:29.826 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:29.825+0000 7f78b3fff700 1 --2- 172.21.15.50:0/2878173004 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f78a0066f30 0x7f78a00693e0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f78b40c7210 tx=0x7f78a40091a0 comp rx=0 tx=0).stop 2023-10-06T01:22:29.826 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:29.825+0000 7f78b3fff700 1 -- 172.21.15.50:0/2878173004 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f78b4156130 msgr2=0x7f78b40afec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:29.826 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:29.825+0000 7f78b3fff700 1 --2- 172.21.15.50:0/2878173004 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f78b4156130 0x7f78b40afec0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f78ac00c910 tx=0x7f78ac0016b0 comp rx=0 tx=0).stop 2023-10-06T01:22:29.827 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:29.825+0000 7f78b3fff700 1 -- 172.21.15.50:0/2878173004 shutdown_connections 2023-10-06T01:22:29.827 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:29.825+0000 7f78b3fff700 1 --2- 172.21.15.50:0/2878173004 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f78b4156130 0x7f78b40afec0 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:29.827 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:29.825+0000 7f78b3fff700 1 --2- 172.21.15.50:0/2878173004 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f78a0066f30 0x7f78a00693e0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:29.827 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:29.825+0000 7f78b3fff700 1 --2- 172.21.15.50:0/2878173004 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f78b40ae0f0 0x7f78b41592e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:29.827 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:29.825+0000 7f78b3fff700 1 --2- 172.21.15.50:0/2878173004 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f78b40c8f70 0x7f78b4169d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:29.827 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:29.825+0000 7f78b3fff700 1 -- 172.21.15.50:0/2878173004 >> 172.21.15.50:0/2878173004 conn(0x7f78b40cbf10 msgr2=0x7f78b40acfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:22:29.827 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:29.825+0000 7f78b3fff700 1 -- 172.21.15.50:0/2878173004 shutdown_connections 2023-10-06T01:22:29.827 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:29.825+0000 7f78b3fff700 1 -- 172.21.15.50:0/2878173004 wait complete. 2023-10-06T01:22:29.843 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-10-06T01:22:30.035 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:30.034+0000 7fc75139d700 1 Processor -- start 2023-10-06T01:22:30.035 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:30.034+0000 7fc75139d700 1 -- start start 2023-10-06T01:22:30.036 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:30.035+0000 7fc75139d700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fc74c15c740 0x7fc74c0c6dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:30.037 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:30.035+0000 7fc75139d700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc74c15d6b0 0x7fc74c0c2530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:30.037 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:30.035+0000 7fc75139d700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc74c0c7300 con 0x7fc74c15cb10 2023-10-06T01:22:30.037 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:30.035+0000 7fc75139d700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc74c0ca350 con 0x7fc74c15c740 2023-10-06T01:22:30.037 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:30.035+0000 7fc75139d700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc74c0cabb0 con 0x7fc74c15d6b0 2023-10-06T01:22:30.037 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:30.036+0000 7fc750b9c700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc74c15d6b0 0x7fc74c0c2530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:30.037 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:30.036+0000 7fc74bfff700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fc74c15c740 0x7fc74c0c6dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:30.037 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:30.036+0000 7fc74b7fe700 1 --1- >> v1:172.21.15.155:6789/0 conn(0x7fc74c15cb10 0x7fc74c15cfa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.155:6789/0 says I am v1:172.21.15.50:42152/0 (socket says 172.21.15.50:42152) 2023-10-06T01:22:30.037 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:30.036+0000 7fc74b7fe700 1 -- 172.21.15.50:0/3071008455 learned_addr learned my addr 172.21.15.50:0/3071008455 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-10-06T01:22:30.039 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:30.036+0000 7fc750b9c700 1 -- 172.21.15.50:0/3071008455 >> v2:172.21.15.155:3300/0 conn(0x7fc74c15c740 msgr2=0x7fc74c0c6dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:22:30.039 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:30.036+0000 7fc750b9c700 1 --2- 172.21.15.50:0/3071008455 >> v2:172.21.15.155:3300/0 conn(0x7fc74c15c740 0x7fc74c0c6dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:30.039 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:30.036+0000 7fc750b9c700 1 -- 172.21.15.50:0/3071008455 >> v1:172.21.15.155:6789/0 conn(0x7fc74c15cb10 legacy=0x7fc74c15cfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:30.039 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:30.036+0000 7fc750b9c700 1 -- 172.21.15.50:0/3071008455 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc74c0cc3d0 con 0x7fc74c15d6b0 2023-10-06T01:22:30.039 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:30.037+0000 7fc750b9c700 1 --2- 172.21.15.50:0/3071008455 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc74c15d6b0 0x7fc74c0c2530 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fc744009e60 tx=0x7fc744009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8aef612aa7ed2fd7 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:22:30.039 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:30.037+0000 7fc74affd700 1 -- 172.21.15.50:0/3071008455 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc74400e070 con 0x7fc74c15d6b0 2023-10-06T01:22:30.039 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:30.037+0000 7fc74affd700 1 -- 172.21.15.50:0/3071008455 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc74400bb60 con 0x7fc74c15d6b0 2023-10-06T01:22:30.039 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:30.037+0000 7fc74affd700 1 -- 172.21.15.50:0/3071008455 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc744012430 con 0x7fc74c15d6b0 2023-10-06T01:22:30.039 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:30.037+0000 7fc75139d700 1 -- 172.21.15.50:0/3071008455 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc74c15d6b0 msgr2=0x7fc74c0c2530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:30.039 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:30.037+0000 7fc75139d700 1 --2- 172.21.15.50:0/3071008455 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc74c15d6b0 0x7fc74c0c2530 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fc744009e60 tx=0x7fc744009780 comp rx=0 tx=0).stop 2023-10-06T01:22:30.039 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:30.038+0000 7fc75139d700 1 -- 172.21.15.50:0/3071008455 shutdown_connections 2023-10-06T01:22:30.040 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:30.038+0000 7fc75139d700 1 --2- 172.21.15.50:0/3071008455 >> v2:172.21.15.155:3300/0 conn(0x7fc74c15c740 0x7fc74c0c6dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:30.040 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:30.038+0000 7fc75139d700 1 --2- 172.21.15.50:0/3071008455 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc74c15d6b0 0x7fc74c0c2530 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:30.040 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:30.038+0000 7fc75139d700 1 -- 172.21.15.50:0/3071008455 >> 172.21.15.50:0/3071008455 conn(0x7fc74c0c91f0 msgr2=0x7fc74c0c95f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:22:30.040 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:30.038+0000 7fc75139d700 1 -- 172.21.15.50:0/3071008455 shutdown_connections 2023-10-06T01:22:30.040 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:30.038+0000 7fc75139d700 1 -- 172.21.15.50:0/3071008455 wait complete. 2023-10-06T01:22:30.041 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:30.039+0000 7fc75139d700 1 Processor -- start 2023-10-06T01:22:30.041 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:30.039+0000 7fc75139d700 1 -- start start 2023-10-06T01:22:30.041 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:30.040+0000 7fc75139d700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc74c15c740 0x7fc74c0af520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:30.041 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:30.040+0000 7fc75139d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc74c15cb10 0x7fc74c1426f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:30.041 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:30.040+0000 7fc75139d700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc74c15d6b0 0x7fc74c159270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:30.042 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:30.040+0000 7fc75139d700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc74c0b0980 con 0x7fc74c15cb10 2023-10-06T01:22:30.042 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:30.040+0000 7fc75139d700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc74c0afd70 con 0x7fc74c15c740 2023-10-06T01:22:30.042 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:30.040+0000 7fc75139d700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc74c0b0050 con 0x7fc74c15d6b0 2023-10-06T01:22:30.042 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:30.040+0000 7fc74b7fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc74c15cb10 0x7fc74c1426f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:30.042 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:30.040+0000 7fc74bfff700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc74c15c740 0x7fc74c0af520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:30.042 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:30.040+0000 7fc74b7fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc74c15cb10 0x7fc74c1426f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:48680/0 (socket says 172.21.15.50:48680) 2023-10-06T01:22:30.042 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:30.040+0000 7fc74b7fe700 1 -- 172.21.15.50:0/3897057786 learned_addr learned my addr 172.21.15.50:0/3897057786 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-06T01:22:30.042 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:30.040+0000 7fc750b9c700 1 --2- 172.21.15.50:0/3897057786 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc74c15d6b0 0x7fc74c159270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:30.044 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:30.041+0000 7fc74b7fe700 1 -- 172.21.15.50:0/3897057786 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc74c15d6b0 msgr2=0x7fc74c159270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:30.044 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:30.041+0000 7fc74b7fe700 1 --2- 172.21.15.50:0/3897057786 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc74c15d6b0 0x7fc74c159270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:30.044 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:30.041+0000 7fc74b7fe700 1 -- 172.21.15.50:0/3897057786 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc74c15c740 msgr2=0x7fc74c0af520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:30.044 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:30.041+0000 7fc74b7fe700 1 --2- 172.21.15.50:0/3897057786 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc74c15c740 0x7fc74c0af520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:30.044 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:30.041+0000 7fc74b7fe700 1 -- 172.21.15.50:0/3897057786 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc744009a20 con 0x7fc74c15cb10 2023-10-06T01:22:30.044 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:30.041+0000 7fc74bfff700 1 --2- 172.21.15.50:0/3897057786 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc74c15c740 0x7fc74c0af520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T01:22:30.045 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:30.041+0000 7fc74b7fe700 1 --2- 172.21.15.50:0/3897057786 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc74c15cb10 0x7fc74c1426f0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fc74000c560 tx=0x7fc740001020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:22:30.045 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:30.041+0000 7fc733fff700 1 -- 172.21.15.50:0/3897057786 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc740005b30 con 0x7fc74c15cb10 2023-10-06T01:22:30.045 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:30.041+0000 7fc733fff700 1 -- 172.21.15.50:0/3897057786 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc740005c90 con 0x7fc74c15cb10 2023-10-06T01:22:30.045 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:30.041+0000 7fc733fff700 1 -- 172.21.15.50:0/3897057786 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc740007320 con 0x7fc74c15cb10 2023-10-06T01:22:30.045 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:30.041+0000 7fc75139d700 1 -- 172.21.15.50:0/3897057786 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc74c0b0330 con 0x7fc74c15cb10 2023-10-06T01:22:30.046 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:30.042+0000 7fc75139d700 1 -- 172.21.15.50:0/3897057786 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc74c0afa60 con 0x7fc74c15cb10 2023-10-06T01:22:30.046 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:30.043+0000 7fc75139d700 1 -- 172.21.15.50:0/3897057786 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc74c0b0af0 con 0x7fc74c15cb10 2023-10-06T01:22:30.047 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:30.044+0000 7fc733fff700 1 -- 172.21.15.50:0/3897057786 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fc74001b3b0 con 0x7fc74c15cb10 2023-10-06T01:22:30.047 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:30.045+0000 7fc733fff700 1 --2- 172.21.15.50:0/3897057786 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7fc738066f30 0x7fc7380693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:30.047 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:30.045+0000 7fc733fff700 1 -- 172.21.15.50:0/3897057786 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6867+0+0 (secure 0 0 0) 0x7fc740083e00 con 0x7fc74c15cb10 2023-10-06T01:22:30.047 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:30.045+0000 7fc74bfff700 1 --2- 172.21.15.50:0/3897057786 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7fc738066f30 0x7fc7380693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:30.047 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:30.046+0000 7fc74bfff700 1 --2- 172.21.15.50:0/3897057786 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7fc738066f30 0x7fc7380693e0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fc73c0113e0 tx=0x7fc73c0091a0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:22:30.049 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:30.049+0000 7fc733fff700 1 -- 172.21.15.50:0/3897057786 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fc740050b40 con 0x7fc74c15cb10 2023-10-06T01:22:30.250 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:30.249+0000 7fc75139d700 1 -- 172.21.15.50:0/3897057786 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7fc74c05f270 con 0x7fc74c15cb10 2023-10-06T01:22:30.251 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:30.250+0000 7fc733fff700 1 -- 172.21.15.50:0/3897057786 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v27) v1 ==== 103+0+11 (secure 0 0 0) 0x7fc7400170a0 con 0x7fc74c15cb10 2023-10-06T01:22:30.251 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 32 2023-10-06T01:22:30.253 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:30.252+0000 7fc75139d700 1 -- 172.21.15.50:0/3897057786 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7fc738066f30 msgr2=0x7fc7380693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:30.253 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:30.252+0000 7fc75139d700 1 --2- 172.21.15.50:0/3897057786 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7fc738066f30 0x7fc7380693e0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fc73c0113e0 tx=0x7fc73c0091a0 comp rx=0 tx=0).stop 2023-10-06T01:22:30.253 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:30.252+0000 7fc75139d700 1 -- 172.21.15.50:0/3897057786 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc74c15cb10 msgr2=0x7fc74c1426f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:30.253 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:30.252+0000 7fc75139d700 1 --2- 172.21.15.50:0/3897057786 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc74c15cb10 0x7fc74c1426f0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fc74000c560 tx=0x7fc740001020 comp rx=0 tx=0).stop 2023-10-06T01:22:30.254 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:30.252+0000 7fc75139d700 1 -- 172.21.15.50:0/3897057786 shutdown_connections 2023-10-06T01:22:30.254 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:30.252+0000 7fc75139d700 1 --2- 172.21.15.50:0/3897057786 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc74c15d6b0 0x7fc74c159270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:30.254 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:30.252+0000 7fc75139d700 1 --2- 172.21.15.50:0/3897057786 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7fc738066f30 0x7fc7380693e0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:30.254 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:30.252+0000 7fc75139d700 1 --2- 172.21.15.50:0/3897057786 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc74c15c740 0x7fc74c0af520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:30.254 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:30.252+0000 7fc75139d700 1 --2- 172.21.15.50:0/3897057786 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc74c15cb10 0x7fc74c1426f0 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:30.254 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:30.252+0000 7fc75139d700 1 -- 172.21.15.50:0/3897057786 >> 172.21.15.50:0/3897057786 conn(0x7fc74c0c91f0 msgr2=0x7fc74c068350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:22:30.254 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:30.252+0000 7fc75139d700 1 -- 172.21.15.50:0/3897057786 shutdown_connections 2023-10-06T01:22:30.254 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:30.252+0000 7fc75139d700 1 -- 172.21.15.50:0/3897057786 wait complete. 2023-10-06T01:22:30.271 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T01:22:30.457 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:30.456+0000 7f8d9f59d700 1 Processor -- start 2023-10-06T01:22:30.457 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:30.456+0000 7f8d9f59d700 1 -- start start 2023-10-06T01:22:30.458 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:30.457+0000 7f8d9f59d700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8d9806a5d0 0x7f8d98153730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:30.459 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:30.458+0000 7f8d9f59d700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8d980c9d00 con 0x7f8d9806a9a0 2023-10-06T01:22:30.459 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:30.458+0000 7f8d9f59d700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8d980c6750 con 0x7f8d9806e6a0 2023-10-06T01:22:30.459 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:30.458+0000 7f8d9f59d700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d9806f5a0 con 0x7f8d9806a5d0 2023-10-06T01:22:30.459 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:30.458+0000 7f8d9dd9a700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f8d9806a9a0 0x7f8d9806df90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:54440/0 (socket says 172.21.15.50:54440) 2023-10-06T01:22:30.459 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:30.458+0000 7f8d9dd9a700 1 -- 172.21.15.50:0/1581686150 learned_addr learned my addr 172.21.15.50:0/1581686150 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-10-06T01:22:30.462 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:30.458+0000 7f8d9e59b700 1 --2- 172.21.15.50:0/1581686150 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8d9806a5d0 0x7f8d98153730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:30.462 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:30.458+0000 7f8d9d599700 1 -- 172.21.15.50:0/1581686150 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 672912289 0 0) 0x7f8d980c9d00 con 0x7f8d9806a9a0 2023-10-06T01:22:30.462 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:30.458+0000 7f8d9d599700 1 -- 172.21.15.50:0/1581686150 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8d84003570 con 0x7f8d9806a9a0 2023-10-06T01:22:30.462 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:30.459+0000 7f8d9d599700 1 -- 172.21.15.50:0/1581686150 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 779393390 0 0) 0x7f8d980c6750 con 0x7f8d9806e6a0 2023-10-06T01:22:30.462 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:30.459+0000 7f8d9d599700 1 -- 172.21.15.50:0/1581686150 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8d980c9d00 con 0x7f8d9806e6a0 2023-10-06T01:22:30.462 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:30.459+0000 7f8d9d599700 1 -- 172.21.15.50:0/1581686150 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2524940406 0 0) 0x7f8d84003570 con 0x7f8d9806a9a0 2023-10-06T01:22:30.463 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:30.459+0000 7f8d9d599700 1 -- 172.21.15.50:0/1581686150 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8d9806a5d0 msgr2=0x7f8d98153730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:22:30.463 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:30.459+0000 7f8d9d599700 1 --2- 172.21.15.50:0/1581686150 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8d9806a5d0 0x7f8d98153730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:30.463 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:30.459+0000 7f8d9d599700 1 -- 172.21.15.50:0/1581686150 >> v1:172.21.15.155:6789/0 conn(0x7f8d9806e6a0 legacy=0x7f8d980ca190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:30.463 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:30.459+0000 7f8d9d599700 1 -- 172.21.15.50:0/1581686150 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d9806ed00 con 0x7f8d9806a9a0 2023-10-06T01:22:30.463 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:30.459+0000 7f8d9d599700 1 -- 172.21.15.50:0/1581686150 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 347519148 0 0) 0x7f8d88001470 con 0x7f8d9806a9a0 2023-10-06T01:22:30.463 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:30.459+0000 7f8d9d599700 1 -- 172.21.15.50:0/1581686150 >> v1:172.21.15.50:6789/0 conn(0x7f8d9806a9a0 legacy=0x7f8d9806df90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:30.463 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:30.459+0000 7f8d9d599700 1 --2- 172.21.15.50:0/1581686150 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8d84003c20 0x7f8d84004010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:30.463 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:30.459+0000 7f8d9d599700 1 --2- 172.21.15.50:0/1581686150 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8d9806a5d0 0x7f8d84004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:30.463 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:30.459+0000 7f8d9d599700 1 --2- 172.21.15.50:0/1581686150 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8d84004d50 0x7f8d840051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:30.463 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:30.459+0000 7f8d9d599700 1 -- 172.21.15.50:0/1581686150 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d9806f5a0 con 0x7f8d84003c20 2023-10-06T01:22:30.463 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:30.459+0000 7f8d9d599700 1 -- 172.21.15.50:0/1581686150 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d8400bb40 con 0x7f8d84004d50 2023-10-06T01:22:30.464 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:30.459+0000 7f8d9d599700 1 -- 172.21.15.50:0/1581686150 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d8400bd00 con 0x7f8d9806a5d0 2023-10-06T01:22:30.464 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:30.459+0000 7f8d9e59b700 1 --2- 172.21.15.50:0/1581686150 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8d84003c20 0x7f8d84004010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:30.464 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:30.459+0000 7f8d9dd9a700 1 --2- 172.21.15.50:0/1581686150 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8d9806a5d0 0x7f8d84004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:30.464 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:30.459+0000 7f8d9ed9c700 1 --2- 172.21.15.50:0/1581686150 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8d84004d50 0x7f8d840051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:30.464 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:30.459+0000 7f8d9e59b700 1 -- 172.21.15.50:0/1581686150 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8d9806a5d0 msgr2=0x7f8d84004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:22:30.464 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:30.459+0000 7f8d9e59b700 1 --2- 172.21.15.50:0/1581686150 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8d9806a5d0 0x7f8d84004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:30.464 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:30.459+0000 7f8d9e59b700 1 -- 172.21.15.50:0/1581686150 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8d84004d50 msgr2=0x7f8d840051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:22:30.464 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:30.459+0000 7f8d9e59b700 1 --2- 172.21.15.50:0/1581686150 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8d84004d50 0x7f8d840051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:30.464 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:30.459+0000 7f8d9e59b700 1 -- 172.21.15.50:0/1581686150 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d84003570 con 0x7f8d84003c20 2023-10-06T01:22:30.464 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:30.460+0000 7f8d9e59b700 1 --2- 172.21.15.50:0/1581686150 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8d84003c20 0x7f8d84004010 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f8d94009c00 tx=0x7f8d940091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=44320f1d543581ee server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:22:30.464 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:30.460+0000 7f8d9d599700 1 -- 172.21.15.50:0/1581686150 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d9400e710 con 0x7f8d84003c20 2023-10-06T01:22:30.465 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:30.460+0000 7f8d9d599700 1 -- 172.21.15.50:0/1581686150 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d9400e870 con 0x7f8d84003c20 2023-10-06T01:22:30.465 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:30.460+0000 7f8d9d599700 1 -- 172.21.15.50:0/1581686150 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d9400ec30 con 0x7f8d84003c20 2023-10-06T01:22:30.465 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:30.460+0000 7f8d9f59d700 1 -- 172.21.15.50:0/1581686150 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8d84003c20 msgr2=0x7f8d84004010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:30.465 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:30.460+0000 7f8d9f59d700 1 --2- 172.21.15.50:0/1581686150 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8d84003c20 0x7f8d84004010 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f8d94009c00 tx=0x7f8d940091a0 comp rx=0 tx=0).stop 2023-10-06T01:22:30.465 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:30.460+0000 7f8d9ed9c700 1 -- 172.21.15.50:0/1581686150 reap_dead start 2023-10-06T01:22:30.465 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:30.460+0000 7f8d9f59d700 1 -- 172.21.15.50:0/1581686150 shutdown_connections 2023-10-06T01:22:30.465 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:30.460+0000 7f8d9f59d700 1 -- 172.21.15.50:0/1581686150 >> 172.21.15.50:0/1581686150 conn(0x7f8d980680c0 msgr2=0x7f8d980cbf00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:22:30.465 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:30.461+0000 7f8d9f59d700 1 -- 172.21.15.50:0/1581686150 shutdown_connections 2023-10-06T01:22:30.465 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:30.461+0000 7f8d9f59d700 1 -- 172.21.15.50:0/1581686150 wait complete. 2023-10-06T01:22:30.467 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:30.462+0000 7f8d9f59d700 1 Processor -- start 2023-10-06T01:22:30.467 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:30.462+0000 7f8d9f59d700 1 -- start start 2023-10-06T01:22:30.467 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:30.463+0000 7f8d9f59d700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8d84003c20 0x7f8d981412d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:30.467 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:30.463+0000 7f8d9f59d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8d980afa90 0x7f8d98141810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:30.468 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:30.463+0000 7f8d9f59d700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8d98141d50 0x7f8d980b0010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:30.468 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:30.463+0000 7f8d9f59d700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d98140bb0 con 0x7f8d980afa90 2023-10-06T01:22:30.468 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:30.463+0000 7f8d9f59d700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d981410e0 con 0x7f8d98141d50 2023-10-06T01:22:30.468 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:30.463+0000 7f8d9f59d700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d981407a0 con 0x7f8d84003c20 2023-10-06T01:22:30.468 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:30.463+0000 7f8d9dd9a700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8d980afa90 0x7f8d98141810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:30.468 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:30.463+0000 7f8d9dd9a700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8d980afa90 0x7f8d98141810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:48700/0 (socket says 172.21.15.50:48700) 2023-10-06T01:22:30.468 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:30.463+0000 7f8d9dd9a700 1 -- 172.21.15.50:0/3158864717 learned_addr learned my addr 172.21.15.50:0/3158864717 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-06T01:22:30.468 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:30.463+0000 7f8d9ed9c700 1 --2- 172.21.15.50:0/3158864717 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8d98141d50 0x7f8d980b0010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:30.468 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:30.463+0000 7f8d9e59b700 1 --2- 172.21.15.50:0/3158864717 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8d84003c20 0x7f8d981412d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:30.468 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:30.464+0000 7f8d9dd9a700 1 -- 172.21.15.50:0/3158864717 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8d84003c20 msgr2=0x7f8d981412d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:30.469 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:30.464+0000 7f8d9dd9a700 1 --2- 172.21.15.50:0/3158864717 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8d84003c20 0x7f8d981412d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:30.469 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:30.464+0000 7f8d9dd9a700 1 -- 172.21.15.50:0/3158864717 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8d98141d50 msgr2=0x7f8d980b0010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:30.469 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:30.464+0000 7f8d9dd9a700 1 --2- 172.21.15.50:0/3158864717 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8d98141d50 0x7f8d980b0010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:30.469 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:30.464+0000 7f8d9dd9a700 1 -- 172.21.15.50:0/3158864717 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d98140e00 con 0x7f8d980afa90 2023-10-06T01:22:30.469 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:30.464+0000 7f8d9dd9a700 1 --2- 172.21.15.50:0/3158864717 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8d980afa90 0x7f8d98141810 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f8d8800ebc0 tx=0x7f8d88000c80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:22:30.469 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:30.464+0000 7f8d8e7fc700 1 -- 172.21.15.50:0/3158864717 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d88005e70 con 0x7f8d980afa90 2023-10-06T01:22:30.469 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:30.464+0000 7f8d8e7fc700 1 -- 172.21.15.50:0/3158864717 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d8800c5d0 con 0x7f8d980afa90 2023-10-06T01:22:30.469 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:30.464+0000 7f8d9f59d700 1 -- 172.21.15.50:0/3158864717 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8d98156800 con 0x7f8d980afa90 2023-10-06T01:22:30.469 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:30.464+0000 7f8d8e7fc700 1 -- 172.21.15.50:0/3158864717 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d8800c990 con 0x7f8d980afa90 2023-10-06T01:22:30.469 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:30.464+0000 7f8d9f59d700 1 -- 172.21.15.50:0/3158864717 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8d98153640 con 0x7f8d980afa90 2023-10-06T01:22:30.469 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:30.465+0000 7f8d9f59d700 1 -- 172.21.15.50:0/3158864717 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8d98142150 con 0x7f8d980afa90 2023-10-06T01:22:30.470 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:30.466+0000 7f8d8e7fc700 1 -- 172.21.15.50:0/3158864717 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f8d8800cd00 con 0x7f8d980afa90 2023-10-06T01:22:30.470 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:30.467+0000 7f8d8e7fc700 1 --2- 172.21.15.50:0/3158864717 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f8d7c066f30 0x7f8d7c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:30.470 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:30.467+0000 7f8d8e7fc700 1 -- 172.21.15.50:0/3158864717 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6867+0+0 (secure 0 0 0) 0x7f8d88084830 con 0x7f8d980afa90 2023-10-06T01:22:30.470 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:30.467+0000 7f8d9e59b700 1 --2- 172.21.15.50:0/3158864717 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f8d7c066f30 0x7f8d7c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:30.471 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:30.468+0000 7f8d9e59b700 1 --2- 172.21.15.50:0/3158864717 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f8d7c066f30 0x7f8d7c0693e0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f8d940091e0 tx=0x7f8d9401a000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:22:30.471 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:30.471+0000 7f8d8e7fc700 1 -- 172.21.15.50:0/3158864717 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f8d88051570 con 0x7f8d980afa90 2023-10-06T01:22:30.677 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:30.676+0000 7f8d9f59d700 1 -- 172.21.15.50:0/3158864717 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f8d9805f270 con 0x7f8d980afa90 2023-10-06T01:22:30.678 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:30.677+0000 7f8d8e7fc700 1 -- 172.21.15.50:0/3158864717 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+18803 (secure 0 0 0) 0x7f8d88054b90 con 0x7f8d980afa90 2023-10-06T01:22:30.678 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-10-06T01:22:30.678 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":27,"fsid":"0bfd9a6b-1587-4fe4-a89e-e43c00286b4e","created":"2023-10-06T01:21:16.828801+0000","modified":"2023-10-06T01:22:24.863940+0000","last_up_change":"2023-10-06T01:21:28.584523+0000","last_in_change":"2023-10-06T01:21:20.179863+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-10-06T01:21:29.304225+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":".mgr","create_time":"2023-10-06T01:21:29.835490+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-06T01:21:34.675315+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-06T01:21:35.753991+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-10-06T01:21:38.853108+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"9060727a-3959-4de3-8363-c5c5d7826c9a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":87837},{"type":"v1","addr":"172.21.15.50:6801","nonce":87837}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":87837},{"type":"v1","addr":"172.21.15.50:6803","nonce":87837}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":87837},{"type":"v1","addr":"172.21.15.50:6807","nonce":87837}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":87837},{"type":"v1","addr":"172.21.15.50:6805","nonce":87837}]},"public_addr":"172.21.15.50:6801/87837","cluster_addr":"172.21.15.50:6803/87837","heartbeat_back_addr":"172.21.15.50:6807/87837","heartbeat_front_addr":"172.21.15.50:6805/87837","state":["exists","up"]},{"osd":1,"uuid":"5ad9ef12-b579-47ea-b690-90ba887e2cef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":87853},{"type":"v1","addr":"172.21.15.50:6809","nonce":87853}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":87853},{"type":"v1","addr":"172.21.15.50:6811","nonce":87853}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":87853},{"type":"v1","addr":"172.21.15.50:6815","nonce":87853}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":87853},{"type":"v1","addr":"172.21.15.50:6813","nonce":87853}]},"public_addr":"172.21.15.50:6809/87853","cluster_addr":"172.21.15.50:6811/87853","heartbeat_back_addr":"172.21.15.50:6815/87853","heartbeat_front_addr":"172.21.15.50:6813/87853","state":["exists","up"]},{"osd":2,"uuid":"c7aee044-6f75-436f-90e1-ba42a57359bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6821","nonce":87855},{"type":"v1","addr":"172.21.15.50:6822","nonce":87855}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6824","nonce":87855},{"type":"v1","addr":"172.21.15.50:6826","nonce":87855}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":87855},{"type":"v1","addr":"172.21.15.50:6831","nonce":87855}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":87855},{"type":"v1","addr":"172.21.15.50:6829","nonce":87855}]},"public_addr":"172.21.15.50:6822/87855","cluster_addr":"172.21.15.50:6826/87855","heartbeat_back_addr":"172.21.15.50:6831/87855","heartbeat_front_addr":"172.21.15.50:6829/87855","state":["exists","up"]},{"osd":3,"uuid":"d9b901c8-e8b2-44af-9508-f453120a96c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":87856},{"type":"v1","addr":"172.21.15.50:6817","nonce":87856}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":87856},{"type":"v1","addr":"172.21.15.50:6819","nonce":87856}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6825","nonce":87856},{"type":"v1","addr":"172.21.15.50:6827","nonce":87856}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6820","nonce":87856},{"type":"v1","addr":"172.21.15.50:6823","nonce":87856}]},"public_addr":"172.21.15.50:6817/87856","cluster_addr":"172.21.15.50:6819/87856","heartbeat_back_addr":"172.21.15.50:6827/87856","heartbeat_front_addr":"172.21.15.50:6823/87856","state":["exists","up"]},{"osd":4,"uuid":"2b3c6b38-e3e9-4301-9445-60fd3fe8ce03","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":85805},{"type":"v1","addr":"172.21.15.155:6801","nonce":85805}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":85805},{"type":"v1","addr":"172.21.15.155:6803","nonce":85805}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6806","nonce":85805},{"type":"v1","addr":"172.21.15.155:6807","nonce":85805}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6804","nonce":85805},{"type":"v1","addr":"172.21.15.155:6805","nonce":85805}]},"public_addr":"172.21.15.155:6801/85805","cluster_addr":"172.21.15.155:6803/85805","heartbeat_back_addr":"172.21.15.155:6807/85805","heartbeat_front_addr":"172.21.15.155:6805/85805","state":["exists","up"]},{"osd":5,"uuid":"417b5f8f-65f1-4c94-91a7-a6ce03fe1679","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6816","nonce":85807},{"type":"v1","addr":"172.21.15.155:6818","nonce":85807}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6820","nonce":85807},{"type":"v1","addr":"172.21.15.155:6822","nonce":85807}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6828","nonce":85807},{"type":"v1","addr":"172.21.15.155:6830","nonce":85807}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6824","nonce":85807},{"type":"v1","addr":"172.21.15.155:6826","nonce":85807}]},"public_addr":"172.21.15.155:6818/85807","cluster_addr":"172.21.15.155:6822/85807","heartbeat_back_addr":"172.21.15.155:6830/85807","heartbeat_front_addr":"172.21.15.155:6826/85807","state":["exists","up"]},{"osd":6,"uuid":"c150cff3-aee4-4714-9c08-d182b1ba9ffd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6808","nonce":85806},{"type":"v1","addr":"172.21.15.155:6809","nonce":85806}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6810","nonce":85806},{"type":"v1","addr":"172.21.15.155:6811","nonce":85806}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6814","nonce":85806},{"type":"v1","addr":"172.21.15.155:6815","nonce":85806}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6812","nonce":85806},{"type":"v1","addr":"172.21.15.155:6813","nonce":85806}]},"public_addr":"172.21.15.155:6809/85806","cluster_addr":"172.21.15.155:6811/85806","heartbeat_back_addr":"172.21.15.155:6815/85806","heartbeat_front_addr":"172.21.15.155:6813/85806","state":["exists","up"]},{"osd":7,"uuid":"71107f0e-04d1-4e72-a0ec-0faf6af003e7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6817","nonce":85832},{"type":"v1","addr":"172.21.15.155:6819","nonce":85832}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6821","nonce":85832},{"type":"v1","addr":"172.21.15.155:6823","nonce":85832}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6829","nonce":85832},{"type":"v1","addr":"172.21.15.155:6831","nonce":85832}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6825","nonce":85832},{"type":"v1","addr":"172.21.15.155:6827","nonce":85832}]},"public_addr":"172.21.15.155:6819/85832","cluster_addr":"172.21.15.155:6823/85832","heartbeat_back_addr":"172.21.15.155:6831/85832","heartbeat_front_addr":"172.21.15.155:6827/85832","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:21:25.423389+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:21:25.472661+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:21:25.817562+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:21:25.551257+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:21:25.407818+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:21:25.557976+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:21:25.747299+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:21:25.827576+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.19","mappings":[{"from":3,"to":5}]},{"pgid":"4.31","mappings":[{"from":1,"to":2}]}],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T01:22:30.681 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:30.680+0000 7f8d9f59d700 1 -- 172.21.15.50:0/3158864717 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f8d7c066f30 msgr2=0x7f8d7c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:30.681 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:30.680+0000 7f8d9f59d700 1 --2- 172.21.15.50:0/3158864717 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f8d7c066f30 0x7f8d7c0693e0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f8d940091e0 tx=0x7f8d9401a000 comp rx=0 tx=0).stop 2023-10-06T01:22:30.681 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:30.680+0000 7f8d9f59d700 1 -- 172.21.15.50:0/3158864717 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8d980afa90 msgr2=0x7f8d98141810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:30.681 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:30.680+0000 7f8d9f59d700 1 --2- 172.21.15.50:0/3158864717 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8d980afa90 0x7f8d98141810 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f8d8800ebc0 tx=0x7f8d88000c80 comp rx=0 tx=0).stop 2023-10-06T01:22:30.681 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:30.680+0000 7f8d9f59d700 1 -- 172.21.15.50:0/3158864717 shutdown_connections 2023-10-06T01:22:30.681 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:30.680+0000 7f8d9f59d700 1 --2- 172.21.15.50:0/3158864717 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f8d7c066f30 0x7f8d7c0693e0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:30.681 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:30.680+0000 7f8d9f59d700 1 --2- 172.21.15.50:0/3158864717 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8d98141d50 0x7f8d980b0010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:30.682 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:30.680+0000 7f8d9f59d700 1 --2- 172.21.15.50:0/3158864717 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8d84003c20 0x7f8d981412d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:30.682 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:30.680+0000 7f8d9f59d700 1 --2- 172.21.15.50:0/3158864717 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8d980afa90 0x7f8d98141810 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:30.682 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:30.680+0000 7f8d9f59d700 1 -- 172.21.15.50:0/3158864717 >> 172.21.15.50:0/3158864717 conn(0x7f8d980680c0 msgr2=0x7f8d98143fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:22:30.682 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:30.680+0000 7f8d9f59d700 1 -- 172.21.15.50:0/3158864717 shutdown_connections 2023-10-06T01:22:30.682 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:30.680+0000 7f8d9f59d700 1 -- 172.21.15.50:0/3158864717 wait complete. 2023-10-06T01:22:30.701 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-10-06T01:21:29.304225+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-10-06T01:21:29.835490+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-06T01:21:34.675315+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-10-06T01:21:35.753991+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-10-06T01:21:38.853108+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-06T01:22:30.702 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-10-06T01:22:30.893 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:30.892+0000 7f9d1b59e700 1 Processor -- start 2023-10-06T01:22:30.893 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:30.892+0000 7f9d1b59e700 1 -- start start 2023-10-06T01:22:30.894 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:30.893+0000 7f9d1b59e700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f9d1c0b2660 0x7f9d1c0cccf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:30.894 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:30.893+0000 7f9d1b59e700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9d1c0cc9b0 con 0x7f9d1c0b2a30 2023-10-06T01:22:30.894 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:30.893+0000 7f9d1b59e700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9d1c0cbda0 con 0x7f9d1c0cf1f0 2023-10-06T01:22:30.894 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:30.893+0000 7f9d1b59e700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9d1c0cc080 con 0x7f9d1c0b2660 2023-10-06T01:22:30.895 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:30.893+0000 7f9d1a59c700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f9d1c0b2660 0x7f9d1c0cccf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:30.895 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:30.893+0000 7f9d19d9b700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f9d1c0b2a30 0x7f9d1c0ceae0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:54450/0 (socket says 172.21.15.50:54450) 2023-10-06T01:22:30.895 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:30.893+0000 7f9d19d9b700 1 -- 172.21.15.50:0/3171575907 learned_addr learned my addr 172.21.15.50:0/3171575907 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-10-06T01:22:30.896 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:30.894+0000 7f9d1a59c700 1 -- 172.21.15.50:0/3171575907 >> v1:172.21.15.155:6789/0 conn(0x7f9d1c0cf1f0 legacy=0x7f9d1c0c5390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:30.896 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:30.894+0000 7f9d1a59c700 1 -- 172.21.15.50:0/3171575907 >> v1:172.21.15.50:6789/0 conn(0x7f9d1c0b2a30 legacy=0x7f9d1c0ceae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:30.896 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:30.894+0000 7f9d1a59c700 1 -- 172.21.15.50:0/3171575907 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d1c0cc360 con 0x7f9d1c0b2660 2023-10-06T01:22:30.896 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:30.894+0000 7f9d1a59c700 1 --2- 172.21.15.50:0/3171575907 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9d1c0b2660 0x7f9d1c0cccf0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f9d0c0098d0 tx=0x7f9d0c009120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ebf919222de16e03 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:22:30.896 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:30.894+0000 7f9d1959a700 1 -- 172.21.15.50:0/3171575907 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d0c009e70 con 0x7f9d1c0b2660 2023-10-06T01:22:30.897 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:30.894+0000 7f9d1959a700 1 -- 172.21.15.50:0/3171575907 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d0c005c10 con 0x7f9d1c0b2660 2023-10-06T01:22:30.897 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:30.894+0000 7f9d1959a700 1 -- 172.21.15.50:0/3171575907 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d0c00b650 con 0x7f9d1c0b2660 2023-10-06T01:22:30.897 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:30.895+0000 7f9d1b59e700 1 -- 172.21.15.50:0/3171575907 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9d1c0b2660 msgr2=0x7f9d1c0cccf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:30.897 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:30.895+0000 7f9d1b59e700 1 --2- 172.21.15.50:0/3171575907 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9d1c0b2660 0x7f9d1c0cccf0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f9d0c0098d0 tx=0x7f9d0c009120 comp rx=0 tx=0).stop 2023-10-06T01:22:30.897 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:30.895+0000 7f9d1b59e700 1 -- 172.21.15.50:0/3171575907 shutdown_connections 2023-10-06T01:22:30.897 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:30.895+0000 7f9d1b59e700 1 --2- 172.21.15.50:0/3171575907 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9d1c0b2660 0x7f9d1c0cccf0 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:30.897 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:30.895+0000 7f9d1b59e700 1 -- 172.21.15.50:0/3171575907 >> 172.21.15.50:0/3171575907 conn(0x7f9d1c099560 msgr2=0x7f9d1c06f500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:22:30.897 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:30.895+0000 7f9d1b59e700 1 -- 172.21.15.50:0/3171575907 shutdown_connections 2023-10-06T01:22:30.897 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:30.895+0000 7f9d1b59e700 1 -- 172.21.15.50:0/3171575907 wait complete. 2023-10-06T01:22:30.898 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:30.897+0000 7f9d1b59e700 1 Processor -- start 2023-10-06T01:22:30.898 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:30.897+0000 7f9d1b59e700 1 -- start start 2023-10-06T01:22:30.900 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:30.898+0000 7f9d1b59e700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9d1c0b2660 0x7f9d1c16c810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:30.900 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:30.898+0000 7f9d1b59e700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9d1c0b2a30 0x7f9d1c0c98c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:30.900 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:30.898+0000 7f9d1b59e700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9d1c0cf1f0 0x7f9d1c068eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:30.900 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:30.898+0000 7f9d1b59e700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d1c0c7cb0 con 0x7f9d1c0cf1f0 2023-10-06T01:22:30.900 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:30.898+0000 7f9d1b59e700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d1c0c73c0 con 0x7f9d1c0b2660 2023-10-06T01:22:30.900 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:30.898+0000 7f9d1b59e700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d1c0ca230 con 0x7f9d1c0b2a30 2023-10-06T01:22:30.901 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:30.898+0000 7f9d1ad9d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9d1c0cf1f0 0x7f9d1c068eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:30.901 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:30.898+0000 7f9d1ad9d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9d1c0cf1f0 0x7f9d1c068eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:48718/0 (socket says 172.21.15.50:48718) 2023-10-06T01:22:30.901 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:30.898+0000 7f9d1ad9d700 1 -- 172.21.15.50:0/1210169529 learned_addr learned my addr 172.21.15.50:0/1210169529 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-06T01:22:30.901 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:30.898+0000 7f9d1a59c700 1 --2- 172.21.15.50:0/1210169529 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9d1c0b2660 0x7f9d1c16c810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:30.901 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:30.898+0000 7f9d19d9b700 1 --2- 172.21.15.50:0/1210169529 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9d1c0b2a30 0x7f9d1c0c98c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:30.901 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:30.898+0000 7f9d1ad9d700 1 -- 172.21.15.50:0/1210169529 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9d1c0b2a30 msgr2=0x7f9d1c0c98c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:30.901 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:30.898+0000 7f9d1ad9d700 1 --2- 172.21.15.50:0/1210169529 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9d1c0b2a30 0x7f9d1c0c98c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:30.901 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:30.898+0000 7f9d1ad9d700 1 -- 172.21.15.50:0/1210169529 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9d1c0b2660 msgr2=0x7f9d1c16c810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:30.901 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:30.898+0000 7f9d1ad9d700 1 --2- 172.21.15.50:0/1210169529 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9d1c0b2660 0x7f9d1c16c810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:30.901 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:30.898+0000 7f9d1ad9d700 1 -- 172.21.15.50:0/1210169529 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d0c0093c0 con 0x7f9d1c0cf1f0 2023-10-06T01:22:30.901 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:30.898+0000 7f9d19d9b700 1 --2- 172.21.15.50:0/1210169529 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9d1c0b2a30 0x7f9d1c0c98c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T01:22:30.901 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:30.898+0000 7f9d1a59c700 1 --2- 172.21.15.50:0/1210169529 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9d1c0b2660 0x7f9d1c16c810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T01:22:30.902 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:30.899+0000 7f9d1ad9d700 1 --2- 172.21.15.50:0/1210169529 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9d1c0cf1f0 0x7f9d1c068eb0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f9d1400c8e0 tx=0x7f9d14001710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:22:30.902 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:30.899+0000 7f9d0a7fc700 1 -- 172.21.15.50:0/1210169529 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d1400ce80 con 0x7f9d1c0cf1f0 2023-10-06T01:22:30.902 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:30.899+0000 7f9d0a7fc700 1 -- 172.21.15.50:0/1210169529 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d1400a7e0 con 0x7f9d1c0cf1f0 2023-10-06T01:22:30.902 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:30.899+0000 7f9d0a7fc700 1 -- 172.21.15.50:0/1210169529 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d1400ab80 con 0x7f9d1c0cf1f0 2023-10-06T01:22:30.902 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:30.899+0000 7f9d1b59e700 1 -- 172.21.15.50:0/1210169529 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9d1c0c7660 con 0x7f9d1c0cf1f0 2023-10-06T01:22:30.902 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:30.899+0000 7f9d1b59e700 1 -- 172.21.15.50:0/1210169529 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9d1c16cd50 con 0x7f9d1c0cf1f0 2023-10-06T01:22:30.905 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:30.900+0000 7f9d1b59e700 1 -- 172.21.15.50:0/1210169529 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9d1c0c7e20 con 0x7f9d1c0cf1f0 2023-10-06T01:22:30.906 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:30.901+0000 7f9d0a7fc700 1 -- 172.21.15.50:0/1210169529 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f9d14012420 con 0x7f9d1c0cf1f0 2023-10-06T01:22:30.906 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:30.902+0000 7f9d0a7fc700 1 --2- 172.21.15.50:0/1210169529 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f9cfc066f30 0x7f9cfc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:30.906 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:30.902+0000 7f9d0a7fc700 1 -- 172.21.15.50:0/1210169529 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6867+0+0 (secure 0 0 0) 0x7f9d14084d50 con 0x7f9d1c0cf1f0 2023-10-06T01:22:30.906 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:30.902+0000 7f9d1a59c700 1 --2- 172.21.15.50:0/1210169529 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f9cfc066f30 0x7f9cfc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:30.906 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:30.903+0000 7f9d1a59c700 1 --2- 172.21.15.50:0/1210169529 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f9cfc066f30 0x7f9cfc0693e0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f9d0c009fd0 tx=0x7f9d0c016000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:22:30.906 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:30.906+0000 7f9d0a7fc700 1 -- 172.21.15.50:0/1210169529 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f9d14051a90 con 0x7f9d1c0cf1f0 2023-10-06T01:22:31.110 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:31.108+0000 7f9d1b59e700 1 -- 172.21.15.50:0/1210169529 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f9d1c05f270 con 0x7f9d1c0cf1f0 2023-10-06T01:22:31.110 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:31.109+0000 7f9d0a7fc700 1 -- 172.21.15.50:0/1210169529 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v27) v1 ==== 92+0+10 (secure 0 0 0) 0x7f9d140550b0 con 0x7f9d1c0cf1f0 2023-10-06T01:22:31.110 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 8 2023-10-06T01:22:31.112 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:31.111+0000 7f9d1b59e700 1 -- 172.21.15.50:0/1210169529 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f9cfc066f30 msgr2=0x7f9cfc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:31.112 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:31.111+0000 7f9d1b59e700 1 --2- 172.21.15.50:0/1210169529 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f9cfc066f30 0x7f9cfc0693e0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f9d0c009fd0 tx=0x7f9d0c016000 comp rx=0 tx=0).stop 2023-10-06T01:22:31.113 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:31.111+0000 7f9d1b59e700 1 -- 172.21.15.50:0/1210169529 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9d1c0cf1f0 msgr2=0x7f9d1c068eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:31.113 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:31.111+0000 7f9d1b59e700 1 --2- 172.21.15.50:0/1210169529 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9d1c0cf1f0 0x7f9d1c068eb0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f9d1400c8e0 tx=0x7f9d14001710 comp rx=0 tx=0).stop 2023-10-06T01:22:31.113 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:31.111+0000 7f9d1b59e700 1 -- 172.21.15.50:0/1210169529 shutdown_connections 2023-10-06T01:22:31.113 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:31.111+0000 7f9d1b59e700 1 --2- 172.21.15.50:0/1210169529 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9d1c0cf1f0 0x7f9d1c068eb0 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:31.113 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:31.111+0000 7f9d1b59e700 1 --2- 172.21.15.50:0/1210169529 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f9cfc066f30 0x7f9cfc0693e0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:31.113 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:31.111+0000 7f9d1b59e700 1 --2- 172.21.15.50:0/1210169529 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9d1c0b2660 0x7f9d1c16c810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:31.113 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:31.111+0000 7f9d1b59e700 1 --2- 172.21.15.50:0/1210169529 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9d1c0b2a30 0x7f9d1c0c98c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:31.113 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:31.111+0000 7f9d1b59e700 1 -- 172.21.15.50:0/1210169529 >> 172.21.15.50:0/1210169529 conn(0x7f9d1c099560 msgr2=0x7f9d1c158cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:22:31.113 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:31.111+0000 7f9d1b59e700 1 -- 172.21.15.50:0/1210169529 shutdown_connections 2023-10-06T01:22:31.113 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:31.111+0000 7f9d1b59e700 1 -- 172.21.15.50:0/1210169529 wait complete. 2023-10-06T01:22:31.130 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-06T01:22:31.319 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:31.318+0000 7faeb759e700 1 Processor -- start 2023-10-06T01:22:31.319 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:31.318+0000 7faeb759e700 1 -- start start 2023-10-06T01:22:31.320 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:31.319+0000 7faeb759e700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7faeb8159580 0x7faeb80ace60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:31.320 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:31.319+0000 7faeb759e700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7faeb80c6060 0x7faeb80ce890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:31.320 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:31.319+0000 7faeb759e700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faeb80ae250 con 0x7faeb8159950 2023-10-06T01:22:31.321 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:31.319+0000 7faeb759e700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faeb80ad3a0 con 0x7faeb8159580 2023-10-06T01:22:31.321 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:31.319+0000 7faeb759e700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faeb80ad640 con 0x7faeb80c6060 2023-10-06T01:22:31.321 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:31.319+0000 7faeb659c700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7faeb8159580 0x7faeb80ace60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:31.321 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:31.320+0000 7faeb659c700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7faeb8159580 0x7faeb80ace60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:48728/0 (socket says 172.21.15.50:48728) 2023-10-06T01:22:31.321 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:31.320+0000 7faeb659c700 1 -- 172.21.15.50:0/2014712965 learned_addr learned my addr 172.21.15.50:0/2014712965 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-06T01:22:31.321 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:31.320+0000 7faeb6d9d700 1 --2- 172.21.15.50:0/2014712965 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7faeb80c6060 0x7faeb80ce890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:31.322 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:31.320+0000 7faeb659c700 1 -- 172.21.15.50:0/2014712965 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7faeb80c6060 msgr2=0x7faeb80ce890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:22:31.323 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:31.320+0000 7faeb659c700 1 --2- 172.21.15.50:0/2014712965 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7faeb80c6060 0x7faeb80ce890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:31.323 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:31.320+0000 7faeb659c700 1 -- 172.21.15.50:0/2014712965 >> v1:172.21.15.155:6789/0 conn(0x7faeb8159950 legacy=0x7faeb80ae6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:31.323 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:31.320+0000 7faeb659c700 1 -- 172.21.15.50:0/2014712965 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faeb80ad920 con 0x7faeb8159580 2023-10-06T01:22:31.323 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:31.320+0000 7faeb559a700 1 -- 172.21.15.50:0/2014712965 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3619966473 0 0) 0x7faeb80ae250 con 0x7faeb8159950 2023-10-06T01:22:31.323 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:31.320+0000 7faeb659c700 1 --2- 172.21.15.50:0/2014712965 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faeb8159580 0x7faeb80ace60 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7faea80099b0 tx=0x7faea8009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7da4d208a9211aba server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:22:31.323 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:31.321+0000 7faeb559a700 1 -- 172.21.15.50:0/2014712965 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faea8009ea0 con 0x7faeb8159580 2023-10-06T01:22:31.323 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:31.321+0000 7faeb559a700 1 -- 172.21.15.50:0/2014712965 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faea800b860 con 0x7faeb8159580 2023-10-06T01:22:31.323 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:31.321+0000 7faeb559a700 1 -- 172.21.15.50:0/2014712965 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faea800bc20 con 0x7faeb8159580 2023-10-06T01:22:31.323 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:31.321+0000 7faeb759e700 1 -- 172.21.15.50:0/2014712965 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faeb8159580 msgr2=0x7faeb80ace60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:31.323 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:31.321+0000 7faeb759e700 1 --2- 172.21.15.50:0/2014712965 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faeb8159580 0x7faeb80ace60 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7faea80099b0 tx=0x7faea8009250 comp rx=0 tx=0).stop 2023-10-06T01:22:31.323 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:31.321+0000 7faeb759e700 1 -- 172.21.15.50:0/2014712965 shutdown_connections 2023-10-06T01:22:31.323 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:31.321+0000 7faeb759e700 1 --2- 172.21.15.50:0/2014712965 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faeb8159580 0x7faeb80ace60 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:31.324 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:31.321+0000 7faeb759e700 1 --2- 172.21.15.50:0/2014712965 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7faeb80c6060 0x7faeb80ce890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:31.324 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:31.321+0000 7faeb759e700 1 -- 172.21.15.50:0/2014712965 >> 172.21.15.50:0/2014712965 conn(0x7faeb8099560 msgr2=0x7faeb806f500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:22:31.324 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:31.321+0000 7faeb759e700 1 -- 172.21.15.50:0/2014712965 shutdown_connections 2023-10-06T01:22:31.324 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:31.321+0000 7faeb759e700 1 -- 172.21.15.50:0/2014712965 wait complete. 2023-10-06T01:22:31.326 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:31.323+0000 7faeb759e700 1 Processor -- start 2023-10-06T01:22:31.326 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:31.323+0000 7faeb759e700 1 -- start start 2023-10-06T01:22:31.326 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:31.324+0000 7faeb759e700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faeb80c6060 0x7faeb80b44d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:31.327 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:31.324+0000 7faeb759e700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7faeb8159580 0x7faeb816cfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:31.327 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:31.324+0000 7faeb759e700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7faeb8159950 0x7faeb816d4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:31.327 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:31.324+0000 7faeb759e700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faeb80c7600 con 0x7faeb80c6060 2023-10-06T01:22:31.327 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:31.324+0000 7faeb759e700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faeb80b3430 con 0x7faeb8159950 2023-10-06T01:22:31.327 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:31.324+0000 7faeb759e700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faeb80b3710 con 0x7faeb8159580 2023-10-06T01:22:31.327 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:31.324+0000 7faeb659c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faeb80c6060 0x7faeb80b44d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:31.327 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:31.324+0000 7faeb659c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faeb80c6060 0x7faeb80b44d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:48738/0 (socket says 172.21.15.50:48738) 2023-10-06T01:22:31.327 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:31.324+0000 7faeb659c700 1 -- 172.21.15.50:0/3303098419 learned_addr learned my addr 172.21.15.50:0/3303098419 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-06T01:22:31.328 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:31.324+0000 7faeb5d9b700 1 --2- 172.21.15.50:0/3303098419 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7faeb8159580 0x7faeb816cfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:31.328 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:31.324+0000 7faeb6d9d700 1 --2- 172.21.15.50:0/3303098419 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7faeb8159950 0x7faeb816d4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:31.328 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:31.324+0000 7faeb659c700 1 -- 172.21.15.50:0/3303098419 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7faeb8159580 msgr2=0x7faeb816cfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:31.328 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:31.324+0000 7faeb659c700 1 --2- 172.21.15.50:0/3303098419 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7faeb8159580 0x7faeb816cfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:31.328 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:31.324+0000 7faeb659c700 1 -- 172.21.15.50:0/3303098419 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7faeb8159950 msgr2=0x7faeb816d4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:31.328 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:31.324+0000 7faeb659c700 1 --2- 172.21.15.50:0/3303098419 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7faeb8159950 0x7faeb816d4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:31.328 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:31.324+0000 7faeb659c700 1 -- 172.21.15.50:0/3303098419 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faea80094f0 con 0x7faeb80c6060 2023-10-06T01:22:31.328 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:31.324+0000 7faeb5d9b700 1 --2- 172.21.15.50:0/3303098419 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7faeb8159580 0x7faeb816cfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T01:22:31.329 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:31.324+0000 7faeb6d9d700 1 --2- 172.21.15.50:0/3303098419 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7faeb8159950 0x7faeb816d4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T01:22:31.329 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:31.325+0000 7faeb659c700 1 --2- 172.21.15.50:0/3303098419 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faeb80c6060 0x7faeb80b44d0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7faeb8067e90 tx=0x7faea8017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:22:31.329 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:31.325+0000 7faea67fc700 1 -- 172.21.15.50:0/3303098419 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faea801f070 con 0x7faeb80c6060 2023-10-06T01:22:31.329 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:31.325+0000 7faea67fc700 1 -- 172.21.15.50:0/3303098419 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faea8000bc0 con 0x7faeb80c6060 2023-10-06T01:22:31.329 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:31.325+0000 7faea67fc700 1 -- 172.21.15.50:0/3303098419 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faea800bc00 con 0x7faeb80c6060 2023-10-06T01:22:31.329 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:31.325+0000 7faeb759e700 1 -- 172.21.15.50:0/3303098419 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faeb80b39f0 con 0x7faeb80c6060 2023-10-06T01:22:31.329 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:31.325+0000 7faeb759e700 1 -- 172.21.15.50:0/3303098419 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faeb80b3fb0 con 0x7faeb80c6060 2023-10-06T01:22:31.331 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:31.326+0000 7faeb759e700 1 -- 172.21.15.50:0/3303098419 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faeb80b4a10 con 0x7faeb80c6060 2023-10-06T01:22:31.331 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:31.327+0000 7faea67fc700 1 -- 172.21.15.50:0/3303098419 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7faea8023070 con 0x7faeb80c6060 2023-10-06T01:22:31.331 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:31.328+0000 7faea67fc700 1 --2- 172.21.15.50:0/3303098419 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7fae98066f30 0x7fae980693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:31.331 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:31.328+0000 7faea67fc700 1 -- 172.21.15.50:0/3303098419 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6867+0+0 (secure 0 0 0) 0x7faea8085c50 con 0x7faeb80c6060 2023-10-06T01:22:31.331 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:31.329+0000 7faeb5d9b700 1 --2- 172.21.15.50:0/3303098419 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7fae98066f30 0x7fae980693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:31.331 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:31.329+0000 7faeb5d9b700 1 --2- 172.21.15.50:0/3303098419 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7fae98066f30 0x7fae980693e0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7faeb81581d0 tx=0x7faeac009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:22:31.333 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:31.332+0000 7faea67fc700 1 -- 172.21.15.50:0/3303098419 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7faea8052a40 con 0x7faeb80c6060 2023-10-06T01:22:31.535 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:31.534+0000 7faeb759e700 1 -- 172.21.15.50:0/3303098419 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7faeb80b41f0 con 0x7faeb80c6060 2023-10-06T01:22:31.536 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:31.535+0000 7faea67fc700 1 -- 172.21.15.50:0/3303098419 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v27) v1 ==== 93+0+10 (secure 0 0 0) 0x7faea8015020 con 0x7faeb80c6060 2023-10-06T01:22:31.536 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 1 2023-10-06T01:22:31.538 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:31.537+0000 7faeb759e700 1 -- 172.21.15.50:0/3303098419 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7fae98066f30 msgr2=0x7fae980693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:31.538 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:31.537+0000 7faeb759e700 1 --2- 172.21.15.50:0/3303098419 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7fae98066f30 0x7fae980693e0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7faeb81581d0 tx=0x7faeac009040 comp rx=0 tx=0).stop 2023-10-06T01:22:31.539 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:31.537+0000 7faeb759e700 1 -- 172.21.15.50:0/3303098419 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faeb80c6060 msgr2=0x7faeb80b44d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:31.539 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:31.537+0000 7faeb759e700 1 --2- 172.21.15.50:0/3303098419 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faeb80c6060 0x7faeb80b44d0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7faeb8067e90 tx=0x7faea8017000 comp rx=0 tx=0).stop 2023-10-06T01:22:31.539 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:31.537+0000 7faeb759e700 1 -- 172.21.15.50:0/3303098419 shutdown_connections 2023-10-06T01:22:31.539 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:31.537+0000 7faeb759e700 1 --2- 172.21.15.50:0/3303098419 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7fae98066f30 0x7fae980693e0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:31.539 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:31.537+0000 7faeb759e700 1 --2- 172.21.15.50:0/3303098419 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7faeb8159950 0x7faeb816d4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:31.539 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:31.537+0000 7faeb759e700 1 --2- 172.21.15.50:0/3303098419 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faeb80c6060 0x7faeb80b44d0 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:31.539 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:31.537+0000 7faeb759e700 1 --2- 172.21.15.50:0/3303098419 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7faeb8159580 0x7faeb816cfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:31.540 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:31.537+0000 7faeb759e700 1 -- 172.21.15.50:0/3303098419 >> 172.21.15.50:0/3303098419 conn(0x7faeb8099560 msgr2=0x7faeb8068150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:22:31.540 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:31.537+0000 7faeb759e700 1 -- 172.21.15.50:0/3303098419 shutdown_connections 2023-10-06T01:22:31.540 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:31.537+0000 7faeb759e700 1 -- 172.21.15.50:0/3303098419 wait complete. 2023-10-06T01:22:31.556 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-06T01:22:31.745 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:31.744+0000 7f9a0679d700 1 Processor -- start 2023-10-06T01:22:31.745 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:31.744+0000 7f9a0679d700 1 -- start start 2023-10-06T01:22:31.746 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:31.745+0000 7f9a0679d700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f9a00159ca0 0x7f9a000c8a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:31.747 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:31.745+0000 7f9a0679d700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9a000acb10 con 0x7f9a000c8f70 2023-10-06T01:22:31.747 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:31.745+0000 7f9a0679d700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9a00156500 con 0x7f9a00156130 2023-10-06T01:22:31.747 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:31.745+0000 7f9a0679d700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9a0015a120 con 0x7f9a00159ca0 2023-10-06T01:22:31.747 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:31.746+0000 7f9a04f9a700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f9a00159ca0 0x7f9a000c8a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:31.747 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:31.746+0000 7f9a04f9a700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f9a00159ca0 0x7f9a000c8a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:48740/0 (socket says 172.21.15.50:48740) 2023-10-06T01:22:31.747 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:31.746+0000 7f9a04f9a700 1 -- 172.21.15.50:0/527297118 learned_addr learned my addr 172.21.15.50:0/527297118 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-06T01:22:31.747 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:31.746+0000 7f9a05f9c700 1 --1- 172.21.15.50:0/527297118 >> v1:172.21.15.50:6789/0 conn(0x7f9a000c8f70 0x7f9a0006e1a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:54466/0 (socket says 172.21.15.50:54466) 2023-10-06T01:22:31.749 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:31.746+0000 7f9a04f9a700 1 -- 172.21.15.50:0/527297118 >> v1:172.21.15.155:6789/0 conn(0x7f9a00156130 legacy=0x7f9a000ae0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:22:31.749 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:31.746+0000 7f9a04f9a700 1 -- 172.21.15.50:0/527297118 >> v1:172.21.15.50:6789/0 conn(0x7f9a000c8f70 legacy=0x7f9a0006e1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:31.749 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:31.746+0000 7f9a04f9a700 1 -- 172.21.15.50:0/527297118 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a0015a310 con 0x7f9a00159ca0 2023-10-06T01:22:31.749 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:31.746+0000 7f99f7fff700 1 -- 172.21.15.50:0/527297118 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4121988425 0 0) 0x7f9a000acb10 con 0x7f9a000c8f70 2023-10-06T01:22:31.749 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:31.747+0000 7f9a04f9a700 1 --2- 172.21.15.50:0/527297118 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9a00159ca0 0x7f9a000c8a30 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f99f00099b0 tx=0x7f99f0009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c36536b14641bb14 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:22:31.750 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:31.747+0000 7f99f7fff700 1 -- 172.21.15.50:0/527297118 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99f000b8b0 con 0x7f9a00159ca0 2023-10-06T01:22:31.750 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:31.747+0000 7f99f7fff700 1 -- 172.21.15.50:0/527297118 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99f000ba10 con 0x7f9a00159ca0 2023-10-06T01:22:31.750 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:31.747+0000 7f99f7fff700 1 -- 172.21.15.50:0/527297118 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99f000bdb0 con 0x7f9a00159ca0 2023-10-06T01:22:31.750 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:31.747+0000 7f9a0679d700 1 -- 172.21.15.50:0/527297118 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9a00159ca0 msgr2=0x7f9a000c8a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:31.750 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:31.747+0000 7f9a0679d700 1 --2- 172.21.15.50:0/527297118 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9a00159ca0 0x7f9a000c8a30 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f99f00099b0 tx=0x7f99f0009250 comp rx=0 tx=0).stop 2023-10-06T01:22:31.750 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:31.747+0000 7f9a0679d700 1 -- 172.21.15.50:0/527297118 shutdown_connections 2023-10-06T01:22:31.750 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:31.747+0000 7f9a0679d700 1 --2- 172.21.15.50:0/527297118 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9a00159ca0 0x7f9a000c8a30 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:31.751 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:31.747+0000 7f9a0679d700 1 -- 172.21.15.50:0/527297118 >> 172.21.15.50:0/527297118 conn(0x7f9a000cbf10 msgr2=0x7f9a000cc310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:22:31.751 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:31.747+0000 7f9a0679d700 1 -- 172.21.15.50:0/527297118 shutdown_connections 2023-10-06T01:22:31.751 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:31.748+0000 7f9a0679d700 1 -- 172.21.15.50:0/527297118 wait complete. 2023-10-06T01:22:31.752 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:31.749+0000 7f9a0679d700 1 Processor -- start 2023-10-06T01:22:31.752 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:31.749+0000 7f9a0679d700 1 -- start start 2023-10-06T01:22:31.753 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:31.750+0000 7f9a0679d700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9a000c8f70 0x7f9a00157ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:31.753 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:31.750+0000 7f9a0679d700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9a00156130 0x7f9a00157500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:31.753 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:31.750+0000 7f9a0679d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9a00159ca0 0x7f9a00154f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:31.753 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:31.750+0000 7f9a0679d700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a00159120 con 0x7f9a00159ca0 2023-10-06T01:22:31.753 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:31.750+0000 7f9a0679d700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a00157a40 con 0x7f9a000c8f70 2023-10-06T01:22:31.753 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:31.750+0000 7f9a0679d700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a00158510 con 0x7f9a00156130 2023-10-06T01:22:31.753 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:31.750+0000 7f9a05f9c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9a00159ca0 0x7f9a00154f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:31.753 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:31.750+0000 7f9a05f9c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9a00159ca0 0x7f9a00154f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:48752/0 (socket says 172.21.15.50:48752) 2023-10-06T01:22:31.754 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:31.750+0000 7f9a05f9c700 1 -- 172.21.15.50:0/4259098171 learned_addr learned my addr 172.21.15.50:0/4259098171 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-06T01:22:31.754 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:31.751+0000 7f9a05f9c700 1 -- 172.21.15.50:0/4259098171 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9a00156130 msgr2=0x7f9a00157500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:31.754 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:31.751+0000 7f9a05f9c700 1 --2- 172.21.15.50:0/4259098171 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9a00156130 0x7f9a00157500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:31.754 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:31.751+0000 7f9a05f9c700 1 -- 172.21.15.50:0/4259098171 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9a000c8f70 msgr2=0x7f9a00157ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:31.754 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:31.751+0000 7f9a05f9c700 1 --2- 172.21.15.50:0/4259098171 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9a000c8f70 0x7f9a00157ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:31.754 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:31.751+0000 7f9a05f9c700 1 -- 172.21.15.50:0/4259098171 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99f00094f0 con 0x7f9a00159ca0 2023-10-06T01:22:31.754 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:31.751+0000 7f9a05f9c700 1 --2- 172.21.15.50:0/4259098171 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9a00159ca0 0x7f9a00154f00 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f99f800cd80 tx=0x7f99f8001ae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:22:31.755 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:31.751+0000 7f99f57fa700 1 -- 172.21.15.50:0/4259098171 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99f8005df0 con 0x7f9a00159ca0 2023-10-06T01:22:31.755 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:31.751+0000 7f99f57fa700 1 -- 172.21.15.50:0/4259098171 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99f800a900 con 0x7f9a00159ca0 2023-10-06T01:22:31.755 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:31.751+0000 7f9a0679d700 1 -- 172.21.15.50:0/4259098171 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9a001587f0 con 0x7f9a00159ca0 2023-10-06T01:22:31.755 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:31.751+0000 7f99f57fa700 1 -- 172.21.15.50:0/4259098171 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99f800acc0 con 0x7f9a00159ca0 2023-10-06T01:22:31.755 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:31.751+0000 7f9a0679d700 1 -- 172.21.15.50:0/4259098171 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9a00158e30 con 0x7f9a00159ca0 2023-10-06T01:22:31.756 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:31.752+0000 7f9a0679d700 1 -- 172.21.15.50:0/4259098171 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9a00153480 con 0x7f9a00159ca0 2023-10-06T01:22:31.756 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:31.753+0000 7f99f57fa700 1 -- 172.21.15.50:0/4259098171 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f99f8007300 con 0x7f9a00159ca0 2023-10-06T01:22:31.756 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:31.754+0000 7f99f57fa700 1 --2- 172.21.15.50:0/4259098171 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f99e4066f30 0x7f99e40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:31.756 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:31.754+0000 7f99f57fa700 1 -- 172.21.15.50:0/4259098171 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6867+0+0 (secure 0 0 0) 0x7f99f8084c10 con 0x7f9a00159ca0 2023-10-06T01:22:31.757 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:31.754+0000 7f9a0579b700 1 --2- 172.21.15.50:0/4259098171 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f99e4066f30 0x7f99e40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:31.757 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:31.755+0000 7f9a0579b700 1 --2- 172.21.15.50:0/4259098171 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f99e4066f30 0x7f99e40693e0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f99fc007fd0 tx=0x7f99fc007b20 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:22:31.759 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:31.758+0000 7f99f57fa700 1 -- 172.21.15.50:0/4259098171 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f99f80519d0 con 0x7f9a00159ca0 2023-10-06T01:22:31.962 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:31.961+0000 7f9a0679d700 1 -- 172.21.15.50:0/4259098171 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f9a0005f270 con 0x7f9a00159ca0 2023-10-06T01:22:31.962 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:31.962+0000 7f99f57fa700 1 -- 172.21.15.50:0/4259098171 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v27) v1 ==== 104+0+11 (secure 0 0 0) 0x7f99f8054ff0 con 0x7f9a00159ca0 2023-10-06T01:22:31.963 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 32 2023-10-06T01:22:31.965 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:31.964+0000 7f9a0679d700 1 -- 172.21.15.50:0/4259098171 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f99e4066f30 msgr2=0x7f99e40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:31.965 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:31.964+0000 7f9a0679d700 1 --2- 172.21.15.50:0/4259098171 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f99e4066f30 0x7f99e40693e0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f99fc007fd0 tx=0x7f99fc007b20 comp rx=0 tx=0).stop 2023-10-06T01:22:31.965 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:31.964+0000 7f9a0679d700 1 -- 172.21.15.50:0/4259098171 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9a00159ca0 msgr2=0x7f9a00154f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:31.965 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:31.964+0000 7f9a0679d700 1 --2- 172.21.15.50:0/4259098171 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9a00159ca0 0x7f9a00154f00 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f99f800cd80 tx=0x7f99f8001ae0 comp rx=0 tx=0).stop 2023-10-06T01:22:31.965 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:31.964+0000 7f9a0679d700 1 -- 172.21.15.50:0/4259098171 shutdown_connections 2023-10-06T01:22:31.965 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:31.964+0000 7f9a0679d700 1 --2- 172.21.15.50:0/4259098171 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9a00159ca0 0x7f9a00154f00 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:31.966 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:31.964+0000 7f9a0679d700 1 --2- 172.21.15.50:0/4259098171 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f99e4066f30 0x7f99e40693e0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:31.966 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:31.964+0000 7f9a0679d700 1 --2- 172.21.15.50:0/4259098171 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9a000c8f70 0x7f9a00157ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:31.966 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:31.964+0000 7f9a0679d700 1 --2- 172.21.15.50:0/4259098171 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9a00156130 0x7f9a00157500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:31.966 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:31.964+0000 7f9a0679d700 1 -- 172.21.15.50:0/4259098171 >> 172.21.15.50:0/4259098171 conn(0x7f9a000cbf10 msgr2=0x7f9a000b0460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:22:31.966 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:31.964+0000 7f9a0679d700 1 -- 172.21.15.50:0/4259098171 shutdown_connections 2023-10-06T01:22:31.966 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:31.964+0000 7f9a0679d700 1 -- 172.21.15.50:0/4259098171 wait complete. 2023-10-06T01:22:31.982 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-06T01:22:32.172 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:32.171+0000 7fa58cd9d700 1 Processor -- start 2023-10-06T01:22:32.172 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:32.171+0000 7fa58cd9d700 1 -- start start 2023-10-06T01:22:32.173 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:32.173+0000 7fa58cd9d700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fa5880b2660 0x7fa5880cccf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:32.174 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:32.173+0000 7fa58cd9d700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fa5880cf1f0 0x7fa5880cd230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:32.174 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:32.173+0000 7fa58cd9d700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa5880cc9b0 con 0x7fa5880b2a30 2023-10-06T01:22:32.174 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:32.173+0000 7fa58cd9d700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa5880cbda0 con 0x7fa5880b2660 2023-10-06T01:22:32.174 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:32.173+0000 7fa58cd9d700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa5880cc080 con 0x7fa5880cf1f0 2023-10-06T01:22:32.174 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:32.173+0000 7fa5877fe700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fa5880b2660 0x7fa5880cccf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:32.174 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:32.173+0000 7fa5877fe700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fa5880b2660 0x7fa5880cccf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:48758/0 (socket says 172.21.15.50:48758) 2023-10-06T01:22:32.175 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:32.173+0000 7fa5877fe700 1 -- 172.21.15.50:0/347076818 learned_addr learned my addr 172.21.15.50:0/347076818 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-06T01:22:32.176 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:32.173+0000 7fa5877fe700 1 -- 172.21.15.50:0/347076818 >> v2:172.21.15.155:3300/0 conn(0x7fa5880cf1f0 msgr2=0x7fa5880cd230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:22:32.176 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:32.173+0000 7fa5877fe700 1 --2- 172.21.15.50:0/347076818 >> v2:172.21.15.155:3300/0 conn(0x7fa5880cf1f0 0x7fa5880cd230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:32.176 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:32.173+0000 7fa5877fe700 1 -- 172.21.15.50:0/347076818 >> v1:172.21.15.155:6789/0 conn(0x7fa5880b2a30 legacy=0x7fa5880ceae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:22:32.176 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:32.173+0000 7fa5877fe700 1 -- 172.21.15.50:0/347076818 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5880cc360 con 0x7fa5880b2660 2023-10-06T01:22:32.177 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:32.174+0000 7fa5877fe700 1 --2- 172.21.15.50:0/347076818 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa5880b2660 0x7fa5880cccf0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fa5880894b0 tx=0x7fa578009220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e2f40177774c4dfa server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:22:32.177 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:32.174+0000 7fa5867fc700 1 -- 172.21.15.50:0/347076818 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa578005c10 con 0x7fa5880b2660 2023-10-06T01:22:32.177 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:32.174+0000 7fa5867fc700 1 -- 172.21.15.50:0/347076818 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa578005d70 con 0x7fa5880b2660 2023-10-06T01:22:32.177 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:32.174+0000 7fa5867fc700 1 -- 172.21.15.50:0/347076818 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa57800b840 con 0x7fa5880b2660 2023-10-06T01:22:32.177 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:32.174+0000 7fa58cd9d700 1 -- 172.21.15.50:0/347076818 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa5880b2660 msgr2=0x7fa5880cccf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:32.177 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:32.174+0000 7fa58cd9d700 1 --2- 172.21.15.50:0/347076818 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa5880b2660 0x7fa5880cccf0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fa5880894b0 tx=0x7fa578009220 comp rx=0 tx=0).stop 2023-10-06T01:22:32.177 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:32.175+0000 7fa58cd9d700 1 -- 172.21.15.50:0/347076818 shutdown_connections 2023-10-06T01:22:32.177 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:32.175+0000 7fa58cd9d700 1 --2- 172.21.15.50:0/347076818 >> v2:172.21.15.155:3300/0 conn(0x7fa5880cf1f0 0x7fa5880cd230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:32.177 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:32.175+0000 7fa58cd9d700 1 --2- 172.21.15.50:0/347076818 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa5880b2660 0x7fa5880cccf0 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:32.178 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:32.175+0000 7fa58cd9d700 1 -- 172.21.15.50:0/347076818 >> 172.21.15.50:0/347076818 conn(0x7fa588099560 msgr2=0x7fa58806f500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:22:32.178 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:32.175+0000 7fa58cd9d700 1 -- 172.21.15.50:0/347076818 shutdown_connections 2023-10-06T01:22:32.178 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:32.175+0000 7fa58cd9d700 1 -- 172.21.15.50:0/347076818 wait complete. 2023-10-06T01:22:32.180 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:32.176+0000 7fa58cd9d700 1 Processor -- start 2023-10-06T01:22:32.180 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:32.176+0000 7fa58cd9d700 1 -- start start 2023-10-06T01:22:32.180 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:32.177+0000 7fa58cd9d700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa5880b2660 0x7fa588159dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:32.180 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:32.177+0000 7fa58cd9d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa5880b2a30 0x7fa58815c200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:32.180 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:32.177+0000 7fa58cd9d700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa5880cf1f0 0x7fa588155ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:32.180 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:32.177+0000 7fa58cd9d700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa58815cf60 con 0x7fa5880b2a30 2023-10-06T01:22:32.181 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:32.177+0000 7fa58cd9d700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5880b44b0 con 0x7fa5880cf1f0 2023-10-06T01:22:32.181 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:32.177+0000 7fa58cd9d700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa58815c740 con 0x7fa5880b2660 2023-10-06T01:22:32.181 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:32.177+0000 7fa586ffd700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa5880b2a30 0x7fa58815c200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:32.181 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:32.177+0000 7fa586ffd700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa5880b2a30 0x7fa58815c200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:48772/0 (socket says 172.21.15.50:48772) 2023-10-06T01:22:32.181 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:32.177+0000 7fa586ffd700 1 -- 172.21.15.50:0/291438417 learned_addr learned my addr 172.21.15.50:0/291438417 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-06T01:22:32.181 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:32.178+0000 7fa5877fe700 1 --2- 172.21.15.50:0/291438417 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa5880b2660 0x7fa588159dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:32.182 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:32.178+0000 7fa587fff700 1 --2- 172.21.15.50:0/291438417 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa5880cf1f0 0x7fa588155ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:32.182 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:32.178+0000 7fa586ffd700 1 -- 172.21.15.50:0/291438417 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa5880b2660 msgr2=0x7fa588159dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:32.182 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:32.178+0000 7fa586ffd700 1 --2- 172.21.15.50:0/291438417 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa5880b2660 0x7fa588159dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:32.182 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:32.178+0000 7fa586ffd700 1 -- 172.21.15.50:0/291438417 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa5880cf1f0 msgr2=0x7fa588155ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:32.182 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:32.178+0000 7fa586ffd700 1 --2- 172.21.15.50:0/291438417 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa5880cf1f0 0x7fa588155ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:32.183 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:32.178+0000 7fa586ffd700 1 -- 172.21.15.50:0/291438417 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa578009480 con 0x7fa5880b2a30 2023-10-06T01:22:32.183 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:32.178+0000 7fa586ffd700 1 --2- 172.21.15.50:0/291438417 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa5880b2a30 0x7fa58815c200 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fa57c00b810 tx=0x7fa57c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:22:32.183 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:32.178+0000 7fa56f7fe700 1 -- 172.21.15.50:0/291438417 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa57c00f510 con 0x7fa5880b2a30 2023-10-06T01:22:32.183 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:32.178+0000 7fa56f7fe700 1 -- 172.21.15.50:0/291438417 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa57c00f670 con 0x7fa5880b2a30 2023-10-06T01:22:32.183 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:32.178+0000 7fa56f7fe700 1 -- 172.21.15.50:0/291438417 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa57c00fa10 con 0x7fa5880b2a30 2023-10-06T01:22:32.184 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:32.178+0000 7fa58cd9d700 1 -- 172.21.15.50:0/291438417 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa58816aa10 con 0x7fa5880b2a30 2023-10-06T01:22:32.184 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:32.179+0000 7fa58cd9d700 1 -- 172.21.15.50:0/291438417 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa58815cc80 con 0x7fa5880b2a30 2023-10-06T01:22:32.184 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:32.179+0000 7fa58cd9d700 1 -- 172.21.15.50:0/291438417 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa5880b4640 con 0x7fa5880b2a30 2023-10-06T01:22:32.184 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:32.180+0000 7fa56f7fe700 1 -- 172.21.15.50:0/291438417 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fa57c01a400 con 0x7fa5880b2a30 2023-10-06T01:22:32.185 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:32.181+0000 7fa56f7fe700 1 --2- 172.21.15.50:0/291438417 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7fa574066f30 0x7fa5740693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:32.185 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:32.181+0000 7fa56f7fe700 1 -- 172.21.15.50:0/291438417 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6867+0+0 (secure 0 0 0) 0x7fa57c084530 con 0x7fa5880b2a30 2023-10-06T01:22:32.185 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:32.182+0000 7fa5877fe700 1 --2- 172.21.15.50:0/291438417 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7fa574066f30 0x7fa5740693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:32.185 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:32.182+0000 7fa5877fe700 1 --2- 172.21.15.50:0/291438417 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7fa574066f30 0x7fa5740693e0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fa578003080 tx=0x7fa578015000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:22:32.186 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:32.185+0000 7fa56f7fe700 1 -- 172.21.15.50:0/291438417 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fa57c0512f0 con 0x7fa5880b2a30 2023-10-06T01:22:32.388 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:32.387+0000 7fa58cd9d700 1 -- 172.21.15.50:0/291438417 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fa58805f2a0 con 0x7fa5880b2a30 2023-10-06T01:22:32.388 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:32.388+0000 7fa56f7fe700 1 -- 172.21.15.50:0/291438417 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v27) v1 ==== 100+0+11 (secure 0 0 0) 0x7fa57c054910 con 0x7fa5880b2a30 2023-10-06T01:22:32.389 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 64 2023-10-06T01:22:32.391 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:32.390+0000 7fa58cd9d700 1 -- 172.21.15.50:0/291438417 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7fa574066f30 msgr2=0x7fa5740693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:32.391 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:32.390+0000 7fa58cd9d700 1 --2- 172.21.15.50:0/291438417 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7fa574066f30 0x7fa5740693e0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fa578003080 tx=0x7fa578015000 comp rx=0 tx=0).stop 2023-10-06T01:22:32.391 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:32.390+0000 7fa58cd9d700 1 -- 172.21.15.50:0/291438417 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa5880b2a30 msgr2=0x7fa58815c200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:32.391 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:32.390+0000 7fa58cd9d700 1 --2- 172.21.15.50:0/291438417 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa5880b2a30 0x7fa58815c200 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fa57c00b810 tx=0x7fa57c0091a0 comp rx=0 tx=0).stop 2023-10-06T01:22:32.391 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:32.390+0000 7fa58cd9d700 1 -- 172.21.15.50:0/291438417 shutdown_connections 2023-10-06T01:22:32.392 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:32.390+0000 7fa58cd9d700 1 --2- 172.21.15.50:0/291438417 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7fa574066f30 0x7fa5740693e0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:32.392 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:32.390+0000 7fa58cd9d700 1 --2- 172.21.15.50:0/291438417 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa5880cf1f0 0x7fa588155ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:32.392 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:32.390+0000 7fa58cd9d700 1 --2- 172.21.15.50:0/291438417 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa5880b2660 0x7fa588159dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:32.392 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:32.390+0000 7fa58cd9d700 1 --2- 172.21.15.50:0/291438417 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa5880b2a30 0x7fa58815c200 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:32.392 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:32.390+0000 7fa58cd9d700 1 -- 172.21.15.50:0/291438417 >> 172.21.15.50:0/291438417 conn(0x7fa588099560 msgr2=0x7fa588158dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:22:32.392 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:32.390+0000 7fa58cd9d700 1 -- 172.21.15.50:0/291438417 shutdown_connections 2023-10-06T01:22:32.392 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:32.390+0000 7fa58cd9d700 1 -- 172.21.15.50:0/291438417 wait complete. 2023-10-06T01:22:32.408 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-10-06T01:22:32.598 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:32.597+0000 7f7894b9d700 1 Processor -- start 2023-10-06T01:22:32.598 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:32.597+0000 7f7894b9d700 1 -- start start 2023-10-06T01:22:32.599 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:32.598+0000 7f7894b9d700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f789006e1a0 0x7f789006e5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:32.599 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:32.598+0000 7f7894b9d700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f78900acb10 con 0x7f7890156130 2023-10-06T01:22:32.600 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:32.599+0000 7f7894b9d700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f789006eb00 con 0x7f7890159ca0 2023-10-06T01:22:32.600 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:32.599+0000 7f7894b9d700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f789015a120 con 0x7f789006e1a0 2023-10-06T01:22:32.600 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:32.599+0000 7f788f7fe700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f7890156130 0x7f78900ae0f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:54474/0 (socket says 172.21.15.50:54474) 2023-10-06T01:22:32.600 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:32.599+0000 7f788f7fe700 1 -- 172.21.15.50:0/3285002203 learned_addr learned my addr 172.21.15.50:0/3285002203 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-10-06T01:22:32.602 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:32.599+0000 7f788ffff700 1 --2- 172.21.15.50:0/3285002203 >> v2:172.21.15.155:3300/0 conn(0x7f789006e1a0 0x7f789006e5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:32.602 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:32.599+0000 7f788e7fc700 1 -- 172.21.15.50:0/3285002203 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1229147401 0 0) 0x7f78900acb10 con 0x7f7890156130 2023-10-06T01:22:32.603 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:32.599+0000 7f788e7fc700 1 -- 172.21.15.50:0/3285002203 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7878003570 con 0x7f7890156130 2023-10-06T01:22:32.603 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:32.599+0000 7f788e7fc700 1 -- 172.21.15.50:0/3285002203 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1899905590 0 0) 0x7f789006eb00 con 0x7f7890159ca0 2023-10-06T01:22:32.603 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:32.599+0000 7f788e7fc700 1 -- 172.21.15.50:0/3285002203 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f78900acb10 con 0x7f7890159ca0 2023-10-06T01:22:32.603 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:32.599+0000 7f788e7fc700 1 -- 172.21.15.50:0/3285002203 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 506440761 0 0) 0x7f7878003570 con 0x7f7890156130 2023-10-06T01:22:32.603 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:32.599+0000 7f788e7fc700 1 -- 172.21.15.50:0/3285002203 >> v2:172.21.15.155:3300/0 conn(0x7f789006e1a0 msgr2=0x7f789006e5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:22:32.603 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:32.599+0000 7f788e7fc700 1 --2- 172.21.15.50:0/3285002203 >> v2:172.21.15.155:3300/0 conn(0x7f789006e1a0 0x7f789006e5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:32.603 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:32.599+0000 7f788e7fc700 1 -- 172.21.15.50:0/3285002203 >> v1:172.21.15.155:6789/0 conn(0x7f7890159ca0 legacy=0x7f78900c8a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:32.603 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:32.599+0000 7f788e7fc700 1 -- 172.21.15.50:0/3285002203 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7890156500 con 0x7f7890156130 2023-10-06T01:22:32.603 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:32.599+0000 7f788e7fc700 1 -- 172.21.15.50:0/3285002203 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 347519148 0 0) 0x7f7880001470 con 0x7f7890156130 2023-10-06T01:22:32.603 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:32.600+0000 7f788e7fc700 1 -- 172.21.15.50:0/3285002203 >> v1:172.21.15.50:6789/0 conn(0x7f7890156130 legacy=0x7f78900ae0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:32.603 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:32.600+0000 7f788e7fc700 1 --2- 172.21.15.50:0/3285002203 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7878003c40 0x7f7878004030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:32.604 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:32.600+0000 7f788e7fc700 1 --2- 172.21.15.50:0/3285002203 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7878004810 0x7f7878004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:32.604 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:32.600+0000 7f788e7fc700 1 --2- 172.21.15.50:0/3285002203 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7878005210 0x7f787800ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:32.604 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:32.600+0000 7f788e7fc700 1 -- 172.21.15.50:0/3285002203 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f787800c130 con 0x7f7878004810 2023-10-06T01:22:32.604 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:32.600+0000 7f788e7fc700 1 -- 172.21.15.50:0/3285002203 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f787800c270 con 0x7f7878003c40 2023-10-06T01:22:32.604 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:32.600+0000 7f788e7fc700 1 -- 172.21.15.50:0/3285002203 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f787800c400 con 0x7f7878005210 2023-10-06T01:22:32.604 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:32.600+0000 7f788effd700 1 --2- 172.21.15.50:0/3285002203 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7878004810 0x7f7878004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:32.604 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:32.600+0000 7f788ffff700 1 --2- 172.21.15.50:0/3285002203 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7878005210 0x7f787800ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:32.604 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:32.600+0000 7f788f7fe700 1 --2- 172.21.15.50:0/3285002203 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7878003c40 0x7f7878004030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:32.604 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:32.600+0000 7f788effd700 1 -- 172.21.15.50:0/3285002203 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7878005210 msgr2=0x7f787800ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:22:32.604 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:32.600+0000 7f788effd700 1 --2- 172.21.15.50:0/3285002203 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7878005210 0x7f787800ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:32.604 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:32.600+0000 7f788effd700 1 -- 172.21.15.50:0/3285002203 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7878003c40 msgr2=0x7f7878004030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:22:32.604 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:32.600+0000 7f788effd700 1 --2- 172.21.15.50:0/3285002203 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7878003c40 0x7f7878004030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:32.605 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:32.600+0000 7f788effd700 1 -- 172.21.15.50:0/3285002203 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7878003570 con 0x7f7878004810 2023-10-06T01:22:32.605 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:32.600+0000 7f788ffff700 1 -- 172.21.15.50:0/3285002203 reap_dead start 2023-10-06T01:22:32.605 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:32.600+0000 7f788f7fe700 1 --2- 172.21.15.50:0/3285002203 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7878003c40 0x7f7878004030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T01:22:32.605 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:32.601+0000 7f788effd700 1 --2- 172.21.15.50:0/3285002203 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7878004810 0x7f7878004c80 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f7884001500 tx=0x7f7884007d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9928de0faf74c946 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:22:32.605 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:32.601+0000 7f788e7fc700 1 -- 172.21.15.50:0/3285002203 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f788400c590 con 0x7f7878004810 2023-10-06T01:22:32.605 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:32.601+0000 7f788e7fc700 1 -- 172.21.15.50:0/3285002203 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f788400c6f0 con 0x7f7878004810 2023-10-06T01:22:32.605 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:32.601+0000 7f788e7fc700 1 -- 172.21.15.50:0/3285002203 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f788400c8a0 con 0x7f7878004810 2023-10-06T01:22:32.605 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:32.601+0000 7f7894b9d700 1 -- 172.21.15.50:0/3285002203 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7878004810 msgr2=0x7f7878004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:32.605 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:32.601+0000 7f7894b9d700 1 --2- 172.21.15.50:0/3285002203 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7878004810 0x7f7878004c80 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f7884001500 tx=0x7f7884007d30 comp rx=0 tx=0).stop 2023-10-06T01:22:32.605 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:32.601+0000 7f7894b9d700 1 -- 172.21.15.50:0/3285002203 shutdown_connections 2023-10-06T01:22:32.605 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:32.601+0000 7f7894b9d700 1 --2- 172.21.15.50:0/3285002203 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7878004810 0x7f7878004c80 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:32.605 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:32.601+0000 7f7894b9d700 1 -- 172.21.15.50:0/3285002203 >> 172.21.15.50:0/3285002203 conn(0x7f78900cbf10 msgr2=0x7f78900cc310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:22:32.606 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:32.602+0000 7f7894b9d700 1 -- 172.21.15.50:0/3285002203 shutdown_connections 2023-10-06T01:22:32.606 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:32.602+0000 7f7894b9d700 1 -- 172.21.15.50:0/3285002203 wait complete. 2023-10-06T01:22:32.608 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:32.603+0000 7f7894b9d700 1 Processor -- start 2023-10-06T01:22:32.608 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:32.603+0000 7f7894b9d700 1 -- start start 2023-10-06T01:22:32.608 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:32.604+0000 7f7894b9d700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7878004810 0x7f78901695d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:32.608 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:32.604+0000 7f7894b9d700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f789016c400 0x7f789016cbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:32.608 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:32.604+0000 7f7894b9d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f789016d110 0x7f7890157b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:32.608 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:32.604+0000 7f7894b9d700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78900cbd50 con 0x7f789016d110 2023-10-06T01:22:32.608 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:32.604+0000 7f7894b9d700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f789016d590 con 0x7f789016c400 2023-10-06T01:22:32.608 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:32.604+0000 7f7894b9d700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78900c9480 con 0x7f7878004810 2023-10-06T01:22:32.608 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:32.604+0000 7f788ffff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f789016d110 0x7f7890157b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:32.608 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:32.604+0000 7f788ffff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f789016d110 0x7f7890157b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:48786/0 (socket says 172.21.15.50:48786) 2023-10-06T01:22:32.608 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:32.604+0000 7f788ffff700 1 -- 172.21.15.50:0/3645461741 learned_addr learned my addr 172.21.15.50:0/3645461741 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-06T01:22:32.609 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:32.604+0000 7f788f7fe700 1 --2- 172.21.15.50:0/3645461741 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7878004810 0x7f78901695d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:32.609 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:32.604+0000 7f788effd700 1 --2- 172.21.15.50:0/3645461741 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f789016c400 0x7f789016cbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:32.609 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:32.605+0000 7f788ffff700 1 -- 172.21.15.50:0/3645461741 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7878004810 msgr2=0x7f78901695d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:32.609 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:32.605+0000 7f788ffff700 1 --2- 172.21.15.50:0/3645461741 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7878004810 0x7f78901695d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:32.609 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:32.605+0000 7f788ffff700 1 -- 172.21.15.50:0/3645461741 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f789016c400 msgr2=0x7f789016cbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:32.609 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:32.605+0000 7f788ffff700 1 --2- 172.21.15.50:0/3645461741 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f789016c400 0x7f789016cbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:32.609 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:32.605+0000 7f788ffff700 1 -- 172.21.15.50:0/3645461741 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78900c91a0 con 0x7f789016d110 2023-10-06T01:22:32.609 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:32.605+0000 7f788ffff700 1 --2- 172.21.15.50:0/3645461741 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f789016d110 0x7f7890157b60 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f78880094d0 tx=0x7f788800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:22:32.609 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:32.605+0000 7f78777fe700 1 -- 172.21.15.50:0/3645461741 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f788800e040 con 0x7f789016d110 2023-10-06T01:22:32.609 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:32.605+0000 7f78777fe700 1 -- 172.21.15.50:0/3645461741 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f788800f040 con 0x7f789016d110 2023-10-06T01:22:32.609 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:32.605+0000 7f78777fe700 1 -- 172.21.15.50:0/3645461741 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f788800fdc0 con 0x7f789016d110 2023-10-06T01:22:32.609 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:32.605+0000 7f7894b9d700 1 -- 172.21.15.50:0/3645461741 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f78900cb700 con 0x7f789016d110 2023-10-06T01:22:32.610 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:32.605+0000 7f7894b9d700 1 -- 172.21.15.50:0/3645461741 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f78900a56b0 con 0x7f789016d110 2023-10-06T01:22:32.610 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:32.607+0000 7f7894b9d700 1 -- 172.21.15.50:0/3645461741 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7890157880 con 0x7f789016d110 2023-10-06T01:22:32.610 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:32.607+0000 7f78777fe700 1 -- 172.21.15.50:0/3645461741 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f7888015640 con 0x7f789016d110 2023-10-06T01:22:32.610 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:32.608+0000 7f78777fe700 1 --2- 172.21.15.50:0/3645461741 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f787c066f30 0x7f787c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:32.611 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:32.608+0000 7f78777fe700 1 -- 172.21.15.50:0/3645461741 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6867+0+0 (secure 0 0 0) 0x7f7888085200 con 0x7f789016d110 2023-10-06T01:22:32.611 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:32.609+0000 7f788f7fe700 1 --2- 172.21.15.50:0/3645461741 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f787c066f30 0x7f787c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:32.611 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:32.610+0000 7f788f7fe700 1 --2- 172.21.15.50:0/3645461741 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f787c066f30 0x7f787c0693e0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f7880000e10 tx=0x7f7880007040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:22:32.613 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:32.613+0000 7f78777fe700 1 -- 172.21.15.50:0/3645461741 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f7890157880 con 0x7f789016d110 2023-10-06T01:22:32.815 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:32.814+0000 7f7894b9d700 1 -- 172.21.15.50:0/3645461741 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f7890157880 con 0x7f789016d110 2023-10-06T01:22:32.815 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:32.814+0000 7f78777fe700 1 -- 172.21.15.50:0/3645461741 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v27) v1 ==== 103+0+11 (secure 0 0 0) 0x7f7890157880 con 0x7f789016d110 2023-10-06T01:22:32.815 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 32 2023-10-06T01:22:32.818 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:32.817+0000 7f7894b9d700 1 -- 172.21.15.50:0/3645461741 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f787c066f30 msgr2=0x7f787c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:32.818 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:32.817+0000 7f7894b9d700 1 --2- 172.21.15.50:0/3645461741 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f787c066f30 0x7f787c0693e0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f7880000e10 tx=0x7f7880007040 comp rx=0 tx=0).stop 2023-10-06T01:22:32.818 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:32.817+0000 7f7894b9d700 1 -- 172.21.15.50:0/3645461741 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f789016d110 msgr2=0x7f7890157b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:32.818 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:32.817+0000 7f7894b9d700 1 --2- 172.21.15.50:0/3645461741 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f789016d110 0x7f7890157b60 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f78880094d0 tx=0x7f788800b040 comp rx=0 tx=0).stop 2023-10-06T01:22:32.818 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:32.817+0000 7f7894b9d700 1 -- 172.21.15.50:0/3645461741 shutdown_connections 2023-10-06T01:22:32.818 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:32.817+0000 7f7894b9d700 1 --2- 172.21.15.50:0/3645461741 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f789016d110 0x7f7890157b60 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:32.819 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:32.817+0000 7f7894b9d700 1 --2- 172.21.15.50:0/3645461741 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7878004810 0x7f78901695d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:32.819 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:32.817+0000 7f7894b9d700 1 --2- 172.21.15.50:0/3645461741 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f787c066f30 0x7f787c0693e0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:32.819 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:32.817+0000 7f7894b9d700 1 --2- 172.21.15.50:0/3645461741 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f789016c400 0x7f789016cbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:32.819 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:32.817+0000 7f7894b9d700 1 -- 172.21.15.50:0/3645461741 >> 172.21.15.50:0/3645461741 conn(0x7f78900cbf10 msgr2=0x7f78900691d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:22:32.819 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:32.817+0000 7f7894b9d700 1 -- 172.21.15.50:0/3645461741 shutdown_connections 2023-10-06T01:22:32.819 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:32.817+0000 7f7894b9d700 1 -- 172.21.15.50:0/3645461741 wait complete. 2023-10-06T01:22:32.837 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T01:22:33.024 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:33.023+0000 7fa54759e700 1 Processor -- start 2023-10-06T01:22:33.024 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:33.024+0000 7fa54759e700 1 -- start start 2023-10-06T01:22:33.026 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:33.025+0000 7fa54759e700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fa5480cb5e0 0x7fa5480cb9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:33.026 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:33.025+0000 7fa54759e700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa54806e080 con 0x7fa54806f350 2023-10-06T01:22:33.026 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:33.025+0000 7fa54759e700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa54806e360 con 0x7fa548159490 2023-10-06T01:22:33.026 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:33.025+0000 7fa54759e700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa54806ec00 con 0x7fa5480cb5e0 2023-10-06T01:22:33.026 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:33.025+0000 7fa54659c700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fa5480cb5e0 0x7fa5480cb9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:33.026 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:33.025+0000 7fa54659c700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fa5480cb5e0 0x7fa5480cb9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:48796/0 (socket says 172.21.15.50:48796) 2023-10-06T01:22:33.027 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:33.025+0000 7fa54659c700 1 -- 172.21.15.50:0/1418399633 learned_addr learned my addr 172.21.15.50:0/1418399633 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-06T01:22:33.027 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:33.025+0000 7fa545d9b700 1 --1- 172.21.15.50:0/1418399633 >> v1:172.21.15.50:6789/0 conn(0x7fa54806f350 0x7fa54806d630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:54480/0 (socket says 172.21.15.50:54480) 2023-10-06T01:22:33.028 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:33.026+0000 7fa54659c700 1 -- 172.21.15.50:0/1418399633 >> v1:172.21.15.155:6789/0 conn(0x7fa548159490 legacy=0x7fa548069650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:33.028 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:33.026+0000 7fa54659c700 1 -- 172.21.15.50:0/1418399633 >> v1:172.21.15.50:6789/0 conn(0x7fa54806f350 legacy=0x7fa54806d630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:33.028 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:33.026+0000 7fa54659c700 1 -- 172.21.15.50:0/1418399633 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa54806e640 con 0x7fa5480cb5e0 2023-10-06T01:22:33.028 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:33.026+0000 7fa54559a700 1 -- 172.21.15.50:0/1418399633 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1262975814 0 0) 0x7fa54806e080 con 0x7fa54806f350 2023-10-06T01:22:33.028 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:33.026+0000 7fa54659c700 1 --2- 172.21.15.50:0/1418399633 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa5480cb5e0 0x7fa5480cb9b0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fa53800bc40 tx=0x7fa53800b4e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=34f655f65d32b661 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:22:33.028 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:33.026+0000 7fa54559a700 1 -- 172.21.15.50:0/1418399633 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa53800db40 con 0x7fa5480cb5e0 2023-10-06T01:22:33.028 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:33.026+0000 7fa54559a700 1 -- 172.21.15.50:0/1418399633 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa53800dca0 con 0x7fa5480cb5e0 2023-10-06T01:22:33.029 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:33.026+0000 7fa54559a700 1 -- 172.21.15.50:0/1418399633 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa538017640 con 0x7fa5480cb5e0 2023-10-06T01:22:33.029 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:33.027+0000 7fa54759e700 1 -- 172.21.15.50:0/1418399633 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa5480cb5e0 msgr2=0x7fa5480cb9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:33.029 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:33.027+0000 7fa54759e700 1 --2- 172.21.15.50:0/1418399633 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa5480cb5e0 0x7fa5480cb9b0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fa53800bc40 tx=0x7fa53800b4e0 comp rx=0 tx=0).stop 2023-10-06T01:22:33.029 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:33.027+0000 7fa54759e700 1 -- 172.21.15.50:0/1418399633 shutdown_connections 2023-10-06T01:22:33.029 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:33.027+0000 7fa54759e700 1 --2- 172.21.15.50:0/1418399633 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa5480cb5e0 0x7fa5480cb9b0 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:33.029 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:33.027+0000 7fa54759e700 1 -- 172.21.15.50:0/1418399633 >> 172.21.15.50:0/1418399633 conn(0x7fa5480680c0 msgr2=0x7fa5480cbf00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:22:33.029 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:33.027+0000 7fa54759e700 1 -- 172.21.15.50:0/1418399633 shutdown_connections 2023-10-06T01:22:33.029 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:33.027+0000 7fa54759e700 1 -- 172.21.15.50:0/1418399633 wait complete. 2023-10-06T01:22:33.031 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:33.028+0000 7fa54759e700 1 Processor -- start 2023-10-06T01:22:33.032 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:33.028+0000 7fa54759e700 1 -- start start 2023-10-06T01:22:33.032 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:33.029+0000 7fa54759e700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa5480cb5e0 0x7fa54814c900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:33.032 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:33.029+0000 7fa54759e700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa548159490 0x7fa5480ada60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:33.032 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:33.029+0000 7fa54759e700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa5480adfa0 0x7fa5480c1820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:33.032 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:33.029+0000 7fa54759e700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa548165440 con 0x7fa5480cb5e0 2023-10-06T01:22:33.032 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:33.029+0000 7fa54759e700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa548165720 con 0x7fa5480adfa0 2023-10-06T01:22:33.032 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:33.029+0000 7fa54759e700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa548165a00 con 0x7fa548159490 2023-10-06T01:22:33.032 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:33.029+0000 7fa54659c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa5480cb5e0 0x7fa54814c900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:33.032 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:33.029+0000 7fa54659c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa5480cb5e0 0x7fa54814c900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:48798/0 (socket says 172.21.15.50:48798) 2023-10-06T01:22:33.033 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:33.029+0000 7fa54659c700 1 -- 172.21.15.50:0/3352443963 learned_addr learned my addr 172.21.15.50:0/3352443963 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-06T01:22:33.033 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:33.030+0000 7fa546d9d700 1 --2- 172.21.15.50:0/3352443963 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa5480adfa0 0x7fa5480c1820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:33.033 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:33.030+0000 7fa545d9b700 1 --2- 172.21.15.50:0/3352443963 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa548159490 0x7fa5480ada60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:33.033 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:33.030+0000 7fa54659c700 1 -- 172.21.15.50:0/3352443963 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa548159490 msgr2=0x7fa5480ada60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:33.033 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:33.030+0000 7fa54659c700 1 --2- 172.21.15.50:0/3352443963 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa548159490 0x7fa5480ada60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:33.033 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:33.030+0000 7fa54659c700 1 -- 172.21.15.50:0/3352443963 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa5480adfa0 msgr2=0x7fa5480c1820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:33.033 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:33.030+0000 7fa54659c700 1 --2- 172.21.15.50:0/3352443963 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa5480adfa0 0x7fa5480c1820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:33.033 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:33.030+0000 7fa54659c700 1 -- 172.21.15.50:0/3352443963 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa53800b780 con 0x7fa5480cb5e0 2023-10-06T01:22:33.033 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:33.030+0000 7fa545d9b700 1 --2- 172.21.15.50:0/3352443963 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa548159490 0x7fa5480ada60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T01:22:33.033 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:33.030+0000 7fa54659c700 1 --2- 172.21.15.50:0/3352443963 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa5480cb5e0 0x7fa54814c900 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fa54806c770 tx=0x7fa538019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:22:33.033 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:33.030+0000 7fa5367fc700 1 -- 172.21.15.50:0/3352443963 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5380226e0 con 0x7fa5480cb5e0 2023-10-06T01:22:33.034 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:33.030+0000 7fa5367fc700 1 -- 172.21.15.50:0/3352443963 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa538022840 con 0x7fa5480cb5e0 2023-10-06T01:22:33.034 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:33.030+0000 7fa5367fc700 1 -- 172.21.15.50:0/3352443963 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa538022be0 con 0x7fa5480cb5e0 2023-10-06T01:22:33.034 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:33.030+0000 7fa54759e700 1 -- 172.21.15.50:0/3352443963 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa548165ce0 con 0x7fa5480cb5e0 2023-10-06T01:22:33.034 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:33.031+0000 7fa54759e700 1 -- 172.21.15.50:0/3352443963 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa54814ce40 con 0x7fa5480cb5e0 2023-10-06T01:22:33.035 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:33.031+0000 7fa54759e700 1 -- 172.21.15.50:0/3352443963 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa54805f270 con 0x7fa5480cb5e0 2023-10-06T01:22:33.035 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:33.032+0000 7fa5367fc700 1 -- 172.21.15.50:0/3352443963 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fa538015070 con 0x7fa5480cb5e0 2023-10-06T01:22:33.035 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:33.034+0000 7fa5367fc700 1 --2- 172.21.15.50:0/3352443963 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7fa528066f30 0x7fa5280693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:33.035 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:33.034+0000 7fa5367fc700 1 -- 172.21.15.50:0/3352443963 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6867+0+0 (secure 0 0 0) 0x7fa538088a40 con 0x7fa5480cb5e0 2023-10-06T01:22:33.035 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:33.034+0000 7fa545d9b700 1 --2- 172.21.15.50:0/3352443963 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7fa528066f30 0x7fa5280693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:33.035 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:33.035+0000 7fa545d9b700 1 --2- 172.21.15.50:0/3352443963 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7fa528066f30 0x7fa5280693e0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fa54814b000 tx=0x7fa53c009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:22:33.038 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:33.037+0000 7fa5367fc700 1 -- 172.21.15.50:0/3352443963 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fa538055780 con 0x7fa5480cb5e0 2023-10-06T01:22:33.245 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:33.244+0000 7fa54759e700 1 -- 172.21.15.50:0/3352443963 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa54806e920 con 0x7fa5480cb5e0 2023-10-06T01:22:33.246 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:33.245+0000 7fa5367fc700 1 -- 172.21.15.50:0/3352443963 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+18803 (secure 0 0 0) 0x7fa538058da0 con 0x7fa5480cb5e0 2023-10-06T01:22:33.247 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-10-06T01:22:33.247 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":27,"fsid":"0bfd9a6b-1587-4fe4-a89e-e43c00286b4e","created":"2023-10-06T01:21:16.828801+0000","modified":"2023-10-06T01:22:24.863940+0000","last_up_change":"2023-10-06T01:21:28.584523+0000","last_in_change":"2023-10-06T01:21:20.179863+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-10-06T01:21:29.304225+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":".mgr","create_time":"2023-10-06T01:21:29.835490+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-06T01:21:34.675315+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-06T01:21:35.753991+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-10-06T01:21:38.853108+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"9060727a-3959-4de3-8363-c5c5d7826c9a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":87837},{"type":"v1","addr":"172.21.15.50:6801","nonce":87837}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":87837},{"type":"v1","addr":"172.21.15.50:6803","nonce":87837}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":87837},{"type":"v1","addr":"172.21.15.50:6807","nonce":87837}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":87837},{"type":"v1","addr":"172.21.15.50:6805","nonce":87837}]},"public_addr":"172.21.15.50:6801/87837","cluster_addr":"172.21.15.50:6803/87837","heartbeat_back_addr":"172.21.15.50:6807/87837","heartbeat_front_addr":"172.21.15.50:6805/87837","state":["exists","up"]},{"osd":1,"uuid":"5ad9ef12-b579-47ea-b690-90ba887e2cef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":87853},{"type":"v1","addr":"172.21.15.50:6809","nonce":87853}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":87853},{"type":"v1","addr":"172.21.15.50:6811","nonce":87853}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":87853},{"type":"v1","addr":"172.21.15.50:6815","nonce":87853}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":87853},{"type":"v1","addr":"172.21.15.50:6813","nonce":87853}]},"public_addr":"172.21.15.50:6809/87853","cluster_addr":"172.21.15.50:6811/87853","heartbeat_back_addr":"172.21.15.50:6815/87853","heartbeat_front_addr":"172.21.15.50:6813/87853","state":["exists","up"]},{"osd":2,"uuid":"c7aee044-6f75-436f-90e1-ba42a57359bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6821","nonce":87855},{"type":"v1","addr":"172.21.15.50:6822","nonce":87855}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6824","nonce":87855},{"type":"v1","addr":"172.21.15.50:6826","nonce":87855}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":87855},{"type":"v1","addr":"172.21.15.50:6831","nonce":87855}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":87855},{"type":"v1","addr":"172.21.15.50:6829","nonce":87855}]},"public_addr":"172.21.15.50:6822/87855","cluster_addr":"172.21.15.50:6826/87855","heartbeat_back_addr":"172.21.15.50:6831/87855","heartbeat_front_addr":"172.21.15.50:6829/87855","state":["exists","up"]},{"osd":3,"uuid":"d9b901c8-e8b2-44af-9508-f453120a96c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":87856},{"type":"v1","addr":"172.21.15.50:6817","nonce":87856}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":87856},{"type":"v1","addr":"172.21.15.50:6819","nonce":87856}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6825","nonce":87856},{"type":"v1","addr":"172.21.15.50:6827","nonce":87856}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6820","nonce":87856},{"type":"v1","addr":"172.21.15.50:6823","nonce":87856}]},"public_addr":"172.21.15.50:6817/87856","cluster_addr":"172.21.15.50:6819/87856","heartbeat_back_addr":"172.21.15.50:6827/87856","heartbeat_front_addr":"172.21.15.50:6823/87856","state":["exists","up"]},{"osd":4,"uuid":"2b3c6b38-e3e9-4301-9445-60fd3fe8ce03","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":85805},{"type":"v1","addr":"172.21.15.155:6801","nonce":85805}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":85805},{"type":"v1","addr":"172.21.15.155:6803","nonce":85805}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6806","nonce":85805},{"type":"v1","addr":"172.21.15.155:6807","nonce":85805}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6804","nonce":85805},{"type":"v1","addr":"172.21.15.155:6805","nonce":85805}]},"public_addr":"172.21.15.155:6801/85805","cluster_addr":"172.21.15.155:6803/85805","heartbeat_back_addr":"172.21.15.155:6807/85805","heartbeat_front_addr":"172.21.15.155:6805/85805","state":["exists","up"]},{"osd":5,"uuid":"417b5f8f-65f1-4c94-91a7-a6ce03fe1679","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6816","nonce":85807},{"type":"v1","addr":"172.21.15.155:6818","nonce":85807}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6820","nonce":85807},{"type":"v1","addr":"172.21.15.155:6822","nonce":85807}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6828","nonce":85807},{"type":"v1","addr":"172.21.15.155:6830","nonce":85807}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6824","nonce":85807},{"type":"v1","addr":"172.21.15.155:6826","nonce":85807}]},"public_addr":"172.21.15.155:6818/85807","cluster_addr":"172.21.15.155:6822/85807","heartbeat_back_addr":"172.21.15.155:6830/85807","heartbeat_front_addr":"172.21.15.155:6826/85807","state":["exists","up"]},{"osd":6,"uuid":"c150cff3-aee4-4714-9c08-d182b1ba9ffd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6808","nonce":85806},{"type":"v1","addr":"172.21.15.155:6809","nonce":85806}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6810","nonce":85806},{"type":"v1","addr":"172.21.15.155:6811","nonce":85806}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6814","nonce":85806},{"type":"v1","addr":"172.21.15.155:6815","nonce":85806}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6812","nonce":85806},{"type":"v1","addr":"172.21.15.155:6813","nonce":85806}]},"public_addr":"172.21.15.155:6809/85806","cluster_addr":"172.21.15.155:6811/85806","heartbeat_back_addr":"172.21.15.155:6815/85806","heartbeat_front_addr":"172.21.15.155:6813/85806","state":["exists","up"]},{"osd":7,"uuid":"71107f0e-04d1-4e72-a0ec-0faf6af003e7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6817","nonce":85832},{"type":"v1","addr":"172.21.15.155:6819","nonce":85832}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6821","nonce":85832},{"type":"v1","addr":"172.21.15.155:6823","nonce":85832}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6829","nonce":85832},{"type":"v1","addr":"172.21.15.155:6831","nonce":85832}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6825","nonce":85832},{"type":"v1","addr":"172.21.15.155:6827","nonce":85832}]},"public_addr":"172.21.15.155:6819/85832","cluster_addr":"172.21.15.155:6823/85832","heartbeat_back_addr":"172.21.15.155:6831/85832","heartbeat_front_addr":"172.21.15.155:6827/85832","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:21:25.423389+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:21:25.472661+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:21:25.817562+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:21:25.551257+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:21:25.407818+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:21:25.557976+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:21:25.747299+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:21:25.827576+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.19","mappings":[{"from":3,"to":5}]},{"pgid":"4.31","mappings":[{"from":1,"to":2}]}],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T01:22:33.249 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:33.248+0000 7fa54759e700 1 -- 172.21.15.50:0/3352443963 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7fa528066f30 msgr2=0x7fa5280693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:33.249 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:33.248+0000 7fa54759e700 1 --2- 172.21.15.50:0/3352443963 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7fa528066f30 0x7fa5280693e0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fa54814b000 tx=0x7fa53c009040 comp rx=0 tx=0).stop 2023-10-06T01:22:33.250 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:33.248+0000 7fa54759e700 1 -- 172.21.15.50:0/3352443963 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa5480cb5e0 msgr2=0x7fa54814c900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:33.250 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:33.248+0000 7fa54759e700 1 --2- 172.21.15.50:0/3352443963 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa5480cb5e0 0x7fa54814c900 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fa54806c770 tx=0x7fa538019000 comp rx=0 tx=0).stop 2023-10-06T01:22:33.250 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:33.248+0000 7fa54759e700 1 -- 172.21.15.50:0/3352443963 shutdown_connections 2023-10-06T01:22:33.250 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:33.248+0000 7fa54759e700 1 --2- 172.21.15.50:0/3352443963 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7fa528066f30 0x7fa5280693e0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:33.250 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:33.248+0000 7fa54759e700 1 --2- 172.21.15.50:0/3352443963 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa5480adfa0 0x7fa5480c1820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:33.250 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:33.248+0000 7fa54759e700 1 --2- 172.21.15.50:0/3352443963 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa5480cb5e0 0x7fa54814c900 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:33.250 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:33.248+0000 7fa54759e700 1 --2- 172.21.15.50:0/3352443963 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa548159490 0x7fa5480ada60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:33.250 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:33.248+0000 7fa54759e700 1 -- 172.21.15.50:0/3352443963 >> 172.21.15.50:0/3352443963 conn(0x7fa5480680c0 msgr2=0x7fa5480c0ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:22:33.250 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:33.248+0000 7fa54759e700 1 -- 172.21.15.50:0/3352443963 shutdown_connections 2023-10-06T01:22:33.251 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:33.248+0000 7fa54759e700 1 -- 172.21.15.50:0/3352443963 wait complete. 2023-10-06T01:22:33.266 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-10-06T01:21:29.304225+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-10-06T01:21:29.835490+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-06T01:21:34.675315+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-10-06T01:21:35.753991+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-10-06T01:21:38.853108+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-06T01:22:33.267 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-10-06T01:22:33.459 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:33.458+0000 7f212df9d700 1 Processor -- start 2023-10-06T01:22:33.459 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:33.458+0000 7f212df9d700 1 -- start start 2023-10-06T01:22:33.461 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:33.459+0000 7f212df9d700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f21280c4320 0x7f21280cc810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:33.461 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:33.459+0000 7f212df9d700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f21280cda00 con 0x7f212815d090 2023-10-06T01:22:33.461 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:33.459+0000 7f212df9d700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f21280b0ab0 con 0x7f21280b06e0 2023-10-06T01:22:33.462 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:33.459+0000 7f212df9d700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2128159980 con 0x7f21280c4320 2023-10-06T01:22:33.462 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:33.460+0000 7f2127fff700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f21280c4320 0x7f21280cc810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:33.462 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:33.460+0000 7f2127fff700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f21280c4320 0x7f21280cc810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:48800/0 (socket says 172.21.15.50:48800) 2023-10-06T01:22:33.462 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:33.460+0000 7f2127fff700 1 -- 172.21.15.50:0/376048322 learned_addr learned my addr 172.21.15.50:0/376048322 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-06T01:22:33.462 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:33.460+0000 7f212d79c700 1 --1- 172.21.15.50:0/376048322 >> v1:172.21.15.50:6789/0 conn(0x7f212815d090 0x7f21280c8900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:54494/0 (socket says 172.21.15.50:54494) 2023-10-06T01:22:33.462 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:33.460+0000 7f2127fff700 1 -- 172.21.15.50:0/376048322 >> v1:172.21.15.155:6789/0 conn(0x7f21280b06e0 legacy=0x7f21280c3c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:22:33.462 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:33.460+0000 7f2127fff700 1 -- 172.21.15.50:0/376048322 >> v1:172.21.15.50:6789/0 conn(0x7f212815d090 legacy=0x7f21280c8900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:33.462 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:33.460+0000 7f2127fff700 1 -- 172.21.15.50:0/376048322 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21280ccdf0 con 0x7f21280c4320 2023-10-06T01:22:33.462 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:33.460+0000 7f21277fe700 1 -- 172.21.15.50:0/376048322 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1180242384 0 0) 0x7f21280cda00 con 0x7f212815d090 2023-10-06T01:22:33.462 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:33.460+0000 7f2127fff700 1 --2- 172.21.15.50:0/376048322 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f21280c4320 0x7f21280cc810 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f21140099b0 tx=0x7f2114009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9244a04365dbc2f server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:22:33.462 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:33.461+0000 7f21277fe700 1 -- 172.21.15.50:0/376048322 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f211400b860 con 0x7f21280c4320 2023-10-06T01:22:33.462 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:33.461+0000 7f21277fe700 1 -- 172.21.15.50:0/376048322 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f211400b9c0 con 0x7f21280c4320 2023-10-06T01:22:33.463 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:33.461+0000 7f21277fe700 1 -- 172.21.15.50:0/376048322 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f211400bd60 con 0x7f21280c4320 2023-10-06T01:22:33.463 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:33.461+0000 7f212df9d700 1 -- 172.21.15.50:0/376048322 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f21280c4320 msgr2=0x7f21280cc810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:33.464 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:33.461+0000 7f212df9d700 1 --2- 172.21.15.50:0/376048322 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f21280c4320 0x7f21280cc810 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f21140099b0 tx=0x7f2114009250 comp rx=0 tx=0).stop 2023-10-06T01:22:33.464 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:33.461+0000 7f212df9d700 1 -- 172.21.15.50:0/376048322 shutdown_connections 2023-10-06T01:22:33.464 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:33.461+0000 7f212df9d700 1 --2- 172.21.15.50:0/376048322 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f21280c4320 0x7f21280cc810 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:33.464 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:33.461+0000 7f212df9d700 1 -- 172.21.15.50:0/376048322 >> 172.21.15.50:0/376048322 conn(0x7f2128067dd0 msgr2=0x7f2128088000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:22:33.464 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:33.461+0000 7f212df9d700 1 -- 172.21.15.50:0/376048322 shutdown_connections 2023-10-06T01:22:33.464 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:33.461+0000 7f212df9d700 1 -- 172.21.15.50:0/376048322 wait complete. 2023-10-06T01:22:33.464 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:33.463+0000 7f212df9d700 1 Processor -- start 2023-10-06T01:22:33.464 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:33.463+0000 7f212df9d700 1 -- start start 2023-10-06T01:22:33.466 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:33.464+0000 7f212df9d700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f21280b06e0 0x7f21280b1b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:33.466 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:33.464+0000 7f212df9d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f21280c4320 0x7f2128157560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:33.466 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:33.464+0000 7f212df9d700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f212815d090 0x7f21280c67b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:33.466 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:33.464+0000 7f212df9d700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2128157aa0 con 0x7f21280c4320 2023-10-06T01:22:33.466 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:33.464+0000 7f212df9d700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21280c6cf0 con 0x7f21280b06e0 2023-10-06T01:22:33.466 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:33.464+0000 7f212df9d700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21280c6f90 con 0x7f212815d090 2023-10-06T01:22:33.466 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:33.464+0000 7f2127fff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f21280c4320 0x7f2128157560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:33.466 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:33.464+0000 7f2127fff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f21280c4320 0x7f2128157560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:48808/0 (socket says 172.21.15.50:48808) 2023-10-06T01:22:33.467 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:33.464+0000 7f2127fff700 1 -- 172.21.15.50:0/1466392919 learned_addr learned my addr 172.21.15.50:0/1466392919 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-06T01:22:33.467 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:33.464+0000 7f212cf9b700 1 --2- 172.21.15.50:0/1466392919 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f21280b06e0 0x7f21280b1b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:33.467 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:33.464+0000 7f212d79c700 1 --2- 172.21.15.50:0/1466392919 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f212815d090 0x7f21280c67b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:33.467 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:33.464+0000 7f2127fff700 1 -- 172.21.15.50:0/1466392919 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f212815d090 msgr2=0x7f21280c67b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:33.467 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:33.464+0000 7f2127fff700 1 --2- 172.21.15.50:0/1466392919 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f212815d090 0x7f21280c67b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:33.467 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:33.464+0000 7f2127fff700 1 -- 172.21.15.50:0/1466392919 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f21280b06e0 msgr2=0x7f21280b1b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:33.467 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:33.464+0000 7f2127fff700 1 --2- 172.21.15.50:0/1466392919 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f21280b06e0 0x7f21280b1b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:33.467 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:33.464+0000 7f2127fff700 1 -- 172.21.15.50:0/1466392919 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21140094f0 con 0x7f21280c4320 2023-10-06T01:22:33.467 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:33.464+0000 7f212cf9b700 1 --2- 172.21.15.50:0/1466392919 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f21280b06e0 0x7f21280b1b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T01:22:33.467 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:33.465+0000 7f2127fff700 1 --2- 172.21.15.50:0/1466392919 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f21280c4320 0x7f2128157560 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f2114006f50 tx=0x7f2114017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:22:33.467 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:33.465+0000 7f2124ff9700 1 -- 172.21.15.50:0/1466392919 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f211401f070 con 0x7f21280c4320 2023-10-06T01:22:33.467 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:33.465+0000 7f2124ff9700 1 -- 172.21.15.50:0/1466392919 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2114011d10 con 0x7f21280c4320 2023-10-06T01:22:33.468 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:33.465+0000 7f2124ff9700 1 -- 172.21.15.50:0/1466392919 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2114025650 con 0x7f21280c4320 2023-10-06T01:22:33.468 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:33.465+0000 7f212df9d700 1 -- 172.21.15.50:0/1466392919 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f21280c7270 con 0x7f21280c4320 2023-10-06T01:22:33.468 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:33.465+0000 7f212df9d700 1 -- 172.21.15.50:0/1466392919 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f21280c7830 con 0x7f21280c4320 2023-10-06T01:22:33.468 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:33.466+0000 7f212df9d700 1 -- 172.21.15.50:0/1466392919 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f212805f270 con 0x7f21280c4320 2023-10-06T01:22:33.468 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:33.467+0000 7f2124ff9700 1 -- 172.21.15.50:0/1466392919 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f2114023070 con 0x7f21280c4320 2023-10-06T01:22:33.469 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:33.468+0000 7f2124ff9700 1 --2- 172.21.15.50:0/1466392919 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f210c066f30 0x7f210c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:33.469 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:33.468+0000 7f2124ff9700 1 -- 172.21.15.50:0/1466392919 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6867+0+0 (secure 0 0 0) 0x7f2114085dc0 con 0x7f21280c4320 2023-10-06T01:22:33.469 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:33.468+0000 7f212cf9b700 1 --2- 172.21.15.50:0/1466392919 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f210c066f30 0x7f210c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:33.470 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:33.469+0000 7f212cf9b700 1 --2- 172.21.15.50:0/1466392919 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f210c066f30 0x7f210c0693e0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f211c0018f0 tx=0x7f211c009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:22:33.473 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:33.472+0000 7f2124ff9700 1 -- 172.21.15.50:0/1466392919 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f2114052b00 con 0x7f21280c4320 2023-10-06T01:22:33.676 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:33.675+0000 7f212df9d700 1 -- 172.21.15.50:0/1466392919 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f21280cd0d0 con 0x7f21280c4320 2023-10-06T01:22:33.676 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:33.675+0000 7f2124ff9700 1 -- 172.21.15.50:0/1466392919 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v27) v1 ==== 92+0+10 (secure 0 0 0) 0x7f211402a0a0 con 0x7f21280c4320 2023-10-06T01:22:33.677 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 8 2023-10-06T01:22:33.679 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:33.678+0000 7f212df9d700 1 -- 172.21.15.50:0/1466392919 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f210c066f30 msgr2=0x7f210c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:33.679 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:33.678+0000 7f212df9d700 1 --2- 172.21.15.50:0/1466392919 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f210c066f30 0x7f210c0693e0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f211c0018f0 tx=0x7f211c009040 comp rx=0 tx=0).stop 2023-10-06T01:22:33.679 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:33.678+0000 7f212df9d700 1 -- 172.21.15.50:0/1466392919 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f21280c4320 msgr2=0x7f2128157560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:33.679 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:33.678+0000 7f212df9d700 1 --2- 172.21.15.50:0/1466392919 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f21280c4320 0x7f2128157560 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f2114006f50 tx=0x7f2114017000 comp rx=0 tx=0).stop 2023-10-06T01:22:33.679 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:33.678+0000 7f212df9d700 1 -- 172.21.15.50:0/1466392919 shutdown_connections 2023-10-06T01:22:33.679 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:33.678+0000 7f212df9d700 1 --2- 172.21.15.50:0/1466392919 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f212815d090 0x7f21280c67b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:33.680 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:33.678+0000 7f212df9d700 1 --2- 172.21.15.50:0/1466392919 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f210c066f30 0x7f210c0693e0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:33.680 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:33.678+0000 7f212df9d700 1 --2- 172.21.15.50:0/1466392919 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f21280b06e0 0x7f21280b1b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:33.680 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:33.678+0000 7f212df9d700 1 --2- 172.21.15.50:0/1466392919 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f21280c4320 0x7f2128157560 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:33.680 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:33.678+0000 7f212df9d700 1 -- 172.21.15.50:0/1466392919 >> 172.21.15.50:0/1466392919 conn(0x7f2128067dd0 msgr2=0x7f21280c37f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:22:33.680 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:33.678+0000 7f212df9d700 1 -- 172.21.15.50:0/1466392919 shutdown_connections 2023-10-06T01:22:33.680 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:33.678+0000 7f212df9d700 1 -- 172.21.15.50:0/1466392919 wait complete. 2023-10-06T01:22:33.696 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-06T01:22:33.888 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:33.886+0000 7f869f59e700 1 Processor -- start 2023-10-06T01:22:33.888 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:33.886+0000 7f869f59e700 1 -- start start 2023-10-06T01:22:33.892 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:33.888+0000 7f869f59e700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f86a0156130 0x7f86a0159ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:33.892 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:33.888+0000 7f869f59e700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f86a00ae0f0 0x7f86a00c8a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:33.892 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:33.888+0000 7f869f59e700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f86a00acb10 con 0x7f86a00c8f70 2023-10-06T01:22:33.892 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:33.888+0000 7f869f59e700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f86a0156500 con 0x7f86a00ae0f0 2023-10-06T01:22:33.892 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:33.888+0000 7f869f59e700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86a015a310 con 0x7f86a0156130 2023-10-06T01:22:33.892 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:33.888+0000 7f869ed9d700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f86a00c8f70 0x7f86a006e1a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:54510/0 (socket says 172.21.15.50:54510) 2023-10-06T01:22:33.892 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:33.888+0000 7f869ed9d700 1 -- 172.21.15.50:0/3022791701 learned_addr learned my addr 172.21.15.50:0/3022791701 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-10-06T01:22:33.892 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:33.888+0000 7f869e59c700 1 --2- 172.21.15.50:0/3022791701 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f86a0156130 0x7f86a0159ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:33.892 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:33.888+0000 7f869dd9b700 1 --2- 172.21.15.50:0/3022791701 >> v2:172.21.15.155:3300/0 conn(0x7f86a00ae0f0 0x7f86a00c8a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:33.892 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:33.888+0000 7f869d59a700 1 -- 172.21.15.50:0/3022791701 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3920884262 0 0) 0x7f86a00acb10 con 0x7f86a00c8f70 2023-10-06T01:22:33.893 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:33.888+0000 7f869d59a700 1 -- 172.21.15.50:0/3022791701 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8688003570 con 0x7f86a00c8f70 2023-10-06T01:22:33.893 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:33.889+0000 7f869d59a700 1 -- 172.21.15.50:0/3022791701 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2907784241 0 0) 0x7f8688003570 con 0x7f86a00c8f70 2023-10-06T01:22:33.893 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:33.889+0000 7f869d59a700 1 -- 172.21.15.50:0/3022791701 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f86a0156130 msgr2=0x7f86a0159ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:22:33.893 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:33.889+0000 7f869d59a700 1 --2- 172.21.15.50:0/3022791701 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f86a0156130 0x7f86a0159ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:33.893 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:33.889+0000 7f869d59a700 1 -- 172.21.15.50:0/3022791701 >> v2:172.21.15.155:3300/0 conn(0x7f86a00ae0f0 msgr2=0x7f86a00c8a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:22:33.893 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:33.889+0000 7f869d59a700 1 --2- 172.21.15.50:0/3022791701 >> v2:172.21.15.155:3300/0 conn(0x7f86a00ae0f0 0x7f86a00c8a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:33.893 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:33.889+0000 7f869d59a700 1 -- 172.21.15.50:0/3022791701 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86a015a5f0 con 0x7f86a00c8f70 2023-10-06T01:22:33.893 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:33.889+0000 7f869d59a700 1 -- 172.21.15.50:0/3022791701 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 347519148 0 0) 0x7f86980017f0 con 0x7f86a00c8f70 2023-10-06T01:22:33.893 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:33.889+0000 7f869dd9b700 1 --2- 172.21.15.50:0/3022791701 >> v2:172.21.15.155:3300/0 conn(0x7f86a00ae0f0 0x7f86a00c8a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T01:22:33.893 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:33.889+0000 7f869d59a700 1 -- 172.21.15.50:0/3022791701 >> v1:172.21.15.50:6789/0 conn(0x7f86a00c8f70 legacy=0x7f86a006e1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:33.893 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:33.889+0000 7f869d59a700 1 --2- 172.21.15.50:0/3022791701 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8688003ae0 0x7f8688003ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:33.894 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:33.889+0000 7f869d59a700 1 --2- 172.21.15.50:0/3022791701 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f86a0156130 0x7f8688004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:33.894 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:33.889+0000 7f869d59a700 1 --2- 172.21.15.50:0/3022791701 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8688004d50 0x7f86880051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:33.894 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:33.889+0000 7f869d59a700 1 -- 172.21.15.50:0/3022791701 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86a0156500 con 0x7f8688004d50 2023-10-06T01:22:33.894 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:33.889+0000 7f869d59a700 1 -- 172.21.15.50:0/3022791701 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86a015a310 con 0x7f8688003ae0 2023-10-06T01:22:33.894 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:33.889+0000 7f869d59a700 1 -- 172.21.15.50:0/3022791701 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f868800dd20 con 0x7f86a0156130 2023-10-06T01:22:33.894 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:33.889+0000 7f869ed9d700 1 --2- 172.21.15.50:0/3022791701 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8688004d50 0x7f86880051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:33.894 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:33.889+0000 7f869e59c700 1 --2- 172.21.15.50:0/3022791701 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8688003ae0 0x7f8688003ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:33.894 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:33.889+0000 7f869dd9b700 1 --2- 172.21.15.50:0/3022791701 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f86a0156130 0x7f8688004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:33.894 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:33.890+0000 7f869ed9d700 1 -- 172.21.15.50:0/3022791701 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f86a0156130 msgr2=0x7f8688004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:22:33.894 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:33.890+0000 7f869ed9d700 1 --2- 172.21.15.50:0/3022791701 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f86a0156130 0x7f8688004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:33.895 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:33.890+0000 7f869ed9d700 1 -- 172.21.15.50:0/3022791701 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8688003ae0 msgr2=0x7f8688003ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:22:33.895 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:33.890+0000 7f869ed9d700 1 --2- 172.21.15.50:0/3022791701 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8688003ae0 0x7f8688003ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:33.895 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:33.890+0000 7f869ed9d700 1 -- 172.21.15.50:0/3022791701 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8688003570 con 0x7f8688004d50 2023-10-06T01:22:33.895 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:33.890+0000 7f869e59c700 1 --2- 172.21.15.50:0/3022791701 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8688003ae0 0x7f8688003ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T01:22:33.895 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:33.890+0000 7f869ed9d700 1 --2- 172.21.15.50:0/3022791701 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8688004d50 0x7f86880051c0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f869800a870 tx=0x7f8698002140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b2e2d1a146d901de server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:22:33.895 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:33.890+0000 7f869d59a700 1 -- 172.21.15.50:0/3022791701 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86980070f0 con 0x7f8688004d50 2023-10-06T01:22:33.895 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:33.890+0000 7f869d59a700 1 -- 172.21.15.50:0/3022791701 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8698007270 con 0x7f8688004d50 2023-10-06T01:22:33.895 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:33.890+0000 7f869d59a700 1 -- 172.21.15.50:0/3022791701 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8698007630 con 0x7f8688004d50 2023-10-06T01:22:33.895 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:33.891+0000 7f869f59e700 1 -- 172.21.15.50:0/3022791701 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8688004d50 msgr2=0x7f86880051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:33.895 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:33.891+0000 7f869f59e700 1 --2- 172.21.15.50:0/3022791701 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8688004d50 0x7f86880051c0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f869800a870 tx=0x7f8698002140 comp rx=0 tx=0).stop 2023-10-06T01:22:33.895 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:33.891+0000 7f869ed9d700 1 -- 172.21.15.50:0/3022791701 reap_dead start 2023-10-06T01:22:33.896 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:33.891+0000 7f869f59e700 1 -- 172.21.15.50:0/3022791701 shutdown_connections 2023-10-06T01:22:33.896 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:33.891+0000 7f869f59e700 1 -- 172.21.15.50:0/3022791701 >> 172.21.15.50:0/3022791701 conn(0x7f86a00cbf10 msgr2=0x7f86a00cc310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:22:33.896 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:33.891+0000 7f869f59e700 1 -- 172.21.15.50:0/3022791701 shutdown_connections 2023-10-06T01:22:33.896 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:33.891+0000 7f869f59e700 1 -- 172.21.15.50:0/3022791701 wait complete. 2023-10-06T01:22:33.898 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:33.892+0000 7f869f59e700 1 Processor -- start 2023-10-06T01:22:33.898 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:33.893+0000 7f869f59e700 1 -- start start 2023-10-06T01:22:33.898 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:33.893+0000 7f869f59e700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8688004d50 0x7f86a0141d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:33.898 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:33.893+0000 7f869f59e700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f86a0158ee0 0x7f86a00ca610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:33.898 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:33.893+0000 7f869f59e700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f86a00cab50 0x7f86a016ab00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:33.898 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:33.893+0000 7f869f59e700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86a00ca180 con 0x7f86a0158ee0 2023-10-06T01:22:33.898 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:33.893+0000 7f869f59e700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86a00c95b0 con 0x7f86a00cab50 2023-10-06T01:22:33.898 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:33.893+0000 7f869f59e700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86a00c9850 con 0x7f8688004d50 2023-10-06T01:22:33.899 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:33.894+0000 7f869dd9b700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f86a0158ee0 0x7f86a00ca610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:33.899 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:33.894+0000 7f869dd9b700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f86a0158ee0 0x7f86a00ca610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:48826/0 (socket says 172.21.15.50:48826) 2023-10-06T01:22:33.899 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:33.894+0000 7f869dd9b700 1 -- 172.21.15.50:0/3926668938 learned_addr learned my addr 172.21.15.50:0/3926668938 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-06T01:22:33.899 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:33.894+0000 7f869e59c700 1 --2- 172.21.15.50:0/3926668938 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8688004d50 0x7f86a0141d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:33.899 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:33.894+0000 7f869ed9d700 1 --2- 172.21.15.50:0/3926668938 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f86a00cab50 0x7f86a016ab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:33.899 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:33.894+0000 7f869dd9b700 1 -- 172.21.15.50:0/3926668938 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8688004d50 msgr2=0x7f86a0141d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:33.899 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:33.894+0000 7f869dd9b700 1 --2- 172.21.15.50:0/3926668938 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8688004d50 0x7f86a0141d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:33.899 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:33.894+0000 7f869dd9b700 1 -- 172.21.15.50:0/3926668938 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f86a00cab50 msgr2=0x7f86a016ab00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:33.899 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:33.894+0000 7f869dd9b700 1 --2- 172.21.15.50:0/3926668938 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f86a00cab50 0x7f86a016ab00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:33.899 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:33.894+0000 7f869dd9b700 1 -- 172.21.15.50:0/3926668938 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86a00c9b30 con 0x7f86a0158ee0 2023-10-06T01:22:33.899 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:33.894+0000 7f869e59c700 1 --2- 172.21.15.50:0/3926668938 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8688004d50 0x7f86a0141d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T01:22:33.900 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:33.894+0000 7f869ed9d700 1 --2- 172.21.15.50:0/3926668938 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f86a00cab50 0x7f86a016ab00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T01:22:33.900 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:33.894+0000 7f869dd9b700 1 --2- 172.21.15.50:0/3926668938 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f86a0158ee0 0x7f86a00ca610 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f8694011d70 tx=0x7f86940091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:22:33.900 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:33.895+0000 7f868e7fc700 1 -- 172.21.15.50:0/3926668938 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f869400fcd0 con 0x7f86a0158ee0 2023-10-06T01:22:33.900 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:33.895+0000 7f868e7fc700 1 -- 172.21.15.50:0/3926668938 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f869400fe30 con 0x7f86a0158ee0 2023-10-06T01:22:33.900 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:33.895+0000 7f868e7fc700 1 -- 172.21.15.50:0/3926668938 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f869401d6d0 con 0x7f86a0158ee0 2023-10-06T01:22:33.900 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:33.895+0000 7f869f59e700 1 -- 172.21.15.50:0/3926668938 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f86a00c9e10 con 0x7f86a0158ee0 2023-10-06T01:22:33.900 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:33.895+0000 7f869f59e700 1 -- 172.21.15.50:0/3926668938 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f86a0159350 con 0x7f86a0158ee0 2023-10-06T01:22:33.900 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:33.896+0000 7f869f59e700 1 -- 172.21.15.50:0/3926668938 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f86a0159630 con 0x7f86a0158ee0 2023-10-06T01:22:33.900 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:33.897+0000 7f868e7fc700 1 -- 172.21.15.50:0/3926668938 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f869401dac0 con 0x7f86a0158ee0 2023-10-06T01:22:33.901 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:33.897+0000 7f868e7fc700 1 --2- 172.21.15.50:0/3926668938 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f8680066f30 0x7f86800693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:33.901 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:33.898+0000 7f868e7fc700 1 -- 172.21.15.50:0/3926668938 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6867+0+0 (secure 0 0 0) 0x7f8694018070 con 0x7f86a0158ee0 2023-10-06T01:22:33.901 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:33.898+0000 7f869e59c700 1 --2- 172.21.15.50:0/3926668938 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f8680066f30 0x7f86800693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:33.901 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:33.899+0000 7f869e59c700 1 --2- 172.21.15.50:0/3926668938 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f8680066f30 0x7f86800693e0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f8690006eb0 tx=0x7f8690008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:22:33.904 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:33.904+0000 7f868e7fc700 1 -- 172.21.15.50:0/3926668938 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f8694052720 con 0x7f86a0158ee0 2023-10-06T01:22:34.109 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:34.108+0000 7f869f59e700 1 -- 172.21.15.50:0/3926668938 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f86a005f270 con 0x7f86a0158ee0 2023-10-06T01:22:34.109 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:34.108+0000 7f868e7fc700 1 -- 172.21.15.50:0/3926668938 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v27) v1 ==== 93+0+10 (secure 0 0 0) 0x7f8694055d40 con 0x7f86a0158ee0 2023-10-06T01:22:34.110 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 1 2023-10-06T01:22:34.112 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:34.111+0000 7f869f59e700 1 -- 172.21.15.50:0/3926668938 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f8680066f30 msgr2=0x7f86800693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:34.112 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:34.111+0000 7f869f59e700 1 --2- 172.21.15.50:0/3926668938 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f8680066f30 0x7f86800693e0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f8690006eb0 tx=0x7f8690008040 comp rx=0 tx=0).stop 2023-10-06T01:22:34.112 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:34.111+0000 7f869f59e700 1 -- 172.21.15.50:0/3926668938 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f86a0158ee0 msgr2=0x7f86a00ca610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:34.112 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:34.111+0000 7f869f59e700 1 --2- 172.21.15.50:0/3926668938 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f86a0158ee0 0x7f86a00ca610 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f8694011d70 tx=0x7f86940091a0 comp rx=0 tx=0).stop 2023-10-06T01:22:34.112 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:34.111+0000 7f869f59e700 1 -- 172.21.15.50:0/3926668938 shutdown_connections 2023-10-06T01:22:34.113 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:34.111+0000 7f869f59e700 1 --2- 172.21.15.50:0/3926668938 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f8680066f30 0x7f86800693e0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:34.113 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:34.111+0000 7f869f59e700 1 --2- 172.21.15.50:0/3926668938 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f86a00cab50 0x7f86a016ab00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:34.113 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:34.111+0000 7f869f59e700 1 --2- 172.21.15.50:0/3926668938 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8688004d50 0x7f86a0141d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:34.113 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:34.111+0000 7f869f59e700 1 --2- 172.21.15.50:0/3926668938 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f86a0158ee0 0x7f86a00ca610 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:34.113 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:34.111+0000 7f869f59e700 1 -- 172.21.15.50:0/3926668938 >> 172.21.15.50:0/3926668938 conn(0x7f86a00cbf10 msgr2=0x7f86a006d190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:22:34.113 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:34.111+0000 7f869f59e700 1 -- 172.21.15.50:0/3926668938 shutdown_connections 2023-10-06T01:22:34.113 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:34.111+0000 7f869f59e700 1 -- 172.21.15.50:0/3926668938 wait complete. 2023-10-06T01:22:34.129 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-06T01:22:34.138 DEBUG:teuthology.orchestra.run.smithi050:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T01:22:34.179 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T01:22:34.320 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:34.319+0000 7f234ffff700 1 Processor -- start 2023-10-06T01:22:34.321 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:34.320+0000 7f234ffff700 1 -- start start 2023-10-06T01:22:34.328 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:34.321+0000 7f234ffff700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f2350155e30 0x7f23500c8a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:34.328 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:34.321+0000 7f234ffff700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f2350156200 0x7f23500adc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:34.328 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:34.321+0000 7f234ffff700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f23500ac980 con 0x7f2350159c00 2023-10-06T01:22:34.328 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:34.321+0000 7f234ffff700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f235006ec70 con 0x7f2350155e30 2023-10-06T01:22:34.328 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:34.321+0000 7f234ffff700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f23500c8fa0 con 0x7f2350156200 2023-10-06T01:22:34.328 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:34.321+0000 7f234effd700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f2350155e30 0x7f23500c8a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:34.329 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:34.321+0000 7f234effd700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f2350155e30 0x7f23500c8a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:48832/0 (socket says 172.21.15.50:48832) 2023-10-06T01:22:34.329 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:34.321+0000 7f234e7fc700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f2350159c00 0x7f235006e560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:54518/0 (socket says 172.21.15.50:54518) 2023-10-06T01:22:34.329 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:34.321+0000 7f234effd700 1 -- 172.21.15.50:0/3286134022 learned_addr learned my addr 172.21.15.50:0/3286134022 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-06T01:22:34.329 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:34.321+0000 7f234f7fe700 1 --2- 172.21.15.50:0/3286134022 >> v2:172.21.15.155:3300/0 conn(0x7f2350156200 0x7f23500adc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:34.329 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:34.322+0000 7f234effd700 1 -- 172.21.15.50:0/3286134022 >> v2:172.21.15.155:3300/0 conn(0x7f2350156200 msgr2=0x7f23500adc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:22:34.329 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:34.322+0000 7f234effd700 1 --2- 172.21.15.50:0/3286134022 >> v2:172.21.15.155:3300/0 conn(0x7f2350156200 0x7f23500adc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:34.329 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:34.322+0000 7f234effd700 1 -- 172.21.15.50:0/3286134022 >> v1:172.21.15.50:6789/0 conn(0x7f2350159c00 legacy=0x7f235006e560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:34.329 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:34.322+0000 7f234effd700 1 -- 172.21.15.50:0/3286134022 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f235015a0e0 con 0x7f2350155e30 2023-10-06T01:22:34.329 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:34.322+0000 7f234dffb700 1 -- 172.21.15.50:0/3286134022 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3089366644 0 0) 0x7f23500ac980 con 0x7f2350159c00 2023-10-06T01:22:34.329 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:34.322+0000 7f234effd700 1 --2- 172.21.15.50:0/3286134022 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2350155e30 0x7f23500c8a60 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f23500ae850 tx=0x7f234000b4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c42a1e8e41d2d8c0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:22:34.329 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:34.322+0000 7f234dffb700 1 -- 172.21.15.50:0/3286134022 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f234000dba0 con 0x7f2350155e30 2023-10-06T01:22:34.330 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:34.322+0000 7f234dffb700 1 -- 172.21.15.50:0/3286134022 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f234000dd00 con 0x7f2350155e30 2023-10-06T01:22:34.330 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:34.322+0000 7f234dffb700 1 -- 172.21.15.50:0/3286134022 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23400196d0 con 0x7f2350155e30 2023-10-06T01:22:34.330 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:34.323+0000 7f234ffff700 1 -- 172.21.15.50:0/3286134022 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2350155e30 msgr2=0x7f23500c8a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:34.330 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:34.323+0000 7f234ffff700 1 --2- 172.21.15.50:0/3286134022 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2350155e30 0x7f23500c8a60 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f23500ae850 tx=0x7f234000b4f0 comp rx=0 tx=0).stop 2023-10-06T01:22:34.330 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:34.323+0000 7f234ffff700 1 -- 172.21.15.50:0/3286134022 shutdown_connections 2023-10-06T01:22:34.330 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:34.323+0000 7f234ffff700 1 --2- 172.21.15.50:0/3286134022 >> v2:172.21.15.155:3300/0 conn(0x7f2350156200 0x7f23500adc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:34.330 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:34.323+0000 7f234ffff700 1 --2- 172.21.15.50:0/3286134022 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2350155e30 0x7f23500c8a60 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:34.330 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:34.323+0000 7f234ffff700 1 -- 172.21.15.50:0/3286134022 >> 172.21.15.50:0/3286134022 conn(0x7f23500cbeb0 msgr2=0x7f23500cc2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:22:34.331 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:34.323+0000 7f234ffff700 1 -- 172.21.15.50:0/3286134022 shutdown_connections 2023-10-06T01:22:34.331 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:34.323+0000 7f234ffff700 1 -- 172.21.15.50:0/3286134022 wait complete. 2023-10-06T01:22:34.331 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:34.324+0000 7f234ffff700 1 Processor -- start 2023-10-06T01:22:34.331 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:34.324+0000 7f234ffff700 1 -- start start 2023-10-06T01:22:34.331 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:34.325+0000 7f234ffff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2350155e30 0x7f235014ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:34.331 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:34.325+0000 7f234ffff700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2350156200 0x7f23501593f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:34.331 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:34.325+0000 7f234ffff700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2350159c00 0x7f2350142820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:34.331 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:34.325+0000 7f234ffff700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2350159930 con 0x7f2350155e30 2023-10-06T01:22:34.331 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:34.325+0000 7f234ffff700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f235014f260 con 0x7f2350159c00 2023-10-06T01:22:34.331 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:34.325+0000 7f234ffff700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f235014f540 con 0x7f2350156200 2023-10-06T01:22:34.332 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:34.325+0000 7f234effd700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2350155e30 0x7f235014ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:34.332 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:34.326+0000 7f234effd700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2350155e30 0x7f235014ec40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:48838/0 (socket says 172.21.15.50:48838) 2023-10-06T01:22:34.332 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:34.326+0000 7f234effd700 1 -- 172.21.15.50:0/3011000871 learned_addr learned my addr 172.21.15.50:0/3011000871 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-06T01:22:34.332 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:34.326+0000 7f234f7fe700 1 --2- 172.21.15.50:0/3011000871 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2350159c00 0x7f2350142820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:34.332 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:34.326+0000 7f234e7fc700 1 --2- 172.21.15.50:0/3011000871 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2350156200 0x7f23501593f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:34.332 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:34.326+0000 7f234effd700 1 -- 172.21.15.50:0/3011000871 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2350156200 msgr2=0x7f23501593f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:34.332 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:34.326+0000 7f234effd700 1 --2- 172.21.15.50:0/3011000871 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2350156200 0x7f23501593f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:34.332 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:34.326+0000 7f234effd700 1 -- 172.21.15.50:0/3011000871 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2350159c00 msgr2=0x7f2350142820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:34.332 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:34.326+0000 7f234effd700 1 --2- 172.21.15.50:0/3011000871 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2350159c00 0x7f2350142820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:34.333 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:34.326+0000 7f234effd700 1 -- 172.21.15.50:0/3011000871 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f234000b790 con 0x7f2350155e30 2023-10-06T01:22:34.333 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:34.326+0000 7f234f7fe700 1 --2- 172.21.15.50:0/3011000871 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2350159c00 0x7f2350142820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T01:22:34.333 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:34.326+0000 7f234e7fc700 1 --2- 172.21.15.50:0/3011000871 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2350156200 0x7f23501593f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T01:22:34.333 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:34.326+0000 7f234effd700 1 --2- 172.21.15.50:0/3011000871 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2350155e30 0x7f235014ec40 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f235006f9f0 tx=0x7f234001b000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:22:34.333 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:34.326+0000 7f2336ffd700 1 -- 172.21.15.50:0/3011000871 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2340010470 con 0x7f2350155e30 2023-10-06T01:22:34.333 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:34.326+0000 7f2336ffd700 1 -- 172.21.15.50:0/3011000871 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f23400105d0 con 0x7f2350155e30 2023-10-06T01:22:34.333 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:34.326+0000 7f234ffff700 1 -- 172.21.15.50:0/3011000871 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f235014f820 con 0x7f2350155e30 2023-10-06T01:22:34.333 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:34.327+0000 7f2336ffd700 1 -- 172.21.15.50:0/3011000871 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2340010950 con 0x7f2350155e30 2023-10-06T01:22:34.333 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:34.327+0000 7f234ffff700 1 -- 172.21.15.50:0/3011000871 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f235014fde0 con 0x7f2350155e30 2023-10-06T01:22:34.335 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:34.327+0000 7f234ffff700 1 -- 172.21.15.50:0/3011000871 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f23501566d0 con 0x7f2350155e30 2023-10-06T01:22:34.335 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:34.328+0000 7f2336ffd700 1 -- 172.21.15.50:0/3011000871 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f2340022030 con 0x7f2350155e30 2023-10-06T01:22:34.335 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:34.329+0000 7f2336ffd700 1 --2- 172.21.15.50:0/3011000871 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f233c066f30 0x7f233c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:34.335 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:34.329+0000 7f2336ffd700 1 -- 172.21.15.50:0/3011000871 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6867+0+0 (secure 0 0 0) 0x7f2340014070 con 0x7f2350155e30 2023-10-06T01:22:34.335 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:34.330+0000 7f234e7fc700 1 --2- 172.21.15.50:0/3011000871 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f233c066f30 0x7f233c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:34.335 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:34.330+0000 7f234e7fc700 1 --2- 172.21.15.50:0/3011000871 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f233c066f30 0x7f233c0693e0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f2350150f40 tx=0x7f2344009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:22:34.336 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:34.334+0000 7f2336ffd700 1 -- 172.21.15.50:0/3011000871 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f2340055910 con 0x7f2350155e30 2023-10-06T01:22:34.535 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:34.533+0000 7f234ffff700 1 -- 172.21.15.50:0/3011000871 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f235005f270 con 0x7f2350155e30 2023-10-06T01:22:34.535 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:34.534+0000 7f2336ffd700 1 -- 172.21.15.50:0/3011000871 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v27) v1 ==== 104+0+11 (secure 0 0 0) 0x7f2340058f30 con 0x7f2350155e30 2023-10-06T01:22:34.535 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 32 2023-10-06T01:22:34.537 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:34.536+0000 7f234ffff700 1 -- 172.21.15.50:0/3011000871 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f233c066f30 msgr2=0x7f233c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:34.538 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:34.536+0000 7f234ffff700 1 --2- 172.21.15.50:0/3011000871 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f233c066f30 0x7f233c0693e0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f2350150f40 tx=0x7f2344009040 comp rx=0 tx=0).stop 2023-10-06T01:22:34.538 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:34.536+0000 7f234ffff700 1 -- 172.21.15.50:0/3011000871 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2350155e30 msgr2=0x7f235014ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:34.538 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:34.536+0000 7f234ffff700 1 --2- 172.21.15.50:0/3011000871 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2350155e30 0x7f235014ec40 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f235006f9f0 tx=0x7f234001b000 comp rx=0 tx=0).stop 2023-10-06T01:22:34.538 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:34.536+0000 7f234ffff700 1 -- 172.21.15.50:0/3011000871 shutdown_connections 2023-10-06T01:22:34.538 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:34.536+0000 7f234ffff700 1 --2- 172.21.15.50:0/3011000871 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f233c066f30 0x7f233c0693e0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:34.538 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:34.536+0000 7f234ffff700 1 --2- 172.21.15.50:0/3011000871 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2350159c00 0x7f2350142820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:34.538 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:34.536+0000 7f234ffff700 1 --2- 172.21.15.50:0/3011000871 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2350155e30 0x7f235014ec40 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:34.538 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:34.536+0000 7f234ffff700 1 --2- 172.21.15.50:0/3011000871 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2350156200 0x7f23501593f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:34.539 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:34.536+0000 7f234ffff700 1 -- 172.21.15.50:0/3011000871 >> 172.21.15.50:0/3011000871 conn(0x7f23500cbeb0 msgr2=0x7f23500ad0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:22:34.539 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:34.536+0000 7f234ffff700 1 -- 172.21.15.50:0/3011000871 shutdown_connections 2023-10-06T01:22:34.539 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:34.536+0000 7f234ffff700 1 -- 172.21.15.50:0/3011000871 wait complete. 2023-10-06T01:22:34.554 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-06T01:22:34.746 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:34.745+0000 7fee0219d700 1 Processor -- start 2023-10-06T01:22:34.746 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:34.745+0000 7fee0219d700 1 -- start start 2023-10-06T01:22:34.748 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:34.746+0000 7fee0219d700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fedfc0c4320 0x7fedfc0cc810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:34.748 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:34.746+0000 7fee0219d700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fedfc15d090 0x7fedfc0c8900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:34.748 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:34.746+0000 7fee0219d700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fedfc0cda00 con 0x7fedfc0b06e0 2023-10-06T01:22:34.748 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:34.746+0000 7fee0219d700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fedfc0b0ab0 con 0x7fedfc15d090 2023-10-06T01:22:34.749 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:34.746+0000 7fee0219d700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fedfc159980 con 0x7fedfc0c4320 2023-10-06T01:22:34.749 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:34.746+0000 7fee0199c700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fedfc15d090 0x7fedfc0c8900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:34.749 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:34.747+0000 7fee0199c700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fedfc15d090 0x7fedfc0c8900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:48844/0 (socket says 172.21.15.50:48844) 2023-10-06T01:22:34.749 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:34.747+0000 7fee0199c700 1 -- 172.21.15.50:0/2380496367 learned_addr learned my addr 172.21.15.50:0/2380496367 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-06T01:22:34.749 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:34.747+0000 7fee0099a700 1 --2- 172.21.15.50:0/2380496367 >> v2:172.21.15.155:3300/0 conn(0x7fedfc0c4320 0x7fedfc0cc810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:34.749 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:34.747+0000 7fee0199c700 1 -- 172.21.15.50:0/2380496367 >> v2:172.21.15.155:3300/0 conn(0x7fedfc0c4320 msgr2=0x7fedfc0cc810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:22:34.749 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:34.747+0000 7fee0199c700 1 --2- 172.21.15.50:0/2380496367 >> v2:172.21.15.155:3300/0 conn(0x7fedfc0c4320 0x7fedfc0cc810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:34.749 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:34.747+0000 7fee0199c700 1 -- 172.21.15.50:0/2380496367 >> v1:172.21.15.155:6789/0 conn(0x7fedfc0b06e0 legacy=0x7fedfc0c3c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:34.749 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:34.747+0000 7fee0199c700 1 -- 172.21.15.50:0/2380496367 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fedfc0ccdf0 con 0x7fedfc15d090 2023-10-06T01:22:34.749 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:34.747+0000 7fee0199c700 1 --2- 172.21.15.50:0/2380496367 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fedfc15d090 0x7fedfc0c8900 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fedfc06e010 tx=0x7fedf4009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e4732b42f87186d6 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:22:34.750 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:34.747+0000 7fedf3fff700 1 -- 172.21.15.50:0/2380496367 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedf400e070 con 0x7fedfc15d090 2023-10-06T01:22:34.750 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:34.747+0000 7fedf3fff700 1 -- 172.21.15.50:0/2380496367 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fedf400ba50 con 0x7fedfc15d090 2023-10-06T01:22:34.750 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:34.748+0000 7fedf3fff700 1 -- 172.21.15.50:0/2380496367 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedf40092e0 con 0x7fedfc15d090 2023-10-06T01:22:34.751 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:34.748+0000 7fee0219d700 1 -- 172.21.15.50:0/2380496367 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fedfc15d090 msgr2=0x7fedfc0c8900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:34.751 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:34.748+0000 7fee0219d700 1 --2- 172.21.15.50:0/2380496367 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fedfc15d090 0x7fedfc0c8900 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fedfc06e010 tx=0x7fedf4009840 comp rx=0 tx=0).stop 2023-10-06T01:22:34.751 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:34.748+0000 7fee0219d700 1 -- 172.21.15.50:0/2380496367 shutdown_connections 2023-10-06T01:22:34.751 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:34.748+0000 7fee0219d700 1 --2- 172.21.15.50:0/2380496367 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fedfc15d090 0x7fedfc0c8900 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:34.751 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:34.748+0000 7fee0219d700 1 --2- 172.21.15.50:0/2380496367 >> v2:172.21.15.155:3300/0 conn(0x7fedfc0c4320 0x7fedfc0cc810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:34.751 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:34.748+0000 7fee0219d700 1 -- 172.21.15.50:0/2380496367 >> 172.21.15.50:0/2380496367 conn(0x7fedfc067dd0 msgr2=0x7fedfc088000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:22:34.751 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:34.748+0000 7fee0219d700 1 -- 172.21.15.50:0/2380496367 shutdown_connections 2023-10-06T01:22:34.751 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:34.748+0000 7fee0219d700 1 -- 172.21.15.50:0/2380496367 wait complete. 2023-10-06T01:22:34.751 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:34.750+0000 7fee0219d700 1 Processor -- start 2023-10-06T01:22:34.751 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:34.750+0000 7fee0219d700 1 -- start start 2023-10-06T01:22:34.753 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:34.751+0000 7fee0219d700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fedfc0b06e0 0x7fedfc15a500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:34.753 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:34.751+0000 7fee0219d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fedfc0c4320 0x7fedfc157350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:34.754 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:34.751+0000 7fee0219d700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fedfc15d090 0x7fedfc15c220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:34.754 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:34.751+0000 7fee0219d700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fedfc15ad40 con 0x7fedfc0c4320 2023-10-06T01:22:34.754 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:34.751+0000 7fee0219d700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fedfc169fd0 con 0x7fedfc15d090 2023-10-06T01:22:34.754 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:34.751+0000 7fee0219d700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fedfc16a460 con 0x7fedfc0b06e0 2023-10-06T01:22:34.754 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:34.751+0000 7fee0099a700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fedfc0c4320 0x7fedfc157350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:34.754 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:34.751+0000 7fee0099a700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fedfc0c4320 0x7fedfc157350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:48858/0 (socket says 172.21.15.50:48858) 2023-10-06T01:22:34.754 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:34.751+0000 7fee0099a700 1 -- 172.21.15.50:0/3259866436 learned_addr learned my addr 172.21.15.50:0/3259866436 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-06T01:22:34.754 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:34.751+0000 7fee0199c700 1 --2- 172.21.15.50:0/3259866436 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fedfc15d090 0x7fedfc15c220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:34.754 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:34.751+0000 7fee0119b700 1 --2- 172.21.15.50:0/3259866436 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fedfc0b06e0 0x7fedfc15a500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:34.754 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:34.751+0000 7fee0099a700 1 -- 172.21.15.50:0/3259866436 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fedfc0b06e0 msgr2=0x7fedfc15a500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:34.754 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:34.751+0000 7fee0099a700 1 --2- 172.21.15.50:0/3259866436 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fedfc0b06e0 0x7fedfc15a500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:34.754 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:34.751+0000 7fee0099a700 1 -- 172.21.15.50:0/3259866436 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fedfc15d090 msgr2=0x7fedfc15c220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:34.755 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:34.751+0000 7fee0099a700 1 --2- 172.21.15.50:0/3259866436 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fedfc15d090 0x7fedfc15c220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:34.755 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:34.751+0000 7fee0099a700 1 -- 172.21.15.50:0/3259866436 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fedf4009ae0 con 0x7fedfc0c4320 2023-10-06T01:22:34.755 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:34.751+0000 7fee0199c700 1 --2- 172.21.15.50:0/3259866436 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fedfc15d090 0x7fedfc15c220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T01:22:34.755 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:34.752+0000 7fee0099a700 1 --2- 172.21.15.50:0/3259866436 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fedfc0c4320 0x7fedfc157350 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fedec00d890 tx=0x7fedec008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:22:34.755 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:34.752+0000 7fedf17fa700 1 -- 172.21.15.50:0/3259866436 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedec00b600 con 0x7fedfc0c4320 2023-10-06T01:22:34.755 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:34.752+0000 7fedf17fa700 1 -- 172.21.15.50:0/3259866436 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fedec00b760 con 0x7fedfc0c4320 2023-10-06T01:22:34.755 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:34.752+0000 7fedf17fa700 1 -- 172.21.15.50:0/3259866436 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedec00bae0 con 0x7fedfc0c4320 2023-10-06T01:22:34.755 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:34.752+0000 7fee0219d700 1 -- 172.21.15.50:0/3259866436 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fedfc1696a0 con 0x7fedfc0c4320 2023-10-06T01:22:34.755 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:34.752+0000 7fee0219d700 1 -- 172.21.15.50:0/3259866436 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fedfc169c60 con 0x7fedfc0c4320 2023-10-06T01:22:34.756 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:34.753+0000 7fee0219d700 1 -- 172.21.15.50:0/3259866436 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fedfc0cba10 con 0x7fedfc0c4320 2023-10-06T01:22:34.756 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:34.754+0000 7fedf17fa700 1 -- 172.21.15.50:0/3259866436 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fedec01e460 con 0x7fedfc0c4320 2023-10-06T01:22:34.756 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:34.755+0000 7fedf17fa700 1 --2- 172.21.15.50:0/3259866436 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7fede0066f30 0x7fede00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:34.756 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:34.755+0000 7fedf17fa700 1 -- 172.21.15.50:0/3259866436 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6867+0+0 (secure 0 0 0) 0x7fedec085110 con 0x7fedfc0c4320 2023-10-06T01:22:34.757 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:34.756+0000 7fee0119b700 1 --2- 172.21.15.50:0/3259866436 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7fede0066f30 0x7fede00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:34.757 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:34.756+0000 7fee0119b700 1 --2- 172.21.15.50:0/3259866436 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7fede0066f30 0x7fede00693e0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fedfc0ccbe0 tx=0x7fedf8009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:22:34.760 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:34.760+0000 7fedf17fa700 1 -- 172.21.15.50:0/3259866436 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fedec051e50 con 0x7fedfc0c4320 2023-10-06T01:22:34.962 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:34.961+0000 7fee0219d700 1 -- 172.21.15.50:0/3259866436 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fedfc16a140 con 0x7fedfc0c4320 2023-10-06T01:22:34.962 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:34.961+0000 7fedf17fa700 1 -- 172.21.15.50:0/3259866436 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v27) v1 ==== 100+0+11 (secure 0 0 0) 0x7fedec055470 con 0x7fedfc0c4320 2023-10-06T01:22:34.962 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 64 2023-10-06T01:22:34.965 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:34.963+0000 7fee0219d700 1 -- 172.21.15.50:0/3259866436 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7fede0066f30 msgr2=0x7fede00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:34.965 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:34.963+0000 7fee0219d700 1 --2- 172.21.15.50:0/3259866436 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7fede0066f30 0x7fede00693e0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fedfc0ccbe0 tx=0x7fedf8009040 comp rx=0 tx=0).stop 2023-10-06T01:22:34.965 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:34.963+0000 7fee0219d700 1 -- 172.21.15.50:0/3259866436 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fedfc0c4320 msgr2=0x7fedfc157350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:34.965 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:34.963+0000 7fee0219d700 1 --2- 172.21.15.50:0/3259866436 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fedfc0c4320 0x7fedfc157350 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fedec00d890 tx=0x7fedec008040 comp rx=0 tx=0).stop 2023-10-06T01:22:34.965 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:34.964+0000 7fee0219d700 1 -- 172.21.15.50:0/3259866436 shutdown_connections 2023-10-06T01:22:34.965 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:34.964+0000 7fee0219d700 1 --2- 172.21.15.50:0/3259866436 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7fede0066f30 0x7fede00693e0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:34.965 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:34.964+0000 7fee0219d700 1 --2- 172.21.15.50:0/3259866436 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fedfc15d090 0x7fedfc15c220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:34.965 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:34.964+0000 7fee0219d700 1 --2- 172.21.15.50:0/3259866436 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fedfc0b06e0 0x7fedfc15a500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:34.965 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:34.964+0000 7fee0219d700 1 --2- 172.21.15.50:0/3259866436 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fedfc0c4320 0x7fedfc157350 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:34.965 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:34.964+0000 7fee0219d700 1 -- 172.21.15.50:0/3259866436 >> 172.21.15.50:0/3259866436 conn(0x7fedfc067dd0 msgr2=0x7fedfc06b990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:22:34.966 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:34.964+0000 7fee0219d700 1 -- 172.21.15.50:0/3259866436 shutdown_connections 2023-10-06T01:22:34.966 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:34.964+0000 7fee0219d700 1 -- 172.21.15.50:0/3259866436 wait complete. 2023-10-06T01:22:34.982 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-10-06T01:22:35.172 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:35.171+0000 7fa98a99d700 1 Processor -- start 2023-10-06T01:22:35.172 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:35.171+0000 7fa98a99d700 1 -- start start 2023-10-06T01:22:35.176 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:35.172+0000 7fa98a99d700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fa98413c470 0x7fa9840ca990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:35.176 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:35.172+0000 7fa98a99d700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa98406d470 con 0x7fa9840caed0 2023-10-06T01:22:35.176 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:35.172+0000 7fa98a99d700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa98406cb80 con 0x7fa98415a250 2023-10-06T01:22:35.176 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:35.172+0000 7fa98a99d700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa9840cb370 con 0x7fa98413c470 2023-10-06T01:22:35.176 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:35.172+0000 7fa98999b700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fa98413c470 0x7fa9840ca990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:35.177 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:35.173+0000 7fa98919a700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fa9840caed0 0x7fa984159b40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:56840/0 (socket says 172.21.15.50:56840) 2023-10-06T01:22:35.177 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:35.173+0000 7fa98999b700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fa98413c470 0x7fa9840ca990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:54678/0 (socket says 172.21.15.50:54678) 2023-10-06T01:22:35.177 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:35.173+0000 7fa98919a700 1 -- 172.21.15.50:0/2133310334 learned_addr learned my addr 172.21.15.50:0/2133310334 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-10-06T01:22:35.177 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:35.173+0000 7fa98999b700 1 -- 172.21.15.50:0/2133310334 >> v1:172.21.15.155:6789/0 conn(0x7fa98415a250 legacy=0x7fa9840c8730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:22:35.177 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:35.173+0000 7fa98999b700 1 -- 172.21.15.50:0/2133310334 >> v1:172.21.15.50:6789/0 conn(0x7fa9840caed0 legacy=0x7fa984159b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:35.177 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:35.173+0000 7fa98999b700 1 -- 172.21.15.50:0/2133310334 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa98413c840 con 0x7fa98413c470 2023-10-06T01:22:35.177 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:35.173+0000 7fa98999b700 1 --2- 172.21.15.50:0/2133310334 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa98413c470 0x7fa9840ca990 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fa9800098e0 tx=0x7fa9800091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4a6ee49043051492 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:22:35.177 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:35.173+0000 7fa988999700 1 -- 172.21.15.50:0/2133310334 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa980009e80 con 0x7fa98413c470 2023-10-06T01:22:35.177 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:35.174+0000 7fa988999700 1 -- 172.21.15.50:0/2133310334 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa98000b860 con 0x7fa98413c470 2023-10-06T01:22:35.177 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:35.174+0000 7fa988999700 1 -- 172.21.15.50:0/2133310334 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa98000bbe0 con 0x7fa98413c470 2023-10-06T01:22:35.178 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:35.174+0000 7fa98a99d700 1 -- 172.21.15.50:0/2133310334 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa98413c470 msgr2=0x7fa9840ca990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:35.178 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:35.174+0000 7fa98a99d700 1 --2- 172.21.15.50:0/2133310334 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa98413c470 0x7fa9840ca990 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fa9800098e0 tx=0x7fa9800091a0 comp rx=0 tx=0).stop 2023-10-06T01:22:35.178 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:35.174+0000 7fa98a99d700 1 -- 172.21.15.50:0/2133310334 shutdown_connections 2023-10-06T01:22:35.178 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:35.174+0000 7fa98a99d700 1 --2- 172.21.15.50:0/2133310334 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa98413c470 0x7fa9840ca990 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:35.178 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:35.174+0000 7fa98a99d700 1 -- 172.21.15.50:0/2133310334 >> 172.21.15.50:0/2133310334 conn(0x7fa98406b370 msgr2=0x7fa98406b770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:22:35.178 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:35.174+0000 7fa98a99d700 1 -- 172.21.15.50:0/2133310334 shutdown_connections 2023-10-06T01:22:35.178 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:35.174+0000 7fa98a99d700 1 -- 172.21.15.50:0/2133310334 wait complete. 2023-10-06T01:22:35.180 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:35.176+0000 7fa98a99d700 1 Processor -- start 2023-10-06T01:22:35.180 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:35.176+0000 7fa98a99d700 1 -- start start 2023-10-06T01:22:35.180 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:35.177+0000 7fa98a99d700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa9840caed0 0x7fa98416a060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:35.180 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:35.177+0000 7fa98a99d700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa98413c470 0x7fa9840b3010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:35.180 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:35.177+0000 7fa98a99d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa98415a250 0x7fa9840afe10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:35.181 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:35.177+0000 7fa98a99d700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9840b0e90 con 0x7fa98415a250 2023-10-06T01:22:35.181 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:35.177+0000 7fa98a99d700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9841581d0 con 0x7fa98413c470 2023-10-06T01:22:35.181 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:35.177+0000 7fa98a99d700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa98416a5a0 con 0x7fa9840caed0 2023-10-06T01:22:35.181 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:35.177+0000 7fa98a19c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa98415a250 0x7fa9840afe10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:35.181 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:35.177+0000 7fa98a19c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa98415a250 0x7fa9840afe10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:54690/0 (socket says 172.21.15.50:54690) 2023-10-06T01:22:35.181 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:35.177+0000 7fa98a19c700 1 -- 172.21.15.50:0/1568590811 learned_addr learned my addr 172.21.15.50:0/1568590811 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-06T01:22:35.181 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:35.177+0000 7fa98919a700 1 --2- 172.21.15.50:0/1568590811 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa98413c470 0x7fa9840b3010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:35.181 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:35.177+0000 7fa98999b700 1 --2- 172.21.15.50:0/1568590811 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa9840caed0 0x7fa98416a060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:35.181 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:35.177+0000 7fa98a19c700 1 -- 172.21.15.50:0/1568590811 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa9840caed0 msgr2=0x7fa98416a060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:35.182 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:35.177+0000 7fa98a19c700 1 --2- 172.21.15.50:0/1568590811 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa9840caed0 0x7fa98416a060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:35.182 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:35.177+0000 7fa98a19c700 1 -- 172.21.15.50:0/1568590811 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa98413c470 msgr2=0x7fa9840b3010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:35.182 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:35.177+0000 7fa98a19c700 1 --2- 172.21.15.50:0/1568590811 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa98413c470 0x7fa9840b3010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:35.182 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:35.177+0000 7fa98a19c700 1 -- 172.21.15.50:0/1568590811 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa980009420 con 0x7fa98415a250 2023-10-06T01:22:35.182 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:35.178+0000 7fa98a19c700 1 --2- 172.21.15.50:0/1568590811 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa98415a250 0x7fa9840afe10 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fa97c00bc30 tx=0x7fa97c009820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:22:35.182 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:35.178+0000 7fa979ffb700 1 -- 172.21.15.50:0/1568590811 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa97c00c8a0 con 0x7fa98415a250 2023-10-06T01:22:35.182 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:35.178+0000 7fa979ffb700 1 -- 172.21.15.50:0/1568590811 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa97c00ca40 con 0x7fa98415a250 2023-10-06T01:22:35.182 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:35.178+0000 7fa979ffb700 1 -- 172.21.15.50:0/1568590811 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa97c00ce00 con 0x7fa98415a250 2023-10-06T01:22:35.182 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:35.178+0000 7fa98a99d700 1 -- 172.21.15.50:0/1568590811 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa9840b1350 con 0x7fa98415a250 2023-10-06T01:22:35.183 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:35.178+0000 7fa98a99d700 1 -- 172.21.15.50:0/1568590811 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa9840b1910 con 0x7fa98415a250 2023-10-06T01:22:35.183 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:35.179+0000 7fa98a99d700 1 -- 172.21.15.50:0/1568590811 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa9840b10d0 con 0x7fa98415a250 2023-10-06T01:22:35.184 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:35.180+0000 7fa979ffb700 1 -- 172.21.15.50:0/1568590811 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fa97c014620 con 0x7fa98415a250 2023-10-06T01:22:35.184 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:35.181+0000 7fa979ffb700 1 --2- 172.21.15.50:0/1568590811 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7fa968066f30 0x7fa9680693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:35.184 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:35.181+0000 7fa979ffb700 1 -- 172.21.15.50:0/1568590811 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6867+0+0 (secure 0 0 0) 0x7fa97c0849d0 con 0x7fa98415a250 2023-10-06T01:22:35.184 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:35.182+0000 7fa98999b700 1 --2- 172.21.15.50:0/1568590811 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7fa968066f30 0x7fa9680693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:35.184 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:35.182+0000 7fa98999b700 1 --2- 172.21.15.50:0/1568590811 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7fa968066f30 0x7fa9680693e0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fa9800091e0 tx=0x7fa980016000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:22:35.186 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:35.185+0000 7fa979ffb700 1 -- 172.21.15.50:0/1568590811 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fa97c04c5a0 con 0x7fa98415a250 2023-10-06T01:22:35.388 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:35.387+0000 7fa98a99d700 1 -- 172.21.15.50:0/1568590811 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7fa98405f270 con 0x7fa98415a250 2023-10-06T01:22:35.389 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:35.388+0000 7fa979ffb700 1 -- 172.21.15.50:0/1568590811 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v27) v1 ==== 103+0+11 (secure 0 0 0) 0x7fa97c051710 con 0x7fa98415a250 2023-10-06T01:22:35.389 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 32 2023-10-06T01:22:35.391 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:35.390+0000 7fa98a99d700 1 -- 172.21.15.50:0/1568590811 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7fa968066f30 msgr2=0x7fa9680693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:35.391 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:35.390+0000 7fa98a99d700 1 --2- 172.21.15.50:0/1568590811 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7fa968066f30 0x7fa9680693e0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fa9800091e0 tx=0x7fa980016000 comp rx=0 tx=0).stop 2023-10-06T01:22:35.391 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:35.390+0000 7fa98a99d700 1 -- 172.21.15.50:0/1568590811 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa98415a250 msgr2=0x7fa9840afe10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:35.391 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:35.390+0000 7fa98a99d700 1 --2- 172.21.15.50:0/1568590811 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa98415a250 0x7fa9840afe10 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fa97c00bc30 tx=0x7fa97c009820 comp rx=0 tx=0).stop 2023-10-06T01:22:35.392 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:35.390+0000 7fa98a99d700 1 -- 172.21.15.50:0/1568590811 shutdown_connections 2023-10-06T01:22:35.392 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:35.390+0000 7fa98a99d700 1 --2- 172.21.15.50:0/1568590811 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa98415a250 0x7fa9840afe10 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:35.392 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:35.390+0000 7fa98a99d700 1 --2- 172.21.15.50:0/1568590811 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa9840caed0 0x7fa98416a060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:35.392 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:35.390+0000 7fa98a99d700 1 --2- 172.21.15.50:0/1568590811 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7fa968066f30 0x7fa9680693e0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:35.392 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:35.390+0000 7fa98a99d700 1 --2- 172.21.15.50:0/1568590811 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa98413c470 0x7fa9840b3010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:35.392 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:35.390+0000 7fa98a99d700 1 -- 172.21.15.50:0/1568590811 >> 172.21.15.50:0/1568590811 conn(0x7fa98406b370 msgr2=0x7fa9840c4800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:22:35.392 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:35.390+0000 7fa98a99d700 1 -- 172.21.15.50:0/1568590811 shutdown_connections 2023-10-06T01:22:35.393 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:35.390+0000 7fa98a99d700 1 -- 172.21.15.50:0/1568590811 wait complete. 2023-10-06T01:22:35.417 INFO:tasks.cephfs_test_runner:Starting test: test_acls (tasks.cephfs.test_acls.TestACLs) 2023-10-06T01:22:35.417 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_acls.TestACLs.test_acls' 2023-10-06T01:22:35.604 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:35.604+0000 7f8ff49fe700 1 Processor -- start 2023-10-06T01:22:35.605 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:35.604+0000 7f8ff49fe700 1 -- start start 2023-10-06T01:22:35.607 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:35.605+0000 7f8ff49fe700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8ff00cb5e0 0x7f8ff00cb9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:35.607 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:35.605+0000 7f8ff49fe700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f8ff006f350 0x7f8ff006d630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:35.607 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:35.605+0000 7f8ff49fe700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f8ff006db70 0x7f8ff0159490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:35.607 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:35.605+0000 7f8ff49fe700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8ff006ec00 con 0x7f8ff006f350 2023-10-06T01:22:35.607 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:35.605+0000 7f8ff49fe700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8ff006e080 con 0x7f8ff006db70 2023-10-06T01:22:35.608 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:35.605+0000 7f8ff49fe700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ff006e360 con 0x7f8ff00cb5e0 2023-10-06T01:22:35.608 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:35.605+0000 7f8fee59c700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f8ff006f350 0x7f8ff006d630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:35.608 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:35.606+0000 7f8fef59e700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f8ff006db70 0x7f8ff0159490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:35.608 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:35.606+0000 7f8fee59c700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f8ff006f350 0x7f8ff006d630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:54704/0 (socket says 172.21.15.50:54704) 2023-10-06T01:22:35.608 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:35.606+0000 7f8fee59c700 1 -- 172.21.15.50:0/1429730938 learned_addr learned my addr 172.21.15.50:0/1429730938 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-06T01:22:35.608 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:35.606+0000 7f8feed9d700 1 --2- 172.21.15.50:0/1429730938 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8ff00cb5e0 0x7f8ff00cb9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:35.608 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:35.606+0000 7f8fee59c700 1 -- 172.21.15.50:0/1429730938 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8ff00cb5e0 msgr2=0x7f8ff00cb9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:22:35.608 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:35.606+0000 7f8fee59c700 1 --2- 172.21.15.50:0/1429730938 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8ff00cb5e0 0x7f8ff00cb9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:35.608 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:35.606+0000 7f8fee59c700 1 -- 172.21.15.50:0/1429730938 >> v2:172.21.15.155:3300/0 conn(0x7f8ff006db70 msgr2=0x7f8ff0159490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:22:35.608 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:35.606+0000 7f8fee59c700 1 --2- 172.21.15.50:0/1429730938 >> v2:172.21.15.155:3300/0 conn(0x7f8ff006db70 0x7f8ff0159490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:35.608 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:35.606+0000 7f8fee59c700 1 -- 172.21.15.50:0/1429730938 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ff006e640 con 0x7f8ff006f350 2023-10-06T01:22:35.608 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:35.606+0000 7f8fef59e700 1 --2- 172.21.15.50:0/1429730938 >> v2:172.21.15.155:3300/0 conn(0x7f8ff006db70 0x7f8ff0159490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T01:22:35.609 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:35.606+0000 7f8fee59c700 1 --2- 172.21.15.50:0/1429730938 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8ff006f350 0x7f8ff006d630 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f8ff00c64d0 tx=0x7f8fe4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8be1ae06eb4c3e0d server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:22:35.609 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:35.606+0000 7f8fedd9b700 1 -- 172.21.15.50:0/1429730938 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fe400b640 con 0x7f8ff006f350 2023-10-06T01:22:35.609 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:35.607+0000 7f8fedd9b700 1 -- 172.21.15.50:0/1429730938 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8fe400b7a0 con 0x7f8ff006f350 2023-10-06T01:22:35.609 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:35.607+0000 7f8fedd9b700 1 -- 172.21.15.50:0/1429730938 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fe400bb60 con 0x7f8ff006f350 2023-10-06T01:22:35.610 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:35.607+0000 7f8ff49fe700 1 -- 172.21.15.50:0/1429730938 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8ff006f350 msgr2=0x7f8ff006d630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:35.610 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:35.607+0000 7f8ff49fe700 1 --2- 172.21.15.50:0/1429730938 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8ff006f350 0x7f8ff006d630 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f8ff00c64d0 tx=0x7f8fe4009250 comp rx=0 tx=0).stop 2023-10-06T01:22:35.610 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:35.607+0000 7f8ff49fe700 1 -- 172.21.15.50:0/1429730938 shutdown_connections 2023-10-06T01:22:35.610 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:35.607+0000 7f8ff49fe700 1 --2- 172.21.15.50:0/1429730938 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8ff00cb5e0 0x7f8ff00cb9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:35.610 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:35.607+0000 7f8ff49fe700 1 --2- 172.21.15.50:0/1429730938 >> v2:172.21.15.155:3300/0 conn(0x7f8ff006db70 0x7f8ff0159490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:35.610 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:35.607+0000 7f8ff49fe700 1 --2- 172.21.15.50:0/1429730938 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8ff006f350 0x7f8ff006d630 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:35.610 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:35.607+0000 7f8ff49fe700 1 -- 172.21.15.50:0/1429730938 >> 172.21.15.50:0/1429730938 conn(0x7f8ff00680c0 msgr2=0x7f8ff00cbf00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:22:35.610 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:35.607+0000 7f8ff49fe700 1 -- 172.21.15.50:0/1429730938 shutdown_connections 2023-10-06T01:22:35.610 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:35.607+0000 7f8ff49fe700 1 -- 172.21.15.50:0/1429730938 wait complete. 2023-10-06T01:22:35.611 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:35.609+0000 7f8ff49fe700 1 Processor -- start 2023-10-06T01:22:35.611 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:35.609+0000 7f8ff49fe700 1 -- start start 2023-10-06T01:22:35.613 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:35.610+0000 7f8ff49fe700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8ff006db70 0x7f8ff00aca30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:35.613 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:35.610+0000 7f8ff49fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8ff00cb5e0 0x7f8ff00af660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:35.613 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:35.610+0000 7f8ff49fe700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8ff00afba0 0x7f8ff00c3f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:35.613 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:35.610+0000 7f8ff49fe700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ff00b0040 con 0x7f8ff00cb5e0 2023-10-06T01:22:35.613 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:35.610+0000 7f8ff49fe700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ff0149360 con 0x7f8ff006db70 2023-10-06T01:22:35.613 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:35.610+0000 7f8ff49fe700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ff00ab740 con 0x7f8ff00afba0 2023-10-06T01:22:35.613 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:35.610+0000 7f8fee59c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8ff00cb5e0 0x7f8ff00af660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:35.613 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:35.610+0000 7f8fee59c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8ff00cb5e0 0x7f8ff00af660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:54714/0 (socket says 172.21.15.50:54714) 2023-10-06T01:22:35.614 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:35.610+0000 7f8fee59c700 1 -- 172.21.15.50:0/3180901240 learned_addr learned my addr 172.21.15.50:0/3180901240 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-06T01:22:35.614 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:35.610+0000 7f8feed9d700 1 --2- 172.21.15.50:0/3180901240 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8ff006db70 0x7f8ff00aca30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:35.614 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:35.610+0000 7f8fef59e700 1 --2- 172.21.15.50:0/3180901240 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8ff00afba0 0x7f8ff00c3f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:35.614 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:35.611+0000 7f8fee59c700 1 -- 172.21.15.50:0/3180901240 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8ff00afba0 msgr2=0x7f8ff00c3f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:35.614 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:35.611+0000 7f8fee59c700 1 --2- 172.21.15.50:0/3180901240 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8ff00afba0 0x7f8ff00c3f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:35.614 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:35.611+0000 7f8fee59c700 1 -- 172.21.15.50:0/3180901240 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8ff006db70 msgr2=0x7f8ff00aca30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:35.614 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:35.611+0000 7f8fee59c700 1 --2- 172.21.15.50:0/3180901240 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8ff006db70 0x7f8ff00aca30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:35.614 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:35.611+0000 7f8fee59c700 1 -- 172.21.15.50:0/3180901240 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8fe8009a20 con 0x7f8ff00cb5e0 2023-10-06T01:22:35.614 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:35.611+0000 7f8fee59c700 1 --2- 172.21.15.50:0/3180901240 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8ff00cb5e0 0x7f8ff00af660 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f8fe4006fd0 tx=0x7f8fe4017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:22:35.614 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:35.611+0000 7f8fd6ffd700 1 -- 172.21.15.50:0/3180901240 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fe4000d10 con 0x7f8ff00cb5e0 2023-10-06T01:22:35.614 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:35.611+0000 7f8fd6ffd700 1 -- 172.21.15.50:0/3180901240 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8fe400bb20 con 0x7f8ff00cb5e0 2023-10-06T01:22:35.615 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:35.611+0000 7f8fd6ffd700 1 -- 172.21.15.50:0/3180901240 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fe4011670 con 0x7f8ff00cb5e0 2023-10-06T01:22:35.615 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:35.611+0000 7f8ff49fe700 1 -- 172.21.15.50:0/3180901240 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8fe40094f0 con 0x7f8ff00cb5e0 2023-10-06T01:22:35.615 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:35.611+0000 7f8ff49fe700 1 -- 172.21.15.50:0/3180901240 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8ff00ac5a0 con 0x7f8ff00cb5e0 2023-10-06T01:22:35.615 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:35.612+0000 7f8ff49fe700 1 -- 172.21.15.50:0/3180901240 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8ff00ac730 con 0x7f8ff00cb5e0 2023-10-06T01:22:35.616 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:35.613+0000 7f8fd6ffd700 1 -- 172.21.15.50:0/3180901240 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f8fe40119e0 con 0x7f8ff00cb5e0 2023-10-06T01:22:35.616 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:35.614+0000 7f8fd6ffd700 1 --2- 172.21.15.50:0/3180901240 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f8fdc066f30 0x7f8fdc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:35.616 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:35.614+0000 7f8fd6ffd700 1 -- 172.21.15.50:0/3180901240 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6867+0+0 (secure 0 0 0) 0x7f8fe4086280 con 0x7f8ff00cb5e0 2023-10-06T01:22:35.616 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:35.614+0000 7f8feed9d700 1 --2- 172.21.15.50:0/3180901240 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f8fdc066f30 0x7f8fdc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:35.616 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:35.615+0000 7f8feed9d700 1 --2- 172.21.15.50:0/3180901240 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f8fdc066f30 0x7f8fdc0693e0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f8fe0009d40 tx=0x7f8fe0008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:22:35.619 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:35.618+0000 7f8fd6ffd700 1 -- 172.21.15.50:0/3180901240 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f8fe4052fc0 con 0x7f8ff00cb5e0 2023-10-06T01:22:35.914 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:35.913+0000 7f8ff49fe700 1 -- 172.21.15.50:0/3180901240 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_acls.TestACLs.test_acls"]} v 0) v1 -- 0x7f8ff005f270 con 0x7f8ff00cb5e0 2023-10-06T01:22:36.916 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:36.915+0000 7f8fd6ffd700 1 -- 172.21.15.50:0/3180901240 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_acls.TestACLs.test_acls"]}]=0 v71) v1 ==== 123+0+0 (secure 0 0 0) 0x7f8fe40565e0 con 0x7f8ff00cb5e0 2023-10-06T01:22:36.919 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:36.918+0000 7f8ff49fe700 1 -- 172.21.15.50:0/3180901240 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f8fdc066f30 msgr2=0x7f8fdc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:36.920 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:36.918+0000 7f8ff49fe700 1 --2- 172.21.15.50:0/3180901240 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f8fdc066f30 0x7f8fdc0693e0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f8fe0009d40 tx=0x7f8fe0008040 comp rx=0 tx=0).stop 2023-10-06T01:22:36.920 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:36.918+0000 7f8ff49fe700 1 -- 172.21.15.50:0/3180901240 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8ff00cb5e0 msgr2=0x7f8ff00af660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:36.920 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:36.918+0000 7f8ff49fe700 1 --2- 172.21.15.50:0/3180901240 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8ff00cb5e0 0x7f8ff00af660 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f8fe4006fd0 tx=0x7f8fe4017000 comp rx=0 tx=0).stop 2023-10-06T01:22:36.920 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:36.918+0000 7f8ff49fe700 1 -- 172.21.15.50:0/3180901240 shutdown_connections 2023-10-06T01:22:36.920 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:36.918+0000 7f8ff49fe700 1 --2- 172.21.15.50:0/3180901240 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8ff00afba0 0x7f8ff00c3f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:36.920 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:36.918+0000 7f8ff49fe700 1 --2- 172.21.15.50:0/3180901240 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f8fdc066f30 0x7f8fdc0693e0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:36.920 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:36.918+0000 7f8ff49fe700 1 --2- 172.21.15.50:0/3180901240 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8ff006db70 0x7f8ff00aca30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:36.920 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:36.918+0000 7f8ff49fe700 1 --2- 172.21.15.50:0/3180901240 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8ff00cb5e0 0x7f8ff00af660 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:36.920 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:36.918+0000 7f8ff49fe700 1 -- 172.21.15.50:0/3180901240 >> 172.21.15.50:0/3180901240 conn(0x7f8ff00680c0 msgr2=0x7f8ff00c6930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:22:36.920 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:36.919+0000 7f8ff49fe700 1 -- 172.21.15.50:0/3180901240 shutdown_connections 2023-10-06T01:22:36.920 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:36.919+0000 7f8ff49fe700 1 -- 172.21.15.50:0/3180901240 wait complete. 2023-10-06T01:22:36.940 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-10-06T01:22:37.135 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:37.134+0000 7fab73fff700 1 Processor -- start 2023-10-06T01:22:37.135 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:37.134+0000 7fab73fff700 1 -- start start 2023-10-06T01:22:37.136 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:37.135+0000 7fab73fff700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fab740b2660 0x7fab740cccf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:37.136 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:37.135+0000 7fab73fff700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fab740b2a30 0x7fab740cd230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:37.136 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:37.135+0000 7fab73fff700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fab740cc9b0 con 0x7fab740ceae0 2023-10-06T01:22:37.137 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:37.135+0000 7fab73fff700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fab740cbda0 con 0x7fab740b2a30 2023-10-06T01:22:37.137 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:37.135+0000 7fab73fff700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab740cc080 con 0x7fab740b2660 2023-10-06T01:22:37.137 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:37.136+0000 7fab737fe700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fab740ceae0 0x7fab740cef80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:56850/0 (socket says 172.21.15.50:56850) 2023-10-06T01:22:37.137 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:37.136+0000 7fab737fe700 1 -- 172.21.15.50:0/3380746075 learned_addr learned my addr 172.21.15.50:0/3380746075 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-10-06T01:22:37.139 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:37.136+0000 7fab727fc700 1 --2- 172.21.15.50:0/3380746075 >> v2:172.21.15.155:3300/0 conn(0x7fab740b2a30 0x7fab740cd230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:37.140 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:37.136+0000 7fab72ffd700 1 --2- 172.21.15.50:0/3380746075 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fab740b2660 0x7fab740cccf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:37.140 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:37.136+0000 7fab71ffb700 1 -- 172.21.15.50:0/3380746075 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2618172455 0 0) 0x7fab740cc9b0 con 0x7fab740ceae0 2023-10-06T01:22:37.140 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:37.136+0000 7fab71ffb700 1 -- 172.21.15.50:0/3380746075 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fab5c003570 con 0x7fab740ceae0 2023-10-06T01:22:37.140 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:37.136+0000 7fab71ffb700 1 -- 172.21.15.50:0/3380746075 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2071156278 0 0) 0x7fab5c003570 con 0x7fab740ceae0 2023-10-06T01:22:37.140 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:37.136+0000 7fab71ffb700 1 -- 172.21.15.50:0/3380746075 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fab740b2660 msgr2=0x7fab740cccf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:22:37.140 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:37.136+0000 7fab71ffb700 1 --2- 172.21.15.50:0/3380746075 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fab740b2660 0x7fab740cccf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:37.140 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:37.137+0000 7fab71ffb700 1 -- 172.21.15.50:0/3380746075 >> v2:172.21.15.155:3300/0 conn(0x7fab740b2a30 msgr2=0x7fab740cd230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:22:37.140 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:37.137+0000 7fab71ffb700 1 --2- 172.21.15.50:0/3380746075 >> v2:172.21.15.155:3300/0 conn(0x7fab740b2a30 0x7fab740cd230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:37.140 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:37.137+0000 7fab71ffb700 1 -- 172.21.15.50:0/3380746075 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab740cc360 con 0x7fab740ceae0 2023-10-06T01:22:37.140 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:37.137+0000 7fab71ffb700 1 -- 172.21.15.50:0/3380746075 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 347519148 0 0) 0x7fab6c0017f0 con 0x7fab740ceae0 2023-10-06T01:22:37.140 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:37.137+0000 7fab71ffb700 1 -- 172.21.15.50:0/3380746075 >> v1:172.21.15.50:6789/0 conn(0x7fab740ceae0 legacy=0x7fab740cef80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:37.141 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:37.137+0000 7fab71ffb700 1 --2- 172.21.15.50:0/3380746075 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fab5c003a60 0x7fab5c003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:37.141 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:37.137+0000 7fab71ffb700 1 --2- 172.21.15.50:0/3380746075 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fab5c004810 0x7fab5c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:37.141 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:37.137+0000 7fab71ffb700 1 --2- 172.21.15.50:0/3380746075 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fab5c0051c0 0x7fab5c00ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:37.141 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:37.137+0000 7fab71ffb700 1 -- 172.21.15.50:0/3380746075 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab740cbda0 con 0x7fab5c003a60 2023-10-06T01:22:37.141 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:37.137+0000 7fab71ffb700 1 -- 172.21.15.50:0/3380746075 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab740cc080 con 0x7fab5c0051c0 2023-10-06T01:22:37.141 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:37.137+0000 7fab71ffb700 1 -- 172.21.15.50:0/3380746075 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab5c00bfa0 con 0x7fab5c004810 2023-10-06T01:22:37.141 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:37.137+0000 7fab727fc700 1 --2- 172.21.15.50:0/3380746075 >> v2:172.21.15.155:3300/0 conn(0x7fab740b2a30 0x7fab740cd230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T01:22:37.141 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:37.137+0000 7fab72ffd700 1 --2- 172.21.15.50:0/3380746075 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fab740b2660 0x7fab740cccf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T01:22:37.141 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:37.137+0000 7fab72ffd700 1 --2- 172.21.15.50:0/3380746075 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fab5c003a60 0x7fab5c003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:37.141 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:37.137+0000 7fab727fc700 1 --2- 172.21.15.50:0/3380746075 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fab5c004810 0x7fab5c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:37.141 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:37.137+0000 7fab72ffd700 1 -- 172.21.15.50:0/3380746075 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fab5c004810 msgr2=0x7fab5c004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:22:37.141 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:37.137+0000 7fab72ffd700 1 --2- 172.21.15.50:0/3380746075 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fab5c004810 0x7fab5c004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:37.141 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:37.137+0000 7fab72ffd700 1 -- 172.21.15.50:0/3380746075 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fab5c0051c0 msgr2=0x7fab5c00ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:22:37.142 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:37.137+0000 7fab72ffd700 1 --2- 172.21.15.50:0/3380746075 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fab5c0051c0 0x7fab5c00ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:37.142 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:37.137+0000 7fab72ffd700 1 -- 172.21.15.50:0/3380746075 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab5c003570 con 0x7fab5c003a60 2023-10-06T01:22:37.142 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:37.137+0000 7fab727fc700 1 --2- 172.21.15.50:0/3380746075 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fab5c004810 0x7fab5c004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T01:22:37.142 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:37.138+0000 7fab72ffd700 1 --2- 172.21.15.50:0/3380746075 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fab5c003a60 0x7fab5c003e70 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fab740d1390 tx=0x7fab64009120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=465be0c4da94d511 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:22:37.142 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:37.138+0000 7fab71ffb700 1 -- 172.21.15.50:0/3380746075 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab6400e710 con 0x7fab5c003a60 2023-10-06T01:22:37.142 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:37.138+0000 7fab71ffb700 1 -- 172.21.15.50:0/3380746075 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab6400e870 con 0x7fab5c003a60 2023-10-06T01:22:37.142 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:37.138+0000 7fab71ffb700 1 -- 172.21.15.50:0/3380746075 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab6400ec10 con 0x7fab5c003a60 2023-10-06T01:22:37.142 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:37.138+0000 7fab73fff700 1 -- 172.21.15.50:0/3380746075 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fab5c003a60 msgr2=0x7fab5c003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:37.142 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:37.138+0000 7fab73fff700 1 --2- 172.21.15.50:0/3380746075 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fab5c003a60 0x7fab5c003e70 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fab740d1390 tx=0x7fab64009120 comp rx=0 tx=0).stop 2023-10-06T01:22:37.142 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:37.138+0000 7fab737fe700 1 -- 172.21.15.50:0/3380746075 reap_dead start 2023-10-06T01:22:37.142 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:37.139+0000 7fab73fff700 1 -- 172.21.15.50:0/3380746075 shutdown_connections 2023-10-06T01:22:37.142 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:37.139+0000 7fab73fff700 1 -- 172.21.15.50:0/3380746075 >> 172.21.15.50:0/3380746075 conn(0x7fab74099560 msgr2=0x7fab7406f500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:22:37.143 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:37.139+0000 7fab73fff700 1 -- 172.21.15.50:0/3380746075 shutdown_connections 2023-10-06T01:22:37.143 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:37.139+0000 7fab73fff700 1 -- 172.21.15.50:0/3380746075 wait complete. 2023-10-06T01:22:37.144 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:37.140+0000 7fab73fff700 1 Processor -- start 2023-10-06T01:22:37.144 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:37.140+0000 7fab73fff700 1 -- start start 2023-10-06T01:22:37.145 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:37.141+0000 7fab73fff700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fab5c003a60 0x7fab74154090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:37.145 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:37.141+0000 7fab73fff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fab7415bcd0 0x7fab7415c140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:37.145 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:37.141+0000 7fab73fff700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fab74159c00 0x7fab7415a0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:37.145 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:37.141+0000 7fab73fff700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab741545d0 con 0x7fab7415bcd0 2023-10-06T01:22:37.145 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:37.141+0000 7fab73fff700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab7415b540 con 0x7fab74159c00 2023-10-06T01:22:37.145 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:37.141+0000 7fab73fff700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab7415c680 con 0x7fab5c003a60 2023-10-06T01:22:37.145 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:37.141+0000 7fab727fc700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fab7415bcd0 0x7fab7415c140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:37.145 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:37.141+0000 7fab727fc700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fab7415bcd0 0x7fab7415c140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:54728/0 (socket says 172.21.15.50:54728) 2023-10-06T01:22:37.145 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:37.141+0000 7fab727fc700 1 -- 172.21.15.50:0/1371630675 learned_addr learned my addr 172.21.15.50:0/1371630675 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-06T01:22:37.145 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:37.141+0000 7fab72ffd700 1 --2- 172.21.15.50:0/1371630675 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fab5c003a60 0x7fab74154090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:37.145 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:37.141+0000 7fab737fe700 1 --2- 172.21.15.50:0/1371630675 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fab74159c00 0x7fab7415a0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:37.146 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:37.142+0000 7fab727fc700 1 -- 172.21.15.50:0/1371630675 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fab5c003a60 msgr2=0x7fab74154090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:37.146 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:37.142+0000 7fab727fc700 1 --2- 172.21.15.50:0/1371630675 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fab5c003a60 0x7fab74154090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:37.146 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:37.142+0000 7fab727fc700 1 -- 172.21.15.50:0/1371630675 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fab74159c00 msgr2=0x7fab7415a0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:37.146 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:37.142+0000 7fab727fc700 1 --2- 172.21.15.50:0/1371630675 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fab74159c00 0x7fab7415a0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:37.146 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:37.142+0000 7fab727fc700 1 -- 172.21.15.50:0/1371630675 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab7415a930 con 0x7fab7415bcd0 2023-10-06T01:22:37.146 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:37.142+0000 7fab727fc700 1 --2- 172.21.15.50:0/1371630675 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fab7415bcd0 0x7fab7415c140 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fab68010ca0 tx=0x7fab68008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:22:37.146 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:37.142+0000 7fab5affd700 1 -- 172.21.15.50:0/1371630675 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab6800e940 con 0x7fab7415bcd0 2023-10-06T01:22:37.146 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:37.142+0000 7fab5affd700 1 -- 172.21.15.50:0/1371630675 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab6800eaa0 con 0x7fab7415bcd0 2023-10-06T01:22:37.146 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:37.142+0000 7fab73fff700 1 -- 172.21.15.50:0/1371630675 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fab7415ac10 con 0x7fab7415bcd0 2023-10-06T01:22:37.146 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:37.142+0000 7fab5affd700 1 -- 172.21.15.50:0/1371630675 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab6800ee20 con 0x7fab7415bcd0 2023-10-06T01:22:37.146 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:37.142+0000 7fab73fff700 1 -- 172.21.15.50:0/1371630675 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fab7415b1d0 con 0x7fab7415bcd0 2023-10-06T01:22:37.146 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:37.143+0000 7fab73fff700 1 -- 172.21.15.50:0/1371630675 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fab7405f270 con 0x7fab7415bcd0 2023-10-06T01:22:37.147 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:37.144+0000 7fab5affd700 1 -- 172.21.15.50:0/1371630675 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fab680143f0 con 0x7fab7415bcd0 2023-10-06T01:22:37.147 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:37.145+0000 7fab5affd700 1 --2- 172.21.15.50:0/1371630675 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7fab60066f30 0x7fab600693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:37.147 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:37.145+0000 7fab5affd700 1 -- 172.21.15.50:0/1371630675 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6867+0+0 (secure 0 0 0) 0x7fab68084fb0 con 0x7fab7415bcd0 2023-10-06T01:22:37.147 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:37.146+0000 7fab72ffd700 1 --2- 172.21.15.50:0/1371630675 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7fab60066f30 0x7fab600693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:37.148 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:37.146+0000 7fab72ffd700 1 --2- 172.21.15.50:0/1371630675 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7fab60066f30 0x7fab600693e0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fab64009570 tx=0x7fab64019000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:22:37.150 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:37.149+0000 7fab5affd700 1 -- 172.21.15.50:0/1371630675 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fab68051cf0 con 0x7fab7415bcd0 2023-10-06T01:22:37.353 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:37.352+0000 7fab73fff700 1 -- 172.21.15.50:0/1371630675 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7fab740cc640 con 0x7fab7415bcd0 2023-10-06T01:22:37.357 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:37.356+0000 7fab5affd700 1 -- 172.21.15.50:0/1371630675 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v10)=0 v10) v1 ==== 122+0+0 (secure 0 0 0) 0x7fab68055310 con 0x7fab7415bcd0 2023-10-06T01:22:37.359 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:37.358+0000 7fab73fff700 1 -- 172.21.15.50:0/1371630675 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7fab60066f30 msgr2=0x7fab600693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:37.360 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:37.358+0000 7fab73fff700 1 --2- 172.21.15.50:0/1371630675 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7fab60066f30 0x7fab600693e0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fab64009570 tx=0x7fab64019000 comp rx=0 tx=0).stop 2023-10-06T01:22:37.360 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:37.358+0000 7fab73fff700 1 -- 172.21.15.50:0/1371630675 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fab7415bcd0 msgr2=0x7fab7415c140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:37.360 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:37.358+0000 7fab73fff700 1 --2- 172.21.15.50:0/1371630675 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fab7415bcd0 0x7fab7415c140 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fab68010ca0 tx=0x7fab68008040 comp rx=0 tx=0).stop 2023-10-06T01:22:37.360 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:37.358+0000 7fab73fff700 1 -- 172.21.15.50:0/1371630675 shutdown_connections 2023-10-06T01:22:37.360 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:37.358+0000 7fab73fff700 1 --2- 172.21.15.50:0/1371630675 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7fab60066f30 0x7fab600693e0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:37.360 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:37.358+0000 7fab73fff700 1 --2- 172.21.15.50:0/1371630675 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fab74159c00 0x7fab7415a0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:37.360 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:37.358+0000 7fab73fff700 1 --2- 172.21.15.50:0/1371630675 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fab5c003a60 0x7fab74154090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:37.360 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:37.358+0000 7fab73fff700 1 --2- 172.21.15.50:0/1371630675 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fab7415bcd0 0x7fab7415c140 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:37.360 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:37.358+0000 7fab73fff700 1 -- 172.21.15.50:0/1371630675 >> 172.21.15.50:0/1371630675 conn(0x7fab74099560 msgr2=0x7fab74156b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:22:37.360 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:37.358+0000 7fab73fff700 1 -- 172.21.15.50:0/1371630675 shutdown_connections 2023-10-06T01:22:37.360 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:37.359+0000 7fab73fff700 1 -- 172.21.15.50:0/1371630675 wait complete. 2023-10-06T01:22:37.377 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-10-06T01:22:37.377 DEBUG:teuthology.orchestra.run.smithi050:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-06T01:22:37.463 DEBUG:teuthology.orchestra.run.smithi155:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-06T01:22:37.560 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-10-06T01:22:37.560 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-10-06T01:22:37.560 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T01:22:37.560 DEBUG:teuthology.orchestra.run.smithi050:> sudo umount /home/ubuntu/cephtest/mnt.0 -f 2023-10-06T01:22:37.669 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi050.front.sepia.ceph.com 2023-10-06T01:22:37.670 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T01:22:37.670 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-10-06T01:22:37.708 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2023-10-06T01:22:37.708 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T01:22:37.708 DEBUG:teuthology.orchestra.run.smithi155:> sudo umount /home/ubuntu/cephtest/mnt.1 -f 2023-10-06T01:22:37.801 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi155.front.sepia.ceph.com 2023-10-06T01:22:37.801 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T01:22:37.802 DEBUG:teuthology.orchestra.run.smithi155:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-10-06T01:22:37.847 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.2... 2023-10-06T01:22:37.847 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T01:22:37.848 DEBUG:teuthology.orchestra.run.smithi050:> sudo umount /home/ubuntu/cephtest/mnt.2 -f 2023-10-06T01:22:37.932 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi050.front.sepia.ceph.com 2023-10-06T01:22:37.932 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T01:22:37.932 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2023-10-06T01:22:37.969 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.3... 2023-10-06T01:22:37.970 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T01:22:37.970 DEBUG:teuthology.orchestra.run.smithi155:> sudo umount /home/ubuntu/cephtest/mnt.3 -f 2023-10-06T01:22:38.050 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi155.front.sepia.ceph.com 2023-10-06T01:22:38.050 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T01:22:38.050 DEBUG:teuthology.orchestra.run.smithi155:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2023-10-06T01:22:38.087 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-10-06T01:22:38.088 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T01:22:38.274 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:38.273+0000 7f6a5c99d700 1 Processor -- start 2023-10-06T01:22:38.274 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:38.273+0000 7f6a5c99d700 1 -- start start 2023-10-06T01:22:38.276 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:38.275+0000 7f6a5c99d700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f6a5806a5d0 0x7f6a58153730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:38.277 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:38.275+0000 7f6a5c99d700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f6a5806a9a0 0x7f6a58153c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:38.277 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:38.275+0000 7f6a5c99d700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6a580c9d00 con 0x7f6a5806df90 2023-10-06T01:22:38.277 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:38.275+0000 7f6a5c99d700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6a5806f5a0 con 0x7f6a5806a9a0 2023-10-06T01:22:38.277 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:38.275+0000 7f6a5c99d700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6a5806eae0 con 0x7f6a5806a5d0 2023-10-06T01:22:38.277 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:38.275+0000 7f6a56ffd700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f6a5806a9a0 0x7f6a58153c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:38.277 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:38.275+0000 7f6a56ffd700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f6a5806a9a0 0x7f6a58153c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:54738/0 (socket says 172.21.15.50:54738) 2023-10-06T01:22:38.277 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:38.275+0000 7f6a56ffd700 1 -- 172.21.15.50:0/3809297951 learned_addr learned my addr 172.21.15.50:0/3809297951 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-06T01:22:38.277 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:38.275+0000 7f6a577fe700 1 --2- 172.21.15.50:0/3809297951 >> v2:172.21.15.155:3300/0 conn(0x7f6a5806a5d0 0x7f6a58153730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:38.277 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:38.276+0000 7f6a56ffd700 1 -- 172.21.15.50:0/3809297951 >> v2:172.21.15.155:3300/0 conn(0x7f6a5806a5d0 msgr2=0x7f6a58153730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:22:38.277 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:38.276+0000 7f6a56ffd700 1 --2- 172.21.15.50:0/3809297951 >> v2:172.21.15.155:3300/0 conn(0x7f6a5806a5d0 0x7f6a58153730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:38.278 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:38.276+0000 7f6a56ffd700 1 -- 172.21.15.50:0/3809297951 >> v1:172.21.15.155:6789/0 conn(0x7f6a5806df90 legacy=0x7f6a5806e3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:38.278 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:38.276+0000 7f6a56ffd700 1 -- 172.21.15.50:0/3809297951 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a580c6750 con 0x7f6a5806a9a0 2023-10-06T01:22:38.278 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:38.276+0000 7f6a56ffd700 1 --2- 172.21.15.50:0/3809297951 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6a5806a9a0 0x7f6a58153c70 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f6a5806c6a0 tx=0x7f6a4c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4c5f4f8ad943fe1 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:22:38.281 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:38.276+0000 7f6a567fc700 1 -- 172.21.15.50:0/3809297951 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a4c009ea0 con 0x7f6a5806a9a0 2023-10-06T01:22:38.281 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:38.276+0000 7f6a567fc700 1 -- 172.21.15.50:0/3809297951 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a4c00b820 con 0x7f6a5806a9a0 2023-10-06T01:22:38.281 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:38.276+0000 7f6a567fc700 1 -- 172.21.15.50:0/3809297951 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a4c00bbc0 con 0x7f6a5806a9a0 2023-10-06T01:22:38.281 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:38.277+0000 7f6a5c99d700 1 -- 172.21.15.50:0/3809297951 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6a5806a9a0 msgr2=0x7f6a58153c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:38.281 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:38.277+0000 7f6a5c99d700 1 --2- 172.21.15.50:0/3809297951 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6a5806a9a0 0x7f6a58153c70 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f6a5806c6a0 tx=0x7f6a4c009250 comp rx=0 tx=0).stop 2023-10-06T01:22:38.282 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:38.277+0000 7f6a5c99d700 1 -- 172.21.15.50:0/3809297951 shutdown_connections 2023-10-06T01:22:38.282 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:38.277+0000 7f6a5c99d700 1 --2- 172.21.15.50:0/3809297951 >> v2:172.21.15.155:3300/0 conn(0x7f6a5806a5d0 0x7f6a58153730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:38.282 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:38.277+0000 7f6a5c99d700 1 --2- 172.21.15.50:0/3809297951 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6a5806a9a0 0x7f6a58153c70 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:38.282 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:38.277+0000 7f6a5c99d700 1 -- 172.21.15.50:0/3809297951 >> 172.21.15.50:0/3809297951 conn(0x7f6a580680c0 msgr2=0x7f6a580cbf00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:22:38.282 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:38.277+0000 7f6a5c99d700 1 -- 172.21.15.50:0/3809297951 shutdown_connections 2023-10-06T01:22:38.282 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:38.277+0000 7f6a5c99d700 1 -- 172.21.15.50:0/3809297951 wait complete. 2023-10-06T01:22:38.282 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:38.278+0000 7f6a5c99d700 1 Processor -- start 2023-10-06T01:22:38.282 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:38.278+0000 7f6a5c99d700 1 -- start start 2023-10-06T01:22:38.285 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:38.279+0000 7f6a5c99d700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6a5806a5d0 0x7f6a58150a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:38.285 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:38.279+0000 7f6a5c99d700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6a5806a9a0 0x7f6a58069270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:38.285 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:38.279+0000 7f6a5c99d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6a5806df90 0x7f6a580697b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:38.285 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:38.279+0000 7f6a5c99d700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a581594f0 con 0x7f6a5806df90 2023-10-06T01:22:38.285 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:38.279+0000 7f6a5c99d700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a580b1960 con 0x7f6a5806a9a0 2023-10-06T01:22:38.286 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:38.279+0000 7f6a5c99d700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a580b14d0 con 0x7f6a5806a5d0 2023-10-06T01:22:38.286 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:38.280+0000 7f6a57fff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6a5806df90 0x7f6a580697b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:38.286 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:38.280+0000 7f6a57fff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6a5806df90 0x7f6a580697b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:54754/0 (socket says 172.21.15.50:54754) 2023-10-06T01:22:38.286 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:38.280+0000 7f6a57fff700 1 -- 172.21.15.50:0/2372402704 learned_addr learned my addr 172.21.15.50:0/2372402704 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-06T01:22:38.286 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:38.280+0000 7f6a57fff700 1 -- 172.21.15.50:0/2372402704 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6a5806a5d0 msgr2=0x7f6a58150a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:38.286 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:38.280+0000 7f6a57fff700 1 --2- 172.21.15.50:0/2372402704 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6a5806a5d0 0x7f6a58150a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:38.286 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:38.280+0000 7f6a57fff700 1 -- 172.21.15.50:0/2372402704 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6a5806a9a0 msgr2=0x7f6a58069270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:38.286 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:38.280+0000 7f6a56ffd700 1 --2- 172.21.15.50:0/2372402704 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6a5806a9a0 0x7f6a58069270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:38.286 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:38.280+0000 7f6a57fff700 1 --2- 172.21.15.50:0/2372402704 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6a5806a9a0 0x7f6a58069270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:38.286 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:38.280+0000 7f6a57fff700 1 -- 172.21.15.50:0/2372402704 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a4c0094f0 con 0x7f6a5806df90 2023-10-06T01:22:38.287 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:38.280+0000 7f6a56ffd700 1 --2- 172.21.15.50:0/2372402704 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6a5806a9a0 0x7f6a58069270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T01:22:38.287 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:38.280+0000 7f6a57fff700 1 --2- 172.21.15.50:0/2372402704 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6a5806df90 0x7f6a580697b0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f6a5000c940 tx=0x7f6a500016d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:22:38.287 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:38.280+0000 7f6a3f7fe700 1 -- 172.21.15.50:0/2372402704 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a5000ce80 con 0x7f6a5806df90 2023-10-06T01:22:38.287 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:38.281+0000 7f6a3f7fe700 1 -- 172.21.15.50:0/2372402704 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a5000a7a0 con 0x7f6a5806df90 2023-10-06T01:22:38.287 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:38.281+0000 7f6a3f7fe700 1 -- 172.21.15.50:0/2372402704 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a5000ab60 con 0x7f6a5806df90 2023-10-06T01:22:38.287 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:38.281+0000 7f6a5c99d700 1 -- 172.21.15.50:0/2372402704 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6a580b08c0 con 0x7f6a5806df90 2023-10-06T01:22:38.287 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:38.281+0000 7f6a5c99d700 1 -- 172.21.15.50:0/2372402704 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6a580b0e80 con 0x7f6a5806df90 2023-10-06T01:22:38.287 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:38.282+0000 7f6a5c99d700 1 -- 172.21.15.50:0/2372402704 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6a580c4130 con 0x7f6a5806df90 2023-10-06T01:22:38.287 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:38.282+0000 7f6a3f7fe700 1 -- 172.21.15.50:0/2372402704 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f6a50003030 con 0x7f6a5806df90 2023-10-06T01:22:38.287 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:38.283+0000 7f6a3f7fe700 1 --2- 172.21.15.50:0/2372402704 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f6a44066f30 0x7f6a440693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:38.288 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:38.284+0000 7f6a3f7fe700 1 -- 172.21.15.50:0/2372402704 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6867+0+0 (secure 0 0 0) 0x7f6a50084ac0 con 0x7f6a5806df90 2023-10-06T01:22:38.288 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:38.284+0000 7f6a577fe700 1 --2- 172.21.15.50:0/2372402704 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f6a44066f30 0x7f6a440693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:38.288 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:38.284+0000 7f6a577fe700 1 --2- 172.21.15.50:0/2372402704 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f6a44066f30 0x7f6a440693e0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f6a48009b10 tx=0x7f6a480091a0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:22:38.288 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:38.287+0000 7f6a3f7fe700 1 -- 172.21.15.50:0/2372402704 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f6a50051800 con 0x7f6a5806df90 2023-10-06T01:22:38.539 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:38.538+0000 7f6a5c99d700 1 -- 172.21.15.50:0/2372402704 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f6a580b1660 con 0x7f6a5806df90 2023-10-06T01:22:38.540 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:38.539+0000 7f6a3f7fe700 1 -- 172.21.15.50:0/2372402704 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4593 (secure 0 0 0) 0x7f6a50054e20 con 0x7f6a5806df90 2023-10-06T01:22:38.540 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-10-06T01:22:38.540 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4214,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6835/33654067","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6833","nonce":33654067},{"type":"v1","addr":"172.21.15.50:6835","nonce":33654067}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4279,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6836/2571345069","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":2571345069},{"type":"v1","addr":"172.21.15.155:6836","nonce":2571345069}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4290,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6834/4140731341","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6832","nonce":4140731341},{"type":"v1","addr":"172.21.15.50:6834","nonce":4140731341}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T01:21:36.779774+0000","modified":"2023-10-06T01:21:58.876370+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4302},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4302":{"gid":4302,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.155:6837/3434423585","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6835","nonce":3434423585},{"type":"v1","addr":"172.21.15.155:6837","nonce":3434423585}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2023-10-06T01:22:38.542 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:38.541+0000 7f6a5c99d700 1 -- 172.21.15.50:0/2372402704 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f6a44066f30 msgr2=0x7f6a440693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:38.543 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:38.541+0000 7f6a5c99d700 1 --2- 172.21.15.50:0/2372402704 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f6a44066f30 0x7f6a440693e0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f6a48009b10 tx=0x7f6a480091a0 comp rx=0 tx=0).stop 2023-10-06T01:22:38.543 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:38.541+0000 7f6a5c99d700 1 -- 172.21.15.50:0/2372402704 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6a5806df90 msgr2=0x7f6a580697b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:38.543 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:38.541+0000 7f6a5c99d700 1 --2- 172.21.15.50:0/2372402704 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6a5806df90 0x7f6a580697b0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f6a5000c940 tx=0x7f6a500016d0 comp rx=0 tx=0).stop 2023-10-06T01:22:38.543 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:38.541+0000 7f6a5c99d700 1 -- 172.21.15.50:0/2372402704 shutdown_connections 2023-10-06T01:22:38.543 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:38.541+0000 7f6a5c99d700 1 --2- 172.21.15.50:0/2372402704 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6a5806df90 0x7f6a580697b0 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:38.543 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:38.541+0000 7f6a5c99d700 1 --2- 172.21.15.50:0/2372402704 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6a5806a5d0 0x7f6a58150a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:38.543 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:38.541+0000 7f6a5c99d700 1 --2- 172.21.15.50:0/2372402704 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f6a44066f30 0x7f6a440693e0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:38.543 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:38.541+0000 7f6a5c99d700 1 --2- 172.21.15.50:0/2372402704 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6a5806a9a0 0x7f6a58069270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:38.543 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:38.541+0000 7f6a5c99d700 1 -- 172.21.15.50:0/2372402704 >> 172.21.15.50:0/2372402704 conn(0x7f6a580680c0 msgr2=0x7f6a580cb790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:22:38.543 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:38.542+0000 7f6a5c99d700 1 -- 172.21.15.50:0/2372402704 shutdown_connections 2023-10-06T01:22:38.543 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:38.542+0000 7f6a5c99d700 1 -- 172.21.15.50:0/2372402704 wait complete. 2023-10-06T01:22:38.544 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 9 2023-10-06T01:22:38.561 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T01:22:38.749 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:38.748+0000 7fa71a39d700 1 Processor -- start 2023-10-06T01:22:38.749 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:38.748+0000 7fa71a39d700 1 -- start start 2023-10-06T01:22:38.751 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:38.749+0000 7fa71a39d700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa7140689b0 0x7fa71415d9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:38.751 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:38.749+0000 7fa71a39d700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fa7140cc0d0 0x7fa7140c6d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:38.751 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:38.749+0000 7fa71a39d700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa71415a860 con 0x7fa714068d80 2023-10-06T01:22:38.751 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:38.749+0000 7fa71a39d700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa7140cac60 con 0x7fa7140cc0d0 2023-10-06T01:22:38.751 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:38.749+0000 7fa71a39d700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7140c7400 con 0x7fa7140689b0 2023-10-06T01:22:38.751 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:38.749+0000 7fa719b9c700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fa7140cc0d0 0x7fa7140c6d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:38.751 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:38.750+0000 7fa718b9a700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fa714068d80 0x7fa7140cb9c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:56856/0 (socket says 172.21.15.50:56856) 2023-10-06T01:22:38.751 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:38.750+0000 7fa718b9a700 1 -- 172.21.15.50:0/3858220249 learned_addr learned my addr 172.21.15.50:0/3858220249 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-10-06T01:22:38.752 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:38.750+0000 7fa71939b700 1 --2- 172.21.15.50:0/3858220249 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa7140689b0 0x7fa71415d9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:38.752 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:38.750+0000 7fa719b9c700 1 -- 172.21.15.50:0/3858220249 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa7140689b0 msgr2=0x7fa71415d9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:22:38.752 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:38.750+0000 7fa719b9c700 1 --2- 172.21.15.50:0/3858220249 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa7140689b0 0x7fa71415d9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:38.752 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:38.750+0000 7fa719b9c700 1 -- 172.21.15.50:0/3858220249 >> v1:172.21.15.50:6789/0 conn(0x7fa714068d80 legacy=0x7fa7140cb9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:38.752 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:38.750+0000 7fa719b9c700 1 -- 172.21.15.50:0/3858220249 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7140ca330 con 0x7fa7140cc0d0 2023-10-06T01:22:38.752 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:38.750+0000 7fa70bfff700 1 -- 172.21.15.50:0/3858220249 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2985467586 0 0) 0x7fa71415a860 con 0x7fa714068d80 2023-10-06T01:22:38.752 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:38.750+0000 7fa719b9c700 1 --2- 172.21.15.50:0/3858220249 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa7140cc0d0 0x7fa7140c6d00 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fa70c009e60 tx=0x7fa70c009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1773ded992881114 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:22:38.753 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:38.751+0000 7fa70bfff700 1 -- 172.21.15.50:0/3858220249 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa70c00e070 con 0x7fa7140cc0d0 2023-10-06T01:22:38.753 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:38.751+0000 7fa70bfff700 1 -- 172.21.15.50:0/3858220249 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa70c00bc30 con 0x7fa7140cc0d0 2023-10-06T01:22:38.753 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:38.751+0000 7fa70bfff700 1 -- 172.21.15.50:0/3858220249 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa70c012430 con 0x7fa7140cc0d0 2023-10-06T01:22:38.754 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:38.751+0000 7fa71a39d700 1 -- 172.21.15.50:0/3858220249 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa7140cc0d0 msgr2=0x7fa7140c6d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:38.754 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:38.751+0000 7fa71a39d700 1 --2- 172.21.15.50:0/3858220249 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa7140cc0d0 0x7fa7140c6d00 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fa70c009e60 tx=0x7fa70c009780 comp rx=0 tx=0).stop 2023-10-06T01:22:38.754 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:38.751+0000 7fa71a39d700 1 -- 172.21.15.50:0/3858220249 shutdown_connections 2023-10-06T01:22:38.754 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:38.751+0000 7fa71a39d700 1 --2- 172.21.15.50:0/3858220249 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa7140cc0d0 0x7fa7140c6d00 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:38.754 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:38.751+0000 7fa71a39d700 1 --2- 172.21.15.50:0/3858220249 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa7140689b0 0x7fa71415d9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:38.754 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:38.751+0000 7fa71a39d700 1 -- 172.21.15.50:0/3858220249 >> 172.21.15.50:0/3858220249 conn(0x7fa7140cd230 msgr2=0x7fa7140c91d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:22:38.754 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:38.751+0000 7fa71a39d700 1 -- 172.21.15.50:0/3858220249 shutdown_connections 2023-10-06T01:22:38.754 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:38.751+0000 7fa71a39d700 1 -- 172.21.15.50:0/3858220249 wait complete. 2023-10-06T01:22:38.754 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:38.753+0000 7fa71a39d700 1 Processor -- start 2023-10-06T01:22:38.754 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:38.753+0000 7fa71a39d700 1 -- start start 2023-10-06T01:22:38.756 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:38.754+0000 7fa71a39d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa7140689b0 0x7fa714157b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:38.756 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:38.754+0000 7fa71a39d700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa714068d80 0x7fa7140af510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:38.757 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:38.754+0000 7fa71a39d700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa7140cc0d0 0x7fa7140b1d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:38.757 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:38.754+0000 7fa71a39d700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7140afa50 con 0x7fa7140689b0 2023-10-06T01:22:38.757 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:38.754+0000 7fa71a39d700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7140b2290 con 0x7fa7140cc0d0 2023-10-06T01:22:38.757 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:38.754+0000 7fa71a39d700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7140b0870 con 0x7fa714068d80 2023-10-06T01:22:38.757 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:38.754+0000 7fa71939b700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa7140689b0 0x7fa714157b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:38.757 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:38.754+0000 7fa71939b700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa7140689b0 0x7fa714157b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:54774/0 (socket says 172.21.15.50:54774) 2023-10-06T01:22:38.757 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:38.754+0000 7fa71939b700 1 -- 172.21.15.50:0/2792166286 learned_addr learned my addr 172.21.15.50:0/2792166286 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-06T01:22:38.757 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:38.754+0000 7fa718b9a700 1 --2- 172.21.15.50:0/2792166286 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa714068d80 0x7fa7140af510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:38.757 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:38.754+0000 7fa719b9c700 1 --2- 172.21.15.50:0/2792166286 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa7140cc0d0 0x7fa7140b1d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:38.757 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:38.754+0000 7fa71939b700 1 -- 172.21.15.50:0/2792166286 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa714068d80 msgr2=0x7fa7140af510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:38.758 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:38.754+0000 7fa71939b700 1 --2- 172.21.15.50:0/2792166286 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa714068d80 0x7fa7140af510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:38.758 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:38.754+0000 7fa71939b700 1 -- 172.21.15.50:0/2792166286 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa7140cc0d0 msgr2=0x7fa7140b1d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:38.758 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:38.754+0000 7fa71939b700 1 --2- 172.21.15.50:0/2792166286 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa7140cc0d0 0x7fa7140b1d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:38.758 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:38.754+0000 7fa71939b700 1 -- 172.21.15.50:0/2792166286 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa70c009a20 con 0x7fa7140689b0 2023-10-06T01:22:38.758 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:38.755+0000 7fa71939b700 1 --2- 172.21.15.50:0/2792166286 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa7140689b0 0x7fa714157b90 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fa71000d890 tx=0x7fa710008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:22:38.758 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:38.755+0000 7fa7097fa700 1 -- 172.21.15.50:0/2792166286 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7100125f0 con 0x7fa7140689b0 2023-10-06T01:22:38.758 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:38.755+0000 7fa7097fa700 1 -- 172.21.15.50:0/2792166286 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa710012750 con 0x7fa7140689b0 2023-10-06T01:22:38.758 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:38.755+0000 7fa71a39d700 1 -- 172.21.15.50:0/2792166286 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa7140afc60 con 0x7fa7140689b0 2023-10-06T01:22:38.758 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:38.755+0000 7fa7097fa700 1 -- 172.21.15.50:0/2792166286 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa710012b10 con 0x7fa7140689b0 2023-10-06T01:22:38.758 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:38.755+0000 7fa71a39d700 1 -- 172.21.15.50:0/2792166286 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa7140b0220 con 0x7fa7140689b0 2023-10-06T01:22:38.759 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:38.756+0000 7fa71a39d700 1 -- 172.21.15.50:0/2792166286 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa71405f270 con 0x7fa7140689b0 2023-10-06T01:22:38.759 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:38.757+0000 7fa7097fa700 1 -- 172.21.15.50:0/2792166286 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fa71001e460 con 0x7fa7140689b0 2023-10-06T01:22:38.759 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:38.758+0000 7fa7097fa700 1 --2- 172.21.15.50:0/2792166286 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7fa6f8066f30 0x7fa6f80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:38.759 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:38.758+0000 7fa7097fa700 1 -- 172.21.15.50:0/2792166286 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6867+0+0 (secure 0 0 0) 0x7fa710084fa0 con 0x7fa7140689b0 2023-10-06T01:22:38.759 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:38.758+0000 7fa718b9a700 1 --2- 172.21.15.50:0/2792166286 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7fa6f8066f30 0x7fa6f80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:38.760 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:38.759+0000 7fa718b9a700 1 --2- 172.21.15.50:0/2792166286 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7fa6f8066f30 0x7fa6f80693e0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fa7140c6c10 tx=0x7fa704009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:22:38.762 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:38.762+0000 7fa7097fa700 1 -- 172.21.15.50:0/2792166286 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fa710055810 con 0x7fa7140689b0 2023-10-06T01:22:38.964 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:38.964+0000 7fa71a39d700 1 -- 172.21.15.50:0/2792166286 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa7140acfe0 con 0x7fa7140689b0 2023-10-06T01:22:38.965 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:38.965+0000 7fa7097fa700 1 -- 172.21.15.50:0/2792166286 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+18803 (secure 0 0 0) 0x7fa7100553a0 con 0x7fa7140689b0 2023-10-06T01:22:38.966 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-10-06T01:22:38.966 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":27,"fsid":"0bfd9a6b-1587-4fe4-a89e-e43c00286b4e","created":"2023-10-06T01:21:16.828801+0000","modified":"2023-10-06T01:22:24.863940+0000","last_up_change":"2023-10-06T01:21:28.584523+0000","last_in_change":"2023-10-06T01:21:20.179863+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-10-06T01:21:29.304225+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":".mgr","create_time":"2023-10-06T01:21:29.835490+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-06T01:21:34.675315+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-06T01:21:35.753991+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-10-06T01:21:38.853108+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"9060727a-3959-4de3-8363-c5c5d7826c9a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":87837},{"type":"v1","addr":"172.21.15.50:6801","nonce":87837}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":87837},{"type":"v1","addr":"172.21.15.50:6803","nonce":87837}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":87837},{"type":"v1","addr":"172.21.15.50:6807","nonce":87837}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":87837},{"type":"v1","addr":"172.21.15.50:6805","nonce":87837}]},"public_addr":"172.21.15.50:6801/87837","cluster_addr":"172.21.15.50:6803/87837","heartbeat_back_addr":"172.21.15.50:6807/87837","heartbeat_front_addr":"172.21.15.50:6805/87837","state":["exists","up"]},{"osd":1,"uuid":"5ad9ef12-b579-47ea-b690-90ba887e2cef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":87853},{"type":"v1","addr":"172.21.15.50:6809","nonce":87853}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":87853},{"type":"v1","addr":"172.21.15.50:6811","nonce":87853}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":87853},{"type":"v1","addr":"172.21.15.50:6815","nonce":87853}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":87853},{"type":"v1","addr":"172.21.15.50:6813","nonce":87853}]},"public_addr":"172.21.15.50:6809/87853","cluster_addr":"172.21.15.50:6811/87853","heartbeat_back_addr":"172.21.15.50:6815/87853","heartbeat_front_addr":"172.21.15.50:6813/87853","state":["exists","up"]},{"osd":2,"uuid":"c7aee044-6f75-436f-90e1-ba42a57359bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6821","nonce":87855},{"type":"v1","addr":"172.21.15.50:6822","nonce":87855}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6824","nonce":87855},{"type":"v1","addr":"172.21.15.50:6826","nonce":87855}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":87855},{"type":"v1","addr":"172.21.15.50:6831","nonce":87855}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":87855},{"type":"v1","addr":"172.21.15.50:6829","nonce":87855}]},"public_addr":"172.21.15.50:6822/87855","cluster_addr":"172.21.15.50:6826/87855","heartbeat_back_addr":"172.21.15.50:6831/87855","heartbeat_front_addr":"172.21.15.50:6829/87855","state":["exists","up"]},{"osd":3,"uuid":"d9b901c8-e8b2-44af-9508-f453120a96c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":87856},{"type":"v1","addr":"172.21.15.50:6817","nonce":87856}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":87856},{"type":"v1","addr":"172.21.15.50:6819","nonce":87856}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6825","nonce":87856},{"type":"v1","addr":"172.21.15.50:6827","nonce":87856}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6820","nonce":87856},{"type":"v1","addr":"172.21.15.50:6823","nonce":87856}]},"public_addr":"172.21.15.50:6817/87856","cluster_addr":"172.21.15.50:6819/87856","heartbeat_back_addr":"172.21.15.50:6827/87856","heartbeat_front_addr":"172.21.15.50:6823/87856","state":["exists","up"]},{"osd":4,"uuid":"2b3c6b38-e3e9-4301-9445-60fd3fe8ce03","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":85805},{"type":"v1","addr":"172.21.15.155:6801","nonce":85805}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":85805},{"type":"v1","addr":"172.21.15.155:6803","nonce":85805}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6806","nonce":85805},{"type":"v1","addr":"172.21.15.155:6807","nonce":85805}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6804","nonce":85805},{"type":"v1","addr":"172.21.15.155:6805","nonce":85805}]},"public_addr":"172.21.15.155:6801/85805","cluster_addr":"172.21.15.155:6803/85805","heartbeat_back_addr":"172.21.15.155:6807/85805","heartbeat_front_addr":"172.21.15.155:6805/85805","state":["exists","up"]},{"osd":5,"uuid":"417b5f8f-65f1-4c94-91a7-a6ce03fe1679","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6816","nonce":85807},{"type":"v1","addr":"172.21.15.155:6818","nonce":85807}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6820","nonce":85807},{"type":"v1","addr":"172.21.15.155:6822","nonce":85807}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6828","nonce":85807},{"type":"v1","addr":"172.21.15.155:6830","nonce":85807}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6824","nonce":85807},{"type":"v1","addr":"172.21.15.155:6826","nonce":85807}]},"public_addr":"172.21.15.155:6818/85807","cluster_addr":"172.21.15.155:6822/85807","heartbeat_back_addr":"172.21.15.155:6830/85807","heartbeat_front_addr":"172.21.15.155:6826/85807","state":["exists","up"]},{"osd":6,"uuid":"c150cff3-aee4-4714-9c08-d182b1ba9ffd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6808","nonce":85806},{"type":"v1","addr":"172.21.15.155:6809","nonce":85806}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6810","nonce":85806},{"type":"v1","addr":"172.21.15.155:6811","nonce":85806}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6814","nonce":85806},{"type":"v1","addr":"172.21.15.155:6815","nonce":85806}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6812","nonce":85806},{"type":"v1","addr":"172.21.15.155:6813","nonce":85806}]},"public_addr":"172.21.15.155:6809/85806","cluster_addr":"172.21.15.155:6811/85806","heartbeat_back_addr":"172.21.15.155:6815/85806","heartbeat_front_addr":"172.21.15.155:6813/85806","state":["exists","up"]},{"osd":7,"uuid":"71107f0e-04d1-4e72-a0ec-0faf6af003e7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6817","nonce":85832},{"type":"v1","addr":"172.21.15.155:6819","nonce":85832}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6821","nonce":85832},{"type":"v1","addr":"172.21.15.155:6823","nonce":85832}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6829","nonce":85832},{"type":"v1","addr":"172.21.15.155:6831","nonce":85832}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6825","nonce":85832},{"type":"v1","addr":"172.21.15.155:6827","nonce":85832}]},"public_addr":"172.21.15.155:6819/85832","cluster_addr":"172.21.15.155:6823/85832","heartbeat_back_addr":"172.21.15.155:6831/85832","heartbeat_front_addr":"172.21.15.155:6827/85832","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:21:25.423389+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:21:25.472661+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:21:25.817562+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:21:25.551257+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:21:25.407818+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:21:25.557976+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:21:25.747299+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:21:25.827576+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.19","mappings":[{"from":3,"to":5}]},{"pgid":"4.31","mappings":[{"from":1,"to":2}]}],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T01:22:38.968 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:38.967+0000 7fa71a39d700 1 -- 172.21.15.50:0/2792166286 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7fa6f8066f30 msgr2=0x7fa6f80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:38.968 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:38.967+0000 7fa71a39d700 1 --2- 172.21.15.50:0/2792166286 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7fa6f8066f30 0x7fa6f80693e0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fa7140c6c10 tx=0x7fa704009040 comp rx=0 tx=0).stop 2023-10-06T01:22:38.968 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:38.967+0000 7fa71a39d700 1 -- 172.21.15.50:0/2792166286 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa7140689b0 msgr2=0x7fa714157b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:38.968 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:38.967+0000 7fa71a39d700 1 --2- 172.21.15.50:0/2792166286 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa7140689b0 0x7fa714157b90 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fa71000d890 tx=0x7fa710008040 comp rx=0 tx=0).stop 2023-10-06T01:22:38.968 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:38.967+0000 7fa71a39d700 1 -- 172.21.15.50:0/2792166286 shutdown_connections 2023-10-06T01:22:38.968 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:38.967+0000 7fa71a39d700 1 --2- 172.21.15.50:0/2792166286 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7fa6f8066f30 0x7fa6f80693e0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:38.969 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:38.967+0000 7fa71a39d700 1 --2- 172.21.15.50:0/2792166286 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa7140cc0d0 0x7fa7140b1d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:38.969 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:38.967+0000 7fa71a39d700 1 --2- 172.21.15.50:0/2792166286 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa7140689b0 0x7fa714157b90 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:38.969 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:38.967+0000 7fa71a39d700 1 --2- 172.21.15.50:0/2792166286 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa714068d80 0x7fa7140af510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:38.969 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:38.967+0000 7fa71a39d700 1 -- 172.21.15.50:0/2792166286 >> 172.21.15.50:0/2792166286 conn(0x7fa7140cd230 msgr2=0x7fa714069700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:22:38.969 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:38.967+0000 7fa71a39d700 1 -- 172.21.15.50:0/2792166286 shutdown_connections 2023-10-06T01:22:38.969 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:38.967+0000 7fa71a39d700 1 -- 172.21.15.50:0/2792166286 wait complete. 2023-10-06T01:22:38.986 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-10-06T01:21:29.304225+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-10-06T01:21:29.835490+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-06T01:21:34.675315+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-10-06T01:21:35.753991+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-10-06T01:21:38.853108+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-06T01:22:38.987 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-10-06T01:22:39.176 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:39.174+0000 7ff3f979d700 1 Processor -- start 2023-10-06T01:22:39.176 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:39.174+0000 7ff3f979d700 1 -- start start 2023-10-06T01:22:39.178 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:39.176+0000 7ff3f979d700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7ff3f41593c0 0x7ff3f40675f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:39.178 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:39.176+0000 7ff3f979d700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7ff3f40afde0 0x7ff3f4067b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:39.178 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:39.176+0000 7ff3f979d700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff3f40b0310 con 0x7ff3f40ad6b0 2023-10-06T01:22:39.178 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:39.176+0000 7ff3f979d700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff3f40cdea0 con 0x7ff3f40afde0 2023-10-06T01:22:39.178 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:39.176+0000 7ff3f979d700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff3f40c9040 con 0x7ff3f41593c0 2023-10-06T01:22:39.178 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:39.176+0000 7ff3f37fe700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7ff3f40afde0 0x7ff3f4067b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:39.178 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:39.176+0000 7ff3f37fe700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7ff3f40afde0 0x7ff3f4067b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:54776/0 (socket says 172.21.15.50:54776) 2023-10-06T01:22:39.178 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:39.176+0000 7ff3f37fe700 1 -- 172.21.15.50:0/399390247 learned_addr learned my addr 172.21.15.50:0/399390247 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-06T01:22:39.179 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:39.176+0000 7ff3f3fff700 1 --2- 172.21.15.50:0/399390247 >> v2:172.21.15.155:3300/0 conn(0x7ff3f41593c0 0x7ff3f40675f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:39.180 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:39.176+0000 7ff3f37fe700 1 -- 172.21.15.50:0/399390247 >> v2:172.21.15.155:3300/0 conn(0x7ff3f41593c0 msgr2=0x7ff3f40675f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:22:39.180 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:39.176+0000 7ff3f37fe700 1 --2- 172.21.15.50:0/399390247 >> v2:172.21.15.155:3300/0 conn(0x7ff3f41593c0 0x7ff3f40675f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:39.180 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:39.176+0000 7ff3f37fe700 1 -- 172.21.15.50:0/399390247 >> v1:172.21.15.50:6789/0 conn(0x7ff3f40ad6b0 legacy=0x7ff3f40adb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:39.180 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:39.176+0000 7ff3f37fe700 1 -- 172.21.15.50:0/399390247 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3f40c9320 con 0x7ff3f40afde0 2023-10-06T01:22:39.180 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:39.177+0000 7ff3f37fe700 1 --2- 172.21.15.50:0/399390247 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff3f40afde0 0x7ff3f4067b30 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7ff3f406e0a0 tx=0x7ff3e8009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5d46786e06008012 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:22:39.181 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:39.177+0000 7ff3f2ffd700 1 -- 172.21.15.50:0/399390247 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3e800b860 con 0x7ff3f40afde0 2023-10-06T01:22:39.181 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:39.177+0000 7ff3f2ffd700 1 -- 172.21.15.50:0/399390247 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff3e800b9c0 con 0x7ff3f40afde0 2023-10-06T01:22:39.181 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:39.177+0000 7ff3f2ffd700 1 -- 172.21.15.50:0/399390247 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3e800bd60 con 0x7ff3f40afde0 2023-10-06T01:22:39.181 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:39.177+0000 7ff3f979d700 1 -- 172.21.15.50:0/399390247 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff3f40afde0 msgr2=0x7ff3f4067b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:39.181 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:39.177+0000 7ff3f979d700 1 --2- 172.21.15.50:0/399390247 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff3f40afde0 0x7ff3f4067b30 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7ff3f406e0a0 tx=0x7ff3e8009250 comp rx=0 tx=0).stop 2023-10-06T01:22:39.181 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:39.178+0000 7ff3f979d700 1 -- 172.21.15.50:0/399390247 shutdown_connections 2023-10-06T01:22:39.181 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:39.178+0000 7ff3f979d700 1 --2- 172.21.15.50:0/399390247 >> v2:172.21.15.155:3300/0 conn(0x7ff3f41593c0 0x7ff3f40675f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:39.181 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:39.178+0000 7ff3f979d700 1 --2- 172.21.15.50:0/399390247 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff3f40afde0 0x7ff3f4067b30 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:39.181 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:39.178+0000 7ff3f979d700 1 -- 172.21.15.50:0/399390247 >> 172.21.15.50:0/399390247 conn(0x7ff3f40691d0 msgr2=0x7ff3f40cd020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:22:39.181 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:39.178+0000 7ff3f979d700 1 -- 172.21.15.50:0/399390247 shutdown_connections 2023-10-06T01:22:39.181 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:39.178+0000 7ff3f979d700 1 -- 172.21.15.50:0/399390247 wait complete. 2023-10-06T01:22:39.183 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:39.179+0000 7ff3f979d700 1 Processor -- start 2023-10-06T01:22:39.184 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:39.179+0000 7ff3f979d700 1 -- start start 2023-10-06T01:22:39.184 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:39.180+0000 7ff3f979d700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff3f40ad6b0 0x7ff3f40cb370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:39.184 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:39.180+0000 7ff3f979d700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff3f40afde0 0x7ff3f415b460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:39.184 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:39.180+0000 7ff3f979d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff3f41593c0 0x7ff3f4096a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:39.184 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:39.180+0000 7ff3f979d700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3f40ca640 con 0x7ff3f41593c0 2023-10-06T01:22:39.184 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:39.180+0000 7ff3f979d700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3f40caee0 con 0x7ff3f40afde0 2023-10-06T01:22:39.184 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:39.180+0000 7ff3f979d700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff3f415b9a0 con 0x7ff3f40ad6b0 2023-10-06T01:22:39.184 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:39.180+0000 7ff3f8f9c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff3f41593c0 0x7ff3f4096a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:39.184 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:39.180+0000 7ff3f8f9c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff3f41593c0 0x7ff3f4096a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:54788/0 (socket says 172.21.15.50:54788) 2023-10-06T01:22:39.184 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:39.180+0000 7ff3f8f9c700 1 -- 172.21.15.50:0/3452415246 learned_addr learned my addr 172.21.15.50:0/3452415246 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-06T01:22:39.184 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:39.181+0000 7ff3f3fff700 1 --2- 172.21.15.50:0/3452415246 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff3f40ad6b0 0x7ff3f40cb370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:39.185 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:39.181+0000 7ff3f37fe700 1 --2- 172.21.15.50:0/3452415246 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff3f40afde0 0x7ff3f415b460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:39.185 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:39.181+0000 7ff3f8f9c700 1 -- 172.21.15.50:0/3452415246 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff3f40ad6b0 msgr2=0x7ff3f40cb370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:39.185 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:39.181+0000 7ff3f8f9c700 1 --2- 172.21.15.50:0/3452415246 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff3f40ad6b0 0x7ff3f40cb370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:39.185 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:39.181+0000 7ff3f8f9c700 1 -- 172.21.15.50:0/3452415246 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff3f40afde0 msgr2=0x7ff3f415b460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:39.185 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:39.181+0000 7ff3f8f9c700 1 --2- 172.21.15.50:0/3452415246 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff3f40afde0 0x7ff3f415b460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:39.185 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:39.181+0000 7ff3f8f9c700 1 -- 172.21.15.50:0/3452415246 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3e80094f0 con 0x7ff3f41593c0 2023-10-06T01:22:39.185 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:39.181+0000 7ff3f37fe700 1 --2- 172.21.15.50:0/3452415246 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff3f40afde0 0x7ff3f415b460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T01:22:39.185 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:39.181+0000 7ff3f8f9c700 1 --2- 172.21.15.50:0/3452415246 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff3f41593c0 0x7ff3f4096a70 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7ff3ec00c910 tx=0x7ff3ec001710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:22:39.185 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:39.181+0000 7ff3dbfff700 1 -- 172.21.15.50:0/3452415246 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3ec012630 con 0x7ff3f41593c0 2023-10-06T01:22:39.185 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:39.181+0000 7ff3dbfff700 1 -- 172.21.15.50:0/3452415246 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff3ec012790 con 0x7ff3f41593c0 2023-10-06T01:22:39.185 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:39.181+0000 7ff3dbfff700 1 -- 172.21.15.50:0/3452415246 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3ec012b30 con 0x7ff3f41593c0 2023-10-06T01:22:39.186 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:39.181+0000 7ff3f979d700 1 -- 172.21.15.50:0/3452415246 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff3f416aa30 con 0x7ff3f41593c0 2023-10-06T01:22:39.186 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:39.182+0000 7ff3f979d700 1 -- 172.21.15.50:0/3452415246 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff3f40cab70 con 0x7ff3f41593c0 2023-10-06T01:22:39.186 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:39.183+0000 7ff3f979d700 1 -- 172.21.15.50:0/3452415246 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff3f40cb090 con 0x7ff3f41593c0 2023-10-06T01:22:39.186 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:39.183+0000 7ff3dbfff700 1 -- 172.21.15.50:0/3452415246 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7ff3ec00a3b0 con 0x7ff3f41593c0 2023-10-06T01:22:39.187 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:39.184+0000 7ff3dbfff700 1 --2- 172.21.15.50:0/3452415246 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7ff3e0066f30 0x7ff3e00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:39.187 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:39.184+0000 7ff3dbfff700 1 -- 172.21.15.50:0/3452415246 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6867+0+0 (secure 0 0 0) 0x7ff3ec084d10 con 0x7ff3f41593c0 2023-10-06T01:22:39.187 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:39.185+0000 7ff3f3fff700 1 --2- 172.21.15.50:0/3452415246 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7ff3e0066f30 0x7ff3e00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:39.187 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:39.185+0000 7ff3f3fff700 1 --2- 172.21.15.50:0/3452415246 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7ff3e0066f30 0x7ff3e00693e0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7ff3e4006fd0 tx=0x7ff3e4008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:22:39.190 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:39.188+0000 7ff3dbfff700 1 -- 172.21.15.50:0/3452415246 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff3f40cb090 con 0x7ff3f41593c0 2023-10-06T01:22:39.395 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:39.393+0000 7ff3f979d700 1 -- 172.21.15.50:0/3452415246 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7ff3f40cb090 con 0x7ff3f41593c0 2023-10-06T01:22:39.395 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:39.393+0000 7ff3dbfff700 1 -- 172.21.15.50:0/3452415246 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v27) v1 ==== 92+0+10 (secure 0 0 0) 0x7ff3f40cb090 con 0x7ff3f41593c0 2023-10-06T01:22:39.395 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 8 2023-10-06T01:22:39.398 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:39.396+0000 7ff3f979d700 1 -- 172.21.15.50:0/3452415246 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7ff3e0066f30 msgr2=0x7ff3e00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:39.398 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:39.396+0000 7ff3f979d700 1 --2- 172.21.15.50:0/3452415246 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7ff3e0066f30 0x7ff3e00693e0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7ff3e4006fd0 tx=0x7ff3e4008040 comp rx=0 tx=0).stop 2023-10-06T01:22:39.398 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:39.396+0000 7ff3f979d700 1 -- 172.21.15.50:0/3452415246 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff3f41593c0 msgr2=0x7ff3f4096a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:39.398 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:39.396+0000 7ff3f979d700 1 --2- 172.21.15.50:0/3452415246 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff3f41593c0 0x7ff3f4096a70 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7ff3ec00c910 tx=0x7ff3ec001710 comp rx=0 tx=0).stop 2023-10-06T01:22:39.398 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:39.396+0000 7ff3f979d700 1 -- 172.21.15.50:0/3452415246 shutdown_connections 2023-10-06T01:22:39.398 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:39.396+0000 7ff3f979d700 1 --2- 172.21.15.50:0/3452415246 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff3f41593c0 0x7ff3f4096a70 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:39.398 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:39.396+0000 7ff3f979d700 1 --2- 172.21.15.50:0/3452415246 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff3f40ad6b0 0x7ff3f40cb370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:39.399 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:39.396+0000 7ff3f979d700 1 --2- 172.21.15.50:0/3452415246 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7ff3e0066f30 0x7ff3e00693e0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:39.399 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:39.396+0000 7ff3f979d700 1 --2- 172.21.15.50:0/3452415246 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff3f40afde0 0x7ff3f415b460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:39.399 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:39.396+0000 7ff3f979d700 1 -- 172.21.15.50:0/3452415246 >> 172.21.15.50:0/3452415246 conn(0x7ff3f40691d0 msgr2=0x7ff3f4157380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:22:39.399 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:39.396+0000 7ff3f979d700 1 -- 172.21.15.50:0/3452415246 shutdown_connections 2023-10-06T01:22:39.399 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:39.396+0000 7ff3f979d700 1 -- 172.21.15.50:0/3452415246 wait complete. 2023-10-06T01:22:39.415 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-06T01:22:39.605 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:39.603+0000 7fd82519d700 1 Processor -- start 2023-10-06T01:22:39.605 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:39.603+0000 7fd82519d700 1 -- start start 2023-10-06T01:22:39.606 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:39.604+0000 7fd82519d700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fd8200b2660 0x7fd8200cccf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:39.607 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:39.604+0000 7fd82519d700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fd8200cf1f0 0x7fd8200cd230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:39.607 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:39.604+0000 7fd82519d700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd8200cc9b0 con 0x7fd8200b2a30 2023-10-06T01:22:39.607 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:39.604+0000 7fd82519d700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd8200cbda0 con 0x7fd8200b2660 2023-10-06T01:22:39.607 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:39.604+0000 7fd82519d700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd8200cc080 con 0x7fd8200cf1f0 2023-10-06T01:22:39.607 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:39.605+0000 7fd81ffff700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fd8200b2660 0x7fd8200cccf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:39.607 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:39.605+0000 7fd81ffff700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fd8200b2660 0x7fd8200cccf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:54804/0 (socket says 172.21.15.50:54804) 2023-10-06T01:22:39.607 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:39.605+0000 7fd81ffff700 1 -- 172.21.15.50:0/87127763 learned_addr learned my addr 172.21.15.50:0/87127763 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-06T01:22:39.607 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:39.605+0000 7fd82499c700 1 --2- 172.21.15.50:0/87127763 >> v2:172.21.15.155:3300/0 conn(0x7fd8200cf1f0 0x7fd8200cd230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:39.609 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:39.605+0000 7fd81ffff700 1 -- 172.21.15.50:0/87127763 >> v2:172.21.15.155:3300/0 conn(0x7fd8200cf1f0 msgr2=0x7fd8200cd230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:22:39.609 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:39.605+0000 7fd81ffff700 1 --2- 172.21.15.50:0/87127763 >> v2:172.21.15.155:3300/0 conn(0x7fd8200cf1f0 0x7fd8200cd230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:39.609 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:39.605+0000 7fd81ffff700 1 -- 172.21.15.50:0/87127763 >> v1:172.21.15.155:6789/0 conn(0x7fd8200b2a30 legacy=0x7fd8200ceae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:39.609 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:39.605+0000 7fd81ffff700 1 -- 172.21.15.50:0/87127763 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8200cc360 con 0x7fd8200b2660 2023-10-06T01:22:39.609 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:39.605+0000 7fd82499c700 1 --2- 172.21.15.50:0/87127763 >> v2:172.21.15.155:3300/0 conn(0x7fd8200cf1f0 0x7fd8200cd230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T01:22:39.609 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:39.606+0000 7fd81ffff700 1 --2- 172.21.15.50:0/87127763 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd8200b2660 0x7fd8200cccf0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fd8200894b0 tx=0x7fd810009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c8eeac9fb756e333 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:22:39.609 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:39.606+0000 7fd81effd700 1 -- 172.21.15.50:0/87127763 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd81000b860 con 0x7fd8200b2660 2023-10-06T01:22:39.609 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:39.606+0000 7fd81effd700 1 -- 172.21.15.50:0/87127763 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd81000b9c0 con 0x7fd8200b2660 2023-10-06T01:22:39.609 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:39.606+0000 7fd81effd700 1 -- 172.21.15.50:0/87127763 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd81000bd60 con 0x7fd8200b2660 2023-10-06T01:22:39.610 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:39.606+0000 7fd82519d700 1 -- 172.21.15.50:0/87127763 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd8200b2660 msgr2=0x7fd8200cccf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:39.610 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:39.606+0000 7fd82519d700 1 --2- 172.21.15.50:0/87127763 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd8200b2660 0x7fd8200cccf0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fd8200894b0 tx=0x7fd810009250 comp rx=0 tx=0).stop 2023-10-06T01:22:39.610 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:39.606+0000 7fd82519d700 1 -- 172.21.15.50:0/87127763 shutdown_connections 2023-10-06T01:22:39.610 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:39.606+0000 7fd82519d700 1 --2- 172.21.15.50:0/87127763 >> v2:172.21.15.155:3300/0 conn(0x7fd8200cf1f0 0x7fd8200cd230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:39.610 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:39.606+0000 7fd82519d700 1 --2- 172.21.15.50:0/87127763 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd8200b2660 0x7fd8200cccf0 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:39.610 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:39.606+0000 7fd82519d700 1 -- 172.21.15.50:0/87127763 >> 172.21.15.50:0/87127763 conn(0x7fd820099560 msgr2=0x7fd82006f500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:22:39.610 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:39.607+0000 7fd82519d700 1 -- 172.21.15.50:0/87127763 shutdown_connections 2023-10-06T01:22:39.610 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:39.607+0000 7fd82519d700 1 -- 172.21.15.50:0/87127763 wait complete. 2023-10-06T01:22:39.612 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:39.608+0000 7fd82519d700 1 Processor -- start 2023-10-06T01:22:39.612 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:39.608+0000 7fd82519d700 1 -- start start 2023-10-06T01:22:39.612 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:39.609+0000 7fd82519d700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd8200b2660 0x7fd82014afe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:39.612 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:39.609+0000 7fd82519d700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd8200b2a30 0x7fd8200c8840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:39.613 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:39.609+0000 7fd82519d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd8200cf1f0 0x7fd82015a5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:39.613 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:39.609+0000 7fd82519d700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd82015d990 con 0x7fd8200cf1f0 2023-10-06T01:22:39.613 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:39.609+0000 7fd82519d700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8200c83b0 con 0x7fd8200b2a30 2023-10-06T01:22:39.613 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:39.609+0000 7fd82519d700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8200c8d80 con 0x7fd8200b2660 2023-10-06T01:22:39.613 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:39.609+0000 7fd82499c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd8200cf1f0 0x7fd82015a5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:39.613 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:39.609+0000 7fd82499c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd8200cf1f0 0x7fd82015a5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:54814/0 (socket says 172.21.15.50:54814) 2023-10-06T01:22:39.613 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:39.609+0000 7fd82499c700 1 -- 172.21.15.50:0/1360000526 learned_addr learned my addr 172.21.15.50:0/1360000526 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-06T01:22:39.613 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:39.609+0000 7fd81f7fe700 1 --2- 172.21.15.50:0/1360000526 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd8200b2a30 0x7fd8200c8840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:39.613 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:39.610+0000 7fd81ffff700 1 --2- 172.21.15.50:0/1360000526 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd8200b2660 0x7fd82014afe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:39.613 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:39.610+0000 7fd82499c700 1 -- 172.21.15.50:0/1360000526 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd8200b2660 msgr2=0x7fd82014afe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:39.613 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:39.610+0000 7fd82499c700 1 --2- 172.21.15.50:0/1360000526 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd8200b2660 0x7fd82014afe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:39.614 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:39.610+0000 7fd82499c700 1 -- 172.21.15.50:0/1360000526 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd8200b2a30 msgr2=0x7fd8200c8840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:39.614 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:39.610+0000 7fd82499c700 1 --2- 172.21.15.50:0/1360000526 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd8200b2a30 0x7fd8200c8840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:39.614 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:39.610+0000 7fd82499c700 1 -- 172.21.15.50:0/1360000526 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd810009490 con 0x7fd8200cf1f0 2023-10-06T01:22:39.614 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:39.610+0000 7fd82499c700 1 --2- 172.21.15.50:0/1360000526 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd8200cf1f0 0x7fd82015a5c0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fd81800d180 tx=0x7fd818009a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:22:39.614 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:39.610+0000 7fd807fff700 1 -- 172.21.15.50:0/1360000526 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd81800dcc0 con 0x7fd8200cf1f0 2023-10-06T01:22:39.614 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:39.610+0000 7fd807fff700 1 -- 172.21.15.50:0/1360000526 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd81800f040 con 0x7fd8200cf1f0 2023-10-06T01:22:39.614 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:39.610+0000 7fd82519d700 1 -- 172.21.15.50:0/1360000526 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd8200c77a0 con 0x7fd8200cf1f0 2023-10-06T01:22:39.614 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:39.610+0000 7fd807fff700 1 -- 172.21.15.50:0/1360000526 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd818015690 con 0x7fd8200cf1f0 2023-10-06T01:22:39.614 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:39.611+0000 7fd82519d700 1 -- 172.21.15.50:0/1360000526 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd8200c7d60 con 0x7fd8200cf1f0 2023-10-06T01:22:39.615 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:39.611+0000 7fd82519d700 1 -- 172.21.15.50:0/1360000526 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd82005f270 con 0x7fd8200cf1f0 2023-10-06T01:22:39.615 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:39.612+0000 7fd807fff700 1 -- 172.21.15.50:0/1360000526 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fd81801e3b0 con 0x7fd8200cf1f0 2023-10-06T01:22:39.615 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:39.613+0000 7fd807fff700 1 --2- 172.21.15.50:0/1360000526 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7fd80c066f30 0x7fd80c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:39.615 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:39.613+0000 7fd807fff700 1 -- 172.21.15.50:0/1360000526 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6867+0+0 (secure 0 0 0) 0x7fd818084ed0 con 0x7fd8200cf1f0 2023-10-06T01:22:39.616 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:39.614+0000 7fd81ffff700 1 --2- 172.21.15.50:0/1360000526 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7fd80c066f30 0x7fd80c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:39.616 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:39.614+0000 7fd81ffff700 1 --2- 172.21.15.50:0/1360000526 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7fd80c066f30 0x7fd80c0693e0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fd8200894b0 tx=0x7fd810017000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:22:39.619 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:39.617+0000 7fd807fff700 1 -- 172.21.15.50:0/1360000526 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd818051c10 con 0x7fd8200cf1f0 2023-10-06T01:22:39.822 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:39.820+0000 7fd82519d700 1 -- 172.21.15.50:0/1360000526 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fd8200cc640 con 0x7fd8200cf1f0 2023-10-06T01:22:39.822 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:39.820+0000 7fd807fff700 1 -- 172.21.15.50:0/1360000526 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v27) v1 ==== 93+0+10 (secure 0 0 0) 0x7fd81801a0a0 con 0x7fd8200cf1f0 2023-10-06T01:22:39.822 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 1 2023-10-06T01:22:39.825 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:39.823+0000 7fd82519d700 1 -- 172.21.15.50:0/1360000526 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7fd80c066f30 msgr2=0x7fd80c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:39.825 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:39.823+0000 7fd82519d700 1 --2- 172.21.15.50:0/1360000526 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7fd80c066f30 0x7fd80c0693e0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fd8200894b0 tx=0x7fd810017000 comp rx=0 tx=0).stop 2023-10-06T01:22:39.825 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:39.823+0000 7fd82519d700 1 -- 172.21.15.50:0/1360000526 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd8200cf1f0 msgr2=0x7fd82015a5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:39.825 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:39.823+0000 7fd82519d700 1 --2- 172.21.15.50:0/1360000526 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd8200cf1f0 0x7fd82015a5c0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fd81800d180 tx=0x7fd818009a50 comp rx=0 tx=0).stop 2023-10-06T01:22:39.825 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:39.823+0000 7fd82519d700 1 -- 172.21.15.50:0/1360000526 shutdown_connections 2023-10-06T01:22:39.825 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:39.823+0000 7fd82519d700 1 --2- 172.21.15.50:0/1360000526 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd8200cf1f0 0x7fd82015a5c0 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:39.825 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:39.823+0000 7fd82519d700 1 --2- 172.21.15.50:0/1360000526 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd8200b2660 0x7fd82014afe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:39.826 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:39.823+0000 7fd82519d700 1 --2- 172.21.15.50:0/1360000526 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7fd80c066f30 0x7fd80c0693e0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:39.826 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:39.823+0000 7fd82519d700 1 --2- 172.21.15.50:0/1360000526 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd8200b2a30 0x7fd8200c8840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:39.826 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:39.823+0000 7fd82519d700 1 -- 172.21.15.50:0/1360000526 >> 172.21.15.50:0/1360000526 conn(0x7fd820099560 msgr2=0x7fd820069370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:22:39.826 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:39.823+0000 7fd82519d700 1 -- 172.21.15.50:0/1360000526 shutdown_connections 2023-10-06T01:22:39.826 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:39.823+0000 7fd82519d700 1 -- 172.21.15.50:0/1360000526 wait complete. 2023-10-06T01:22:39.842 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-06T01:22:40.033 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:40.031+0000 7fb25a39d700 1 Processor -- start 2023-10-06T01:22:40.033 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:40.031+0000 7fb25a39d700 1 -- start start 2023-10-06T01:22:40.034 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:40.032+0000 7fb25a39d700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb2540c4320 0x7fb2540cc810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:40.034 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:40.032+0000 7fb25a39d700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fb25415d090 0x7fb2540c8900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:40.034 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:40.032+0000 7fb25a39d700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb2540cda00 con 0x7fb2540b06e0 2023-10-06T01:22:40.034 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:40.032+0000 7fb25a39d700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb2540b0ab0 con 0x7fb25415d090 2023-10-06T01:22:40.034 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:40.032+0000 7fb25a39d700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb254159980 con 0x7fb2540c4320 2023-10-06T01:22:40.034 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:40.032+0000 7fb25939b700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fb2540b06e0 0x7fb2540c3c10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:56880/0 (socket says 172.21.15.50:56880) 2023-10-06T01:22:40.035 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:40.032+0000 7fb25939b700 1 -- 172.21.15.50:0/722873155 learned_addr learned my addr 172.21.15.50:0/722873155 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-10-06T01:22:40.035 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:40.032+0000 7fb259b9c700 1 --2- 172.21.15.50:0/722873155 >> v2:172.21.15.50:3300/0 conn(0x7fb25415d090 0x7fb2540c8900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:40.036 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:40.033+0000 7fb258b9a700 1 --2- 172.21.15.50:0/722873155 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb2540c4320 0x7fb2540cc810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:40.036 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:40.033+0000 7fb24bfff700 1 -- 172.21.15.50:0/722873155 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1929276083 0 0) 0x7fb2540cda00 con 0x7fb2540b06e0 2023-10-06T01:22:40.036 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:40.033+0000 7fb24bfff700 1 -- 172.21.15.50:0/722873155 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb240003570 con 0x7fb2540b06e0 2023-10-06T01:22:40.036 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:40.033+0000 7fb259b9c700 1 -- 172.21.15.50:0/722873155 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb2540c4320 msgr2=0x7fb2540cc810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:22:40.036 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:40.033+0000 7fb259b9c700 1 --2- 172.21.15.50:0/722873155 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb2540c4320 0x7fb2540cc810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:40.036 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:40.033+0000 7fb259b9c700 1 -- 172.21.15.50:0/722873155 >> v1:172.21.15.50:6789/0 conn(0x7fb2540b06e0 legacy=0x7fb2540c3c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:40.037 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:40.033+0000 7fb259b9c700 1 -- 172.21.15.50:0/722873155 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2540ccdf0 con 0x7fb25415d090 2023-10-06T01:22:40.037 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:40.033+0000 7fb258b9a700 1 --2- 172.21.15.50:0/722873155 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb2540c4320 0x7fb2540cc810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T01:22:40.037 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:40.033+0000 7fb259b9c700 1 --2- 172.21.15.50:0/722873155 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb25415d090 0x7fb2540c8900 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fb24c009e60 tx=0x7fb24c009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=98613d164e6093da server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:22:40.037 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:40.033+0000 7fb24bfff700 1 -- 172.21.15.50:0/722873155 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb24c00e070 con 0x7fb25415d090 2023-10-06T01:22:40.037 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:40.033+0000 7fb24bfff700 1 -- 172.21.15.50:0/722873155 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb24c00bb60 con 0x7fb25415d090 2023-10-06T01:22:40.037 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:40.033+0000 7fb24bfff700 1 -- 172.21.15.50:0/722873155 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb24c012430 con 0x7fb25415d090 2023-10-06T01:22:40.037 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:40.034+0000 7fb25a39d700 1 -- 172.21.15.50:0/722873155 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb25415d090 msgr2=0x7fb2540c8900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:40.037 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:40.034+0000 7fb25a39d700 1 --2- 172.21.15.50:0/722873155 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb25415d090 0x7fb2540c8900 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fb24c009e60 tx=0x7fb24c009780 comp rx=0 tx=0).stop 2023-10-06T01:22:40.037 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:40.034+0000 7fb25a39d700 1 -- 172.21.15.50:0/722873155 shutdown_connections 2023-10-06T01:22:40.037 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:40.034+0000 7fb25a39d700 1 --2- 172.21.15.50:0/722873155 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb25415d090 0x7fb2540c8900 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:40.037 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:40.034+0000 7fb25a39d700 1 --2- 172.21.15.50:0/722873155 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb2540c4320 0x7fb2540cc810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:40.038 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:40.034+0000 7fb25a39d700 1 -- 172.21.15.50:0/722873155 >> 172.21.15.50:0/722873155 conn(0x7fb254067dd0 msgr2=0x7fb254088000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:22:40.038 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:40.034+0000 7fb25a39d700 1 -- 172.21.15.50:0/722873155 shutdown_connections 2023-10-06T01:22:40.038 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:40.034+0000 7fb25a39d700 1 -- 172.21.15.50:0/722873155 wait complete. 2023-10-06T01:22:40.039 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:40.035+0000 7fb25a39d700 1 Processor -- start 2023-10-06T01:22:40.040 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:40.036+0000 7fb25a39d700 1 -- start start 2023-10-06T01:22:40.040 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:40.036+0000 7fb25a39d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb2540b06e0 0x7fb25415b030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:40.040 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:40.036+0000 7fb25a39d700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb2540c4320 0x7fb2541571a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:40.040 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:40.037+0000 7fb25a39d700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb25415d090 0x7fb254068c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:40.040 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:40.037+0000 7fb25a39d700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2541576e0 con 0x7fb2540b06e0 2023-10-06T01:22:40.040 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:40.037+0000 7fb25a39d700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2540b30b0 con 0x7fb2540c4320 2023-10-06T01:22:40.040 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:40.037+0000 7fb25a39d700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2540b3390 con 0x7fb25415d090 2023-10-06T01:22:40.040 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:40.037+0000 7fb25939b700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb2540b06e0 0x7fb25415b030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:40.040 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:40.037+0000 7fb25939b700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb2540b06e0 0x7fb25415b030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:54834/0 (socket says 172.21.15.50:54834) 2023-10-06T01:22:40.040 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:40.037+0000 7fb25939b700 1 -- 172.21.15.50:0/3604990576 learned_addr learned my addr 172.21.15.50:0/3604990576 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-06T01:22:40.041 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:40.037+0000 7fb25939b700 1 -- 172.21.15.50:0/3604990576 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb25415d090 msgr2=0x7fb254068c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:40.041 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:40.037+0000 7fb25939b700 1 --2- 172.21.15.50:0/3604990576 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb25415d090 0x7fb254068c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:40.041 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:40.037+0000 7fb25939b700 1 -- 172.21.15.50:0/3604990576 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb2540c4320 msgr2=0x7fb2541571a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:40.041 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:40.037+0000 7fb25939b700 1 --2- 172.21.15.50:0/3604990576 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb2540c4320 0x7fb2541571a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:40.041 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:40.037+0000 7fb25939b700 1 -- 172.21.15.50:0/3604990576 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb24c009a20 con 0x7fb2540b06e0 2023-10-06T01:22:40.041 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:40.037+0000 7fb25939b700 1 --2- 172.21.15.50:0/3604990576 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb2540b06e0 0x7fb25415b030 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fb25000c790 tx=0x7fb250007c80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:22:40.041 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:40.038+0000 7fb2497fa700 1 -- 172.21.15.50:0/3604990576 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2500072e0 con 0x7fb2540b06e0 2023-10-06T01:22:40.041 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:40.038+0000 7fb2497fa700 1 -- 172.21.15.50:0/3604990576 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb250007440 con 0x7fb2540b06e0 2023-10-06T01:22:40.041 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:40.038+0000 7fb25a39d700 1 -- 172.21.15.50:0/3604990576 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb2540b3670 con 0x7fb2540b06e0 2023-10-06T01:22:40.041 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:40.038+0000 7fb2497fa700 1 -- 172.21.15.50:0/3604990576 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2500057f0 con 0x7fb2540b06e0 2023-10-06T01:22:40.041 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:40.038+0000 7fb25a39d700 1 -- 172.21.15.50:0/3604990576 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb2540b3c30 con 0x7fb2540b06e0 2023-10-06T01:22:40.042 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:40.039+0000 7fb25a39d700 1 -- 172.21.15.50:0/3604990576 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb254070bd0 con 0x7fb2540b06e0 2023-10-06T01:22:40.042 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:40.040+0000 7fb2497fa700 1 -- 172.21.15.50:0/3604990576 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fb250005c20 con 0x7fb2540b06e0 2023-10-06T01:22:40.043 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:40.041+0000 7fb2497fa700 1 --2- 172.21.15.50:0/3604990576 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7fb238066f30 0x7fb2380693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:40.043 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:40.041+0000 7fb2497fa700 1 -- 172.21.15.50:0/3604990576 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6867+0+0 (secure 0 0 0) 0x7fb250083e50 con 0x7fb2540b06e0 2023-10-06T01:22:40.043 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:40.041+0000 7fb258b9a700 1 --2- 172.21.15.50:0/3604990576 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7fb238066f30 0x7fb2380693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:40.043 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:40.042+0000 7fb258b9a700 1 --2- 172.21.15.50:0/3604990576 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7fb238066f30 0x7fb2380693e0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fb244006fd0 tx=0x7fb244008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:22:40.046 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:40.045+0000 7fb2497fa700 1 -- 172.21.15.50:0/3604990576 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb25004b5a0 con 0x7fb2540b06e0 2023-10-06T01:22:40.249 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:40.247+0000 7fb25a39d700 1 -- 172.21.15.50:0/3604990576 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fb25405f270 con 0x7fb2540b06e0 2023-10-06T01:22:40.249 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:40.247+0000 7fb2497fa700 1 -- 172.21.15.50:0/3604990576 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v27) v1 ==== 104+0+11 (secure 0 0 0) 0x7fb2500170a0 con 0x7fb2540b06e0 2023-10-06T01:22:40.249 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 32 2023-10-06T01:22:40.252 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:40.249+0000 7fb25a39d700 1 -- 172.21.15.50:0/3604990576 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7fb238066f30 msgr2=0x7fb2380693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:40.252 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:40.249+0000 7fb25a39d700 1 --2- 172.21.15.50:0/3604990576 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7fb238066f30 0x7fb2380693e0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fb244006fd0 tx=0x7fb244008040 comp rx=0 tx=0).stop 2023-10-06T01:22:40.252 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:40.249+0000 7fb25a39d700 1 -- 172.21.15.50:0/3604990576 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb2540b06e0 msgr2=0x7fb25415b030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:40.252 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:40.249+0000 7fb25a39d700 1 --2- 172.21.15.50:0/3604990576 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb2540b06e0 0x7fb25415b030 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fb25000c790 tx=0x7fb250007c80 comp rx=0 tx=0).stop 2023-10-06T01:22:40.252 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:40.250+0000 7fb25a39d700 1 -- 172.21.15.50:0/3604990576 shutdown_connections 2023-10-06T01:22:40.252 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:40.250+0000 7fb25a39d700 1 --2- 172.21.15.50:0/3604990576 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb25415d090 0x7fb254068c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:40.252 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:40.250+0000 7fb25a39d700 1 --2- 172.21.15.50:0/3604990576 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb2540b06e0 0x7fb25415b030 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:40.253 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:40.250+0000 7fb25a39d700 1 --2- 172.21.15.50:0/3604990576 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7fb238066f30 0x7fb2380693e0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:40.253 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:40.250+0000 7fb25a39d700 1 --2- 172.21.15.50:0/3604990576 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb2540c4320 0x7fb2541571a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:40.253 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:40.250+0000 7fb25a39d700 1 -- 172.21.15.50:0/3604990576 >> 172.21.15.50:0/3604990576 conn(0x7fb254067dd0 msgr2=0x7fb25406cb30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:22:40.253 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:40.250+0000 7fb25a39d700 1 -- 172.21.15.50:0/3604990576 shutdown_connections 2023-10-06T01:22:40.253 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:40.250+0000 7fb25a39d700 1 -- 172.21.15.50:0/3604990576 wait complete. 2023-10-06T01:22:40.269 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-06T01:22:40.464 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:40.462+0000 7f5ba6d9d700 1 Processor -- start 2023-10-06T01:22:40.464 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:40.462+0000 7f5ba6d9d700 1 -- start start 2023-10-06T01:22:40.465 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:40.463+0000 7f5ba6d9d700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f5ba00cb0a0 0x7f5ba0159b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:40.465 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:40.463+0000 7f5ba6d9d700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5ba006d470 con 0x7f5ba013c470 2023-10-06T01:22:40.465 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:40.463+0000 7f5ba6d9d700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5ba006cb80 con 0x7f5ba015a080 2023-10-06T01:22:40.465 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:40.463+0000 7f5ba6d9d700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5ba013c840 con 0x7f5ba00cb0a0 2023-10-06T01:22:40.465 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:40.463+0000 7f5ba5d9b700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f5ba013c470 0x7f5ba00ca990 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:56884/0 (socket says 172.21.15.50:56884) 2023-10-06T01:22:40.466 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:40.463+0000 7f5ba5d9b700 1 -- 172.21.15.50:0/4291084188 learned_addr learned my addr 172.21.15.50:0/4291084188 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-10-06T01:22:40.469 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:40.464+0000 7f5ba559a700 1 --2- 172.21.15.50:0/4291084188 >> v2:172.21.15.155:3300/0 conn(0x7f5ba00cb0a0 0x7f5ba0159b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:40.469 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:40.464+0000 7f5ba4d99700 1 -- 172.21.15.50:0/4291084188 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1993090309 0 0) 0x7f5ba006d470 con 0x7f5ba013c470 2023-10-06T01:22:40.469 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:40.464+0000 7f5ba4d99700 1 -- 172.21.15.50:0/4291084188 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5b8c003570 con 0x7f5ba013c470 2023-10-06T01:22:40.469 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:40.464+0000 7f5ba4d99700 1 -- 172.21.15.50:0/4291084188 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2061640714 0 0) 0x7f5b8c003570 con 0x7f5ba013c470 2023-10-06T01:22:40.470 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:40.464+0000 7f5ba4d99700 1 -- 172.21.15.50:0/4291084188 >> v2:172.21.15.155:3300/0 conn(0x7f5ba00cb0a0 msgr2=0x7f5ba0159b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:22:40.470 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:40.464+0000 7f5ba4d99700 1 --2- 172.21.15.50:0/4291084188 >> v2:172.21.15.155:3300/0 conn(0x7f5ba00cb0a0 0x7f5ba0159b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:40.470 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:40.464+0000 7f5ba4d99700 1 -- 172.21.15.50:0/4291084188 >> v1:172.21.15.155:6789/0 conn(0x7f5ba015a080 legacy=0x7f5ba00c8730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:40.470 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:40.464+0000 7f5ba4d99700 1 -- 172.21.15.50:0/4291084188 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ba006ce20 con 0x7f5ba013c470 2023-10-06T01:22:40.470 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:40.464+0000 7f5ba4d99700 1 -- 172.21.15.50:0/4291084188 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 347519148 0 0) 0x7f5b9c001470 con 0x7f5ba013c470 2023-10-06T01:22:40.470 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:40.464+0000 7f5ba4d99700 1 -- 172.21.15.50:0/4291084188 >> v1:172.21.15.50:6789/0 conn(0x7f5ba013c470 legacy=0x7f5ba00ca990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:40.471 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:40.464+0000 7f5ba4d99700 1 --2- 172.21.15.50:0/4291084188 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5b8c003a60 0x7f5b8c003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:40.471 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:40.464+0000 7f5ba4d99700 1 --2- 172.21.15.50:0/4291084188 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5b8c004810 0x7f5b8c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:40.471 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:40.464+0000 7f5ba4d99700 1 --2- 172.21.15.50:0/4291084188 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5b8c0051c0 0x7f5b8c00ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:40.471 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:40.464+0000 7f5ba4d99700 1 -- 172.21.15.50:0/4291084188 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ba013c840 con 0x7f5b8c003a60 2023-10-06T01:22:40.471 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:40.464+0000 7f5ba4d99700 1 -- 172.21.15.50:0/4291084188 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b8c00c0b0 con 0x7f5b8c0051c0 2023-10-06T01:22:40.471 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:40.464+0000 7f5ba4d99700 1 -- 172.21.15.50:0/4291084188 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b8c00c270 con 0x7f5b8c004810 2023-10-06T01:22:40.471 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:40.465+0000 7f5ba5d9b700 1 --2- 172.21.15.50:0/4291084188 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5b8c003a60 0x7f5b8c003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:40.472 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:40.465+0000 7f5ba659c700 1 --2- 172.21.15.50:0/4291084188 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5b8c0051c0 0x7f5b8c00ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:40.472 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:40.465+0000 7f5ba559a700 1 --2- 172.21.15.50:0/4291084188 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5b8c004810 0x7f5b8c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:40.472 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:40.465+0000 7f5ba5d9b700 1 -- 172.21.15.50:0/4291084188 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5b8c004810 msgr2=0x7f5b8c004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:22:40.472 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:40.465+0000 7f5ba5d9b700 1 --2- 172.21.15.50:0/4291084188 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5b8c004810 0x7f5b8c004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:40.472 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:40.465+0000 7f5ba5d9b700 1 -- 172.21.15.50:0/4291084188 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5b8c0051c0 msgr2=0x7f5b8c00ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:22:40.472 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:40.465+0000 7f5ba5d9b700 1 --2- 172.21.15.50:0/4291084188 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5b8c0051c0 0x7f5b8c00ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:40.472 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:40.465+0000 7f5ba5d9b700 1 -- 172.21.15.50:0/4291084188 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b8c003570 con 0x7f5b8c003a60 2023-10-06T01:22:40.472 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:40.465+0000 7f5ba659c700 1 -- 172.21.15.50:0/4291084188 reap_dead start 2023-10-06T01:22:40.473 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:40.465+0000 7f5ba5d9b700 1 --2- 172.21.15.50:0/4291084188 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5b8c003a60 0x7f5b8c003e30 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f5b9c00c2d0 tx=0x7f5b9c001da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8fd91a272d25e35e server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:22:40.473 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:40.466+0000 7f5ba4d99700 1 -- 172.21.15.50:0/4291084188 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b9c00cba0 con 0x7f5b8c003a60 2023-10-06T01:22:40.473 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:40.466+0000 7f5ba4d99700 1 -- 172.21.15.50:0/4291084188 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b9c00cd20 con 0x7f5b8c003a60 2023-10-06T01:22:40.473 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:40.466+0000 7f5ba4d99700 1 -- 172.21.15.50:0/4291084188 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b9c005b70 con 0x7f5b8c003a60 2023-10-06T01:22:40.473 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:40.466+0000 7f5ba6d9d700 1 -- 172.21.15.50:0/4291084188 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5b8c003a60 msgr2=0x7f5b8c003e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:40.473 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:40.466+0000 7f5ba6d9d700 1 --2- 172.21.15.50:0/4291084188 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5b8c003a60 0x7f5b8c003e30 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f5b9c00c2d0 tx=0x7f5b9c001da0 comp rx=0 tx=0).stop 2023-10-06T01:22:40.473 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:40.466+0000 7f5ba6d9d700 1 -- 172.21.15.50:0/4291084188 shutdown_connections 2023-10-06T01:22:40.473 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:40.466+0000 7f5ba6d9d700 1 --2- 172.21.15.50:0/4291084188 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5b8c003a60 0x7f5b8c003e30 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:40.474 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:40.466+0000 7f5ba6d9d700 1 -- 172.21.15.50:0/4291084188 >> 172.21.15.50:0/4291084188 conn(0x7f5ba006b370 msgr2=0x7f5ba006b770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:22:40.474 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:40.466+0000 7f5ba6d9d700 1 -- 172.21.15.50:0/4291084188 shutdown_connections 2023-10-06T01:22:40.474 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:40.466+0000 7f5ba6d9d700 1 -- 172.21.15.50:0/4291084188 wait complete. 2023-10-06T01:22:40.477 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:40.468+0000 7f5ba6d9d700 1 Processor -- start 2023-10-06T01:22:40.477 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:40.468+0000 7f5ba6d9d700 1 -- start start 2023-10-06T01:22:40.477 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:40.469+0000 7f5ba6d9d700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5b8c003a60 0x7f5ba013b3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:40.477 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:40.469+0000 7f5ba6d9d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5ba013bab0 0x7f5ba0169b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:40.477 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:40.469+0000 7f5ba6d9d700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5ba00693c0 0x7f5ba0069860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:40.477 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:40.469+0000 7f5ba6d9d700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ba0069da0 con 0x7f5ba013bab0 2023-10-06T01:22:40.478 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:40.469+0000 7f5ba6d9d700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ba00b2b20 con 0x7f5ba00693c0 2023-10-06T01:22:40.478 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:40.469+0000 7f5ba6d9d700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ba013c980 con 0x7f5b8c003a60 2023-10-06T01:22:40.478 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:40.469+0000 7f5ba559a700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5ba013bab0 0x7f5ba0169b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:40.478 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:40.469+0000 7f5ba559a700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5ba013bab0 0x7f5ba0169b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:54848/0 (socket says 172.21.15.50:54848) 2023-10-06T01:22:40.478 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:40.469+0000 7f5ba559a700 1 -- 172.21.15.50:0/3471076974 learned_addr learned my addr 172.21.15.50:0/3471076974 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-06T01:22:40.478 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:40.469+0000 7f5ba5d9b700 1 --2- 172.21.15.50:0/3471076974 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5b8c003a60 0x7f5ba013b3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:40.478 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:40.469+0000 7f5ba659c700 1 --2- 172.21.15.50:0/3471076974 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5ba00693c0 0x7f5ba0069860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:40.479 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:40.469+0000 7f5ba559a700 1 -- 172.21.15.50:0/3471076974 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5b8c003a60 msgr2=0x7f5ba013b3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:40.479 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:40.469+0000 7f5ba559a700 1 --2- 172.21.15.50:0/3471076974 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5b8c003a60 0x7f5ba013b3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:40.479 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:40.469+0000 7f5ba559a700 1 -- 172.21.15.50:0/3471076974 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5ba00693c0 msgr2=0x7f5ba0069860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:40.479 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:40.469+0000 7f5ba559a700 1 --2- 172.21.15.50:0/3471076974 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5ba00693c0 0x7f5ba0069860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:40.479 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:40.470+0000 7f5ba559a700 1 -- 172.21.15.50:0/3471076974 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ba013cf40 con 0x7f5ba013bab0 2023-10-06T01:22:40.479 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:40.470+0000 7f5ba559a700 1 --2- 172.21.15.50:0/3471076974 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5ba013bab0 0x7f5ba0169b30 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f5b90011a20 tx=0x7f5b900091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:22:40.479 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:40.470+0000 7f5b95ffb700 1 -- 172.21.15.50:0/3471076974 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b9000f940 con 0x7f5ba013bab0 2023-10-06T01:22:40.479 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:40.470+0000 7f5b95ffb700 1 -- 172.21.15.50:0/3471076974 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b9000faa0 con 0x7f5ba013bab0 2023-10-06T01:22:40.480 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:40.470+0000 7f5ba6d9d700 1 -- 172.21.15.50:0/3471076974 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5ba016a070 con 0x7f5ba013bab0 2023-10-06T01:22:40.480 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:40.470+0000 7f5b95ffb700 1 -- 172.21.15.50:0/3471076974 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b9000fe40 con 0x7f5ba013bab0 2023-10-06T01:22:40.480 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:40.470+0000 7f5ba6d9d700 1 -- 172.21.15.50:0/3471076974 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5ba00b3010 con 0x7f5ba013bab0 2023-10-06T01:22:40.480 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:40.471+0000 7f5ba6d9d700 1 -- 172.21.15.50:0/3471076974 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5ba005f270 con 0x7f5ba013bab0 2023-10-06T01:22:40.480 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:40.472+0000 7f5b95ffb700 1 -- 172.21.15.50:0/3471076974 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f5b90014650 con 0x7f5ba013bab0 2023-10-06T01:22:40.480 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:40.473+0000 7f5b95ffb700 1 --2- 172.21.15.50:0/3471076974 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f5b84066f30 0x7f5b840693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:40.480 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:40.473+0000 7f5b95ffb700 1 -- 172.21.15.50:0/3471076974 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6867+0+0 (secure 0 0 0) 0x7f5b90018030 con 0x7f5ba013bab0 2023-10-06T01:22:40.481 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:40.474+0000 7f5ba5d9b700 1 --2- 172.21.15.50:0/3471076974 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f5b84066f30 0x7f5b840693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:40.481 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:40.474+0000 7f5ba5d9b700 1 --2- 172.21.15.50:0/3471076974 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f5b84066f30 0x7f5b840693e0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f5ba00b2830 tx=0x7f5b9c015000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:22:40.481 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:40.477+0000 7f5b95ffb700 1 -- 172.21.15.50:0/3471076974 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f5b90055b60 con 0x7f5ba013bab0 2023-10-06T01:22:40.681 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:40.680+0000 7f5ba6d9d700 1 -- 172.21.15.50:0/3471076974 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f5ba006d100 con 0x7f5ba013bab0 2023-10-06T01:22:40.682 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:40.680+0000 7f5b95ffb700 1 -- 172.21.15.50:0/3471076974 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v27) v1 ==== 100+0+11 (secure 0 0 0) 0x7f5b900556f0 con 0x7f5ba013bab0 2023-10-06T01:22:40.682 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 64 2023-10-06T01:22:40.685 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:40.682+0000 7f5ba6d9d700 1 -- 172.21.15.50:0/3471076974 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f5b84066f30 msgr2=0x7f5b840693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:40.685 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:40.682+0000 7f5ba6d9d700 1 --2- 172.21.15.50:0/3471076974 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f5b84066f30 0x7f5b840693e0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f5ba00b2830 tx=0x7f5b9c015000 comp rx=0 tx=0).stop 2023-10-06T01:22:40.685 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:40.682+0000 7f5ba6d9d700 1 -- 172.21.15.50:0/3471076974 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5ba013bab0 msgr2=0x7f5ba0169b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:40.685 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:40.682+0000 7f5ba6d9d700 1 --2- 172.21.15.50:0/3471076974 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5ba013bab0 0x7f5ba0169b30 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f5b90011a20 tx=0x7f5b900091a0 comp rx=0 tx=0).stop 2023-10-06T01:22:40.685 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:40.682+0000 7f5ba6d9d700 1 -- 172.21.15.50:0/3471076974 shutdown_connections 2023-10-06T01:22:40.685 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:40.682+0000 7f5ba6d9d700 1 --2- 172.21.15.50:0/3471076974 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f5b84066f30 0x7f5b840693e0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:40.685 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:40.682+0000 7f5ba6d9d700 1 --2- 172.21.15.50:0/3471076974 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5ba00693c0 0x7f5ba0069860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:40.686 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:40.682+0000 7f5ba6d9d700 1 --2- 172.21.15.50:0/3471076974 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5b8c003a60 0x7f5ba013b3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:40.686 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:40.682+0000 7f5ba6d9d700 1 --2- 172.21.15.50:0/3471076974 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5ba013bab0 0x7f5ba0169b30 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:40.686 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:40.682+0000 7f5ba6d9d700 1 -- 172.21.15.50:0/3471076974 >> 172.21.15.50:0/3471076974 conn(0x7f5ba006b370 msgr2=0x7f5ba0157960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:22:40.686 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:40.683+0000 7f5ba6d9d700 1 -- 172.21.15.50:0/3471076974 shutdown_connections 2023-10-06T01:22:40.686 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:40.683+0000 7f5ba6d9d700 1 -- 172.21.15.50:0/3471076974 wait complete. 2023-10-06T01:22:40.702 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-10-06T01:22:40.896 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:40.894+0000 7f16a1f9d700 1 Processor -- start 2023-10-06T01:22:40.896 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:40.894+0000 7f16a1f9d700 1 -- start start 2023-10-06T01:22:40.897 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:40.896+0000 7f16a1f9d700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f169c13c470 0x7f169c0ca990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:40.898 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:40.896+0000 7f16a1f9d700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f169c15a250 0x7f169c0c8730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:40.898 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:40.896+0000 7f16a1f9d700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f169c0cb340 con 0x7f169c0caed0 2023-10-06T01:22:40.898 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:40.896+0000 7f16a1f9d700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f169c15a6d0 con 0x7f169c15a250 2023-10-06T01:22:40.898 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:40.896+0000 7f16a1f9d700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f169c06d470 con 0x7f169c13c470 2023-10-06T01:22:40.900 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:40.896+0000 7f16a179c700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f169c15a250 0x7f169c0c8730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:40.900 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:40.896+0000 7f16a0f9b700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f169c13c470 0x7f169c0ca990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:40.900 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:40.896+0000 7f16a179c700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f169c15a250 0x7f169c0c8730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.50:53134/0 (socket says 172.21.15.50:53134) 2023-10-06T01:22:40.900 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:40.896+0000 7f16a179c700 1 -- 172.21.15.50:0/731322147 learned_addr learned my addr 172.21.15.50:0/731322147 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-06T01:22:40.900 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:40.897+0000 7f16a179c700 1 -- 172.21.15.50:0/731322147 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f169c13c470 msgr2=0x7f169c0ca990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:22:40.900 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:40.897+0000 7f16a179c700 1 --2- 172.21.15.50:0/731322147 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f169c13c470 0x7f169c0ca990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:40.900 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:40.897+0000 7f16a179c700 1 -- 172.21.15.50:0/731322147 >> v1:172.21.15.155:6789/0 conn(0x7f169c0caed0 legacy=0x7f169c159b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:40.901 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:40.897+0000 7f16a179c700 1 -- 172.21.15.50:0/731322147 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f169c06cb80 con 0x7f169c15a250 2023-10-06T01:22:40.901 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:40.897+0000 7f16a0f9b700 1 --2- 172.21.15.50:0/731322147 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f169c13c470 0x7f169c0ca990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T01:22:40.901 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:40.897+0000 7f16a179c700 1 --2- 172.21.15.50:0/731322147 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f169c15a250 0x7f169c0c8730 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f1694009f20 tx=0x7f1694009840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9abda5d6c6b15f6b server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:22:40.901 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:40.897+0000 7f169b7fe700 1 -- 172.21.15.50:0/731322147 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f169400e070 con 0x7f169c15a250 2023-10-06T01:22:40.901 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:40.897+0000 7f169b7fe700 1 -- 172.21.15.50:0/731322147 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f169400b9d0 con 0x7f169c15a250 2023-10-06T01:22:40.901 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:40.897+0000 7f169b7fe700 1 -- 172.21.15.50:0/731322147 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16940092e0 con 0x7f169c15a250 2023-10-06T01:22:40.901 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:40.898+0000 7f16a1f9d700 1 -- 172.21.15.50:0/731322147 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f169c15a250 msgr2=0x7f169c0c8730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:40.901 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:40.898+0000 7f16a1f9d700 1 --2- 172.21.15.50:0/731322147 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f169c15a250 0x7f169c0c8730 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f1694009f20 tx=0x7f1694009840 comp rx=0 tx=0).stop 2023-10-06T01:22:40.901 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:40.898+0000 7f16a1f9d700 1 -- 172.21.15.50:0/731322147 shutdown_connections 2023-10-06T01:22:40.901 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:40.898+0000 7f16a1f9d700 1 --2- 172.21.15.50:0/731322147 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f169c15a250 0x7f169c0c8730 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:40.901 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:40.898+0000 7f16a1f9d700 1 --2- 172.21.15.50:0/731322147 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f169c13c470 0x7f169c0ca990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:40.901 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:40.898+0000 7f16a1f9d700 1 -- 172.21.15.50:0/731322147 >> 172.21.15.50:0/731322147 conn(0x7f169c06b370 msgr2=0x7f169c06b770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:22:40.901 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:40.898+0000 7f16a1f9d700 1 -- 172.21.15.50:0/731322147 shutdown_connections 2023-10-06T01:22:40.902 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:40.898+0000 7f16a1f9d700 1 -- 172.21.15.50:0/731322147 wait complete. 2023-10-06T01:22:40.903 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:40.899+0000 7f16a1f9d700 1 Processor -- start 2023-10-06T01:22:40.903 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:40.900+0000 7f16a1f9d700 1 -- start start 2023-10-06T01:22:40.903 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:40.900+0000 7f16a1f9d700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f169c0caed0 0x7f169c169f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:40.903 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:40.900+0000 7f16a1f9d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f169c13c470 0x7f169c156bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:40.903 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:40.901+0000 7f16a1f9d700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f169c15a250 0x7f169c15d960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:40.904 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:40.901+0000 7f16a1f9d700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f169c15c9c0 con 0x7f169c13c470 2023-10-06T01:22:40.904 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:40.901+0000 7f16a1f9d700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f169c15d4d0 con 0x7f169c0caed0 2023-10-06T01:22:40.904 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:40.901+0000 7f16a1f9d700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f169c15cba0 con 0x7f169c15a250 2023-10-06T01:22:40.904 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:40.901+0000 7f169bfff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f169c13c470 0x7f169c156bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:40.904 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:40.901+0000 7f169bfff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f169c13c470 0x7f169c156bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:54856/0 (socket says 172.21.15.50:54856) 2023-10-06T01:22:40.904 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:40.901+0000 7f169bfff700 1 -- 172.21.15.50:0/1576836773 learned_addr learned my addr 172.21.15.50:0/1576836773 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-06T01:22:40.904 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:40.901+0000 7f16a0f9b700 1 --2- 172.21.15.50:0/1576836773 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f169c0caed0 0x7f169c169f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:40.904 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:40.901+0000 7f16a179c700 1 --2- 172.21.15.50:0/1576836773 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f169c15a250 0x7f169c15d960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:40.904 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:40.901+0000 7f169bfff700 1 -- 172.21.15.50:0/1576836773 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f169c15a250 msgr2=0x7f169c15d960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:40.904 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:40.901+0000 7f169bfff700 1 --2- 172.21.15.50:0/1576836773 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f169c15a250 0x7f169c15d960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:40.904 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:40.901+0000 7f169bfff700 1 -- 172.21.15.50:0/1576836773 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f169c0caed0 msgr2=0x7f169c169f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:40.904 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:40.901+0000 7f169bfff700 1 --2- 172.21.15.50:0/1576836773 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f169c0caed0 0x7f169c169f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:40.905 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:40.901+0000 7f169bfff700 1 -- 172.21.15.50:0/1576836773 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1690009420 con 0x7f169c13c470 2023-10-06T01:22:40.905 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:40.901+0000 7f16a179c700 1 --2- 172.21.15.50:0/1576836773 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f169c15a250 0x7f169c15d960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T01:22:40.905 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:40.901+0000 7f16a0f9b700 1 --2- 172.21.15.50:0/1576836773 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f169c0caed0 0x7f169c169f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T01:22:40.905 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:40.902+0000 7f169bfff700 1 --2- 172.21.15.50:0/1576836773 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f169c13c470 0x7f169c156bb0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f168800c590 tx=0x7f168800c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:22:40.906 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:40.902+0000 7f1698ff9700 1 -- 172.21.15.50:0/1576836773 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1688011590 con 0x7f169c13c470 2023-10-06T01:22:40.906 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:40.902+0000 7f1698ff9700 1 -- 172.21.15.50:0/1576836773 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16880116f0 con 0x7f169c13c470 2023-10-06T01:22:40.906 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:40.902+0000 7f16a1f9d700 1 -- 172.21.15.50:0/1576836773 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1694009ae0 con 0x7f169c13c470 2023-10-06T01:22:40.906 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:40.902+0000 7f1698ff9700 1 -- 172.21.15.50:0/1576836773 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1688011ab0 con 0x7f169c13c470 2023-10-06T01:22:40.906 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:40.902+0000 7f16a1f9d700 1 -- 172.21.15.50:0/1576836773 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f169c15d160 con 0x7f169c13c470 2023-10-06T01:22:40.906 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:40.903+0000 7f16a1f9d700 1 -- 172.21.15.50:0/1576836773 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f169c15d640 con 0x7f169c13c470 2023-10-06T01:22:40.906 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:40.904+0000 7f1698ff9700 1 -- 172.21.15.50:0/1576836773 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f168801b3b0 con 0x7f169c13c470 2023-10-06T01:22:40.907 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:40.905+0000 7f1698ff9700 1 --2- 172.21.15.50:0/1576836773 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f1680066f30 0x7f16800693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:40.907 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:40.905+0000 7f1698ff9700 1 -- 172.21.15.50:0/1576836773 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6867+0+0 (secure 0 0 0) 0x7f1688083fb0 con 0x7f169c13c470 2023-10-06T01:22:40.907 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:40.906+0000 7f16a0f9b700 1 --2- 172.21.15.50:0/1576836773 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f1680066f30 0x7f16800693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:40.908 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:40.907+0000 7f16a0f9b700 1 --2- 172.21.15.50:0/1576836773 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f1680066f30 0x7f16800693e0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f16900093f0 tx=0x7f1690008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:22:40.911 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:40.909+0000 7f1698ff9700 1 -- 172.21.15.50:0/1576836773 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f1688050cf0 con 0x7f169c13c470 2023-10-06T01:22:41.115 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:41.113+0000 7f16a1f9d700 1 -- 172.21.15.50:0/1576836773 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f169c05f270 con 0x7f169c13c470 2023-10-06T01:22:41.116 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:41.114+0000 7f1698ff9700 1 -- 172.21.15.50:0/1576836773 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v27) v1 ==== 103+0+11 (secure 0 0 0) 0x7f1688017070 con 0x7f169c13c470 2023-10-06T01:22:41.116 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 32 2023-10-06T01:22:41.118 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:41.116+0000 7f16a1f9d700 1 -- 172.21.15.50:0/1576836773 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f1680066f30 msgr2=0x7f16800693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:41.118 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:41.116+0000 7f16a1f9d700 1 --2- 172.21.15.50:0/1576836773 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f1680066f30 0x7f16800693e0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f16900093f0 tx=0x7f1690008040 comp rx=0 tx=0).stop 2023-10-06T01:22:41.118 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:41.116+0000 7f16a1f9d700 1 -- 172.21.15.50:0/1576836773 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f169c13c470 msgr2=0x7f169c156bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:41.118 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:41.116+0000 7f16a1f9d700 1 --2- 172.21.15.50:0/1576836773 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f169c13c470 0x7f169c156bb0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f168800c590 tx=0x7f168800c950 comp rx=0 tx=0).stop 2023-10-06T01:22:41.118 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:41.116+0000 7f16a1f9d700 1 -- 172.21.15.50:0/1576836773 shutdown_connections 2023-10-06T01:22:41.119 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:41.116+0000 7f16a1f9d700 1 --2- 172.21.15.50:0/1576836773 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f169c15a250 0x7f169c15d960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:41.119 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:41.116+0000 7f16a1f9d700 1 --2- 172.21.15.50:0/1576836773 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f1680066f30 0x7f16800693e0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:41.119 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:41.116+0000 7f16a1f9d700 1 --2- 172.21.15.50:0/1576836773 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f169c0caed0 0x7f169c169f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:41.119 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:41.116+0000 7f16a1f9d700 1 --2- 172.21.15.50:0/1576836773 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f169c13c470 0x7f169c156bb0 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:41.119 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:41.116+0000 7f16a1f9d700 1 -- 172.21.15.50:0/1576836773 >> 172.21.15.50:0/1576836773 conn(0x7f169c06b370 msgr2=0x7f169c069540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:22:41.119 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:41.116+0000 7f16a1f9d700 1 -- 172.21.15.50:0/1576836773 shutdown_connections 2023-10-06T01:22:41.119 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:41.116+0000 7f16a1f9d700 1 -- 172.21.15.50:0/1576836773 wait complete. 2023-10-06T01:22:41.136 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T01:22:41.323 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:41.321+0000 7f840959d700 1 Processor -- start 2023-10-06T01:22:41.324 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:41.321+0000 7f840959d700 1 -- start start 2023-10-06T01:22:41.327 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:41.323+0000 7f840959d700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f84041538f0 0x7f84040a98e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:41.327 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:41.323+0000 7f840959d700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f8404153cc0 0x7f8404159ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:41.327 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:41.323+0000 7f840959d700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f840415a010 0x7f84040cabf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:41.327 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:41.323+0000 7f840959d700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f840415aae0 con 0x7f8404153cc0 2023-10-06T01:22:41.327 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:41.323+0000 7f840959d700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f840406a890 con 0x7f840415a010 2023-10-06T01:22:41.327 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:41.323+0000 7f840959d700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84040a9e20 con 0x7f84041538f0 2023-10-06T01:22:41.327 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:41.323+0000 7f84037fe700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f8404153cc0 0x7f8404159ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:41.327 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:41.323+0000 7f84037fe700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f8404153cc0 0x7f8404159ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:54858/0 (socket says 172.21.15.50:54858) 2023-10-06T01:22:41.327 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:41.323+0000 7f84037fe700 1 -- 172.21.15.50:0/1247886883 learned_addr learned my addr 172.21.15.50:0/1247886883 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-06T01:22:41.328 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:41.323+0000 7f8403fff700 1 --2- 172.21.15.50:0/1247886883 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f84041538f0 0x7f84040a98e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:41.328 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:41.323+0000 7f8408d9c700 1 --2- 172.21.15.50:0/1247886883 >> v2:172.21.15.155:3300/0 conn(0x7f840415a010 0x7f84040cabf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:41.328 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:41.324+0000 7f84037fe700 1 -- 172.21.15.50:0/1247886883 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f84041538f0 msgr2=0x7f84040a98e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:22:41.328 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:41.324+0000 7f84037fe700 1 --2- 172.21.15.50:0/1247886883 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f84041538f0 0x7f84040a98e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:41.328 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:41.324+0000 7f84037fe700 1 -- 172.21.15.50:0/1247886883 >> v2:172.21.15.155:3300/0 conn(0x7f840415a010 msgr2=0x7f84040cabf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:22:41.328 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:41.324+0000 7f84037fe700 1 --2- 172.21.15.50:0/1247886883 >> v2:172.21.15.155:3300/0 conn(0x7f840415a010 0x7f84040cabf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:41.328 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:41.324+0000 7f84037fe700 1 -- 172.21.15.50:0/1247886883 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f840415a520 con 0x7f8404153cc0 2023-10-06T01:22:41.328 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:41.324+0000 7f84037fe700 1 --2- 172.21.15.50:0/1247886883 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8404153cc0 0x7f8404159ad0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f8404154130 tx=0x7f83f8009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7a00d42430cdc571 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:22:41.328 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:41.324+0000 7f8402ffd700 1 -- 172.21.15.50:0/1247886883 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83f800b640 con 0x7f8404153cc0 2023-10-06T01:22:41.328 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:41.324+0000 7f8402ffd700 1 -- 172.21.15.50:0/1247886883 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83f800b7a0 con 0x7f8404153cc0 2023-10-06T01:22:41.329 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:41.324+0000 7f8402ffd700 1 -- 172.21.15.50:0/1247886883 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83f800bb60 con 0x7f8404153cc0 2023-10-06T01:22:41.329 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:41.325+0000 7f840959d700 1 -- 172.21.15.50:0/1247886883 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8404153cc0 msgr2=0x7f8404159ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:41.329 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:41.325+0000 7f840959d700 1 --2- 172.21.15.50:0/1247886883 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8404153cc0 0x7f8404159ad0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f8404154130 tx=0x7f83f8009250 comp rx=0 tx=0).stop 2023-10-06T01:22:41.329 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:41.325+0000 7f840959d700 1 -- 172.21.15.50:0/1247886883 shutdown_connections 2023-10-06T01:22:41.329 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:41.325+0000 7f840959d700 1 --2- 172.21.15.50:0/1247886883 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f84041538f0 0x7f84040a98e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:41.329 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:41.325+0000 7f840959d700 1 --2- 172.21.15.50:0/1247886883 >> v2:172.21.15.155:3300/0 conn(0x7f840415a010 0x7f84040cabf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:41.329 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:41.325+0000 7f840959d700 1 --2- 172.21.15.50:0/1247886883 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8404153cc0 0x7f8404159ad0 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:41.329 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:41.325+0000 7f840959d700 1 -- 172.21.15.50:0/1247886883 >> 172.21.15.50:0/1247886883 conn(0x7f84040691d0 msgr2=0x7f84040cd020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:22:41.330 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:41.325+0000 7f840959d700 1 -- 172.21.15.50:0/1247886883 shutdown_connections 2023-10-06T01:22:41.330 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:41.325+0000 7f840959d700 1 -- 172.21.15.50:0/1247886883 wait complete. 2023-10-06T01:22:41.332 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:41.326+0000 7f840959d700 1 Processor -- start 2023-10-06T01:22:41.332 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:41.326+0000 7f840959d700 1 -- start start 2023-10-06T01:22:41.332 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:41.327+0000 7f840959d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f84041538f0 0x7f840415ac20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:41.332 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:41.327+0000 7f840959d700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8404153cc0 0x7f84040aaf70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:41.333 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:41.327+0000 7f840959d700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f840415a010 0x7f8404150bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:41.333 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:41.327+0000 7f840959d700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f840415b160 con 0x7f84041538f0 2023-10-06T01:22:41.333 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:41.327+0000 7f840959d700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84040ae680 con 0x7f8404153cc0 2023-10-06T01:22:41.333 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:41.327+0000 7f840959d700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84040ad6a0 con 0x7f840415a010 2023-10-06T01:22:41.333 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:41.328+0000 7f8403fff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f84041538f0 0x7f840415ac20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:41.333 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:41.328+0000 7f8403fff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f84041538f0 0x7f840415ac20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:54862/0 (socket says 172.21.15.50:54862) 2023-10-06T01:22:41.333 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:41.328+0000 7f8403fff700 1 -- 172.21.15.50:0/3251599741 learned_addr learned my addr 172.21.15.50:0/3251599741 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-06T01:22:41.333 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:41.328+0000 7f8403fff700 1 -- 172.21.15.50:0/3251599741 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f840415a010 msgr2=0x7f8404150bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:41.334 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:41.328+0000 7f8403fff700 1 --2- 172.21.15.50:0/3251599741 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f840415a010 0x7f8404150bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:41.334 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:41.328+0000 7f8403fff700 1 -- 172.21.15.50:0/3251599741 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8404153cc0 msgr2=0x7f84040aaf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:41.334 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:41.328+0000 7f8403fff700 1 --2- 172.21.15.50:0/3251599741 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8404153cc0 0x7f84040aaf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:41.334 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:41.328+0000 7f8403fff700 1 -- 172.21.15.50:0/3251599741 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83f80094f0 con 0x7f84041538f0 2023-10-06T01:22:41.334 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:41.328+0000 7f8403fff700 1 --2- 172.21.15.50:0/3251599741 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f84041538f0 0x7f840415ac20 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f83f400e930 tx=0x7f83f40091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:22:41.334 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:41.328+0000 7f83ebfff700 1 -- 172.21.15.50:0/3251599741 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83f400eed0 con 0x7f84041538f0 2023-10-06T01:22:41.334 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:41.329+0000 7f83ebfff700 1 -- 172.21.15.50:0/3251599741 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83f400c850 con 0x7f84041538f0 2023-10-06T01:22:41.334 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:41.329+0000 7f83ebfff700 1 -- 172.21.15.50:0/3251599741 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83f400cbf0 con 0x7f84041538f0 2023-10-06T01:22:41.334 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:41.329+0000 7f840959d700 1 -- 172.21.15.50:0/3251599741 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f84040ae920 con 0x7f84041538f0 2023-10-06T01:22:41.334 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:41.329+0000 7f840959d700 1 -- 172.21.15.50:0/3251599741 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f840415dc10 con 0x7f84041538f0 2023-10-06T01:22:41.335 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:41.330+0000 7f840959d700 1 -- 172.21.15.50:0/3251599741 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f840405f270 con 0x7f84041538f0 2023-10-06T01:22:41.335 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:41.330+0000 7f83ebfff700 1 -- 172.21.15.50:0/3251599741 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f83f4013470 con 0x7f84041538f0 2023-10-06T01:22:41.335 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:41.331+0000 7f83ebfff700 1 --2- 172.21.15.50:0/3251599741 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f83f0066f60 0x7f83f0069410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:41.335 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:41.331+0000 7f83ebfff700 1 -- 172.21.15.50:0/3251599741 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6867+0+0 (secure 0 0 0) 0x7f83f4084c50 con 0x7f84041538f0 2023-10-06T01:22:41.336 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:41.332+0000 7f84037fe700 1 --2- 172.21.15.50:0/3251599741 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f83f0066f60 0x7f83f0069410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:41.336 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:41.333+0000 7f84037fe700 1 --2- 172.21.15.50:0/3251599741 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f83f0066f60 0x7f83f0069410 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f8404154130 tx=0x7f83f8017000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:22:41.337 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:41.335+0000 7f83ebfff700 1 -- 172.21.15.50:0/3251599741 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f83f4051990 con 0x7f84041538f0 2023-10-06T01:22:41.587 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:41.585+0000 7f840959d700 1 -- 172.21.15.50:0/3251599741 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f84040c3b70 con 0x7f84041538f0 2023-10-06T01:22:41.587 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:41.586+0000 7f83ebfff700 1 -- 172.21.15.50:0/3251599741 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4593 (secure 0 0 0) 0x7f83f4054fb0 con 0x7f84041538f0 2023-10-06T01:22:41.588 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-10-06T01:22:41.588 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4214,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6835/33654067","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6833","nonce":33654067},{"type":"v1","addr":"172.21.15.50:6835","nonce":33654067}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4279,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6836/2571345069","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":2571345069},{"type":"v1","addr":"172.21.15.155:6836","nonce":2571345069}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4290,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6834/4140731341","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6832","nonce":4140731341},{"type":"v1","addr":"172.21.15.50:6834","nonce":4140731341}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T01:21:36.779774+0000","modified":"2023-10-06T01:21:58.876370+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4302},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4302":{"gid":4302,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.155:6837/3434423585","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6835","nonce":3434423585},{"type":"v1","addr":"172.21.15.155:6837","nonce":3434423585}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2023-10-06T01:22:41.591 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:41.588+0000 7f840959d700 1 -- 172.21.15.50:0/3251599741 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f83f0066f60 msgr2=0x7f83f0069410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:41.591 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:41.588+0000 7f840959d700 1 --2- 172.21.15.50:0/3251599741 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f83f0066f60 0x7f83f0069410 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f8404154130 tx=0x7f83f8017000 comp rx=0 tx=0).stop 2023-10-06T01:22:41.591 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:41.588+0000 7f840959d700 1 -- 172.21.15.50:0/3251599741 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f84041538f0 msgr2=0x7f840415ac20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:41.591 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:41.588+0000 7f840959d700 1 --2- 172.21.15.50:0/3251599741 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f84041538f0 0x7f840415ac20 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f83f400e930 tx=0x7f83f40091a0 comp rx=0 tx=0).stop 2023-10-06T01:22:41.591 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:41.588+0000 7f840959d700 1 -- 172.21.15.50:0/3251599741 shutdown_connections 2023-10-06T01:22:41.591 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:41.588+0000 7f840959d700 1 --2- 172.21.15.50:0/3251599741 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f840415a010 0x7f8404150bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:41.591 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:41.588+0000 7f840959d700 1 --2- 172.21.15.50:0/3251599741 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f84041538f0 0x7f840415ac20 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:41.591 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:41.588+0000 7f840959d700 1 --2- 172.21.15.50:0/3251599741 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f83f0066f60 0x7f83f0069410 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:41.591 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:41.588+0000 7f840959d700 1 --2- 172.21.15.50:0/3251599741 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8404153cc0 0x7f84040aaf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:41.591 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:41.588+0000 7f840959d700 1 -- 172.21.15.50:0/3251599741 >> 172.21.15.50:0/3251599741 conn(0x7f84040691d0 msgr2=0x7f84040c2a00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:22:41.592 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:41.588+0000 7f840959d700 1 -- 172.21.15.50:0/3251599741 shutdown_connections 2023-10-06T01:22:41.592 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:41.588+0000 7f840959d700 1 -- 172.21.15.50:0/3251599741 wait complete. 2023-10-06T01:22:41.592 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 9 2023-10-06T01:22:41.607 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T01:22:41.795 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:41.793+0000 7fe290b9d700 1 Processor -- start 2023-10-06T01:22:41.795 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:41.793+0000 7fe290b9d700 1 -- start start 2023-10-06T01:22:41.796 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:41.794+0000 7fe290b9d700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fe28c06a5d0 0x7fe28c153730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:41.796 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:41.794+0000 7fe290b9d700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fe28c06e6a0 0x7fe28c153c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:41.796 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:41.794+0000 7fe290b9d700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe28c0c9d00 con 0x7fe28c06a9a0 2023-10-06T01:22:41.797 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:41.794+0000 7fe290b9d700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe28c06f5a0 con 0x7fe28c06e6a0 2023-10-06T01:22:41.797 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:41.794+0000 7fe290b9d700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe28c06eae0 con 0x7fe28c06a5d0 2023-10-06T01:22:41.797 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:41.794+0000 7fe28affd700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fe28c06a9a0 0x7fe28c06df90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:56890/0 (socket says 172.21.15.50:56890) 2023-10-06T01:22:41.797 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:41.794+0000 7fe28affd700 1 -- 172.21.15.50:0/2553361786 learned_addr learned my addr 172.21.15.50:0/2553361786 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-10-06T01:22:41.797 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:41.794+0000 7fe28bfff700 1 --2- 172.21.15.50:0/2553361786 >> v2:172.21.15.50:3300/0 conn(0x7fe28c06e6a0 0x7fe28c153c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:41.797 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:41.795+0000 7fe28b7fe700 1 --2- 172.21.15.50:0/2553361786 >> v2:172.21.15.155:3300/0 conn(0x7fe28c06a5d0 0x7fe28c153730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:41.798 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:41.795+0000 7fe28a7fc700 1 -- 172.21.15.50:0/2553361786 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 55569784 0 0) 0x7fe28c0c9d00 con 0x7fe28c06a9a0 2023-10-06T01:22:41.799 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:41.795+0000 7fe28bfff700 1 -- 172.21.15.50:0/2553361786 >> v2:172.21.15.155:3300/0 conn(0x7fe28c06a5d0 msgr2=0x7fe28c153730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:22:41.799 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:41.795+0000 7fe28bfff700 1 --2- 172.21.15.50:0/2553361786 >> v2:172.21.15.155:3300/0 conn(0x7fe28c06a5d0 0x7fe28c153730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:41.799 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:41.795+0000 7fe28bfff700 1 -- 172.21.15.50:0/2553361786 >> v1:172.21.15.50:6789/0 conn(0x7fe28c06a9a0 legacy=0x7fe28c06df90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:41.799 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:41.795+0000 7fe28bfff700 1 -- 172.21.15.50:0/2553361786 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe28c0c6750 con 0x7fe28c06e6a0 2023-10-06T01:22:41.799 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:41.795+0000 7fe28bfff700 1 --2- 172.21.15.50:0/2553361786 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe28c06e6a0 0x7fe28c153c70 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fe28c06c6a0 tx=0x7fe284009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dd075456a44a595c server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:22:41.799 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:41.795+0000 7fe28a7fc700 1 -- 172.21.15.50:0/2553361786 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe28400e070 con 0x7fe28c06e6a0 2023-10-06T01:22:41.799 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:41.795+0000 7fe28a7fc700 1 -- 172.21.15.50:0/2553361786 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe28400bb20 con 0x7fe28c06e6a0 2023-10-06T01:22:41.799 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:41.795+0000 7fe28a7fc700 1 -- 172.21.15.50:0/2553361786 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe284012430 con 0x7fe28c06e6a0 2023-10-06T01:22:41.799 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:41.796+0000 7fe290b9d700 1 -- 172.21.15.50:0/2553361786 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe28c06e6a0 msgr2=0x7fe28c153c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:41.799 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:41.796+0000 7fe290b9d700 1 --2- 172.21.15.50:0/2553361786 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe28c06e6a0 0x7fe28c153c70 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fe28c06c6a0 tx=0x7fe284009780 comp rx=0 tx=0).stop 2023-10-06T01:22:41.799 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:41.796+0000 7fe290b9d700 1 -- 172.21.15.50:0/2553361786 shutdown_connections 2023-10-06T01:22:41.800 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:41.796+0000 7fe290b9d700 1 --2- 172.21.15.50:0/2553361786 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe28c06e6a0 0x7fe28c153c70 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:41.800 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:41.796+0000 7fe290b9d700 1 --2- 172.21.15.50:0/2553361786 >> v2:172.21.15.155:3300/0 conn(0x7fe28c06a5d0 0x7fe28c153730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:41.800 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:41.796+0000 7fe290b9d700 1 -- 172.21.15.50:0/2553361786 >> 172.21.15.50:0/2553361786 conn(0x7fe28c0680c0 msgr2=0x7fe28c0cbf00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:22:41.800 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:41.796+0000 7fe290b9d700 1 -- 172.21.15.50:0/2553361786 shutdown_connections 2023-10-06T01:22:41.800 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:41.796+0000 7fe290b9d700 1 -- 172.21.15.50:0/2553361786 wait complete. 2023-10-06T01:22:41.802 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:41.798+0000 7fe290b9d700 1 Processor -- start 2023-10-06T01:22:41.802 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:41.798+0000 7fe290b9d700 1 -- start start 2023-10-06T01:22:41.802 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:41.799+0000 7fe290b9d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe28c06a5d0 0x7fe28c1695b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:41.802 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:41.799+0000 7fe290b9d700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe28c06a9a0 0x7fe28c0c2fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:41.803 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:41.799+0000 7fe290b9d700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe28c06e6a0 0x7fe28c0c34f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:41.803 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:41.799+0000 7fe290b9d700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe28c158e60 con 0x7fe28c06a5d0 2023-10-06T01:22:41.803 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:41.799+0000 7fe290b9d700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe28c1589d0 con 0x7fe28c06a9a0 2023-10-06T01:22:41.803 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:41.799+0000 7fe290b9d700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe28c157dc0 con 0x7fe28c06e6a0 2023-10-06T01:22:41.803 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:41.799+0000 7fe28b7fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe28c06a5d0 0x7fe28c1695b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:41.803 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:41.799+0000 7fe28b7fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe28c06a5d0 0x7fe28c1695b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:54876/0 (socket says 172.21.15.50:54876) 2023-10-06T01:22:41.803 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:41.799+0000 7fe28b7fe700 1 -- 172.21.15.50:0/934074341 learned_addr learned my addr 172.21.15.50:0/934074341 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-06T01:22:41.803 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:41.799+0000 7fe28affd700 1 --2- 172.21.15.50:0/934074341 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe28c06a9a0 0x7fe28c0c2fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:41.803 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:41.799+0000 7fe28bfff700 1 --2- 172.21.15.50:0/934074341 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe28c06e6a0 0x7fe28c0c34f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:41.803 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:41.799+0000 7fe28b7fe700 1 -- 172.21.15.50:0/934074341 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe28c06e6a0 msgr2=0x7fe28c0c34f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:41.803 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:41.799+0000 7fe28b7fe700 1 --2- 172.21.15.50:0/934074341 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe28c06e6a0 0x7fe28c0c34f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:41.804 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:41.799+0000 7fe28b7fe700 1 -- 172.21.15.50:0/934074341 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe28c06a9a0 msgr2=0x7fe28c0c2fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:41.804 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:41.799+0000 7fe28b7fe700 1 --2- 172.21.15.50:0/934074341 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe28c06a9a0 0x7fe28c0c2fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:41.804 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:41.799+0000 7fe28b7fe700 1 -- 172.21.15.50:0/934074341 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe284009a20 con 0x7fe28c06a5d0 2023-10-06T01:22:41.804 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:41.800+0000 7fe28b7fe700 1 --2- 172.21.15.50:0/934074341 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe28c06a5d0 0x7fe28c1695b0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fe27c00e960 tx=0x7fe27c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:22:41.804 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:41.800+0000 7fe2737fe700 1 -- 172.21.15.50:0/934074341 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe27c00c7f0 con 0x7fe28c06a5d0 2023-10-06T01:22:41.804 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:41.800+0000 7fe2737fe700 1 -- 172.21.15.50:0/934074341 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe27c00c950 con 0x7fe28c06a5d0 2023-10-06T01:22:41.804 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:41.800+0000 7fe2737fe700 1 -- 172.21.15.50:0/934074341 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe27c00ccf0 con 0x7fe28c06a5d0 2023-10-06T01:22:41.804 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:41.800+0000 7fe290b9d700 1 -- 172.21.15.50:0/934074341 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe28c1580a0 con 0x7fe28c06a5d0 2023-10-06T01:22:41.804 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:41.800+0000 7fe290b9d700 1 -- 172.21.15.50:0/934074341 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe28c158660 con 0x7fe28c06a5d0 2023-10-06T01:22:41.805 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:41.801+0000 7fe290b9d700 1 -- 172.21.15.50:0/934074341 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe28c05f270 con 0x7fe28c06a5d0 2023-10-06T01:22:41.805 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:41.802+0000 7fe2737fe700 1 -- 172.21.15.50:0/934074341 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fe27c013680 con 0x7fe28c06a5d0 2023-10-06T01:22:41.805 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:41.803+0000 7fe2737fe700 1 --2- 172.21.15.50:0/934074341 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7fe278066f30 0x7fe2780693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:41.806 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:41.803+0000 7fe2737fe700 1 -- 172.21.15.50:0/934074341 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6867+0+0 (secure 0 0 0) 0x7fe27c084c30 con 0x7fe28c06a5d0 2023-10-06T01:22:41.806 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:41.804+0000 7fe28affd700 1 --2- 172.21.15.50:0/934074341 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7fe278066f30 0x7fe2780693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:41.806 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:41.804+0000 7fe28affd700 1 --2- 172.21.15.50:0/934074341 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7fe278066f30 0x7fe2780693e0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fe28c0c1910 tx=0x7fe280009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:22:41.809 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:41.807+0000 7fe2737fe700 1 -- 172.21.15.50:0/934074341 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe27c051970 con 0x7fe28c06a5d0 2023-10-06T01:22:42.014 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:42.012+0000 7fe290b9d700 1 -- 172.21.15.50:0/934074341 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe28c0c7f80 con 0x7fe28c06a5d0 2023-10-06T01:22:42.014 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:42.013+0000 7fe2737fe700 1 -- 172.21.15.50:0/934074341 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+18803 (secure 0 0 0) 0x7fe27c054f90 con 0x7fe28c06a5d0 2023-10-06T01:22:42.015 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-10-06T01:22:42.015 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":27,"fsid":"0bfd9a6b-1587-4fe4-a89e-e43c00286b4e","created":"2023-10-06T01:21:16.828801+0000","modified":"2023-10-06T01:22:24.863940+0000","last_up_change":"2023-10-06T01:21:28.584523+0000","last_in_change":"2023-10-06T01:21:20.179863+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-10-06T01:21:29.304225+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":".mgr","create_time":"2023-10-06T01:21:29.835490+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-06T01:21:34.675315+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-06T01:21:35.753991+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-10-06T01:21:38.853108+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"9060727a-3959-4de3-8363-c5c5d7826c9a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":87837},{"type":"v1","addr":"172.21.15.50:6801","nonce":87837}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":87837},{"type":"v1","addr":"172.21.15.50:6803","nonce":87837}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":87837},{"type":"v1","addr":"172.21.15.50:6807","nonce":87837}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":87837},{"type":"v1","addr":"172.21.15.50:6805","nonce":87837}]},"public_addr":"172.21.15.50:6801/87837","cluster_addr":"172.21.15.50:6803/87837","heartbeat_back_addr":"172.21.15.50:6807/87837","heartbeat_front_addr":"172.21.15.50:6805/87837","state":["exists","up"]},{"osd":1,"uuid":"5ad9ef12-b579-47ea-b690-90ba887e2cef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":87853},{"type":"v1","addr":"172.21.15.50:6809","nonce":87853}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":87853},{"type":"v1","addr":"172.21.15.50:6811","nonce":87853}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":87853},{"type":"v1","addr":"172.21.15.50:6815","nonce":87853}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":87853},{"type":"v1","addr":"172.21.15.50:6813","nonce":87853}]},"public_addr":"172.21.15.50:6809/87853","cluster_addr":"172.21.15.50:6811/87853","heartbeat_back_addr":"172.21.15.50:6815/87853","heartbeat_front_addr":"172.21.15.50:6813/87853","state":["exists","up"]},{"osd":2,"uuid":"c7aee044-6f75-436f-90e1-ba42a57359bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6821","nonce":87855},{"type":"v1","addr":"172.21.15.50:6822","nonce":87855}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6824","nonce":87855},{"type":"v1","addr":"172.21.15.50:6826","nonce":87855}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":87855},{"type":"v1","addr":"172.21.15.50:6831","nonce":87855}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":87855},{"type":"v1","addr":"172.21.15.50:6829","nonce":87855}]},"public_addr":"172.21.15.50:6822/87855","cluster_addr":"172.21.15.50:6826/87855","heartbeat_back_addr":"172.21.15.50:6831/87855","heartbeat_front_addr":"172.21.15.50:6829/87855","state":["exists","up"]},{"osd":3,"uuid":"d9b901c8-e8b2-44af-9508-f453120a96c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":87856},{"type":"v1","addr":"172.21.15.50:6817","nonce":87856}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":87856},{"type":"v1","addr":"172.21.15.50:6819","nonce":87856}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6825","nonce":87856},{"type":"v1","addr":"172.21.15.50:6827","nonce":87856}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6820","nonce":87856},{"type":"v1","addr":"172.21.15.50:6823","nonce":87856}]},"public_addr":"172.21.15.50:6817/87856","cluster_addr":"172.21.15.50:6819/87856","heartbeat_back_addr":"172.21.15.50:6827/87856","heartbeat_front_addr":"172.21.15.50:6823/87856","state":["exists","up"]},{"osd":4,"uuid":"2b3c6b38-e3e9-4301-9445-60fd3fe8ce03","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":85805},{"type":"v1","addr":"172.21.15.155:6801","nonce":85805}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":85805},{"type":"v1","addr":"172.21.15.155:6803","nonce":85805}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6806","nonce":85805},{"type":"v1","addr":"172.21.15.155:6807","nonce":85805}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6804","nonce":85805},{"type":"v1","addr":"172.21.15.155:6805","nonce":85805}]},"public_addr":"172.21.15.155:6801/85805","cluster_addr":"172.21.15.155:6803/85805","heartbeat_back_addr":"172.21.15.155:6807/85805","heartbeat_front_addr":"172.21.15.155:6805/85805","state":["exists","up"]},{"osd":5,"uuid":"417b5f8f-65f1-4c94-91a7-a6ce03fe1679","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6816","nonce":85807},{"type":"v1","addr":"172.21.15.155:6818","nonce":85807}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6820","nonce":85807},{"type":"v1","addr":"172.21.15.155:6822","nonce":85807}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6828","nonce":85807},{"type":"v1","addr":"172.21.15.155:6830","nonce":85807}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6824","nonce":85807},{"type":"v1","addr":"172.21.15.155:6826","nonce":85807}]},"public_addr":"172.21.15.155:6818/85807","cluster_addr":"172.21.15.155:6822/85807","heartbeat_back_addr":"172.21.15.155:6830/85807","heartbeat_front_addr":"172.21.15.155:6826/85807","state":["exists","up"]},{"osd":6,"uuid":"c150cff3-aee4-4714-9c08-d182b1ba9ffd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6808","nonce":85806},{"type":"v1","addr":"172.21.15.155:6809","nonce":85806}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6810","nonce":85806},{"type":"v1","addr":"172.21.15.155:6811","nonce":85806}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6814","nonce":85806},{"type":"v1","addr":"172.21.15.155:6815","nonce":85806}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6812","nonce":85806},{"type":"v1","addr":"172.21.15.155:6813","nonce":85806}]},"public_addr":"172.21.15.155:6809/85806","cluster_addr":"172.21.15.155:6811/85806","heartbeat_back_addr":"172.21.15.155:6815/85806","heartbeat_front_addr":"172.21.15.155:6813/85806","state":["exists","up"]},{"osd":7,"uuid":"71107f0e-04d1-4e72-a0ec-0faf6af003e7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6817","nonce":85832},{"type":"v1","addr":"172.21.15.155:6819","nonce":85832}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6821","nonce":85832},{"type":"v1","addr":"172.21.15.155:6823","nonce":85832}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6829","nonce":85832},{"type":"v1","addr":"172.21.15.155:6831","nonce":85832}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6825","nonce":85832},{"type":"v1","addr":"172.21.15.155:6827","nonce":85832}]},"public_addr":"172.21.15.155:6819/85832","cluster_addr":"172.21.15.155:6823/85832","heartbeat_back_addr":"172.21.15.155:6831/85832","heartbeat_front_addr":"172.21.15.155:6827/85832","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:21:25.423389+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:21:25.472661+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:21:25.817562+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:21:25.551257+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:21:25.407818+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:21:25.557976+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:21:25.747299+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:21:25.827576+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.19","mappings":[{"from":3,"to":5}]},{"pgid":"4.31","mappings":[{"from":1,"to":2}]}],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T01:22:42.017 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:42.015+0000 7fe290b9d700 1 -- 172.21.15.50:0/934074341 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7fe278066f30 msgr2=0x7fe2780693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:42.018 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:42.015+0000 7fe290b9d700 1 --2- 172.21.15.50:0/934074341 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7fe278066f30 0x7fe2780693e0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fe28c0c1910 tx=0x7fe280009040 comp rx=0 tx=0).stop 2023-10-06T01:22:42.018 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:42.015+0000 7fe290b9d700 1 -- 172.21.15.50:0/934074341 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe28c06a5d0 msgr2=0x7fe28c1695b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:42.018 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:42.015+0000 7fe290b9d700 1 --2- 172.21.15.50:0/934074341 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe28c06a5d0 0x7fe28c1695b0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fe27c00e960 tx=0x7fe27c0091a0 comp rx=0 tx=0).stop 2023-10-06T01:22:42.018 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:42.015+0000 7fe290b9d700 1 -- 172.21.15.50:0/934074341 shutdown_connections 2023-10-06T01:22:42.018 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:42.015+0000 7fe290b9d700 1 --2- 172.21.15.50:0/934074341 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe28c06e6a0 0x7fe28c0c34f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:42.018 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:42.015+0000 7fe290b9d700 1 --2- 172.21.15.50:0/934074341 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe28c06a5d0 0x7fe28c1695b0 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:42.018 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:42.015+0000 7fe290b9d700 1 --2- 172.21.15.50:0/934074341 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7fe278066f30 0x7fe2780693e0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:42.019 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:42.015+0000 7fe290b9d700 1 --2- 172.21.15.50:0/934074341 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe28c06a9a0 0x7fe28c0c2fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:42.019 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:42.015+0000 7fe290b9d700 1 -- 172.21.15.50:0/934074341 >> 172.21.15.50:0/934074341 conn(0x7fe28c0680c0 msgr2=0x7fe28c0c6e10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:22:42.019 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:42.015+0000 7fe290b9d700 1 -- 172.21.15.50:0/934074341 shutdown_connections 2023-10-06T01:22:42.019 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:42.015+0000 7fe290b9d700 1 -- 172.21.15.50:0/934074341 wait complete. 2023-10-06T01:22:42.035 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-10-06T01:22:42.035 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T01:22:42.222 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:42.220+0000 7f759ffff700 1 Processor -- start 2023-10-06T01:22:42.222 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:42.220+0000 7f759ffff700 1 -- start start 2023-10-06T01:22:42.223 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:42.221+0000 7f759ffff700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f75a00cbc70 0x7f75a00cc0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:42.223 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:42.221+0000 7f759ffff700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f75a00cb7e0 con 0x7f75a0159480 2023-10-06T01:22:42.223 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:42.221+0000 7f759ffff700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f75a00b08a0 con 0x7f75a00b2140 2023-10-06T01:22:42.223 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:42.221+0000 7f759ffff700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f75a00cb190 con 0x7f75a00cbc70 2023-10-06T01:22:42.223 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:42.221+0000 7f759effd700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f75a0159480 0x7f75a00b30d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:56896/0 (socket says 172.21.15.50:56896) 2023-10-06T01:22:42.223 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:42.221+0000 7f759effd700 1 -- 172.21.15.50:0/2969377663 learned_addr learned my addr 172.21.15.50:0/2969377663 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-10-06T01:22:42.226 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:42.222+0000 7f759e7fc700 1 --2- 172.21.15.50:0/2969377663 >> v2:172.21.15.155:3300/0 conn(0x7f75a00cbc70 0x7f75a00cc0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:42.226 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:42.222+0000 7f759dffb700 1 -- 172.21.15.50:0/2969377663 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1282387506 0 0) 0x7f75a00cb7e0 con 0x7f75a0159480 2023-10-06T01:22:42.226 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:42.222+0000 7f759dffb700 1 -- 172.21.15.50:0/2969377663 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7588003570 con 0x7f75a0159480 2023-10-06T01:22:42.226 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:42.222+0000 7f759dffb700 1 -- 172.21.15.50:0/2969377663 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2546682218 0 0) 0x7f7588003570 con 0x7f75a0159480 2023-10-06T01:22:42.226 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:42.222+0000 7f759dffb700 1 -- 172.21.15.50:0/2969377663 >> v2:172.21.15.155:3300/0 conn(0x7f75a00cbc70 msgr2=0x7f75a00cc0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:22:42.226 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:42.222+0000 7f759dffb700 1 --2- 172.21.15.50:0/2969377663 >> v2:172.21.15.155:3300/0 conn(0x7f75a00cbc70 0x7f75a00cc0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:42.226 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:42.222+0000 7f759dffb700 1 -- 172.21.15.50:0/2969377663 >> v1:172.21.15.155:6789/0 conn(0x7f75a00b2140 legacy=0x7f75a00b2560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:42.227 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:42.222+0000 7f759dffb700 1 -- 172.21.15.50:0/2969377663 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75a00cb470 con 0x7f75a0159480 2023-10-06T01:22:42.227 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:42.222+0000 7f759dffb700 1 -- 172.21.15.50:0/2969377663 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 347519148 0 0) 0x7f7590001470 con 0x7f75a0159480 2023-10-06T01:22:42.227 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:42.222+0000 7f759dffb700 1 -- 172.21.15.50:0/2969377663 >> v1:172.21.15.50:6789/0 conn(0x7f75a0159480 legacy=0x7f75a00b30d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:42.227 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:42.222+0000 7f759dffb700 1 --2- 172.21.15.50:0/2969377663 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7588003a60 0x7f7588003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:42.227 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:42.222+0000 7f759dffb700 1 --2- 172.21.15.50:0/2969377663 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7588004810 0x7f7588004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:42.227 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:42.222+0000 7f759dffb700 1 --2- 172.21.15.50:0/2969377663 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f75880051c0 0x7f758800ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:42.227 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:42.222+0000 7f759dffb700 1 -- 172.21.15.50:0/2969377663 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75a00cb190 con 0x7f7588003a60 2023-10-06T01:22:42.227 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:42.222+0000 7f759dffb700 1 -- 172.21.15.50:0/2969377663 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f758800c050 con 0x7f7588004810 2023-10-06T01:22:42.227 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:42.222+0000 7f759dffb700 1 -- 172.21.15.50:0/2969377663 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f758800c210 con 0x7f75880051c0 2023-10-06T01:22:42.227 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:42.222+0000 7f759effd700 1 --2- 172.21.15.50:0/2969377663 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7588003a60 0x7f7588003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:42.227 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:42.223+0000 7f759f7fe700 1 --2- 172.21.15.50:0/2969377663 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f75880051c0 0x7f758800ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:42.227 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:42.223+0000 7f759e7fc700 1 --2- 172.21.15.50:0/2969377663 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7588004810 0x7f7588004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:42.228 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:42.223+0000 7f759effd700 1 -- 172.21.15.50:0/2969377663 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f75880051c0 msgr2=0x7f758800ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:22:42.228 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:42.223+0000 7f759effd700 1 --2- 172.21.15.50:0/2969377663 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f75880051c0 0x7f758800ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:42.228 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:42.223+0000 7f759effd700 1 -- 172.21.15.50:0/2969377663 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7588004810 msgr2=0x7f7588004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:22:42.228 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:42.223+0000 7f759effd700 1 --2- 172.21.15.50:0/2969377663 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7588004810 0x7f7588004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:42.228 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:42.223+0000 7f759effd700 1 -- 172.21.15.50:0/2969377663 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7588003570 con 0x7f7588003a60 2023-10-06T01:22:42.228 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:42.223+0000 7f759f7fe700 1 -- 172.21.15.50:0/2969377663 reap_dead start 2023-10-06T01:22:42.228 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:42.223+0000 7f759effd700 1 --2- 172.21.15.50:0/2969377663 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7588003a60 0x7f7588003e30 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f759000c3c0 tx=0x7f7590001e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=54f325d77aa79487 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:22:42.228 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:42.223+0000 7f759dffb700 1 -- 172.21.15.50:0/2969377663 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f759000cc50 con 0x7f7588003a60 2023-10-06T01:22:42.228 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:42.224+0000 7f759dffb700 1 -- 172.21.15.50:0/2969377663 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f759000cdb0 con 0x7f7588003a60 2023-10-06T01:22:42.228 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:42.224+0000 7f759dffb700 1 -- 172.21.15.50:0/2969377663 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7590005b70 con 0x7f7588003a60 2023-10-06T01:22:42.228 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:42.224+0000 7f759ffff700 1 -- 172.21.15.50:0/2969377663 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7588003a60 msgr2=0x7f7588003e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:42.229 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:42.224+0000 7f759ffff700 1 --2- 172.21.15.50:0/2969377663 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7588003a60 0x7f7588003e30 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f759000c3c0 tx=0x7f7590001e70 comp rx=0 tx=0).stop 2023-10-06T01:22:42.229 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:42.224+0000 7f759ffff700 1 -- 172.21.15.50:0/2969377663 shutdown_connections 2023-10-06T01:22:42.229 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:42.224+0000 7f759ffff700 1 --2- 172.21.15.50:0/2969377663 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7588003a60 0x7f7588003e30 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:42.229 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:42.224+0000 7f759ffff700 1 -- 172.21.15.50:0/2969377663 >> 172.21.15.50:0/2969377663 conn(0x7f75a006ed20 msgr2=0x7f75a006f120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:22:42.229 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:42.224+0000 7f759ffff700 1 -- 172.21.15.50:0/2969377663 shutdown_connections 2023-10-06T01:22:42.229 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:42.224+0000 7f759ffff700 1 -- 172.21.15.50:0/2969377663 wait complete. 2023-10-06T01:22:42.231 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:42.226+0000 7f759ffff700 1 Processor -- start 2023-10-06T01:22:42.231 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:42.226+0000 7f759ffff700 1 -- start start 2023-10-06T01:22:42.231 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:42.227+0000 7f759ffff700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7588003a60 0x7f75a00c7e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:42.231 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:42.227+0000 7f759ffff700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f75a00c64e0 0x7f75a01557f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:42.231 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:42.227+0000 7f759ffff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f75a015ac10 0x7f75a00c9550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:42.231 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:42.227+0000 7f759ffff700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75a00c9370 con 0x7f75a015ac10 2023-10-06T01:22:42.232 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:42.227+0000 7f759ffff700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75a00c8360 con 0x7f7588003a60 2023-10-06T01:22:42.232 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:42.227+0000 7f759ffff700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75a0155d30 con 0x7f75a00c64e0 2023-10-06T01:22:42.232 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:42.227+0000 7f759f7fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f75a015ac10 0x7f75a00c9550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:42.232 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:42.227+0000 7f759f7fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f75a015ac10 0x7f75a00c9550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:54892/0 (socket says 172.21.15.50:54892) 2023-10-06T01:22:42.232 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:42.227+0000 7f759f7fe700 1 -- 172.21.15.50:0/2606608293 learned_addr learned my addr 172.21.15.50:0/2606608293 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-06T01:22:42.232 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:42.227+0000 7f759e7fc700 1 --2- 172.21.15.50:0/2606608293 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f75a00c64e0 0x7f75a01557f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:42.232 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:42.227+0000 7f759effd700 1 --2- 172.21.15.50:0/2606608293 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7588003a60 0x7f75a00c7e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:42.232 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:42.227+0000 7f759f7fe700 1 -- 172.21.15.50:0/2606608293 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f75a00c64e0 msgr2=0x7f75a01557f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:42.232 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:42.227+0000 7f759f7fe700 1 --2- 172.21.15.50:0/2606608293 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f75a00c64e0 0x7f75a01557f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:42.232 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:42.227+0000 7f759f7fe700 1 -- 172.21.15.50:0/2606608293 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7588003a60 msgr2=0x7f75a00c7e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:42.232 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:42.227+0000 7f759f7fe700 1 --2- 172.21.15.50:0/2606608293 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7588003a60 0x7f75a00c7e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:42.233 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:42.227+0000 7f759f7fe700 1 -- 172.21.15.50:0/2606608293 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75a00c3ca0 con 0x7f75a015ac10 2023-10-06T01:22:42.233 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:42.228+0000 7f759f7fe700 1 --2- 172.21.15.50:0/2606608293 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f75a015ac10 0x7f75a00c9550 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f75a00c3ad0 tx=0x7f7598001710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:22:42.233 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:42.228+0000 7f7586ffd700 1 -- 172.21.15.50:0/2606608293 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f759800c820 con 0x7f75a015ac10 2023-10-06T01:22:42.233 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:42.228+0000 7f7586ffd700 1 -- 172.21.15.50:0/2606608293 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f759800c9a0 con 0x7f75a015ac10 2023-10-06T01:22:42.233 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:42.228+0000 7f7586ffd700 1 -- 172.21.15.50:0/2606608293 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f759800cd60 con 0x7f75a015ac10 2023-10-06T01:22:42.233 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:42.228+0000 7f759ffff700 1 -- 172.21.15.50:0/2606608293 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f75a00c3f80 con 0x7f75a015ac10 2023-10-06T01:22:42.233 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:42.228+0000 7f759ffff700 1 -- 172.21.15.50:0/2606608293 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f75a00c4540 con 0x7f75a015ac10 2023-10-06T01:22:42.233 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:42.229+0000 7f759ffff700 1 -- 172.21.15.50:0/2606608293 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f75a00c4760 con 0x7f75a015ac10 2023-10-06T01:22:42.234 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:42.230+0000 7f7586ffd700 1 -- 172.21.15.50:0/2606608293 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f7598015640 con 0x7f75a015ac10 2023-10-06T01:22:42.234 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:42.231+0000 7f7586ffd700 1 --2- 172.21.15.50:0/2606608293 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f758c066f30 0x7f758c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:42.234 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:42.231+0000 7f7586ffd700 1 -- 172.21.15.50:0/2606608293 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6867+0+0 (secure 0 0 0) 0x7f75980850a0 con 0x7f75a015ac10 2023-10-06T01:22:42.234 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:42.232+0000 7f759effd700 1 --2- 172.21.15.50:0/2606608293 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f758c066f30 0x7f758c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:42.234 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:42.232+0000 7f759effd700 1 --2- 172.21.15.50:0/2606608293 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f758c066f30 0x7f758c0693e0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f7590007cf0 tx=0x7f7590015000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:22:42.237 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:42.235+0000 7f7586ffd700 1 -- 172.21.15.50:0/2606608293 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f7598051de0 con 0x7f75a015ac10 2023-10-06T01:22:42.485 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:42.483+0000 7f759ffff700 1 -- 172.21.15.50:0/2606608293 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f75a005f270 con 0x7f75a015ac10 2023-10-06T01:22:42.486 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:42.484+0000 7f7586ffd700 1 -- 172.21.15.50:0/2606608293 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4593 (secure 0 0 0) 0x7f7598004100 con 0x7f75a015ac10 2023-10-06T01:22:42.486 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-10-06T01:22:42.486 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4214,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6835/33654067","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6833","nonce":33654067},{"type":"v1","addr":"172.21.15.50:6835","nonce":33654067}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4279,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6836/2571345069","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":2571345069},{"type":"v1","addr":"172.21.15.155:6836","nonce":2571345069}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4290,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6834/4140731341","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6832","nonce":4140731341},{"type":"v1","addr":"172.21.15.50:6834","nonce":4140731341}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T01:21:36.779774+0000","modified":"2023-10-06T01:21:58.876370+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4302},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4302":{"gid":4302,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.155:6837/3434423585","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6835","nonce":3434423585},{"type":"v1","addr":"172.21.15.155:6837","nonce":3434423585}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2023-10-06T01:22:42.489 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:42.486+0000 7f759ffff700 1 -- 172.21.15.50:0/2606608293 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f758c066f30 msgr2=0x7f758c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:42.489 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:42.486+0000 7f759ffff700 1 --2- 172.21.15.50:0/2606608293 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f758c066f30 0x7f758c0693e0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f7590007cf0 tx=0x7f7590015000 comp rx=0 tx=0).stop 2023-10-06T01:22:42.489 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:42.486+0000 7f759ffff700 1 -- 172.21.15.50:0/2606608293 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f75a015ac10 msgr2=0x7f75a00c9550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:42.489 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:42.486+0000 7f759ffff700 1 --2- 172.21.15.50:0/2606608293 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f75a015ac10 0x7f75a00c9550 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f75a00c3ad0 tx=0x7f7598001710 comp rx=0 tx=0).stop 2023-10-06T01:22:42.489 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:42.487+0000 7f759ffff700 1 -- 172.21.15.50:0/2606608293 shutdown_connections 2023-10-06T01:22:42.490 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:42.487+0000 7f759ffff700 1 --2- 172.21.15.50:0/2606608293 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f75a015ac10 0x7f75a00c9550 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:42.490 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:42.487+0000 7f759ffff700 1 --2- 172.21.15.50:0/2606608293 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f758c066f30 0x7f758c0693e0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:42.490 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:42.487+0000 7f759ffff700 1 --2- 172.21.15.50:0/2606608293 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7588003a60 0x7f75a00c7e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:42.490 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:42.487+0000 7f759ffff700 1 --2- 172.21.15.50:0/2606608293 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f75a00c64e0 0x7f75a01557f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:42.490 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:42.487+0000 7f759ffff700 1 -- 172.21.15.50:0/2606608293 >> 172.21.15.50:0/2606608293 conn(0x7f75a006ed20 msgr2=0x7f75a00cde30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:22:42.490 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:42.487+0000 7f759ffff700 1 -- 172.21.15.50:0/2606608293 shutdown_connections 2023-10-06T01:22:42.490 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:42.487+0000 7f759ffff700 1 -- 172.21.15.50:0/2606608293 wait complete. 2023-10-06T01:22:42.491 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 9 2023-10-06T01:22:42.506 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T01:22:42.694 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:42.692+0000 7f8c0bfff700 1 Processor -- start 2023-10-06T01:22:42.694 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:42.692+0000 7f8c0bfff700 1 -- start start 2023-10-06T01:22:42.695 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:42.693+0000 7f8c0bfff700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f8c0c0cb5e0 0x7f8c0c0cb9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:42.695 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:42.693+0000 7f8c0bfff700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8c0c06f350 0x7f8c0c06d630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:42.695 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:42.693+0000 7f8c0bfff700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8c0c06e080 con 0x7f8c0c06db70 2023-10-06T01:22:42.695 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:42.693+0000 7f8c0bfff700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8c0c06ec00 con 0x7f8c0c0cb5e0 2023-10-06T01:22:42.695 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:42.693+0000 7f8c0bfff700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c0c06e360 con 0x7f8c0c06f350 2023-10-06T01:22:42.695 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:42.693+0000 7f8c0b7fe700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f8c0c06db70 0x7f8c0c159490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:56910/0 (socket says 172.21.15.50:56910) 2023-10-06T01:22:42.696 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:42.693+0000 7f8c0b7fe700 1 -- 172.21.15.50:0/2328828488 learned_addr learned my addr 172.21.15.50:0/2328828488 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-10-06T01:22:42.698 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:42.694+0000 7f8c0affd700 1 --2- 172.21.15.50:0/2328828488 >> v2:172.21.15.155:3300/0 conn(0x7f8c0c0cb5e0 0x7f8c0c0cb9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:42.698 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:42.694+0000 7f8c0a7fc700 1 --2- 172.21.15.50:0/2328828488 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8c0c06f350 0x7f8c0c06d630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:42.699 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:42.694+0000 7f8c09ffb700 1 -- 172.21.15.50:0/2328828488 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1209145008 0 0) 0x7f8c0c06e080 con 0x7f8c0c06db70 2023-10-06T01:22:42.699 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:42.694+0000 7f8c09ffb700 1 -- 172.21.15.50:0/2328828488 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8bf4003570 con 0x7f8c0c06db70 2023-10-06T01:22:42.699 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:42.694+0000 7f8c09ffb700 1 -- 172.21.15.50:0/2328828488 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2659678617 0 0) 0x7f8bf4003570 con 0x7f8c0c06db70 2023-10-06T01:22:42.699 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:42.694+0000 7f8c09ffb700 1 -- 172.21.15.50:0/2328828488 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8c0c06f350 msgr2=0x7f8c0c06d630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:22:42.699 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:42.694+0000 7f8c09ffb700 1 --2- 172.21.15.50:0/2328828488 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8c0c06f350 0x7f8c0c06d630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:42.699 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:42.694+0000 7f8c09ffb700 1 -- 172.21.15.50:0/2328828488 >> v2:172.21.15.155:3300/0 conn(0x7f8c0c0cb5e0 msgr2=0x7f8c0c0cb9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:22:42.699 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:42.694+0000 7f8c09ffb700 1 --2- 172.21.15.50:0/2328828488 >> v2:172.21.15.155:3300/0 conn(0x7f8c0c0cb5e0 0x7f8c0c0cb9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:42.700 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:42.694+0000 7f8c09ffb700 1 -- 172.21.15.50:0/2328828488 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c0c06e640 con 0x7f8c0c06db70 2023-10-06T01:22:42.700 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:42.694+0000 7f8c09ffb700 1 -- 172.21.15.50:0/2328828488 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 347519148 0 0) 0x7f8c040017f0 con 0x7f8c0c06db70 2023-10-06T01:22:42.700 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:42.694+0000 7f8c09ffb700 1 -- 172.21.15.50:0/2328828488 >> v1:172.21.15.50:6789/0 conn(0x7f8c0c06db70 legacy=0x7f8c0c159490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:42.701 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:42.694+0000 7f8c09ffb700 1 --2- 172.21.15.50:0/2328828488 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8bf4003ae0 0x7f8bf4003ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:42.701 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:42.694+0000 7f8c09ffb700 1 --2- 172.21.15.50:0/2328828488 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8bf4004810 0x7f8bf4004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:42.701 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:42.694+0000 7f8c09ffb700 1 --2- 172.21.15.50:0/2328828488 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8bf40051c0 0x7f8bf400dc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:42.701 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:42.694+0000 7f8c09ffb700 1 -- 172.21.15.50:0/2328828488 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c0c06ec00 con 0x7f8bf4004810 2023-10-06T01:22:42.701 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:42.694+0000 7f8c09ffb700 1 -- 172.21.15.50:0/2328828488 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c0c06e360 con 0x7f8bf4003ae0 2023-10-06T01:22:42.701 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:42.694+0000 7f8c09ffb700 1 -- 172.21.15.50:0/2328828488 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8bf400e1b0 con 0x7f8bf40051c0 2023-10-06T01:22:42.702 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:42.695+0000 7f8c0a7fc700 1 --2- 172.21.15.50:0/2328828488 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8bf4004810 0x7f8bf4004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:42.702 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:42.695+0000 7f8c0affd700 1 --2- 172.21.15.50:0/2328828488 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8bf4003ae0 0x7f8bf4003ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:42.702 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:42.695+0000 7f8c0b7fe700 1 --2- 172.21.15.50:0/2328828488 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8bf40051c0 0x7f8bf400dc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:42.702 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:42.695+0000 7f8c0a7fc700 1 -- 172.21.15.50:0/2328828488 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8bf40051c0 msgr2=0x7f8bf400dc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:22:42.702 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:42.695+0000 7f8c0a7fc700 1 --2- 172.21.15.50:0/2328828488 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8bf40051c0 0x7f8bf400dc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:42.703 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:42.695+0000 7f8c0a7fc700 1 -- 172.21.15.50:0/2328828488 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8bf4003ae0 msgr2=0x7f8bf4003ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:22:42.703 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:42.695+0000 7f8c0a7fc700 1 --2- 172.21.15.50:0/2328828488 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8bf4003ae0 0x7f8bf4003ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:42.703 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:42.695+0000 7f8c0a7fc700 1 -- 172.21.15.50:0/2328828488 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8bf4003570 con 0x7f8bf4004810 2023-10-06T01:22:42.703 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:42.695+0000 7f8c0a7fc700 1 --2- 172.21.15.50:0/2328828488 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8bf4004810 0x7f8bf4004c80 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f8c00009c00 tx=0x7f8c000091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=92f28f4e9974fa77 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:22:42.703 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:42.696+0000 7f8c09ffb700 1 -- 172.21.15.50:0/2328828488 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c0000e710 con 0x7f8bf4004810 2023-10-06T01:22:42.704 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:42.696+0000 7f8c09ffb700 1 -- 172.21.15.50:0/2328828488 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c0000e870 con 0x7f8bf4004810 2023-10-06T01:22:42.704 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:42.696+0000 7f8c09ffb700 1 -- 172.21.15.50:0/2328828488 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c0000ec30 con 0x7f8bf4004810 2023-10-06T01:22:42.704 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:42.696+0000 7f8c0bfff700 1 -- 172.21.15.50:0/2328828488 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8bf4004810 msgr2=0x7f8bf4004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:42.704 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:42.696+0000 7f8c0bfff700 1 --2- 172.21.15.50:0/2328828488 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8bf4004810 0x7f8bf4004c80 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f8c00009c00 tx=0x7f8c000091a0 comp rx=0 tx=0).stop 2023-10-06T01:22:42.704 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:42.696+0000 7f8c0b7fe700 1 -- 172.21.15.50:0/2328828488 reap_dead start 2023-10-06T01:22:42.705 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:42.696+0000 7f8c0bfff700 1 -- 172.21.15.50:0/2328828488 shutdown_connections 2023-10-06T01:22:42.705 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:42.696+0000 7f8c0bfff700 1 -- 172.21.15.50:0/2328828488 >> 172.21.15.50:0/2328828488 conn(0x7f8c0c0680c0 msgr2=0x7f8c0c0cbf00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:22:42.706 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:42.696+0000 7f8c0bfff700 1 -- 172.21.15.50:0/2328828488 shutdown_connections 2023-10-06T01:22:42.706 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:42.696+0000 7f8c0bfff700 1 -- 172.21.15.50:0/2328828488 wait complete. 2023-10-06T01:22:42.711 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:42.698+0000 7f8c0bfff700 1 Processor -- start 2023-10-06T01:22:42.711 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:42.698+0000 7f8c0bfff700 1 -- start start 2023-10-06T01:22:42.711 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:42.699+0000 7f8c0bfff700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8bf4004810 0x7f8c0c156ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:42.711 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:42.699+0000 7f8c0bfff700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8c0c151d50 0x7f8c0c0ac740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:42.711 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:42.699+0000 7f8c0bfff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8c0c14acb0 0x7f8c0c06a000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:42.712 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:42.699+0000 7f8c0bfff700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c0c0acc80 con 0x7f8c0c14acb0 2023-10-06T01:22:42.712 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:42.699+0000 7f8c0bfff700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c0c158d50 con 0x7f8bf4004810 2023-10-06T01:22:42.712 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:42.699+0000 7f8c0bfff700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c0c150640 con 0x7f8c0c151d50 2023-10-06T01:22:42.712 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:42.699+0000 7f8c0b7fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8c0c14acb0 0x7f8c0c06a000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:42.712 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:42.699+0000 7f8c0b7fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8c0c14acb0 0x7f8c0c06a000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:54912/0 (socket says 172.21.15.50:54912) 2023-10-06T01:22:42.712 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:42.699+0000 7f8c0b7fe700 1 -- 172.21.15.50:0/3223376034 learned_addr learned my addr 172.21.15.50:0/3223376034 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-06T01:22:42.713 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:42.699+0000 7f8c0affd700 1 --2- 172.21.15.50:0/3223376034 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8bf4004810 0x7f8c0c156ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:42.713 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:42.699+0000 7f8c0a7fc700 1 --2- 172.21.15.50:0/3223376034 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8c0c151d50 0x7f8c0c0ac740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:42.713 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:42.699+0000 7f8c0b7fe700 1 -- 172.21.15.50:0/3223376034 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8c0c151d50 msgr2=0x7f8c0c0ac740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:42.713 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:42.699+0000 7f8c0b7fe700 1 --2- 172.21.15.50:0/3223376034 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8c0c151d50 0x7f8c0c0ac740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:42.714 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:42.699+0000 7f8c0b7fe700 1 -- 172.21.15.50:0/3223376034 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8bf4004810 msgr2=0x7f8c0c156ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:42.714 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:42.699+0000 7f8c0b7fe700 1 --2- 172.21.15.50:0/3223376034 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8bf4004810 0x7f8c0c156ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:42.714 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:42.699+0000 7f8c0b7fe700 1 -- 172.21.15.50:0/3223376034 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c0c1575e0 con 0x7f8c0c14acb0 2023-10-06T01:22:42.714 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:42.700+0000 7f8c0b7fe700 1 --2- 172.21.15.50:0/3223376034 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8c0c14acb0 0x7f8c0c06a000 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f8c0c15a470 tx=0x7f8c04001350 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:22:42.715 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:42.700+0000 7f8bf2ffd700 1 -- 172.21.15.50:0/3223376034 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c04017070 con 0x7f8c0c14acb0 2023-10-06T01:22:42.715 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:42.700+0000 7f8bf2ffd700 1 -- 172.21.15.50:0/3223376034 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c0400eb10 con 0x7f8c0c14acb0 2023-10-06T01:22:42.715 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:42.700+0000 7f8bf2ffd700 1 -- 172.21.15.50:0/3223376034 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c0400eeb0 con 0x7f8c0c14acb0 2023-10-06T01:22:42.715 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:42.700+0000 7f8c0bfff700 1 -- 172.21.15.50:0/3223376034 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8c0c1578c0 con 0x7f8c0c14acb0 2023-10-06T01:22:42.716 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:42.700+0000 7f8c0bfff700 1 -- 172.21.15.50:0/3223376034 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8c0c157e80 con 0x7f8c0c14acb0 2023-10-06T01:22:42.716 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:42.701+0000 7f8c0bfff700 1 -- 172.21.15.50:0/3223376034 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8c0c1507d0 con 0x7f8c0c14acb0 2023-10-06T01:22:42.716 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:42.702+0000 7f8bf2ffd700 1 -- 172.21.15.50:0/3223376034 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f8c04013630 con 0x7f8c0c14acb0 2023-10-06T01:22:42.717 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:42.703+0000 7f8bf2ffd700 1 --2- 172.21.15.50:0/3223376034 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f8bf8066f30 0x7f8bf80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:42.717 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:42.703+0000 7f8bf2ffd700 1 -- 172.21.15.50:0/3223376034 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6867+0+0 (secure 0 0 0) 0x7f8c04084830 con 0x7f8c0c14acb0 2023-10-06T01:22:42.717 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:42.704+0000 7f8c0affd700 1 --2- 172.21.15.50:0/3223376034 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f8bf8066f30 0x7f8bf80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:42.718 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:42.704+0000 7f8c0affd700 1 --2- 172.21.15.50:0/3223376034 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f8bf8066f30 0x7f8bf80693e0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f8bfc00afb0 tx=0x7f8bfc00a330 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:22:42.718 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:42.707+0000 7f8bf2ffd700 1 -- 172.21.15.50:0/3223376034 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f8c04051570 con 0x7f8c0c14acb0 2023-10-06T01:22:42.958 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:42.957+0000 7f8c0bfff700 1 -- 172.21.15.50:0/3223376034 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f8c0c05f270 con 0x7f8c0c14acb0 2023-10-06T01:22:42.959 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:42.957+0000 7f8bf2ffd700 1 -- 172.21.15.50:0/3223376034 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4593 (secure 0 0 0) 0x7f8c04054b90 con 0x7f8c0c14acb0 2023-10-06T01:22:42.959 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-10-06T01:22:42.959 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4214,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6835/33654067","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6833","nonce":33654067},{"type":"v1","addr":"172.21.15.50:6835","nonce":33654067}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4279,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6836/2571345069","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":2571345069},{"type":"v1","addr":"172.21.15.155:6836","nonce":2571345069}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4290,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6834/4140731341","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6832","nonce":4140731341},{"type":"v1","addr":"172.21.15.50:6834","nonce":4140731341}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T01:21:36.779774+0000","modified":"2023-10-06T01:21:58.876370+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4302},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4302":{"gid":4302,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.155:6837/3434423585","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6835","nonce":3434423585},{"type":"v1","addr":"172.21.15.155:6837","nonce":3434423585}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2023-10-06T01:22:42.962 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:42.959+0000 7f8c0bfff700 1 -- 172.21.15.50:0/3223376034 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f8bf8066f30 msgr2=0x7f8bf80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:42.962 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:42.959+0000 7f8c0bfff700 1 --2- 172.21.15.50:0/3223376034 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f8bf8066f30 0x7f8bf80693e0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f8bfc00afb0 tx=0x7f8bfc00a330 comp rx=0 tx=0).stop 2023-10-06T01:22:42.962 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:42.959+0000 7f8c0bfff700 1 -- 172.21.15.50:0/3223376034 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8c0c14acb0 msgr2=0x7f8c0c06a000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:42.962 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:42.959+0000 7f8c0bfff700 1 --2- 172.21.15.50:0/3223376034 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8c0c14acb0 0x7f8c0c06a000 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f8c0c15a470 tx=0x7f8c04001350 comp rx=0 tx=0).stop 2023-10-06T01:22:42.962 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:42.960+0000 7f8c0bfff700 1 -- 172.21.15.50:0/3223376034 shutdown_connections 2023-10-06T01:22:42.962 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:42.960+0000 7f8c0bfff700 1 --2- 172.21.15.50:0/3223376034 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8c0c14acb0 0x7f8c0c06a000 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:42.962 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:42.960+0000 7f8c0bfff700 1 --2- 172.21.15.50:0/3223376034 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f8bf8066f30 0x7f8bf80693e0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:42.962 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:42.960+0000 7f8c0bfff700 1 --2- 172.21.15.50:0/3223376034 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8bf4004810 0x7f8c0c156ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:42.963 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:42.960+0000 7f8c0bfff700 1 --2- 172.21.15.50:0/3223376034 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8c0c151d50 0x7f8c0c0ac740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:42.963 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:42.960+0000 7f8c0bfff700 1 -- 172.21.15.50:0/3223376034 >> 172.21.15.50:0/3223376034 conn(0x7f8c0c0680c0 msgr2=0x7f8c0c14f720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:22:42.963 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:42.960+0000 7f8c0bfff700 1 -- 172.21.15.50:0/3223376034 shutdown_connections 2023-10-06T01:22:42.963 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:42.960+0000 7f8c0bfff700 1 -- 172.21.15.50:0/3223376034 wait complete. 2023-10-06T01:22:42.964 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 9 2023-10-06T01:22:42.979 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T01:22:43.165 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:43.163+0000 7f1cbef9d700 1 Processor -- start 2023-10-06T01:22:43.165 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:43.163+0000 7f1cbef9d700 1 -- start start 2023-10-06T01:22:43.166 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:43.164+0000 7f1cbef9d700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1cb806f310 0x7f1cb815adf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:43.166 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:43.164+0000 7f1cbef9d700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1cb806d960 con 0x7f1cb8140b80 2023-10-06T01:22:43.167 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:43.164+0000 7f1cbef9d700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1cb80af3d0 con 0x7f1cb81407b0 2023-10-06T01:22:43.167 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:43.164+0000 7f1cbef9d700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1cb80c6540 con 0x7f1cb806f310 2023-10-06T01:22:43.167 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:43.165+0000 7f1cbd79a700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f1cb8140b80 0x7f1cb80aecc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:56914/0 (socket says 172.21.15.50:56914) 2023-10-06T01:22:43.167 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:43.165+0000 7f1cbd79a700 1 -- 172.21.15.50:0/2300784832 learned_addr learned my addr 172.21.15.50:0/2300784832 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-10-06T01:22:43.170 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:43.165+0000 7f1cbe79c700 1 --2- 172.21.15.50:0/2300784832 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1cb806f310 0x7f1cb815adf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:43.170 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:43.165+0000 7f1cbcf99700 1 -- 172.21.15.50:0/2300784832 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2194043136 0 0) 0x7f1ca8001110 con 0x7f1cb8140b80 2023-10-06T01:22:43.170 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:43.165+0000 7f1cbcf99700 1 -- 172.21.15.50:0/2300784832 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1ca4003570 con 0x7f1cb8140b80 2023-10-06T01:22:43.170 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:43.165+0000 7f1cbcf99700 1 -- 172.21.15.50:0/2300784832 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1201964641 0 0) 0x7f1ca4003570 con 0x7f1cb8140b80 2023-10-06T01:22:43.171 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:43.165+0000 7f1cbcf99700 1 -- 172.21.15.50:0/2300784832 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1cb806f310 msgr2=0x7f1cb815adf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:22:43.171 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:43.165+0000 7f1cbcf99700 1 --2- 172.21.15.50:0/2300784832 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1cb806f310 0x7f1cb815adf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:43.171 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:43.165+0000 7f1cbcf99700 1 -- 172.21.15.50:0/2300784832 >> v1:172.21.15.155:6789/0 conn(0x7f1cb81407b0 legacy=0x7f1cb806d250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:43.171 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:43.165+0000 7f1cbcf99700 1 -- 172.21.15.50:0/2300784832 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1cb80c6820 con 0x7f1cb8140b80 2023-10-06T01:22:43.171 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:43.165+0000 7f1cbcf99700 1 -- 172.21.15.50:0/2300784832 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 347519148 0 0) 0x7f1ca8001600 con 0x7f1cb8140b80 2023-10-06T01:22:43.171 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:43.165+0000 7f1cbcf99700 1 -- 172.21.15.50:0/2300784832 >> v1:172.21.15.50:6789/0 conn(0x7f1cb8140b80 legacy=0x7f1cb80aecc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:43.171 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:43.165+0000 7f1cbcf99700 1 --2- 172.21.15.50:0/2300784832 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1cb806f310 0x7f1ca4003a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:43.171 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:43.166+0000 7f1cbcf99700 1 --2- 172.21.15.50:0/2300784832 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1ca4004010 0x7f1ca4004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:43.172 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:43.166+0000 7f1cbcf99700 1 --2- 172.21.15.50:0/2300784832 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1ca4004d50 0x7f1ca40051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:43.172 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:43.166+0000 7f1cbcf99700 1 -- 172.21.15.50:0/2300784832 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1cb80c6540 con 0x7f1ca4004d50 2023-10-06T01:22:43.172 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:43.166+0000 7f1cbcf99700 1 -- 172.21.15.50:0/2300784832 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ca400bbf0 con 0x7f1ca4004010 2023-10-06T01:22:43.172 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:43.166+0000 7f1cbcf99700 1 -- 172.21.15.50:0/2300784832 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ca400bdb0 con 0x7f1cb806f310 2023-10-06T01:22:43.172 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:43.166+0000 7f1cbe79c700 1 --2- 172.21.15.50:0/2300784832 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1ca4004d50 0x7f1ca40051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:43.172 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:43.166+0000 7f1cbdf9b700 1 --2- 172.21.15.50:0/2300784832 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1cb806f310 0x7f1ca4003a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:43.173 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:43.166+0000 7f1cbd79a700 1 --2- 172.21.15.50:0/2300784832 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1ca4004010 0x7f1ca4004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:43.173 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:43.166+0000 7f1cbe79c700 1 -- 172.21.15.50:0/2300784832 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1cb806f310 msgr2=0x7f1ca4003a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:22:43.173 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:43.166+0000 7f1cbe79c700 1 --2- 172.21.15.50:0/2300784832 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1cb806f310 0x7f1ca4003a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:43.173 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:43.166+0000 7f1cbe79c700 1 -- 172.21.15.50:0/2300784832 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1ca4004010 msgr2=0x7f1ca4004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:22:43.173 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:43.166+0000 7f1cbe79c700 1 --2- 172.21.15.50:0/2300784832 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1ca4004010 0x7f1ca4004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:43.173 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:43.166+0000 7f1cbe79c700 1 -- 172.21.15.50:0/2300784832 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ca4003570 con 0x7f1ca4004d50 2023-10-06T01:22:43.173 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:43.167+0000 7f1cbe79c700 1 --2- 172.21.15.50:0/2300784832 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1ca4004d50 0x7f1ca40051c0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f1cb00094d0 tx=0x7f1cb000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eb49499f03df6871 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:22:43.174 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:43.167+0000 7f1cbcf99700 1 -- 172.21.15.50:0/2300784832 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cb000ea60 con 0x7f1ca4004d50 2023-10-06T01:22:43.174 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:43.167+0000 7f1cbcf99700 1 -- 172.21.15.50:0/2300784832 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1cb000f040 con 0x7f1ca4004d50 2023-10-06T01:22:43.174 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:43.167+0000 7f1cbcf99700 1 -- 172.21.15.50:0/2300784832 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cb000edf0 con 0x7f1ca4004d50 2023-10-06T01:22:43.174 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:43.167+0000 7f1cbef9d700 1 -- 172.21.15.50:0/2300784832 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1ca4004d50 msgr2=0x7f1ca40051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:43.174 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:43.167+0000 7f1cbef9d700 1 --2- 172.21.15.50:0/2300784832 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1ca4004d50 0x7f1ca40051c0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f1cb00094d0 tx=0x7f1cb000b040 comp rx=0 tx=0).stop 2023-10-06T01:22:43.174 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:43.167+0000 7f1cbe79c700 1 -- 172.21.15.50:0/2300784832 reap_dead start 2023-10-06T01:22:43.175 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:43.167+0000 7f1cbef9d700 1 -- 172.21.15.50:0/2300784832 shutdown_connections 2023-10-06T01:22:43.175 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:43.167+0000 7f1cbef9d700 1 -- 172.21.15.50:0/2300784832 >> 172.21.15.50:0/2300784832 conn(0x7f1cb80680c0 msgr2=0x7f1cb80cbf00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:22:43.175 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:43.167+0000 7f1cbef9d700 1 -- 172.21.15.50:0/2300784832 shutdown_connections 2023-10-06T01:22:43.175 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:43.167+0000 7f1cbef9d700 1 -- 172.21.15.50:0/2300784832 wait complete. 2023-10-06T01:22:43.180 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:43.169+0000 7f1cbef9d700 1 Processor -- start 2023-10-06T01:22:43.180 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:43.169+0000 7f1cbef9d700 1 -- start start 2023-10-06T01:22:43.180 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:43.170+0000 7f1cbef9d700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1ca4004d50 0x7f1cb80af5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:43.180 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:43.170+0000 7f1cbef9d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1cb81382c0 0x7f1cb813a0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:43.180 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:43.170+0000 7f1cbef9d700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1cb80c3720 0x7f1cb80c3b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:43.181 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:43.170+0000 7f1cbef9d700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1cb80c5520 con 0x7f1cb81382c0 2023-10-06T01:22:43.181 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:43.170+0000 7f1cbef9d700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1cb80c2fb0 con 0x7f1ca4004d50 2023-10-06T01:22:43.181 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:43.170+0000 7f1cbef9d700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1cb80c3290 con 0x7f1cb80c3720 2023-10-06T01:22:43.181 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:43.170+0000 7f1cbd79a700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1cb81382c0 0x7f1cb813a0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:43.181 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:43.170+0000 7f1cbd79a700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1cb81382c0 0x7f1cb813a0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:54932/0 (socket says 172.21.15.50:54932) 2023-10-06T01:22:43.181 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:43.170+0000 7f1cbd79a700 1 -- 172.21.15.50:0/3760616382 learned_addr learned my addr 172.21.15.50:0/3760616382 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-06T01:22:43.181 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:43.170+0000 7f1cbe79c700 1 --2- 172.21.15.50:0/3760616382 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1cb80c3720 0x7f1cb80c3b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:43.181 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:43.170+0000 7f1cbdf9b700 1 --2- 172.21.15.50:0/3760616382 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1ca4004d50 0x7f1cb80af5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:43.182 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:43.170+0000 7f1cbd79a700 1 -- 172.21.15.50:0/3760616382 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1cb80c3720 msgr2=0x7f1cb80c3b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:43.182 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:43.170+0000 7f1cbd79a700 1 --2- 172.21.15.50:0/3760616382 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1cb80c3720 0x7f1cb80c3b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:43.182 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:43.170+0000 7f1cbd79a700 1 -- 172.21.15.50:0/3760616382 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1ca4004d50 msgr2=0x7f1cb80af5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:43.182 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:43.170+0000 7f1cbd79a700 1 --2- 172.21.15.50:0/3760616382 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1ca4004d50 0x7f1cb80af5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:43.182 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:43.170+0000 7f1cbd79a700 1 -- 172.21.15.50:0/3760616382 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1cb80afb10 con 0x7f1cb81382c0 2023-10-06T01:22:43.182 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:43.170+0000 7f1cbe79c700 1 --2- 172.21.15.50:0/3760616382 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1cb80c3720 0x7f1cb80c3b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T01:22:43.183 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:43.170+0000 7f1cbdf9b700 1 --2- 172.21.15.50:0/3760616382 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1ca4004d50 0x7f1cb80af5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T01:22:43.183 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:43.171+0000 7f1cbd79a700 1 --2- 172.21.15.50:0/3760616382 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1cb81382c0 0x7f1cb813a0b0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f1ca80073c0 tx=0x7f1ca8007a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:22:43.183 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:43.171+0000 7f1cadffb700 1 -- 172.21.15.50:0/3760616382 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ca8018030 con 0x7f1cb81382c0 2023-10-06T01:22:43.183 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:43.171+0000 7f1cadffb700 1 -- 172.21.15.50:0/3760616382 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ca800f9a0 con 0x7f1cb81382c0 2023-10-06T01:22:43.184 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:43.171+0000 7f1cadffb700 1 -- 172.21.15.50:0/3760616382 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ca800fd40 con 0x7f1cb81382c0 2023-10-06T01:22:43.184 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:43.171+0000 7f1cbef9d700 1 -- 172.21.15.50:0/3760616382 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1cb80afd90 con 0x7f1cb81382c0 2023-10-06T01:22:43.184 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:43.171+0000 7f1cbef9d700 1 -- 172.21.15.50:0/3760616382 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1cb80b0350 con 0x7f1cb81382c0 2023-10-06T01:22:43.184 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:43.172+0000 7f1cbef9d700 1 -- 172.21.15.50:0/3760616382 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1cb80c3400 con 0x7f1cb81382c0 2023-10-06T01:22:43.184 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:43.173+0000 7f1cadffb700 1 -- 172.21.15.50:0/3760616382 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f1ca801b070 con 0x7f1cb81382c0 2023-10-06T01:22:43.184 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:43.174+0000 7f1cadffb700 1 --2- 172.21.15.50:0/3760616382 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f1c9c066f30 0x7f1c9c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:43.185 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:43.174+0000 7f1cadffb700 1 -- 172.21.15.50:0/3760616382 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6867+0+0 (secure 0 0 0) 0x7f1ca8019070 con 0x7f1cb81382c0 2023-10-06T01:22:43.185 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:43.174+0000 7f1cbdf9b700 1 --2- 172.21.15.50:0/3760616382 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f1c9c066f30 0x7f1c9c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:43.185 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:43.175+0000 7f1cbdf9b700 1 --2- 172.21.15.50:0/3760616382 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f1c9c066f30 0x7f1c9c0693e0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f1cb4000f60 tx=0x7f1cb4009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:22:43.185 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:43.178+0000 7f1cadffb700 1 -- 172.21.15.50:0/3760616382 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f1ca80515f0 con 0x7f1cb81382c0 2023-10-06T01:22:43.382 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:43.381+0000 7f1cbef9d700 1 -- 172.21.15.50:0/3760616382 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1cb806d960 con 0x7f1cb81382c0 2023-10-06T01:22:43.383 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:43.382+0000 7f1cadffb700 1 -- 172.21.15.50:0/3760616382 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+18803 (secure 0 0 0) 0x7f1cb806d960 con 0x7f1cb81382c0 2023-10-06T01:22:43.384 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-10-06T01:22:43.384 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":27,"fsid":"0bfd9a6b-1587-4fe4-a89e-e43c00286b4e","created":"2023-10-06T01:21:16.828801+0000","modified":"2023-10-06T01:22:24.863940+0000","last_up_change":"2023-10-06T01:21:28.584523+0000","last_in_change":"2023-10-06T01:21:20.179863+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-10-06T01:21:29.304225+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":".mgr","create_time":"2023-10-06T01:21:29.835490+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-06T01:21:34.675315+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-06T01:21:35.753991+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-10-06T01:21:38.853108+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"9060727a-3959-4de3-8363-c5c5d7826c9a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":87837},{"type":"v1","addr":"172.21.15.50:6801","nonce":87837}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":87837},{"type":"v1","addr":"172.21.15.50:6803","nonce":87837}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":87837},{"type":"v1","addr":"172.21.15.50:6807","nonce":87837}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":87837},{"type":"v1","addr":"172.21.15.50:6805","nonce":87837}]},"public_addr":"172.21.15.50:6801/87837","cluster_addr":"172.21.15.50:6803/87837","heartbeat_back_addr":"172.21.15.50:6807/87837","heartbeat_front_addr":"172.21.15.50:6805/87837","state":["exists","up"]},{"osd":1,"uuid":"5ad9ef12-b579-47ea-b690-90ba887e2cef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":87853},{"type":"v1","addr":"172.21.15.50:6809","nonce":87853}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":87853},{"type":"v1","addr":"172.21.15.50:6811","nonce":87853}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":87853},{"type":"v1","addr":"172.21.15.50:6815","nonce":87853}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":87853},{"type":"v1","addr":"172.21.15.50:6813","nonce":87853}]},"public_addr":"172.21.15.50:6809/87853","cluster_addr":"172.21.15.50:6811/87853","heartbeat_back_addr":"172.21.15.50:6815/87853","heartbeat_front_addr":"172.21.15.50:6813/87853","state":["exists","up"]},{"osd":2,"uuid":"c7aee044-6f75-436f-90e1-ba42a57359bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6821","nonce":87855},{"type":"v1","addr":"172.21.15.50:6822","nonce":87855}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6824","nonce":87855},{"type":"v1","addr":"172.21.15.50:6826","nonce":87855}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":87855},{"type":"v1","addr":"172.21.15.50:6831","nonce":87855}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":87855},{"type":"v1","addr":"172.21.15.50:6829","nonce":87855}]},"public_addr":"172.21.15.50:6822/87855","cluster_addr":"172.21.15.50:6826/87855","heartbeat_back_addr":"172.21.15.50:6831/87855","heartbeat_front_addr":"172.21.15.50:6829/87855","state":["exists","up"]},{"osd":3,"uuid":"d9b901c8-e8b2-44af-9508-f453120a96c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":87856},{"type":"v1","addr":"172.21.15.50:6817","nonce":87856}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":87856},{"type":"v1","addr":"172.21.15.50:6819","nonce":87856}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6825","nonce":87856},{"type":"v1","addr":"172.21.15.50:6827","nonce":87856}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6820","nonce":87856},{"type":"v1","addr":"172.21.15.50:6823","nonce":87856}]},"public_addr":"172.21.15.50:6817/87856","cluster_addr":"172.21.15.50:6819/87856","heartbeat_back_addr":"172.21.15.50:6827/87856","heartbeat_front_addr":"172.21.15.50:6823/87856","state":["exists","up"]},{"osd":4,"uuid":"2b3c6b38-e3e9-4301-9445-60fd3fe8ce03","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":85805},{"type":"v1","addr":"172.21.15.155:6801","nonce":85805}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":85805},{"type":"v1","addr":"172.21.15.155:6803","nonce":85805}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6806","nonce":85805},{"type":"v1","addr":"172.21.15.155:6807","nonce":85805}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6804","nonce":85805},{"type":"v1","addr":"172.21.15.155:6805","nonce":85805}]},"public_addr":"172.21.15.155:6801/85805","cluster_addr":"172.21.15.155:6803/85805","heartbeat_back_addr":"172.21.15.155:6807/85805","heartbeat_front_addr":"172.21.15.155:6805/85805","state":["exists","up"]},{"osd":5,"uuid":"417b5f8f-65f1-4c94-91a7-a6ce03fe1679","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6816","nonce":85807},{"type":"v1","addr":"172.21.15.155:6818","nonce":85807}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6820","nonce":85807},{"type":"v1","addr":"172.21.15.155:6822","nonce":85807}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6828","nonce":85807},{"type":"v1","addr":"172.21.15.155:6830","nonce":85807}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6824","nonce":85807},{"type":"v1","addr":"172.21.15.155:6826","nonce":85807}]},"public_addr":"172.21.15.155:6818/85807","cluster_addr":"172.21.15.155:6822/85807","heartbeat_back_addr":"172.21.15.155:6830/85807","heartbeat_front_addr":"172.21.15.155:6826/85807","state":["exists","up"]},{"osd":6,"uuid":"c150cff3-aee4-4714-9c08-d182b1ba9ffd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6808","nonce":85806},{"type":"v1","addr":"172.21.15.155:6809","nonce":85806}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6810","nonce":85806},{"type":"v1","addr":"172.21.15.155:6811","nonce":85806}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6814","nonce":85806},{"type":"v1","addr":"172.21.15.155:6815","nonce":85806}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6812","nonce":85806},{"type":"v1","addr":"172.21.15.155:6813","nonce":85806}]},"public_addr":"172.21.15.155:6809/85806","cluster_addr":"172.21.15.155:6811/85806","heartbeat_back_addr":"172.21.15.155:6815/85806","heartbeat_front_addr":"172.21.15.155:6813/85806","state":["exists","up"]},{"osd":7,"uuid":"71107f0e-04d1-4e72-a0ec-0faf6af003e7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6817","nonce":85832},{"type":"v1","addr":"172.21.15.155:6819","nonce":85832}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6821","nonce":85832},{"type":"v1","addr":"172.21.15.155:6823","nonce":85832}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6829","nonce":85832},{"type":"v1","addr":"172.21.15.155:6831","nonce":85832}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6825","nonce":85832},{"type":"v1","addr":"172.21.15.155:6827","nonce":85832}]},"public_addr":"172.21.15.155:6819/85832","cluster_addr":"172.21.15.155:6823/85832","heartbeat_back_addr":"172.21.15.155:6831/85832","heartbeat_front_addr":"172.21.15.155:6827/85832","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:21:25.423389+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:21:25.472661+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:21:25.817562+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:21:25.551257+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:21:25.407818+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:21:25.557976+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:21:25.747299+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:21:25.827576+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.19","mappings":[{"from":3,"to":5}]},{"pgid":"4.31","mappings":[{"from":1,"to":2}]}],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T01:22:43.387 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:43.384+0000 7f1cbef9d700 1 -- 172.21.15.50:0/3760616382 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f1c9c066f30 msgr2=0x7f1c9c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:43.387 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:43.384+0000 7f1cbef9d700 1 --2- 172.21.15.50:0/3760616382 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f1c9c066f30 0x7f1c9c0693e0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f1cb4000f60 tx=0x7f1cb4009040 comp rx=0 tx=0).stop 2023-10-06T01:22:43.387 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:43.384+0000 7f1cbef9d700 1 -- 172.21.15.50:0/3760616382 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1cb81382c0 msgr2=0x7f1cb813a0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:43.387 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:43.384+0000 7f1cbef9d700 1 --2- 172.21.15.50:0/3760616382 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1cb81382c0 0x7f1cb813a0b0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f1ca80073c0 tx=0x7f1ca8007a50 comp rx=0 tx=0).stop 2023-10-06T01:22:43.387 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:43.384+0000 7f1cbef9d700 1 -- 172.21.15.50:0/3760616382 shutdown_connections 2023-10-06T01:22:43.387 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:43.384+0000 7f1cbef9d700 1 --2- 172.21.15.50:0/3760616382 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1cb80c3720 0x7f1cb80c3b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:43.388 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:43.384+0000 7f1cbef9d700 1 --2- 172.21.15.50:0/3760616382 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f1c9c066f30 0x7f1c9c0693e0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:43.388 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:43.384+0000 7f1cbef9d700 1 --2- 172.21.15.50:0/3760616382 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1ca4004d50 0x7f1cb80af5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:43.388 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:43.384+0000 7f1cbef9d700 1 --2- 172.21.15.50:0/3760616382 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1cb81382c0 0x7f1cb813a0b0 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:43.388 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:43.384+0000 7f1cbef9d700 1 -- 172.21.15.50:0/3760616382 >> 172.21.15.50:0/3760616382 conn(0x7f1cb80680c0 msgr2=0x7f1cb813b540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:22:43.388 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:43.384+0000 7f1cbef9d700 1 -- 172.21.15.50:0/3760616382 shutdown_connections 2023-10-06T01:22:43.388 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:43.384+0000 7f1cbef9d700 1 -- 172.21.15.50:0/3760616382 wait complete. 2023-10-06T01:22:43.404 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-10-06T01:22:43.592 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:43.590+0000 7f392af9d700 1 Processor -- start 2023-10-06T01:22:43.592 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:43.590+0000 7f392af9d700 1 -- start start 2023-10-06T01:22:43.594 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:43.591+0000 7f392af9d700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f39241407b0 0x7f392406d250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:43.594 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:43.591+0000 7f392af9d700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f3924140b80 0x7f39240aecc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:43.594 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:43.591+0000 7f392af9d700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f39240af200 0x7f392415adf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:43.595 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:43.591+0000 7f392af9d700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f39240c6540 con 0x7f39240af200 2023-10-06T01:22:43.595 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:43.591+0000 7f392af9d700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f39240c6820 con 0x7f3924140b80 2023-10-06T01:22:43.595 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:43.591+0000 7f392af9d700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f39240c6b00 con 0x7f39241407b0 2023-10-06T01:22:43.595 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:43.591+0000 7f392a79c700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f39240af200 0x7f392415adf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:43.595 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:43.592+0000 7f392a79c700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f39240af200 0x7f392415adf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:54946/0 (socket says 172.21.15.50:54946) 2023-10-06T01:22:43.595 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:43.592+0000 7f392a79c700 1 -- 172.21.15.50:0/2415129606 learned_addr learned my addr 172.21.15.50:0/2415129606 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-06T01:22:43.595 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:43.592+0000 7f392979a700 1 --2- 172.21.15.50:0/2415129606 >> v2:172.21.15.155:3300/0 conn(0x7f3924140b80 0x7f39240aecc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:43.595 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:43.592+0000 7f3929f9b700 1 --2- 172.21.15.50:0/2415129606 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f39241407b0 0x7f392406d250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:43.595 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:43.592+0000 7f392a79c700 1 -- 172.21.15.50:0/2415129606 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f39241407b0 msgr2=0x7f392406d250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:22:43.595 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:43.592+0000 7f392a79c700 1 --2- 172.21.15.50:0/2415129606 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f39241407b0 0x7f392406d250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:43.596 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:43.592+0000 7f392a79c700 1 -- 172.21.15.50:0/2415129606 >> v2:172.21.15.155:3300/0 conn(0x7f3924140b80 msgr2=0x7f39240aecc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:22:43.596 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:43.592+0000 7f392a79c700 1 --2- 172.21.15.50:0/2415129606 >> v2:172.21.15.155:3300/0 conn(0x7f3924140b80 0x7f39240aecc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:43.596 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:43.592+0000 7f392a79c700 1 -- 172.21.15.50:0/2415129606 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39240c6de0 con 0x7f39240af200 2023-10-06T01:22:43.596 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:43.592+0000 7f392979a700 1 --2- 172.21.15.50:0/2415129606 >> v2:172.21.15.155:3300/0 conn(0x7f3924140b80 0x7f39240aecc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T01:22:43.596 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:43.592+0000 7f392a79c700 1 --2- 172.21.15.50:0/2415129606 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f39240af200 0x7f392415adf0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f39240c9a10 tx=0x7f391c009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f465385a711c667c server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:22:43.596 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:43.592+0000 7f3928f99700 1 -- 172.21.15.50:0/2415129606 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f391c00e070 con 0x7f39240af200 2023-10-06T01:22:43.596 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:43.593+0000 7f3928f99700 1 -- 172.21.15.50:0/2415129606 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f391c00ba50 con 0x7f39240af200 2023-10-06T01:22:43.596 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:43.593+0000 7f3928f99700 1 -- 172.21.15.50:0/2415129606 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f391c0092e0 con 0x7f39240af200 2023-10-06T01:22:43.599 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:43.593+0000 7f392af9d700 1 -- 172.21.15.50:0/2415129606 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f39240af200 msgr2=0x7f392415adf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:43.599 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:43.593+0000 7f392af9d700 1 --2- 172.21.15.50:0/2415129606 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f39240af200 0x7f392415adf0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f39240c9a10 tx=0x7f391c009840 comp rx=0 tx=0).stop 2023-10-06T01:22:43.599 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:43.593+0000 7f392af9d700 1 -- 172.21.15.50:0/2415129606 shutdown_connections 2023-10-06T01:22:43.599 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:43.593+0000 7f392af9d700 1 --2- 172.21.15.50:0/2415129606 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f39241407b0 0x7f392406d250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:43.600 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:43.593+0000 7f392af9d700 1 --2- 172.21.15.50:0/2415129606 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f39240af200 0x7f392415adf0 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:43.600 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:43.593+0000 7f392af9d700 1 --2- 172.21.15.50:0/2415129606 >> v2:172.21.15.155:3300/0 conn(0x7f3924140b80 0x7f39240aecc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:43.600 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:43.593+0000 7f392af9d700 1 -- 172.21.15.50:0/2415129606 >> 172.21.15.50:0/2415129606 conn(0x7f39240680c0 msgr2=0x7f39240cbf00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:22:43.600 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:43.593+0000 7f392af9d700 1 -- 172.21.15.50:0/2415129606 shutdown_connections 2023-10-06T01:22:43.600 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:43.593+0000 7f392af9d700 1 -- 172.21.15.50:0/2415129606 wait complete. 2023-10-06T01:22:43.600 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:43.595+0000 7f392af9d700 1 Processor -- start 2023-10-06T01:22:43.600 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:43.595+0000 7f392af9d700 1 -- start start 2023-10-06T01:22:43.600 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:43.596+0000 7f392af9d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f39240af200 0x7f3924156bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:43.600 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:43.596+0000 7f392af9d700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f39241407b0 0x7f392415aae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:43.600 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:43.596+0000 7f392af9d700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f392415b020 0x7f3924158e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:43.600 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:43.596+0000 7f392af9d700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f392415b4c0 con 0x7f39240af200 2023-10-06T01:22:43.600 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:43.596+0000 7f392af9d700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f392416a8a0 con 0x7f392415b020 2023-10-06T01:22:43.601 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:43.596+0000 7f392af9d700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3924157830 con 0x7f39241407b0 2023-10-06T01:22:43.601 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:43.596+0000 7f3929f9b700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f39240af200 0x7f3924156bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:43.601 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:43.596+0000 7f3929f9b700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f39240af200 0x7f3924156bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:54960/0 (socket says 172.21.15.50:54960) 2023-10-06T01:22:43.601 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:43.596+0000 7f3929f9b700 1 -- 172.21.15.50:0/1230901140 learned_addr learned my addr 172.21.15.50:0/1230901140 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-06T01:22:43.601 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:43.596+0000 7f392979a700 1 --2- 172.21.15.50:0/1230901140 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f39241407b0 0x7f392415aae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:43.601 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:43.596+0000 7f392a79c700 1 --2- 172.21.15.50:0/1230901140 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f392415b020 0x7f3924158e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:43.601 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:43.596+0000 7f3929f9b700 1 -- 172.21.15.50:0/1230901140 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f39241407b0 msgr2=0x7f392415aae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:43.601 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:43.596+0000 7f3929f9b700 1 --2- 172.21.15.50:0/1230901140 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f39241407b0 0x7f392415aae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:43.601 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:43.596+0000 7f3929f9b700 1 -- 172.21.15.50:0/1230901140 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f392415b020 msgr2=0x7f3924158e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:43.602 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:43.596+0000 7f3929f9b700 1 --2- 172.21.15.50:0/1230901140 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f392415b020 0x7f3924158e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:43.602 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:43.596+0000 7f3929f9b700 1 -- 172.21.15.50:0/1230901140 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f391c009ae0 con 0x7f39240af200 2023-10-06T01:22:43.602 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:43.597+0000 7f3929f9b700 1 --2- 172.21.15.50:0/1230901140 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f39240af200 0x7f3924156bd0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f392000d890 tx=0x7f3920008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:22:43.602 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:43.597+0000 7f3919ffb700 1 -- 172.21.15.50:0/1230901140 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39200125f0 con 0x7f39240af200 2023-10-06T01:22:43.602 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:43.597+0000 7f3919ffb700 1 -- 172.21.15.50:0/1230901140 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3920012770 con 0x7f39240af200 2023-10-06T01:22:43.602 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:43.597+0000 7f3919ffb700 1 -- 172.21.15.50:0/1230901140 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3920012b30 con 0x7f39240af200 2023-10-06T01:22:43.602 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:43.597+0000 7f392af9d700 1 -- 172.21.15.50:0/1230901140 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f39241583b0 con 0x7f39240af200 2023-10-06T01:22:43.602 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:43.597+0000 7f392af9d700 1 -- 172.21.15.50:0/1230901140 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3924157d60 con 0x7f39240af200 2023-10-06T01:22:43.603 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:43.598+0000 7f392af9d700 1 -- 172.21.15.50:0/1230901140 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f392405f270 con 0x7f39240af200 2023-10-06T01:22:43.603 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:43.599+0000 7f3919ffb700 1 -- 172.21.15.50:0/1230901140 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f392001e460 con 0x7f39240af200 2023-10-06T01:22:43.603 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:43.600+0000 7f3919ffb700 1 --2- 172.21.15.50:0/1230901140 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f3908066f30 0x7f39080693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:43.603 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:43.600+0000 7f3919ffb700 1 -- 172.21.15.50:0/1230901140 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6867+0+0 (secure 0 0 0) 0x7f3920085160 con 0x7f39240af200 2023-10-06T01:22:43.603 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:43.600+0000 7f392979a700 1 --2- 172.21.15.50:0/1230901140 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f3908066f30 0x7f39080693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:43.604 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:43.601+0000 7f392979a700 1 --2- 172.21.15.50:0/1230901140 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f3908066f30 0x7f39080693e0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f3914006f00 tx=0x7f3914008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:22:43.606 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:43.604+0000 7f3919ffb700 1 -- 172.21.15.50:0/1230901140 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f3920051ea0 con 0x7f39240af200 2023-10-06T01:22:43.853 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:43.851+0000 7f392af9d700 1 -- 172.21.15.50:0/1230901140 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f39240c70c0 con 0x7f39240af200 2023-10-06T01:22:43.854 INFO:tasks.ceph.mon.a.smithi050.stderr:2023-10-06T01:22:43.852+0000 7f6cf57f1700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-10-06T01:22:43.859 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:43.857+0000 7f3919ffb700 1 -- 172.21.15.50:0/1230901140 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v10) v1 ==== 161+0+0 (secure 0 0 0) 0x7f39200554c0 con 0x7f39240af200 2023-10-06T01:22:43.862 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:43.860+0000 7f392af9d700 1 -- 172.21.15.50:0/1230901140 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f3908066f30 msgr2=0x7f39080693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:43.863 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:43.860+0000 7f392af9d700 1 --2- 172.21.15.50:0/1230901140 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f3908066f30 0x7f39080693e0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f3914006f00 tx=0x7f3914008040 comp rx=0 tx=0).stop 2023-10-06T01:22:43.863 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:43.860+0000 7f392af9d700 1 -- 172.21.15.50:0/1230901140 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f39240af200 msgr2=0x7f3924156bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:43.863 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:43.860+0000 7f392af9d700 1 --2- 172.21.15.50:0/1230901140 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f39240af200 0x7f3924156bd0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f392000d890 tx=0x7f3920008040 comp rx=0 tx=0).stop 2023-10-06T01:22:43.863 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:43.860+0000 7f392af9d700 1 -- 172.21.15.50:0/1230901140 shutdown_connections 2023-10-06T01:22:43.863 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:43.860+0000 7f392af9d700 1 --2- 172.21.15.50:0/1230901140 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f3908066f30 0x7f39080693e0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:43.863 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:43.860+0000 7f392af9d700 1 --2- 172.21.15.50:0/1230901140 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f392415b020 0x7f3924158e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:43.863 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:43.860+0000 7f392af9d700 1 --2- 172.21.15.50:0/1230901140 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f39240af200 0x7f3924156bd0 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:43.864 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:43.860+0000 7f392af9d700 1 --2- 172.21.15.50:0/1230901140 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f39241407b0 0x7f392415aae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:43.864 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:43.860+0000 7f392af9d700 1 -- 172.21.15.50:0/1230901140 >> 172.21.15.50:0/1230901140 conn(0x7f39240680c0 msgr2=0x7f39240c7430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:22:43.864 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:43.860+0000 7f392af9d700 1 -- 172.21.15.50:0/1230901140 shutdown_connections 2023-10-06T01:22:43.864 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:43.860+0000 7f392af9d700 1 -- 172.21.15.50:0/1230901140 wait complete. 2023-10-06T01:22:43.865 INFO:teuthology.orchestra.run.smithi050.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-10-06T01:22:43.868 INFO:tasks.ceph.mds.d.smithi155.stderr: -4415> 2023-10-06T01:21:41.786+0000 7fd236bf1700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-06T01:22:43.880 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-10-06T01:22:43.915 INFO:tasks.ceph.mds.d.smithi155.stdout:starting mds.d at 2023-10-06T01:22:44.068 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:44.066+0000 7f0c2919d700 1 Processor -- start 2023-10-06T01:22:44.068 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:44.066+0000 7f0c2919d700 1 -- start start 2023-10-06T01:22:44.071 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:44.067+0000 7f0c2919d700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0c2413c470 0x7f0c240ca990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:44.071 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:44.067+0000 7f0c2919d700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f0c240caed0 0x7f0c24159b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:44.071 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:44.067+0000 7f0c2919d700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f0c2415a080 0x7f0c2415cf80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:44.071 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:44.067+0000 7f0c2919d700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0c240cb340 con 0x7f0c240caed0 2023-10-06T01:22:44.071 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:44.068+0000 7f0c2919d700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0c2406d470 con 0x7f0c2415a080 2023-10-06T01:22:44.071 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:44.068+0000 7f0c2919d700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c2406cb80 con 0x7f0c2413c470 2023-10-06T01:22:44.072 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:44.068+0000 7f0c237fe700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f0c240caed0 0x7f0c24159b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:44.072 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:44.068+0000 7f0c237fe700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f0c240caed0 0x7f0c24159b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:54976/0 (socket says 172.21.15.50:54976) 2023-10-06T01:22:44.072 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:44.068+0000 7f0c237fe700 1 -- 172.21.15.50:0/3336375385 learned_addr learned my addr 172.21.15.50:0/3336375385 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-06T01:22:44.072 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:44.068+0000 7f0c23fff700 1 --2- 172.21.15.50:0/3336375385 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0c2413c470 0x7f0c240ca990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:44.072 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:44.068+0000 7f0c2899c700 1 --2- 172.21.15.50:0/3336375385 >> v2:172.21.15.155:3300/0 conn(0x7f0c2415a080 0x7f0c2415cf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:44.072 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:44.068+0000 7f0c237fe700 1 -- 172.21.15.50:0/3336375385 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0c2413c470 msgr2=0x7f0c240ca990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:22:44.072 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:44.068+0000 7f0c237fe700 1 --2- 172.21.15.50:0/3336375385 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0c2413c470 0x7f0c240ca990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:44.073 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:44.068+0000 7f0c237fe700 1 -- 172.21.15.50:0/3336375385 >> v2:172.21.15.155:3300/0 conn(0x7f0c2415a080 msgr2=0x7f0c2415cf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:22:44.073 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:44.068+0000 7f0c237fe700 1 --2- 172.21.15.50:0/3336375385 >> v2:172.21.15.155:3300/0 conn(0x7f0c2415a080 0x7f0c2415cf80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:44.073 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:44.068+0000 7f0c237fe700 1 -- 172.21.15.50:0/3336375385 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c2413c840 con 0x7f0c240caed0 2023-10-06T01:22:44.074 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:44.069+0000 7f0c237fe700 1 --2- 172.21.15.50:0/3336375385 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0c240caed0 0x7f0c24159b40 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f0c240c86b0 tx=0x7f0c18009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9403f2cd4e65bb46 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:22:44.074 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:44.069+0000 7f0c22ffd700 1 -- 172.21.15.50:0/3336375385 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c1800b640 con 0x7f0c240caed0 2023-10-06T01:22:44.074 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:44.069+0000 7f0c22ffd700 1 -- 172.21.15.50:0/3336375385 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c1800b7a0 con 0x7f0c240caed0 2023-10-06T01:22:44.075 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:44.069+0000 7f0c22ffd700 1 -- 172.21.15.50:0/3336375385 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c1800bb60 con 0x7f0c240caed0 2023-10-06T01:22:44.078 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:44.069+0000 7f0c2919d700 1 -- 172.21.15.50:0/3336375385 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0c240caed0 msgr2=0x7f0c24159b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:44.078 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:44.069+0000 7f0c2919d700 1 --2- 172.21.15.50:0/3336375385 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0c240caed0 0x7f0c24159b40 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f0c240c86b0 tx=0x7f0c18009250 comp rx=0 tx=0).stop 2023-10-06T01:22:44.079 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:44.070+0000 7f0c2919d700 1 -- 172.21.15.50:0/3336375385 shutdown_connections 2023-10-06T01:22:44.079 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:44.070+0000 7f0c2919d700 1 --2- 172.21.15.50:0/3336375385 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0c2413c470 0x7f0c240ca990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:44.079 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:44.070+0000 7f0c2919d700 1 --2- 172.21.15.50:0/3336375385 >> v2:172.21.15.155:3300/0 conn(0x7f0c2415a080 0x7f0c2415cf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:44.079 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:44.070+0000 7f0c2919d700 1 --2- 172.21.15.50:0/3336375385 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0c240caed0 0x7f0c24159b40 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:44.079 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:44.070+0000 7f0c2919d700 1 -- 172.21.15.50:0/3336375385 >> 172.21.15.50:0/3336375385 conn(0x7f0c2406b370 msgr2=0x7f0c2406b770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:22:44.080 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:44.070+0000 7f0c2919d700 1 -- 172.21.15.50:0/3336375385 shutdown_connections 2023-10-06T01:22:44.080 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:44.070+0000 7f0c2919d700 1 -- 172.21.15.50:0/3336375385 wait complete. 2023-10-06T01:22:44.080 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:44.071+0000 7f0c2919d700 1 Processor -- start 2023-10-06T01:22:44.080 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:44.071+0000 7f0c2919d700 1 -- start start 2023-10-06T01:22:44.080 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:44.072+0000 7f0c2919d700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0c240caed0 0x7f0c240b28f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:44.081 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:44.072+0000 7f0c2919d700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0c2413c470 0x7f0c240b1c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:44.081 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:44.072+0000 7f0c2919d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0c2415a080 0x7f0c2416cb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:44.081 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:44.072+0000 7f0c2919d700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c240b21c0 con 0x7f0c2415a080 2023-10-06T01:22:44.081 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:44.072+0000 7f0c2919d700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c240b2f40 con 0x7f0c2413c470 2023-10-06T01:22:44.081 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:44.072+0000 7f0c2919d700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c240b3220 con 0x7f0c240caed0 2023-10-06T01:22:44.081 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:44.072+0000 7f0c2899c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0c2415a080 0x7f0c2416cb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:44.082 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:44.072+0000 7f0c2899c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0c2415a080 0x7f0c2416cb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:54978/0 (socket says 172.21.15.50:54978) 2023-10-06T01:22:44.082 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:44.072+0000 7f0c237fe700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0c2413c470 0x7f0c240b1c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:44.082 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:44.072+0000 7f0c2899c700 1 -- 172.21.15.50:0/981970773 learned_addr learned my addr 172.21.15.50:0/981970773 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-06T01:22:44.082 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:44.072+0000 7f0c23fff700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0c240caed0 0x7f0c240b28f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:44.082 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:44.073+0000 7f0c2899c700 1 -- 172.21.15.50:0/981970773 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0c240caed0 msgr2=0x7f0c240b28f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:44.083 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:44.073+0000 7f0c2899c700 1 --2- 172.21.15.50:0/981970773 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0c240caed0 0x7f0c240b28f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:44.083 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:44.073+0000 7f0c2899c700 1 -- 172.21.15.50:0/981970773 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0c2413c470 msgr2=0x7f0c240b1c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:44.083 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:44.073+0000 7f0c2899c700 1 --2- 172.21.15.50:0/981970773 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0c2413c470 0x7f0c240b1c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:44.083 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:44.073+0000 7f0c2899c700 1 -- 172.21.15.50:0/981970773 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c180094f0 con 0x7f0c2415a080 2023-10-06T01:22:44.083 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:44.073+0000 7f0c2899c700 1 --2- 172.21.15.50:0/981970773 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0c2415a080 0x7f0c2416cb20 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f0c1c009df0 tx=0x7f0c1c00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:22:44.084 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:44.073+0000 7f0c0bfff700 1 -- 172.21.15.50:0/981970773 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c1c00caa0 con 0x7f0c2415a080 2023-10-06T01:22:44.084 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:44.073+0000 7f0c0bfff700 1 -- 172.21.15.50:0/981970773 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c1c00f040 con 0x7f0c2415a080 2023-10-06T01:22:44.084 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:44.073+0000 7f0c0bfff700 1 -- 172.21.15.50:0/981970773 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c1c00ce70 con 0x7f0c2415a080 2023-10-06T01:22:44.084 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:44.073+0000 7f0c2919d700 1 -- 172.21.15.50:0/981970773 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0c240b3500 con 0x7f0c2415a080 2023-10-06T01:22:44.085 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:44.073+0000 7f0c2919d700 1 -- 172.21.15.50:0/981970773 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0c240b3ac0 con 0x7f0c2415a080 2023-10-06T01:22:44.085 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:44.074+0000 7f0c2919d700 1 -- 172.21.15.50:0/981970773 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0c240b3ce0 con 0x7f0c2415a080 2023-10-06T01:22:44.085 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:44.075+0000 7f0c0bfff700 1 -- 172.21.15.50:0/981970773 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f0c1c014690 con 0x7f0c2415a080 2023-10-06T01:22:44.085 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:44.076+0000 7f0c0bfff700 1 --2- 172.21.15.50:0/981970773 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f0c10066f30 0x7f0c100693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:44.085 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:44.076+0000 7f0c0bfff700 1 -- 172.21.15.50:0/981970773 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6953+0+0 (secure 0 0 0) 0x7f0c1c0852c0 con 0x7f0c2415a080 2023-10-06T01:22:44.085 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:44.076+0000 7f0c23fff700 1 --2- 172.21.15.50:0/981970773 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f0c10066f30 0x7f0c100693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:44.086 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:44.077+0000 7f0c23fff700 1 --2- 172.21.15.50:0/981970773 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f0c10066f30 0x7f0c100693e0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f0c240c4430 tx=0x7f0c140091a0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:22:44.086 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:44.080+0000 7f0c0bfff700 1 -- 172.21.15.50:0/981970773 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f0c1c055a40 con 0x7f0c2415a080 2023-10-06T01:22:44.327 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:44.326+0000 7f0c2919d700 1 -- 172.21.15.50:0/981970773 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f0c2405f270 con 0x7f0c2415a080 2023-10-06T01:22:44.860 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:44.858+0000 7f0c0bfff700 1 -- 172.21.15.50:0/981970773 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v11) v1 ==== 104+0+0 (secure 0 0 0) 0x7f0c1c0555d0 con 0x7f0c2415a080 2023-10-06T01:22:44.863 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:44.861+0000 7f0c2919d700 1 -- 172.21.15.50:0/981970773 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f0c10066f30 msgr2=0x7f0c100693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:44.863 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:44.861+0000 7f0c2919d700 1 --2- 172.21.15.50:0/981970773 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f0c10066f30 0x7f0c100693e0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f0c240c4430 tx=0x7f0c140091a0 comp rx=0 tx=0).stop 2023-10-06T01:22:44.863 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:44.861+0000 7f0c2919d700 1 -- 172.21.15.50:0/981970773 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0c2415a080 msgr2=0x7f0c2416cb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:44.863 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:44.861+0000 7f0c2919d700 1 --2- 172.21.15.50:0/981970773 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0c2415a080 0x7f0c2416cb20 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f0c1c009df0 tx=0x7f0c1c00b040 comp rx=0 tx=0).stop 2023-10-06T01:22:44.864 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:44.861+0000 7f0c2919d700 1 -- 172.21.15.50:0/981970773 shutdown_connections 2023-10-06T01:22:44.864 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:44.861+0000 7f0c2919d700 1 --2- 172.21.15.50:0/981970773 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0c2415a080 0x7f0c2416cb20 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:44.864 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:44.861+0000 7f0c2919d700 1 --2- 172.21.15.50:0/981970773 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0c240caed0 0x7f0c240b28f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:44.864 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:44.861+0000 7f0c2919d700 1 --2- 172.21.15.50:0/981970773 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f0c10066f30 0x7f0c100693e0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:44.864 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:44.861+0000 7f0c2919d700 1 --2- 172.21.15.50:0/981970773 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0c2413c470 0x7f0c240b1c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:44.864 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:44.861+0000 7f0c2919d700 1 -- 172.21.15.50:0/981970773 >> 172.21.15.50:0/981970773 conn(0x7f0c2406b370 msgr2=0x7f0c241591c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:22:44.864 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:44.861+0000 7f0c2919d700 1 -- 172.21.15.50:0/981970773 shutdown_connections 2023-10-06T01:22:44.864 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:44.861+0000 7f0c2919d700 1 -- 172.21.15.50:0/981970773 wait complete. 2023-10-06T01:22:44.883 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-10-06T01:22:45.078 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:45.077+0000 7fbff2b9d700 1 Processor -- start 2023-10-06T01:22:45.078 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:45.077+0000 7fbff2b9d700 1 -- start start 2023-10-06T01:22:45.080 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:45.077+0000 7fbff2b9d700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fbfec0ccab0 0x7fbfec0d02f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:45.080 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:45.077+0000 7fbff2b9d700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbfec0d0830 0x7fbfec0ce8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:45.080 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:45.077+0000 7fbff2b9d700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbfec0d0c90 con 0x7fbfec1539d0 2023-10-06T01:22:45.080 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:45.077+0000 7fbff2b9d700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbfec0cdc30 con 0x7fbfec0ccab0 2023-10-06T01:22:45.080 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:45.077+0000 7fbff2b9d700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbfec0cb500 con 0x7fbfec0d0830 2023-10-06T01:22:45.080 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:45.077+0000 7fbff139a700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fbfec0ccab0 0x7fbfec0d02f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:45.080 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:45.078+0000 7fbff139a700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fbfec0ccab0 0x7fbfec0d02f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:52540/0 (socket says 172.21.15.50:52540) 2023-10-06T01:22:45.080 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:45.078+0000 7fbff139a700 1 -- 172.21.15.50:0/2439223385 learned_addr learned my addr 172.21.15.50:0/2439223385 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-06T01:22:45.081 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:45.078+0000 7fbff239c700 1 --2- 172.21.15.50:0/2439223385 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbfec0d0830 0x7fbfec0ce8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:45.081 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:45.078+0000 7fbff139a700 1 -- 172.21.15.50:0/2439223385 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbfec0d0830 msgr2=0x7fbfec0ce8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:22:45.081 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:45.078+0000 7fbff139a700 1 --2- 172.21.15.50:0/2439223385 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbfec0d0830 0x7fbfec0ce8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:45.081 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:45.078+0000 7fbff139a700 1 -- 172.21.15.50:0/2439223385 >> v1:172.21.15.155:6789/0 conn(0x7fbfec1539d0 legacy=0x7fbfec15a3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:22:45.081 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:45.078+0000 7fbff139a700 1 -- 172.21.15.50:0/2439223385 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbfec0cd020 con 0x7fbfec0ccab0 2023-10-06T01:22:45.081 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:45.078+0000 7fbff139a700 1 --2- 172.21.15.50:0/2439223385 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbfec0ccab0 0x7fbfec0d02f0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fbfdc0099b0 tx=0x7fbfdc009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=20f013bb5f7f0a23 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:22:45.082 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:45.078+0000 7fbff0b99700 1 -- 172.21.15.50:0/2439223385 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfdc00b860 con 0x7fbfec0ccab0 2023-10-06T01:22:45.082 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:45.079+0000 7fbff0b99700 1 -- 172.21.15.50:0/2439223385 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbfdc00b9c0 con 0x7fbfec0ccab0 2023-10-06T01:22:45.082 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:45.079+0000 7fbff0b99700 1 -- 172.21.15.50:0/2439223385 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfdc00bd60 con 0x7fbfec0ccab0 2023-10-06T01:22:45.082 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:45.079+0000 7fbff2b9d700 1 -- 172.21.15.50:0/2439223385 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbfec0ccab0 msgr2=0x7fbfec0d02f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:45.082 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:45.079+0000 7fbff2b9d700 1 --2- 172.21.15.50:0/2439223385 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbfec0ccab0 0x7fbfec0d02f0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fbfdc0099b0 tx=0x7fbfdc009250 comp rx=0 tx=0).stop 2023-10-06T01:22:45.082 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:45.079+0000 7fbff2b9d700 1 -- 172.21.15.50:0/2439223385 shutdown_connections 2023-10-06T01:22:45.082 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:45.079+0000 7fbff2b9d700 1 --2- 172.21.15.50:0/2439223385 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbfec0d0830 0x7fbfec0ce8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:45.083 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:45.079+0000 7fbff2b9d700 1 --2- 172.21.15.50:0/2439223385 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbfec0ccab0 0x7fbfec0d02f0 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:45.083 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:45.079+0000 7fbff2b9d700 1 -- 172.21.15.50:0/2439223385 >> 172.21.15.50:0/2439223385 conn(0x7fbfec068100 msgr2=0x7fbfec0684d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:22:45.083 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:45.079+0000 7fbff2b9d700 1 -- 172.21.15.50:0/2439223385 shutdown_connections 2023-10-06T01:22:45.083 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:45.079+0000 7fbff2b9d700 1 -- 172.21.15.50:0/2439223385 wait complete. 2023-10-06T01:22:45.084 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:45.082+0000 7fbff2b9d700 1 Processor -- start 2023-10-06T01:22:45.084 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:45.082+0000 7fbff2b9d700 1 -- start start 2023-10-06T01:22:45.084 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:45.082+0000 7fbff2b9d700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbfec0ccab0 0x7fbfec1516b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:45.084 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:45.082+0000 7fbff2b9d700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbfec0d0830 0x7fbfec0b4550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:45.085 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:45.082+0000 7fbff2b9d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbfec1539d0 0x7fbfec0b1520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:45.085 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:45.082+0000 7fbff2b9d700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbfec0b5a60 con 0x7fbfec1539d0 2023-10-06T01:22:45.085 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:45.082+0000 7fbff2b9d700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbfec151bf0 con 0x7fbfec0d0830 2023-10-06T01:22:45.085 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:45.082+0000 7fbff2b9d700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbfec0b4e50 con 0x7fbfec0ccab0 2023-10-06T01:22:45.085 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:45.082+0000 7fbff239c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbfec1539d0 0x7fbfec0b1520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:45.085 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:45.082+0000 7fbff239c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbfec1539d0 0x7fbfec0b1520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:52556/0 (socket says 172.21.15.50:52556) 2023-10-06T01:22:45.085 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:45.082+0000 7fbff239c700 1 -- 172.21.15.50:0/322358922 learned_addr learned my addr 172.21.15.50:0/322358922 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-06T01:22:45.085 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:45.082+0000 7fbff1b9b700 1 --2- 172.21.15.50:0/322358922 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbfec0ccab0 0x7fbfec1516b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:45.085 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:45.082+0000 7fbff139a700 1 --2- 172.21.15.50:0/322358922 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbfec0d0830 0x7fbfec0b4550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:45.085 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:45.083+0000 7fbff239c700 1 -- 172.21.15.50:0/322358922 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbfec0ccab0 msgr2=0x7fbfec1516b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:45.085 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:45.083+0000 7fbff239c700 1 --2- 172.21.15.50:0/322358922 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbfec0ccab0 0x7fbfec1516b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:45.085 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:45.083+0000 7fbff239c700 1 -- 172.21.15.50:0/322358922 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbfec0d0830 msgr2=0x7fbfec0b4550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:45.086 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:45.083+0000 7fbff239c700 1 --2- 172.21.15.50:0/322358922 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbfec0d0830 0x7fbfec0b4550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:45.086 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:45.083+0000 7fbff239c700 1 -- 172.21.15.50:0/322358922 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbfdc0094f0 con 0x7fbfec1539d0 2023-10-06T01:22:45.087 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:45.083+0000 7fbff239c700 1 --2- 172.21.15.50:0/322358922 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbfec1539d0 0x7fbfec0b1520 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fbfe4007f20 tx=0x7fbfe4009860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:22:45.087 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:45.083+0000 7fbfe1ffb700 1 -- 172.21.15.50:0/322358922 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfe400eca0 con 0x7fbfec1539d0 2023-10-06T01:22:45.087 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:45.083+0000 7fbfe1ffb700 1 -- 172.21.15.50:0/322358922 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbfe400ee20 con 0x7fbfec1539d0 2023-10-06T01:22:45.087 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:45.083+0000 7fbff2b9d700 1 -- 172.21.15.50:0/322358922 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbfec0b5130 con 0x7fbfec1539d0 2023-10-06T01:22:45.087 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:45.083+0000 7fbfe1ffb700 1 -- 172.21.15.50:0/322358922 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfe4014670 con 0x7fbfec1539d0 2023-10-06T01:22:45.087 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:45.083+0000 7fbff2b9d700 1 -- 172.21.15.50:0/322358922 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbfec0b56f0 con 0x7fbfec1539d0 2023-10-06T01:22:45.087 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:45.084+0000 7fbff2b9d700 1 -- 172.21.15.50:0/322358922 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbfec0b5bd0 con 0x7fbfec1539d0 2023-10-06T01:22:45.087 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:45.085+0000 7fbfe1ffb700 1 -- 172.21.15.50:0/322358922 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fbfe40149e0 con 0x7fbfec1539d0 2023-10-06T01:22:45.088 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:45.086+0000 7fbfe1ffb700 1 --2- 172.21.15.50:0/322358922 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7fbfd0066f30 0x7fbfd00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:45.088 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:45.086+0000 7fbfe1ffb700 1 -- 172.21.15.50:0/322358922 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6953+0+0 (secure 0 0 0) 0x7fbfe40851e0 con 0x7fbfec1539d0 2023-10-06T01:22:45.088 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:45.086+0000 7fbff1b9b700 1 --2- 172.21.15.50:0/322358922 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7fbfd0066f30 0x7fbfd00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:45.089 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:45.087+0000 7fbff1b9b700 1 --2- 172.21.15.50:0/322358922 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7fbfd0066f30 0x7fbfd00693e0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fbfe80037c0 tx=0x7fbfe8009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:22:45.092 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:45.091+0000 7fbfe1ffb700 1 -- 172.21.15.50:0/322358922 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fbfe4051ed0 con 0x7fbfec1539d0 2023-10-06T01:22:45.293 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:45.291+0000 7fbff2b9d700 1 -- 172.21.15.50:0/322358922 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fbfec05f270 con 0x7fbfec1539d0 2023-10-06T01:22:45.863 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:45.862+0000 7fbfe1ffb700 1 -- 172.21.15.50:0/322358922 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v29) v1 ==== 181+0+0 (secure 0 0 0) 0x7fbfe40554f0 con 0x7fbfec1539d0 2023-10-06T01:22:45.869 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:45.868+0000 7fbff2b9d700 1 -- 172.21.15.50:0/322358922 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7fbfd0066f30 msgr2=0x7fbfd00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:45.869 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:45.868+0000 7fbff2b9d700 1 --2- 172.21.15.50:0/322358922 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7fbfd0066f30 0x7fbfd00693e0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fbfe80037c0 tx=0x7fbfe8009040 comp rx=0 tx=0).stop 2023-10-06T01:22:45.869 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:45.868+0000 7fbff2b9d700 1 -- 172.21.15.50:0/322358922 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbfec1539d0 msgr2=0x7fbfec0b1520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:45.869 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:45.868+0000 7fbff2b9d700 1 --2- 172.21.15.50:0/322358922 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbfec1539d0 0x7fbfec0b1520 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fbfe4007f20 tx=0x7fbfe4009860 comp rx=0 tx=0).stop 2023-10-06T01:22:45.870 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:45.868+0000 7fbff2b9d700 1 -- 172.21.15.50:0/322358922 shutdown_connections 2023-10-06T01:22:45.870 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:45.868+0000 7fbff2b9d700 1 --2- 172.21.15.50:0/322358922 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbfec1539d0 0x7fbfec0b1520 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:45.870 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:45.868+0000 7fbff2b9d700 1 --2- 172.21.15.50:0/322358922 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbfec0ccab0 0x7fbfec1516b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:45.870 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:45.868+0000 7fbff2b9d700 1 --2- 172.21.15.50:0/322358922 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7fbfd0066f30 0x7fbfd00693e0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:45.870 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:45.868+0000 7fbff2b9d700 1 --2- 172.21.15.50:0/322358922 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbfec0d0830 0x7fbfec0b4550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:45.870 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:45.868+0000 7fbff2b9d700 1 -- 172.21.15.50:0/322358922 >> 172.21.15.50:0/322358922 conn(0x7fbfec068100 msgr2=0x7fbfec1599d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:22:45.870 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:45.868+0000 7fbff2b9d700 1 -- 172.21.15.50:0/322358922 shutdown_connections 2023-10-06T01:22:45.870 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:45.868+0000 7fbff2b9d700 1 -- 172.21.15.50:0/322358922 wait complete. 2023-10-06T01:22:45.871 INFO:teuthology.orchestra.run.smithi050.stderr:pool 'cephfs_metadata' removed 2023-10-06T01:22:45.890 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-10-06T01:22:46.084 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:46.083+0000 7f4c9199d700 1 Processor -- start 2023-10-06T01:22:46.084 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:46.083+0000 7f4c9199d700 1 -- start start 2023-10-06T01:22:46.085 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:46.084+0000 7f4c9199d700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f4c8c06d470 0x7f4c8c0ab780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:46.085 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:46.084+0000 7f4c9199d700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f4c8c06a8f0 0x7f4c8c1405e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:46.086 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:46.084+0000 7f4c9199d700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4c8c0c6530 con 0x7f4c8c06d840 2023-10-06T01:22:46.086 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:46.084+0000 7f4c9199d700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4c8c0c70b0 con 0x7f4c8c06d470 2023-10-06T01:22:46.086 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:46.084+0000 7f4c9199d700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4c8c0abcc0 con 0x7f4c8c06a8f0 2023-10-06T01:22:46.086 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:46.085+0000 7f4c8bfff700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f4c8c06d840 0x7f4c8c06a1e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:44760/0 (socket says 172.21.15.50:44760) 2023-10-06T01:22:46.086 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:46.085+0000 7f4c8bfff700 1 -- 172.21.15.50:0/2710590442 learned_addr learned my addr 172.21.15.50:0/2710590442 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-10-06T01:22:46.086 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:46.085+0000 7f4c9099b700 1 --2- 172.21.15.50:0/2710590442 >> v2:172.21.15.50:3300/0 conn(0x7f4c8c06d470 0x7f4c8c0ab780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:46.088 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:46.085+0000 7f4c9119c700 1 --2- 172.21.15.50:0/2710590442 >> v2:172.21.15.155:3300/0 conn(0x7f4c8c06a8f0 0x7f4c8c1405e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:46.088 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:46.085+0000 7f4c8b7fe700 1 -- 172.21.15.50:0/2710590442 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2320242932 0 0) 0x7f4c8c0c6530 con 0x7f4c8c06d840 2023-10-06T01:22:46.088 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:46.085+0000 7f4c8b7fe700 1 -- 172.21.15.50:0/2710590442 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4c7c003570 con 0x7f4c8c06d840 2023-10-06T01:22:46.088 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:46.085+0000 7f4c9099b700 1 -- 172.21.15.50:0/2710590442 >> v2:172.21.15.155:3300/0 conn(0x7f4c8c06a8f0 msgr2=0x7f4c8c1405e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:22:46.088 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:46.085+0000 7f4c9099b700 1 --2- 172.21.15.50:0/2710590442 >> v2:172.21.15.155:3300/0 conn(0x7f4c8c06a8f0 0x7f4c8c1405e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:46.088 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:46.085+0000 7f4c9099b700 1 -- 172.21.15.50:0/2710590442 >> v1:172.21.15.50:6789/0 conn(0x7f4c8c06d840 legacy=0x7f4c8c06a1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:46.089 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:46.085+0000 7f4c9099b700 1 -- 172.21.15.50:0/2710590442 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c8c0695b0 con 0x7f4c8c06d470 2023-10-06T01:22:46.089 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:46.085+0000 7f4c9099b700 1 --2- 172.21.15.50:0/2710590442 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4c8c06d470 0x7f4c8c0ab780 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f4c8c157970 tx=0x7f4c800091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=301bad9d91d87cac server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:22:46.089 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:46.086+0000 7f4c8b7fe700 1 -- 172.21.15.50:0/2710590442 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c80011630 con 0x7f4c8c06d470 2023-10-06T01:22:46.089 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:46.086+0000 7f4c8b7fe700 1 -- 172.21.15.50:0/2710590442 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c80011790 con 0x7f4c8c06d470 2023-10-06T01:22:46.089 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:46.086+0000 7f4c8b7fe700 1 -- 172.21.15.50:0/2710590442 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c80011b30 con 0x7f4c8c06d470 2023-10-06T01:22:46.089 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:46.086+0000 7f4c9199d700 1 -- 172.21.15.50:0/2710590442 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4c8c06d470 msgr2=0x7f4c8c0ab780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:46.089 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:46.086+0000 7f4c9199d700 1 --2- 172.21.15.50:0/2710590442 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4c8c06d470 0x7f4c8c0ab780 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f4c8c157970 tx=0x7f4c800091a0 comp rx=0 tx=0).stop 2023-10-06T01:22:46.089 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:46.086+0000 7f4c9199d700 1 -- 172.21.15.50:0/2710590442 shutdown_connections 2023-10-06T01:22:46.089 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:46.086+0000 7f4c9199d700 1 --2- 172.21.15.50:0/2710590442 >> v2:172.21.15.155:3300/0 conn(0x7f4c8c06a8f0 0x7f4c8c1405e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:46.089 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:46.086+0000 7f4c9199d700 1 --2- 172.21.15.50:0/2710590442 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4c8c06d470 0x7f4c8c0ab780 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:46.089 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:46.086+0000 7f4c9199d700 1 -- 172.21.15.50:0/2710590442 >> 172.21.15.50:0/2710590442 conn(0x7f4c8c0680c0 msgr2=0x7f4c8c0cbef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:22:46.090 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:46.086+0000 7f4c9199d700 1 -- 172.21.15.50:0/2710590442 shutdown_connections 2023-10-06T01:22:46.090 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:46.086+0000 7f4c9199d700 1 -- 172.21.15.50:0/2710590442 wait complete. 2023-10-06T01:22:46.092 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:46.088+0000 7f4c9199d700 1 Processor -- start 2023-10-06T01:22:46.092 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:46.088+0000 7f4c9199d700 1 -- start start 2023-10-06T01:22:46.092 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:46.089+0000 7f4c9199d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4c8c06a8f0 0x7f4c8c0b14b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:46.092 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:46.089+0000 7f4c9199d700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4c8c06d470 0x7f4c8c1579a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:46.092 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:46.089+0000 7f4c9199d700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4c8c06d840 0x7f4c8c1593b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:46.092 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:46.089+0000 7f4c9199d700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c8c0b1b20 con 0x7f4c8c06a8f0 2023-10-06T01:22:46.092 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:46.089+0000 7f4c9199d700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c8c0af700 con 0x7f4c8c06d470 2023-10-06T01:22:46.092 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:46.089+0000 7f4c9199d700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c8c157ee0 con 0x7f4c8c06d840 2023-10-06T01:22:46.092 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:46.089+0000 7f4c9099b700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4c8c06a8f0 0x7f4c8c0b14b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:46.093 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:46.089+0000 7f4c9099b700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4c8c06a8f0 0x7f4c8c0b14b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:52576/0 (socket says 172.21.15.50:52576) 2023-10-06T01:22:46.093 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:46.089+0000 7f4c9099b700 1 -- 172.21.15.50:0/4293617742 learned_addr learned my addr 172.21.15.50:0/4293617742 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-06T01:22:46.093 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:46.089+0000 7f4c8bfff700 1 --2- 172.21.15.50:0/4293617742 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4c8c06d470 0x7f4c8c1579a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:46.093 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:46.089+0000 7f4c9119c700 1 --2- 172.21.15.50:0/4293617742 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4c8c06d840 0x7f4c8c1593b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:46.093 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:46.090+0000 7f4c9099b700 1 -- 172.21.15.50:0/4293617742 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4c8c06d840 msgr2=0x7f4c8c1593b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:46.093 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:46.090+0000 7f4c9099b700 1 --2- 172.21.15.50:0/4293617742 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4c8c06d840 0x7f4c8c1593b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:46.093 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:46.090+0000 7f4c9099b700 1 -- 172.21.15.50:0/4293617742 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4c8c06d470 msgr2=0x7f4c8c1579a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:46.093 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:46.090+0000 7f4c9099b700 1 --2- 172.21.15.50:0/4293617742 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4c8c06d470 0x7f4c8c1579a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:46.093 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:46.090+0000 7f4c9099b700 1 -- 172.21.15.50:0/4293617742 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c80009420 con 0x7f4c8c06a8f0 2023-10-06T01:22:46.093 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:46.090+0000 7f4c8bfff700 1 --2- 172.21.15.50:0/4293617742 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4c8c06d470 0x7f4c8c1579a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T01:22:46.093 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:46.090+0000 7f4c9099b700 1 --2- 172.21.15.50:0/4293617742 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4c8c06a8f0 0x7f4c8c0b14b0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f4c8c068be0 tx=0x7f4c80017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:22:46.094 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:46.090+0000 7f4c88ff9700 1 -- 172.21.15.50:0/4293617742 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c80011b10 con 0x7f4c8c06a8f0 2023-10-06T01:22:46.094 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:46.090+0000 7f4c88ff9700 1 -- 172.21.15.50:0/4293617742 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c800233f0 con 0x7f4c8c06a8f0 2023-10-06T01:22:46.094 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:46.090+0000 7f4c9199d700 1 -- 172.21.15.50:0/4293617742 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4c8c0b0220 con 0x7f4c8c06a8f0 2023-10-06T01:22:46.094 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:46.090+0000 7f4c88ff9700 1 -- 172.21.15.50:0/4293617742 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c800237b0 con 0x7f4c8c06a8f0 2023-10-06T01:22:46.094 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:46.090+0000 7f4c9199d700 1 -- 172.21.15.50:0/4293617742 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4c8c0afbd0 con 0x7f4c8c06a8f0 2023-10-06T01:22:46.094 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:46.091+0000 7f4c9199d700 1 -- 172.21.15.50:0/4293617742 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4c8c15bd10 con 0x7f4c8c06a8f0 2023-10-06T01:22:46.095 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:46.092+0000 7f4c88ff9700 1 -- 172.21.15.50:0/4293617742 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f4c800193b0 con 0x7f4c8c06a8f0 2023-10-06T01:22:46.095 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:46.093+0000 7f4c88ff9700 1 --2- 172.21.15.50:0/4293617742 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f4c70066f30 0x7f4c700693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:46.095 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:46.093+0000 7f4c88ff9700 1 -- 172.21.15.50:0/4293617742 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6515+0+0 (secure 0 0 0) 0x7f4c80085db0 con 0x7f4c8c06a8f0 2023-10-06T01:22:46.095 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:46.093+0000 7f4c8bfff700 1 --2- 172.21.15.50:0/4293617742 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f4c70066f30 0x7f4c700693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:46.095 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:46.094+0000 7f4c8bfff700 1 --2- 172.21.15.50:0/4293617742 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f4c70066f30 0x7f4c700693e0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f4c8c0c6750 tx=0x7f4c78009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:22:46.098 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:46.097+0000 7f4c88ff9700 1 -- 172.21.15.50:0/4293617742 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4c8008a070 con 0x7f4c8c06a8f0 2023-10-06T01:22:46.310 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:46.309+0000 7f4c9199d700 1 -- 172.21.15.50:0/4293617742 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f4c8c05f270 con 0x7f4c8c06a8f0 2023-10-06T01:22:46.864 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:46.863+0000 7f4c88ff9700 1 -- 172.21.15.50:0/4293617742 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v30) v1 ==== 169+0+0 (secure 0 0 0) 0x7f4c800280d0 con 0x7f4c8c06a8f0 2023-10-06T01:22:46.870 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:46.870+0000 7f4c9199d700 1 -- 172.21.15.50:0/4293617742 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f4c70066f30 msgr2=0x7f4c700693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:46.871 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:46.870+0000 7f4c9199d700 1 --2- 172.21.15.50:0/4293617742 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f4c70066f30 0x7f4c700693e0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f4c8c0c6750 tx=0x7f4c78009040 comp rx=0 tx=0).stop 2023-10-06T01:22:46.871 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:46.870+0000 7f4c9199d700 1 -- 172.21.15.50:0/4293617742 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4c8c06a8f0 msgr2=0x7f4c8c0b14b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:46.871 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:46.870+0000 7f4c9199d700 1 --2- 172.21.15.50:0/4293617742 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4c8c06a8f0 0x7f4c8c0b14b0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f4c8c068be0 tx=0x7f4c80017000 comp rx=0 tx=0).stop 2023-10-06T01:22:46.873 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:46.871+0000 7f4c9199d700 1 -- 172.21.15.50:0/4293617742 shutdown_connections 2023-10-06T01:22:46.873 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:46.871+0000 7f4c9199d700 1 --2- 172.21.15.50:0/4293617742 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4c8c06d840 0x7f4c8c1593b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:46.873 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:46.871+0000 7f4c9199d700 1 --2- 172.21.15.50:0/4293617742 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4c8c06a8f0 0x7f4c8c0b14b0 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:46.873 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:46.871+0000 7f4c9199d700 1 --2- 172.21.15.50:0/4293617742 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f4c70066f30 0x7f4c700693e0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:46.874 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:46.871+0000 7f4c9199d700 1 --2- 172.21.15.50:0/4293617742 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4c8c06d470 0x7f4c8c1579a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:46.874 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:46.871+0000 7f4c9199d700 1 -- 172.21.15.50:0/4293617742 >> 172.21.15.50:0/4293617742 conn(0x7f4c8c0680c0 msgr2=0x7f4c8c13f450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:22:46.874 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:46.871+0000 7f4c9199d700 1 -- 172.21.15.50:0/4293617742 shutdown_connections 2023-10-06T01:22:46.874 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:46.874+0000 7f4c9199d700 1 -- 172.21.15.50:0/4293617742 wait complete. 2023-10-06T01:22:46.877 INFO:teuthology.orchestra.run.smithi050.stderr:pool 'cephfs_data' removed 2023-10-06T01:22:46.899 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data_ec cephfs_data_ec --yes-i-really-really-mean-it 2023-10-06T01:22:47.094 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:47.093+0000 7f37b7fff700 1 Processor -- start 2023-10-06T01:22:47.094 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:47.093+0000 7f37b7fff700 1 -- start start 2023-10-06T01:22:47.097 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:47.094+0000 7f37b7fff700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f37b80af390 0x7f37b80c1da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:47.097 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:47.095+0000 7f37b7fff700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f37b806eb20 con 0x7f37b806efb0 2023-10-06T01:22:47.097 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:47.095+0000 7f37b7fff700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f37b815a7f0 con 0x7f37b80af760 2023-10-06T01:22:47.097 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:47.095+0000 7f37b7fff700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f37b815aad0 con 0x7f37b80af390 2023-10-06T01:22:47.097 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:47.095+0000 7f37b77fe700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f37b806efb0 0x7f37b81532b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:44766/0 (socket says 172.21.15.50:44766) 2023-10-06T01:22:47.097 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:47.095+0000 7f37b77fe700 1 -- 172.21.15.50:0/3329966356 learned_addr learned my addr 172.21.15.50:0/3329966356 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-10-06T01:22:47.102 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:47.095+0000 7f37b6ffd700 1 --2- 172.21.15.50:0/3329966356 >> v2:172.21.15.155:3300/0 conn(0x7f37b80af390 0x7f37b80c1da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:47.102 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:47.095+0000 7f37b5ffb700 1 -- 172.21.15.50:0/3329966356 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 41763669 0 0) 0x7f37b806eb20 con 0x7f37b806efb0 2023-10-06T01:22:47.102 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:47.095+0000 7f37b5ffb700 1 -- 172.21.15.50:0/3329966356 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f37a0003570 con 0x7f37b806efb0 2023-10-06T01:22:47.102 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:47.096+0000 7f37b5ffb700 1 -- 172.21.15.50:0/3329966356 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 157141194 0 0) 0x7f37b815a7f0 con 0x7f37b80af760 2023-10-06T01:22:47.102 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:47.096+0000 7f37b5ffb700 1 -- 172.21.15.50:0/3329966356 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f37b806eb20 con 0x7f37b80af760 2023-10-06T01:22:47.102 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:47.096+0000 7f37b5ffb700 1 -- 172.21.15.50:0/3329966356 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3505701567 0 0) 0x7f37a0003570 con 0x7f37b806efb0 2023-10-06T01:22:47.102 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:47.096+0000 7f37b6ffd700 1 -- 172.21.15.50:0/3329966356 >> v1:172.21.15.155:6789/0 conn(0x7f37b80af760 legacy=0x7f37b8159a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:47.102 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:47.096+0000 7f37b6ffd700 1 -- 172.21.15.50:0/3329966356 >> v1:172.21.15.50:6789/0 conn(0x7f37b806efb0 legacy=0x7f37b81532b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:47.102 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:47.096+0000 7f37b6ffd700 1 -- 172.21.15.50:0/3329966356 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37b806e4d0 con 0x7f37b80af390 2023-10-06T01:22:47.103 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:47.096+0000 7f37b6ffd700 1 --2- 172.21.15.50:0/3329966356 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f37b80af390 0x7f37b80c1da0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f37a80098e0 tx=0x7f37a80091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=174f721b645b6803 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:22:47.103 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:47.096+0000 7f37b5ffb700 1 -- 172.21.15.50:0/3329966356 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37b00017f0 con 0x7f37b80af390 2023-10-06T01:22:47.103 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:47.096+0000 7f37b5ffb700 1 -- 172.21.15.50:0/3329966356 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f37a8011420 con 0x7f37b80af390 2023-10-06T01:22:47.103 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:47.096+0000 7f37b5ffb700 1 -- 172.21.15.50:0/3329966356 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37a80117c0 con 0x7f37b80af390 2023-10-06T01:22:47.103 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:47.097+0000 7f37b7fff700 1 -- 172.21.15.50:0/3329966356 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f37b80af390 msgr2=0x7f37b80c1da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:47.103 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:47.097+0000 7f37b7fff700 1 --2- 172.21.15.50:0/3329966356 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f37b80af390 0x7f37b80c1da0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f37a80098e0 tx=0x7f37a80091a0 comp rx=0 tx=0).stop 2023-10-06T01:22:47.103 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:47.097+0000 7f37b7fff700 1 -- 172.21.15.50:0/3329966356 shutdown_connections 2023-10-06T01:22:47.103 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:47.097+0000 7f37b7fff700 1 --2- 172.21.15.50:0/3329966356 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f37b80af390 0x7f37b80c1da0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:47.103 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:47.097+0000 7f37b7fff700 1 -- 172.21.15.50:0/3329966356 >> 172.21.15.50:0/3329966356 conn(0x7f37b80691d0 msgr2=0x7f37b80cd000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:22:47.103 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:47.097+0000 7f37b7fff700 1 -- 172.21.15.50:0/3329966356 shutdown_connections 2023-10-06T01:22:47.103 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:47.097+0000 7f37b7fff700 1 -- 172.21.15.50:0/3329966356 wait complete. 2023-10-06T01:22:47.104 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:47.098+0000 7f37b7fff700 1 Processor -- start 2023-10-06T01:22:47.104 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:47.099+0000 7f37b7fff700 1 -- start start 2023-10-06T01:22:47.104 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:47.099+0000 7f37b7fff700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f37b806efb0 0x7f37b81576b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:47.104 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:47.099+0000 7f37b7fff700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f37b80af390 0x7f37b8159720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:47.104 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:47.099+0000 7f37b7fff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f37b80af760 0x7f37b814fd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:47.104 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:47.099+0000 7f37b7fff700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37b8157d90 con 0x7f37b80af760 2023-10-06T01:22:47.104 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:47.099+0000 7f37b7fff700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37b8158070 con 0x7f37b80af390 2023-10-06T01:22:47.104 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:47.099+0000 7f37b7fff700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37b8158350 con 0x7f37b806efb0 2023-10-06T01:22:47.104 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:47.100+0000 7f37b77fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f37b80af760 0x7f37b814fd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:47.104 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:47.100+0000 7f37b77fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f37b80af760 0x7f37b814fd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:52586/0 (socket says 172.21.15.50:52586) 2023-10-06T01:22:47.104 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:47.100+0000 7f37b77fe700 1 -- 172.21.15.50:0/122803329 learned_addr learned my addr 172.21.15.50:0/122803329 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-06T01:22:47.104 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:47.100+0000 7f37b6ffd700 1 --2- 172.21.15.50:0/122803329 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f37b806efb0 0x7f37b81576b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:47.105 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:47.100+0000 7f37b67fc700 1 --2- 172.21.15.50:0/122803329 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f37b80af390 0x7f37b8159720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:47.105 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:47.100+0000 7f37b77fe700 1 -- 172.21.15.50:0/122803329 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f37b806efb0 msgr2=0x7f37b81576b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:47.105 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:47.100+0000 7f37b77fe700 1 --2- 172.21.15.50:0/122803329 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f37b806efb0 0x7f37b81576b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:47.105 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:47.100+0000 7f37b77fe700 1 -- 172.21.15.50:0/122803329 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f37b80af390 msgr2=0x7f37b8159720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:47.105 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:47.100+0000 7f37b77fe700 1 --2- 172.21.15.50:0/122803329 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f37b80af390 0x7f37b8159720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:47.105 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:47.100+0000 7f37b77fe700 1 -- 172.21.15.50:0/122803329 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37a8009420 con 0x7f37b80af760 2023-10-06T01:22:47.105 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:47.100+0000 7f37b67fc700 1 --2- 172.21.15.50:0/122803329 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f37b80af390 0x7f37b8159720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T01:22:47.105 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:47.100+0000 7f37b77fe700 1 --2- 172.21.15.50:0/122803329 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f37b80af760 0x7f37b814fd80 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f37b0001560 tx=0x7f37b0007d20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:22:47.105 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:47.101+0000 7f379effd700 1 -- 172.21.15.50:0/122803329 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37b000ce10 con 0x7f37b80af760 2023-10-06T01:22:47.105 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:47.101+0000 7f379effd700 1 -- 172.21.15.50:0/122803329 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f37b0004dc0 con 0x7f37b80af760 2023-10-06T01:22:47.105 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:47.101+0000 7f379effd700 1 -- 172.21.15.50:0/122803329 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37b000ab50 con 0x7f37b80af760 2023-10-06T01:22:47.106 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:47.101+0000 7f37b7fff700 1 -- 172.21.15.50:0/122803329 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f37b8158630 con 0x7f37b80af760 2023-10-06T01:22:47.106 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:47.101+0000 7f37b7fff700 1 -- 172.21.15.50:0/122803329 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f37b80c44d0 con 0x7f37b80af760 2023-10-06T01:22:47.106 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:47.102+0000 7f37b7fff700 1 -- 172.21.15.50:0/122803329 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f37b80c4750 con 0x7f37b80af760 2023-10-06T01:22:47.107 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:47.103+0000 7f379effd700 1 -- 172.21.15.50:0/122803329 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f37b0007150 con 0x7f37b80af760 2023-10-06T01:22:47.107 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:47.104+0000 7f379effd700 1 --2- 172.21.15.50:0/122803329 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f37a4066f30 0x7f37a40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:47.107 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:47.104+0000 7f379effd700 1 -- 172.21.15.50:0/122803329 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6043+0+0 (secure 0 0 0) 0x7f37b00842f0 con 0x7f37b80af760 2023-10-06T01:22:47.107 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:47.104+0000 7f37b6ffd700 1 --2- 172.21.15.50:0/122803329 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f37a4066f30 0x7f37a40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:47.107 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:47.105+0000 7f37b6ffd700 1 --2- 172.21.15.50:0/122803329 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f37a4066f30 0x7f37a40693e0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f37a80093f0 tx=0x7f37a8016000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:22:47.108 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:47.108+0000 7f379effd700 1 -- 172.21.15.50:0/122803329 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f37b00513f0 con 0x7f37b80af760 2023-10-06T01:22:47.311 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:47.309+0000 7f37b7fff700 1 -- 172.21.15.50:0/122803329 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f37b805f270 con 0x7f37b80af760 2023-10-06T01:22:47.884 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:47.879+0000 7f379effd700 1 -- 172.21.15.50:0/122803329 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data_ec' removed v31) v1 ==== 178+0+0 (secure 0 0 0) 0x7f37b00180d0 con 0x7f37b80af760 2023-10-06T01:22:47.885 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:47.884+0000 7f37b7fff700 1 -- 172.21.15.50:0/122803329 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f37a4066f30 msgr2=0x7f37a40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:47.885 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:47.884+0000 7f37b7fff700 1 --2- 172.21.15.50:0/122803329 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f37a4066f30 0x7f37a40693e0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f37a80093f0 tx=0x7f37a8016000 comp rx=0 tx=0).stop 2023-10-06T01:22:47.885 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:47.884+0000 7f37b7fff700 1 -- 172.21.15.50:0/122803329 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f37b80af760 msgr2=0x7f37b814fd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:47.885 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:47.884+0000 7f37b7fff700 1 --2- 172.21.15.50:0/122803329 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f37b80af760 0x7f37b814fd80 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f37b0001560 tx=0x7f37b0007d20 comp rx=0 tx=0).stop 2023-10-06T01:22:47.885 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:47.884+0000 7f37b7fff700 1 -- 172.21.15.50:0/122803329 shutdown_connections 2023-10-06T01:22:47.886 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:47.884+0000 7f37b7fff700 1 --2- 172.21.15.50:0/122803329 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f37b80af760 0x7f37b814fd80 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:47.886 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:47.884+0000 7f37b7fff700 1 --2- 172.21.15.50:0/122803329 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f37b806efb0 0x7f37b81576b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:47.886 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:47.884+0000 7f37b7fff700 1 --2- 172.21.15.50:0/122803329 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f37a4066f30 0x7f37a40693e0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:47.886 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:47.884+0000 7f37b7fff700 1 --2- 172.21.15.50:0/122803329 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f37b80af390 0x7f37b8159720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:47.886 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:47.884+0000 7f37b7fff700 1 -- 172.21.15.50:0/122803329 >> 172.21.15.50:0/122803329 conn(0x7f37b80691d0 msgr2=0x7f37b80c7aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:22:47.886 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:47.884+0000 7f37b7fff700 1 -- 172.21.15.50:0/122803329 shutdown_connections 2023-10-06T01:22:47.886 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:47.885+0000 7f37b7fff700 1 -- 172.21.15.50:0/122803329 wait complete. 2023-10-06T01:22:47.891 INFO:teuthology.orchestra.run.smithi050.stderr:pool 'cephfs_data_ec' removed 2023-10-06T01:22:47.913 INFO:tasks.ceph.mds.a:Restarting daemon 2023-10-06T01:22:47.914 INFO:tasks.ceph.mds.a:Stopping old one... 2023-10-06T01:22:47.914 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-10-06T01:22:47.914 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T01:22:47.914 INFO:tasks.ceph.mds.c:Restarting daemon 2023-10-06T01:22:47.914 INFO:tasks.ceph.mds.c:Stopping old one... 2023-10-06T01:22:47.914 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-10-06T01:22:47.914 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T01:22:47.915 INFO:tasks.ceph.mds.b:Restarting daemon 2023-10-06T01:22:47.915 INFO:tasks.ceph.mds.b:Stopping old one... 2023-10-06T01:22:47.915 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-10-06T01:22:47.915 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T01:22:47.915 INFO:tasks.ceph.mds.d:Restarting daemon 2023-10-06T01:22:47.915 INFO:tasks.ceph.mds.d:Stopping old one... 2023-10-06T01:22:47.916 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-10-06T01:22:47.916 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T01:22:47.927 INFO:tasks.ceph.mds.a:Stopped 2023-10-06T01:22:47.928 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-10-06T01:22:47.929 INFO:tasks.ceph.mds.c:Stopped 2023-10-06T01:22:47.929 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-10-06T01:22:47.932 INFO:tasks.ceph.mds.d:Stopped 2023-10-06T01:22:47.932 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-10-06T01:22:47.933 INFO:tasks.ceph.mds.b:Stopped 2023-10-06T01:22:47.933 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-10-06T01:22:47.973 INFO:tasks.ceph.mds.a:Started 2023-10-06T01:22:47.973 DEBUG:teuthology.parallel:result is None 2023-10-06T01:22:47.976 INFO:tasks.ceph.mds.c:Started 2023-10-06T01:22:47.976 DEBUG:teuthology.parallel:result is None 2023-10-06T01:22:47.977 INFO:tasks.ceph.mds.d:Started 2023-10-06T01:22:47.977 DEBUG:teuthology.parallel:result is None 2023-10-06T01:22:47.980 INFO:tasks.ceph.mds.b:Started 2023-10-06T01:22:47.980 DEBUG:teuthology.parallel:result is None 2023-10-06T01:22:47.980 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-10-06T01:22:48.114 INFO:tasks.ceph.mds.d.smithi155.stdout:starting mds.d at 2023-10-06T01:22:48.115 INFO:tasks.ceph.mds.a.smithi050.stdout:starting mds.a at 2023-10-06T01:22:48.115 INFO:tasks.ceph.mds.b.smithi155.stdout:starting mds.b at 2023-10-06T01:22:48.117 INFO:tasks.ceph.mds.c.smithi050.stdout:starting mds.c at 2023-10-06T01:22:48.182 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:48.181+0000 7f501219d700 1 Processor -- start 2023-10-06T01:22:48.182 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:48.181+0000 7f501219d700 1 -- start start 2023-10-06T01:22:48.184 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:48.183+0000 7f501219d700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f500c0b2850 0x7f500c0cc0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:48.184 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:48.183+0000 7f501219d700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f500c0cb7e0 con 0x7f500c0cbc70 2023-10-06T01:22:48.184 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:48.183+0000 7f501219d700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f500c0b08a0 con 0x7f500c159480 2023-10-06T01:22:48.184 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:48.183+0000 7f501219d700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f500c0cb190 con 0x7f500c0b2850 2023-10-06T01:22:48.184 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:48.183+0000 7f501099a700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f500c0cbc70 0x7f500c0b2140 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:44780/0 (socket says 172.21.15.50:44780) 2023-10-06T01:22:48.184 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:48.183+0000 7f501099a700 1 -- 172.21.15.50:0/4200249378 learned_addr learned my addr 172.21.15.50:0/4200249378 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-10-06T01:22:48.184 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:48.183+0000 7f501199c700 1 --2- 172.21.15.50:0/4200249378 >> v2:172.21.15.155:3300/0 conn(0x7f500c0b2850 0x7f500c0cc0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:48.186 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:48.183+0000 7f5003fff700 1 -- 172.21.15.50:0/4200249378 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 754942542 0 0) 0x7f500c0cb7e0 con 0x7f500c0cbc70 2023-10-06T01:22:48.186 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:48.183+0000 7f5003fff700 1 -- 172.21.15.50:0/4200249378 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4ff8003570 con 0x7f500c0cbc70 2023-10-06T01:22:48.186 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:48.183+0000 7f501199c700 1 -- 172.21.15.50:0/4200249378 >> v1:172.21.15.155:6789/0 conn(0x7f500c159480 legacy=0x7f500c0b30d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:48.186 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:48.183+0000 7f5003fff700 1 -- 172.21.15.50:0/4200249378 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1500735103 0 0) 0x7f500c0b08a0 con 0x7f500c159480 2023-10-06T01:22:48.186 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:48.183+0000 7f501199c700 1 -- 172.21.15.50:0/4200249378 >> v1:172.21.15.50:6789/0 conn(0x7f500c0cbc70 legacy=0x7f500c0b2140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:48.186 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:48.184+0000 7f501199c700 1 -- 172.21.15.50:0/4200249378 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f500c0cb470 con 0x7f500c0b2850 2023-10-06T01:22:48.186 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:48.184+0000 7f501199c700 1 --2- 172.21.15.50:0/4200249378 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f500c0b2850 0x7f500c0cc0c0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f5004009e60 tx=0x7f5004009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=920b0e9b5fae2ccc server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:22:48.186 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:48.184+0000 7f5003fff700 1 -- 172.21.15.50:0/4200249378 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f500400e070 con 0x7f500c0b2850 2023-10-06T01:22:48.186 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:48.184+0000 7f5003fff700 1 -- 172.21.15.50:0/4200249378 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f500400bb60 con 0x7f500c0b2850 2023-10-06T01:22:48.187 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:48.184+0000 7f5003fff700 1 -- 172.21.15.50:0/4200249378 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5004012430 con 0x7f500c0b2850 2023-10-06T01:22:48.187 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:48.185+0000 7f501219d700 1 -- 172.21.15.50:0/4200249378 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f500c0b2850 msgr2=0x7f500c0cc0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:48.187 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:48.185+0000 7f501219d700 1 --2- 172.21.15.50:0/4200249378 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f500c0b2850 0x7f500c0cc0c0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f5004009e60 tx=0x7f5004009780 comp rx=0 tx=0).stop 2023-10-06T01:22:48.187 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:48.185+0000 7f501219d700 1 -- 172.21.15.50:0/4200249378 shutdown_connections 2023-10-06T01:22:48.187 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:48.185+0000 7f501219d700 1 --2- 172.21.15.50:0/4200249378 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f500c0b2850 0x7f500c0cc0c0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:48.187 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:48.185+0000 7f501219d700 1 -- 172.21.15.50:0/4200249378 >> 172.21.15.50:0/4200249378 conn(0x7f500c06ed20 msgr2=0x7f500c06f120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:22:48.187 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:48.185+0000 7f501219d700 1 -- 172.21.15.50:0/4200249378 shutdown_connections 2023-10-06T01:22:48.187 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:48.185+0000 7f501219d700 1 -- 172.21.15.50:0/4200249378 wait complete. 2023-10-06T01:22:48.188 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:48.186+0000 7f501219d700 1 Processor -- start 2023-10-06T01:22:48.188 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:48.186+0000 7f501219d700 1 -- start start 2023-10-06T01:22:48.188 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:48.187+0000 7f501219d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f500c0b2850 0x7f500c0c7d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:48.189 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:48.187+0000 7f501219d700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f500c0cbc70 0x7f500c15df20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:48.189 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:48.187+0000 7f501219d700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f500c159480 0x7f500c0c9c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:48.189 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:48.187+0000 7f501219d700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f500c0c82d0 con 0x7f500c0b2850 2023-10-06T01:22:48.189 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:48.187+0000 7f501219d700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f500c15e460 con 0x7f500c0cbc70 2023-10-06T01:22:48.189 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:48.187+0000 7f501219d700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f500c15eef0 con 0x7f500c159480 2023-10-06T01:22:48.189 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:48.187+0000 7f501119b700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f500c0b2850 0x7f500c0c7d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:48.189 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:48.188+0000 7f501119b700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f500c0b2850 0x7f500c0c7d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:52628/0 (socket says 172.21.15.50:52628) 2023-10-06T01:22:48.189 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:48.188+0000 7f501119b700 1 -- 172.21.15.50:0/636432428 learned_addr learned my addr 172.21.15.50:0/636432428 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-06T01:22:48.189 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:48.188+0000 7f501099a700 1 --2- 172.21.15.50:0/636432428 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f500c0cbc70 0x7f500c15df20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:48.189 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:48.188+0000 7f501199c700 1 --2- 172.21.15.50:0/636432428 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f500c159480 0x7f500c0c9c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:48.191 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:48.188+0000 7f501119b700 1 -- 172.21.15.50:0/636432428 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f500c159480 msgr2=0x7f500c0c9c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:48.191 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:48.188+0000 7f501119b700 1 --2- 172.21.15.50:0/636432428 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f500c159480 0x7f500c0c9c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:48.191 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:48.188+0000 7f501119b700 1 -- 172.21.15.50:0/636432428 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f500c0cbc70 msgr2=0x7f500c15df20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:48.191 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:48.188+0000 7f501119b700 1 --2- 172.21.15.50:0/636432428 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f500c0cbc70 0x7f500c15df20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:48.191 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:48.188+0000 7f501119b700 1 -- 172.21.15.50:0/636432428 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5004009a20 con 0x7f500c0b2850 2023-10-06T01:22:48.191 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:48.188+0000 7f501119b700 1 --2- 172.21.15.50:0/636432428 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f500c0b2850 0x7f500c0c7d90 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f500800c4e0 tx=0x7f500800c7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:22:48.191 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:48.188+0000 7f50017fa700 1 -- 172.21.15.50:0/636432428 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5008011590 con 0x7f500c0b2850 2023-10-06T01:22:48.191 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:48.189+0000 7f50017fa700 1 -- 172.21.15.50:0/636432428 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5008011710 con 0x7f500c0b2850 2023-10-06T01:22:48.192 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:48.189+0000 7f50017fa700 1 -- 172.21.15.50:0/636432428 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5008011ad0 con 0x7f500c0b2850 2023-10-06T01:22:48.192 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:48.189+0000 7f501219d700 1 -- 172.21.15.50:0/636432428 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f500c0c3d10 con 0x7f500c0b2850 2023-10-06T01:22:48.192 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:48.189+0000 7f501219d700 1 -- 172.21.15.50:0/636432428 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f500c15e650 con 0x7f500c0b2850 2023-10-06T01:22:48.192 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:48.190+0000 7f501219d700 1 -- 172.21.15.50:0/636432428 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f500c05f270 con 0x7f500c0b2850 2023-10-06T01:22:48.192 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:48.191+0000 7f50017fa700 1 -- 172.21.15.50:0/636432428 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f500801b3b0 con 0x7f500c0b2850 2023-10-06T01:22:48.193 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:48.191+0000 7f50017fa700 1 --2- 172.21.15.50:0/636432428 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f4ff0066f30 0x7f4ff00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:48.193 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:48.192+0000 7f50017fa700 1 -- 172.21.15.50:0/636432428 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5612+0+0 (secure 0 0 0) 0x7f50080839d0 con 0x7f500c0b2850 2023-10-06T01:22:48.193 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:48.192+0000 7f501099a700 1 --2- 172.21.15.50:0/636432428 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f4ff0066f30 0x7f4ff00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:48.193 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:48.193+0000 7f501099a700 1 --2- 172.21.15.50:0/636432428 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f4ff0066f30 0x7f4ff00693e0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f500c0d0ee0 tx=0x7f4ffc009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:22:48.196 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:48.195+0000 7f50017fa700 1 -- 172.21.15.50:0/636432428 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f5008050c00 con 0x7f500c0b2850 2023-10-06T01:22:48.414 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:48.413+0000 7f501219d700 1 -- 172.21.15.50:0/636432428 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f500c159850 con 0x7f500c0b2850 2023-10-06T01:22:48.893 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:48.892+0000 7f50017fa700 1 -- 172.21.15.50:0/636432428 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v33) v1 ==== 97+0+0 (secure 0 0 0) 0x7f5008017070 con 0x7f500c0b2850 2023-10-06T01:22:48.897 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:48.896+0000 7f501219d700 1 -- 172.21.15.50:0/636432428 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f4ff0066f30 msgr2=0x7f4ff00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:48.897 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:48.896+0000 7f501219d700 1 --2- 172.21.15.50:0/636432428 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f4ff0066f30 0x7f4ff00693e0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f500c0d0ee0 tx=0x7f4ffc009040 comp rx=0 tx=0).stop 2023-10-06T01:22:48.897 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:48.896+0000 7f501219d700 1 -- 172.21.15.50:0/636432428 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f500c0b2850 msgr2=0x7f500c0c7d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:48.897 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:48.896+0000 7f501219d700 1 --2- 172.21.15.50:0/636432428 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f500c0b2850 0x7f500c0c7d90 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f500800c4e0 tx=0x7f500800c7f0 comp rx=0 tx=0).stop 2023-10-06T01:22:48.898 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:48.896+0000 7f501219d700 1 -- 172.21.15.50:0/636432428 shutdown_connections 2023-10-06T01:22:48.898 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:48.896+0000 7f501219d700 1 --2- 172.21.15.50:0/636432428 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f500c159480 0x7f500c0c9c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:48.898 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:48.896+0000 7f501219d700 1 --2- 172.21.15.50:0/636432428 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f500c0b2850 0x7f500c0c7d90 secure :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f500800c4e0 tx=0x7f500800c7f0 comp rx=0 tx=0).stop 2023-10-06T01:22:48.898 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:48.896+0000 7f501219d700 1 --2- 172.21.15.50:0/636432428 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f4ff0066f30 0x7f4ff00693e0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:48.898 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:48.896+0000 7f501219d700 1 --2- 172.21.15.50:0/636432428 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f500c0cbc70 0x7f500c15df20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:48.898 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:48.896+0000 7f501219d700 1 -- 172.21.15.50:0/636432428 >> 172.21.15.50:0/636432428 conn(0x7f500c06ed20 msgr2=0x7f500c156c80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:22:48.898 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:48.896+0000 7f501219d700 1 -- 172.21.15.50:0/636432428 shutdown_connections 2023-10-06T01:22:48.898 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:48.896+0000 7f501219d700 1 -- 172.21.15.50:0/636432428 wait complete. 2023-10-06T01:22:48.901 INFO:teuthology.orchestra.run.smithi050.stderr: removed all blocklist entries 2023-10-06T01:22:48.923 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-10-06T01:22:49.113 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:49.112+0000 7f663dd9d700 1 Processor -- start 2023-10-06T01:22:49.113 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:49.112+0000 7f663dd9d700 1 -- start start 2023-10-06T01:22:49.114 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:49.113+0000 7f663dd9d700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f66380cc0d0 0x7f663815d9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:49.114 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:49.113+0000 7f663dd9d700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f663815a860 con 0x7f66380689b0 2023-10-06T01:22:49.114 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:49.113+0000 7f663dd9d700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f66380cac60 con 0x7f6638068d80 2023-10-06T01:22:49.114 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:49.113+0000 7f663dd9d700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f66380c7400 con 0x7f66380cc0d0 2023-10-06T01:22:49.114 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:49.113+0000 7f663cd9b700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f66380689b0 0x7f66380cb9c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:44784/0 (socket says 172.21.15.50:44784) 2023-10-06T01:22:49.115 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:49.113+0000 7f6637fff700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f66380cc0d0 0x7f663815d9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:49.115 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:49.113+0000 7f663cd9b700 1 -- 172.21.15.50:0/2933111531 learned_addr learned my addr 172.21.15.50:0/2933111531 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-10-06T01:22:49.116 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:49.114+0000 7f6637fff700 1 -- 172.21.15.50:0/2933111531 >> v1:172.21.15.155:6789/0 conn(0x7f6638068d80 legacy=0x7f66380675f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:49.116 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:49.114+0000 7f6637fff700 1 -- 172.21.15.50:0/2933111531 >> v1:172.21.15.50:6789/0 conn(0x7f66380689b0 legacy=0x7f66380cb9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:49.116 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:49.114+0000 7f66377fe700 1 -- 172.21.15.50:0/2933111531 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1788809395 0 0) 0x7f663815a860 con 0x7f66380689b0 2023-10-06T01:22:49.116 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:49.114+0000 7f6637fff700 1 -- 172.21.15.50:0/2933111531 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66380ca330 con 0x7f66380cc0d0 2023-10-06T01:22:49.116 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:49.114+0000 7f6637fff700 1 --2- 172.21.15.50:0/2933111531 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f66380cc0d0 0x7f663815d9d0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f66240098e0 tx=0x7f66240091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2095c72790356ca4 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:22:49.117 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:49.114+0000 7f66377fe700 1 -- 172.21.15.50:0/2933111531 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6624009e80 con 0x7f66380cc0d0 2023-10-06T01:22:49.117 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:49.114+0000 7f66377fe700 1 -- 172.21.15.50:0/2933111531 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f662400b860 con 0x7f66380cc0d0 2023-10-06T01:22:49.117 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:49.114+0000 7f66377fe700 1 -- 172.21.15.50:0/2933111531 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f662400bbe0 con 0x7f66380cc0d0 2023-10-06T01:22:49.117 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:49.115+0000 7f663dd9d700 1 -- 172.21.15.50:0/2933111531 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f66380cc0d0 msgr2=0x7f663815d9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:49.117 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:49.115+0000 7f663dd9d700 1 --2- 172.21.15.50:0/2933111531 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f66380cc0d0 0x7f663815d9d0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f66240098e0 tx=0x7f66240091a0 comp rx=0 tx=0).stop 2023-10-06T01:22:49.117 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:49.115+0000 7f663dd9d700 1 -- 172.21.15.50:0/2933111531 shutdown_connections 2023-10-06T01:22:49.117 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:49.115+0000 7f663dd9d700 1 --2- 172.21.15.50:0/2933111531 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f66380cc0d0 0x7f663815d9d0 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:49.117 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:49.115+0000 7f663dd9d700 1 -- 172.21.15.50:0/2933111531 >> 172.21.15.50:0/2933111531 conn(0x7f66380cd230 msgr2=0x7f66380c91d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:22:49.117 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:49.115+0000 7f663dd9d700 1 -- 172.21.15.50:0/2933111531 shutdown_connections 2023-10-06T01:22:49.117 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:49.115+0000 7f663dd9d700 1 -- 172.21.15.50:0/2933111531 wait complete. 2023-10-06T01:22:49.118 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:49.116+0000 7f663dd9d700 1 Processor -- start 2023-10-06T01:22:49.118 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:49.117+0000 7f663dd9d700 1 -- start start 2023-10-06T01:22:49.120 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:49.117+0000 7f663dd9d700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f66380689b0 0x7f66380c3770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:49.120 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:49.118+0000 7f663dd9d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6638068d80 0x7f663814bd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:49.120 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:49.118+0000 7f663dd9d700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f66380cc0d0 0x7f66380675f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:49.120 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:49.118+0000 7f663dd9d700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f663816a5a0 con 0x7f6638068d80 2023-10-06T01:22:49.120 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:49.118+0000 7f663dd9d700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f663814c2d0 con 0x7f66380689b0 2023-10-06T01:22:49.120 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:49.118+0000 7f663dd9d700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6638169990 con 0x7f66380cc0d0 2023-10-06T01:22:49.121 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:49.118+0000 7f6637fff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6638068d80 0x7f663814bd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:49.121 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:49.118+0000 7f6637fff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6638068d80 0x7f663814bd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:52640/0 (socket says 172.21.15.50:52640) 2023-10-06T01:22:49.121 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:49.118+0000 7f6637fff700 1 -- 172.21.15.50:0/4088833665 learned_addr learned my addr 172.21.15.50:0/4088833665 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-06T01:22:49.121 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:49.118+0000 7f663cd9b700 1 --2- 172.21.15.50:0/4088833665 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f66380689b0 0x7f66380c3770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:49.121 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:49.118+0000 7f663d59c700 1 --2- 172.21.15.50:0/4088833665 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f66380cc0d0 0x7f66380675f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:49.121 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:49.118+0000 7f6637fff700 1 -- 172.21.15.50:0/4088833665 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f66380cc0d0 msgr2=0x7f66380675f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:49.121 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:49.118+0000 7f6637fff700 1 --2- 172.21.15.50:0/4088833665 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f66380cc0d0 0x7f66380675f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:49.121 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:49.118+0000 7f6637fff700 1 -- 172.21.15.50:0/4088833665 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f66380689b0 msgr2=0x7f66380c3770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:49.122 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:49.118+0000 7f6637fff700 1 --2- 172.21.15.50:0/4088833665 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f66380689b0 0x7f66380c3770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:49.122 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:49.118+0000 7f6637fff700 1 -- 172.21.15.50:0/4088833665 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6624009420 con 0x7f6638068d80 2023-10-06T01:22:49.122 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:49.118+0000 7f6637fff700 1 --2- 172.21.15.50:0/4088833665 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6638068d80 0x7f663814bd90 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f6624013000 tx=0x7f6624017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:22:49.122 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:49.119+0000 7f6634ff9700 1 -- 172.21.15.50:0/4088833665 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f662401f070 con 0x7f6638068d80 2023-10-06T01:22:49.122 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:49.119+0000 7f6634ff9700 1 -- 172.21.15.50:0/4088833665 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f662400b9d0 con 0x7f6638068d80 2023-10-06T01:22:49.122 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:49.119+0000 7f663dd9d700 1 -- 172.21.15.50:0/4088833665 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6638169c70 con 0x7f6638068d80 2023-10-06T01:22:49.122 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:49.119+0000 7f6634ff9700 1 -- 172.21.15.50:0/4088833665 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6624025670 con 0x7f6638068d80 2023-10-06T01:22:49.122 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:49.119+0000 7f663dd9d700 1 -- 172.21.15.50:0/4088833665 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f663816a230 con 0x7f6638068d80 2023-10-06T01:22:49.123 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:49.120+0000 7f663dd9d700 1 -- 172.21.15.50:0/4088833665 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f663805f270 con 0x7f6638068d80 2023-10-06T01:22:49.123 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:49.121+0000 7f6634ff9700 1 -- 172.21.15.50:0/4088833665 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f6624023070 con 0x7f6638068d80 2023-10-06T01:22:49.124 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:49.122+0000 7f6634ff9700 1 --2- 172.21.15.50:0/4088833665 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f661c066f30 0x7f661c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:49.124 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:49.122+0000 7f6634ff9700 1 -- 172.21.15.50:0/4088833665 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5526+0+0 (secure 0 0 0) 0x7f6624085a50 con 0x7f6638068d80 2023-10-06T01:22:49.124 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:49.123+0000 7f663cd9b700 1 --2- 172.21.15.50:0/4088833665 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f661c066f30 0x7f661c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:49.124 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:49.123+0000 7f663cd9b700 1 --2- 172.21.15.50:0/4088833665 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f661c066f30 0x7f661c0693e0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f66380b2530 tx=0x7f662c009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:22:49.127 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:49.126+0000 7f6634ff9700 1 -- 172.21.15.50:0/4088833665 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f6624052cd0 con 0x7f6638068d80 2023-10-06T01:22:49.411 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:49.410+0000 7f663dd9d700 1 -- 172.21.15.50:0/4088833665 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f66380ca610 con 0x7f6638068d80 2023-10-06T01:22:49.412 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:49.411+0000 7f6634ff9700 1 -- 172.21.15.50:0/4088833665 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v2) v1 ==== 80+0+6645 (secure 0 0 0) 0x7f6624015090 con 0x7f6638068d80 2023-10-06T01:22:49.412 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-10-06T01:22:49.412 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2023-10-06T01:22:49.412 INFO:teuthology.orchestra.run.smithi050.stdout: "auth_dump": [ 2023-10-06T01:22:49.412 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-10-06T01:22:49.412 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "mds.a", 2023-10-06T01:22:49.412 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQDlYB9lud7pERAAvt2kBCO8ciGTgwElI1oEvQ==", 2023-10-06T01:22:49.413 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2023-10-06T01:22:49.413 INFO:teuthology.orchestra.run.smithi050.stdout: "mds": "allow", 2023-10-06T01:22:49.413 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow *", 2023-10-06T01:22:49.413 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow *", 2023-10-06T01:22:49.413 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2023-10-06T01:22:49.413 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-10-06T01:22:49.413 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-06T01:22:49.413 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-10-06T01:22:49.413 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "mds.b", 2023-10-06T01:22:49.413 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQDlYB9l81CaJxAAmSJ2iq7sgKOm6aQkweRUmw==", 2023-10-06T01:22:49.413 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2023-10-06T01:22:49.413 INFO:teuthology.orchestra.run.smithi050.stdout: "mds": "allow", 2023-10-06T01:22:49.414 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow *", 2023-10-06T01:22:49.414 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow *", 2023-10-06T01:22:49.414 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2023-10-06T01:22:49.414 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-10-06T01:22:49.414 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-06T01:22:49.414 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-10-06T01:22:49.414 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "mds.c", 2023-10-06T01:22:49.414 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQDlYB9lsQO7HBAA2ctu0JyuieydQEsnAdxe4g==", 2023-10-06T01:22:49.414 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2023-10-06T01:22:49.414 INFO:teuthology.orchestra.run.smithi050.stdout: "mds": "allow", 2023-10-06T01:22:49.414 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow *", 2023-10-06T01:22:49.415 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow *", 2023-10-06T01:22:49.415 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2023-10-06T01:22:49.415 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-10-06T01:22:49.415 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-06T01:22:49.415 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-10-06T01:22:49.415 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "mds.d", 2023-10-06T01:22:49.415 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQDlYB9lpaoGMhAA1smpLPyNHMFd8KB11WuEVw==", 2023-10-06T01:22:49.415 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2023-10-06T01:22:49.415 INFO:teuthology.orchestra.run.smithi050.stdout: "mds": "allow", 2023-10-06T01:22:49.415 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow *", 2023-10-06T01:22:49.416 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow *", 2023-10-06T01:22:49.416 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2023-10-06T01:22:49.416 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-10-06T01:22:49.416 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-06T01:22:49.416 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-10-06T01:22:49.416 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "osd.0", 2023-10-06T01:22:49.416 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQDnYB9lK/jfLhAAKoVEn64/qEG1jUKRSRf6Hw==", 2023-10-06T01:22:49.416 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2023-10-06T01:22:49.416 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow profile osd", 2023-10-06T01:22:49.416 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow profile osd", 2023-10-06T01:22:49.416 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2023-10-06T01:22:49.417 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-10-06T01:22:49.417 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-06T01:22:49.417 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-10-06T01:22:49.417 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "osd.1", 2023-10-06T01:22:49.417 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQDqYB9lpNe9MRAARwXOyWY1El1/QAebuns9Nw==", 2023-10-06T01:22:49.417 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2023-10-06T01:22:49.417 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow profile osd", 2023-10-06T01:22:49.417 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow profile osd", 2023-10-06T01:22:49.417 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2023-10-06T01:22:49.417 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-10-06T01:22:49.417 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-06T01:22:49.417 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-10-06T01:22:49.417 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "osd.2", 2023-10-06T01:22:49.418 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQDtYB9lW1ouNBAAFsxCFJ33SEJ2wD+LjheR1A==", 2023-10-06T01:22:49.418 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2023-10-06T01:22:49.418 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow profile osd", 2023-10-06T01:22:49.418 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow profile osd", 2023-10-06T01:22:49.418 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2023-10-06T01:22:49.418 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-10-06T01:22:49.418 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-06T01:22:49.418 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-10-06T01:22:49.418 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "osd.3", 2023-10-06T01:22:49.418 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQDwYB9lnAXNNxAA9hW5oDzBQRnW/EHS7qU6Eg==", 2023-10-06T01:22:49.418 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2023-10-06T01:22:49.418 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow profile osd", 2023-10-06T01:22:49.419 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow profile osd", 2023-10-06T01:22:49.419 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2023-10-06T01:22:49.419 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-10-06T01:22:49.419 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-06T01:22:49.419 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-10-06T01:22:49.419 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "osd.4", 2023-10-06T01:22:49.419 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQD3YB9lTV3LDBAA37KXA7yKc0LBZzMK3u6Myw==", 2023-10-06T01:22:49.419 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2023-10-06T01:22:49.419 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow profile osd", 2023-10-06T01:22:49.419 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow profile osd", 2023-10-06T01:22:49.419 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2023-10-06T01:22:49.419 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-10-06T01:22:49.419 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-06T01:22:49.420 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-10-06T01:22:49.420 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "osd.5", 2023-10-06T01:22:49.420 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQD6YB9lITBlEhAAFaNVu44B1CEWcPazSF071g==", 2023-10-06T01:22:49.420 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2023-10-06T01:22:49.420 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow profile osd", 2023-10-06T01:22:49.420 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow profile osd", 2023-10-06T01:22:49.420 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2023-10-06T01:22:49.420 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-10-06T01:22:49.420 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-06T01:22:49.420 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-10-06T01:22:49.420 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "osd.6", 2023-10-06T01:22:49.421 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQD9YB9lFqG3FBAAnzOc0e//w1hE2Qg+S3Z4Ew==", 2023-10-06T01:22:49.421 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2023-10-06T01:22:49.421 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow profile osd", 2023-10-06T01:22:49.421 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow profile osd", 2023-10-06T01:22:49.421 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2023-10-06T01:22:49.421 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-10-06T01:22:49.421 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-06T01:22:49.421 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-10-06T01:22:49.421 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "osd.7", 2023-10-06T01:22:49.421 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQAAYR9lY5wzFxAAXt+cjEmGy77K89tTEamVrA==", 2023-10-06T01:22:49.421 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2023-10-06T01:22:49.421 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow profile osd", 2023-10-06T01:22:49.422 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow profile osd", 2023-10-06T01:22:49.422 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2023-10-06T01:22:49.422 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-10-06T01:22:49.422 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-06T01:22:49.422 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-10-06T01:22:49.422 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "client.0", 2023-10-06T01:22:49.422 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQDlYB9l+CUhOxAAIGNbzfc234/z9JKUyQ2WxA==", 2023-10-06T01:22:49.422 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2023-10-06T01:22:49.422 INFO:teuthology.orchestra.run.smithi050.stdout: "mds": "allow", 2023-10-06T01:22:49.422 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow r", 2023-10-06T01:22:49.422 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow rw", 2023-10-06T01:22:49.422 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow rwx" 2023-10-06T01:22:49.422 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-10-06T01:22:49.423 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-06T01:22:49.423 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-10-06T01:22:49.423 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "client.1", 2023-10-06T01:22:49.423 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQDmYB9l+5xRDRAALxAmTNAGNADrWoYVLH7/DA==", 2023-10-06T01:22:49.423 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2023-10-06T01:22:49.423 INFO:teuthology.orchestra.run.smithi050.stdout: "mds": "allow", 2023-10-06T01:22:49.423 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow r", 2023-10-06T01:22:49.423 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow rw", 2023-10-06T01:22:49.423 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow rwx" 2023-10-06T01:22:49.423 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-10-06T01:22:49.423 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-06T01:22:49.423 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-10-06T01:22:49.424 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "client.2", 2023-10-06T01:22:49.424 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQDmYB9laX1zBhAAqB5vZ65xv4Gw7nUDBK6z/w==", 2023-10-06T01:22:49.424 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2023-10-06T01:22:49.424 INFO:teuthology.orchestra.run.smithi050.stdout: "mds": "allow", 2023-10-06T01:22:49.424 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow r", 2023-10-06T01:22:49.424 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow rw", 2023-10-06T01:22:49.424 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow rwx" 2023-10-06T01:22:49.424 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-10-06T01:22:49.424 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-06T01:22:49.424 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-10-06T01:22:49.424 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "client.3", 2023-10-06T01:22:49.424 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQDmYB9lazulFRAAE410DH6LzPVx1hN7wkjoTA==", 2023-10-06T01:22:49.424 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2023-10-06T01:22:49.425 INFO:teuthology.orchestra.run.smithi050.stdout: "mds": "allow", 2023-10-06T01:22:49.425 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow r", 2023-10-06T01:22:49.425 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow rw", 2023-10-06T01:22:49.425 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow rwx" 2023-10-06T01:22:49.425 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-10-06T01:22:49.425 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-06T01:22:49.425 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-10-06T01:22:49.425 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "client.admin", 2023-10-06T01:22:49.425 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQDkYB9l/Gj8GhAAnzbyNWlMyOV84o4C27Jajg==", 2023-10-06T01:22:49.425 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2023-10-06T01:22:49.425 INFO:teuthology.orchestra.run.smithi050.stdout: "mds": "allow *", 2023-10-06T01:22:49.425 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow *", 2023-10-06T01:22:49.426 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow *", 2023-10-06T01:22:49.426 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2023-10-06T01:22:49.426 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-10-06T01:22:49.426 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-06T01:22:49.426 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-10-06T01:22:49.426 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "client.bootstrap-mds", 2023-10-06T01:22:49.426 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQAMYR9l2yl0MRAAOT20RS2l7LZaSiy+dRWDRA==", 2023-10-06T01:22:49.426 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2023-10-06T01:22:49.426 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow profile bootstrap-mds" 2023-10-06T01:22:49.426 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-10-06T01:22:49.426 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-06T01:22:49.426 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-10-06T01:22:49.427 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "client.bootstrap-mgr", 2023-10-06T01:22:49.427 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQAMYR9lIzR0MRAAgZ4QmIHKfBBA1Jp03flpmQ==", 2023-10-06T01:22:49.427 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2023-10-06T01:22:49.427 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow profile bootstrap-mgr" 2023-10-06T01:22:49.427 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-10-06T01:22:49.427 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-06T01:22:49.427 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-10-06T01:22:49.427 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "client.bootstrap-osd", 2023-10-06T01:22:49.427 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQAMYR9lbj50MRAAAl38/kImtEv4UcEoEPYwxw==", 2023-10-06T01:22:49.427 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2023-10-06T01:22:49.427 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow profile bootstrap-osd" 2023-10-06T01:22:49.427 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-10-06T01:22:49.427 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-06T01:22:49.428 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-10-06T01:22:49.428 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "client.bootstrap-rbd", 2023-10-06T01:22:49.428 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQAMYR9lY0d0MRAAenRcDAmClJXJplRfw55QBg==", 2023-10-06T01:22:49.428 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2023-10-06T01:22:49.428 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow profile bootstrap-rbd" 2023-10-06T01:22:49.428 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-10-06T01:22:49.428 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-06T01:22:49.428 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-10-06T01:22:49.428 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "client.bootstrap-rbd-mirror", 2023-10-06T01:22:49.428 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQAMYR9ld1B0MRAAR7y5rHJycYYLyU30vieEGA==", 2023-10-06T01:22:49.428 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2023-10-06T01:22:49.428 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow profile bootstrap-rbd-mirror" 2023-10-06T01:22:49.428 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-10-06T01:22:49.429 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-06T01:22:49.429 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-10-06T01:22:49.429 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "client.bootstrap-rgw", 2023-10-06T01:22:49.429 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQAMYR9lHll0MRAAnwNruDD1405B7GUV8jMA2Q==", 2023-10-06T01:22:49.429 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2023-10-06T01:22:49.429 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow profile bootstrap-rgw" 2023-10-06T01:22:49.429 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-10-06T01:22:49.429 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-06T01:22:49.429 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-10-06T01:22:49.429 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "mgr.x", 2023-10-06T01:22:49.429 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQDlYB9lOr69ChAAvDbezvRT4bWhgdQsKkDe2g==", 2023-10-06T01:22:49.430 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2023-10-06T01:22:49.430 INFO:teuthology.orchestra.run.smithi050.stdout: "mds": "allow *", 2023-10-06T01:22:49.430 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow profile mgr", 2023-10-06T01:22:49.430 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2023-10-06T01:22:49.430 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-10-06T01:22:49.430 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-06T01:22:49.430 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-10-06T01:22:49.430 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "mgr.y", 2023-10-06T01:22:49.430 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQDlYB9l8smaAxAAZxC8BlF22lsEF8C8fZrZGw==", 2023-10-06T01:22:49.430 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2023-10-06T01:22:49.430 INFO:teuthology.orchestra.run.smithi050.stdout: "mds": "allow *", 2023-10-06T01:22:49.430 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow profile mgr", 2023-10-06T01:22:49.431 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2023-10-06T01:22:49.431 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-10-06T01:22:49.431 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-10-06T01:22:49.431 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-10-06T01:22:49.431 INFO:teuthology.orchestra.run.smithi050.stdout:} 2023-10-06T01:22:49.433 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:49.413+0000 7f663dd9d700 1 -- 172.21.15.50:0/4088833665 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f661c066f30 msgr2=0x7f661c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:49.433 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:49.413+0000 7f663dd9d700 1 --2- 172.21.15.50:0/4088833665 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f661c066f30 0x7f661c0693e0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f66380b2530 tx=0x7f662c009040 comp rx=0 tx=0).stop 2023-10-06T01:22:49.433 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:49.413+0000 7f663dd9d700 1 -- 172.21.15.50:0/4088833665 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6638068d80 msgr2=0x7f663814bd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:49.433 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:49.413+0000 7f663dd9d700 1 --2- 172.21.15.50:0/4088833665 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6638068d80 0x7f663814bd90 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f6624013000 tx=0x7f6624017000 comp rx=0 tx=0).stop 2023-10-06T01:22:49.433 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:49.413+0000 7f663dd9d700 1 -- 172.21.15.50:0/4088833665 shutdown_connections 2023-10-06T01:22:49.433 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:49.413+0000 7f663dd9d700 1 --2- 172.21.15.50:0/4088833665 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f66380cc0d0 0x7f66380675f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:49.433 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:49.413+0000 7f663dd9d700 1 --2- 172.21.15.50:0/4088833665 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f661c066f30 0x7f661c0693e0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:49.433 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:49.413+0000 7f663dd9d700 1 --2- 172.21.15.50:0/4088833665 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f66380689b0 0x7f66380c3770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:49.433 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:49.413+0000 7f663dd9d700 1 --2- 172.21.15.50:0/4088833665 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6638068d80 0x7f663814bd90 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:49.433 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:49.413+0000 7f663dd9d700 1 -- 172.21.15.50:0/4088833665 >> 172.21.15.50:0/4088833665 conn(0x7f66380cd230 msgr2=0x7f6638069930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:22:49.434 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:49.414+0000 7f663dd9d700 1 -- 172.21.15.50:0/4088833665 shutdown_connections 2023-10-06T01:22:49.434 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:49.414+0000 7f663dd9d700 1 -- 172.21.15.50:0/4088833665 wait complete. 2023-10-06T01:22:49.434 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mds 2023-10-06T01:22:49.622 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:49.621+0000 7fb8eed9d700 1 Processor -- start 2023-10-06T01:22:49.622 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:49.621+0000 7fb8eed9d700 1 -- start start 2023-10-06T01:22:49.623 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:49.622+0000 7fb8eed9d700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fb8e8159480 0x7fb8e80b30d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:49.623 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:49.622+0000 7fb8eed9d700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb8e80b3610 0x7fb8e80cbc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:49.623 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:49.622+0000 7fb8eed9d700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb8e80cb7e0 con 0x7fb8e80cc1b0 2023-10-06T01:22:49.623 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:49.622+0000 7fb8eed9d700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb8e80b08a0 con 0x7fb8e8159480 2023-10-06T01:22:49.623 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:49.622+0000 7fb8eed9d700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8e80cb190 con 0x7fb8e80b3610 2023-10-06T01:22:49.625 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:49.623+0000 7fb8ed59a700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb8e80b3610 0x7fb8e80cbc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:49.625 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:49.623+0000 7fb8edd9b700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fb8e8159480 0x7fb8e80b30d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:49.625 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:49.623+0000 7fb8ee59c700 1 --1- >> v1:172.21.15.155:6789/0 conn(0x7fb8e80cc1b0 0x7fb8e80b2140 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.155:6789/0 says I am v1:172.21.15.50:50778/0 (socket says 172.21.15.50:50778) 2023-10-06T01:22:49.625 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:49.623+0000 7fb8ee59c700 1 -- 172.21.15.50:0/152124500 learned_addr learned my addr 172.21.15.50:0/152124500 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-10-06T01:22:49.625 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:49.623+0000 7fb8edd9b700 1 -- 172.21.15.50:0/152124500 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb8e80b3610 msgr2=0x7fb8e80cbc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:22:49.625 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:49.623+0000 7fb8edd9b700 1 --2- 172.21.15.50:0/152124500 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb8e80b3610 0x7fb8e80cbc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:49.625 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:49.623+0000 7fb8edd9b700 1 -- 172.21.15.50:0/152124500 >> v1:172.21.15.155:6789/0 conn(0x7fb8e80cc1b0 legacy=0x7fb8e80b2140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:49.625 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:49.623+0000 7fb8edd9b700 1 -- 172.21.15.50:0/152124500 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8e80cb470 con 0x7fb8e8159480 2023-10-06T01:22:49.625 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:49.623+0000 7fb8ed59a700 1 --2- 172.21.15.50:0/152124500 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb8e80b3610 0x7fb8e80cbc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T01:22:49.625 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:49.623+0000 7fb8ecd99700 1 -- 172.21.15.50:0/152124500 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3753441385 0 0) 0x7fb8e80cb7e0 con 0x7fb8e80cc1b0 2023-10-06T01:22:49.625 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:49.624+0000 7fb8edd9b700 1 --2- 172.21.15.50:0/152124500 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb8e8159480 0x7fb8e80b30d0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fb8e40098e0 tx=0x7fb8e40091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c2cd06a139aba5d8 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:22:49.626 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:49.624+0000 7fb8ecd99700 1 -- 172.21.15.50:0/152124500 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8e400b640 con 0x7fb8e8159480 2023-10-06T01:22:49.626 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:49.624+0000 7fb8ecd99700 1 -- 172.21.15.50:0/152124500 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8e400b7a0 con 0x7fb8e8159480 2023-10-06T01:22:49.626 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:49.624+0000 7fb8ecd99700 1 -- 172.21.15.50:0/152124500 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8e400bb40 con 0x7fb8e8159480 2023-10-06T01:22:49.627 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:49.624+0000 7fb8eed9d700 1 -- 172.21.15.50:0/152124500 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb8e8159480 msgr2=0x7fb8e80b30d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:49.627 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:49.624+0000 7fb8eed9d700 1 --2- 172.21.15.50:0/152124500 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb8e8159480 0x7fb8e80b30d0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fb8e40098e0 tx=0x7fb8e40091a0 comp rx=0 tx=0).stop 2023-10-06T01:22:49.627 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:49.625+0000 7fb8eed9d700 1 -- 172.21.15.50:0/152124500 shutdown_connections 2023-10-06T01:22:49.627 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:49.625+0000 7fb8eed9d700 1 --2- 172.21.15.50:0/152124500 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb8e8159480 0x7fb8e80b30d0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:49.627 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:49.625+0000 7fb8eed9d700 1 --2- 172.21.15.50:0/152124500 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb8e80b3610 0x7fb8e80cbc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:49.627 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:49.625+0000 7fb8eed9d700 1 -- 172.21.15.50:0/152124500 >> 172.21.15.50:0/152124500 conn(0x7fb8e806ed20 msgr2=0x7fb8e806f120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:22:49.627 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:49.625+0000 7fb8eed9d700 1 -- 172.21.15.50:0/152124500 shutdown_connections 2023-10-06T01:22:49.627 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:49.625+0000 7fb8eed9d700 1 -- 172.21.15.50:0/152124500 wait complete. 2023-10-06T01:22:49.628 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:49.626+0000 7fb8eed9d700 1 Processor -- start 2023-10-06T01:22:49.628 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:49.626+0000 7fb8eed9d700 1 -- start start 2023-10-06T01:22:49.630 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:49.627+0000 7fb8eed9d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb8e80b3610 0x7fb8e816a420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:49.630 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:49.627+0000 7fb8eed9d700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb8e80cc1b0 0x7fb8e8159af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:49.630 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:49.627+0000 7fb8eed9d700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb8e8159480 0x7fb8e80d0100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:49.630 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:49.627+0000 7fb8eed9d700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8e8169f90 con 0x7fb8e80b3610 2023-10-06T01:22:49.630 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:49.627+0000 7fb8eed9d700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8e815a5b0 con 0x7fb8e80cc1b0 2023-10-06T01:22:49.630 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:49.627+0000 7fb8eed9d700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8e815a890 con 0x7fb8e8159480 2023-10-06T01:22:49.630 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:49.627+0000 7fb8edd9b700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb8e80b3610 0x7fb8e816a420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:49.630 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:49.627+0000 7fb8edd9b700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb8e80b3610 0x7fb8e816a420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:52656/0 (socket says 172.21.15.50:52656) 2023-10-06T01:22:49.630 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:49.627+0000 7fb8edd9b700 1 -- 172.21.15.50:0/2026948301 learned_addr learned my addr 172.21.15.50:0/2026948301 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-06T01:22:49.631 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:49.628+0000 7fb8ee59c700 1 --2- 172.21.15.50:0/2026948301 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb8e8159480 0x7fb8e80d0100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:49.631 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:49.628+0000 7fb8ed59a700 1 --2- 172.21.15.50:0/2026948301 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb8e80cc1b0 0x7fb8e8159af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:49.631 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:49.628+0000 7fb8edd9b700 1 -- 172.21.15.50:0/2026948301 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb8e8159480 msgr2=0x7fb8e80d0100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:49.631 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:49.628+0000 7fb8edd9b700 1 --2- 172.21.15.50:0/2026948301 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb8e8159480 0x7fb8e80d0100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:49.631 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:49.628+0000 7fb8edd9b700 1 -- 172.21.15.50:0/2026948301 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb8e80cc1b0 msgr2=0x7fb8e8159af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:49.631 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:49.628+0000 7fb8edd9b700 1 --2- 172.21.15.50:0/2026948301 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb8e80cc1b0 0x7fb8e8159af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:49.631 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:49.628+0000 7fb8edd9b700 1 -- 172.21.15.50:0/2026948301 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8d8009420 con 0x7fb8e80b3610 2023-10-06T01:22:49.632 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:49.628+0000 7fb8edd9b700 1 --2- 172.21.15.50:0/2026948301 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb8e80b3610 0x7fb8e816a420 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7fb8e8069190 tx=0x7fb8e4017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:22:49.633 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:49.628+0000 7fb8ddffb700 1 -- 172.21.15.50:0/2026948301 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8e400bb20 con 0x7fb8e80b3610 2023-10-06T01:22:49.633 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:49.629+0000 7fb8ddffb700 1 -- 172.21.15.50:0/2026948301 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8e4000c90 con 0x7fb8e80b3610 2023-10-06T01:22:49.633 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:49.629+0000 7fb8eed9d700 1 -- 172.21.15.50:0/2026948301 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb8e4009420 con 0x7fb8e80b3610 2023-10-06T01:22:49.633 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:49.629+0000 7fb8ddffb700 1 -- 172.21.15.50:0/2026948301 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8e4011630 con 0x7fb8e80b3610 2023-10-06T01:22:49.633 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:49.629+0000 7fb8eed9d700 1 -- 172.21.15.50:0/2026948301 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb8e8169900 con 0x7fb8e80b3610 2023-10-06T01:22:49.634 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:49.630+0000 7fb8eed9d700 1 -- 172.21.15.50:0/2026948301 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb8e80d12a0 con 0x7fb8e80b3610 2023-10-06T01:22:49.634 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:49.630+0000 7fb8ddffb700 1 -- 172.21.15.50:0/2026948301 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fb8e40119a0 con 0x7fb8e80b3610 2023-10-06T01:22:49.634 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:49.631+0000 7fb8ddffb700 1 --2- 172.21.15.50:0/2026948301 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7fb8cc066f30 0x7fb8cc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:49.634 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:49.631+0000 7fb8ddffb700 1 -- 172.21.15.50:0/2026948301 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5526+0+0 (secure 0 0 0) 0x7fb8e4085770 con 0x7fb8e80b3610 2023-10-06T01:22:49.634 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:49.632+0000 7fb8ed59a700 1 --2- 172.21.15.50:0/2026948301 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7fb8cc066f30 0x7fb8cc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:49.635 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:49.632+0000 7fb8ed59a700 1 --2- 172.21.15.50:0/2026948301 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7fb8cc066f30 0x7fb8cc0693e0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fb8e80c7240 tx=0x7fb8d80091a0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:22:49.636 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:49.635+0000 7fb8ddffb700 1 -- 172.21.15.50:0/2026948301 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb8e40529f0 con 0x7fb8e80b3610 2023-10-06T01:22:49.922 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:49.921+0000 7fb8eed9d700 1 -- 172.21.15.50:0/2026948301 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mds"} v 0) v1 -- 0x7fb8e816a270 con 0x7fb8e80b3610 2023-10-06T01:22:49.925 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:49.925+0000 7fb8ddffb700 1 -- 172.21.15.50:0/2026948301 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mds"}]=0 v3) v1 ==== 90+0+0 (secure 0 0 0) 0x7fb8e4056010 con 0x7fb8e80b3610 2023-10-06T01:22:49.929 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:49.927+0000 7fb8eed9d700 1 -- 172.21.15.50:0/2026948301 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7fb8cc066f30 msgr2=0x7fb8cc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:49.929 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:49.927+0000 7fb8eed9d700 1 --2- 172.21.15.50:0/2026948301 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7fb8cc066f30 0x7fb8cc0693e0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fb8e80c7240 tx=0x7fb8d80091a0 comp rx=0 tx=0).stop 2023-10-06T01:22:49.929 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:49.927+0000 7fb8eed9d700 1 -- 172.21.15.50:0/2026948301 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb8e80b3610 msgr2=0x7fb8e816a420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:49.929 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:49.927+0000 7fb8eed9d700 1 --2- 172.21.15.50:0/2026948301 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb8e80b3610 0x7fb8e816a420 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7fb8e8069190 tx=0x7fb8e4017000 comp rx=0 tx=0).stop 2023-10-06T01:22:49.929 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:49.927+0000 7fb8eed9d700 1 -- 172.21.15.50:0/2026948301 shutdown_connections 2023-10-06T01:22:49.929 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:49.927+0000 7fb8eed9d700 1 --2- 172.21.15.50:0/2026948301 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb8e8159480 0x7fb8e80d0100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:49.929 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:49.927+0000 7fb8eed9d700 1 --2- 172.21.15.50:0/2026948301 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb8e80b3610 0x7fb8e816a420 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:49.929 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:49.927+0000 7fb8eed9d700 1 --2- 172.21.15.50:0/2026948301 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7fb8cc066f30 0x7fb8cc0693e0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:49.929 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:49.927+0000 7fb8eed9d700 1 --2- 172.21.15.50:0/2026948301 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb8e80cc1b0 0x7fb8e8159af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:49.929 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:49.927+0000 7fb8eed9d700 1 -- 172.21.15.50:0/2026948301 >> 172.21.15.50:0/2026948301 conn(0x7fb8e806ed20 msgr2=0x7fb8e8155220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:22:49.929 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:49.927+0000 7fb8eed9d700 1 -- 172.21.15.50:0/2026948301 shutdown_connections 2023-10-06T01:22:49.930 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:49.927+0000 7fb8eed9d700 1 -- 172.21.15.50:0/2026948301 wait complete. 2023-10-06T01:22:49.945 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mgr 2023-10-06T01:22:50.134 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:50.132+0000 7f30bbfff700 1 Processor -- start 2023-10-06T01:22:50.134 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:50.132+0000 7f30bbfff700 1 -- start start 2023-10-06T01:22:50.138 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:50.134+0000 7f30bbfff700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f30bc153e40 0x7f30bc06df90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:50.139 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:50.134+0000 7f30bbfff700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f30bc06a9a0 0x7f30bc06e4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:50.139 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:50.134+0000 7f30bbfff700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f30bc0c9d00 con 0x7f30bc06a5d0 2023-10-06T01:22:50.139 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:50.134+0000 7f30bbfff700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f30bc06f5a0 con 0x7f30bc06a9a0 2023-10-06T01:22:50.139 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:50.134+0000 7f30bbfff700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f30bc0c6750 con 0x7f30bc153e40 2023-10-06T01:22:50.139 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:50.134+0000 7f30bb7fe700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f30bc06a9a0 0x7f30bc06e4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:50.139 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:50.134+0000 7f30bb7fe700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f30bc06a9a0 0x7f30bc06e4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:52660/0 (socket says 172.21.15.50:52660) 2023-10-06T01:22:50.139 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:50.134+0000 7f30bb7fe700 1 -- 172.21.15.50:0/2087345958 learned_addr learned my addr 172.21.15.50:0/2087345958 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-06T01:22:50.139 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:50.134+0000 7f30ba7fc700 1 --2- 172.21.15.50:0/2087345958 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f30bc153e40 0x7f30bc06df90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:50.140 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:50.134+0000 7f30bb7fe700 1 -- 172.21.15.50:0/2087345958 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f30bc153e40 msgr2=0x7f30bc06df90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:22:50.140 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:50.134+0000 7f30bb7fe700 1 --2- 172.21.15.50:0/2087345958 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f30bc153e40 0x7f30bc06df90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:50.140 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:50.134+0000 7f30bb7fe700 1 -- 172.21.15.50:0/2087345958 >> v1:172.21.15.155:6789/0 conn(0x7f30bc06a5d0 legacy=0x7f30bc153730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:50.140 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:50.134+0000 7f30bb7fe700 1 -- 172.21.15.50:0/2087345958 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30bc06ed00 con 0x7f30bc06a9a0 2023-10-06T01:22:50.140 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:50.134+0000 7f30ba7fc700 1 --2- 172.21.15.50:0/2087345958 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f30bc153e40 0x7f30bc06df90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T01:22:50.140 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:50.135+0000 7f30bb7fe700 1 --2- 172.21.15.50:0/2087345958 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f30bc06a9a0 0x7f30bc06e4d0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f30b4009f80 tx=0x7f30b4009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f371b0218c025d6 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:22:50.141 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:50.135+0000 7f30b9ffb700 1 -- 172.21.15.50:0/2087345958 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30b400e070 con 0x7f30bc06a9a0 2023-10-06T01:22:50.141 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:50.135+0000 7f30b9ffb700 1 -- 172.21.15.50:0/2087345958 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f30b400bab0 con 0x7f30bc06a9a0 2023-10-06T01:22:50.141 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:50.135+0000 7f30b9ffb700 1 -- 172.21.15.50:0/2087345958 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30b40092e0 con 0x7f30bc06a9a0 2023-10-06T01:22:50.141 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:50.135+0000 7f30bbfff700 1 -- 172.21.15.50:0/2087345958 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f30bc06a9a0 msgr2=0x7f30bc06e4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:50.141 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:50.135+0000 7f30bbfff700 1 --2- 172.21.15.50:0/2087345958 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f30bc06a9a0 0x7f30bc06e4d0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f30b4009f80 tx=0x7f30b4009840 comp rx=0 tx=0).stop 2023-10-06T01:22:50.141 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:50.136+0000 7f30bbfff700 1 -- 172.21.15.50:0/2087345958 shutdown_connections 2023-10-06T01:22:50.142 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:50.136+0000 7f30bbfff700 1 --2- 172.21.15.50:0/2087345958 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f30bc06a9a0 0x7f30bc06e4d0 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:50.142 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:50.136+0000 7f30bbfff700 1 --2- 172.21.15.50:0/2087345958 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f30bc153e40 0x7f30bc06df90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:50.142 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:50.136+0000 7f30bbfff700 1 -- 172.21.15.50:0/2087345958 >> 172.21.15.50:0/2087345958 conn(0x7f30bc0680c0 msgr2=0x7f30bc0cbf00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:22:50.142 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:50.136+0000 7f30bbfff700 1 -- 172.21.15.50:0/2087345958 shutdown_connections 2023-10-06T01:22:50.142 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:50.136+0000 7f30bbfff700 1 -- 172.21.15.50:0/2087345958 wait complete. 2023-10-06T01:22:50.142 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:50.137+0000 7f30bbfff700 1 Processor -- start 2023-10-06T01:22:50.142 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:50.137+0000 7f30bbfff700 1 -- start start 2023-10-06T01:22:50.145 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:50.138+0000 7f30bbfff700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f30bc06a5d0 0x7f30bc0cb530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:50.145 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:50.138+0000 7f30bbfff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f30bc06a9a0 0x7f30bc13dae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:50.145 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:50.138+0000 7f30bbfff700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f30bc153e40 0x7f30bc0ca190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:50.145 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:50.138+0000 7f30bbfff700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30bc0c0ca0 con 0x7f30bc06a9a0 2023-10-06T01:22:50.145 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:50.138+0000 7f30bbfff700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30bc0c0f40 con 0x7f30bc153e40 2023-10-06T01:22:50.146 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:50.138+0000 7f30bbfff700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f30bc13e020 con 0x7f30bc06a5d0 2023-10-06T01:22:50.146 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:50.138+0000 7f30ba7fc700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f30bc06a9a0 0x7f30bc13dae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:50.146 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:50.138+0000 7f30ba7fc700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f30bc06a9a0 0x7f30bc13dae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:52662/0 (socket says 172.21.15.50:52662) 2023-10-06T01:22:50.146 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:50.138+0000 7f30ba7fc700 1 -- 172.21.15.50:0/1847425061 learned_addr learned my addr 172.21.15.50:0/1847425061 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-06T01:22:50.146 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:50.139+0000 7f30bb7fe700 1 --2- 172.21.15.50:0/1847425061 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f30bc153e40 0x7f30bc0ca190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:50.147 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:50.139+0000 7f30baffd700 1 --2- 172.21.15.50:0/1847425061 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f30bc06a5d0 0x7f30bc0cb530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:50.147 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:50.139+0000 7f30ba7fc700 1 -- 172.21.15.50:0/1847425061 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f30bc06a5d0 msgr2=0x7f30bc0cb530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:50.147 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:50.139+0000 7f30ba7fc700 1 --2- 172.21.15.50:0/1847425061 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f30bc06a5d0 0x7f30bc0cb530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:50.147 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:50.139+0000 7f30ba7fc700 1 -- 172.21.15.50:0/1847425061 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f30bc153e40 msgr2=0x7f30bc0ca190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:50.147 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:50.139+0000 7f30ba7fc700 1 --2- 172.21.15.50:0/1847425061 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f30bc153e40 0x7f30bc0ca190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:50.147 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:50.139+0000 7f30ba7fc700 1 -- 172.21.15.50:0/1847425061 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30b4009ae0 con 0x7f30bc06a9a0 2023-10-06T01:22:50.147 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:50.139+0000 7f30ba7fc700 1 --2- 172.21.15.50:0/1847425061 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f30bc06a9a0 0x7f30bc13dae0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f30b000d810 tx=0x7f30b0008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:22:50.147 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:50.139+0000 7f30a2ffd700 1 -- 172.21.15.50:0/1847425061 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30b00125f0 con 0x7f30bc06a9a0 2023-10-06T01:22:50.148 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:50.139+0000 7f30a2ffd700 1 -- 172.21.15.50:0/1847425061 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f30b0012750 con 0x7f30bc06a9a0 2023-10-06T01:22:50.148 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:50.139+0000 7f30a2ffd700 1 -- 172.21.15.50:0/1847425061 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30b0012b10 con 0x7f30bc06a9a0 2023-10-06T01:22:50.148 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:50.139+0000 7f30bbfff700 1 -- 172.21.15.50:0/1847425061 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f30bc146200 con 0x7f30bc06a9a0 2023-10-06T01:22:50.148 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:50.140+0000 7f30bbfff700 1 -- 172.21.15.50:0/1847425061 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f30bc16b900 con 0x7f30bc06a9a0 2023-10-06T01:22:50.148 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:50.140+0000 7f30bbfff700 1 -- 172.21.15.50:0/1847425061 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f30bc0c10f0 con 0x7f30bc06a9a0 2023-10-06T01:22:50.148 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:50.141+0000 7f30a2ffd700 1 -- 172.21.15.50:0/1847425061 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f30b001e460 con 0x7f30bc06a9a0 2023-10-06T01:22:50.148 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:50.142+0000 7f30a2ffd700 1 --2- 172.21.15.50:0/1847425061 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f30a8066f30 0x7f30a80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:50.148 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:50.143+0000 7f30a2ffd700 1 -- 172.21.15.50:0/1847425061 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5526+0+0 (secure 0 0 0) 0x7f30b0084b80 con 0x7f30bc06a9a0 2023-10-06T01:22:50.148 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:50.143+0000 7f30baffd700 1 --2- 172.21.15.50:0/1847425061 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f30a8066f30 0x7f30a80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:50.148 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:50.144+0000 7f30baffd700 1 --2- 172.21.15.50:0/1847425061 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f30a8066f30 0x7f30a80693e0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f30ac003860 tx=0x7f30ac009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:22:50.149 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:50.146+0000 7f30a2ffd700 1 -- 172.21.15.50:0/1847425061 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f30bc0c10f0 con 0x7f30bc06a9a0 2023-10-06T01:22:50.425 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:50.424+0000 7f30bbfff700 1 -- 172.21.15.50:0/1847425061 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mgr"} v 0) v1 -- 0x7f30bc0c10f0 con 0x7f30bc06a9a0 2023-10-06T01:22:50.429 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:50.428+0000 7f30a2ffd700 1 -- 172.21.15.50:0/1847425061 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mgr"}]=0 v4) v1 ==== 90+0+0 (secure 0 0 0) 0x7f30bc0c10f0 con 0x7f30bc06a9a0 2023-10-06T01:22:50.432 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:50.431+0000 7f30bbfff700 1 -- 172.21.15.50:0/1847425061 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f30a8066f30 msgr2=0x7f30a80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:50.432 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:50.431+0000 7f30bbfff700 1 --2- 172.21.15.50:0/1847425061 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f30a8066f30 0x7f30a80693e0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f30ac003860 tx=0x7f30ac009040 comp rx=0 tx=0).stop 2023-10-06T01:22:50.432 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:50.431+0000 7f30bbfff700 1 -- 172.21.15.50:0/1847425061 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f30bc06a9a0 msgr2=0x7f30bc13dae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:50.432 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:50.431+0000 7f30bbfff700 1 --2- 172.21.15.50:0/1847425061 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f30bc06a9a0 0x7f30bc13dae0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f30b000d810 tx=0x7f30b0008040 comp rx=0 tx=0).stop 2023-10-06T01:22:50.432 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:50.431+0000 7f30bbfff700 1 -- 172.21.15.50:0/1847425061 shutdown_connections 2023-10-06T01:22:50.432 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:50.431+0000 7f30bbfff700 1 --2- 172.21.15.50:0/1847425061 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f30a8066f30 0x7f30a80693e0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:50.432 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:50.431+0000 7f30bbfff700 1 --2- 172.21.15.50:0/1847425061 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f30bc153e40 0x7f30bc0ca190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:50.432 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:50.431+0000 7f30bbfff700 1 --2- 172.21.15.50:0/1847425061 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f30bc06a5d0 0x7f30bc0cb530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:50.433 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:50.431+0000 7f30bbfff700 1 --2- 172.21.15.50:0/1847425061 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f30bc06a9a0 0x7f30bc13dae0 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:50.433 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:50.431+0000 7f30bbfff700 1 -- 172.21.15.50:0/1847425061 >> 172.21.15.50:0/1847425061 conn(0x7f30bc0680c0 msgr2=0x7f30bc155950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:22:50.433 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:50.431+0000 7f30bbfff700 1 -- 172.21.15.50:0/1847425061 shutdown_connections 2023-10-06T01:22:50.433 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:50.431+0000 7f30bbfff700 1 -- 172.21.15.50:0/1847425061 wait complete. 2023-10-06T01:22:50.449 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-osd 2023-10-06T01:22:50.637 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:50.636+0000 7f532959d700 1 Processor -- start 2023-10-06T01:22:50.637 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:50.636+0000 7f532959d700 1 -- start start 2023-10-06T01:22:50.639 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:50.637+0000 7f532959d700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f53240689b0 0x7f532415d9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:50.639 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:50.637+0000 7f532959d700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f53240cc0d0 0x7f53240c6d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:50.639 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:50.637+0000 7f532959d700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f532415a860 con 0x7f5324068d80 2023-10-06T01:22:50.639 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:50.637+0000 7f532959d700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f53240cac60 con 0x7f53240cc0d0 2023-10-06T01:22:50.639 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:50.637+0000 7f532959d700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53240c7400 con 0x7f53240689b0 2023-10-06T01:22:50.639 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:50.638+0000 7f5328d9c700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f53240cc0d0 0x7f53240c6d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:50.640 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:50.638+0000 7f5328d9c700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f53240cc0d0 0x7f53240c6d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:52666/0 (socket says 172.21.15.50:52666) 2023-10-06T01:22:50.640 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:50.638+0000 7f5328d9c700 1 -- 172.21.15.50:0/4089545561 learned_addr learned my addr 172.21.15.50:0/4089545561 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-06T01:22:50.640 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:50.638+0000 7f5323fff700 1 --2- 172.21.15.50:0/4089545561 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f53240689b0 0x7f532415d9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:50.640 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:50.638+0000 7f5328d9c700 1 -- 172.21.15.50:0/4089545561 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f53240689b0 msgr2=0x7f532415d9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:22:50.640 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:50.638+0000 7f5328d9c700 1 --2- 172.21.15.50:0/4089545561 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f53240689b0 0x7f532415d9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:50.640 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:50.638+0000 7f5328d9c700 1 -- 172.21.15.50:0/4089545561 >> v1:172.21.15.155:6789/0 conn(0x7f5324068d80 legacy=0x7f53240cb9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:22:50.640 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:50.638+0000 7f5328d9c700 1 -- 172.21.15.50:0/4089545561 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53240ca330 con 0x7f53240cc0d0 2023-10-06T01:22:50.640 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:50.638+0000 7f5328d9c700 1 --2- 172.21.15.50:0/4089545561 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f53240cc0d0 0x7f53240c6d00 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f531c009f20 tx=0x7f531c009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aeaa65e8af6a2f0f server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:22:50.641 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:50.639+0000 7f5322ffd700 1 -- 172.21.15.50:0/4089545561 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f531c00e070 con 0x7f53240cc0d0 2023-10-06T01:22:50.642 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:50.639+0000 7f5322ffd700 1 -- 172.21.15.50:0/4089545561 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f531c00ba40 con 0x7f53240cc0d0 2023-10-06T01:22:50.642 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:50.639+0000 7f5322ffd700 1 -- 172.21.15.50:0/4089545561 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f531c0092e0 con 0x7f53240cc0d0 2023-10-06T01:22:50.642 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:50.639+0000 7f532959d700 1 -- 172.21.15.50:0/4089545561 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f53240cc0d0 msgr2=0x7f53240c6d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:50.642 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:50.639+0000 7f532959d700 1 --2- 172.21.15.50:0/4089545561 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f53240cc0d0 0x7f53240c6d00 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f531c009f20 tx=0x7f531c009840 comp rx=0 tx=0).stop 2023-10-06T01:22:50.642 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:50.639+0000 7f532959d700 1 -- 172.21.15.50:0/4089545561 shutdown_connections 2023-10-06T01:22:50.642 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:50.639+0000 7f532959d700 1 --2- 172.21.15.50:0/4089545561 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f53240cc0d0 0x7f53240c6d00 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:50.642 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:50.639+0000 7f532959d700 1 --2- 172.21.15.50:0/4089545561 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f53240689b0 0x7f532415d9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:50.642 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:50.639+0000 7f532959d700 1 -- 172.21.15.50:0/4089545561 >> 172.21.15.50:0/4089545561 conn(0x7f53240cd230 msgr2=0x7f53240c91d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:22:50.643 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:50.639+0000 7f532959d700 1 -- 172.21.15.50:0/4089545561 shutdown_connections 2023-10-06T01:22:50.643 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:50.639+0000 7f532959d700 1 -- 172.21.15.50:0/4089545561 wait complete. 2023-10-06T01:22:50.643 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:50.641+0000 7f532959d700 1 Processor -- start 2023-10-06T01:22:50.643 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:50.641+0000 7f532959d700 1 -- start start 2023-10-06T01:22:50.645 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:50.642+0000 7f532959d700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f53240689b0 0x7f53240ae9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:50.645 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:50.642+0000 7f532959d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5324068d80 0x7f532416d160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:50.645 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:50.642+0000 7f532959d700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f53240cc0d0 0x7f53240675f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:50.645 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:50.642+0000 7f532959d700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f532415e2c0 con 0x7f5324068d80 2023-10-06T01:22:50.646 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:50.642+0000 7f532959d700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f532416d6a0 con 0x7f53240689b0 2023-10-06T01:22:50.646 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:50.642+0000 7f532959d700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53240afe40 con 0x7f53240cc0d0 2023-10-06T01:22:50.646 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:50.642+0000 7f53237fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5324068d80 0x7f532416d160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:50.646 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:50.642+0000 7f53237fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5324068d80 0x7f532416d160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:52668/0 (socket says 172.21.15.50:52668) 2023-10-06T01:22:50.646 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:50.642+0000 7f53237fe700 1 -- 172.21.15.50:0/1447620481 learned_addr learned my addr 172.21.15.50:0/1447620481 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-06T01:22:50.646 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:50.643+0000 7f5328d9c700 1 --2- 172.21.15.50:0/1447620481 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f53240cc0d0 0x7f53240675f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:50.646 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:50.643+0000 7f5323fff700 1 --2- 172.21.15.50:0/1447620481 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f53240689b0 0x7f53240ae9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:50.646 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:50.643+0000 7f53237fe700 1 -- 172.21.15.50:0/1447620481 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f53240cc0d0 msgr2=0x7f53240675f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:50.647 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:50.643+0000 7f53237fe700 1 --2- 172.21.15.50:0/1447620481 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f53240cc0d0 0x7f53240675f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:50.647 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:50.643+0000 7f53237fe700 1 -- 172.21.15.50:0/1447620481 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f53240689b0 msgr2=0x7f53240ae9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:50.647 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:50.643+0000 7f53237fe700 1 --2- 172.21.15.50:0/1447620481 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f53240689b0 0x7f53240ae9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:50.647 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:50.643+0000 7f53237fe700 1 -- 172.21.15.50:0/1447620481 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f531c009ae0 con 0x7f5324068d80 2023-10-06T01:22:50.647 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:50.643+0000 7f53237fe700 1 --2- 172.21.15.50:0/1447620481 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5324068d80 0x7f532416d160 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f531800c5d0 tx=0x7f5318007f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:22:50.647 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:50.643+0000 7f530bfff700 1 -- 172.21.15.50:0/1447620481 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5318011590 con 0x7f5324068d80 2023-10-06T01:22:50.647 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:50.643+0000 7f530bfff700 1 -- 172.21.15.50:0/1447620481 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5318011710 con 0x7f5324068d80 2023-10-06T01:22:50.647 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:50.643+0000 7f530bfff700 1 -- 172.21.15.50:0/1447620481 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5318011ad0 con 0x7f5324068d80 2023-10-06T01:22:50.647 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:50.643+0000 7f532959d700 1 -- 172.21.15.50:0/1447620481 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f53240b0120 con 0x7f5324068d80 2023-10-06T01:22:50.647 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:50.643+0000 7f532959d700 1 -- 172.21.15.50:0/1447620481 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f53240b06e0 con 0x7f5324068d80 2023-10-06T01:22:50.647 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:50.644+0000 7f532959d700 1 -- 172.21.15.50:0/1447620481 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f532405f270 con 0x7f5324068d80 2023-10-06T01:22:50.648 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:50.646+0000 7f530bfff700 1 -- 172.21.15.50:0/1447620481 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f531801c460 con 0x7f5324068d80 2023-10-06T01:22:50.648 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:50.646+0000 7f530bfff700 1 --2- 172.21.15.50:0/1447620481 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f5310066f30 0x7f53100693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:50.649 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:50.647+0000 7f530bfff700 1 -- 172.21.15.50:0/1447620481 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5526+0+0 (secure 0 0 0) 0x7f5318084320 con 0x7f5324068d80 2023-10-06T01:22:50.649 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:50.647+0000 7f5323fff700 1 --2- 172.21.15.50:0/1447620481 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f5310066f30 0x7f53100693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:50.649 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:50.648+0000 7f5323fff700 1 --2- 172.21.15.50:0/1447620481 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f5310066f30 0x7f53100693e0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f53240aa920 tx=0x7f5314008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:22:50.651 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:50.651+0000 7f530bfff700 1 -- 172.21.15.50:0/1447620481 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f53180515a0 con 0x7f5324068d80 2023-10-06T01:22:50.935 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:50.934+0000 7f532959d700 1 -- 172.21.15.50:0/1447620481 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-osd"} v 0) v1 -- 0x7f53240c9bf0 con 0x7f5324068d80 2023-10-06T01:22:50.939 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:50.938+0000 7f530bfff700 1 -- 172.21.15.50:0/1447620481 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-osd"}]=0 v5) v1 ==== 90+0+0 (secure 0 0 0) 0x7f5318054bc0 con 0x7f5324068d80 2023-10-06T01:22:50.942 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:50.940+0000 7f532959d700 1 -- 172.21.15.50:0/1447620481 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f5310066f30 msgr2=0x7f53100693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:50.942 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:50.940+0000 7f532959d700 1 --2- 172.21.15.50:0/1447620481 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f5310066f30 0x7f53100693e0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f53240aa920 tx=0x7f5314008040 comp rx=0 tx=0).stop 2023-10-06T01:22:50.942 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:50.940+0000 7f532959d700 1 -- 172.21.15.50:0/1447620481 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5324068d80 msgr2=0x7f532416d160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:50.942 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:50.940+0000 7f532959d700 1 --2- 172.21.15.50:0/1447620481 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5324068d80 0x7f532416d160 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f531800c5d0 tx=0x7f5318007f60 comp rx=0 tx=0).stop 2023-10-06T01:22:50.942 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:50.941+0000 7f532959d700 1 -- 172.21.15.50:0/1447620481 shutdown_connections 2023-10-06T01:22:50.942 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:50.941+0000 7f532959d700 1 --2- 172.21.15.50:0/1447620481 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f53240cc0d0 0x7f53240675f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:50.942 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:50.941+0000 7f532959d700 1 --2- 172.21.15.50:0/1447620481 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f5310066f30 0x7f53100693e0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:50.942 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:50.941+0000 7f532959d700 1 --2- 172.21.15.50:0/1447620481 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f53240689b0 0x7f53240ae9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:50.942 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:50.941+0000 7f532959d700 1 --2- 172.21.15.50:0/1447620481 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5324068d80 0x7f532416d160 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:50.942 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:50.941+0000 7f532959d700 1 -- 172.21.15.50:0/1447620481 >> 172.21.15.50:0/1447620481 conn(0x7f53240cd230 msgr2=0x7f53240699e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:22:50.943 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:50.941+0000 7f532959d700 1 -- 172.21.15.50:0/1447620481 shutdown_connections 2023-10-06T01:22:50.943 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:50.941+0000 7f532959d700 1 -- 172.21.15.50:0/1447620481 wait complete. 2023-10-06T01:22:50.959 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd 2023-10-06T01:22:51.147 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:51.146+0000 7f190bfff700 1 Processor -- start 2023-10-06T01:22:51.147 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:51.146+0000 7f190bfff700 1 -- start start 2023-10-06T01:22:51.148 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:51.147+0000 7f190bfff700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f190c1593d0 0x7f190c0ac920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:51.148 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:51.147+0000 7f190bfff700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f190c068700 con 0x7f190c0ab450 2023-10-06T01:22:51.149 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:51.147+0000 7f190bfff700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f190c068cc0 con 0x7f190c1597a0 2023-10-06T01:22:51.149 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:51.147+0000 7f190bfff700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f190c0ace60 con 0x7f190c1593d0 2023-10-06T01:22:51.149 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:51.148+0000 7f190affd700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f190c1593d0 0x7f190c0ac920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:51.149 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:51.148+0000 7f190b7fe700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f190c0ab450 0x7f190c0aebb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:44796/0 (socket says 172.21.15.50:44796) 2023-10-06T01:22:51.149 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:51.148+0000 7f190b7fe700 1 -- 172.21.15.50:0/3369986397 learned_addr learned my addr 172.21.15.50:0/3369986397 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-10-06T01:22:51.151 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:51.148+0000 7f1909ffb700 1 -- 172.21.15.50:0/3369986397 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 594108650 0 0) 0x7f190c068700 con 0x7f190c0ab450 2023-10-06T01:22:51.151 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:51.148+0000 7f1909ffb700 1 -- 172.21.15.50:0/3369986397 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f18f4003570 con 0x7f190c0ab450 2023-10-06T01:22:51.152 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:51.148+0000 7f190affd700 1 -- 172.21.15.50:0/3369986397 >> v1:172.21.15.155:6789/0 conn(0x7f190c1597a0 legacy=0x7f190c0aad40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:51.152 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:51.148+0000 7f190affd700 1 -- 172.21.15.50:0/3369986397 >> v1:172.21.15.50:6789/0 conn(0x7f190c0ab450 legacy=0x7f190c0aebb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:51.152 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:51.148+0000 7f190affd700 1 -- 172.21.15.50:0/3369986397 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f190c0ad130 con 0x7f190c1593d0 2023-10-06T01:22:51.152 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:51.148+0000 7f190affd700 1 --2- 172.21.15.50:0/3369986397 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f190c1593d0 0x7f190c0ac920 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f18fc0098e0 tx=0x7f18fc0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8aae38773d439131 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:22:51.152 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:51.149+0000 7f1909ffb700 1 -- 172.21.15.50:0/3369986397 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18fc00b640 con 0x7f190c1593d0 2023-10-06T01:22:51.153 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:51.149+0000 7f1909ffb700 1 -- 172.21.15.50:0/3369986397 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18fc00b7a0 con 0x7f190c1593d0 2023-10-06T01:22:51.153 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:51.149+0000 7f1909ffb700 1 -- 172.21.15.50:0/3369986397 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18fc00bb20 con 0x7f190c1593d0 2023-10-06T01:22:51.153 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:51.149+0000 7f190bfff700 1 -- 172.21.15.50:0/3369986397 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f190c1593d0 msgr2=0x7f190c0ac920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:51.153 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:51.149+0000 7f190bfff700 1 --2- 172.21.15.50:0/3369986397 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f190c1593d0 0x7f190c0ac920 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f18fc0098e0 tx=0x7f18fc0091a0 comp rx=0 tx=0).stop 2023-10-06T01:22:51.153 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:51.149+0000 7f190bfff700 1 -- 172.21.15.50:0/3369986397 shutdown_connections 2023-10-06T01:22:51.153 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:51.149+0000 7f190bfff700 1 --2- 172.21.15.50:0/3369986397 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f190c1593d0 0x7f190c0ac920 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:51.153 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:51.149+0000 7f190bfff700 1 -- 172.21.15.50:0/3369986397 >> 172.21.15.50:0/3369986397 conn(0x7f190c097450 msgr2=0x7f190c067dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:22:51.154 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:51.149+0000 7f190bfff700 1 -- 172.21.15.50:0/3369986397 shutdown_connections 2023-10-06T01:22:51.154 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:51.149+0000 7f190bfff700 1 -- 172.21.15.50:0/3369986397 wait complete. 2023-10-06T01:22:51.154 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:51.151+0000 7f190bfff700 1 Processor -- start 2023-10-06T01:22:51.154 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:51.151+0000 7f190bfff700 1 -- start start 2023-10-06T01:22:51.156 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:51.152+0000 7f190bfff700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f190c0ab450 0x7f190c15b080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:51.157 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:51.152+0000 7f190bfff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f190c1593d0 0x7f190c0b1eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:51.157 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:51.152+0000 7f190bfff700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f190c1597a0 0x7f190c099610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:51.157 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:51.152+0000 7f190bfff700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f190c1545f0 con 0x7f190c1593d0 2023-10-06T01:22:51.157 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:51.152+0000 7f190bfff700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f190c15b5c0 con 0x7f190c0ab450 2023-10-06T01:22:51.157 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:51.152+0000 7f190bfff700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f190c159fe0 con 0x7f190c1597a0 2023-10-06T01:22:51.157 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:51.152+0000 7f190a7fc700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f190c1593d0 0x7f190c0b1eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:51.158 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:51.152+0000 7f190a7fc700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f190c1593d0 0x7f190c0b1eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:52692/0 (socket says 172.21.15.50:52692) 2023-10-06T01:22:51.158 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:51.152+0000 7f190a7fc700 1 -- 172.21.15.50:0/1689755053 learned_addr learned my addr 172.21.15.50:0/1689755053 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-06T01:22:51.158 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:51.152+0000 7f190affd700 1 --2- 172.21.15.50:0/1689755053 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f190c0ab450 0x7f190c15b080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:51.158 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:51.152+0000 7f190b7fe700 1 --2- 172.21.15.50:0/1689755053 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f190c1597a0 0x7f190c099610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:51.158 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:51.152+0000 7f190a7fc700 1 -- 172.21.15.50:0/1689755053 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f190c1597a0 msgr2=0x7f190c099610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:51.158 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:51.152+0000 7f190a7fc700 1 --2- 172.21.15.50:0/1689755053 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f190c1597a0 0x7f190c099610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:51.159 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:51.152+0000 7f190a7fc700 1 -- 172.21.15.50:0/1689755053 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f190c0ab450 msgr2=0x7f190c15b080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:51.159 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:51.152+0000 7f190a7fc700 1 --2- 172.21.15.50:0/1689755053 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f190c0ab450 0x7f190c15b080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:51.159 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:51.152+0000 7f190a7fc700 1 -- 172.21.15.50:0/1689755053 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18fc009420 con 0x7f190c1593d0 2023-10-06T01:22:51.159 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:51.152+0000 7f190affd700 1 --2- 172.21.15.50:0/1689755053 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f190c0ab450 0x7f190c15b080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T01:22:51.159 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:51.152+0000 7f190b7fe700 1 --2- 172.21.15.50:0/1689755053 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f190c1597a0 0x7f190c099610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T01:22:51.159 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:51.153+0000 7f190a7fc700 1 --2- 172.21.15.50:0/1689755053 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f190c1593d0 0x7f190c0b1eb0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f190000c590 tx=0x7f1900007f30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:22:51.160 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:51.153+0000 7f18f2ffd700 1 -- 172.21.15.50:0/1689755053 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1900011590 con 0x7f190c1593d0 2023-10-06T01:22:51.160 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:51.153+0000 7f18f2ffd700 1 -- 172.21.15.50:0/1689755053 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1900011730 con 0x7f190c1593d0 2023-10-06T01:22:51.160 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:51.153+0000 7f18f2ffd700 1 -- 172.21.15.50:0/1689755053 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1900011af0 con 0x7f190c1593d0 2023-10-06T01:22:51.160 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:51.153+0000 7f190bfff700 1 -- 172.21.15.50:0/1689755053 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f190c15a2c0 con 0x7f190c1593d0 2023-10-06T01:22:51.160 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:51.153+0000 7f190bfff700 1 -- 172.21.15.50:0/1689755053 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f190c15a880 con 0x7f190c1593d0 2023-10-06T01:22:51.160 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:51.154+0000 7f190bfff700 1 -- 172.21.15.50:0/1689755053 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f190c05f270 con 0x7f190c1593d0 2023-10-06T01:22:51.160 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:51.155+0000 7f18f2ffd700 1 -- 172.21.15.50:0/1689755053 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f1900012420 con 0x7f190c1593d0 2023-10-06T01:22:51.161 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:51.157+0000 7f18f2ffd700 1 --2- 172.21.15.50:0/1689755053 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f18f8066f30 0x7f18f80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:51.161 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:51.157+0000 7f18f2ffd700 1 -- 172.21.15.50:0/1689755053 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5526+0+0 (secure 0 0 0) 0x7f19000837a0 con 0x7f190c1593d0 2023-10-06T01:22:51.161 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:51.157+0000 7f190affd700 1 --2- 172.21.15.50:0/1689755053 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f18f8066f30 0x7f18f80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:51.161 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:51.158+0000 7f190affd700 1 --2- 172.21.15.50:0/1689755053 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f18f8066f30 0x7f18f80693e0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f18fc003080 tx=0x7f18fc017000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:22:51.161 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:51.161+0000 7f18f2ffd700 1 -- 172.21.15.50:0/1689755053 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f190004b5a0 con 0x7f190c1593d0 2023-10-06T01:22:51.442 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:51.441+0000 7f190bfff700 1 -- 172.21.15.50:0/1689755053 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd"} v 0) v1 -- 0x7f190c06c0c0 con 0x7f190c1593d0 2023-10-06T01:22:51.446 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:51.445+0000 7f18f2ffd700 1 -- 172.21.15.50:0/1689755053 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd"}]=0 v6) v1 ==== 90+0+0 (secure 0 0 0) 0x7f1900017020 con 0x7f190c1593d0 2023-10-06T01:22:51.449 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:51.447+0000 7f190bfff700 1 -- 172.21.15.50:0/1689755053 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f18f8066f30 msgr2=0x7f18f80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:51.449 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:51.447+0000 7f190bfff700 1 --2- 172.21.15.50:0/1689755053 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f18f8066f30 0x7f18f80693e0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f18fc003080 tx=0x7f18fc017000 comp rx=0 tx=0).stop 2023-10-06T01:22:51.449 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:51.447+0000 7f190bfff700 1 -- 172.21.15.50:0/1689755053 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f190c1593d0 msgr2=0x7f190c0b1eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:51.449 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:51.447+0000 7f190bfff700 1 --2- 172.21.15.50:0/1689755053 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f190c1593d0 0x7f190c0b1eb0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f190000c590 tx=0x7f1900007f30 comp rx=0 tx=0).stop 2023-10-06T01:22:51.449 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:51.447+0000 7f190bfff700 1 -- 172.21.15.50:0/1689755053 shutdown_connections 2023-10-06T01:22:51.449 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:51.447+0000 7f190bfff700 1 --2- 172.21.15.50:0/1689755053 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f190c1597a0 0x7f190c099610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:51.449 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:51.447+0000 7f190bfff700 1 --2- 172.21.15.50:0/1689755053 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f18f8066f30 0x7f18f80693e0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:51.449 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:51.447+0000 7f190bfff700 1 --2- 172.21.15.50:0/1689755053 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f190c0ab450 0x7f190c15b080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:51.450 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:51.447+0000 7f190bfff700 1 --2- 172.21.15.50:0/1689755053 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f190c1593d0 0x7f190c0b1eb0 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:51.450 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:51.447+0000 7f190bfff700 1 -- 172.21.15.50:0/1689755053 >> 172.21.15.50:0/1689755053 conn(0x7f190c097450 msgr2=0x7f190c06c8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:22:51.450 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:51.448+0000 7f190bfff700 1 -- 172.21.15.50:0/1689755053 shutdown_connections 2023-10-06T01:22:51.450 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:51.448+0000 7f190bfff700 1 -- 172.21.15.50:0/1689755053 wait complete. 2023-10-06T01:22:51.466 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd-mirror 2023-10-06T01:22:51.654 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:51.653+0000 7fe3beb9d700 1 Processor -- start 2023-10-06T01:22:51.655 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:51.653+0000 7fe3beb9d700 1 -- start start 2023-10-06T01:22:51.656 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:51.655+0000 7fe3beb9d700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fe3b8153cc0 0x7fe3b8159ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:51.656 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:51.655+0000 7fe3beb9d700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe3b806a890 con 0x7fe3b81538f0 2023-10-06T01:22:51.656 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:51.655+0000 7fe3beb9d700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe3b815a520 con 0x7fe3b815a010 2023-10-06T01:22:51.656 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:51.655+0000 7fe3beb9d700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe3b815aae0 con 0x7fe3b8153cc0 2023-10-06T01:22:51.656 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:51.655+0000 7fe3bdb9b700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fe3b81538f0 0x7fe3b80a98e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:44798/0 (socket says 172.21.15.50:44798) 2023-10-06T01:22:51.656 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:51.655+0000 7fe3bdb9b700 1 -- 172.21.15.50:0/3766217450 learned_addr learned my addr 172.21.15.50:0/3766217450 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-10-06T01:22:51.656 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:51.655+0000 7fe3bd39a700 1 --2- 172.21.15.50:0/3766217450 >> v2:172.21.15.50:3300/0 conn(0x7fe3b8153cc0 0x7fe3b8159ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:51.658 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:51.655+0000 7fe3bcb99700 1 -- 172.21.15.50:0/3766217450 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3128019447 0 0) 0x7fe3b806a890 con 0x7fe3b81538f0 2023-10-06T01:22:51.658 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:51.655+0000 7fe3bcb99700 1 -- 172.21.15.50:0/3766217450 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe3a4003570 con 0x7fe3b81538f0 2023-10-06T01:22:51.658 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:51.656+0000 7fe3bd39a700 1 -- 172.21.15.50:0/3766217450 >> v1:172.21.15.155:6789/0 conn(0x7fe3b815a010 legacy=0x7fe3b80cabf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:51.658 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:51.656+0000 7fe3bd39a700 1 -- 172.21.15.50:0/3766217450 >> v1:172.21.15.50:6789/0 conn(0x7fe3b81538f0 legacy=0x7fe3b80a98e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:51.658 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:51.656+0000 7fe3bd39a700 1 -- 172.21.15.50:0/3766217450 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3b815a800 con 0x7fe3b8153cc0 2023-10-06T01:22:51.658 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:51.656+0000 7fe3bd39a700 1 --2- 172.21.15.50:0/3766217450 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe3b8153cc0 0x7fe3b8159ad0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7fe3a80098e0 tx=0x7fe3a80091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a066cc44f840cb05 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:22:51.659 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:51.656+0000 7fe3bcb99700 1 -- 172.21.15.50:0/3766217450 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3a800b640 con 0x7fe3b8153cc0 2023-10-06T01:22:51.659 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:51.656+0000 7fe3bcb99700 1 -- 172.21.15.50:0/3766217450 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe3a800b7a0 con 0x7fe3b8153cc0 2023-10-06T01:22:51.659 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:51.656+0000 7fe3bcb99700 1 -- 172.21.15.50:0/3766217450 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3a800bb20 con 0x7fe3b8153cc0 2023-10-06T01:22:51.659 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:51.657+0000 7fe3beb9d700 1 -- 172.21.15.50:0/3766217450 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe3b8153cc0 msgr2=0x7fe3b8159ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:51.659 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:51.657+0000 7fe3beb9d700 1 --2- 172.21.15.50:0/3766217450 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe3b8153cc0 0x7fe3b8159ad0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7fe3a80098e0 tx=0x7fe3a80091a0 comp rx=0 tx=0).stop 2023-10-06T01:22:51.659 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:51.657+0000 7fe3beb9d700 1 -- 172.21.15.50:0/3766217450 shutdown_connections 2023-10-06T01:22:51.659 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:51.657+0000 7fe3beb9d700 1 --2- 172.21.15.50:0/3766217450 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe3b8153cc0 0x7fe3b8159ad0 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:51.659 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:51.657+0000 7fe3beb9d700 1 -- 172.21.15.50:0/3766217450 >> 172.21.15.50:0/3766217450 conn(0x7fe3b80691d0 msgr2=0x7fe3b80cd020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:22:51.659 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:51.657+0000 7fe3beb9d700 1 -- 172.21.15.50:0/3766217450 shutdown_connections 2023-10-06T01:22:51.659 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:51.657+0000 7fe3beb9d700 1 -- 172.21.15.50:0/3766217450 wait complete. 2023-10-06T01:22:51.662 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:51.658+0000 7fe3beb9d700 1 Processor -- start 2023-10-06T01:22:51.662 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:51.658+0000 7fe3beb9d700 1 -- start start 2023-10-06T01:22:51.662 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:51.659+0000 7fe3beb9d700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe3b81538f0 0x7fe3b81593b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:51.663 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:51.659+0000 7fe3beb9d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe3b8153cc0 0x7fe3b814dae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:51.663 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:51.659+0000 7fe3beb9d700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe3b815a010 0x7fe3b80c26b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:51.663 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:51.659+0000 7fe3beb9d700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3b8169a30 con 0x7fe3b8153cc0 2023-10-06T01:22:51.663 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:51.659+0000 7fe3beb9d700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3b816a9e0 con 0x7fe3b81538f0 2023-10-06T01:22:51.663 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:51.659+0000 7fe3beb9d700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3b8169c20 con 0x7fe3b815a010 2023-10-06T01:22:51.663 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:51.660+0000 7fe3bd39a700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe3b8153cc0 0x7fe3b814dae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:51.663 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:51.660+0000 7fe3bd39a700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe3b8153cc0 0x7fe3b814dae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:52712/0 (socket says 172.21.15.50:52712) 2023-10-06T01:22:51.663 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:51.660+0000 7fe3bd39a700 1 -- 172.21.15.50:0/427210977 learned_addr learned my addr 172.21.15.50:0/427210977 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-06T01:22:51.663 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:51.660+0000 7fe3bd39a700 1 -- 172.21.15.50:0/427210977 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe3b815a010 msgr2=0x7fe3b80c26b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:51.664 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:51.660+0000 7fe3bd39a700 1 --2- 172.21.15.50:0/427210977 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe3b815a010 0x7fe3b80c26b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:51.664 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:51.660+0000 7fe3bdb9b700 1 --2- 172.21.15.50:0/427210977 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe3b81538f0 0x7fe3b81593b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:51.664 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:51.660+0000 7fe3bd39a700 1 -- 172.21.15.50:0/427210977 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe3b81538f0 msgr2=0x7fe3b81593b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:51.664 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:51.660+0000 7fe3bd39a700 1 --2- 172.21.15.50:0/427210977 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe3b81538f0 0x7fe3b81593b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:51.664 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:51.660+0000 7fe3bd39a700 1 -- 172.21.15.50:0/427210977 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3a8009420 con 0x7fe3b8153cc0 2023-10-06T01:22:51.664 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:51.660+0000 7fe3bdb9b700 1 --2- 172.21.15.50:0/427210977 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe3b81538f0 0x7fe3b81593b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T01:22:51.664 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:51.660+0000 7fe3bd39a700 1 --2- 172.21.15.50:0/427210977 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe3b8153cc0 0x7fe3b814dae0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7fe3a80093f0 tx=0x7fe3a8017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:22:51.665 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:51.661+0000 7fe3adffb700 1 -- 172.21.15.50:0/427210977 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3a800bb20 con 0x7fe3b8153cc0 2023-10-06T01:22:51.665 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:51.661+0000 7fe3adffb700 1 -- 172.21.15.50:0/427210977 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe3a8011420 con 0x7fe3b8153cc0 2023-10-06T01:22:51.665 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:51.661+0000 7fe3adffb700 1 -- 172.21.15.50:0/427210977 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3a8011820 con 0x7fe3b8153cc0 2023-10-06T01:22:51.665 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:51.661+0000 7fe3beb9d700 1 -- 172.21.15.50:0/427210977 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe3b8169f00 con 0x7fe3b8153cc0 2023-10-06T01:22:51.665 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:51.661+0000 7fe3beb9d700 1 -- 172.21.15.50:0/427210977 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe3b816a4c0 con 0x7fe3b8153cc0 2023-10-06T01:22:51.666 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:51.662+0000 7fe3beb9d700 1 -- 172.21.15.50:0/427210977 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe3b816a6b0 con 0x7fe3b8153cc0 2023-10-06T01:22:51.666 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:51.663+0000 7fe3adffb700 1 -- 172.21.15.50:0/427210977 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fe3a8011c50 con 0x7fe3b8153cc0 2023-10-06T01:22:51.666 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:51.663+0000 7fe3adffb700 1 --2- 172.21.15.50:0/427210977 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7fe39c066f30 0x7fe39c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:51.666 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:51.664+0000 7fe3adffb700 1 -- 172.21.15.50:0/427210977 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5526+0+0 (secure 0 0 0) 0x7fe3a8085f00 con 0x7fe3b8153cc0 2023-10-06T01:22:51.666 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:51.664+0000 7fe3bdb9b700 1 --2- 172.21.15.50:0/427210977 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7fe39c066f30 0x7fe39c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:51.666 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:51.665+0000 7fe3bdb9b700 1 --2- 172.21.15.50:0/427210977 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7fe39c066f30 0x7fe39c0693e0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fe3b4007fd0 tx=0x7fe3b4009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:22:51.668 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:51.668+0000 7fe3adffb700 1 -- 172.21.15.50:0/427210977 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe3a8053220 con 0x7fe3b8153cc0 2023-10-06T01:22:51.953 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:51.953+0000 7fe3beb9d700 1 -- 172.21.15.50:0/427210977 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"} v 0) v1 -- 0x7fe3b805f270 con 0x7fe3b8153cc0 2023-10-06T01:22:51.957 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:51.956+0000 7fe3adffb700 1 -- 172.21.15.50:0/427210977 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"}]=0 v7) v1 ==== 97+0+0 (secure 0 0 0) 0x7fe3a8056840 con 0x7fe3b8153cc0 2023-10-06T01:22:51.960 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:51.958+0000 7fe3beb9d700 1 -- 172.21.15.50:0/427210977 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7fe39c066f30 msgr2=0x7fe39c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:51.960 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:51.958+0000 7fe3beb9d700 1 --2- 172.21.15.50:0/427210977 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7fe39c066f30 0x7fe39c0693e0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fe3b4007fd0 tx=0x7fe3b4009040 comp rx=0 tx=0).stop 2023-10-06T01:22:51.960 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:51.958+0000 7fe3beb9d700 1 -- 172.21.15.50:0/427210977 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe3b8153cc0 msgr2=0x7fe3b814dae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:51.960 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:51.958+0000 7fe3beb9d700 1 --2- 172.21.15.50:0/427210977 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe3b8153cc0 0x7fe3b814dae0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7fe3a80093f0 tx=0x7fe3a8017000 comp rx=0 tx=0).stop 2023-10-06T01:22:51.960 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:51.959+0000 7fe3beb9d700 1 -- 172.21.15.50:0/427210977 shutdown_connections 2023-10-06T01:22:51.960 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:51.959+0000 7fe3beb9d700 1 --2- 172.21.15.50:0/427210977 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe3b815a010 0x7fe3b80c26b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:51.960 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:51.959+0000 7fe3beb9d700 1 --2- 172.21.15.50:0/427210977 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7fe39c066f30 0x7fe39c0693e0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:51.960 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:51.959+0000 7fe3beb9d700 1 --2- 172.21.15.50:0/427210977 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe3b81538f0 0x7fe3b81593b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:51.960 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:51.959+0000 7fe3beb9d700 1 --2- 172.21.15.50:0/427210977 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe3b8153cc0 0x7fe3b814dae0 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:51.960 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:51.959+0000 7fe3beb9d700 1 -- 172.21.15.50:0/427210977 >> 172.21.15.50:0/427210977 conn(0x7fe3b80691d0 msgr2=0x7fe3b8151b40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:22:51.961 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:51.959+0000 7fe3beb9d700 1 -- 172.21.15.50:0/427210977 shutdown_connections 2023-10-06T01:22:51.961 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:51.959+0000 7fe3beb9d700 1 -- 172.21.15.50:0/427210977 wait complete. 2023-10-06T01:22:51.978 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rgw 2023-10-06T01:22:52.165 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:52.164+0000 7ff66cb9d700 1 Processor -- start 2023-10-06T01:22:52.165 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:52.164+0000 7ff66cb9d700 1 -- start start 2023-10-06T01:22:52.167 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:52.165+0000 7ff66cb9d700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7ff6680cbc70 0x7ff6680cc0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:52.167 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:52.165+0000 7ff66cb9d700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff6680b2140 0x7ff6680b25a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:52.167 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:52.165+0000 7ff66cb9d700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff6680cb7e0 con 0x7ff668159480 2023-10-06T01:22:52.167 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:52.165+0000 7ff66cb9d700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff6680b08a0 con 0x7ff6680cbc70 2023-10-06T01:22:52.167 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:52.165+0000 7ff66cb9d700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff6680cb190 con 0x7ff6680b2140 2023-10-06T01:22:52.167 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:52.166+0000 7ff666ffd700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7ff6680cbc70 0x7ff6680cc0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:52.168 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:52.166+0000 7ff666ffd700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7ff6680cbc70 0x7ff6680cc0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:52720/0 (socket says 172.21.15.50:52720) 2023-10-06T01:22:52.168 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:52.166+0000 7ff666ffd700 1 -- 172.21.15.50:0/439633418 learned_addr learned my addr 172.21.15.50:0/439633418 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-06T01:22:52.168 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:52.166+0000 7ff667fff700 1 --2- 172.21.15.50:0/439633418 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff6680b2140 0x7ff6680b25a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:52.168 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:52.166+0000 7ff666ffd700 1 -- 172.21.15.50:0/439633418 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff6680b2140 msgr2=0x7ff6680b25a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:22:52.168 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:52.166+0000 7ff666ffd700 1 --2- 172.21.15.50:0/439633418 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff6680b2140 0x7ff6680b25a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:52.168 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:52.166+0000 7ff666ffd700 1 -- 172.21.15.50:0/439633418 >> v1:172.21.15.155:6789/0 conn(0x7ff668159480 legacy=0x7ff6680b30d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:52.168 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:52.166+0000 7ff666ffd700 1 -- 172.21.15.50:0/439633418 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6680cb470 con 0x7ff6680cbc70 2023-10-06T01:22:52.168 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:52.166+0000 7ff667fff700 1 --2- 172.21.15.50:0/439633418 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff6680b2140 0x7ff6680b25a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T01:22:52.170 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:52.166+0000 7ff666ffd700 1 --2- 172.21.15.50:0/439633418 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff6680cbc70 0x7ff6680cc0c0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7ff65c0099b0 tx=0x7ff65c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f657f896b9a6ef79 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:22:52.170 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:52.167+0000 7ff6667fc700 1 -- 172.21.15.50:0/439633418 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff65c00b860 con 0x7ff6680cbc70 2023-10-06T01:22:52.170 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:52.167+0000 7ff6667fc700 1 -- 172.21.15.50:0/439633418 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff65c00b9c0 con 0x7ff6680cbc70 2023-10-06T01:22:52.170 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:52.167+0000 7ff6667fc700 1 -- 172.21.15.50:0/439633418 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff65c00bd60 con 0x7ff6680cbc70 2023-10-06T01:22:52.170 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:52.167+0000 7ff66cb9d700 1 -- 172.21.15.50:0/439633418 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff6680cbc70 msgr2=0x7ff6680cc0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:52.170 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:52.167+0000 7ff66cb9d700 1 --2- 172.21.15.50:0/439633418 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff6680cbc70 0x7ff6680cc0c0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7ff65c0099b0 tx=0x7ff65c009250 comp rx=0 tx=0).stop 2023-10-06T01:22:52.170 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:52.167+0000 7ff66cb9d700 1 -- 172.21.15.50:0/439633418 shutdown_connections 2023-10-06T01:22:52.170 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:52.167+0000 7ff66cb9d700 1 --2- 172.21.15.50:0/439633418 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff6680b2140 0x7ff6680b25a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:52.170 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:52.167+0000 7ff66cb9d700 1 --2- 172.21.15.50:0/439633418 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff6680cbc70 0x7ff6680cc0c0 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:52.170 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:52.167+0000 7ff66cb9d700 1 -- 172.21.15.50:0/439633418 >> 172.21.15.50:0/439633418 conn(0x7ff66806ed20 msgr2=0x7ff66806f120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:22:52.171 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:52.167+0000 7ff66cb9d700 1 -- 172.21.15.50:0/439633418 shutdown_connections 2023-10-06T01:22:52.171 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:52.167+0000 7ff66cb9d700 1 -- 172.21.15.50:0/439633418 wait complete. 2023-10-06T01:22:52.171 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:52.169+0000 7ff66cb9d700 1 Processor -- start 2023-10-06T01:22:52.171 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:52.169+0000 7ff66cb9d700 1 -- start start 2023-10-06T01:22:52.173 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:52.170+0000 7ff66cb9d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff6680b2140 0x7ff668154af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:52.173 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:52.170+0000 7ff66cb9d700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff6680cbc70 0x7ff6680ce7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:52.173 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:52.170+0000 7ff66cb9d700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff668159480 0x7ff6680c9460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:52.173 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:52.170+0000 7ff66cb9d700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff668159f40 con 0x7ff6680b2140 2023-10-06T01:22:52.173 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:52.170+0000 7ff66cb9d700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff668155030 con 0x7ff6680cbc70 2023-10-06T01:22:52.173 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:52.170+0000 7ff66cb9d700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff6680d0a50 con 0x7ff668159480 2023-10-06T01:22:52.173 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:52.170+0000 7ff6677fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff6680b2140 0x7ff668154af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:52.173 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:52.170+0000 7ff6677fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff6680b2140 0x7ff668154af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:52732/0 (socket says 172.21.15.50:52732) 2023-10-06T01:22:52.173 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:52.170+0000 7ff6677fe700 1 -- 172.21.15.50:0/4079232165 learned_addr learned my addr 172.21.15.50:0/4079232165 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-06T01:22:52.173 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:52.170+0000 7ff666ffd700 1 --2- 172.21.15.50:0/4079232165 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff6680cbc70 0x7ff6680ce7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:52.173 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:52.170+0000 7ff667fff700 1 --2- 172.21.15.50:0/4079232165 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff668159480 0x7ff6680c9460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:52.174 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:52.171+0000 7ff6677fe700 1 -- 172.21.15.50:0/4079232165 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff668159480 msgr2=0x7ff6680c9460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:52.174 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:52.171+0000 7ff6677fe700 1 --2- 172.21.15.50:0/4079232165 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff668159480 0x7ff6680c9460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:52.174 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:52.171+0000 7ff6677fe700 1 -- 172.21.15.50:0/4079232165 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff6680cbc70 msgr2=0x7ff6680ce7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:52.174 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:52.171+0000 7ff6677fe700 1 --2- 172.21.15.50:0/4079232165 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff6680cbc70 0x7ff6680ce7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:52.174 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:52.171+0000 7ff6677fe700 1 -- 172.21.15.50:0/4079232165 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff65c0094f0 con 0x7ff6680b2140 2023-10-06T01:22:52.174 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:52.171+0000 7ff666ffd700 1 --2- 172.21.15.50:0/4079232165 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff6680cbc70 0x7ff6680ce7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T01:22:52.174 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:52.171+0000 7ff667fff700 1 --2- 172.21.15.50:0/4079232165 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff668159480 0x7ff6680c9460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T01:22:52.174 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:52.171+0000 7ff6677fe700 1 --2- 172.21.15.50:0/4079232165 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff6680b2140 0x7ff668154af0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7ff65800c590 tx=0x7ff658007f30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:22:52.174 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:52.171+0000 7ff64f7fe700 1 -- 172.21.15.50:0/4079232165 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff658011590 con 0x7ff6680b2140 2023-10-06T01:22:52.174 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:52.171+0000 7ff64f7fe700 1 -- 172.21.15.50:0/4079232165 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff658011730 con 0x7ff6680b2140 2023-10-06T01:22:52.174 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:52.171+0000 7ff66cb9d700 1 -- 172.21.15.50:0/4079232165 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff6680d0d30 con 0x7ff6680b2140 2023-10-06T01:22:52.175 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:52.171+0000 7ff64f7fe700 1 -- 172.21.15.50:0/4079232165 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff658011af0 con 0x7ff6680b2140 2023-10-06T01:22:52.175 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:52.171+0000 7ff66cb9d700 1 -- 172.21.15.50:0/4079232165 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff668159bd0 con 0x7ff6680b2140 2023-10-06T01:22:52.175 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:52.172+0000 7ff66cb9d700 1 -- 172.21.15.50:0/4079232165 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff66805f270 con 0x7ff6680b2140 2023-10-06T01:22:52.176 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:52.173+0000 7ff64f7fe700 1 -- 172.21.15.50:0/4079232165 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7ff658012420 con 0x7ff6680b2140 2023-10-06T01:22:52.176 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:52.174+0000 7ff64f7fe700 1 --2- 172.21.15.50:0/4079232165 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7ff654066f30 0x7ff6540693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:52.176 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:52.174+0000 7ff64f7fe700 1 -- 172.21.15.50:0/4079232165 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5526+0+0 (secure 0 0 0) 0x7ff658083840 con 0x7ff6680b2140 2023-10-06T01:22:52.176 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:52.175+0000 7ff666ffd700 1 --2- 172.21.15.50:0/4079232165 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7ff654066f30 0x7ff6540693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:52.176 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:52.175+0000 7ff666ffd700 1 --2- 172.21.15.50:0/4079232165 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7ff654066f30 0x7ff6540693e0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7ff65c0099b0 tx=0x7ff65c017000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:22:52.179 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:52.178+0000 7ff64f7fe700 1 -- 172.21.15.50:0/4079232165 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff65804b5a0 con 0x7ff6680b2140 2023-10-06T01:22:52.460 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:52.460+0000 7ff66cb9d700 1 -- 172.21.15.50:0/4079232165 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rgw"} v 0) v1 -- 0x7ff6680b2ae0 con 0x7ff6680b2140 2023-10-06T01:22:52.463 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:52.463+0000 7ff64f7fe700 1 -- 172.21.15.50:0/4079232165 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rgw"}]=0 v8) v1 ==== 90+0+0 (secure 0 0 0) 0x7ff658017020 con 0x7ff6680b2140 2023-10-06T01:22:52.467 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:52.465+0000 7ff66cb9d700 1 -- 172.21.15.50:0/4079232165 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7ff654066f30 msgr2=0x7ff6540693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:52.467 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:52.465+0000 7ff66cb9d700 1 --2- 172.21.15.50:0/4079232165 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7ff654066f30 0x7ff6540693e0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7ff65c0099b0 tx=0x7ff65c017000 comp rx=0 tx=0).stop 2023-10-06T01:22:52.467 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:52.465+0000 7ff66cb9d700 1 -- 172.21.15.50:0/4079232165 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff6680b2140 msgr2=0x7ff668154af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:52.467 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:52.465+0000 7ff66cb9d700 1 --2- 172.21.15.50:0/4079232165 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff6680b2140 0x7ff668154af0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7ff65800c590 tx=0x7ff658007f30 comp rx=0 tx=0).stop 2023-10-06T01:22:52.467 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:52.465+0000 7ff66cb9d700 1 -- 172.21.15.50:0/4079232165 shutdown_connections 2023-10-06T01:22:52.468 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:52.465+0000 7ff66cb9d700 1 --2- 172.21.15.50:0/4079232165 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff668159480 0x7ff6680c9460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:52.468 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:52.465+0000 7ff66cb9d700 1 --2- 172.21.15.50:0/4079232165 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff6680b2140 0x7ff668154af0 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:52.468 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:52.465+0000 7ff66cb9d700 1 --2- 172.21.15.50:0/4079232165 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7ff654066f30 0x7ff6540693e0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:52.468 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:52.465+0000 7ff66cb9d700 1 --2- 172.21.15.50:0/4079232165 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff6680cbc70 0x7ff6680ce7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:52.468 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:52.465+0000 7ff66cb9d700 1 -- 172.21.15.50:0/4079232165 >> 172.21.15.50:0/4079232165 conn(0x7ff66806ed20 msgr2=0x7ff6680b4600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:22:52.468 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:52.466+0000 7ff66cb9d700 1 -- 172.21.15.50:0/4079232165 shutdown_connections 2023-10-06T01:22:52.468 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:52.466+0000 7ff66cb9d700 1 -- 172.21.15.50:0/4079232165 wait complete. 2023-10-06T01:22:52.484 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T01:22:52.671 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:52.670+0000 7fa58d79d700 1 Processor -- start 2023-10-06T01:22:52.671 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:52.670+0000 7fa58d79d700 1 -- start start 2023-10-06T01:22:52.673 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:52.671+0000 7fa58d79d700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa5881538f0 0x7fa5880a98e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:52.673 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:52.671+0000 7fa58d79d700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fa588153cc0 0x7fa588159ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:52.673 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:52.671+0000 7fa58d79d700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa58806a890 con 0x7fa58815a010 2023-10-06T01:22:52.673 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:52.671+0000 7fa58d79d700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa58815aae0 con 0x7fa588153cc0 2023-10-06T01:22:52.673 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:52.671+0000 7fa58d79d700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5880a9e20 con 0x7fa5881538f0 2023-10-06T01:22:52.673 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:52.672+0000 7fa5877fe700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fa588153cc0 0x7fa588159ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:52.673 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:52.672+0000 7fa5877fe700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fa588153cc0 0x7fa588159ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:52744/0 (socket says 172.21.15.50:52744) 2023-10-06T01:22:52.674 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:52.672+0000 7fa5877fe700 1 -- 172.21.15.50:0/3277471267 learned_addr learned my addr 172.21.15.50:0/3277471267 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-06T01:22:52.674 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:52.672+0000 7fa587fff700 1 --2- 172.21.15.50:0/3277471267 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa5881538f0 0x7fa5880a98e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:52.674 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:52.672+0000 7fa5877fe700 1 -- 172.21.15.50:0/3277471267 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa5881538f0 msgr2=0x7fa5880a98e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:22:52.674 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:52.672+0000 7fa5877fe700 1 --2- 172.21.15.50:0/3277471267 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa5881538f0 0x7fa5880a98e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:52.674 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:52.672+0000 7fa5877fe700 1 -- 172.21.15.50:0/3277471267 >> v1:172.21.15.155:6789/0 conn(0x7fa58815a010 legacy=0x7fa5880cabf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:22:52.674 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:52.672+0000 7fa5877fe700 1 -- 172.21.15.50:0/3277471267 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa58815a520 con 0x7fa588153cc0 2023-10-06T01:22:52.674 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:52.672+0000 7fa5877fe700 1 --2- 172.21.15.50:0/3277471267 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa588153cc0 0x7fa588159ad0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7fa57c0099b0 tx=0x7fa57c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3002650f1a6897f server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:22:52.675 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:52.673+0000 7fa586ffd700 1 -- 172.21.15.50:0/3277471267 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa57c00b820 con 0x7fa588153cc0 2023-10-06T01:22:52.675 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:52.673+0000 7fa586ffd700 1 -- 172.21.15.50:0/3277471267 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa57c00b980 con 0x7fa588153cc0 2023-10-06T01:22:52.675 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:52.673+0000 7fa586ffd700 1 -- 172.21.15.50:0/3277471267 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa57c00bd20 con 0x7fa588153cc0 2023-10-06T01:22:52.675 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:52.673+0000 7fa58d79d700 1 -- 172.21.15.50:0/3277471267 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa588153cc0 msgr2=0x7fa588159ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:52.675 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:52.673+0000 7fa58d79d700 1 --2- 172.21.15.50:0/3277471267 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa588153cc0 0x7fa588159ad0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7fa57c0099b0 tx=0x7fa57c009250 comp rx=0 tx=0).stop 2023-10-06T01:22:52.676 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:52.673+0000 7fa58d79d700 1 -- 172.21.15.50:0/3277471267 shutdown_connections 2023-10-06T01:22:52.676 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:52.673+0000 7fa58d79d700 1 --2- 172.21.15.50:0/3277471267 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa5881538f0 0x7fa5880a98e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:52.676 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:52.673+0000 7fa58d79d700 1 --2- 172.21.15.50:0/3277471267 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa588153cc0 0x7fa588159ad0 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:52.676 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:52.673+0000 7fa58d79d700 1 -- 172.21.15.50:0/3277471267 >> 172.21.15.50:0/3277471267 conn(0x7fa5880691d0 msgr2=0x7fa5880cd020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:22:52.676 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:52.673+0000 7fa58d79d700 1 -- 172.21.15.50:0/3277471267 shutdown_connections 2023-10-06T01:22:52.676 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:52.673+0000 7fa58d79d700 1 -- 172.21.15.50:0/3277471267 wait complete. 2023-10-06T01:22:52.678 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:52.675+0000 7fa58d79d700 1 Processor -- start 2023-10-06T01:22:52.678 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:52.675+0000 7fa58d79d700 1 -- start start 2023-10-06T01:22:52.678 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:52.676+0000 7fa58d79d700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa5881538f0 0x7fa588144ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:52.678 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:52.676+0000 7fa58d79d700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa588153cc0 0x7fa5880aa230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:52.678 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:52.676+0000 7fa58d79d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa58815a010 0x7fa5880aa770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:52.678 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:52.676+0000 7fa58d79d700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5880c40d0 con 0x7fa58815a010 2023-10-06T01:22:52.678 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:52.676+0000 7fa58d79d700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5880c4320 con 0x7fa588153cc0 2023-10-06T01:22:52.679 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:52.676+0000 7fa58d79d700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5880c4600 con 0x7fa5881538f0 2023-10-06T01:22:52.679 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:52.676+0000 7fa58cf9c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa58815a010 0x7fa5880aa770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:52.679 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:52.676+0000 7fa58cf9c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa58815a010 0x7fa5880aa770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:52758/0 (socket says 172.21.15.50:52758) 2023-10-06T01:22:52.679 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:52.676+0000 7fa58cf9c700 1 -- 172.21.15.50:0/756813923 learned_addr learned my addr 172.21.15.50:0/756813923 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-06T01:22:52.679 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:52.676+0000 7fa587fff700 1 --2- 172.21.15.50:0/756813923 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa5881538f0 0x7fa588144ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:52.679 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:52.676+0000 7fa5877fe700 1 --2- 172.21.15.50:0/756813923 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa588153cc0 0x7fa5880aa230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:52.679 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:52.677+0000 7fa58cf9c700 1 -- 172.21.15.50:0/756813923 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa5881538f0 msgr2=0x7fa588144ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:52.679 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:52.677+0000 7fa58cf9c700 1 --2- 172.21.15.50:0/756813923 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa5881538f0 0x7fa588144ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:52.679 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:52.677+0000 7fa58cf9c700 1 -- 172.21.15.50:0/756813923 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa588153cc0 msgr2=0x7fa5880aa230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:52.679 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:52.677+0000 7fa58cf9c700 1 --2- 172.21.15.50:0/756813923 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa588153cc0 0x7fa5880aa230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:52.679 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:52.677+0000 7fa58cf9c700 1 -- 172.21.15.50:0/756813923 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa57c0094f0 con 0x7fa58815a010 2023-10-06T01:22:52.680 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:52.677+0000 7fa58cf9c700 1 --2- 172.21.15.50:0/756813923 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa58815a010 0x7fa5880aa770 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7fa58000c890 tx=0x7fa5800026a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:22:52.680 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:52.677+0000 7fa56ffff700 1 -- 172.21.15.50:0/756813923 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa580012630 con 0x7fa58815a010 2023-10-06T01:22:52.680 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:52.677+0000 7fa56ffff700 1 -- 172.21.15.50:0/756813923 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5800127b0 con 0x7fa58815a010 2023-10-06T01:22:52.680 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:52.677+0000 7fa56ffff700 1 -- 172.21.15.50:0/756813923 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa580012b70 con 0x7fa58815a010 2023-10-06T01:22:52.680 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:52.677+0000 7fa58d79d700 1 -- 172.21.15.50:0/756813923 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa5880c48e0 con 0x7fa58815a010 2023-10-06T01:22:52.680 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:52.677+0000 7fa58d79d700 1 -- 172.21.15.50:0/756813923 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa588145000 con 0x7fa58815a010 2023-10-06T01:22:52.681 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:52.678+0000 7fa58d79d700 1 -- 172.21.15.50:0/756813923 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa58805f270 con 0x7fa58815a010 2023-10-06T01:22:52.681 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:52.679+0000 7fa56ffff700 1 -- 172.21.15.50:0/756813923 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fa58001b400 con 0x7fa58815a010 2023-10-06T01:22:52.681 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:52.680+0000 7fa56ffff700 1 --2- 172.21.15.50:0/756813923 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7fa574066f30 0x7fa5740693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:52.681 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:52.680+0000 7fa56ffff700 1 -- 172.21.15.50:0/756813923 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5526+0+0 (secure 0 0 0) 0x7fa5800847b0 con 0x7fa58815a010 2023-10-06T01:22:52.681 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:52.681+0000 7fa587fff700 1 --2- 172.21.15.50:0/756813923 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7fa574066f30 0x7fa5740693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:52.682 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:52.681+0000 7fa587fff700 1 --2- 172.21.15.50:0/756813923 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7fa574066f30 0x7fa5740693e0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fa578006fd0 tx=0x7fa578008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:22:52.685 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:52.684+0000 7fa56ffff700 1 -- 172.21.15.50:0/756813923 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fa580051a30 con 0x7fa58815a010 2023-10-06T01:22:52.888 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:52.887+0000 7fa58d79d700 1 -- 172.21.15.50:0/756813923 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa588153120 con 0x7fa58815a010 2023-10-06T01:22:52.889 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:52.888+0000 7fa56ffff700 1 -- 172.21.15.50:0/756813923 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v35) v1 ==== 74+0+13855 (secure 0 0 0) 0x7fa580055050 con 0x7fa58815a010 2023-10-06T01:22:52.889 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-10-06T01:22:52.889 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":35,"fsid":"0bfd9a6b-1587-4fe4-a89e-e43c00286b4e","created":"2023-10-06T01:21:16.828801+0000","modified":"2023-10-06T01:22:48.898762+0000","last_up_change":"2023-10-06T01:21:28.584523+0000","last_in_change":"2023-10-06T01:21:20.179863+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-10-06T01:21:29.304225+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":".mgr","create_time":"2023-10-06T01:21:29.835490+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"9060727a-3959-4de3-8363-c5c5d7826c9a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":87837},{"type":"v1","addr":"172.21.15.50:6801","nonce":87837}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":87837},{"type":"v1","addr":"172.21.15.50:6803","nonce":87837}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":87837},{"type":"v1","addr":"172.21.15.50:6807","nonce":87837}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":87837},{"type":"v1","addr":"172.21.15.50:6805","nonce":87837}]},"public_addr":"172.21.15.50:6801/87837","cluster_addr":"172.21.15.50:6803/87837","heartbeat_back_addr":"172.21.15.50:6807/87837","heartbeat_front_addr":"172.21.15.50:6805/87837","state":["exists","up"]},{"osd":1,"uuid":"5ad9ef12-b579-47ea-b690-90ba887e2cef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":87853},{"type":"v1","addr":"172.21.15.50:6809","nonce":87853}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":87853},{"type":"v1","addr":"172.21.15.50:6811","nonce":87853}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":87853},{"type":"v1","addr":"172.21.15.50:6815","nonce":87853}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":87853},{"type":"v1","addr":"172.21.15.50:6813","nonce":87853}]},"public_addr":"172.21.15.50:6809/87853","cluster_addr":"172.21.15.50:6811/87853","heartbeat_back_addr":"172.21.15.50:6815/87853","heartbeat_front_addr":"172.21.15.50:6813/87853","state":["exists","up"]},{"osd":2,"uuid":"c7aee044-6f75-436f-90e1-ba42a57359bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6821","nonce":87855},{"type":"v1","addr":"172.21.15.50:6822","nonce":87855}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6824","nonce":87855},{"type":"v1","addr":"172.21.15.50:6826","nonce":87855}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":87855},{"type":"v1","addr":"172.21.15.50:6831","nonce":87855}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":87855},{"type":"v1","addr":"172.21.15.50:6829","nonce":87855}]},"public_addr":"172.21.15.50:6822/87855","cluster_addr":"172.21.15.50:6826/87855","heartbeat_back_addr":"172.21.15.50:6831/87855","heartbeat_front_addr":"172.21.15.50:6829/87855","state":["exists","up"]},{"osd":3,"uuid":"d9b901c8-e8b2-44af-9508-f453120a96c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":87856},{"type":"v1","addr":"172.21.15.50:6817","nonce":87856}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":87856},{"type":"v1","addr":"172.21.15.50:6819","nonce":87856}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6825","nonce":87856},{"type":"v1","addr":"172.21.15.50:6827","nonce":87856}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6820","nonce":87856},{"type":"v1","addr":"172.21.15.50:6823","nonce":87856}]},"public_addr":"172.21.15.50:6817/87856","cluster_addr":"172.21.15.50:6819/87856","heartbeat_back_addr":"172.21.15.50:6827/87856","heartbeat_front_addr":"172.21.15.50:6823/87856","state":["exists","up"]},{"osd":4,"uuid":"2b3c6b38-e3e9-4301-9445-60fd3fe8ce03","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":85805},{"type":"v1","addr":"172.21.15.155:6801","nonce":85805}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":85805},{"type":"v1","addr":"172.21.15.155:6803","nonce":85805}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6806","nonce":85805},{"type":"v1","addr":"172.21.15.155:6807","nonce":85805}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6804","nonce":85805},{"type":"v1","addr":"172.21.15.155:6805","nonce":85805}]},"public_addr":"172.21.15.155:6801/85805","cluster_addr":"172.21.15.155:6803/85805","heartbeat_back_addr":"172.21.15.155:6807/85805","heartbeat_front_addr":"172.21.15.155:6805/85805","state":["exists","up"]},{"osd":5,"uuid":"417b5f8f-65f1-4c94-91a7-a6ce03fe1679","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6816","nonce":85807},{"type":"v1","addr":"172.21.15.155:6818","nonce":85807}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6820","nonce":85807},{"type":"v1","addr":"172.21.15.155:6822","nonce":85807}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6828","nonce":85807},{"type":"v1","addr":"172.21.15.155:6830","nonce":85807}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6824","nonce":85807},{"type":"v1","addr":"172.21.15.155:6826","nonce":85807}]},"public_addr":"172.21.15.155:6818/85807","cluster_addr":"172.21.15.155:6822/85807","heartbeat_back_addr":"172.21.15.155:6830/85807","heartbeat_front_addr":"172.21.15.155:6826/85807","state":["exists","up"]},{"osd":6,"uuid":"c150cff3-aee4-4714-9c08-d182b1ba9ffd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6808","nonce":85806},{"type":"v1","addr":"172.21.15.155:6809","nonce":85806}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6810","nonce":85806},{"type":"v1","addr":"172.21.15.155:6811","nonce":85806}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6814","nonce":85806},{"type":"v1","addr":"172.21.15.155:6815","nonce":85806}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6812","nonce":85806},{"type":"v1","addr":"172.21.15.155:6813","nonce":85806}]},"public_addr":"172.21.15.155:6809/85806","cluster_addr":"172.21.15.155:6811/85806","heartbeat_back_addr":"172.21.15.155:6815/85806","heartbeat_front_addr":"172.21.15.155:6813/85806","state":["exists","up"]},{"osd":7,"uuid":"71107f0e-04d1-4e72-a0ec-0faf6af003e7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6817","nonce":85832},{"type":"v1","addr":"172.21.15.155:6819","nonce":85832}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6821","nonce":85832},{"type":"v1","addr":"172.21.15.155:6823","nonce":85832}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6829","nonce":85832},{"type":"v1","addr":"172.21.15.155:6831","nonce":85832}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6825","nonce":85832},{"type":"v1","addr":"172.21.15.155:6827","nonce":85832}]},"public_addr":"172.21.15.155:6819/85832","cluster_addr":"172.21.15.155:6823/85832","heartbeat_back_addr":"172.21.15.155:6831/85832","heartbeat_front_addr":"172.21.15.155:6827/85832","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:21:25.423389+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:21:25.472661+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:21:25.817562+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:21:25.551257+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:21:25.407818+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:21:25.557976+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:21:25.747299+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:21:25.827576+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T01:22:52.892 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:52.891+0000 7fa58d79d700 1 -- 172.21.15.50:0/756813923 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7fa574066f30 msgr2=0x7fa5740693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:52.892 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:52.891+0000 7fa58d79d700 1 --2- 172.21.15.50:0/756813923 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7fa574066f30 0x7fa5740693e0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fa578006fd0 tx=0x7fa578008040 comp rx=0 tx=0).stop 2023-10-06T01:22:52.892 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:52.891+0000 7fa58d79d700 1 -- 172.21.15.50:0/756813923 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa58815a010 msgr2=0x7fa5880aa770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:52.892 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:52.891+0000 7fa58d79d700 1 --2- 172.21.15.50:0/756813923 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa58815a010 0x7fa5880aa770 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7fa58000c890 tx=0x7fa5800026a0 comp rx=0 tx=0).stop 2023-10-06T01:22:52.892 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:52.891+0000 7fa58d79d700 1 -- 172.21.15.50:0/756813923 shutdown_connections 2023-10-06T01:22:52.892 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:52.891+0000 7fa58d79d700 1 --2- 172.21.15.50:0/756813923 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa58815a010 0x7fa5880aa770 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:52.892 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:52.891+0000 7fa58d79d700 1 --2- 172.21.15.50:0/756813923 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa5881538f0 0x7fa588144ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:52.892 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:52.891+0000 7fa58d79d700 1 --2- 172.21.15.50:0/756813923 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7fa574066f30 0x7fa5740693e0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:52.893 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:52.891+0000 7fa58d79d700 1 --2- 172.21.15.50:0/756813923 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa588153cc0 0x7fa5880aa230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:52.893 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:52.891+0000 7fa58d79d700 1 -- 172.21.15.50:0/756813923 >> 172.21.15.50:0/756813923 conn(0x7fa5880691d0 msgr2=0x7fa5880aaf80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:22:52.893 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:52.891+0000 7fa58d79d700 1 -- 172.21.15.50:0/756813923 shutdown_connections 2023-10-06T01:22:52.893 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:52.891+0000 7fa58d79d700 1 -- 172.21.15.50:0/756813923 wait complete. 2023-10-06T01:22:52.910 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-10-06T01:21:29.304225+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-10-06T01:21:29.835490+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}] 2023-10-06T01:22:52.911 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-10-06T01:22:53.100 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:53.099+0000 7f5f1619d700 1 Processor -- start 2023-10-06T01:22:53.101 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:53.099+0000 7f5f1619d700 1 -- start start 2023-10-06T01:22:53.102 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:53.101+0000 7f5f1619d700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f5f10156130 0x7f5f10159ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:53.102 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:53.101+0000 7f5f1619d700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f5f100ae0f0 0x7f5f100c8a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:53.102 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:53.101+0000 7f5f1619d700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5f100acb10 con 0x7f5f100c8f70 2023-10-06T01:22:53.103 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:53.101+0000 7f5f1619d700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5f10156500 con 0x7f5f10156130 2023-10-06T01:22:53.103 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:53.101+0000 7f5f1619d700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5f1015a310 con 0x7f5f100ae0f0 2023-10-06T01:22:53.103 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:53.101+0000 7f5f1519b700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f5f10156130 0x7f5f10159ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:53.103 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:53.101+0000 7f5f1599c700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f5f100c8f70 0x7f5f1006e1a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:44802/0 (socket says 172.21.15.50:44802) 2023-10-06T01:22:53.103 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:53.101+0000 7f5f1599c700 1 -- 172.21.15.50:0/2846271527 learned_addr learned my addr 172.21.15.50:0/2846271527 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-10-06T01:22:53.103 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:53.101+0000 7f5f1499a700 1 --2- 172.21.15.50:0/2846271527 >> v2:172.21.15.155:3300/0 conn(0x7f5f100ae0f0 0x7f5f100c8a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:53.103 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:53.101+0000 7f5f1519b700 1 -- 172.21.15.50:0/2846271527 >> v2:172.21.15.155:3300/0 conn(0x7f5f100ae0f0 msgr2=0x7f5f100c8a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:22:53.103 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:53.101+0000 7f5f1519b700 1 --2- 172.21.15.50:0/2846271527 >> v2:172.21.15.155:3300/0 conn(0x7f5f100ae0f0 0x7f5f100c8a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:53.103 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:53.101+0000 7f5f1519b700 1 -- 172.21.15.50:0/2846271527 >> v1:172.21.15.50:6789/0 conn(0x7f5f100c8f70 legacy=0x7f5f1006e1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:53.103 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:53.101+0000 7f5f1519b700 1 -- 172.21.15.50:0/2846271527 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f1015a5f0 con 0x7f5f10156130 2023-10-06T01:22:53.103 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:53.102+0000 7f5f1519b700 1 --2- 172.21.15.50:0/2846271527 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5f10156130 0x7f5f10159ca0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f5f1006ee00 tx=0x7f5f0c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6e59046ff30251cf server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:22:53.104 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:53.102+0000 7f5f07fff700 1 -- 172.21.15.50:0/2846271527 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f0c00b6b0 con 0x7f5f10156130 2023-10-06T01:22:53.104 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:53.102+0000 7f5f07fff700 1 -- 172.21.15.50:0/2846271527 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f0c00b810 con 0x7f5f10156130 2023-10-06T01:22:53.105 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:53.102+0000 7f5f07fff700 1 -- 172.21.15.50:0/2846271527 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f0c00bbb0 con 0x7f5f10156130 2023-10-06T01:22:53.105 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:53.102+0000 7f5f1619d700 1 -- 172.21.15.50:0/2846271527 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5f10156130 msgr2=0x7f5f10159ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:53.105 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:53.102+0000 7f5f1619d700 1 --2- 172.21.15.50:0/2846271527 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5f10156130 0x7f5f10159ca0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f5f1006ee00 tx=0x7f5f0c0091a0 comp rx=0 tx=0).stop 2023-10-06T01:22:53.105 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:53.103+0000 7f5f1619d700 1 -- 172.21.15.50:0/2846271527 shutdown_connections 2023-10-06T01:22:53.105 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:53.103+0000 7f5f1619d700 1 --2- 172.21.15.50:0/2846271527 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5f10156130 0x7f5f10159ca0 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:53.105 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:53.103+0000 7f5f1619d700 1 --2- 172.21.15.50:0/2846271527 >> v2:172.21.15.155:3300/0 conn(0x7f5f100ae0f0 0x7f5f100c8a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:53.105 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:53.103+0000 7f5f1619d700 1 -- 172.21.15.50:0/2846271527 >> 172.21.15.50:0/2846271527 conn(0x7f5f100cbf10 msgr2=0x7f5f100cc310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:22:53.105 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:53.103+0000 7f5f1619d700 1 -- 172.21.15.50:0/2846271527 shutdown_connections 2023-10-06T01:22:53.105 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:53.103+0000 7f5f1619d700 1 -- 172.21.15.50:0/2846271527 wait complete. 2023-10-06T01:22:53.107 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:53.104+0000 7f5f1619d700 1 Processor -- start 2023-10-06T01:22:53.107 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:53.104+0000 7f5f1619d700 1 -- start start 2023-10-06T01:22:53.107 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:53.105+0000 7f5f1619d700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5f100ae0f0 0x7f5f1014b780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:53.107 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:53.105+0000 7f5f1619d700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5f100c8f70 0x7f5f1006e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:53.107 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:53.105+0000 7f5f1619d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5f10156130 0x7f5f1006e5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:53.107 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:53.105+0000 7f5f1619d700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f100c7c20 con 0x7f5f10156130 2023-10-06T01:22:53.107 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:53.105+0000 7f5f1619d700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f100c9e20 con 0x7f5f100c8f70 2023-10-06T01:22:53.107 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:53.105+0000 7f5f1619d700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f100cb290 con 0x7f5f100ae0f0 2023-10-06T01:22:53.108 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:53.106+0000 7f5f1599c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5f10156130 0x7f5f1006e5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:53.108 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:53.106+0000 7f5f1599c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5f10156130 0x7f5f1006e5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:52770/0 (socket says 172.21.15.50:52770) 2023-10-06T01:22:53.108 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:53.106+0000 7f5f1599c700 1 -- 172.21.15.50:0/3793325230 learned_addr learned my addr 172.21.15.50:0/3793325230 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-06T01:22:53.108 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:53.106+0000 7f5f1499a700 1 --2- 172.21.15.50:0/3793325230 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5f100c8f70 0x7f5f1006e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:53.108 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:53.106+0000 7f5f1519b700 1 --2- 172.21.15.50:0/3793325230 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5f100ae0f0 0x7f5f1014b780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:53.108 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:53.106+0000 7f5f1599c700 1 -- 172.21.15.50:0/3793325230 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5f100ae0f0 msgr2=0x7f5f1014b780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:53.108 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:53.106+0000 7f5f1599c700 1 --2- 172.21.15.50:0/3793325230 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5f100ae0f0 0x7f5f1014b780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:53.108 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:53.106+0000 7f5f1599c700 1 -- 172.21.15.50:0/3793325230 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5f100c8f70 msgr2=0x7f5f1006e090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:53.108 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:53.106+0000 7f5f1599c700 1 --2- 172.21.15.50:0/3793325230 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5f100c8f70 0x7f5f1006e090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:53.108 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:53.106+0000 7f5f1599c700 1 -- 172.21.15.50:0/3793325230 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f0c009420 con 0x7f5f10156130 2023-10-06T01:22:53.108 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:53.106+0000 7f5f1519b700 1 --2- 172.21.15.50:0/3793325230 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5f100ae0f0 0x7f5f1014b780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T01:22:53.109 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:53.106+0000 7f5f1599c700 1 --2- 172.21.15.50:0/3793325230 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5f10156130 0x7f5f1006e5d0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f5f0800cca0 tx=0x7f5f08001a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:22:53.109 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:53.107+0000 7f5f057fa700 1 -- 172.21.15.50:0/3793325230 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f0800a920 con 0x7f5f10156130 2023-10-06T01:22:53.110 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:53.107+0000 7f5f057fa700 1 -- 172.21.15.50:0/3793325230 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f0800aaa0 con 0x7f5f10156130 2023-10-06T01:22:53.110 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:53.107+0000 7f5f057fa700 1 -- 172.21.15.50:0/3793325230 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f0800ae60 con 0x7f5f10156130 2023-10-06T01:22:53.110 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:53.107+0000 7f5f1619d700 1 -- 172.21.15.50:0/3793325230 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5f100c94f0 con 0x7f5f10156130 2023-10-06T01:22:53.110 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:53.107+0000 7f5f1619d700 1 -- 172.21.15.50:0/3793325230 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5f100c9ab0 con 0x7f5f10156130 2023-10-06T01:22:53.110 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:53.108+0000 7f5f1619d700 1 -- 172.21.15.50:0/3793325230 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5f100c9fb0 con 0x7f5f10156130 2023-10-06T01:22:53.110 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:53.109+0000 7f5f057fa700 1 -- 172.21.15.50:0/3793325230 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f5f08007300 con 0x7f5f10156130 2023-10-06T01:22:53.111 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:53.109+0000 7f5f057fa700 1 --2- 172.21.15.50:0/3793325230 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f5ef4066f30 0x7f5ef40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:53.111 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:53.110+0000 7f5f057fa700 1 -- 172.21.15.50:0/3793325230 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5526+0+0 (secure 0 0 0) 0x7f5f080847a0 con 0x7f5f10156130 2023-10-06T01:22:53.111 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:53.110+0000 7f5f1519b700 1 --2- 172.21.15.50:0/3793325230 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f5ef4066f30 0x7f5ef40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:53.111 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:53.111+0000 7f5f1519b700 1 --2- 172.21.15.50:0/3793325230 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f5ef4066f30 0x7f5ef40693e0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f5f0c0093f0 tx=0x7f5f0c017000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:22:53.114 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:53.113+0000 7f5f057fa700 1 -- 172.21.15.50:0/3793325230 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f5f08051aa0 con 0x7f5f10156130 2023-10-06T01:22:53.315 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:53.314+0000 7f5f1619d700 1 -- 172.21.15.50:0/3793325230 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f5f1005f270 con 0x7f5f10156130 2023-10-06T01:22:53.316 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:53.314+0000 7f5f057fa700 1 -- 172.21.15.50:0/3793325230 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v35) v1 ==== 92+0+10 (secure 0 0 0) 0x7f5f080550c0 con 0x7f5f10156130 2023-10-06T01:22:53.316 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 8 2023-10-06T01:22:53.319 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:53.317+0000 7f5f1619d700 1 -- 172.21.15.50:0/3793325230 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f5ef4066f30 msgr2=0x7f5ef40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:53.319 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:53.317+0000 7f5f1619d700 1 --2- 172.21.15.50:0/3793325230 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f5ef4066f30 0x7f5ef40693e0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f5f0c0093f0 tx=0x7f5f0c017000 comp rx=0 tx=0).stop 2023-10-06T01:22:53.319 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:53.317+0000 7f5f1619d700 1 -- 172.21.15.50:0/3793325230 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5f10156130 msgr2=0x7f5f1006e5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:53.320 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:53.317+0000 7f5f1619d700 1 --2- 172.21.15.50:0/3793325230 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5f10156130 0x7f5f1006e5d0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f5f0800cca0 tx=0x7f5f08001a20 comp rx=0 tx=0).stop 2023-10-06T01:22:53.320 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:53.317+0000 7f5f1619d700 1 -- 172.21.15.50:0/3793325230 shutdown_connections 2023-10-06T01:22:53.320 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:53.317+0000 7f5f1619d700 1 --2- 172.21.15.50:0/3793325230 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5f10156130 0x7f5f1006e5d0 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:53.320 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:53.317+0000 7f5f1619d700 1 --2- 172.21.15.50:0/3793325230 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5f100ae0f0 0x7f5f1014b780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:53.320 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:53.317+0000 7f5f1619d700 1 --2- 172.21.15.50:0/3793325230 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f5ef4066f30 0x7f5ef40693e0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:53.321 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:53.317+0000 7f5f1619d700 1 --2- 172.21.15.50:0/3793325230 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5f100c8f70 0x7f5f1006e090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:53.321 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:53.317+0000 7f5f1619d700 1 -- 172.21.15.50:0/3793325230 >> 172.21.15.50:0/3793325230 conn(0x7f5f100cbf10 msgr2=0x7f5f10069790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:22:53.321 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:53.317+0000 7f5f1619d700 1 -- 172.21.15.50:0/3793325230 shutdown_connections 2023-10-06T01:22:53.321 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:53.317+0000 7f5f1619d700 1 -- 172.21.15.50:0/3793325230 wait complete. 2023-10-06T01:22:53.336 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-06T01:22:53.526 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:53.525+0000 7f4f2cd9d700 1 Processor -- start 2023-10-06T01:22:53.526 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:53.525+0000 7f4f2cd9d700 1 -- start start 2023-10-06T01:22:53.527 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:53.526+0000 7f4f2cd9d700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f4f2815a250 0x7f4f28164050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:53.527 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:53.526+0000 7f4f2cd9d700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4f2806d470 con 0x7f4f2813c470 2023-10-06T01:22:53.528 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:53.526+0000 7f4f2cd9d700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4f280c9740 con 0x7f4f280cb0a0 2023-10-06T01:22:53.528 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:53.526+0000 7f4f2cd9d700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4f2815a640 con 0x7f4f2815a250 2023-10-06T01:22:53.528 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:53.527+0000 7f4f277fe700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f4f2813c470 0x7f4f280ca990 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:44804/0 (socket says 172.21.15.50:44804) 2023-10-06T01:22:53.528 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:53.527+0000 7f4f277fe700 1 -- 172.21.15.50:0/3305546462 learned_addr learned my addr 172.21.15.50:0/3305546462 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-10-06T01:22:53.528 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:53.527+0000 7f4f27fff700 1 --2- 172.21.15.50:0/3305546462 >> v2:172.21.15.50:3300/0 conn(0x7f4f2815a250 0x7f4f28164050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:53.530 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:53.527+0000 7f4f267fc700 1 -- 172.21.15.50:0/3305546462 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1560313315 0 0) 0x7f4f2806d470 con 0x7f4f2813c470 2023-10-06T01:22:53.530 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:53.527+0000 7f4f267fc700 1 -- 172.21.15.50:0/3305546462 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4f10003570 con 0x7f4f2813c470 2023-10-06T01:22:53.530 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:53.527+0000 7f4f267fc700 1 -- 172.21.15.50:0/3305546462 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1376283745 0 0) 0x7f4f280c9740 con 0x7f4f280cb0a0 2023-10-06T01:22:53.530 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:53.527+0000 7f4f267fc700 1 -- 172.21.15.50:0/3305546462 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4f2806d470 con 0x7f4f280cb0a0 2023-10-06T01:22:53.530 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:53.527+0000 7f4f267fc700 1 -- 172.21.15.50:0/3305546462 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 766591793 0 0) 0x7f4f10003570 con 0x7f4f2813c470 2023-10-06T01:22:53.530 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:53.527+0000 7f4f27fff700 1 -- 172.21.15.50:0/3305546462 >> v1:172.21.15.155:6789/0 conn(0x7f4f280cb0a0 legacy=0x7f4f28159b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:53.530 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:53.527+0000 7f4f27fff700 1 -- 172.21.15.50:0/3305546462 >> v1:172.21.15.50:6789/0 conn(0x7f4f2813c470 legacy=0x7f4f280ca990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:53.530 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:53.527+0000 7f4f27fff700 1 -- 172.21.15.50:0/3305546462 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f2806cb80 con 0x7f4f2815a250 2023-10-06T01:22:53.531 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:53.528+0000 7f4f27fff700 1 --2- 172.21.15.50:0/3305546462 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4f2815a250 0x7f4f28164050 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f4f20009e60 tx=0x7f4f20009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=79e13b5efc7e8bb9 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:22:53.531 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:53.528+0000 7f4f267fc700 1 -- 172.21.15.50:0/3305546462 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f2000e070 con 0x7f4f2815a250 2023-10-06T01:22:53.531 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:53.528+0000 7f4f267fc700 1 -- 172.21.15.50:0/3305546462 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f2000b7a0 con 0x7f4f2815a250 2023-10-06T01:22:53.531 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:53.528+0000 7f4f267fc700 1 -- 172.21.15.50:0/3305546462 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f18001470 con 0x7f4f2815a250 2023-10-06T01:22:53.531 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:53.528+0000 7f4f2cd9d700 1 -- 172.21.15.50:0/3305546462 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4f2815a250 msgr2=0x7f4f28164050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:53.531 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:53.528+0000 7f4f2cd9d700 1 --2- 172.21.15.50:0/3305546462 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4f2815a250 0x7f4f28164050 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f4f20009e60 tx=0x7f4f20009780 comp rx=0 tx=0).stop 2023-10-06T01:22:53.531 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:53.529+0000 7f4f2cd9d700 1 -- 172.21.15.50:0/3305546462 shutdown_connections 2023-10-06T01:22:53.531 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:53.529+0000 7f4f2cd9d700 1 --2- 172.21.15.50:0/3305546462 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4f2815a250 0x7f4f28164050 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:53.531 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:53.529+0000 7f4f2cd9d700 1 -- 172.21.15.50:0/3305546462 >> 172.21.15.50:0/3305546462 conn(0x7f4f2806b370 msgr2=0x7f4f2806b770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:22:53.531 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:53.529+0000 7f4f2cd9d700 1 -- 172.21.15.50:0/3305546462 shutdown_connections 2023-10-06T01:22:53.531 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:53.529+0000 7f4f2cd9d700 1 -- 172.21.15.50:0/3305546462 wait complete. 2023-10-06T01:22:53.533 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:53.530+0000 7f4f2cd9d700 1 Processor -- start 2023-10-06T01:22:53.534 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:53.530+0000 7f4f2cd9d700 1 -- start start 2023-10-06T01:22:53.534 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:53.531+0000 7f4f2cd9d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4f280cb0a0 0x7f4f280b3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:53.534 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:53.531+0000 7f4f2cd9d700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4f2813c470 0x7f4f2813ab50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:53.534 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:53.531+0000 7f4f2cd9d700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4f2815a250 0x7f4f2815dc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:53.534 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:53.531+0000 7f4f2cd9d700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f2813b090 con 0x7f4f280cb0a0 2023-10-06T01:22:53.534 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:53.531+0000 7f4f2cd9d700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f280b0e90 con 0x7f4f2815a250 2023-10-06T01:22:53.534 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:53.531+0000 7f4f2cd9d700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f280b1450 con 0x7f4f2813c470 2023-10-06T01:22:53.534 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:53.532+0000 7f4f277fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4f280cb0a0 0x7f4f280b3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:53.534 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:53.532+0000 7f4f277fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4f280cb0a0 0x7f4f280b3940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:52790/0 (socket says 172.21.15.50:52790) 2023-10-06T01:22:53.534 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:53.532+0000 7f4f277fe700 1 -- 172.21.15.50:0/2800540200 learned_addr learned my addr 172.21.15.50:0/2800540200 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-06T01:22:53.534 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:53.532+0000 7f4f27fff700 1 --2- 172.21.15.50:0/2800540200 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4f2815a250 0x7f4f2815dc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:53.535 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:53.532+0000 7f4f26ffd700 1 --2- 172.21.15.50:0/2800540200 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4f2813c470 0x7f4f2813ab50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:53.535 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:53.532+0000 7f4f277fe700 1 -- 172.21.15.50:0/2800540200 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4f2813c470 msgr2=0x7f4f2813ab50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:53.535 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:53.532+0000 7f4f277fe700 1 --2- 172.21.15.50:0/2800540200 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4f2813c470 0x7f4f2813ab50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:53.535 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:53.532+0000 7f4f277fe700 1 -- 172.21.15.50:0/2800540200 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4f2815a250 msgr2=0x7f4f2815dc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:53.535 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:53.532+0000 7f4f277fe700 1 --2- 172.21.15.50:0/2800540200 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4f2815a250 0x7f4f2815dc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:53.535 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:53.532+0000 7f4f277fe700 1 -- 172.21.15.50:0/2800540200 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f20009a20 con 0x7f4f280cb0a0 2023-10-06T01:22:53.535 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:53.532+0000 7f4f26ffd700 1 --2- 172.21.15.50:0/2800540200 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4f2813c470 0x7f4f2813ab50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T01:22:53.535 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:53.532+0000 7f4f277fe700 1 --2- 172.21.15.50:0/2800540200 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4f280cb0a0 0x7f4f280b3940 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f4f1800cb90 tx=0x7f4f18001ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:22:53.535 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:53.532+0000 7f4f0f7fe700 1 -- 172.21.15.50:0/2800540200 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f18001d00 con 0x7f4f280cb0a0 2023-10-06T01:22:53.535 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:53.533+0000 7f4f0f7fe700 1 -- 172.21.15.50:0/2800540200 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f18007360 con 0x7f4f280cb0a0 2023-10-06T01:22:53.535 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:53.533+0000 7f4f2cd9d700 1 -- 172.21.15.50:0/2800540200 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4f2815cbb0 con 0x7f4f280cb0a0 2023-10-06T01:22:53.536 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:53.533+0000 7f4f0f7fe700 1 -- 172.21.15.50:0/2800540200 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f18004830 con 0x7f4f280cb0a0 2023-10-06T01:22:53.536 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:53.533+0000 7f4f2cd9d700 1 -- 172.21.15.50:0/2800540200 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4f280b10e0 con 0x7f4f280cb0a0 2023-10-06T01:22:53.536 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:53.534+0000 7f4f2cd9d700 1 -- 172.21.15.50:0/2800540200 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4f2805f270 con 0x7f4f280cb0a0 2023-10-06T01:22:53.537 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:53.535+0000 7f4f0f7fe700 1 -- 172.21.15.50:0/2800540200 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f4f18004ba0 con 0x7f4f280cb0a0 2023-10-06T01:22:53.537 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:53.535+0000 7f4f0f7fe700 1 --2- 172.21.15.50:0/2800540200 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f4f14066f30 0x7f4f140693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:53.537 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:53.535+0000 7f4f0f7fe700 1 -- 172.21.15.50:0/2800540200 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5526+0+0 (secure 0 0 0) 0x7f4f18083dd0 con 0x7f4f280cb0a0 2023-10-06T01:22:53.537 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:53.536+0000 7f4f26ffd700 1 --2- 172.21.15.50:0/2800540200 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f4f14066f30 0x7f4f140693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:53.537 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:53.537+0000 7f4f26ffd700 1 --2- 172.21.15.50:0/2800540200 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f4f14066f30 0x7f4f140693e0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f4f1c007fd0 tx=0x7f4f1c009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:22:53.540 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:53.539+0000 7f4f0f7fe700 1 -- 172.21.15.50:0/2800540200 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4f180510d0 con 0x7f4f280cb0a0 2023-10-06T01:22:53.742 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:53.742+0000 7f4f2cd9d700 1 -- 172.21.15.50:0/2800540200 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f4f280b1270 con 0x7f4f280cb0a0 2023-10-06T01:22:53.743 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:53.742+0000 7f4f0f7fe700 1 -- 172.21.15.50:0/2800540200 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v35) v1 ==== 93+0+10 (secure 0 0 0) 0x7f4f18018020 con 0x7f4f280cb0a0 2023-10-06T01:22:53.743 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 1 2023-10-06T01:22:53.746 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:53.744+0000 7f4f2cd9d700 1 -- 172.21.15.50:0/2800540200 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f4f14066f30 msgr2=0x7f4f140693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:53.746 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:53.744+0000 7f4f2cd9d700 1 --2- 172.21.15.50:0/2800540200 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f4f14066f30 0x7f4f140693e0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f4f1c007fd0 tx=0x7f4f1c009040 comp rx=0 tx=0).stop 2023-10-06T01:22:53.746 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:53.744+0000 7f4f2cd9d700 1 -- 172.21.15.50:0/2800540200 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4f280cb0a0 msgr2=0x7f4f280b3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:53.747 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:53.744+0000 7f4f2cd9d700 1 --2- 172.21.15.50:0/2800540200 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4f280cb0a0 0x7f4f280b3940 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f4f1800cb90 tx=0x7f4f18001ab0 comp rx=0 tx=0).stop 2023-10-06T01:22:53.747 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:53.745+0000 7f4f2cd9d700 1 -- 172.21.15.50:0/2800540200 shutdown_connections 2023-10-06T01:22:53.747 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:53.745+0000 7f4f2cd9d700 1 --2- 172.21.15.50:0/2800540200 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f4f14066f30 0x7f4f140693e0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:53.747 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:53.745+0000 7f4f2cd9d700 1 --2- 172.21.15.50:0/2800540200 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4f2815a250 0x7f4f2815dc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:53.747 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:53.745+0000 7f4f2cd9d700 1 --2- 172.21.15.50:0/2800540200 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4f280cb0a0 0x7f4f280b3940 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:53.748 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:53.745+0000 7f4f2cd9d700 1 --2- 172.21.15.50:0/2800540200 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4f2813c470 0x7f4f2813ab50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:53.748 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:53.745+0000 7f4f2cd9d700 1 -- 172.21.15.50:0/2800540200 >> 172.21.15.50:0/2800540200 conn(0x7f4f2806b370 msgr2=0x7f4f280c8b00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:22:53.748 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:53.745+0000 7f4f2cd9d700 1 -- 172.21.15.50:0/2800540200 shutdown_connections 2023-10-06T01:22:53.748 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:53.745+0000 7f4f2cd9d700 1 -- 172.21.15.50:0/2800540200 wait complete. 2023-10-06T01:22:53.763 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-10-06T01:22:53.952 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:53.951+0000 7f356f39d700 1 Processor -- start 2023-10-06T01:22:53.952 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:53.951+0000 7f356f39d700 1 -- start start 2023-10-06T01:22:53.956 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:53.952+0000 7f356f39d700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f35680689b0 0x7f356815d9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:53.956 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:53.952+0000 7f356f39d700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f35680cc0d0 0x7f35680c6d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:53.956 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:53.952+0000 7f356f39d700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f356815a860 con 0x7f3568068d80 2023-10-06T01:22:53.956 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:53.952+0000 7f356f39d700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f35680cac60 con 0x7f35680689b0 2023-10-06T01:22:53.956 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:53.952+0000 7f356f39d700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35680c7400 con 0x7f35680cc0d0 2023-10-06T01:22:53.956 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:53.953+0000 7f356db9a700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f3568068d80 0x7f35680cb9c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:44806/0 (socket says 172.21.15.50:44806) 2023-10-06T01:22:53.956 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:53.953+0000 7f356db9a700 1 -- 172.21.15.50:0/94953063 learned_addr learned my addr 172.21.15.50:0/94953063 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-10-06T01:22:53.957 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:53.953+0000 7f356eb9c700 1 --2- 172.21.15.50:0/94953063 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f35680cc0d0 0x7f35680c6d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:53.957 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:53.953+0000 7f356e39b700 1 --2- 172.21.15.50:0/94953063 >> v2:172.21.15.155:3300/0 conn(0x7f35680689b0 0x7f356815d9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:53.957 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:53.953+0000 7f356d399700 1 -- 172.21.15.50:0/94953063 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2803197854 0 0) 0x7f356815a860 con 0x7f3568068d80 2023-10-06T01:22:53.957 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:53.953+0000 7f356d399700 1 -- 172.21.15.50:0/94953063 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3554003570 con 0x7f3568068d80 2023-10-06T01:22:53.957 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:53.953+0000 7f356eb9c700 1 -- 172.21.15.50:0/94953063 >> v2:172.21.15.155:3300/0 conn(0x7f35680689b0 msgr2=0x7f356815d9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:22:53.957 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:53.953+0000 7f356eb9c700 1 --2- 172.21.15.50:0/94953063 >> v2:172.21.15.155:3300/0 conn(0x7f35680689b0 0x7f356815d9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:53.957 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:53.953+0000 7f356eb9c700 1 -- 172.21.15.50:0/94953063 >> v1:172.21.15.50:6789/0 conn(0x7f3568068d80 legacy=0x7f35680cb9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:53.958 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:53.953+0000 7f356eb9c700 1 -- 172.21.15.50:0/94953063 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35680ca330 con 0x7f35680cc0d0 2023-10-06T01:22:53.958 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:53.954+0000 7f356eb9c700 1 --2- 172.21.15.50:0/94953063 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f35680cc0d0 0x7f35680c6d00 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f3560009e60 tx=0x7f3560009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=326086c274dd32b2 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:22:53.958 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:53.954+0000 7f356d399700 1 -- 172.21.15.50:0/94953063 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f356000e070 con 0x7f35680cc0d0 2023-10-06T01:22:53.958 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:53.954+0000 7f356d399700 1 -- 172.21.15.50:0/94953063 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f356000bab0 con 0x7f35680cc0d0 2023-10-06T01:22:53.958 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:53.954+0000 7f356d399700 1 -- 172.21.15.50:0/94953063 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f356000be70 con 0x7f35680cc0d0 2023-10-06T01:22:53.958 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:53.954+0000 7f356f39d700 1 -- 172.21.15.50:0/94953063 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f35680cc0d0 msgr2=0x7f35680c6d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:53.958 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:53.954+0000 7f356f39d700 1 --2- 172.21.15.50:0/94953063 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f35680cc0d0 0x7f35680c6d00 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f3560009e60 tx=0x7f3560009780 comp rx=0 tx=0).stop 2023-10-06T01:22:53.959 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:53.954+0000 7f356f39d700 1 -- 172.21.15.50:0/94953063 shutdown_connections 2023-10-06T01:22:53.959 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:53.954+0000 7f356f39d700 1 --2- 172.21.15.50:0/94953063 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f35680cc0d0 0x7f35680c6d00 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:53.959 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:53.954+0000 7f356f39d700 1 --2- 172.21.15.50:0/94953063 >> v2:172.21.15.155:3300/0 conn(0x7f35680689b0 0x7f356815d9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:53.959 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:53.954+0000 7f356f39d700 1 -- 172.21.15.50:0/94953063 >> 172.21.15.50:0/94953063 conn(0x7f35680cd230 msgr2=0x7f35680c91d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:22:53.959 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:53.955+0000 7f356f39d700 1 -- 172.21.15.50:0/94953063 shutdown_connections 2023-10-06T01:22:53.959 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:53.955+0000 7f356f39d700 1 -- 172.21.15.50:0/94953063 wait complete. 2023-10-06T01:22:53.962 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:53.956+0000 7f356f39d700 1 Processor -- start 2023-10-06T01:22:53.963 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:53.956+0000 7f356f39d700 1 -- start start 2023-10-06T01:22:53.963 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:53.957+0000 7f356f39d700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f35680689b0 0x7f3568158930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:53.963 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:53.957+0000 7f356f39d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3568068d80 0x7f35680b08d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:53.963 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:53.957+0000 7f356f39d700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f35680cc0d0 0x7f356815e840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:53.963 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:53.957+0000 7f356f39d700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35680b0fd0 con 0x7f3568068d80 2023-10-06T01:22:53.964 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:53.957+0000 7f356f39d700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35680b1cf0 con 0x7f35680cc0d0 2023-10-06T01:22:53.964 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:53.957+0000 7f356f39d700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35681591f0 con 0x7f35680689b0 2023-10-06T01:22:53.964 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:53.957+0000 7f356db9a700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3568068d80 0x7f35680b08d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:53.964 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:53.957+0000 7f356db9a700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3568068d80 0x7f35680b08d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:52798/0 (socket says 172.21.15.50:52798) 2023-10-06T01:22:53.964 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:53.957+0000 7f356db9a700 1 -- 172.21.15.50:0/12702306 learned_addr learned my addr 172.21.15.50:0/12702306 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-06T01:22:53.964 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:53.958+0000 7f356e39b700 1 --2- 172.21.15.50:0/12702306 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f35680689b0 0x7f3568158930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:53.964 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:53.958+0000 7f356eb9c700 1 --2- 172.21.15.50:0/12702306 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f35680cc0d0 0x7f356815e840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:53.965 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:53.958+0000 7f356db9a700 1 -- 172.21.15.50:0/12702306 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f35680689b0 msgr2=0x7f3568158930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:53.965 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:53.958+0000 7f356db9a700 1 --2- 172.21.15.50:0/12702306 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f35680689b0 0x7f3568158930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:53.965 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:53.958+0000 7f356db9a700 1 -- 172.21.15.50:0/12702306 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f35680cc0d0 msgr2=0x7f356815e840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:53.965 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:53.958+0000 7f356db9a700 1 --2- 172.21.15.50:0/12702306 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f35680cc0d0 0x7f356815e840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:53.965 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:53.958+0000 7f356db9a700 1 -- 172.21.15.50:0/12702306 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3560009a20 con 0x7f3568068d80 2023-10-06T01:22:53.965 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:53.958+0000 7f356db9a700 1 --2- 172.21.15.50:0/12702306 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3568068d80 0x7f35680b08d0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f355800c7c0 tx=0x7f3558007dd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:22:53.966 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:53.958+0000 7f355e7fc700 1 -- 172.21.15.50:0/12702306 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3558005c00 con 0x7f3568068d80 2023-10-06T01:22:53.966 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:53.958+0000 7f355e7fc700 1 -- 172.21.15.50:0/12702306 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3558005d60 con 0x7f3568068d80 2023-10-06T01:22:53.966 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:53.958+0000 7f355e7fc700 1 -- 172.21.15.50:0/12702306 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3558007320 con 0x7f3568068d80 2023-10-06T01:22:53.966 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:53.958+0000 7f356f39d700 1 -- 172.21.15.50:0/12702306 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f35680b1400 con 0x7f3568068d80 2023-10-06T01:22:53.966 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:53.958+0000 7f356f39d700 1 -- 172.21.15.50:0/12702306 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f35680b1980 con 0x7f3568068d80 2023-10-06T01:22:53.966 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:53.959+0000 7f356f39d700 1 -- 172.21.15.50:0/12702306 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f35680b1e60 con 0x7f3568068d80 2023-10-06T01:22:53.966 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:53.960+0000 7f355e7fc700 1 -- 172.21.15.50:0/12702306 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f3558007690 con 0x7f3568068d80 2023-10-06T01:22:53.966 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:53.962+0000 7f355e7fc700 1 --2- 172.21.15.50:0/12702306 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f354c066f30 0x7f354c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:53.966 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:53.962+0000 7f355e7fc700 1 -- 172.21.15.50:0/12702306 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5526+0+0 (secure 0 0 0) 0x7f3558084040 con 0x7f3568068d80 2023-10-06T01:22:53.967 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:53.962+0000 7f356e39b700 1 --2- 172.21.15.50:0/12702306 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f354c066f30 0x7f354c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:53.967 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:53.963+0000 7f356e39b700 1 --2- 172.21.15.50:0/12702306 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f354c066f30 0x7f354c0693e0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f3564009ca0 tx=0x7f3564008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:22:53.967 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:53.966+0000 7f355e7fc700 1 -- 172.21.15.50:0/12702306 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f3558051340 con 0x7f3568068d80 2023-10-06T01:22:54.173 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:54.172+0000 7f356f39d700 1 -- 172.21.15.50:0/12702306 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f35680b1150 con 0x7f3568068d80 2023-10-06T01:22:54.173 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:54.173+0000 7f355e7fc700 1 -- 172.21.15.50:0/12702306 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v35) v1 ==== 84+0+126 (secure 0 0 0) 0x7f3558054960 con 0x7f3568068d80 2023-10-06T01:22:54.174 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-10-06T01:22:54.174 INFO:teuthology.orchestra.run.smithi050.stdout:[ 2023-10-06T01:22:54.174 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-10-06T01:22:54.174 INFO:teuthology.orchestra.run.smithi050.stdout: "poolnum": 1, 2023-10-06T01:22:54.174 INFO:teuthology.orchestra.run.smithi050.stdout: "poolname": "rbd" 2023-10-06T01:22:54.174 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-06T01:22:54.174 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-10-06T01:22:54.174 INFO:teuthology.orchestra.run.smithi050.stdout: "poolnum": 2, 2023-10-06T01:22:54.175 INFO:teuthology.orchestra.run.smithi050.stdout: "poolname": ".mgr" 2023-10-06T01:22:54.175 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-10-06T01:22:54.175 INFO:teuthology.orchestra.run.smithi050.stdout:] 2023-10-06T01:22:54.176 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:54.175+0000 7f356f39d700 1 -- 172.21.15.50:0/12702306 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f354c066f30 msgr2=0x7f354c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:54.176 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:54.175+0000 7f356f39d700 1 --2- 172.21.15.50:0/12702306 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f354c066f30 0x7f354c0693e0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f3564009ca0 tx=0x7f3564008040 comp rx=0 tx=0).stop 2023-10-06T01:22:54.176 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:54.175+0000 7f356f39d700 1 -- 172.21.15.50:0/12702306 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3568068d80 msgr2=0x7f35680b08d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:54.176 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:54.175+0000 7f356f39d700 1 --2- 172.21.15.50:0/12702306 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3568068d80 0x7f35680b08d0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f355800c7c0 tx=0x7f3558007dd0 comp rx=0 tx=0).stop 2023-10-06T01:22:54.176 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:54.175+0000 7f356f39d700 1 -- 172.21.15.50:0/12702306 shutdown_connections 2023-10-06T01:22:54.176 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:54.175+0000 7f356f39d700 1 --2- 172.21.15.50:0/12702306 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f354c066f30 0x7f354c0693e0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:54.177 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:54.175+0000 7f356f39d700 1 --2- 172.21.15.50:0/12702306 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f35680cc0d0 0x7f356815e840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:54.177 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:54.175+0000 7f356f39d700 1 --2- 172.21.15.50:0/12702306 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f35680689b0 0x7f3568158930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:54.177 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:54.175+0000 7f356f39d700 1 --2- 172.21.15.50:0/12702306 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3568068d80 0x7f35680b08d0 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:54.177 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:54.175+0000 7f356f39d700 1 -- 172.21.15.50:0/12702306 >> 172.21.15.50:0/12702306 conn(0x7f35680cd230 msgr2=0x7f356806ae10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:22:54.177 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:54.175+0000 7f356f39d700 1 -- 172.21.15.50:0/12702306 shutdown_connections 2023-10-06T01:22:54.177 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:54.175+0000 7f356f39d700 1 -- 172.21.15.50:0/12702306 wait complete. 2023-10-06T01:22:54.193 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-10-06T01:22:54.193 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-10-06T01:22:54.385 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:54.384+0000 7faaeb59e700 1 Processor -- start 2023-10-06T01:22:54.385 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:54.384+0000 7faaeb59e700 1 -- start start 2023-10-06T01:22:54.387 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:54.385+0000 7faaeb59e700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7faaec1593a0 0x7faaec0b5d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:54.387 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:54.385+0000 7faaeb59e700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7faaec159770 0x7faaec0b3d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:54.387 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:54.385+0000 7faaeb59e700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7faaec0b42c0 0x7faaec0cf3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:54.387 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:54.385+0000 7faaeb59e700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faaec0ab200 con 0x7faaec1593a0 2023-10-06T01:22:54.387 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:54.385+0000 7faaeb59e700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faaec0b4720 con 0x7faaec159770 2023-10-06T01:22:54.387 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:54.385+0000 7faaeb59e700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faaec0b1660 con 0x7faaec0b42c0 2023-10-06T01:22:54.387 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:54.385+0000 7faaea59c700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7faaec1593a0 0x7faaec0b5d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:54.387 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:54.385+0000 7faaea59c700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7faaec1593a0 0x7faaec0b5d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:52812/0 (socket says 172.21.15.50:52812) 2023-10-06T01:22:54.387 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:54.385+0000 7faaea59c700 1 -- 172.21.15.50:0/831561417 learned_addr learned my addr 172.21.15.50:0/831561417 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-06T01:22:54.388 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:54.386+0000 7faaead9d700 1 --2- 172.21.15.50:0/831561417 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7faaec0b42c0 0x7faaec0cf3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:54.388 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:54.386+0000 7faae9d9b700 1 --2- 172.21.15.50:0/831561417 >> v2:172.21.15.155:3300/0 conn(0x7faaec159770 0x7faaec0b3d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:54.388 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:54.386+0000 7faaea59c700 1 -- 172.21.15.50:0/831561417 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7faaec0b42c0 msgr2=0x7faaec0cf3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:22:54.388 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:54.386+0000 7faaea59c700 1 --2- 172.21.15.50:0/831561417 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7faaec0b42c0 0x7faaec0cf3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:54.388 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:54.386+0000 7faaea59c700 1 -- 172.21.15.50:0/831561417 >> v2:172.21.15.155:3300/0 conn(0x7faaec159770 msgr2=0x7faaec0b3d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:22:54.388 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:54.386+0000 7faaea59c700 1 --2- 172.21.15.50:0/831561417 >> v2:172.21.15.155:3300/0 conn(0x7faaec159770 0x7faaec0b3d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:54.388 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:54.386+0000 7faaea59c700 1 -- 172.21.15.50:0/831561417 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faaec0b0a50 con 0x7faaec1593a0 2023-10-06T01:22:54.388 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:54.386+0000 7faaea59c700 1 --2- 172.21.15.50:0/831561417 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faaec1593a0 0x7faaec0b5d70 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7faaec06fd20 tx=0x7faadc009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2be867f39e605739 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:22:54.390 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:54.386+0000 7faae959a700 1 -- 172.21.15.50:0/831561417 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faadc00b8f0 con 0x7faaec1593a0 2023-10-06T01:22:54.390 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:54.386+0000 7faae959a700 1 -- 172.21.15.50:0/831561417 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faadc00ba50 con 0x7faaec1593a0 2023-10-06T01:22:54.390 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:54.386+0000 7faae959a700 1 -- 172.21.15.50:0/831561417 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faadc00bdf0 con 0x7faaec1593a0 2023-10-06T01:22:54.390 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:54.387+0000 7faaeb59e700 1 -- 172.21.15.50:0/831561417 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faaec1593a0 msgr2=0x7faaec0b5d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:54.390 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:54.387+0000 7faaeb59e700 1 --2- 172.21.15.50:0/831561417 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faaec1593a0 0x7faaec0b5d70 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7faaec06fd20 tx=0x7faadc009250 comp rx=0 tx=0).stop 2023-10-06T01:22:54.390 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:54.387+0000 7faaeb59e700 1 -- 172.21.15.50:0/831561417 shutdown_connections 2023-10-06T01:22:54.390 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:54.387+0000 7faaeb59e700 1 --2- 172.21.15.50:0/831561417 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7faaec0b42c0 0x7faaec0cf3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:54.390 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:54.387+0000 7faaeb59e700 1 --2- 172.21.15.50:0/831561417 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faaec1593a0 0x7faaec0b5d70 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:54.390 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:54.387+0000 7faaeb59e700 1 --2- 172.21.15.50:0/831561417 >> v2:172.21.15.155:3300/0 conn(0x7faaec159770 0x7faaec0b3d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:54.390 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:54.387+0000 7faaeb59e700 1 -- 172.21.15.50:0/831561417 >> 172.21.15.50:0/831561417 conn(0x7faaec0995c0 msgr2=0x7faaec06f500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:22:54.391 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:54.387+0000 7faaeb59e700 1 -- 172.21.15.50:0/831561417 shutdown_connections 2023-10-06T01:22:54.391 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:54.387+0000 7faaeb59e700 1 -- 172.21.15.50:0/831561417 wait complete. 2023-10-06T01:22:54.391 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:54.389+0000 7faaeb59e700 1 Processor -- start 2023-10-06T01:22:54.391 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:54.389+0000 7faaeb59e700 1 -- start start 2023-10-06T01:22:54.393 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:54.390+0000 7faaeb59e700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faaec0b42c0 0x7faaec15c7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:54.393 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:54.390+0000 7faaeb59e700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7faaec1593a0 0x7faaec15e660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:54.393 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:54.390+0000 7faaeb59e700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7faaec159770 0x7faaec15eba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:54.393 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:54.390+0000 7faaeb59e700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faaec0addc0 con 0x7faaec0b42c0 2023-10-06T01:22:54.393 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:54.390+0000 7faaeb59e700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faaec0ae080 con 0x7faaec1593a0 2023-10-06T01:22:54.393 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:54.390+0000 7faaeb59e700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faaec0ae360 con 0x7faaec159770 2023-10-06T01:22:54.393 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:54.390+0000 7faaea59c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faaec0b42c0 0x7faaec15c7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:54.393 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:54.390+0000 7faaea59c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faaec0b42c0 0x7faaec15c7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:52816/0 (socket says 172.21.15.50:52816) 2023-10-06T01:22:54.394 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:54.390+0000 7faaea59c700 1 -- 172.21.15.50:0/4093174140 learned_addr learned my addr 172.21.15.50:0/4093174140 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-06T01:22:54.394 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:54.390+0000 7faaead9d700 1 --2- 172.21.15.50:0/4093174140 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7faaec159770 0x7faaec15eba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:54.394 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:54.390+0000 7faae9d9b700 1 --2- 172.21.15.50:0/4093174140 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7faaec1593a0 0x7faaec15e660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:54.394 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:54.390+0000 7faaea59c700 1 -- 172.21.15.50:0/4093174140 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7faaec159770 msgr2=0x7faaec15eba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:54.394 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:54.390+0000 7faaea59c700 1 --2- 172.21.15.50:0/4093174140 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7faaec159770 0x7faaec15eba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:54.394 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:54.390+0000 7faaea59c700 1 -- 172.21.15.50:0/4093174140 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7faaec1593a0 msgr2=0x7faaec15e660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:54.394 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:54.390+0000 7faaea59c700 1 --2- 172.21.15.50:0/4093174140 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7faaec1593a0 0x7faaec15e660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:54.394 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:54.390+0000 7faaea59c700 1 -- 172.21.15.50:0/4093174140 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faadc0094f0 con 0x7faaec0b42c0 2023-10-06T01:22:54.394 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:54.390+0000 7faaead9d700 1 --2- 172.21.15.50:0/4093174140 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7faaec159770 0x7faaec15eba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T01:22:54.394 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:54.390+0000 7faae9d9b700 1 --2- 172.21.15.50:0/4093174140 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7faaec1593a0 0x7faaec15e660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T01:22:54.395 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:54.391+0000 7faaea59c700 1 --2- 172.21.15.50:0/4093174140 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faaec0b42c0 0x7faaec15c7c0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7faaec06fcb0 tx=0x7faadc017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:22:54.395 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:54.391+0000 7faada7fc700 1 -- 172.21.15.50:0/4093174140 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faadc011e60 con 0x7faaec0b42c0 2023-10-06T01:22:54.395 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:54.391+0000 7faada7fc700 1 -- 172.21.15.50:0/4093174140 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faadc01a630 con 0x7faaec0b42c0 2023-10-06T01:22:54.395 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:54.391+0000 7faada7fc700 1 -- 172.21.15.50:0/4093174140 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faadc01a9f0 con 0x7faaec0b42c0 2023-10-06T01:22:54.395 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:54.391+0000 7faaeb59e700 1 -- 172.21.15.50:0/4093174140 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faaec0ae640 con 0x7faaec0b42c0 2023-10-06T01:22:54.395 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:54.391+0000 7faaeb59e700 1 -- 172.21.15.50:0/4093174140 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faaec0aec00 con 0x7faaec0b42c0 2023-10-06T01:22:54.395 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:54.392+0000 7faaeb59e700 1 -- 172.21.15.50:0/4093174140 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faaec05f270 con 0x7faaec0b42c0 2023-10-06T01:22:54.396 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:54.393+0000 7faada7fc700 1 -- 172.21.15.50:0/4093174140 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7faadc0233e0 con 0x7faaec0b42c0 2023-10-06T01:22:54.396 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:54.394+0000 7faada7fc700 1 --2- 172.21.15.50:0/4093174140 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7faacc066f30 0x7faacc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:54.396 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:54.394+0000 7faada7fc700 1 -- 172.21.15.50:0/4093174140 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5526+0+0 (secure 0 0 0) 0x7faadc085c20 con 0x7faaec0b42c0 2023-10-06T01:22:54.396 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:54.395+0000 7faae9d9b700 1 --2- 172.21.15.50:0/4093174140 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7faacc066f30 0x7faacc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:54.396 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:54.395+0000 7faae9d9b700 1 --2- 172.21.15.50:0/4093174140 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7faacc066f30 0x7faacc0693e0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7faaec09d5e0 tx=0x7faae0008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:22:54.399 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:54.399+0000 7faada7fc700 1 -- 172.21.15.50:0/4093174140 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7faadc052ea0 con 0x7faaec0b42c0 2023-10-06T01:22:54.602 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:54.601+0000 7faaeb59e700 1 -- 172.21.15.50:0/4093174140 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7faaec0b0d30 con 0x7faaec0b42c0 2023-10-06T01:22:54.909 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:54.908+0000 7faada7fc700 1 -- 172.21.15.50:0/4093174140 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v36) v1 ==== 138+0+0 (secure 0 0 0) 0x7faadc0150b0 con 0x7faaec0b42c0 2023-10-06T01:22:54.914 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:54.913+0000 7faaeb59e700 1 -- 172.21.15.50:0/4093174140 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7faacc066f30 msgr2=0x7faacc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:54.914 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:54.913+0000 7faaeb59e700 1 --2- 172.21.15.50:0/4093174140 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7faacc066f30 0x7faacc0693e0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7faaec09d5e0 tx=0x7faae0008040 comp rx=0 tx=0).stop 2023-10-06T01:22:54.914 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:54.913+0000 7faaeb59e700 1 -- 172.21.15.50:0/4093174140 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faaec0b42c0 msgr2=0x7faaec15c7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:54.914 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:54.913+0000 7faaeb59e700 1 --2- 172.21.15.50:0/4093174140 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faaec0b42c0 0x7faaec15c7c0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7faaec06fcb0 tx=0x7faadc017000 comp rx=0 tx=0).stop 2023-10-06T01:22:54.915 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:54.914+0000 7faaeb59e700 1 -- 172.21.15.50:0/4093174140 shutdown_connections 2023-10-06T01:22:54.916 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:54.914+0000 7faaeb59e700 1 --2- 172.21.15.50:0/4093174140 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7faaec159770 0x7faaec15eba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:54.916 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:54.914+0000 7faaeb59e700 1 --2- 172.21.15.50:0/4093174140 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faaec0b42c0 0x7faaec15c7c0 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:54.916 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:54.914+0000 7faaeb59e700 1 --2- 172.21.15.50:0/4093174140 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7faacc066f30 0x7faacc0693e0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:54.916 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:54.914+0000 7faaeb59e700 1 --2- 172.21.15.50:0/4093174140 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7faaec1593a0 0x7faaec15e660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:54.916 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:54.914+0000 7faaeb59e700 1 -- 172.21.15.50:0/4093174140 >> 172.21.15.50:0/4093174140 conn(0x7faaec0995c0 msgr2=0x7faaec158840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:22:54.916 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:54.915+0000 7faaeb59e700 1 -- 172.21.15.50:0/4093174140 shutdown_connections 2023-10-06T01:22:54.916 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:54.915+0000 7faaeb59e700 1 -- 172.21.15.50:0/4093174140 wait complete. 2023-10-06T01:22:54.918 INFO:teuthology.orchestra.run.smithi050.stderr:pool 'cephfs_metadata' created 2023-10-06T01:22:54.935 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-10-06T01:22:55.130 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:55.129+0000 7fa948f9d700 1 Processor -- start 2023-10-06T01:22:55.131 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:55.129+0000 7fa948f9d700 1 -- start start 2023-10-06T01:22:55.132 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:55.131+0000 7fa948f9d700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fa94413c470 0x7fa9440ca990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:55.133 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:55.131+0000 7fa948f9d700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa94415a250 0x7fa9440c8730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:55.133 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:55.131+0000 7fa948f9d700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa94406d470 con 0x7fa9440caed0 2023-10-06T01:22:55.133 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:55.131+0000 7fa948f9d700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa94415a6d0 con 0x7fa94413c470 2023-10-06T01:22:55.133 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:55.131+0000 7fa948f9d700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa9440cb370 con 0x7fa94415a250 2023-10-06T01:22:55.133 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:55.131+0000 7fa9437fe700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fa94413c470 0x7fa9440ca990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:55.133 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:55.131+0000 7fa9437fe700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fa94413c470 0x7fa9440ca990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:53672/0 (socket says 172.21.15.50:53672) 2023-10-06T01:22:55.133 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:55.131+0000 7fa9437fe700 1 -- 172.21.15.50:0/3839216790 learned_addr learned my addr 172.21.15.50:0/3839216790 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-06T01:22:55.133 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:55.131+0000 7fa943fff700 1 --2- 172.21.15.50:0/3839216790 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa94415a250 0x7fa9440c8730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:55.133 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:55.132+0000 7fa9437fe700 1 -- 172.21.15.50:0/3839216790 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa94415a250 msgr2=0x7fa9440c8730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:22:55.134 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:55.132+0000 7fa9437fe700 1 --2- 172.21.15.50:0/3839216790 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa94415a250 0x7fa9440c8730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:55.134 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:55.132+0000 7fa9437fe700 1 -- 172.21.15.50:0/3839216790 >> v1:172.21.15.155:6789/0 conn(0x7fa9440caed0 legacy=0x7fa944159b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:55.134 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:55.132+0000 7fa9437fe700 1 -- 172.21.15.50:0/3839216790 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa94406cb80 con 0x7fa94413c470 2023-10-06T01:22:55.134 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:55.132+0000 7fa943fff700 1 --2- 172.21.15.50:0/3839216790 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa94415a250 0x7fa9440c8730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T01:22:55.134 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:55.132+0000 7fa9437fe700 1 --2- 172.21.15.50:0/3839216790 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa94413c470 0x7fa9440ca990 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7fa9340099b0 tx=0x7fa934009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fdeb539d51d39a9f server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:22:55.135 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:55.132+0000 7fa9427fc700 1 -- 172.21.15.50:0/3839216790 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa93400b860 con 0x7fa94413c470 2023-10-06T01:22:55.136 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:55.132+0000 7fa9427fc700 1 -- 172.21.15.50:0/3839216790 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa93400b9c0 con 0x7fa94413c470 2023-10-06T01:22:55.136 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:55.132+0000 7fa9427fc700 1 -- 172.21.15.50:0/3839216790 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa93400bd60 con 0x7fa94413c470 2023-10-06T01:22:55.136 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:55.133+0000 7fa948f9d700 1 -- 172.21.15.50:0/3839216790 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa94413c470 msgr2=0x7fa9440ca990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:55.136 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:55.133+0000 7fa948f9d700 1 --2- 172.21.15.50:0/3839216790 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa94413c470 0x7fa9440ca990 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7fa9340099b0 tx=0x7fa934009250 comp rx=0 tx=0).stop 2023-10-06T01:22:55.136 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:55.133+0000 7fa948f9d700 1 -- 172.21.15.50:0/3839216790 shutdown_connections 2023-10-06T01:22:55.136 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:55.133+0000 7fa948f9d700 1 --2- 172.21.15.50:0/3839216790 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa94413c470 0x7fa9440ca990 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:55.136 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:55.133+0000 7fa948f9d700 1 --2- 172.21.15.50:0/3839216790 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa94415a250 0x7fa9440c8730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:55.136 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:55.133+0000 7fa948f9d700 1 -- 172.21.15.50:0/3839216790 >> 172.21.15.50:0/3839216790 conn(0x7fa94406b370 msgr2=0x7fa94406b770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:22:55.136 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:55.133+0000 7fa948f9d700 1 -- 172.21.15.50:0/3839216790 shutdown_connections 2023-10-06T01:22:55.136 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:55.133+0000 7fa948f9d700 1 -- 172.21.15.50:0/3839216790 wait complete. 2023-10-06T01:22:55.137 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:55.134+0000 7fa948f9d700 1 Processor -- start 2023-10-06T01:22:55.137 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:55.135+0000 7fa948f9d700 1 -- start start 2023-10-06T01:22:55.139 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:55.135+0000 7fa948f9d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa9440caed0 0x7fa94413f4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:55.139 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:55.135+0000 7fa948f9d700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa94413c470 0x7fa9440b18a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:55.139 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:55.135+0000 7fa948f9d700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa94415a250 0x7fa944155f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:55.139 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:55.135+0000 7fa948f9d700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa94413d3a0 con 0x7fa9440caed0 2023-10-06T01:22:55.139 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:55.135+0000 7fa948f9d700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9440b1de0 con 0x7fa94415a250 2023-10-06T01:22:55.139 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:55.135+0000 7fa948f9d700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa9440b2080 con 0x7fa94413c470 2023-10-06T01:22:55.139 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:55.136+0000 7fa9437fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa9440caed0 0x7fa94413f4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:55.140 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:55.136+0000 7fa9437fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa9440caed0 0x7fa94413f4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:53674/0 (socket says 172.21.15.50:53674) 2023-10-06T01:22:55.140 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:55.136+0000 7fa9437fe700 1 -- 172.21.15.50:0/2829771966 learned_addr learned my addr 172.21.15.50:0/2829771966 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-06T01:22:55.140 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:55.136+0000 7fa943fff700 1 --2- 172.21.15.50:0/2829771966 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa94415a250 0x7fa944155f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:55.140 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:55.136+0000 7fa942ffd700 1 --2- 172.21.15.50:0/2829771966 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa94413c470 0x7fa9440b18a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:55.140 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:55.136+0000 7fa9437fe700 1 -- 172.21.15.50:0/2829771966 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa94413c470 msgr2=0x7fa9440b18a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:55.140 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:55.136+0000 7fa9437fe700 1 --2- 172.21.15.50:0/2829771966 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa94413c470 0x7fa9440b18a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:55.140 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:55.136+0000 7fa9437fe700 1 -- 172.21.15.50:0/2829771966 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa94415a250 msgr2=0x7fa944155f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:55.140 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:55.136+0000 7fa9437fe700 1 --2- 172.21.15.50:0/2829771966 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa94415a250 0x7fa944155f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:55.140 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:55.136+0000 7fa9437fe700 1 -- 172.21.15.50:0/2829771966 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9340094f0 con 0x7fa9440caed0 2023-10-06T01:22:55.140 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:55.136+0000 7fa9437fe700 1 --2- 172.21.15.50:0/2829771966 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa9440caed0 0x7fa94413f4a0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7fa934009290 tx=0x7fa934017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:22:55.140 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:55.136+0000 7fa92b7fe700 1 -- 172.21.15.50:0/2829771966 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa934026480 con 0x7fa9440caed0 2023-10-06T01:22:55.141 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:55.137+0000 7fa92b7fe700 1 -- 172.21.15.50:0/2829771966 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa93401f070 con 0x7fa9440caed0 2023-10-06T01:22:55.141 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:55.137+0000 7fa92b7fe700 1 -- 172.21.15.50:0/2829771966 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa934026830 con 0x7fa9440caed0 2023-10-06T01:22:55.141 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:55.137+0000 7fa948f9d700 1 -- 172.21.15.50:0/2829771966 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa94413ca70 con 0x7fa9440caed0 2023-10-06T01:22:55.141 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:55.137+0000 7fa948f9d700 1 -- 172.21.15.50:0/2829771966 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa94413d030 con 0x7fa9440caed0 2023-10-06T01:22:55.141 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:55.138+0000 7fa948f9d700 1 -- 172.21.15.50:0/2829771966 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa94405f270 con 0x7fa9440caed0 2023-10-06T01:22:55.142 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:55.139+0000 7fa92b7fe700 1 -- 172.21.15.50:0/2829771966 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fa934026ba0 con 0x7fa9440caed0 2023-10-06T01:22:55.142 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:55.140+0000 7fa92b7fe700 1 --2- 172.21.15.50:0/2829771966 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7fa930066f30 0x7fa9300693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:55.142 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:55.140+0000 7fa92b7fe700 1 -- 172.21.15.50:0/2829771966 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5896+0+0 (secure 0 0 0) 0x7fa934021070 con 0x7fa9440caed0 2023-10-06T01:22:55.142 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:55.140+0000 7fa942ffd700 1 --2- 172.21.15.50:0/2829771966 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7fa930066f30 0x7fa9300693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:55.142 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:55.141+0000 7fa942ffd700 1 --2- 172.21.15.50:0/2829771966 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7fa930066f30 0x7fa9300693e0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fa94416e060 tx=0x7fa938009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:22:55.146 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:55.145+0000 7fa92b7fe700 1 -- 172.21.15.50:0/2829771966 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fa9340536a0 con 0x7fa9440caed0 2023-10-06T01:22:55.351 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:55.350+0000 7fa948f9d700 1 -- 172.21.15.50:0/2829771966 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7fa9440c4450 con 0x7fa9440caed0 2023-10-06T01:22:55.916 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:55.915+0000 7fa92b7fe700 1 -- 172.21.15.50:0/2829771966 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v37) v1 ==== 170+0+0 (secure 0 0 0) 0x7fa934056cc0 con 0x7fa9440caed0 2023-10-06T01:22:55.923 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:55.922+0000 7fa948f9d700 1 -- 172.21.15.50:0/2829771966 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7fa930066f30 msgr2=0x7fa9300693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:55.923 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:55.922+0000 7fa948f9d700 1 --2- 172.21.15.50:0/2829771966 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7fa930066f30 0x7fa9300693e0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fa94416e060 tx=0x7fa938009040 comp rx=0 tx=0).stop 2023-10-06T01:22:55.923 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:55.922+0000 7fa948f9d700 1 -- 172.21.15.50:0/2829771966 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa9440caed0 msgr2=0x7fa94413f4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:55.923 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:55.922+0000 7fa948f9d700 1 --2- 172.21.15.50:0/2829771966 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa9440caed0 0x7fa94413f4a0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7fa934009290 tx=0x7fa934017000 comp rx=0 tx=0).stop 2023-10-06T01:22:55.930 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:55.928+0000 7fa948f9d700 1 -- 172.21.15.50:0/2829771966 shutdown_connections 2023-10-06T01:22:55.930 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:55.929+0000 7fa948f9d700 1 --2- 172.21.15.50:0/2829771966 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7fa930066f30 0x7fa9300693e0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:55.930 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:55.929+0000 7fa948f9d700 1 --2- 172.21.15.50:0/2829771966 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa94415a250 0x7fa944155f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:55.930 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:55.929+0000 7fa948f9d700 1 --2- 172.21.15.50:0/2829771966 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa9440caed0 0x7fa94413f4a0 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:55.930 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:55.929+0000 7fa948f9d700 1 --2- 172.21.15.50:0/2829771966 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa94413c470 0x7fa9440b18a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:55.930 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:55.929+0000 7fa948f9d700 1 -- 172.21.15.50:0/2829771966 >> 172.21.15.50:0/2829771966 conn(0x7fa94406b370 msgr2=0x7fa9440cbca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:22:55.936 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:55.935+0000 7fa948f9d700 1 -- 172.21.15.50:0/2829771966 shutdown_connections 2023-10-06T01:22:55.936 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:55.935+0000 7fa948f9d700 1 -- 172.21.15.50:0/2829771966 wait complete. 2023-10-06T01:22:55.940 INFO:teuthology.orchestra.run.smithi050.stderr:pool 'cephfs_data' created 2023-10-06T01:22:55.960 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-10-06T01:22:56.152 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:56.152+0000 7f6aff59e700 1 Processor -- start 2023-10-06T01:22:56.153 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:56.152+0000 7f6aff59e700 1 -- start start 2023-10-06T01:22:56.155 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:56.153+0000 7f6aff59e700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f6b00154ad0 0x7f6b000b15d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:56.155 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:56.153+0000 7f6aff59e700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f6b000ae1f0 0x7f6b000ab7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:56.155 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:56.153+0000 7f6aff59e700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6b0006ef50 con 0x7f6b00154ea0 2023-10-06T01:22:56.155 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:56.153+0000 7f6aff59e700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6b0006e340 con 0x7f6b00154ad0 2023-10-06T01:22:56.155 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:56.153+0000 7f6aff59e700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6b0006e620 con 0x7f6b000ae1f0 2023-10-06T01:22:56.155 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:56.153+0000 7f6afe59c700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f6b00154ad0 0x7f6b000b15d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:56.155 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:56.153+0000 7f6afe59c700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f6b00154ad0 0x7f6b000b15d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:53676/0 (socket says 172.21.15.50:53676) 2023-10-06T01:22:56.155 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:56.153+0000 7f6afe59c700 1 -- 172.21.15.50:0/4289816068 learned_addr learned my addr 172.21.15.50:0/4289816068 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-06T01:22:56.155 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:56.154+0000 7f6afed9d700 1 --2- 172.21.15.50:0/4289816068 >> v2:172.21.15.155:3300/0 conn(0x7f6b000ae1f0 0x7f6b000ab7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:56.155 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:56.154+0000 7f6afe59c700 1 -- 172.21.15.50:0/4289816068 >> v2:172.21.15.155:3300/0 conn(0x7f6b000ae1f0 msgr2=0x7f6b000ab7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:22:56.156 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:56.154+0000 7f6afe59c700 1 --2- 172.21.15.50:0/4289816068 >> v2:172.21.15.155:3300/0 conn(0x7f6b000ae1f0 0x7f6b000ab7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:56.156 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:56.154+0000 7f6afe59c700 1 -- 172.21.15.50:0/4289816068 >> v1:172.21.15.155:6789/0 conn(0x7f6b00154ea0 legacy=0x7f6b000adae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:22:56.156 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:56.154+0000 7f6afe59c700 1 -- 172.21.15.50:0/4289816068 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b0006e900 con 0x7f6b00154ad0 2023-10-06T01:22:56.156 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:56.154+0000 7f6afe59c700 1 --2- 172.21.15.50:0/4289816068 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6b00154ad0 0x7f6b000b15d0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f6b00157790 tx=0x7f6af0009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a5f42193e5c3284 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:22:56.157 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:56.154+0000 7f6afd59a700 1 -- 172.21.15.50:0/4289816068 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6af000b820 con 0x7f6b00154ad0 2023-10-06T01:22:56.157 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:56.154+0000 7f6afd59a700 1 -- 172.21.15.50:0/4289816068 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6af000b980 con 0x7f6b00154ad0 2023-10-06T01:22:56.157 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:56.154+0000 7f6afd59a700 1 -- 172.21.15.50:0/4289816068 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6af000bd20 con 0x7f6b00154ad0 2023-10-06T01:22:56.157 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:56.155+0000 7f6aff59e700 1 -- 172.21.15.50:0/4289816068 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6b00154ad0 msgr2=0x7f6b000b15d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:56.157 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:56.155+0000 7f6aff59e700 1 --2- 172.21.15.50:0/4289816068 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6b00154ad0 0x7f6b000b15d0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f6b00157790 tx=0x7f6af0009250 comp rx=0 tx=0).stop 2023-10-06T01:22:56.157 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:56.155+0000 7f6aff59e700 1 -- 172.21.15.50:0/4289816068 shutdown_connections 2023-10-06T01:22:56.157 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:56.155+0000 7f6aff59e700 1 --2- 172.21.15.50:0/4289816068 >> v2:172.21.15.155:3300/0 conn(0x7f6b000ae1f0 0x7f6b000ab7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:56.157 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:56.155+0000 7f6aff59e700 1 --2- 172.21.15.50:0/4289816068 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6b00154ad0 0x7f6b000b15d0 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:56.157 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:56.155+0000 7f6aff59e700 1 -- 172.21.15.50:0/4289816068 >> 172.21.15.50:0/4289816068 conn(0x7f6b000cbf10 msgr2=0x7f6b000cc310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:22:56.158 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:56.155+0000 7f6aff59e700 1 -- 172.21.15.50:0/4289816068 shutdown_connections 2023-10-06T01:22:56.158 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:56.155+0000 7f6aff59e700 1 -- 172.21.15.50:0/4289816068 wait complete. 2023-10-06T01:22:56.159 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:56.157+0000 7f6aff59e700 1 Processor -- start 2023-10-06T01:22:56.159 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:56.157+0000 7f6aff59e700 1 -- start start 2023-10-06T01:22:56.159 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:56.158+0000 7f6aff59e700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6b000ae1f0 0x7f6b001587e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:56.160 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:56.158+0000 7f6aff59e700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6b00154ad0 0x7f6b00155e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:56.160 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:56.158+0000 7f6aff59e700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6b00154ea0 0x7f6b00156390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:56.160 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:56.158+0000 7f6aff59e700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b001559c0 con 0x7f6b00154ad0 2023-10-06T01:22:56.160 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:56.158+0000 7f6aff59e700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b00159260 con 0x7f6b000ae1f0 2023-10-06T01:22:56.160 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:56.158+0000 7f6aff59e700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b00159540 con 0x7f6b00154ea0 2023-10-06T01:22:56.160 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:56.158+0000 7f6afdd9b700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6b00154ad0 0x7f6b00155e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:56.160 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:56.158+0000 7f6afdd9b700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6b00154ad0 0x7f6b00155e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:53680/0 (socket says 172.21.15.50:53680) 2023-10-06T01:22:56.160 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:56.158+0000 7f6afdd9b700 1 -- 172.21.15.50:0/2472412324 learned_addr learned my addr 172.21.15.50:0/2472412324 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-06T01:22:56.160 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:56.158+0000 7f6afe59c700 1 --2- 172.21.15.50:0/2472412324 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6b000ae1f0 0x7f6b001587e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:56.160 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:56.158+0000 7f6afed9d700 1 --2- 172.21.15.50:0/2472412324 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6b00154ea0 0x7f6b00156390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:56.160 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:56.158+0000 7f6afdd9b700 1 -- 172.21.15.50:0/2472412324 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6b00154ea0 msgr2=0x7f6b00156390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:56.161 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:56.158+0000 7f6afdd9b700 1 --2- 172.21.15.50:0/2472412324 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6b00154ea0 0x7f6b00156390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:56.161 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:56.158+0000 7f6afdd9b700 1 -- 172.21.15.50:0/2472412324 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6b000ae1f0 msgr2=0x7f6b001587e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:56.161 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:56.158+0000 7f6afdd9b700 1 --2- 172.21.15.50:0/2472412324 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6b000ae1f0 0x7f6b001587e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:56.161 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:56.158+0000 7f6afdd9b700 1 -- 172.21.15.50:0/2472412324 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6af00094f0 con 0x7f6b00154ad0 2023-10-06T01:22:56.161 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:56.159+0000 7f6afdd9b700 1 --2- 172.21.15.50:0/2472412324 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6b00154ad0 0x7f6b00155e50 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f6af400b5e0 tx=0x7f6af40090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:22:56.162 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:56.159+0000 7f6aee7fc700 1 -- 172.21.15.50:0/2472412324 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6af400f510 con 0x7f6b00154ad0 2023-10-06T01:22:56.162 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:56.159+0000 7f6aee7fc700 1 -- 172.21.15.50:0/2472412324 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6af400f6b0 con 0x7f6b00154ad0 2023-10-06T01:22:56.162 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:56.159+0000 7f6aee7fc700 1 -- 172.21.15.50:0/2472412324 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6af400fa70 con 0x7f6b00154ad0 2023-10-06T01:22:56.162 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:56.159+0000 7f6aff59e700 1 -- 172.21.15.50:0/2472412324 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6b00155370 con 0x7f6b00154ad0 2023-10-06T01:22:56.162 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:56.159+0000 7f6aff59e700 1 -- 172.21.15.50:0/2472412324 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6b0014d8a0 con 0x7f6b00154ad0 2023-10-06T01:22:56.162 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:56.160+0000 7f6aff59e700 1 -- 172.21.15.50:0/2472412324 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6b00155b70 con 0x7f6b00154ad0 2023-10-06T01:22:56.162 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:56.161+0000 7f6aee7fc700 1 -- 172.21.15.50:0/2472412324 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f6af401a400 con 0x7f6b00154ad0 2023-10-06T01:22:56.163 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:56.162+0000 7f6aee7fc700 1 --2- 172.21.15.50:0/2472412324 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f6ae0066f30 0x7f6ae00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:56.163 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:56.162+0000 7f6aee7fc700 1 -- 172.21.15.50:0/2472412324 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6278+0+0 (secure 0 0 0) 0x7f6af40841b0 con 0x7f6b00154ad0 2023-10-06T01:22:56.163 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:56.163+0000 7f6afe59c700 1 --2- 172.21.15.50:0/2472412324 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f6ae0066f30 0x7f6ae00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:56.164 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:56.164+0000 7f6afe59c700 1 --2- 172.21.15.50:0/2472412324 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f6ae0066f30 0x7f6ae00693e0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f6b00157790 tx=0x7f6af0016000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:22:56.167 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:56.167+0000 7f6aee7fc700 1 -- 172.21.15.50:0/2472412324 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f6b00155b70 con 0x7f6b00154ad0 2023-10-06T01:22:56.415 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:56.414+0000 7f6aff59e700 1 -- 172.21.15.50:0/2472412324 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f6b00155810 con 0x7f6b00154ad0 2023-10-06T01:22:56.917 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:56.916+0000 7f6aee7fc700 1 -- 172.21.15.50:0/2472412324 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 6 and data pool 7 v14) v1 ==== 172+0+0 (secure 0 0 0) 0x7f6af4054c50 con 0x7f6b00154ad0 2023-10-06T01:22:56.921 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:56.921+0000 7f6aff59e700 1 -- 172.21.15.50:0/2472412324 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f6ae0066f30 msgr2=0x7f6ae00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:56.922 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:56.921+0000 7f6aff59e700 1 --2- 172.21.15.50:0/2472412324 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f6ae0066f30 0x7f6ae00693e0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f6b00157790 tx=0x7f6af0016000 comp rx=0 tx=0).stop 2023-10-06T01:22:56.922 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:56.921+0000 7f6aff59e700 1 -- 172.21.15.50:0/2472412324 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6b00154ad0 msgr2=0x7f6b00155e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:56.922 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:56.921+0000 7f6aff59e700 1 --2- 172.21.15.50:0/2472412324 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6b00154ad0 0x7f6b00155e50 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f6af400b5e0 tx=0x7f6af40090f0 comp rx=0 tx=0).stop 2023-10-06T01:22:56.922 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:56.921+0000 7f6aff59e700 1 -- 172.21.15.50:0/2472412324 shutdown_connections 2023-10-06T01:22:56.922 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:56.921+0000 7f6aff59e700 1 --2- 172.21.15.50:0/2472412324 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6b00154ea0 0x7f6b00156390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:56.922 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:56.921+0000 7f6aff59e700 1 --2- 172.21.15.50:0/2472412324 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f6ae0066f30 0x7f6ae00693e0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:56.922 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:56.921+0000 7f6aff59e700 1 --2- 172.21.15.50:0/2472412324 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6b000ae1f0 0x7f6b001587e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:56.922 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:56.921+0000 7f6aff59e700 1 --2- 172.21.15.50:0/2472412324 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6b00154ad0 0x7f6b00155e50 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:56.922 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:56.921+0000 7f6aff59e700 1 -- 172.21.15.50:0/2472412324 >> 172.21.15.50:0/2472412324 conn(0x7f6b000cbf10 msgr2=0x7f6b000ac750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:22:56.923 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:56.922+0000 7f6aff59e700 1 -- 172.21.15.50:0/2472412324 shutdown_connections 2023-10-06T01:22:56.923 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:56.922+0000 7f6aff59e700 1 -- 172.21.15.50:0/2472412324 wait complete. 2023-10-06T01:22:56.930 INFO:teuthology.orchestra.run.smithi050.stderr:new fs with metadata pool 6 and data pool 7 2023-10-06T01:22:56.949 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T01:22:57.136 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:57.135+0000 7fcbad99d700 1 Processor -- start 2023-10-06T01:22:57.136 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:57.135+0000 7fcbad99d700 1 -- start start 2023-10-06T01:22:57.138 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:57.137+0000 7fcbad99d700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fcba80c9f30 0x7fcba80c65b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:57.138 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:57.137+0000 7fcbad99d700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fcba80ca300 0x7fcba81599f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:57.138 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:57.137+0000 7fcbad99d700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcba8069960 con 0x7fcba8159f30 2023-10-06T01:22:57.139 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:57.137+0000 7fcbad99d700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcba815a670 con 0x7fcba80c9f30 2023-10-06T01:22:57.139 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:57.137+0000 7fcbad99d700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcba8069310 con 0x7fcba80ca300 2023-10-06T01:22:57.139 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:57.137+0000 7fcbac99b700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fcba80c9f30 0x7fcba80c65b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:57.139 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:57.137+0000 7fcbac99b700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fcba80c9f30 0x7fcba80c65b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:53692/0 (socket says 172.21.15.50:53692) 2023-10-06T01:22:57.139 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:57.137+0000 7fcbac99b700 1 -- 172.21.15.50:0/2733583822 learned_addr learned my addr 172.21.15.50:0/2733583822 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-06T01:22:57.139 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:57.137+0000 7fcba7fff700 1 --2- 172.21.15.50:0/2733583822 >> v2:172.21.15.155:3300/0 conn(0x7fcba80ca300 0x7fcba81599f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:57.139 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:57.137+0000 7fcbac99b700 1 -- 172.21.15.50:0/2733583822 >> v2:172.21.15.155:3300/0 conn(0x7fcba80ca300 msgr2=0x7fcba81599f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:22:57.139 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:57.138+0000 7fcbac99b700 1 --2- 172.21.15.50:0/2733583822 >> v2:172.21.15.155:3300/0 conn(0x7fcba80ca300 0x7fcba81599f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:57.139 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:57.138+0000 7fcbac99b700 1 -- 172.21.15.50:0/2733583822 >> v1:172.21.15.155:6789/0 conn(0x7fcba8159f30 legacy=0x7fcba80ade00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:22:57.139 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:57.138+0000 7fcbac99b700 1 -- 172.21.15.50:0/2733583822 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcba80695f0 con 0x7fcba80c9f30 2023-10-06T01:22:57.140 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:57.138+0000 7fcbac99b700 1 --2- 172.21.15.50:0/2733583822 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcba80c9f30 0x7fcba80c65b0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7fcba80c64d0 tx=0x7fcb9c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a244e3ee288f606f server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:22:57.140 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:57.138+0000 7fcba77fe700 1 -- 172.21.15.50:0/2733583822 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb9c00b8f0 con 0x7fcba80c9f30 2023-10-06T01:22:57.140 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:57.138+0000 7fcba77fe700 1 -- 172.21.15.50:0/2733583822 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb9c00ba50 con 0x7fcba80c9f30 2023-10-06T01:22:57.141 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:57.138+0000 7fcba77fe700 1 -- 172.21.15.50:0/2733583822 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb9c00bdf0 con 0x7fcba80c9f30 2023-10-06T01:22:57.141 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:57.139+0000 7fcbad99d700 1 -- 172.21.15.50:0/2733583822 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcba80c9f30 msgr2=0x7fcba80c65b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:57.141 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:57.139+0000 7fcbad99d700 1 --2- 172.21.15.50:0/2733583822 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcba80c9f30 0x7fcba80c65b0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7fcba80c64d0 tx=0x7fcb9c009250 comp rx=0 tx=0).stop 2023-10-06T01:22:57.141 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:57.139+0000 7fcbad99d700 1 -- 172.21.15.50:0/2733583822 shutdown_connections 2023-10-06T01:22:57.141 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:57.139+0000 7fcbad99d700 1 --2- 172.21.15.50:0/2733583822 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcba80c9f30 0x7fcba80c65b0 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:57.141 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:57.139+0000 7fcbad99d700 1 --2- 172.21.15.50:0/2733583822 >> v2:172.21.15.155:3300/0 conn(0x7fcba80ca300 0x7fcba81599f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:57.141 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:57.139+0000 7fcbad99d700 1 -- 172.21.15.50:0/2733583822 >> 172.21.15.50:0/2733583822 conn(0x7fcba80680c0 msgr2=0x7fcba80cbf00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:22:57.141 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:57.139+0000 7fcbad99d700 1 -- 172.21.15.50:0/2733583822 shutdown_connections 2023-10-06T01:22:57.141 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:57.139+0000 7fcbad99d700 1 -- 172.21.15.50:0/2733583822 wait complete. 2023-10-06T01:22:57.143 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:57.140+0000 7fcbad99d700 1 Processor -- start 2023-10-06T01:22:57.143 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:57.141+0000 7fcbad99d700 1 -- start start 2023-10-06T01:22:57.143 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:57.141+0000 7fcbad99d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcba80c9f30 0x7fcba814b900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:57.143 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:57.141+0000 7fcbad99d700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fcba80ca300 0x7fcba80c4e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:57.143 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:57.141+0000 7fcbad99d700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fcba8159f30 0x7fcba806ea10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:57.143 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:57.141+0000 7fcbad99d700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcba80af950 con 0x7fcba80c9f30 2023-10-06T01:22:57.143 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:57.141+0000 7fcbad99d700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcba80aed40 con 0x7fcba80ca300 2023-10-06T01:22:57.144 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:57.141+0000 7fcbad99d700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcba80af020 con 0x7fcba8159f30 2023-10-06T01:22:57.144 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:57.142+0000 7fcbac99b700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcba80c9f30 0x7fcba814b900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:57.144 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:57.142+0000 7fcbac99b700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcba80c9f30 0x7fcba814b900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:53696/0 (socket says 172.21.15.50:53696) 2023-10-06T01:22:57.144 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:57.142+0000 7fcbac99b700 1 -- 172.21.15.50:0/553582238 learned_addr learned my addr 172.21.15.50:0/553582238 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-06T01:22:57.144 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:57.142+0000 7fcbac99b700 1 -- 172.21.15.50:0/553582238 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fcba8159f30 msgr2=0x7fcba806ea10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:57.144 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:57.142+0000 7fcbac99b700 1 --2- 172.21.15.50:0/553582238 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fcba8159f30 0x7fcba806ea10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:57.144 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:57.142+0000 7fcbac99b700 1 -- 172.21.15.50:0/553582238 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fcba80ca300 msgr2=0x7fcba80c4e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:57.144 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:57.142+0000 7fcbac99b700 1 --2- 172.21.15.50:0/553582238 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fcba80ca300 0x7fcba80c4e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:57.144 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:57.142+0000 7fcbac99b700 1 -- 172.21.15.50:0/553582238 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb9c0094f0 con 0x7fcba80c9f30 2023-10-06T01:22:57.144 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:57.142+0000 7fcbac99b700 1 --2- 172.21.15.50:0/553582238 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcba80c9f30 0x7fcba814b900 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7fcb9c009290 tx=0x7fcb9c017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:22:57.145 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:57.143+0000 7fcba4ff9700 1 -- 172.21.15.50:0/553582238 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb9c006bc0 con 0x7fcba80c9f30 2023-10-06T01:22:57.146 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:57.143+0000 7fcba4ff9700 1 -- 172.21.15.50:0/553582238 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb9c011e20 con 0x7fcba80c9f30 2023-10-06T01:22:57.146 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:57.143+0000 7fcbad99d700 1 -- 172.21.15.50:0/553582238 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcba80af300 con 0x7fcba80c9f30 2023-10-06T01:22:57.146 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:57.143+0000 7fcba4ff9700 1 -- 172.21.15.50:0/553582238 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb9c01a880 con 0x7fcba80c9f30 2023-10-06T01:22:57.146 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:57.143+0000 7fcbad99d700 1 -- 172.21.15.50:0/553582238 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcba814be40 con 0x7fcba80c9f30 2023-10-06T01:22:57.146 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:57.144+0000 7fcbad99d700 1 -- 172.21.15.50:0/553582238 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcba805f270 con 0x7fcba80c9f30 2023-10-06T01:22:57.146 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:57.145+0000 7fcba4ff9700 1 -- 172.21.15.50:0/553582238 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fcb9c01acb0 con 0x7fcba80c9f30 2023-10-06T01:22:57.149 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:57.146+0000 7fcba4ff9700 1 --2- 172.21.15.50:0/553582238 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7fcb8c066f30 0x7fcb8c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:57.150 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:57.146+0000 7fcba4ff9700 1 -- 172.21.15.50:0/553582238 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6378+0+0 (secure 0 0 0) 0x7fcb9c0864b0 con 0x7fcba80c9f30 2023-10-06T01:22:57.150 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:57.147+0000 7fcba7fff700 1 --2- 172.21.15.50:0/553582238 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7fcb8c066f30 0x7fcb8c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:57.150 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:57.148+0000 7fcba7fff700 1 --2- 172.21.15.50:0/553582238 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7fcb8c066f30 0x7fcb8c0693e0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fcba815b060 tx=0x7fcb94008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:22:57.151 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:57.151+0000 7fcba4ff9700 1 -- 172.21.15.50:0/553582238 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fcb9c053480 con 0x7fcba80c9f30 2023-10-06T01:22:57.355 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:57.354+0000 7fcbad99d700 1 -- 172.21.15.50:0/553582238 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fcba80c2d40 con 0x7fcba80c9f30 2023-10-06T01:22:57.355 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:57.355+0000 7fcba4ff9700 1 -- 172.21.15.50:0/553582238 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v38) v1 ==== 74+0+17084 (secure 0 0 0) 0x7fcb9c056aa0 con 0x7fcba80c9f30 2023-10-06T01:22:57.356 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-10-06T01:22:57.356 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":38,"fsid":"0bfd9a6b-1587-4fe4-a89e-e43c00286b4e","created":"2023-10-06T01:21:16.828801+0000","modified":"2023-10-06T01:22:56.416120+0000","last_up_change":"2023-10-06T01:21:28.584523+0000","last_in_change":"2023-10-06T01:21:20.179863+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-10-06T01:21:29.304225+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":".mgr","create_time":"2023-10-06T01:21:29.835490+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2023-10-06T01:22:54.641549+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":7,"pool_name":"cephfs_data","create_time":"2023-10-06T01:22:55.389647+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"9060727a-3959-4de3-8363-c5c5d7826c9a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":87837},{"type":"v1","addr":"172.21.15.50:6801","nonce":87837}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":87837},{"type":"v1","addr":"172.21.15.50:6803","nonce":87837}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":87837},{"type":"v1","addr":"172.21.15.50:6807","nonce":87837}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":87837},{"type":"v1","addr":"172.21.15.50:6805","nonce":87837}]},"public_addr":"172.21.15.50:6801/87837","cluster_addr":"172.21.15.50:6803/87837","heartbeat_back_addr":"172.21.15.50:6807/87837","heartbeat_front_addr":"172.21.15.50:6805/87837","state":["exists","up"]},{"osd":1,"uuid":"5ad9ef12-b579-47ea-b690-90ba887e2cef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":87853},{"type":"v1","addr":"172.21.15.50:6809","nonce":87853}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":87853},{"type":"v1","addr":"172.21.15.50:6811","nonce":87853}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":87853},{"type":"v1","addr":"172.21.15.50:6815","nonce":87853}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":87853},{"type":"v1","addr":"172.21.15.50:6813","nonce":87853}]},"public_addr":"172.21.15.50:6809/87853","cluster_addr":"172.21.15.50:6811/87853","heartbeat_back_addr":"172.21.15.50:6815/87853","heartbeat_front_addr":"172.21.15.50:6813/87853","state":["exists","up"]},{"osd":2,"uuid":"c7aee044-6f75-436f-90e1-ba42a57359bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6821","nonce":87855},{"type":"v1","addr":"172.21.15.50:6822","nonce":87855}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6824","nonce":87855},{"type":"v1","addr":"172.21.15.50:6826","nonce":87855}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":87855},{"type":"v1","addr":"172.21.15.50:6831","nonce":87855}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":87855},{"type":"v1","addr":"172.21.15.50:6829","nonce":87855}]},"public_addr":"172.21.15.50:6822/87855","cluster_addr":"172.21.15.50:6826/87855","heartbeat_back_addr":"172.21.15.50:6831/87855","heartbeat_front_addr":"172.21.15.50:6829/87855","state":["exists","up"]},{"osd":3,"uuid":"d9b901c8-e8b2-44af-9508-f453120a96c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":87856},{"type":"v1","addr":"172.21.15.50:6817","nonce":87856}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":87856},{"type":"v1","addr":"172.21.15.50:6819","nonce":87856}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6825","nonce":87856},{"type":"v1","addr":"172.21.15.50:6827","nonce":87856}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6820","nonce":87856},{"type":"v1","addr":"172.21.15.50:6823","nonce":87856}]},"public_addr":"172.21.15.50:6817/87856","cluster_addr":"172.21.15.50:6819/87856","heartbeat_back_addr":"172.21.15.50:6827/87856","heartbeat_front_addr":"172.21.15.50:6823/87856","state":["exists","up"]},{"osd":4,"uuid":"2b3c6b38-e3e9-4301-9445-60fd3fe8ce03","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":85805},{"type":"v1","addr":"172.21.15.155:6801","nonce":85805}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":85805},{"type":"v1","addr":"172.21.15.155:6803","nonce":85805}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6806","nonce":85805},{"type":"v1","addr":"172.21.15.155:6807","nonce":85805}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6804","nonce":85805},{"type":"v1","addr":"172.21.15.155:6805","nonce":85805}]},"public_addr":"172.21.15.155:6801/85805","cluster_addr":"172.21.15.155:6803/85805","heartbeat_back_addr":"172.21.15.155:6807/85805","heartbeat_front_addr":"172.21.15.155:6805/85805","state":["exists","up"]},{"osd":5,"uuid":"417b5f8f-65f1-4c94-91a7-a6ce03fe1679","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6816","nonce":85807},{"type":"v1","addr":"172.21.15.155:6818","nonce":85807}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6820","nonce":85807},{"type":"v1","addr":"172.21.15.155:6822","nonce":85807}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6828","nonce":85807},{"type":"v1","addr":"172.21.15.155:6830","nonce":85807}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6824","nonce":85807},{"type":"v1","addr":"172.21.15.155:6826","nonce":85807}]},"public_addr":"172.21.15.155:6818/85807","cluster_addr":"172.21.15.155:6822/85807","heartbeat_back_addr":"172.21.15.155:6830/85807","heartbeat_front_addr":"172.21.15.155:6826/85807","state":["exists","up"]},{"osd":6,"uuid":"c150cff3-aee4-4714-9c08-d182b1ba9ffd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6808","nonce":85806},{"type":"v1","addr":"172.21.15.155:6809","nonce":85806}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6810","nonce":85806},{"type":"v1","addr":"172.21.15.155:6811","nonce":85806}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6814","nonce":85806},{"type":"v1","addr":"172.21.15.155:6815","nonce":85806}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6812","nonce":85806},{"type":"v1","addr":"172.21.15.155:6813","nonce":85806}]},"public_addr":"172.21.15.155:6809/85806","cluster_addr":"172.21.15.155:6811/85806","heartbeat_back_addr":"172.21.15.155:6815/85806","heartbeat_front_addr":"172.21.15.155:6813/85806","state":["exists","up"]},{"osd":7,"uuid":"71107f0e-04d1-4e72-a0ec-0faf6af003e7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6817","nonce":85832},{"type":"v1","addr":"172.21.15.155:6819","nonce":85832}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6821","nonce":85832},{"type":"v1","addr":"172.21.15.155:6823","nonce":85832}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6829","nonce":85832},{"type":"v1","addr":"172.21.15.155:6831","nonce":85832}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6825","nonce":85832},{"type":"v1","addr":"172.21.15.155:6827","nonce":85832}]},"public_addr":"172.21.15.155:6819/85832","cluster_addr":"172.21.15.155:6823/85832","heartbeat_back_addr":"172.21.15.155:6831/85832","heartbeat_front_addr":"172.21.15.155:6827/85832","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:21:25.423389+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:21:25.472661+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:21:25.817562+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:21:25.551257+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:21:25.407818+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:21:25.557976+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:21:25.747299+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:21:25.827576+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T01:22:57.358 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:57.357+0000 7fcbad99d700 1 -- 172.21.15.50:0/553582238 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7fcb8c066f30 msgr2=0x7fcb8c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:57.359 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:57.357+0000 7fcbad99d700 1 --2- 172.21.15.50:0/553582238 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7fcb8c066f30 0x7fcb8c0693e0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fcba815b060 tx=0x7fcb94008040 comp rx=0 tx=0).stop 2023-10-06T01:22:57.359 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:57.357+0000 7fcbad99d700 1 -- 172.21.15.50:0/553582238 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcba80c9f30 msgr2=0x7fcba814b900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:57.359 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:57.357+0000 7fcbad99d700 1 --2- 172.21.15.50:0/553582238 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcba80c9f30 0x7fcba814b900 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7fcb9c009290 tx=0x7fcb9c017000 comp rx=0 tx=0).stop 2023-10-06T01:22:57.359 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:57.357+0000 7fcbad99d700 1 -- 172.21.15.50:0/553582238 shutdown_connections 2023-10-06T01:22:57.359 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:57.357+0000 7fcbad99d700 1 --2- 172.21.15.50:0/553582238 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fcba8159f30 0x7fcba806ea10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:57.359 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:57.357+0000 7fcbad99d700 1 --2- 172.21.15.50:0/553582238 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcba80c9f30 0x7fcba814b900 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:57.359 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:57.357+0000 7fcbad99d700 1 --2- 172.21.15.50:0/553582238 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7fcb8c066f30 0x7fcb8c0693e0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:57.359 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:57.357+0000 7fcbad99d700 1 --2- 172.21.15.50:0/553582238 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fcba80ca300 0x7fcba80c4e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:57.359 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:57.357+0000 7fcbad99d700 1 -- 172.21.15.50:0/553582238 >> 172.21.15.50:0/553582238 conn(0x7fcba80680c0 msgr2=0x7fcba81574b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:22:57.359 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:57.357+0000 7fcbad99d700 1 -- 172.21.15.50:0/553582238 shutdown_connections 2023-10-06T01:22:57.360 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:57.357+0000 7fcbad99d700 1 -- 172.21.15.50:0/553582238 wait complete. 2023-10-06T01:22:57.376 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T01:22:57.564 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:57.563+0000 7fe239f9d700 1 Processor -- start 2023-10-06T01:22:57.564 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:57.563+0000 7fe239f9d700 1 -- start start 2023-10-06T01:22:57.566 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:57.564+0000 7fe239f9d700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fe234159480 0x7fe2340b30d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:57.566 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:57.564+0000 7fe239f9d700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fe2340b3610 0x7fe2340cbc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:57.566 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:57.564+0000 7fe239f9d700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe2340cb7e0 con 0x7fe2340cc1b0 2023-10-06T01:22:57.566 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:57.564+0000 7fe239f9d700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe2340b08a0 con 0x7fe2340b3610 2023-10-06T01:22:57.566 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:57.564+0000 7fe239f9d700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe2340cb190 con 0x7fe234159480 2023-10-06T01:22:57.566 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:57.564+0000 7fe233fff700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fe2340b3610 0x7fe2340cbc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:57.566 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:57.565+0000 7fe23979c700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fe2340cc1b0 0x7fe2340b2140 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:51798/0 (socket says 172.21.15.50:51798) 2023-10-06T01:22:57.566 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:57.565+0000 7fe23979c700 1 -- 172.21.15.50:0/2920547941 learned_addr learned my addr 172.21.15.50:0/2920547941 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-10-06T01:22:57.566 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:57.565+0000 7fe238f9b700 1 --2- 172.21.15.50:0/2920547941 >> v2:172.21.15.155:3300/0 conn(0x7fe234159480 0x7fe2340b30d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:57.567 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:57.565+0000 7fe233fff700 1 -- 172.21.15.50:0/2920547941 >> v2:172.21.15.155:3300/0 conn(0x7fe234159480 msgr2=0x7fe2340b30d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:22:57.567 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:57.565+0000 7fe233fff700 1 --2- 172.21.15.50:0/2920547941 >> v2:172.21.15.155:3300/0 conn(0x7fe234159480 0x7fe2340b30d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:57.567 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:57.565+0000 7fe233fff700 1 -- 172.21.15.50:0/2920547941 >> v1:172.21.15.50:6789/0 conn(0x7fe2340cc1b0 legacy=0x7fe2340b2140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:57.567 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:57.565+0000 7fe233fff700 1 -- 172.21.15.50:0/2920547941 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2340cb470 con 0x7fe2340b3610 2023-10-06T01:22:57.567 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:57.565+0000 7fe2337fe700 1 -- 172.21.15.50:0/2920547941 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2901601908 0 0) 0x7fe2340cb7e0 con 0x7fe2340cc1b0 2023-10-06T01:22:57.567 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:57.565+0000 7fe233fff700 1 --2- 172.21.15.50:0/2920547941 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe2340b3610 0x7fe2340cbc70 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7fe23406fa30 tx=0x7fe2200091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=da6ce3c9dc0da6ee server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:22:57.568 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:57.565+0000 7fe2337fe700 1 -- 172.21.15.50:0/2920547941 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe22000b6b0 con 0x7fe2340b3610 2023-10-06T01:22:57.568 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:57.566+0000 7fe2337fe700 1 -- 172.21.15.50:0/2920547941 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe22000b810 con 0x7fe2340b3610 2023-10-06T01:22:57.568 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:57.566+0000 7fe2337fe700 1 -- 172.21.15.50:0/2920547941 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe22000bbb0 con 0x7fe2340b3610 2023-10-06T01:22:57.568 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:57.566+0000 7fe239f9d700 1 -- 172.21.15.50:0/2920547941 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe2340b3610 msgr2=0x7fe2340cbc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:57.568 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:57.566+0000 7fe239f9d700 1 --2- 172.21.15.50:0/2920547941 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe2340b3610 0x7fe2340cbc70 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7fe23406fa30 tx=0x7fe2200091a0 comp rx=0 tx=0).stop 2023-10-06T01:22:57.568 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:57.566+0000 7fe239f9d700 1 -- 172.21.15.50:0/2920547941 shutdown_connections 2023-10-06T01:22:57.569 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:57.566+0000 7fe239f9d700 1 --2- 172.21.15.50:0/2920547941 >> v2:172.21.15.155:3300/0 conn(0x7fe234159480 0x7fe2340b30d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:57.569 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:57.566+0000 7fe239f9d700 1 --2- 172.21.15.50:0/2920547941 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe2340b3610 0x7fe2340cbc70 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:57.569 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:57.566+0000 7fe239f9d700 1 -- 172.21.15.50:0/2920547941 >> 172.21.15.50:0/2920547941 conn(0x7fe23406ed20 msgr2=0x7fe23406f120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:22:57.569 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:57.566+0000 7fe239f9d700 1 -- 172.21.15.50:0/2920547941 shutdown_connections 2023-10-06T01:22:57.569 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:57.566+0000 7fe239f9d700 1 -- 172.21.15.50:0/2920547941 wait complete. 2023-10-06T01:22:57.569 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:57.568+0000 7fe239f9d700 1 Processor -- start 2023-10-06T01:22:57.571 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:57.568+0000 7fe239f9d700 1 -- start start 2023-10-06T01:22:57.571 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:57.569+0000 7fe239f9d700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe2340b3610 0x7fe2340c3f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:57.571 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:57.569+0000 7fe239f9d700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe2340cc1b0 0x7fe2340c44c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:57.571 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:57.569+0000 7fe239f9d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe234159480 0x7fe23416ccc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:57.571 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:57.569+0000 7fe239f9d700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2340c5c40 con 0x7fe234159480 2023-10-06T01:22:57.571 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:57.569+0000 7fe239f9d700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2340c5e90 con 0x7fe2340b3610 2023-10-06T01:22:57.571 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:57.569+0000 7fe239f9d700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2340c6170 con 0x7fe2340cc1b0 2023-10-06T01:22:57.571 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:57.569+0000 7fe23979c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe234159480 0x7fe23416ccc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:57.572 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:57.569+0000 7fe23979c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe234159480 0x7fe23416ccc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:53716/0 (socket says 172.21.15.50:53716) 2023-10-06T01:22:57.572 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:57.569+0000 7fe23979c700 1 -- 172.21.15.50:0/1360833218 learned_addr learned my addr 172.21.15.50:0/1360833218 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-06T01:22:57.572 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:57.569+0000 7fe238f9b700 1 --2- 172.21.15.50:0/1360833218 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe2340b3610 0x7fe2340c3f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:57.572 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:57.569+0000 7fe233fff700 1 --2- 172.21.15.50:0/1360833218 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe2340cc1b0 0x7fe2340c44c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:57.572 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:57.569+0000 7fe23979c700 1 -- 172.21.15.50:0/1360833218 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe2340cc1b0 msgr2=0x7fe2340c44c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:57.572 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:57.569+0000 7fe23979c700 1 --2- 172.21.15.50:0/1360833218 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe2340cc1b0 0x7fe2340c44c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:57.572 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:57.569+0000 7fe23979c700 1 -- 172.21.15.50:0/1360833218 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe2340b3610 msgr2=0x7fe2340c3f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:57.572 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:57.569+0000 7fe23979c700 1 --2- 172.21.15.50:0/1360833218 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe2340b3610 0x7fe2340c3f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:57.572 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:57.569+0000 7fe23979c700 1 -- 172.21.15.50:0/1360833218 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe220009420 con 0x7fe234159480 2023-10-06T01:22:57.572 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:57.570+0000 7fe23979c700 1 --2- 172.21.15.50:0/1360833218 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe234159480 0x7fe23416ccc0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7fe22c00cc90 tx=0x7fe22c001a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:22:57.572 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:57.570+0000 7fe230ff9700 1 -- 172.21.15.50:0/1360833218 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe22c00cea0 con 0x7fe234159480 2023-10-06T01:22:57.572 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:57.570+0000 7fe230ff9700 1 -- 172.21.15.50:0/1360833218 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe22c00ab30 con 0x7fe234159480 2023-10-06T01:22:57.572 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:57.570+0000 7fe230ff9700 1 -- 172.21.15.50:0/1360833218 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe22c0070f0 con 0x7fe234159480 2023-10-06T01:22:57.573 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:57.570+0000 7fe239f9d700 1 -- 172.21.15.50:0/1360833218 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe2340c6450 con 0x7fe234159480 2023-10-06T01:22:57.573 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:57.570+0000 7fe239f9d700 1 -- 172.21.15.50:0/1360833218 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe2340c4a00 con 0x7fe234159480 2023-10-06T01:22:57.573 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:57.571+0000 7fe239f9d700 1 -- 172.21.15.50:0/1360833218 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe2340c6970 con 0x7fe234159480 2023-10-06T01:22:57.573 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:57.572+0000 7fe230ff9700 1 -- 172.21.15.50:0/1360833218 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fe22c0074a0 con 0x7fe234159480 2023-10-06T01:22:57.573 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:57.573+0000 7fe230ff9700 1 --2- 172.21.15.50:0/1360833218 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7fe218066f30 0x7fe2180693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:57.574 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:57.573+0000 7fe230ff9700 1 -- 172.21.15.50:0/1360833218 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6378+0+0 (secure 0 0 0) 0x7fe22c084c90 con 0x7fe234159480 2023-10-06T01:22:57.574 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:57.573+0000 7fe238f9b700 1 --2- 172.21.15.50:0/1360833218 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7fe218066f30 0x7fe2180693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:57.575 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:57.574+0000 7fe238f9b700 1 --2- 172.21.15.50:0/1360833218 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7fe218066f30 0x7fe2180693e0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fe228006fd0 tx=0x7fe228008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:22:57.578 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:57.577+0000 7fe230ff9700 1 -- 172.21.15.50:0/1360833218 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe2340c6970 con 0x7fe234159480 2023-10-06T01:22:57.789 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:57.788+0000 7fe239f9d700 1 -- 172.21.15.50:0/1360833218 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe2340c6970 con 0x7fe234159480 2023-10-06T01:22:57.789 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:57.789+0000 7fe230ff9700 1 -- 172.21.15.50:0/1360833218 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v38) v1 ==== 74+0+17084 (secure 0 0 0) 0x7fe2340c6970 con 0x7fe234159480 2023-10-06T01:22:57.790 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-10-06T01:22:57.790 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":38,"fsid":"0bfd9a6b-1587-4fe4-a89e-e43c00286b4e","created":"2023-10-06T01:21:16.828801+0000","modified":"2023-10-06T01:22:56.416120+0000","last_up_change":"2023-10-06T01:21:28.584523+0000","last_in_change":"2023-10-06T01:21:20.179863+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-10-06T01:21:29.304225+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":".mgr","create_time":"2023-10-06T01:21:29.835490+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2023-10-06T01:22:54.641549+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":7,"pool_name":"cephfs_data","create_time":"2023-10-06T01:22:55.389647+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"9060727a-3959-4de3-8363-c5c5d7826c9a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":87837},{"type":"v1","addr":"172.21.15.50:6801","nonce":87837}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":87837},{"type":"v1","addr":"172.21.15.50:6803","nonce":87837}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":87837},{"type":"v1","addr":"172.21.15.50:6807","nonce":87837}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":87837},{"type":"v1","addr":"172.21.15.50:6805","nonce":87837}]},"public_addr":"172.21.15.50:6801/87837","cluster_addr":"172.21.15.50:6803/87837","heartbeat_back_addr":"172.21.15.50:6807/87837","heartbeat_front_addr":"172.21.15.50:6805/87837","state":["exists","up"]},{"osd":1,"uuid":"5ad9ef12-b579-47ea-b690-90ba887e2cef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":87853},{"type":"v1","addr":"172.21.15.50:6809","nonce":87853}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":87853},{"type":"v1","addr":"172.21.15.50:6811","nonce":87853}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":87853},{"type":"v1","addr":"172.21.15.50:6815","nonce":87853}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":87853},{"type":"v1","addr":"172.21.15.50:6813","nonce":87853}]},"public_addr":"172.21.15.50:6809/87853","cluster_addr":"172.21.15.50:6811/87853","heartbeat_back_addr":"172.21.15.50:6815/87853","heartbeat_front_addr":"172.21.15.50:6813/87853","state":["exists","up"]},{"osd":2,"uuid":"c7aee044-6f75-436f-90e1-ba42a57359bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6821","nonce":87855},{"type":"v1","addr":"172.21.15.50:6822","nonce":87855}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6824","nonce":87855},{"type":"v1","addr":"172.21.15.50:6826","nonce":87855}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":87855},{"type":"v1","addr":"172.21.15.50:6831","nonce":87855}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":87855},{"type":"v1","addr":"172.21.15.50:6829","nonce":87855}]},"public_addr":"172.21.15.50:6822/87855","cluster_addr":"172.21.15.50:6826/87855","heartbeat_back_addr":"172.21.15.50:6831/87855","heartbeat_front_addr":"172.21.15.50:6829/87855","state":["exists","up"]},{"osd":3,"uuid":"d9b901c8-e8b2-44af-9508-f453120a96c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":87856},{"type":"v1","addr":"172.21.15.50:6817","nonce":87856}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":87856},{"type":"v1","addr":"172.21.15.50:6819","nonce":87856}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6825","nonce":87856},{"type":"v1","addr":"172.21.15.50:6827","nonce":87856}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6820","nonce":87856},{"type":"v1","addr":"172.21.15.50:6823","nonce":87856}]},"public_addr":"172.21.15.50:6817/87856","cluster_addr":"172.21.15.50:6819/87856","heartbeat_back_addr":"172.21.15.50:6827/87856","heartbeat_front_addr":"172.21.15.50:6823/87856","state":["exists","up"]},{"osd":4,"uuid":"2b3c6b38-e3e9-4301-9445-60fd3fe8ce03","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":85805},{"type":"v1","addr":"172.21.15.155:6801","nonce":85805}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":85805},{"type":"v1","addr":"172.21.15.155:6803","nonce":85805}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6806","nonce":85805},{"type":"v1","addr":"172.21.15.155:6807","nonce":85805}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6804","nonce":85805},{"type":"v1","addr":"172.21.15.155:6805","nonce":85805}]},"public_addr":"172.21.15.155:6801/85805","cluster_addr":"172.21.15.155:6803/85805","heartbeat_back_addr":"172.21.15.155:6807/85805","heartbeat_front_addr":"172.21.15.155:6805/85805","state":["exists","up"]},{"osd":5,"uuid":"417b5f8f-65f1-4c94-91a7-a6ce03fe1679","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6816","nonce":85807},{"type":"v1","addr":"172.21.15.155:6818","nonce":85807}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6820","nonce":85807},{"type":"v1","addr":"172.21.15.155:6822","nonce":85807}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6828","nonce":85807},{"type":"v1","addr":"172.21.15.155:6830","nonce":85807}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6824","nonce":85807},{"type":"v1","addr":"172.21.15.155:6826","nonce":85807}]},"public_addr":"172.21.15.155:6818/85807","cluster_addr":"172.21.15.155:6822/85807","heartbeat_back_addr":"172.21.15.155:6830/85807","heartbeat_front_addr":"172.21.15.155:6826/85807","state":["exists","up"]},{"osd":6,"uuid":"c150cff3-aee4-4714-9c08-d182b1ba9ffd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6808","nonce":85806},{"type":"v1","addr":"172.21.15.155:6809","nonce":85806}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6810","nonce":85806},{"type":"v1","addr":"172.21.15.155:6811","nonce":85806}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6814","nonce":85806},{"type":"v1","addr":"172.21.15.155:6815","nonce":85806}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6812","nonce":85806},{"type":"v1","addr":"172.21.15.155:6813","nonce":85806}]},"public_addr":"172.21.15.155:6809/85806","cluster_addr":"172.21.15.155:6811/85806","heartbeat_back_addr":"172.21.15.155:6815/85806","heartbeat_front_addr":"172.21.15.155:6813/85806","state":["exists","up"]},{"osd":7,"uuid":"71107f0e-04d1-4e72-a0ec-0faf6af003e7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6817","nonce":85832},{"type":"v1","addr":"172.21.15.155:6819","nonce":85832}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6821","nonce":85832},{"type":"v1","addr":"172.21.15.155:6823","nonce":85832}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6829","nonce":85832},{"type":"v1","addr":"172.21.15.155:6831","nonce":85832}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6825","nonce":85832},{"type":"v1","addr":"172.21.15.155:6827","nonce":85832}]},"public_addr":"172.21.15.155:6819/85832","cluster_addr":"172.21.15.155:6823/85832","heartbeat_back_addr":"172.21.15.155:6831/85832","heartbeat_front_addr":"172.21.15.155:6827/85832","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:21:25.423389+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:21:25.472661+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:21:25.817562+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:21:25.551257+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:21:25.407818+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:21:25.557976+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:21:25.747299+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:21:25.827576+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T01:22:57.792 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:57.791+0000 7fe239f9d700 1 -- 172.21.15.50:0/1360833218 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7fe218066f30 msgr2=0x7fe2180693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:57.793 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:57.791+0000 7fe239f9d700 1 --2- 172.21.15.50:0/1360833218 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7fe218066f30 0x7fe2180693e0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fe228006fd0 tx=0x7fe228008040 comp rx=0 tx=0).stop 2023-10-06T01:22:57.793 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:57.791+0000 7fe239f9d700 1 -- 172.21.15.50:0/1360833218 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe234159480 msgr2=0x7fe23416ccc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:57.793 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:57.791+0000 7fe239f9d700 1 --2- 172.21.15.50:0/1360833218 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe234159480 0x7fe23416ccc0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7fe22c00cc90 tx=0x7fe22c001a20 comp rx=0 tx=0).stop 2023-10-06T01:22:57.793 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:57.791+0000 7fe239f9d700 1 -- 172.21.15.50:0/1360833218 shutdown_connections 2023-10-06T01:22:57.793 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:57.791+0000 7fe239f9d700 1 --2- 172.21.15.50:0/1360833218 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe234159480 0x7fe23416ccc0 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:57.793 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:57.791+0000 7fe239f9d700 1 --2- 172.21.15.50:0/1360833218 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7fe218066f30 0x7fe2180693e0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:57.793 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:57.791+0000 7fe239f9d700 1 --2- 172.21.15.50:0/1360833218 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe2340b3610 0x7fe2340c3f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:57.793 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:57.791+0000 7fe239f9d700 1 --2- 172.21.15.50:0/1360833218 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe2340cc1b0 0x7fe2340c44c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:57.793 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:57.791+0000 7fe239f9d700 1 -- 172.21.15.50:0/1360833218 >> 172.21.15.50:0/1360833218 conn(0x7fe23406ed20 msgr2=0x7fe23415beb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:22:57.793 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:57.791+0000 7fe239f9d700 1 -- 172.21.15.50:0/1360833218 shutdown_connections 2023-10-06T01:22:57.793 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:57.791+0000 7fe239f9d700 1 -- 172.21.15.50:0/1360833218 wait complete. 2023-10-06T01:22:57.810 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-10-06T01:22:58.002 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:58.001+0000 7f184659d700 1 Processor -- start 2023-10-06T01:22:58.002 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:58.001+0000 7f184659d700 1 -- start start 2023-10-06T01:22:58.004 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:58.003+0000 7f184659d700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1840159c00 0x7f184006e560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:58.004 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:58.003+0000 7f184659d700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f18400ac980 con 0x7f1840156200 2023-10-06T01:22:58.004 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:58.003+0000 7f184659d700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f184015a0e0 con 0x7f1840155e30 2023-10-06T01:22:58.004 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:58.003+0000 7f184659d700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f184015a3c0 con 0x7f1840159c00 2023-10-06T01:22:58.004 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:58.003+0000 7f1845d9c700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f1840156200 0x7f18400adc50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:51802/0 (socket says 172.21.15.50:51802) 2023-10-06T01:22:58.004 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:58.003+0000 7f1845d9c700 1 -- 172.21.15.50:0/281658888 learned_addr learned my addr 172.21.15.50:0/281658888 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-10-06T01:22:58.004 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:58.003+0000 7f1844d9a700 1 --2- 172.21.15.50:0/281658888 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1840159c00 0x7f184006e560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:58.006 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:58.003+0000 7f1837fff700 1 -- 172.21.15.50:0/281658888 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1229179350 0 0) 0x7f18400ac980 con 0x7f1840156200 2023-10-06T01:22:58.006 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:58.004+0000 7f1837fff700 1 -- 172.21.15.50:0/281658888 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f182c003570 con 0x7f1840156200 2023-10-06T01:22:58.006 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:58.004+0000 7f1837fff700 1 -- 172.21.15.50:0/281658888 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3228370931 0 0) 0x7f184015a0e0 con 0x7f1840155e30 2023-10-06T01:22:58.006 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:58.004+0000 7f1837fff700 1 -- 172.21.15.50:0/281658888 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f18400ac980 con 0x7f1840155e30 2023-10-06T01:22:58.006 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:58.004+0000 7f1844d9a700 1 -- 172.21.15.50:0/281658888 >> v1:172.21.15.155:6789/0 conn(0x7f1840155e30 legacy=0x7f18400c8a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:58.006 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:58.004+0000 7f1844d9a700 1 -- 172.21.15.50:0/281658888 >> v1:172.21.15.50:6789/0 conn(0x7f1840156200 legacy=0x7f18400adc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:58.006 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:58.004+0000 7f1844d9a700 1 -- 172.21.15.50:0/281658888 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f184015a6a0 con 0x7f1840159c00 2023-10-06T01:22:58.007 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:58.004+0000 7f1844d9a700 1 --2- 172.21.15.50:0/281658888 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1840159c00 0x7f184006e560 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f1830009910 tx=0x7f18300091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4fd243a1ab6489a8 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:22:58.007 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:58.004+0000 7f1837fff700 1 -- 172.21.15.50:0/281658888 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1830011630 con 0x7f1840159c00 2023-10-06T01:22:58.007 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:58.004+0000 7f1837fff700 1 -- 172.21.15.50:0/281658888 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1830011790 con 0x7f1840159c00 2023-10-06T01:22:58.007 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:58.004+0000 7f1837fff700 1 -- 172.21.15.50:0/281658888 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1830011b30 con 0x7f1840159c00 2023-10-06T01:22:58.007 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:58.005+0000 7f184659d700 1 -- 172.21.15.50:0/281658888 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1840159c00 msgr2=0x7f184006e560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:58.007 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:58.005+0000 7f184659d700 1 --2- 172.21.15.50:0/281658888 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1840159c00 0x7f184006e560 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f1830009910 tx=0x7f18300091a0 comp rx=0 tx=0).stop 2023-10-06T01:22:58.007 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:58.005+0000 7f184659d700 1 -- 172.21.15.50:0/281658888 shutdown_connections 2023-10-06T01:22:58.007 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:58.005+0000 7f184659d700 1 --2- 172.21.15.50:0/281658888 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1840159c00 0x7f184006e560 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:58.007 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:58.005+0000 7f184659d700 1 -- 172.21.15.50:0/281658888 >> 172.21.15.50:0/281658888 conn(0x7f18400cbeb0 msgr2=0x7f18400cc2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:22:58.007 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:58.005+0000 7f184659d700 1 -- 172.21.15.50:0/281658888 shutdown_connections 2023-10-06T01:22:58.007 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:58.005+0000 7f184659d700 1 -- 172.21.15.50:0/281658888 wait complete. 2023-10-06T01:22:58.008 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:58.006+0000 7f184659d700 1 Processor -- start 2023-10-06T01:22:58.009 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:58.007+0000 7f184659d700 1 -- start start 2023-10-06T01:22:58.009 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:58.008+0000 7f184659d700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1840155e30 0x7f1840150990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:58.009 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:58.008+0000 7f184659d700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1840156200 0x7f1840069e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:58.009 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:58.008+0000 7f184659d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1840159c00 0x7f184016d210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:58.009 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:58.008+0000 7f184659d700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1840158e20 con 0x7f1840159c00 2023-10-06T01:22:58.009 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:58.008+0000 7f184659d700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1840158240 con 0x7f1840155e30 2023-10-06T01:22:58.009 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:58.008+0000 7f184659d700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1840157c20 con 0x7f1840156200 2023-10-06T01:22:58.009 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:58.008+0000 7f1845d9c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1840159c00 0x7f184016d210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:58.009 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:58.008+0000 7f1845d9c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1840159c00 0x7f184016d210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:53730/0 (socket says 172.21.15.50:53730) 2023-10-06T01:22:58.010 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:58.008+0000 7f1845d9c700 1 -- 172.21.15.50:0/4270287121 learned_addr learned my addr 172.21.15.50:0/4270287121 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-06T01:22:58.010 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:58.008+0000 7f184559b700 1 --2- 172.21.15.50:0/4270287121 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1840155e30 0x7f1840150990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:58.010 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:58.008+0000 7f1844d9a700 1 --2- 172.21.15.50:0/4270287121 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1840156200 0x7f1840069e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:58.011 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:58.008+0000 7f1845d9c700 1 -- 172.21.15.50:0/4270287121 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1840156200 msgr2=0x7f1840069e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:58.011 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:58.008+0000 7f1845d9c700 1 --2- 172.21.15.50:0/4270287121 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1840156200 0x7f1840069e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:58.011 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:58.008+0000 7f1845d9c700 1 -- 172.21.15.50:0/4270287121 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1840155e30 msgr2=0x7f1840150990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:58.011 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:58.008+0000 7f1845d9c700 1 --2- 172.21.15.50:0/4270287121 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1840155e30 0x7f1840150990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:58.011 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:58.008+0000 7f1845d9c700 1 -- 172.21.15.50:0/4270287121 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1830009420 con 0x7f1840159c00 2023-10-06T01:22:58.011 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:58.009+0000 7f1845d9c700 1 --2- 172.21.15.50:0/4270287121 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1840159c00 0x7f184016d210 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f183800cc60 tx=0x7f1838001ae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:22:58.012 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:58.009+0000 7f18357fa700 1 -- 172.21.15.50:0/4270287121 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f183800a8b0 con 0x7f1840159c00 2023-10-06T01:22:58.012 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:58.009+0000 7f18357fa700 1 -- 172.21.15.50:0/4270287121 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f183800aa30 con 0x7f1840159c00 2023-10-06T01:22:58.012 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:58.009+0000 7f18357fa700 1 -- 172.21.15.50:0/4270287121 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f183800adf0 con 0x7f1840159c00 2023-10-06T01:22:58.012 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:58.009+0000 7f184659d700 1 -- 172.21.15.50:0/4270287121 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1840159070 con 0x7f1840159c00 2023-10-06T01:22:58.012 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:58.009+0000 7f184659d700 1 -- 172.21.15.50:0/4270287121 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1840157ed0 con 0x7f1840159c00 2023-10-06T01:22:58.012 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:58.010+0000 7f184659d700 1 -- 172.21.15.50:0/4270287121 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f18400ac5d0 con 0x7f1840159c00 2023-10-06T01:22:58.013 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:58.011+0000 7f18357fa700 1 -- 172.21.15.50:0/4270287121 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f1838007300 con 0x7f1840159c00 2023-10-06T01:22:58.013 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:58.012+0000 7f18357fa700 1 --2- 172.21.15.50:0/4270287121 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f1824066f30 0x7f18240693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:58.013 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:58.012+0000 7f18357fa700 1 -- 172.21.15.50:0/4270287121 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f1838084ba0 con 0x7f1840159c00 2023-10-06T01:22:58.013 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:58.012+0000 7f184559b700 1 --2- 172.21.15.50:0/4270287121 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f1824066f30 0x7f18240693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:58.013 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:58.013+0000 7f184559b700 1 --2- 172.21.15.50:0/4270287121 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f1824066f30 0x7f18240693e0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f183c007fd0 tx=0x7f183c007d50 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:22:58.018 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:58.017+0000 7f18357fa700 1 -- 172.21.15.50:0/4270287121 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f1838051b50 con 0x7f1840159c00 2023-10-06T01:22:58.265 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:58.264+0000 7f184659d700 1 -- 172.21.15.50:0/4270287121 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f18401583b0 con 0x7f1840159c00 2023-10-06T01:22:58.936 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:58.935+0000 7f18357fa700 1 -- 172.21.15.50:0/4270287121 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v17) v1 ==== 118+0+0 (secure 0 0 0) 0x7f1838055170 con 0x7f1840159c00 2023-10-06T01:22:58.939 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:58.938+0000 7f184659d700 1 -- 172.21.15.50:0/4270287121 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f1824066f30 msgr2=0x7f18240693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:58.940 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:58.938+0000 7f184659d700 1 --2- 172.21.15.50:0/4270287121 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f1824066f30 0x7f18240693e0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f183c007fd0 tx=0x7f183c007d50 comp rx=0 tx=0).stop 2023-10-06T01:22:58.940 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:58.938+0000 7f184659d700 1 -- 172.21.15.50:0/4270287121 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1840159c00 msgr2=0x7f184016d210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:58.940 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:58.938+0000 7f184659d700 1 --2- 172.21.15.50:0/4270287121 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1840159c00 0x7f184016d210 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f183800cc60 tx=0x7f1838001ae0 comp rx=0 tx=0).stop 2023-10-06T01:22:58.940 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:58.938+0000 7f184659d700 1 -- 172.21.15.50:0/4270287121 shutdown_connections 2023-10-06T01:22:58.940 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:58.938+0000 7f184659d700 1 --2- 172.21.15.50:0/4270287121 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1840159c00 0x7f184016d210 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:58.940 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:58.938+0000 7f184659d700 1 --2- 172.21.15.50:0/4270287121 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f1824066f30 0x7f18240693e0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:58.940 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:58.938+0000 7f184659d700 1 --2- 172.21.15.50:0/4270287121 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1840155e30 0x7f1840150990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:58.940 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:58.938+0000 7f184659d700 1 --2- 172.21.15.50:0/4270287121 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1840156200 0x7f1840069e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:58.940 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:58.939+0000 7f184659d700 1 -- 172.21.15.50:0/4270287121 >> 172.21.15.50:0/4270287121 conn(0x7f18400cbeb0 msgr2=0x7f18400cc6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:22:58.941 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:58.939+0000 7f184659d700 1 -- 172.21.15.50:0/4270287121 shutdown_connections 2023-10-06T01:22:58.941 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:58.939+0000 7f184659d700 1 -- 172.21.15.50:0/4270287121 wait complete. 2023-10-06T01:22:58.961 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-10-06T01:22:59.158 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:59.157+0000 7f0a1ef9d700 1 Processor -- start 2023-10-06T01:22:59.158 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:59.157+0000 7f0a1ef9d700 1 -- start start 2023-10-06T01:22:59.159 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:59.158+0000 7f0a1ef9d700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0a180b2a30 0x7f0a18164360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:59.159 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:59.158+0000 7f0a1ef9d700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0a180cc9b0 con 0x7f0a180cd400 2023-10-06T01:22:59.159 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:59.158+0000 7f0a1ef9d700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0a180cbda0 con 0x7f0a180b2660 2023-10-06T01:22:59.160 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:59.158+0000 7f0a1ef9d700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a180cc080 con 0x7f0a180b2a30 2023-10-06T01:22:59.160 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:59.159+0000 7f0a1d79a700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f0a180cd400 0x7f0a180ceae0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:51806/0 (socket says 172.21.15.50:51806) 2023-10-06T01:22:59.160 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:59.159+0000 7f0a1d79a700 1 -- 172.21.15.50:0/1939829782 learned_addr learned my addr 172.21.15.50:0/1939829782 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-10-06T01:22:59.163 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:59.159+0000 7f0a1e79c700 1 --2- 172.21.15.50:0/1939829782 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0a180b2a30 0x7f0a18164360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:59.164 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:59.159+0000 7f0a1cf99700 1 -- 172.21.15.50:0/1939829782 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2882028872 0 0) 0x7f0a180cc9b0 con 0x7f0a180cd400 2023-10-06T01:22:59.164 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:59.159+0000 7f0a1cf99700 1 -- 172.21.15.50:0/1939829782 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0a04003570 con 0x7f0a180cd400 2023-10-06T01:22:59.164 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:59.159+0000 7f0a1cf99700 1 -- 172.21.15.50:0/1939829782 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 592548344 0 0) 0x7f0a180cbda0 con 0x7f0a180b2660 2023-10-06T01:22:59.164 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:59.159+0000 7f0a1cf99700 1 -- 172.21.15.50:0/1939829782 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0a180cc9b0 con 0x7f0a180b2660 2023-10-06T01:22:59.164 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:59.159+0000 7f0a1cf99700 1 -- 172.21.15.50:0/1939829782 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3781385998 0 0) 0x7f0a04003570 con 0x7f0a180cd400 2023-10-06T01:22:59.164 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:59.159+0000 7f0a1cf99700 1 -- 172.21.15.50:0/1939829782 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0a180b2a30 msgr2=0x7f0a18164360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:22:59.164 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:59.159+0000 7f0a1cf99700 1 --2- 172.21.15.50:0/1939829782 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0a180b2a30 0x7f0a18164360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:59.164 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:59.159+0000 7f0a1cf99700 1 -- 172.21.15.50:0/1939829782 >> v1:172.21.15.155:6789/0 conn(0x7f0a180b2660 legacy=0x7f0a180cccf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:59.164 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:59.159+0000 7f0a1cf99700 1 -- 172.21.15.50:0/1939829782 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a180cc360 con 0x7f0a180cd400 2023-10-06T01:22:59.164 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:59.159+0000 7f0a1cf99700 1 -- 172.21.15.50:0/1939829782 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 347519148 0 0) 0x7f0a08001470 con 0x7f0a180cd400 2023-10-06T01:22:59.164 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:59.160+0000 7f0a1cf99700 1 -- 172.21.15.50:0/1939829782 >> v1:172.21.15.50:6789/0 conn(0x7f0a180cd400 legacy=0x7f0a180ceae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:59.165 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:59.160+0000 7f0a1cf99700 1 --2- 172.21.15.50:0/1939829782 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0a04003c20 0x7f0a04004010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:59.165 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:59.160+0000 7f0a1cf99700 1 --2- 172.21.15.50:0/1939829782 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0a180b2a30 0x7f0a04004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:59.165 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:59.160+0000 7f0a1cf99700 1 --2- 172.21.15.50:0/1939829782 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0a04004d50 0x7f0a040051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:59.165 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:59.160+0000 7f0a1cf99700 1 -- 172.21.15.50:0/1939829782 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a180cc080 con 0x7f0a04003c20 2023-10-06T01:22:59.165 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:59.160+0000 7f0a1cf99700 1 -- 172.21.15.50:0/1939829782 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a0400bb40 con 0x7f0a04004d50 2023-10-06T01:22:59.165 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:59.160+0000 7f0a1cf99700 1 -- 172.21.15.50:0/1939829782 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a0400bd00 con 0x7f0a180b2a30 2023-10-06T01:22:59.165 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:59.160+0000 7f0a1df9b700 1 --2- 172.21.15.50:0/1939829782 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0a04003c20 0x7f0a04004010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:59.165 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:59.160+0000 7f0a1d79a700 1 --2- 172.21.15.50:0/1939829782 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0a180b2a30 0x7f0a04004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:59.165 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:59.160+0000 7f0a1e79c700 1 --2- 172.21.15.50:0/1939829782 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0a04004d50 0x7f0a040051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:59.165 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:59.160+0000 7f0a1df9b700 1 -- 172.21.15.50:0/1939829782 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0a180b2a30 msgr2=0x7f0a04004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:22:59.165 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:59.160+0000 7f0a1df9b700 1 --2- 172.21.15.50:0/1939829782 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0a180b2a30 0x7f0a04004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:59.166 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:59.160+0000 7f0a1df9b700 1 -- 172.21.15.50:0/1939829782 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0a04004d50 msgr2=0x7f0a040051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:22:59.166 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:59.160+0000 7f0a1df9b700 1 --2- 172.21.15.50:0/1939829782 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0a04004d50 0x7f0a040051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:59.166 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:59.160+0000 7f0a1df9b700 1 -- 172.21.15.50:0/1939829782 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a04003570 con 0x7f0a04003c20 2023-10-06T01:22:59.166 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:59.160+0000 7f0a1e79c700 1 --2- 172.21.15.50:0/1939829782 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0a04004d50 0x7f0a040051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T01:22:59.166 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:59.160+0000 7f0a1df9b700 1 --2- 172.21.15.50:0/1939829782 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0a04003c20 0x7f0a04004010 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f0a14001a70 tx=0x7f0a14007d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e784fb05f8e8615a server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:22:59.166 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:59.161+0000 7f0a1cf99700 1 -- 172.21.15.50:0/1939829782 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a14001430 con 0x7f0a04003c20 2023-10-06T01:22:59.166 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:59.161+0000 7f0a1cf99700 1 -- 172.21.15.50:0/1939829782 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a1400c5d0 con 0x7f0a04003c20 2023-10-06T01:22:59.166 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:59.161+0000 7f0a1cf99700 1 -- 172.21.15.50:0/1939829782 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a1400c990 con 0x7f0a04003c20 2023-10-06T01:22:59.166 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:59.161+0000 7f0a1ef9d700 1 -- 172.21.15.50:0/1939829782 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0a04003c20 msgr2=0x7f0a04004010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:59.166 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:59.161+0000 7f0a1ef9d700 1 --2- 172.21.15.50:0/1939829782 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0a04003c20 0x7f0a04004010 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f0a14001a70 tx=0x7f0a14007d80 comp rx=0 tx=0).stop 2023-10-06T01:22:59.166 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:59.161+0000 7f0a1e79c700 1 -- 172.21.15.50:0/1939829782 reap_dead start 2023-10-06T01:22:59.166 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:59.161+0000 7f0a1ef9d700 1 -- 172.21.15.50:0/1939829782 shutdown_connections 2023-10-06T01:22:59.167 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:59.161+0000 7f0a1ef9d700 1 -- 172.21.15.50:0/1939829782 >> 172.21.15.50:0/1939829782 conn(0x7f0a18099560 msgr2=0x7f0a1806f500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:22:59.167 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:59.161+0000 7f0a1ef9d700 1 -- 172.21.15.50:0/1939829782 shutdown_connections 2023-10-06T01:22:59.167 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:59.161+0000 7f0a1ef9d700 1 -- 172.21.15.50:0/1939829782 wait complete. 2023-10-06T01:22:59.167 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:59.163+0000 7f0a1ef9d700 1 Processor -- start 2023-10-06T01:22:59.167 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:59.163+0000 7f0a1ef9d700 1 -- start start 2023-10-06T01:22:59.169 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:59.164+0000 7f0a1ef9d700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0a04003c20 0x7f0a18152d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:59.169 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:59.164+0000 7f0a1ef9d700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0a18157330 0x7f0a181577a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:59.169 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:59.164+0000 7f0a1ef9d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0a18159c00 0x7f0a1815a070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:59.169 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:59.164+0000 7f0a1ef9d700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a1815aaf0 con 0x7f0a18159c00 2023-10-06T01:22:59.169 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:59.164+0000 7f0a1ef9d700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a181537e0 con 0x7f0a04003c20 2023-10-06T01:22:59.170 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:59.164+0000 7f0a1ef9d700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a18153260 con 0x7f0a18157330 2023-10-06T01:22:59.170 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:59.164+0000 7f0a1e79c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0a18159c00 0x7f0a1815a070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:59.170 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:59.164+0000 7f0a1e79c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0a18159c00 0x7f0a1815a070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:53762/0 (socket says 172.21.15.50:53762) 2023-10-06T01:22:59.170 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:59.164+0000 7f0a1e79c700 1 -- 172.21.15.50:0/3022988575 learned_addr learned my addr 172.21.15.50:0/3022988575 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-06T01:22:59.170 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:59.164+0000 7f0a1d79a700 1 --2- 172.21.15.50:0/3022988575 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0a18157330 0x7f0a181577a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:59.170 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:59.164+0000 7f0a1df9b700 1 --2- 172.21.15.50:0/3022988575 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0a04003c20 0x7f0a18152d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:59.170 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:59.164+0000 7f0a1e79c700 1 -- 172.21.15.50:0/3022988575 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0a18157330 msgr2=0x7f0a181577a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:59.170 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:59.164+0000 7f0a1e79c700 1 --2- 172.21.15.50:0/3022988575 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0a18157330 0x7f0a181577a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:59.170 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:59.164+0000 7f0a1e79c700 1 -- 172.21.15.50:0/3022988575 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0a04003c20 msgr2=0x7f0a18152d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:59.170 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:59.164+0000 7f0a1e79c700 1 --2- 172.21.15.50:0/3022988575 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0a04003c20 0x7f0a18152d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:59.170 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:59.164+0000 7f0a1e79c700 1 -- 172.21.15.50:0/3022988575 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a18157ce0 con 0x7f0a18159c00 2023-10-06T01:22:59.171 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:59.164+0000 7f0a1df9b700 1 --2- 172.21.15.50:0/3022988575 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0a04003c20 0x7f0a18152d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T01:22:59.171 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:59.165+0000 7f0a1e79c700 1 --2- 172.21.15.50:0/3022988575 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0a18159c00 0x7f0a1815a070 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f0a10007ef0 tx=0x7f0a1000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:22:59.171 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:59.165+0000 7f0a0dffb700 1 -- 172.21.15.50:0/3022988575 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a1000fce0 con 0x7f0a18159c00 2023-10-06T01:22:59.171 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:59.165+0000 7f0a0dffb700 1 -- 172.21.15.50:0/3022988575 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a1000fe40 con 0x7f0a18159c00 2023-10-06T01:22:59.171 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:59.165+0000 7f0a0dffb700 1 -- 172.21.15.50:0/3022988575 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a10016650 con 0x7f0a18159c00 2023-10-06T01:22:59.171 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:59.165+0000 7f0a1ef9d700 1 -- 172.21.15.50:0/3022988575 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0a1815a5b0 con 0x7f0a18159c00 2023-10-06T01:22:59.171 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:59.165+0000 7f0a1ef9d700 1 -- 172.21.15.50:0/3022988575 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0a1816d170 con 0x7f0a18159c00 2023-10-06T01:22:59.171 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:59.166+0000 7f0a1ef9d700 1 -- 172.21.15.50:0/3022988575 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0a1816cfd0 con 0x7f0a18159c00 2023-10-06T01:22:59.171 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:59.167+0000 7f0a0dffb700 1 -- 172.21.15.50:0/3022988575 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f0a100169c0 con 0x7f0a18159c00 2023-10-06T01:22:59.171 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:59.168+0000 7f0a0dffb700 1 --2- 172.21.15.50:0/3022988575 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f09fc066f30 0x7f09fc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:22:59.171 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:59.168+0000 7f0a0dffb700 1 -- 172.21.15.50:0/3022988575 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f0a100853e0 con 0x7f0a18159c00 2023-10-06T01:22:59.171 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:59.168+0000 7f0a1df9b700 1 --2- 172.21.15.50:0/3022988575 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f09fc066f30 0x7f09fc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:22:59.172 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:59.169+0000 7f0a1df9b700 1 --2- 172.21.15.50:0/3022988575 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f09fc066f30 0x7f09fc0693e0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f0a14000c00 tx=0x7f0a14015000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:22:59.172 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:59.172+0000 7f0a0dffb700 1 -- 172.21.15.50:0/3022988575 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f0a1816cfd0 con 0x7f0a18159c00 2023-10-06T01:22:59.419 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:59.418+0000 7f0a1ef9d700 1 -- 172.21.15.50:0/3022988575 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f0a1816cfd0 con 0x7f0a18159c00 2023-10-06T01:22:59.899 INFO:tasks.ceph.mds.c.smithi050.stderr:2023-10-06T01:22:59.898+0000 7fd4cb1f1700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-06T01:22:59.941 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:59.940+0000 7f0a0dffb700 1 -- 172.21.15.50:0/3022988575 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v18) v1 ==== 122+0+0 (secure 0 0 0) 0x7f0a1816cfd0 con 0x7f0a18159c00 2023-10-06T01:22:59.944 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:59.943+0000 7f0a1ef9d700 1 -- 172.21.15.50:0/3022988575 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f09fc066f30 msgr2=0x7f09fc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:59.944 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:59.943+0000 7f0a1ef9d700 1 --2- 172.21.15.50:0/3022988575 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f09fc066f30 0x7f09fc0693e0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f0a14000c00 tx=0x7f0a14015000 comp rx=0 tx=0).stop 2023-10-06T01:22:59.944 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:59.943+0000 7f0a1ef9d700 1 -- 172.21.15.50:0/3022988575 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0a18159c00 msgr2=0x7f0a1815a070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:22:59.944 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:59.943+0000 7f0a1ef9d700 1 --2- 172.21.15.50:0/3022988575 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0a18159c00 0x7f0a1815a070 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f0a10007ef0 tx=0x7f0a1000b040 comp rx=0 tx=0).stop 2023-10-06T01:22:59.945 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:59.943+0000 7f0a1ef9d700 1 -- 172.21.15.50:0/3022988575 shutdown_connections 2023-10-06T01:22:59.945 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:59.943+0000 7f0a1ef9d700 1 --2- 172.21.15.50:0/3022988575 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0a18159c00 0x7f0a1815a070 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:59.945 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:59.943+0000 7f0a1ef9d700 1 --2- 172.21.15.50:0/3022988575 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f09fc066f30 0x7f09fc0693e0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:59.945 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:59.943+0000 7f0a1ef9d700 1 --2- 172.21.15.50:0/3022988575 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0a04003c20 0x7f0a18152d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:59.945 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:59.943+0000 7f0a1ef9d700 1 --2- 172.21.15.50:0/3022988575 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0a18157330 0x7f0a181577a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:22:59.945 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:59.943+0000 7f0a1ef9d700 1 -- 172.21.15.50:0/3022988575 >> 172.21.15.50:0/3022988575 conn(0x7f0a18099560 msgr2=0x7f0a18154270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:22:59.945 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:59.943+0000 7f0a1ef9d700 1 -- 172.21.15.50:0/3022988575 shutdown_connections 2023-10-06T01:22:59.945 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:22:59.943+0000 7f0a1ef9d700 1 -- 172.21.15.50:0/3022988575 wait complete. 2023-10-06T01:22:59.963 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T01:23:00.154 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:00.153+0000 7f318b39d700 1 Processor -- start 2023-10-06T01:23:00.155 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:00.153+0000 7f318b39d700 1 -- start start 2023-10-06T01:23:00.156 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:00.155+0000 7f318b39d700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f31840cb5e0 0x7f31840cb9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:23:00.156 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:00.155+0000 7f318b39d700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f3184159490 0x7f31841598d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:23:00.156 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:00.155+0000 7f318b39d700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3184159e10 con 0x7f318406f350 2023-10-06T01:23:00.156 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:00.155+0000 7f318b39d700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f318406ec00 con 0x7f3184159490 2023-10-06T01:23:00.156 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:00.155+0000 7f318b39d700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f318406e080 con 0x7f31840cb5e0 2023-10-06T01:23:00.156 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:00.155+0000 7f318ab9c700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f3184159490 0x7f31841598d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:23:00.157 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:00.155+0000 7f318ab9c700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f3184159490 0x7f31841598d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:53764/0 (socket says 172.21.15.50:53764) 2023-10-06T01:23:00.157 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:00.155+0000 7f318ab9c700 1 -- 172.21.15.50:0/1681424679 learned_addr learned my addr 172.21.15.50:0/1681424679 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-06T01:23:00.157 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:00.155+0000 7f318a39b700 1 --2- 172.21.15.50:0/1681424679 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f31840cb5e0 0x7f31840cb9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:23:00.158 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:00.156+0000 7f318ab9c700 1 -- 172.21.15.50:0/1681424679 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f31840cb5e0 msgr2=0x7f31840cb9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:23:00.158 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:00.156+0000 7f318ab9c700 1 --2- 172.21.15.50:0/1681424679 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f31840cb5e0 0x7f31840cb9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:23:00.158 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:00.156+0000 7f318ab9c700 1 -- 172.21.15.50:0/1681424679 >> v1:172.21.15.155:6789/0 conn(0x7f318406f350 legacy=0x7f318406d630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:23:00.158 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:00.156+0000 7f318ab9c700 1 -- 172.21.15.50:0/1681424679 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f318406e360 con 0x7f3184159490 2023-10-06T01:23:00.159 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:00.156+0000 7f318ab9c700 1 --2- 172.21.15.50:0/1681424679 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3184159490 0x7f31841598d0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f317c00d1a0 tx=0x7f317c00ba50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cf846e84c0d92526 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:23:00.159 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:00.156+0000 7f3189399700 1 -- 172.21.15.50:0/1681424679 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f317c010070 con 0x7f3184159490 2023-10-06T01:23:00.159 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:00.156+0000 7f3189399700 1 -- 172.21.15.50:0/1681424679 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f317c00dc00 con 0x7f3184159490 2023-10-06T01:23:00.159 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:00.156+0000 7f3189399700 1 -- 172.21.15.50:0/1681424679 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f317c016400 con 0x7f3184159490 2023-10-06T01:23:00.159 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:00.157+0000 7f318b39d700 1 -- 172.21.15.50:0/1681424679 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3184159490 msgr2=0x7f31841598d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:23:00.159 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:00.157+0000 7f318b39d700 1 --2- 172.21.15.50:0/1681424679 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3184159490 0x7f31841598d0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f317c00d1a0 tx=0x7f317c00ba50 comp rx=0 tx=0).stop 2023-10-06T01:23:00.159 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:00.157+0000 7f318b39d700 1 -- 172.21.15.50:0/1681424679 shutdown_connections 2023-10-06T01:23:00.159 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:00.157+0000 7f318b39d700 1 --2- 172.21.15.50:0/1681424679 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3184159490 0x7f31841598d0 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:23:00.159 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:00.157+0000 7f318b39d700 1 --2- 172.21.15.50:0/1681424679 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f31840cb5e0 0x7f31840cb9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:23:00.159 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:00.157+0000 7f318b39d700 1 -- 172.21.15.50:0/1681424679 >> 172.21.15.50:0/1681424679 conn(0x7f31840680c0 msgr2=0x7f31840cbf00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:23:00.160 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:00.157+0000 7f318b39d700 1 -- 172.21.15.50:0/1681424679 shutdown_connections 2023-10-06T01:23:00.160 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:00.157+0000 7f318b39d700 1 -- 172.21.15.50:0/1681424679 wait complete. 2023-10-06T01:23:00.162 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:00.158+0000 7f318b39d700 1 Processor -- start 2023-10-06T01:23:00.162 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:00.159+0000 7f318b39d700 1 -- start start 2023-10-06T01:23:00.162 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:00.159+0000 7f318b39d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f31840cb5e0 0x7f31840ab740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:23:00.162 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:00.160+0000 7f318b39d700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3184159490 0x7f31840ad0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:23:00.162 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:00.160+0000 7f318b39d700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f318414dff0 0x7f31840ad630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:23:00.162 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:00.160+0000 7f318b39d700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31841693b0 con 0x7f31840cb5e0 2023-10-06T01:23:00.162 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:00.160+0000 7f318b39d700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31840c5c40 con 0x7f318414dff0 2023-10-06T01:23:00.162 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:00.160+0000 7f318b39d700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31840abc80 con 0x7f3184159490 2023-10-06T01:23:00.162 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:00.160+0000 7f318a39b700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f31840cb5e0 0x7f31840ab740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:23:00.163 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:00.160+0000 7f318a39b700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f31840cb5e0 0x7f31840ab740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:53776/0 (socket says 172.21.15.50:53776) 2023-10-06T01:23:00.163 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:00.160+0000 7f318a39b700 1 -- 172.21.15.50:0/3384405629 learned_addr learned my addr 172.21.15.50:0/3384405629 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-06T01:23:00.163 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:00.160+0000 7f3189b9a700 1 --2- 172.21.15.50:0/3384405629 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3184159490 0x7f31840ad0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:23:00.163 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:00.160+0000 7f318ab9c700 1 --2- 172.21.15.50:0/3384405629 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f318414dff0 0x7f31840ad630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:23:00.163 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:00.160+0000 7f318a39b700 1 -- 172.21.15.50:0/3384405629 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3184159490 msgr2=0x7f31840ad0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:23:00.163 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:00.160+0000 7f318a39b700 1 --2- 172.21.15.50:0/3384405629 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3184159490 0x7f31840ad0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:23:00.163 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:00.160+0000 7f318a39b700 1 -- 172.21.15.50:0/3384405629 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f318414dff0 msgr2=0x7f31840ad630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:23:00.163 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:00.160+0000 7f318a39b700 1 --2- 172.21.15.50:0/3384405629 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f318414dff0 0x7f31840ad630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:23:00.163 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:00.160+0000 7f318a39b700 1 -- 172.21.15.50:0/3384405629 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f317c00bcf0 con 0x7f31840cb5e0 2023-10-06T01:23:00.164 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:00.161+0000 7f318a39b700 1 --2- 172.21.15.50:0/3384405629 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f31840cb5e0 0x7f31840ab740 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f318000ec80 tx=0x7f31800091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:23:00.164 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:00.161+0000 7f317a7fc700 1 -- 172.21.15.50:0/3384405629 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f318000c850 con 0x7f31840cb5e0 2023-10-06T01:23:00.164 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:00.161+0000 7f317a7fc700 1 -- 172.21.15.50:0/3384405629 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f318000c9b0 con 0x7f31840cb5e0 2023-10-06T01:23:00.164 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:00.161+0000 7f318b39d700 1 -- 172.21.15.50:0/3384405629 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f318414e520 con 0x7f31840cb5e0 2023-10-06T01:23:00.164 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:00.161+0000 7f317a7fc700 1 -- 172.21.15.50:0/3384405629 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f318000cd50 con 0x7f31840cb5e0 2023-10-06T01:23:00.164 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:00.161+0000 7f318b39d700 1 -- 172.21.15.50:0/3384405629 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f318414eae0 con 0x7f31840cb5e0 2023-10-06T01:23:00.165 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:00.162+0000 7f318b39d700 1 -- 172.21.15.50:0/3384405629 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f31840c3220 con 0x7f31840cb5e0 2023-10-06T01:23:00.165 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:00.163+0000 7f317a7fc700 1 -- 172.21.15.50:0/3384405629 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f3180013680 con 0x7f31840cb5e0 2023-10-06T01:23:00.165 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:00.164+0000 7f317a7fc700 1 --2- 172.21.15.50:0/3384405629 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f3168066f30 0x7f31680693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:23:00.165 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:00.164+0000 7f317a7fc700 1 -- 172.21.15.50:0/3384405629 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f3180084aa0 con 0x7f31840cb5e0 2023-10-06T01:23:00.166 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:00.165+0000 7f3189b9a700 1 --2- 172.21.15.50:0/3384405629 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f3168066f30 0x7f31680693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:23:00.166 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:00.165+0000 7f3189b9a700 1 --2- 172.21.15.50:0/3384405629 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f3168066f30 0x7f31680693e0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f318416ca70 tx=0x7f3174007ec0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:23:00.169 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:00.168+0000 7f317a7fc700 1 -- 172.21.15.50:0/3384405629 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f31800519d0 con 0x7f31840cb5e0 2023-10-06T01:23:00.414 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:00.414+0000 7f318b39d700 1 -- 172.21.15.50:0/3384405629 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f318405f270 con 0x7f31840cb5e0 2023-10-06T01:23:00.415 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:00.414+0000 7f317a7fc700 1 -- 172.21.15.50:0/3384405629 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) v1 ==== 94+0+4603 (secure 0 0 0) 0x7f3180054ff0 con 0x7f31840cb5e0 2023-10-06T01:23:00.415 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-10-06T01:23:00.415 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":18,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4769,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6833/3835292201","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6832","nonce":3835292201},{"type":"v1","addr":"172.21.15.50:6833","nonce":3835292201}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":13},{"gid":4772,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6837/2073318681","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6835","nonce":2073318681},{"type":"v1","addr":"172.21.15.155:6837","nonce":2073318681}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":13},{"gid":4993,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6836/2652534948","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":2652534948},{"type":"v1","addr":"172.21.15.155:6836","nonce":2652534948}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":18,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T01:22:56.416443+0000","modified":"2023-10-06T01:22:59.935058+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5160},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5160":{"gid":5160,"name":"c","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.50:6835/3957156573","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6834","nonce":3957156573},{"type":"v1","addr":"172.21.15.50:6835","nonce":3957156573}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2}]} 2023-10-06T01:23:00.418 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:00.417+0000 7f318b39d700 1 -- 172.21.15.50:0/3384405629 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f3168066f30 msgr2=0x7f31680693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:23:00.418 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:00.417+0000 7f318b39d700 1 --2- 172.21.15.50:0/3384405629 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f3168066f30 0x7f31680693e0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f318416ca70 tx=0x7f3174007ec0 comp rx=0 tx=0).stop 2023-10-06T01:23:00.418 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:00.417+0000 7f318b39d700 1 -- 172.21.15.50:0/3384405629 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f31840cb5e0 msgr2=0x7f31840ab740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:23:00.418 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:00.417+0000 7f318b39d700 1 --2- 172.21.15.50:0/3384405629 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f31840cb5e0 0x7f31840ab740 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f318000ec80 tx=0x7f31800091a0 comp rx=0 tx=0).stop 2023-10-06T01:23:00.419 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:00.417+0000 7f318b39d700 1 -- 172.21.15.50:0/3384405629 shutdown_connections 2023-10-06T01:23:00.419 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:00.417+0000 7f318b39d700 1 --2- 172.21.15.50:0/3384405629 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f3168066f30 0x7f31680693e0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:23:00.419 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:00.417+0000 7f318b39d700 1 --2- 172.21.15.50:0/3384405629 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f318414dff0 0x7f31840ad630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:23:00.419 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:00.417+0000 7f318b39d700 1 --2- 172.21.15.50:0/3384405629 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f31840cb5e0 0x7f31840ab740 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:23:00.419 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:00.417+0000 7f318b39d700 1 --2- 172.21.15.50:0/3384405629 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3184159490 0x7f31840ad0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:23:00.419 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:00.417+0000 7f318b39d700 1 -- 172.21.15.50:0/3384405629 >> 172.21.15.50:0/3384405629 conn(0x7f31840680c0 msgr2=0x7f31840c1ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:23:00.419 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:00.417+0000 7f318b39d700 1 -- 172.21.15.50:0/3384405629 shutdown_connections 2023-10-06T01:23:00.419 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:00.417+0000 7f318b39d700 1 -- 172.21.15.50:0/3384405629 wait complete. 2023-10-06T01:23:00.420 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 18 2023-10-06T01:23:00.437 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T01:23:00.625 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:00.624+0000 7f2f6ed9d700 1 Processor -- start 2023-10-06T01:23:00.625 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:00.624+0000 7f2f6ed9d700 1 -- start start 2023-10-06T01:23:00.626 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:00.625+0000 7f2f6ed9d700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2f68159480 0x7f2f680b30d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:23:00.626 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:00.625+0000 7f2f6ed9d700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f2f680b3610 0x7f2f680cbc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:23:00.626 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:00.625+0000 7f2f6ed9d700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2f680cb7e0 con 0x7f2f680cc1b0 2023-10-06T01:23:00.627 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:00.625+0000 7f2f6ed9d700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2f680b08a0 con 0x7f2f680b3610 2023-10-06T01:23:00.627 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:00.625+0000 7f2f6ed9d700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f680cb190 con 0x7f2f68159480 2023-10-06T01:23:00.627 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:00.626+0000 7f2f6e59c700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f2f680cc1b0 0x7f2f680b2140 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:51810/0 (socket says 172.21.15.50:51810) 2023-10-06T01:23:00.627 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:00.626+0000 7f2f6e59c700 1 -- 172.21.15.50:0/3096129644 learned_addr learned my addr 172.21.15.50:0/3096129644 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-10-06T01:23:00.627 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:00.626+0000 7f2f6d59a700 1 --2- 172.21.15.50:0/3096129644 >> v2:172.21.15.50:3300/0 conn(0x7f2f680b3610 0x7f2f680cbc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:23:00.628 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:00.626+0000 7f2f6dd9b700 1 --2- 172.21.15.50:0/3096129644 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2f68159480 0x7f2f680b30d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:23:00.628 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:00.626+0000 7f2f6d59a700 1 -- 172.21.15.50:0/3096129644 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2f68159480 msgr2=0x7f2f680b30d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:23:00.629 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:00.626+0000 7f2f6cd99700 1 -- 172.21.15.50:0/3096129644 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 105842795 0 0) 0x7f2f680cb7e0 con 0x7f2f680cc1b0 2023-10-06T01:23:00.629 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:00.626+0000 7f2f6d59a700 1 --2- 172.21.15.50:0/3096129644 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2f68159480 0x7f2f680b30d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:23:00.629 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:00.626+0000 7f2f6d59a700 1 -- 172.21.15.50:0/3096129644 >> v1:172.21.15.50:6789/0 conn(0x7f2f680cc1b0 legacy=0x7f2f680b2140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:23:00.629 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:00.626+0000 7f2f6d59a700 1 -- 172.21.15.50:0/3096129644 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f680cb470 con 0x7f2f680b3610 2023-10-06T01:23:00.629 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:00.626+0000 7f2f6dd9b700 1 --2- 172.21.15.50:0/3096129644 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2f68159480 0x7f2f680b30d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T01:23:00.629 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:00.626+0000 7f2f6d59a700 1 --2- 172.21.15.50:0/3096129644 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2f680b3610 0x7f2f680cbc70 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f2f580098e0 tx=0x7f2f580091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5435496c1bfada31 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:23:00.629 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:00.627+0000 7f2f6cd99700 1 -- 172.21.15.50:0/3096129644 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f58009e80 con 0x7f2f680b3610 2023-10-06T01:23:00.629 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:00.627+0000 7f2f6cd99700 1 -- 172.21.15.50:0/3096129644 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f5800b860 con 0x7f2f680b3610 2023-10-06T01:23:00.629 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:00.627+0000 7f2f6cd99700 1 -- 172.21.15.50:0/3096129644 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f5800bbe0 con 0x7f2f680b3610 2023-10-06T01:23:00.629 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:00.627+0000 7f2f6ed9d700 1 -- 172.21.15.50:0/3096129644 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2f680b3610 msgr2=0x7f2f680cbc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:23:00.629 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:00.627+0000 7f2f6ed9d700 1 --2- 172.21.15.50:0/3096129644 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2f680b3610 0x7f2f680cbc70 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f2f580098e0 tx=0x7f2f580091a0 comp rx=0 tx=0).stop 2023-10-06T01:23:00.629 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:00.627+0000 7f2f6ed9d700 1 -- 172.21.15.50:0/3096129644 shutdown_connections 2023-10-06T01:23:00.630 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:00.627+0000 7f2f6ed9d700 1 --2- 172.21.15.50:0/3096129644 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2f68159480 0x7f2f680b30d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:23:00.630 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:00.627+0000 7f2f6ed9d700 1 --2- 172.21.15.50:0/3096129644 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2f680b3610 0x7f2f680cbc70 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:23:00.630 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:00.627+0000 7f2f6ed9d700 1 -- 172.21.15.50:0/3096129644 >> 172.21.15.50:0/3096129644 conn(0x7f2f6806ed20 msgr2=0x7f2f6806f120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:23:00.630 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:00.627+0000 7f2f6ed9d700 1 -- 172.21.15.50:0/3096129644 shutdown_connections 2023-10-06T01:23:00.630 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:00.627+0000 7f2f6ed9d700 1 -- 172.21.15.50:0/3096129644 wait complete. 2023-10-06T01:23:00.632 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:00.629+0000 7f2f6ed9d700 1 Processor -- start 2023-10-06T01:23:00.632 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:00.629+0000 7f2f6ed9d700 1 -- start start 2023-10-06T01:23:00.632 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:00.630+0000 7f2f6ed9d700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2f680b3610 0x7f2f681547e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:23:00.632 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:00.630+0000 7f2f6ed9d700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2f680cc1b0 0x7f2f680c9a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:23:00.632 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:00.630+0000 7f2f6ed9d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2f68159480 0x7f2f681552b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:23:00.632 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:00.630+0000 7f2f6ed9d700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f6815c490 con 0x7f2f68159480 2023-10-06T01:23:00.632 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:00.630+0000 7f2f6ed9d700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f680c8990 con 0x7f2f680b3610 2023-10-06T01:23:00.633 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:00.630+0000 7f2f6ed9d700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f680c8c70 con 0x7f2f680cc1b0 2023-10-06T01:23:00.633 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:00.630+0000 7f2f6e59c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2f68159480 0x7f2f681552b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:23:00.633 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:00.630+0000 7f2f6e59c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2f68159480 0x7f2f681552b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:53800/0 (socket says 172.21.15.50:53800) 2023-10-06T01:23:00.633 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:00.630+0000 7f2f6e59c700 1 -- 172.21.15.50:0/1885777751 learned_addr learned my addr 172.21.15.50:0/1885777751 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-06T01:23:00.633 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:00.630+0000 7f2f6d59a700 1 --2- 172.21.15.50:0/1885777751 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2f680cc1b0 0x7f2f680c9a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:23:00.633 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:00.630+0000 7f2f6dd9b700 1 --2- 172.21.15.50:0/1885777751 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2f680b3610 0x7f2f681547e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:23:00.633 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:00.630+0000 7f2f6e59c700 1 -- 172.21.15.50:0/1885777751 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2f680cc1b0 msgr2=0x7f2f680c9a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:23:00.633 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:00.630+0000 7f2f6e59c700 1 --2- 172.21.15.50:0/1885777751 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2f680cc1b0 0x7f2f680c9a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:23:00.633 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:00.630+0000 7f2f6e59c700 1 -- 172.21.15.50:0/1885777751 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2f680b3610 msgr2=0x7f2f681547e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:23:00.633 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:00.630+0000 7f2f6e59c700 1 --2- 172.21.15.50:0/1885777751 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2f680b3610 0x7f2f681547e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:23:00.633 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:00.630+0000 7f2f6e59c700 1 -- 172.21.15.50:0/1885777751 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f58009420 con 0x7f2f68159480 2023-10-06T01:23:00.633 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:00.631+0000 7f2f6e59c700 1 --2- 172.21.15.50:0/1885777751 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2f68159480 0x7f2f681552b0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f2f6000cc90 tx=0x7f2f60001a80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:23:00.634 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:00.631+0000 7f2f5dffb700 1 -- 172.21.15.50:0/1885777751 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f6000a8b0 con 0x7f2f68159480 2023-10-06T01:23:00.634 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:00.631+0000 7f2f5dffb700 1 -- 172.21.15.50:0/1885777751 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f6000aa10 con 0x7f2f68159480 2023-10-06T01:23:00.634 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:00.631+0000 7f2f5dffb700 1 -- 172.21.15.50:0/1885777751 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f6000add0 con 0x7f2f68159480 2023-10-06T01:23:00.634 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:00.631+0000 7f2f6ed9d700 1 -- 172.21.15.50:0/1885777751 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2f680c8f50 con 0x7f2f68159480 2023-10-06T01:23:00.634 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:00.631+0000 7f2f6ed9d700 1 -- 172.21.15.50:0/1885777751 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2f680c9510 con 0x7f2f68159480 2023-10-06T01:23:00.635 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:00.632+0000 7f2f6ed9d700 1 -- 172.21.15.50:0/1885777751 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2f680c9700 con 0x7f2f68159480 2023-10-06T01:23:00.635 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:00.633+0000 7f2f5dffb700 1 -- 172.21.15.50:0/1885777751 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f2f60007300 con 0x7f2f68159480 2023-10-06T01:23:00.635 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:00.634+0000 7f2f5dffb700 1 --2- 172.21.15.50:0/1885777751 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f2f4c066f30 0x7f2f4c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:23:00.635 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:00.634+0000 7f2f5dffb700 1 -- 172.21.15.50:0/1885777751 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f2f60084b90 con 0x7f2f68159480 2023-10-06T01:23:00.635 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:00.635+0000 7f2f6dd9b700 1 --2- 172.21.15.50:0/1885777751 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f2f4c066f30 0x7f2f4c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:23:00.636 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:00.635+0000 7f2f6dd9b700 1 --2- 172.21.15.50:0/1885777751 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f2f4c066f30 0x7f2f4c0693e0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f2f64006fd0 tx=0x7f2f64008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:23:00.641 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:00.638+0000 7f2f5dffb700 1 -- 172.21.15.50:0/1885777751 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f2f60051b40 con 0x7f2f68159480 2023-10-06T01:23:00.842 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:00.842+0000 7f2f6ed9d700 1 -- 172.21.15.50:0/1885777751 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2f6805f270 con 0x7f2f68159480 2023-10-06T01:23:00.845 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:00.843+0000 7f2f5dffb700 1 -- 172.21.15.50:0/1885777751 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v39) v1 ==== 74+0+17071 (secure 0 0 0) 0x7f2f60055160 con 0x7f2f68159480 2023-10-06T01:23:00.846 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-10-06T01:23:00.846 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":39,"fsid":"0bfd9a6b-1587-4fe4-a89e-e43c00286b4e","created":"2023-10-06T01:21:16.828801+0000","modified":"2023-10-06T01:22:57.825986+0000","last_up_change":"2023-10-06T01:21:28.584523+0000","last_in_change":"2023-10-06T01:21:20.179863+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-10-06T01:21:29.304225+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":".mgr","create_time":"2023-10-06T01:21:29.835490+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2023-10-06T01:22:54.641549+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":7,"pool_name":"cephfs_data","create_time":"2023-10-06T01:22:55.389647+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"39","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"9060727a-3959-4de3-8363-c5c5d7826c9a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":87837},{"type":"v1","addr":"172.21.15.50:6801","nonce":87837}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":87837},{"type":"v1","addr":"172.21.15.50:6803","nonce":87837}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":87837},{"type":"v1","addr":"172.21.15.50:6807","nonce":87837}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":87837},{"type":"v1","addr":"172.21.15.50:6805","nonce":87837}]},"public_addr":"172.21.15.50:6801/87837","cluster_addr":"172.21.15.50:6803/87837","heartbeat_back_addr":"172.21.15.50:6807/87837","heartbeat_front_addr":"172.21.15.50:6805/87837","state":["exists","up"]},{"osd":1,"uuid":"5ad9ef12-b579-47ea-b690-90ba887e2cef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":87853},{"type":"v1","addr":"172.21.15.50:6809","nonce":87853}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":87853},{"type":"v1","addr":"172.21.15.50:6811","nonce":87853}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":87853},{"type":"v1","addr":"172.21.15.50:6815","nonce":87853}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":87853},{"type":"v1","addr":"172.21.15.50:6813","nonce":87853}]},"public_addr":"172.21.15.50:6809/87853","cluster_addr":"172.21.15.50:6811/87853","heartbeat_back_addr":"172.21.15.50:6815/87853","heartbeat_front_addr":"172.21.15.50:6813/87853","state":["exists","up"]},{"osd":2,"uuid":"c7aee044-6f75-436f-90e1-ba42a57359bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6821","nonce":87855},{"type":"v1","addr":"172.21.15.50:6822","nonce":87855}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6824","nonce":87855},{"type":"v1","addr":"172.21.15.50:6826","nonce":87855}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":87855},{"type":"v1","addr":"172.21.15.50:6831","nonce":87855}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":87855},{"type":"v1","addr":"172.21.15.50:6829","nonce":87855}]},"public_addr":"172.21.15.50:6822/87855","cluster_addr":"172.21.15.50:6826/87855","heartbeat_back_addr":"172.21.15.50:6831/87855","heartbeat_front_addr":"172.21.15.50:6829/87855","state":["exists","up"]},{"osd":3,"uuid":"d9b901c8-e8b2-44af-9508-f453120a96c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":87856},{"type":"v1","addr":"172.21.15.50:6817","nonce":87856}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":87856},{"type":"v1","addr":"172.21.15.50:6819","nonce":87856}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6825","nonce":87856},{"type":"v1","addr":"172.21.15.50:6827","nonce":87856}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6820","nonce":87856},{"type":"v1","addr":"172.21.15.50:6823","nonce":87856}]},"public_addr":"172.21.15.50:6817/87856","cluster_addr":"172.21.15.50:6819/87856","heartbeat_back_addr":"172.21.15.50:6827/87856","heartbeat_front_addr":"172.21.15.50:6823/87856","state":["exists","up"]},{"osd":4,"uuid":"2b3c6b38-e3e9-4301-9445-60fd3fe8ce03","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":85805},{"type":"v1","addr":"172.21.15.155:6801","nonce":85805}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":85805},{"type":"v1","addr":"172.21.15.155:6803","nonce":85805}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6806","nonce":85805},{"type":"v1","addr":"172.21.15.155:6807","nonce":85805}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6804","nonce":85805},{"type":"v1","addr":"172.21.15.155:6805","nonce":85805}]},"public_addr":"172.21.15.155:6801/85805","cluster_addr":"172.21.15.155:6803/85805","heartbeat_back_addr":"172.21.15.155:6807/85805","heartbeat_front_addr":"172.21.15.155:6805/85805","state":["exists","up"]},{"osd":5,"uuid":"417b5f8f-65f1-4c94-91a7-a6ce03fe1679","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6816","nonce":85807},{"type":"v1","addr":"172.21.15.155:6818","nonce":85807}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6820","nonce":85807},{"type":"v1","addr":"172.21.15.155:6822","nonce":85807}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6828","nonce":85807},{"type":"v1","addr":"172.21.15.155:6830","nonce":85807}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6824","nonce":85807},{"type":"v1","addr":"172.21.15.155:6826","nonce":85807}]},"public_addr":"172.21.15.155:6818/85807","cluster_addr":"172.21.15.155:6822/85807","heartbeat_back_addr":"172.21.15.155:6830/85807","heartbeat_front_addr":"172.21.15.155:6826/85807","state":["exists","up"]},{"osd":6,"uuid":"c150cff3-aee4-4714-9c08-d182b1ba9ffd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6808","nonce":85806},{"type":"v1","addr":"172.21.15.155:6809","nonce":85806}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6810","nonce":85806},{"type":"v1","addr":"172.21.15.155:6811","nonce":85806}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6814","nonce":85806},{"type":"v1","addr":"172.21.15.155:6815","nonce":85806}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6812","nonce":85806},{"type":"v1","addr":"172.21.15.155:6813","nonce":85806}]},"public_addr":"172.21.15.155:6809/85806","cluster_addr":"172.21.15.155:6811/85806","heartbeat_back_addr":"172.21.15.155:6815/85806","heartbeat_front_addr":"172.21.15.155:6813/85806","state":["exists","up"]},{"osd":7,"uuid":"71107f0e-04d1-4e72-a0ec-0faf6af003e7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6817","nonce":85832},{"type":"v1","addr":"172.21.15.155:6819","nonce":85832}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6821","nonce":85832},{"type":"v1","addr":"172.21.15.155:6823","nonce":85832}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6829","nonce":85832},{"type":"v1","addr":"172.21.15.155:6831","nonce":85832}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6825","nonce":85832},{"type":"v1","addr":"172.21.15.155:6827","nonce":85832}]},"public_addr":"172.21.15.155:6819/85832","cluster_addr":"172.21.15.155:6823/85832","heartbeat_back_addr":"172.21.15.155:6831/85832","heartbeat_front_addr":"172.21.15.155:6827/85832","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:21:25.423389+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:21:25.472661+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:21:25.817562+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:21:25.551257+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:21:25.407818+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:21:25.557976+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:21:25.747299+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:21:25.827576+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T01:23:00.847 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:00.845+0000 7f2f6ed9d700 1 -- 172.21.15.50:0/1885777751 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f2f4c066f30 msgr2=0x7f2f4c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:23:00.847 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:00.845+0000 7f2f6ed9d700 1 --2- 172.21.15.50:0/1885777751 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f2f4c066f30 0x7f2f4c0693e0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f2f64006fd0 tx=0x7f2f64008040 comp rx=0 tx=0).stop 2023-10-06T01:23:00.847 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:00.845+0000 7f2f6ed9d700 1 -- 172.21.15.50:0/1885777751 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2f68159480 msgr2=0x7f2f681552b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:23:00.847 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:00.845+0000 7f2f6ed9d700 1 --2- 172.21.15.50:0/1885777751 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2f68159480 0x7f2f681552b0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f2f6000cc90 tx=0x7f2f60001a80 comp rx=0 tx=0).stop 2023-10-06T01:23:00.847 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:00.845+0000 7f2f6ed9d700 1 -- 172.21.15.50:0/1885777751 shutdown_connections 2023-10-06T01:23:00.847 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:00.845+0000 7f2f6ed9d700 1 --2- 172.21.15.50:0/1885777751 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2f68159480 0x7f2f681552b0 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:23:00.847 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:00.845+0000 7f2f6ed9d700 1 --2- 172.21.15.50:0/1885777751 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f2f4c066f30 0x7f2f4c0693e0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:23:00.847 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:00.845+0000 7f2f6ed9d700 1 --2- 172.21.15.50:0/1885777751 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2f680b3610 0x7f2f681547e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:23:00.848 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:00.845+0000 7f2f6ed9d700 1 --2- 172.21.15.50:0/1885777751 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2f680cc1b0 0x7f2f680c9a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:23:00.848 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:00.845+0000 7f2f6ed9d700 1 -- 172.21.15.50:0/1885777751 >> 172.21.15.50:0/1885777751 conn(0x7f2f6806ed20 msgr2=0x7f2f680b4070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:23:00.848 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:00.845+0000 7f2f6ed9d700 1 -- 172.21.15.50:0/1885777751 shutdown_connections 2023-10-06T01:23:00.848 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:00.845+0000 7f2f6ed9d700 1 -- 172.21.15.50:0/1885777751 wait complete. 2023-10-06T01:23:00.864 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-10-06T01:23:00.864 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-06T01:23:01.052 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:01.050+0000 7fd46db9d700 1 Processor -- start 2023-10-06T01:23:01.052 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:01.050+0000 7fd46db9d700 1 -- start start 2023-10-06T01:23:01.056 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:01.052+0000 7fd46db9d700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fd4680cb5e0 0x7fd4680cb9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:23:01.056 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:01.052+0000 7fd46db9d700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd468159490 0x7fd4681598f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:23:01.057 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:01.052+0000 7fd46db9d700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd468159e30 con 0x7fd46806f350 2023-10-06T01:23:01.057 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:01.052+0000 7fd46db9d700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd46806ec00 con 0x7fd4680cb5e0 2023-10-06T01:23:01.057 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:01.052+0000 7fd46db9d700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd46806e080 con 0x7fd468159490 2023-10-06T01:23:01.057 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:01.052+0000 7fd46cb9b700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fd4680cb5e0 0x7fd4680cb9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:23:01.057 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:01.052+0000 7fd46d39c700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd468159490 0x7fd4681598f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:23:01.057 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:01.052+0000 7fd46cb9b700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fd4680cb5e0 0x7fd4680cb9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.50:50112/0 (socket says 172.21.15.50:50112) 2023-10-06T01:23:01.057 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:01.052+0000 7fd46cb9b700 1 -- 172.21.15.50:0/3536076504 learned_addr learned my addr 172.21.15.50:0/3536076504 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-06T01:23:01.058 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:01.052+0000 7fd46d39c700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd468159490 0x7fd4681598f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3301/0 says I am v2:172.21.15.50:52536/0 (socket says 172.21.15.50:52536) 2023-10-06T01:23:01.058 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:01.053+0000 7fd46d39c700 1 -- 172.21.15.50:0/3536076504 >> v2:172.21.15.155:3300/0 conn(0x7fd4680cb5e0 msgr2=0x7fd4680cb9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:23:01.058 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:01.053+0000 7fd46d39c700 1 --2- 172.21.15.50:0/3536076504 >> v2:172.21.15.155:3300/0 conn(0x7fd4680cb5e0 0x7fd4680cb9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:23:01.059 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:01.053+0000 7fd46d39c700 1 -- 172.21.15.50:0/3536076504 >> v1:172.21.15.155:6789/0 conn(0x7fd46806f350 legacy=0x7fd46806d630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:23:01.059 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:01.053+0000 7fd46d39c700 1 -- 172.21.15.50:0/3536076504 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd46806e360 con 0x7fd468159490 2023-10-06T01:23:01.059 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:01.053+0000 7fd46d39c700 1 --2- 172.21.15.50:0/3536076504 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd468159490 0x7fd4681598f0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fd46000af70 tx=0x7fd46000a890 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d5444cec991ead1c server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:23:01.059 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:01.053+0000 7fd4677fe700 1 -- 172.21.15.50:0/3536076504 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd46000f070 con 0x7fd468159490 2023-10-06T01:23:01.059 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:01.053+0000 7fd4677fe700 1 -- 172.21.15.50:0/3536076504 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd46000a2e0 con 0x7fd468159490 2023-10-06T01:23:01.060 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:01.053+0000 7fd4677fe700 1 -- 172.21.15.50:0/3536076504 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd46000cc70 con 0x7fd468159490 2023-10-06T01:23:01.060 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:01.054+0000 7fd46db9d700 1 -- 172.21.15.50:0/3536076504 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd468159490 msgr2=0x7fd4681598f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:23:01.060 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:01.054+0000 7fd46db9d700 1 --2- 172.21.15.50:0/3536076504 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd468159490 0x7fd4681598f0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fd46000af70 tx=0x7fd46000a890 comp rx=0 tx=0).stop 2023-10-06T01:23:01.060 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:01.054+0000 7fd46db9d700 1 -- 172.21.15.50:0/3536076504 shutdown_connections 2023-10-06T01:23:01.060 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:01.054+0000 7fd46db9d700 1 --2- 172.21.15.50:0/3536076504 >> v2:172.21.15.155:3300/0 conn(0x7fd4680cb5e0 0x7fd4680cb9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:23:01.060 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:01.054+0000 7fd46db9d700 1 --2- 172.21.15.50:0/3536076504 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd468159490 0x7fd4681598f0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:23:01.061 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:01.054+0000 7fd46db9d700 1 -- 172.21.15.50:0/3536076504 >> 172.21.15.50:0/3536076504 conn(0x7fd4680680c0 msgr2=0x7fd4680cbf00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:23:01.061 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:01.054+0000 7fd46db9d700 1 -- 172.21.15.50:0/3536076504 shutdown_connections 2023-10-06T01:23:01.061 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:01.054+0000 7fd46db9d700 1 -- 172.21.15.50:0/3536076504 wait complete. 2023-10-06T01:23:01.061 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:01.055+0000 7fd46db9d700 1 Processor -- start 2023-10-06T01:23:01.061 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:01.056+0000 7fd46db9d700 1 -- start start 2023-10-06T01:23:01.066 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:01.056+0000 7fd46db9d700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd4680cb5e0 0x7fd468150b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:23:01.066 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:01.056+0000 7fd46db9d700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd468159490 0x7fd4680abff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:23:01.066 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:01.056+0000 7fd46db9d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd468158310 0x7fd468158760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:23:01.066 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:01.056+0000 7fd46db9d700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd468158ca0 con 0x7fd468158310 2023-10-06T01:23:01.066 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:01.056+0000 7fd46db9d700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4680ac530 con 0x7fd4680cb5e0 2023-10-06T01:23:01.067 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:01.056+0000 7fd46db9d700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd46816c9e0 con 0x7fd468159490 2023-10-06T01:23:01.067 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:01.057+0000 7fd46d39c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd468158310 0x7fd468158760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:23:01.067 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:01.057+0000 7fd46d39c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd468158310 0x7fd468158760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:53804/0 (socket says 172.21.15.50:53804) 2023-10-06T01:23:01.067 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:01.057+0000 7fd46d39c700 1 -- 172.21.15.50:0/1717016596 learned_addr learned my addr 172.21.15.50:0/1717016596 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-06T01:23:01.067 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:01.057+0000 7fd46cb9b700 1 --2- 172.21.15.50:0/1717016596 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd4680cb5e0 0x7fd468150b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:23:01.068 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:01.057+0000 7fd467fff700 1 --2- 172.21.15.50:0/1717016596 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd468159490 0x7fd4680abff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:23:01.068 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:01.057+0000 7fd46d39c700 1 -- 172.21.15.50:0/1717016596 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd468159490 msgr2=0x7fd4680abff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:23:01.068 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:01.057+0000 7fd46d39c700 1 --2- 172.21.15.50:0/1717016596 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd468159490 0x7fd4680abff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:23:01.068 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:01.057+0000 7fd46d39c700 1 -- 172.21.15.50:0/1717016596 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd4680cb5e0 msgr2=0x7fd468150b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:23:01.068 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:01.057+0000 7fd46d39c700 1 --2- 172.21.15.50:0/1717016596 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd4680cb5e0 0x7fd468150b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:23:01.069 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:01.057+0000 7fd46d39c700 1 -- 172.21.15.50:0/1717016596 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd46000ab30 con 0x7fd468158310 2023-10-06T01:23:01.069 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:01.057+0000 7fd46d39c700 1 --2- 172.21.15.50:0/1717016596 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd468158310 0x7fd468158760 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7fd46000a8d0 tx=0x7fd460019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:23:01.069 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:01.058+0000 7fd464ff9700 1 -- 172.21.15.50:0/1717016596 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd460009b20 con 0x7fd468158310 2023-10-06T01:23:01.069 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:01.058+0000 7fd464ff9700 1 -- 172.21.15.50:0/1717016596 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd460009ca0 con 0x7fd468158310 2023-10-06T01:23:01.069 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:01.058+0000 7fd464ff9700 1 -- 172.21.15.50:0/1717016596 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd460027660 con 0x7fd468158310 2023-10-06T01:23:01.069 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:01.058+0000 7fd46db9d700 1 -- 172.21.15.50:0/1717016596 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd46816ccc0 con 0x7fd468158310 2023-10-06T01:23:01.069 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:01.058+0000 7fd46db9d700 1 -- 172.21.15.50:0/1717016596 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd46816d280 con 0x7fd468158310 2023-10-06T01:23:01.070 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:01.059+0000 7fd46db9d700 1 -- 172.21.15.50:0/1717016596 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd46805f270 con 0x7fd468158310 2023-10-06T01:23:01.070 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:01.060+0000 7fd464ff9700 1 -- 172.21.15.50:0/1717016596 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fd46001d410 con 0x7fd468158310 2023-10-06T01:23:01.070 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:01.060+0000 7fd464ff9700 1 --2- 172.21.15.50:0/1717016596 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7fd44c066f30 0x7fd44c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:23:01.070 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:01.061+0000 7fd464ff9700 1 -- 172.21.15.50:0/1717016596 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6378+0+0 (secure 0 0 0) 0x7fd460085fe0 con 0x7fd468158310 2023-10-06T01:23:01.070 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:01.061+0000 7fd46cb9b700 1 --2- 172.21.15.50:0/1717016596 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7fd44c066f30 0x7fd44c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:23:01.070 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:01.062+0000 7fd46cb9b700 1 --2- 172.21.15.50:0/1717016596 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7fd44c066f30 0x7fd44c0693e0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fd45c006d40 tx=0x7fd45c009250 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:23:01.070 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:01.065+0000 7fd464ff9700 1 -- 172.21.15.50:0/1717016596 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd460052f50 con 0x7fd468158310 2023-10-06T01:23:01.261 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:01.260+0000 7fd46db9d700 1 -- 172.21.15.50:0/1717016596 --> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fd4681592b0 con 0x7fd44c066f30 2023-10-06T01:23:01.272 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:01.271+0000 7fd464ff9700 1 -- 172.21.15.50:0/1717016596 <== mgr.4099 v2:172.21.15.155:6832/85215 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+311360 (secure 0 0 0) 0x7fd4681592b0 con 0x7fd44c066f30 2023-10-06T01:23:01.276 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-10-06T01:23:01.279 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:01.275+0000 7fd46db9d700 1 -- 172.21.15.50:0/1717016596 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7fd44c066f30 msgr2=0x7fd44c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:23:01.279 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:01.275+0000 7fd46db9d700 1 --2- 172.21.15.50:0/1717016596 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7fd44c066f30 0x7fd44c0693e0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fd45c006d40 tx=0x7fd45c009250 comp rx=0 tx=0).stop 2023-10-06T01:23:01.279 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:01.275+0000 7fd46db9d700 1 -- 172.21.15.50:0/1717016596 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd468158310 msgr2=0x7fd468158760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:23:01.279 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:01.275+0000 7fd46db9d700 1 --2- 172.21.15.50:0/1717016596 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd468158310 0x7fd468158760 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7fd46000a8d0 tx=0x7fd460019000 comp rx=0 tx=0).stop 2023-10-06T01:23:01.279 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:01.275+0000 7fd46db9d700 1 -- 172.21.15.50:0/1717016596 shutdown_connections 2023-10-06T01:23:01.279 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:01.275+0000 7fd46db9d700 1 --2- 172.21.15.50:0/1717016596 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd468158310 0x7fd468158760 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:23:01.279 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:01.275+0000 7fd46db9d700 1 --2- 172.21.15.50:0/1717016596 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7fd44c066f30 0x7fd44c0693e0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:23:01.279 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:01.275+0000 7fd46db9d700 1 --2- 172.21.15.50:0/1717016596 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd4680cb5e0 0x7fd468150b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:23:01.279 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:01.275+0000 7fd46db9d700 1 --2- 172.21.15.50:0/1717016596 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd468159490 0x7fd4680abff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:23:01.279 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:01.275+0000 7fd46db9d700 1 -- 172.21.15.50:0/1717016596 >> 172.21.15.50:0/1717016596 conn(0x7fd4680680c0 msgr2=0x7fd46806a670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:23:01.279 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:01.276+0000 7fd46db9d700 1 -- 172.21.15.50:0/1717016596 shutdown_connections 2023-10-06T01:23:01.280 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:01.276+0000 7fd46db9d700 1 -- 172.21.15.50:0/1717016596 wait complete. 2023-10-06T01:23:01.280 INFO:teuthology.orchestra.run.smithi050.stderr:dumped all 2023-10-06T01:23:01.294 INFO:teuthology.orchestra.run.smithi050.stdout:{"pg_ready":true,"pg_map":{"version":78,"stamp":"2023-10-06T01:22:59.791139+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":206,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2399372,"kb_used_data":4684,"kb_used_omap":0,"kb_used_meta":2394624,"kb_avail":752575348,"statfs":{"total":773094113280,"available":770637156352,"internally_reserved":0,"allocated":4796416,"data_stored":2770594,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2452094976},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":27,"apply_latency_ms":27,"commit_latency_ns":27000000,"apply_latency_ns":27000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.882100"},"pg_stats":[{"pgid":"7.3f","version":"0'0","reported_seq":8,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-06T01:22:56.849083+0000","last_change":"2023-10-06T01:22:56.849083+0000","last_active":"2023-10-06T01:22:56.849083+0000","last_peered":"2023-10-06T01:22:56.849083+0000","last_clean":"2023-10-06T01:22:56.849083+0000","last_became_active":"2023-10-06T01:22:56.848821+0000","last_became_peered":"2023-10-06T01:22:56.848821+0000","last_unstale":"2023-10-06T01:22:56.849083+0000","last_undegraded":"2023-10-06T01:22:56.849083+0000","last_fullsized":"2023-10-06T01:22:56.849083+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:22:55.908368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:22:55.908368+0000","last_clean_scrub_stamp":"2023-10-06T01:22:55.908368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:01:10.322200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3e","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-06T01:22:56.854780+0000","last_change":"2023-10-06T01:22:56.850163+0000","last_active":"2023-10-06T01:22:56.854780+0000","last_peered":"2023-10-06T01:22:56.854780+0000","last_clean":"2023-10-06T01:22:56.854780+0000","last_became_active":"2023-10-06T01:22:56.849861+0000","last_became_peered":"2023-10-06T01:22:56.849861+0000","last_unstale":"2023-10-06T01:22:56.854780+0000","last_undegraded":"2023-10-06T01:22:56.854780+0000","last_fullsized":"2023-10-06T01:22:56.854780+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:22:55.908368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:22:55.908368+0000","last_clean_scrub_stamp":"2023-10-06T01:22:55.908368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:53:56.829612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3d","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-06T01:22:56.851845+0000","last_change":"2023-10-06T01:22:56.847772+0000","last_active":"2023-10-06T01:22:56.851845+0000","last_peered":"2023-10-06T01:22:56.851845+0000","last_clean":"2023-10-06T01:22:56.851845+0000","last_became_active":"2023-10-06T01:22:56.847485+0000","last_became_peered":"2023-10-06T01:22:56.847485+0000","last_unstale":"2023-10-06T01:22:56.851845+0000","last_undegraded":"2023-10-06T01:22:56.851845+0000","last_fullsized":"2023-10-06T01:22:56.851845+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:22:55.908368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:22:55.908368+0000","last_clean_scrub_stamp":"2023-10-06T01:22:55.908368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:06:45.219470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3c","version":"0'0","reported_seq":8,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-06T01:22:56.853172+0000","last_change":"2023-10-06T01:22:56.853172+0000","last_active":"2023-10-06T01:22:56.853172+0000","last_peered":"2023-10-06T01:22:56.853172+0000","last_clean":"2023-10-06T01:22:56.853172+0000","last_became_active":"2023-10-06T01:22:56.852861+0000","last_became_peered":"2023-10-06T01:22:56.852861+0000","last_unstale":"2023-10-06T01:22:56.853172+0000","last_undegraded":"2023-10-06T01:22:56.853172+0000","last_fullsized":"2023-10-06T01:22:56.853172+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:22:55.908368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:22:55.908368+0000","last_clean_scrub_stamp":"2023-10-06T01:22:55.908368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:07:52.525128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3b","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-06T01:22:56.854742+0000","last_change":"2023-10-06T01:22:56.848726+0000","last_active":"2023-10-06T01:22:56.854742+0000","last_peered":"2023-10-06T01:22:56.854742+0000","last_clean":"2023-10-06T01:22:56.854742+0000","last_became_active":"2023-10-06T01:22:56.848449+0000","last_became_peered":"2023-10-06T01:22:56.848449+0000","last_unstale":"2023-10-06T01:22:56.854742+0000","last_undegraded":"2023-10-06T01:22:56.854742+0000","last_fullsized":"2023-10-06T01:22:56.854742+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:22:55.908368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:22:55.908368+0000","last_clean_scrub_stamp":"2023-10-06T01:22:55.908368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:25:51.642335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3a","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-06T01:22:56.848309+0000","last_change":"2023-10-06T01:22:56.843022+0000","last_active":"2023-10-06T01:22:56.848309+0000","last_peered":"2023-10-06T01:22:56.848309+0000","last_clean":"2023-10-06T01:22:56.848309+0000","last_became_active":"2023-10-06T01:22:56.842774+0000","last_became_peered":"2023-10-06T01:22:56.842774+0000","last_unstale":"2023-10-06T01:22:56.848309+0000","last_undegraded":"2023-10-06T01:22:56.848309+0000","last_fullsized":"2023-10-06T01:22:56.848309+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:22:55.908368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:22:55.908368+0000","last_clean_scrub_stamp":"2023-10-06T01:22:55.908368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:18:50.037609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.39","version":"0'0","reported_seq":8,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-06T01:22:56.855214+0000","last_change":"2023-10-06T01:22:56.855214+0000","last_active":"2023-10-06T01:22:56.855214+0000","last_peered":"2023-10-06T01:22:56.855214+0000","last_clean":"2023-10-06T01:22:56.855214+0000","last_became_active":"2023-10-06T01:22:56.853390+0000","last_became_peered":"2023-10-06T01:22:56.853390+0000","last_unstale":"2023-10-06T01:22:56.855214+0000","last_undegraded":"2023-10-06T01:22:56.855214+0000","last_fullsized":"2023-10-06T01:22:56.855214+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:22:55.908368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:22:55.908368+0000","last_clean_scrub_stamp":"2023-10-06T01:22:55.908368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:55:35.329247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.38","version":"0'0","reported_seq":8,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-06T01:22:56.851791+0000","last_change":"2023-10-06T01:22:56.851791+0000","last_active":"2023-10-06T01:22:56.851791+0000","last_peered":"2023-10-06T01:22:56.851791+0000","last_clean":"2023-10-06T01:22:56.851791+0000","last_became_active":"2023-10-06T01:22:56.851529+0000","last_became_peered":"2023-10-06T01:22:56.851529+0000","last_unstale":"2023-10-06T01:22:56.851791+0000","last_undegraded":"2023-10-06T01:22:56.851791+0000","last_fullsized":"2023-10-06T01:22:56.851791+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:22:55.908368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:22:55.908368+0000","last_clean_scrub_stamp":"2023-10-06T01:22:55.908368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:56:38.604493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.37","version":"0'0","reported_seq":8,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-06T01:22:56.849144+0000","last_change":"2023-10-06T01:22:56.849144+0000","last_active":"2023-10-06T01:22:56.849144+0000","last_peered":"2023-10-06T01:22:56.849144+0000","last_clean":"2023-10-06T01:22:56.849144+0000","last_became_active":"2023-10-06T01:22:56.848911+0000","last_became_peered":"2023-10-06T01:22:56.848911+0000","last_unstale":"2023-10-06T01:22:56.849144+0000","last_undegraded":"2023-10-06T01:22:56.849144+0000","last_fullsized":"2023-10-06T01:22:56.849144+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:22:55.908368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:22:55.908368+0000","last_clean_scrub_stamp":"2023-10-06T01:22:55.908368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:25:50.057545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.36","version":"0'0","reported_seq":8,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-06T01:22:56.854015+0000","last_change":"2023-10-06T01:22:56.854015+0000","last_active":"2023-10-06T01:22:56.854015+0000","last_peered":"2023-10-06T01:22:56.854015+0000","last_clean":"2023-10-06T01:22:56.854015+0000","last_became_active":"2023-10-06T01:22:56.853761+0000","last_became_peered":"2023-10-06T01:22:56.853761+0000","last_unstale":"2023-10-06T01:22:56.854015+0000","last_undegraded":"2023-10-06T01:22:56.854015+0000","last_fullsized":"2023-10-06T01:22:56.854015+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:22:55.908368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:22:55.908368+0000","last_clean_scrub_stamp":"2023-10-06T01:22:55.908368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:15:20.271419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.35","version":"0'0","reported_seq":8,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-06T01:22:56.855284+0000","last_change":"2023-10-06T01:22:56.855284+0000","last_active":"2023-10-06T01:22:56.855284+0000","last_peered":"2023-10-06T01:22:56.855284+0000","last_clean":"2023-10-06T01:22:56.855284+0000","last_became_active":"2023-10-06T01:22:56.855043+0000","last_became_peered":"2023-10-06T01:22:56.855043+0000","last_unstale":"2023-10-06T01:22:56.855284+0000","last_undegraded":"2023-10-06T01:22:56.855284+0000","last_fullsized":"2023-10-06T01:22:56.855284+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:22:55.908368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:22:55.908368+0000","last_clean_scrub_stamp":"2023-10-06T01:22:55.908368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:37:47.029243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.34","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-06T01:22:56.849048+0000","last_change":"2023-10-06T01:22:56.840367+0000","last_active":"2023-10-06T01:22:56.849048+0000","last_peered":"2023-10-06T01:22:56.849048+0000","last_clean":"2023-10-06T01:22:56.849048+0000","last_became_active":"2023-10-06T01:22:56.840019+0000","last_became_peered":"2023-10-06T01:22:56.840019+0000","last_unstale":"2023-10-06T01:22:56.849048+0000","last_undegraded":"2023-10-06T01:22:56.849048+0000","last_fullsized":"2023-10-06T01:22:56.849048+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:22:55.908368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:22:55.908368+0000","last_clean_scrub_stamp":"2023-10-06T01:22:55.908368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:03:24.636246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.33","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-06T01:22:56.858406+0000","last_change":"2023-10-06T01:22:56.853967+0000","last_active":"2023-10-06T01:22:56.858406+0000","last_peered":"2023-10-06T01:22:56.858406+0000","last_clean":"2023-10-06T01:22:56.858406+0000","last_became_active":"2023-10-06T01:22:56.853665+0000","last_became_peered":"2023-10-06T01:22:56.853665+0000","last_unstale":"2023-10-06T01:22:56.858406+0000","last_undegraded":"2023-10-06T01:22:56.858406+0000","last_fullsized":"2023-10-06T01:22:56.858406+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:22:55.908368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:22:55.908368+0000","last_clean_scrub_stamp":"2023-10-06T01:22:55.908368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:08:58.050013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.32","version":"0'0","reported_seq":8,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-06T01:22:56.855330+0000","last_change":"2023-10-06T01:22:56.855330+0000","last_active":"2023-10-06T01:22:56.855330+0000","last_peered":"2023-10-06T01:22:56.855330+0000","last_clean":"2023-10-06T01:22:56.855330+0000","last_became_active":"2023-10-06T01:22:56.855095+0000","last_became_peered":"2023-10-06T01:22:56.855095+0000","last_unstale":"2023-10-06T01:22:56.855330+0000","last_undegraded":"2023-10-06T01:22:56.855330+0000","last_fullsized":"2023-10-06T01:22:56.855330+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:22:55.908368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:22:55.908368+0000","last_clean_scrub_stamp":"2023-10-06T01:22:55.908368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:18:50.037609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.31","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-06T01:22:56.854026+0000","last_change":"2023-10-06T01:22:56.848287+0000","last_active":"2023-10-06T01:22:56.854026+0000","last_peered":"2023-10-06T01:22:56.854026+0000","last_clean":"2023-10-06T01:22:56.854026+0000","last_became_active":"2023-10-06T01:22:56.847994+0000","last_became_peered":"2023-10-06T01:22:56.847994+0000","last_unstale":"2023-10-06T01:22:56.854026+0000","last_undegraded":"2023-10-06T01:22:56.854026+0000","last_fullsized":"2023-10-06T01:22:56.854026+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:22:55.908368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:22:55.908368+0000","last_clean_scrub_stamp":"2023-10-06T01:22:55.908368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:55:32.218597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.30","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-06T01:22:56.855020+0000","last_change":"2023-10-06T01:22:56.849894+0000","last_active":"2023-10-06T01:22:56.855020+0000","last_peered":"2023-10-06T01:22:56.855020+0000","last_clean":"2023-10-06T01:22:56.855020+0000","last_became_active":"2023-10-06T01:22:56.849643+0000","last_became_peered":"2023-10-06T01:22:56.849643+0000","last_unstale":"2023-10-06T01:22:56.855020+0000","last_undegraded":"2023-10-06T01:22:56.855020+0000","last_fullsized":"2023-10-06T01:22:56.855020+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:22:55.908368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:22:55.908368+0000","last_clean_scrub_stamp":"2023-10-06T01:22:55.908368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:51:41.788130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2f","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-06T01:22:56.856528+0000","last_change":"2023-10-06T01:22:56.854123+0000","last_active":"2023-10-06T01:22:56.856528+0000","last_peered":"2023-10-06T01:22:56.856528+0000","last_clean":"2023-10-06T01:22:56.856528+0000","last_became_active":"2023-10-06T01:22:56.853787+0000","last_became_peered":"2023-10-06T01:22:56.853787+0000","last_unstale":"2023-10-06T01:22:56.856528+0000","last_undegraded":"2023-10-06T01:22:56.856528+0000","last_fullsized":"2023-10-06T01:22:56.856528+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:22:55.908368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:22:55.908368+0000","last_clean_scrub_stamp":"2023-10-06T01:22:55.908368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:18:50.037609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2e","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-06T01:22:56.861138+0000","last_change":"2023-10-06T01:22:56.858937+0000","last_active":"2023-10-06T01:22:56.861138+0000","last_peered":"2023-10-06T01:22:56.861138+0000","last_clean":"2023-10-06T01:22:56.861138+0000","last_became_active":"2023-10-06T01:22:56.858576+0000","last_became_peered":"2023-10-06T01:22:56.858576+0000","last_unstale":"2023-10-06T01:22:56.861138+0000","last_undegraded":"2023-10-06T01:22:56.861138+0000","last_fullsized":"2023-10-06T01:22:56.861138+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:22:55.908368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:22:55.908368+0000","last_clean_scrub_stamp":"2023-10-06T01:22:55.908368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:56:38.604493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2d","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-06T01:22:56.853214+0000","last_change":"2023-10-06T01:22:56.847999+0000","last_active":"2023-10-06T01:22:56.853214+0000","last_peered":"2023-10-06T01:22:56.853214+0000","last_clean":"2023-10-06T01:22:56.853214+0000","last_became_active":"2023-10-06T01:22:56.847691+0000","last_became_peered":"2023-10-06T01:22:56.847691+0000","last_unstale":"2023-10-06T01:22:56.853214+0000","last_undegraded":"2023-10-06T01:22:56.853214+0000","last_fullsized":"2023-10-06T01:22:56.853214+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:22:55.908368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:22:55.908368+0000","last_clean_scrub_stamp":"2023-10-06T01:22:55.908368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:08:58.050013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2c","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-06T01:22:56.846561+0000","last_change":"2023-10-06T01:22:56.845633+0000","last_active":"2023-10-06T01:22:56.846561+0000","last_peered":"2023-10-06T01:22:56.846561+0000","last_clean":"2023-10-06T01:22:56.846561+0000","last_became_active":"2023-10-06T01:22:56.845341+0000","last_became_peered":"2023-10-06T01:22:56.845341+0000","last_unstale":"2023-10-06T01:22:56.846561+0000","last_undegraded":"2023-10-06T01:22:56.846561+0000","last_fullsized":"2023-10-06T01:22:56.846561+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:22:55.908368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:22:55.908368+0000","last_clean_scrub_stamp":"2023-10-06T01:22:55.908368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:03:58.916755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2b","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-06T01:22:56.857962+0000","last_change":"2023-10-06T01:22:56.852933+0000","last_active":"2023-10-06T01:22:56.857962+0000","last_peered":"2023-10-06T01:22:56.857962+0000","last_clean":"2023-10-06T01:22:56.857962+0000","last_became_active":"2023-10-06T01:22:56.852533+0000","last_became_peered":"2023-10-06T01:22:56.852533+0000","last_unstale":"2023-10-06T01:22:56.857962+0000","last_undegraded":"2023-10-06T01:22:56.857962+0000","last_fullsized":"2023-10-06T01:22:56.857962+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:22:55.908368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:22:55.908368+0000","last_clean_scrub_stamp":"2023-10-06T01:22:55.908368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:37:59.339689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.2a","version":"0'0","reported_seq":8,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-06T01:22:56.851077+0000","last_change":"2023-10-06T01:22:56.851077+0000","last_active":"2023-10-06T01:22:56.851077+0000","last_peered":"2023-10-06T01:22:56.851077+0000","last_clean":"2023-10-06T01:22:56.851077+0000","last_became_active":"2023-10-06T01:22:56.850792+0000","last_became_peered":"2023-10-06T01:22:56.850792+0000","last_unstale":"2023-10-06T01:22:56.851077+0000","last_undegraded":"2023-10-06T01:22:56.851077+0000","last_fullsized":"2023-10-06T01:22:56.851077+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:22:55.908368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:22:55.908368+0000","last_clean_scrub_stamp":"2023-10-06T01:22:55.908368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:42:29.916205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.29","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-06T01:22:56.849105+0000","last_change":"2023-10-06T01:22:56.845329+0000","last_active":"2023-10-06T01:22:56.849105+0000","last_peered":"2023-10-06T01:22:56.849105+0000","last_clean":"2023-10-06T01:22:56.849105+0000","last_became_active":"2023-10-06T01:22:56.844846+0000","last_became_peered":"2023-10-06T01:22:56.844846+0000","last_unstale":"2023-10-06T01:22:56.849105+0000","last_undegraded":"2023-10-06T01:22:56.849105+0000","last_fullsized":"2023-10-06T01:22:56.849105+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:22:55.908368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:22:55.908368+0000","last_clean_scrub_stamp":"2023-10-06T01:22:55.908368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:25:18.654795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.28","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-06T01:22:56.850061+0000","last_change":"2023-10-06T01:22:56.843914+0000","last_active":"2023-10-06T01:22:56.850061+0000","last_peered":"2023-10-06T01:22:56.850061+0000","last_clean":"2023-10-06T01:22:56.850061+0000","last_became_active":"2023-10-06T01:22:56.843662+0000","last_became_peered":"2023-10-06T01:22:56.843662+0000","last_unstale":"2023-10-06T01:22:56.850061+0000","last_undegraded":"2023-10-06T01:22:56.850061+0000","last_fullsized":"2023-10-06T01:22:56.850061+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:22:55.908368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:22:55.908368+0000","last_clean_scrub_stamp":"2023-10-06T01:22:55.908368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:23:28.916695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.27","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-06T01:22:56.855367+0000","last_change":"2023-10-06T01:22:56.851243+0000","last_active":"2023-10-06T01:22:56.855367+0000","last_peered":"2023-10-06T01:22:56.855367+0000","last_clean":"2023-10-06T01:22:56.855367+0000","last_became_active":"2023-10-06T01:22:56.850958+0000","last_became_peered":"2023-10-06T01:22:56.850958+0000","last_unstale":"2023-10-06T01:22:56.855367+0000","last_undegraded":"2023-10-06T01:22:56.855367+0000","last_fullsized":"2023-10-06T01:22:56.855367+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:22:55.908368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:22:55.908368+0000","last_clean_scrub_stamp":"2023-10-06T01:22:55.908368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:42:43.961190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.26","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-06T01:22:56.847063+0000","last_change":"2023-10-06T01:22:56.841949+0000","last_active":"2023-10-06T01:22:56.847063+0000","last_peered":"2023-10-06T01:22:56.847063+0000","last_clean":"2023-10-06T01:22:56.847063+0000","last_became_active":"2023-10-06T01:22:56.841487+0000","last_became_peered":"2023-10-06T01:22:56.841487+0000","last_unstale":"2023-10-06T01:22:56.847063+0000","last_undegraded":"2023-10-06T01:22:56.847063+0000","last_fullsized":"2023-10-06T01:22:56.847063+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:22:55.908368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:22:55.908368+0000","last_clean_scrub_stamp":"2023-10-06T01:22:55.908368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:00:44.475252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.25","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-06T01:22:56.861083+0000","last_change":"2023-10-06T01:22:56.856843+0000","last_active":"2023-10-06T01:22:56.861083+0000","last_peered":"2023-10-06T01:22:56.861083+0000","last_clean":"2023-10-06T01:22:56.861083+0000","last_became_active":"2023-10-06T01:22:56.856521+0000","last_became_peered":"2023-10-06T01:22:56.856521+0000","last_unstale":"2023-10-06T01:22:56.861083+0000","last_undegraded":"2023-10-06T01:22:56.861083+0000","last_fullsized":"2023-10-06T01:22:56.861083+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:22:55.908368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:22:55.908368+0000","last_clean_scrub_stamp":"2023-10-06T01:22:55.908368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:30:04.146182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.24","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-06T01:22:56.854828+0000","last_change":"2023-10-06T01:22:56.847316+0000","last_active":"2023-10-06T01:22:56.854828+0000","last_peered":"2023-10-06T01:22:56.854828+0000","last_clean":"2023-10-06T01:22:56.854828+0000","last_became_active":"2023-10-06T01:22:56.846448+0000","last_became_peered":"2023-10-06T01:22:56.846448+0000","last_unstale":"2023-10-06T01:22:56.854828+0000","last_undegraded":"2023-10-06T01:22:56.854828+0000","last_fullsized":"2023-10-06T01:22:56.854828+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:22:55.908368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:22:55.908368+0000","last_clean_scrub_stamp":"2023-10-06T01:22:55.908368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:25:17.049218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.23","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-06T01:22:56.857113+0000","last_change":"2023-10-06T01:22:56.851314+0000","last_active":"2023-10-06T01:22:56.857113+0000","last_peered":"2023-10-06T01:22:56.857113+0000","last_clean":"2023-10-06T01:22:56.857113+0000","last_became_active":"2023-10-06T01:22:56.851049+0000","last_became_peered":"2023-10-06T01:22:56.851049+0000","last_unstale":"2023-10-06T01:22:56.857113+0000","last_undegraded":"2023-10-06T01:22:56.857113+0000","last_fullsized":"2023-10-06T01:22:56.857113+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:22:55.908368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:22:55.908368+0000","last_clean_scrub_stamp":"2023-10-06T01:22:55.908368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:07:21.358973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.22","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-06T01:22:56.856496+0000","last_change":"2023-10-06T01:22:56.854244+0000","last_active":"2023-10-06T01:22:56.856496+0000","last_peered":"2023-10-06T01:22:56.856496+0000","last_clean":"2023-10-06T01:22:56.856496+0000","last_became_active":"2023-10-06T01:22:56.853956+0000","last_became_peered":"2023-10-06T01:22:56.853956+0000","last_unstale":"2023-10-06T01:22:56.856496+0000","last_undegraded":"2023-10-06T01:22:56.856496+0000","last_fullsized":"2023-10-06T01:22:56.856496+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:22:55.908368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:22:55.908368+0000","last_clean_scrub_stamp":"2023-10-06T01:22:55.908368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:51:57.198044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.21","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-06T01:22:56.839899+0000","last_change":"2023-10-06T01:22:56.836978+0000","last_active":"2023-10-06T01:22:56.839899+0000","last_peered":"2023-10-06T01:22:56.839899+0000","last_clean":"2023-10-06T01:22:56.839899+0000","last_became_active":"2023-10-06T01:22:56.836654+0000","last_became_peered":"2023-10-06T01:22:56.836654+0000","last_unstale":"2023-10-06T01:22:56.839899+0000","last_undegraded":"2023-10-06T01:22:56.839899+0000","last_fullsized":"2023-10-06T01:22:56.839899+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:22:55.908368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:22:55.908368+0000","last_clean_scrub_stamp":"2023-10-06T01:22:55.908368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:25:50.057545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.20","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-06T01:22:56.844577+0000","last_change":"2023-10-06T01:22:56.841511+0000","last_active":"2023-10-06T01:22:56.844577+0000","last_peered":"2023-10-06T01:22:56.844577+0000","last_clean":"2023-10-06T01:22:56.844577+0000","last_became_active":"2023-10-06T01:22:56.841266+0000","last_became_peered":"2023-10-06T01:22:56.841266+0000","last_unstale":"2023-10-06T01:22:56.844577+0000","last_undegraded":"2023-10-06T01:22:56.844577+0000","last_fullsized":"2023-10-06T01:22:56.844577+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:22:55.908368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:22:55.908368+0000","last_clean_scrub_stamp":"2023-10-06T01:22:55.908368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:37:39.783131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-06T01:22:56.850943+0000","last_change":"2023-10-06T01:22:56.843877+0000","last_active":"2023-10-06T01:22:56.850943+0000","last_peered":"2023-10-06T01:22:56.850943+0000","last_clean":"2023-10-06T01:22:56.850943+0000","last_became_active":"2023-10-06T01:22:56.843529+0000","last_became_peered":"2023-10-06T01:22:56.843529+0000","last_unstale":"2023-10-06T01:22:56.850943+0000","last_undegraded":"2023-10-06T01:22:56.850943+0000","last_fullsized":"2023-10-06T01:22:56.850943+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:22:55.908368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:22:55.908368+0000","last_clean_scrub_stamp":"2023-10-06T01:22:55.908368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:00:44.475252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"38'4","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-06T01:22:56.929024+0000","last_change":"2023-10-06T01:22:55.945877+0000","last_active":"2023-10-06T01:22:56.929024+0000","last_peered":"2023-10-06T01:22:56.929024+0000","last_clean":"2023-10-06T01:22:56.929024+0000","last_became_active":"2023-10-06T01:22:55.945506+0000","last_became_peered":"2023-10-06T01:22:55.945506+0000","last_unstale":"2023-10-06T01:22:56.929024+0000","last_undegraded":"2023-10-06T01:22:56.929024+0000","last_fullsized":"2023-10-06T01:22:56.929024+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:22:54.901806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:22:54.901806+0000","last_clean_scrub_stamp":"2023-10-06T01:22:54.901806+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:26:32.058068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-06T01:22:56.855340+0000","last_change":"2023-10-06T01:22:56.851143+0000","last_active":"2023-10-06T01:22:56.855340+0000","last_peered":"2023-10-06T01:22:56.855340+0000","last_clean":"2023-10-06T01:22:56.855340+0000","last_became_active":"2023-10-06T01:22:56.850808+0000","last_became_peered":"2023-10-06T01:22:56.850808+0000","last_unstale":"2023-10-06T01:22:56.855340+0000","last_undegraded":"2023-10-06T01:22:56.855340+0000","last_fullsized":"2023-10-06T01:22:56.855340+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:22:55.908368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:22:55.908368+0000","last_clean_scrub_stamp":"2023-10-06T01:22:55.908368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:18:25.838496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1e","version":"38'1","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-06T01:22:56.931342+0000","last_change":"2023-10-06T01:22:55.941792+0000","last_active":"2023-10-06T01:22:56.931342+0000","last_peered":"2023-10-06T01:22:56.931342+0000","last_clean":"2023-10-06T01:22:56.931342+0000","last_became_active":"2023-10-06T01:22:55.941523+0000","last_became_peered":"2023-10-06T01:22:55.941523+0000","last_unstale":"2023-10-06T01:22:56.931342+0000","last_undegraded":"2023-10-06T01:22:56.931342+0000","last_fullsized":"2023-10-06T01:22:56.931342+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:22:54.901806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:22:54.901806+0000","last_clean_scrub_stamp":"2023-10-06T01:22:54.901806+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:23:51.567575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-06T01:22:56.854846+0000","last_change":"2023-10-06T01:22:56.847689+0000","last_active":"2023-10-06T01:22:56.854846+0000","last_peered":"2023-10-06T01:22:56.854846+0000","last_clean":"2023-10-06T01:22:56.854846+0000","last_became_active":"2023-10-06T01:22:56.846794+0000","last_became_peered":"2023-10-06T01:22:56.846794+0000","last_unstale":"2023-10-06T01:22:56.854846+0000","last_undegraded":"2023-10-06T01:22:56.854846+0000","last_fullsized":"2023-10-06T01:22:56.854846+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:22:55.908368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:22:55.908368+0000","last_clean_scrub_stamp":"2023-10-06T01:22:55.908368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:01:10.322200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1d","version":"38'2","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-06T01:22:56.929007+0000","last_change":"2023-10-06T01:22:55.928358+0000","last_active":"2023-10-06T01:22:56.929007+0000","last_peered":"2023-10-06T01:22:56.929007+0000","last_clean":"2023-10-06T01:22:56.929007+0000","last_became_active":"2023-10-06T01:22:55.928004+0000","last_became_peered":"2023-10-06T01:22:55.928004+0000","last_unstale":"2023-10-06T01:22:56.929007+0000","last_undegraded":"2023-10-06T01:22:56.929007+0000","last_fullsized":"2023-10-06T01:22:56.929007+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:22:54.901806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:22:54.901806+0000","last_clean_scrub_stamp":"2023-10-06T01:22:54.901806+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T01:35:12.097687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-06T01:22:56.858276+0000","last_change":"2023-10-06T01:22:56.851529+0000","last_active":"2023-10-06T01:22:56.858276+0000","last_peered":"2023-10-06T01:22:56.858276+0000","last_clean":"2023-10-06T01:22:56.858276+0000","last_became_active":"2023-10-06T01:22:56.851278+0000","last_became_peered":"2023-10-06T01:22:56.851278+0000","last_unstale":"2023-10-06T01:22:56.858276+0000","last_undegraded":"2023-10-06T01:22:56.858276+0000","last_fullsized":"2023-10-06T01:22:56.858276+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:22:55.908368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:22:55.908368+0000","last_clean_scrub_stamp":"2023-10-06T01:22:55.908368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:35:21.678412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"38'2","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-06T01:22:56.935905+0000","last_change":"2023-10-06T01:22:55.936828+0000","last_active":"2023-10-06T01:22:56.935905+0000","last_peered":"2023-10-06T01:22:56.935905+0000","last_clean":"2023-10-06T01:22:56.935905+0000","last_became_active":"2023-10-06T01:22:55.936590+0000","last_became_peered":"2023-10-06T01:22:55.936590+0000","last_unstale":"2023-10-06T01:22:56.935905+0000","last_undegraded":"2023-10-06T01:22:56.935905+0000","last_fullsized":"2023-10-06T01:22:56.935905+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:22:54.901806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:22:54.901806+0000","last_clean_scrub_stamp":"2023-10-06T01:22:54.901806+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:25:17.648232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-06T01:22:56.860580+0000","last_change":"2023-10-06T01:22:56.856186+0000","last_active":"2023-10-06T01:22:56.860580+0000","last_peered":"2023-10-06T01:22:56.860580+0000","last_clean":"2023-10-06T01:22:56.860580+0000","last_became_active":"2023-10-06T01:22:56.855921+0000","last_became_peered":"2023-10-06T01:22:56.855921+0000","last_unstale":"2023-10-06T01:22:56.860580+0000","last_undegraded":"2023-10-06T01:22:56.860580+0000","last_fullsized":"2023-10-06T01:22:56.860580+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:22:55.908368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:22:55.908368+0000","last_clean_scrub_stamp":"2023-10-06T01:22:55.908368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:15:29.318011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"38'1","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-06T01:22:56.929075+0000","last_change":"2023-10-06T01:22:55.942730+0000","last_active":"2023-10-06T01:22:56.929075+0000","last_peered":"2023-10-06T01:22:56.929075+0000","last_clean":"2023-10-06T01:22:56.929075+0000","last_became_active":"2023-10-06T01:22:55.941006+0000","last_became_peered":"2023-10-06T01:22:55.941006+0000","last_unstale":"2023-10-06T01:22:56.929075+0000","last_undegraded":"2023-10-06T01:22:56.929075+0000","last_fullsized":"2023-10-06T01:22:56.929075+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:22:54.901806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:22:54.901806+0000","last_clean_scrub_stamp":"2023-10-06T01:22:54.901806+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:18:24.831933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":8,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-06T01:22:56.845818+0000","last_change":"2023-10-06T01:22:56.845818+0000","last_active":"2023-10-06T01:22:56.845818+0000","last_peered":"2023-10-06T01:22:56.845818+0000","last_clean":"2023-10-06T01:22:56.845818+0000","last_became_active":"2023-10-06T01:22:56.845557+0000","last_became_peered":"2023-10-06T01:22:56.845557+0000","last_unstale":"2023-10-06T01:22:56.845818+0000","last_undegraded":"2023-10-06T01:22:56.845818+0000","last_fullsized":"2023-10-06T01:22:56.845818+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:22:55.908368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:22:55.908368+0000","last_clean_scrub_stamp":"2023-10-06T01:22:55.908368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:25:17.049218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1a","version":"38'1","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-06T01:22:56.928981+0000","last_change":"2023-10-06T01:22:55.933270+0000","last_active":"2023-10-06T01:22:56.928981+0000","last_peered":"2023-10-06T01:22:56.928981+0000","last_clean":"2023-10-06T01:22:56.928981+0000","last_became_active":"2023-10-06T01:22:55.933008+0000","last_became_peered":"2023-10-06T01:22:55.933008+0000","last_unstale":"2023-10-06T01:22:56.928981+0000","last_undegraded":"2023-10-06T01:22:56.928981+0000","last_fullsized":"2023-10-06T01:22:56.928981+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:22:54.901806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:22:54.901806+0000","last_clean_scrub_stamp":"2023-10-06T01:22:54.901806+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:42:33.564210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":8,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-06T01:22:56.850294+0000","last_change":"2023-10-06T01:22:56.850294+0000","last_active":"2023-10-06T01:22:56.850294+0000","last_peered":"2023-10-06T01:22:56.850294+0000","last_clean":"2023-10-06T01:22:56.850294+0000","last_became_active":"2023-10-06T01:22:56.850028+0000","last_became_peered":"2023-10-06T01:22:56.850028+0000","last_unstale":"2023-10-06T01:22:56.850294+0000","last_undegraded":"2023-10-06T01:22:56.850294+0000","last_fullsized":"2023-10-06T01:22:56.850294+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:22:55.908368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:22:55.908368+0000","last_clean_scrub_stamp":"2023-10-06T01:22:55.908368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:37:59.339689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-06T01:22:56.830919+0000","last_change":"2023-10-06T01:22:55.932743+0000","last_active":"2023-10-06T01:22:56.830919+0000","last_peered":"2023-10-06T01:22:56.830919+0000","last_clean":"2023-10-06T01:22:56.830919+0000","last_became_active":"2023-10-06T01:22:55.932494+0000","last_became_peered":"2023-10-06T01:22:55.932494+0000","last_unstale":"2023-10-06T01:22:56.830919+0000","last_undegraded":"2023-10-06T01:22:56.830919+0000","last_fullsized":"2023-10-06T01:22:56.830919+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:22:54.901806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:22:54.901806+0000","last_clean_scrub_stamp":"2023-10-06T01:22:54.901806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:07:20.352410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-06T01:22:56.849083+0000","last_change":"2023-10-06T01:22:56.845113+0000","last_active":"2023-10-06T01:22:56.849083+0000","last_peered":"2023-10-06T01:22:56.849083+0000","last_clean":"2023-10-06T01:22:56.849083+0000","last_became_active":"2023-10-06T01:22:56.844503+0000","last_became_peered":"2023-10-06T01:22:56.844503+0000","last_unstale":"2023-10-06T01:22:56.849083+0000","last_undegraded":"2023-10-06T01:22:56.849083+0000","last_fullsized":"2023-10-06T01:22:56.849083+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:22:55.908368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:22:55.908368+0000","last_clean_scrub_stamp":"2023-10-06T01:22:55.908368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:07:00.581304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T01:22:55.940615+0000","last_change":"2023-10-06T01:22:55.937881+0000","last_active":"2023-10-06T01:22:55.940615+0000","last_peered":"2023-10-06T01:22:55.940615+0000","last_clean":"2023-10-06T01:22:55.940615+0000","last_became_active":"2023-10-06T01:22:55.936260+0000","last_became_peered":"2023-10-06T01:22:55.936260+0000","last_unstale":"2023-10-06T01:22:55.940615+0000","last_undegraded":"2023-10-06T01:22:55.940615+0000","last_fullsized":"2023-10-06T01:22:55.940615+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:22:54.901806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:22:54.901806+0000","last_clean_scrub_stamp":"2023-10-06T01:22:54.901806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:41:45.615324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-06T01:22:56.861105+0000","last_change":"2023-10-06T01:22:56.858651+0000","last_active":"2023-10-06T01:22:56.861105+0000","last_peered":"2023-10-06T01:22:56.861105+0000","last_clean":"2023-10-06T01:22:56.861105+0000","last_became_active":"2023-10-06T01:22:56.858303+0000","last_became_peered":"2023-10-06T01:22:56.858303+0000","last_unstale":"2023-10-06T01:22:56.861105+0000","last_undegraded":"2023-10-06T01:22:56.861105+0000","last_fullsized":"2023-10-06T01:22:56.861105+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:22:55.908368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:22:55.908368+0000","last_clean_scrub_stamp":"2023-10-06T01:22:55.908368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:37:59.339689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-06T01:22:56.844666+0000","last_change":"2023-10-06T01:22:55.933376+0000","last_active":"2023-10-06T01:22:56.844666+0000","last_peered":"2023-10-06T01:22:56.844666+0000","last_clean":"2023-10-06T01:22:56.844666+0000","last_became_active":"2023-10-06T01:22:55.933076+0000","last_became_peered":"2023-10-06T01:22:55.933076+0000","last_unstale":"2023-10-06T01:22:56.844666+0000","last_undegraded":"2023-10-06T01:22:56.844666+0000","last_fullsized":"2023-10-06T01:22:56.844666+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:22:54.901806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:22:54.901806+0000","last_clean_scrub_stamp":"2023-10-06T01:22:54.901806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:53:55.823050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":8,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-06T01:22:56.842286+0000","last_change":"2023-10-06T01:22:56.842286+0000","last_active":"2023-10-06T01:22:56.842286+0000","last_peered":"2023-10-06T01:22:56.842286+0000","last_clean":"2023-10-06T01:22:56.842286+0000","last_became_active":"2023-10-06T01:22:56.842017+0000","last_became_peered":"2023-10-06T01:22:56.842017+0000","last_unstale":"2023-10-06T01:22:56.842286+0000","last_undegraded":"2023-10-06T01:22:56.842286+0000","last_fullsized":"2023-10-06T01:22:56.842286+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:22:55.908368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:22:55.908368+0000","last_clean_scrub_stamp":"2023-10-06T01:22:55.908368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:25:50.057545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T01:22:55.940656+0000","last_change":"2023-10-06T01:22:55.937771+0000","last_active":"2023-10-06T01:22:55.940656+0000","last_peered":"2023-10-06T01:22:55.940656+0000","last_clean":"2023-10-06T01:22:55.940656+0000","last_became_active":"2023-10-06T01:22:55.937514+0000","last_became_peered":"2023-10-06T01:22:55.937514+0000","last_unstale":"2023-10-06T01:22:55.940656+0000","last_undegraded":"2023-10-06T01:22:55.940656+0000","last_fullsized":"2023-10-06T01:22:55.940656+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:22:54.901806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:22:54.901806+0000","last_clean_scrub_stamp":"2023-10-06T01:22:54.901806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:08:57.043450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-06T01:22:56.853997+0000","last_change":"2023-10-06T01:22:56.846213+0000","last_active":"2023-10-06T01:22:56.853997+0000","last_peered":"2023-10-06T01:22:56.853997+0000","last_clean":"2023-10-06T01:22:56.853997+0000","last_became_active":"2023-10-06T01:22:56.845971+0000","last_became_peered":"2023-10-06T01:22:56.845971+0000","last_unstale":"2023-10-06T01:22:56.853997+0000","last_undegraded":"2023-10-06T01:22:56.853997+0000","last_fullsized":"2023-10-06T01:22:56.853997+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:22:55.908368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:22:55.908368+0000","last_clean_scrub_stamp":"2023-10-06T01:22:55.908368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:30:04.146182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"38'3","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-06T01:22:56.936169+0000","last_change":"2023-10-06T01:22:55.942244+0000","last_active":"2023-10-06T01:22:56.936169+0000","last_peered":"2023-10-06T01:22:56.936169+0000","last_clean":"2023-10-06T01:22:56.936169+0000","last_became_active":"2023-10-06T01:22:55.941957+0000","last_became_peered":"2023-10-06T01:22:55.941957+0000","last_unstale":"2023-10-06T01:22:56.936169+0000","last_undegraded":"2023-10-06T01:22:56.936169+0000","last_fullsized":"2023-10-06T01:22:56.936169+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:22:54.901806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:22:54.901806+0000","last_clean_scrub_stamp":"2023-10-06T01:22:54.901806+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:26:32.058068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":8,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-06T01:22:56.850049+0000","last_change":"2023-10-06T01:22:56.850049+0000","last_active":"2023-10-06T01:22:56.850049+0000","last_peered":"2023-10-06T01:22:56.850049+0000","last_clean":"2023-10-06T01:22:56.850049+0000","last_became_active":"2023-10-06T01:22:56.849212+0000","last_became_peered":"2023-10-06T01:22:56.849212+0000","last_unstale":"2023-10-06T01:22:56.850049+0000","last_undegraded":"2023-10-06T01:22:56.850049+0000","last_fullsized":"2023-10-06T01:22:56.850049+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:22:55.908368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:22:55.908368+0000","last_clean_scrub_stamp":"2023-10-06T01:22:55.908368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:25:51.642335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.14","version":"38'6","reported_seq":16,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-06T01:22:56.933698+0000","last_change":"2023-10-06T01:22:55.929382+0000","last_active":"2023-10-06T01:22:56.933698+0000","last_peered":"2023-10-06T01:22:56.933698+0000","last_clean":"2023-10-06T01:22:56.933698+0000","last_became_active":"2023-10-06T01:22:55.929069+0000","last_became_peered":"2023-10-06T01:22:55.929069+0000","last_unstale":"2023-10-06T01:22:56.933698+0000","last_undegraded":"2023-10-06T01:22:56.933698+0000","last_fullsized":"2023-10-06T01:22:56.933698+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:22:54.901806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:22:54.901806+0000","last_clean_scrub_stamp":"2023-10-06T01:22:54.901806+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:45:21.907915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-06T01:22:56.855113+0000","last_change":"2023-10-06T01:22:56.849162+0000","last_active":"2023-10-06T01:22:56.855113+0000","last_peered":"2023-10-06T01:22:56.855113+0000","last_clean":"2023-10-06T01:22:56.855113+0000","last_became_active":"2023-10-06T01:22:56.848894+0000","last_became_peered":"2023-10-06T01:22:56.848894+0000","last_unstale":"2023-10-06T01:22:56.855113+0000","last_undegraded":"2023-10-06T01:22:56.855113+0000","last_fullsized":"2023-10-06T01:22:56.855113+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:22:55.908368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:22:55.908368+0000","last_clean_scrub_stamp":"2023-10-06T01:22:55.908368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:41:46.621887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"38'2","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-06T01:22:56.929264+0000","last_change":"2023-10-06T01:22:55.943190+0000","last_active":"2023-10-06T01:22:56.929264+0000","last_peered":"2023-10-06T01:22:56.929264+0000","last_clean":"2023-10-06T01:22:56.929264+0000","last_became_active":"2023-10-06T01:22:55.942949+0000","last_became_peered":"2023-10-06T01:22:55.942949+0000","last_unstale":"2023-10-06T01:22:56.929264+0000","last_undegraded":"2023-10-06T01:22:56.929264+0000","last_fullsized":"2023-10-06T01:22:56.929264+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:22:54.901806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:22:54.901806+0000","last_clean_scrub_stamp":"2023-10-06T01:22:54.901806+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:34:52.114529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":8,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-06T01:22:56.857247+0000","last_change":"2023-10-06T01:22:56.857247+0000","last_active":"2023-10-06T01:22:56.857247+0000","last_peered":"2023-10-06T01:22:56.857247+0000","last_clean":"2023-10-06T01:22:56.857247+0000","last_became_active":"2023-10-06T01:22:56.856881+0000","last_became_peered":"2023-10-06T01:22:56.856881+0000","last_unstale":"2023-10-06T01:22:56.857247+0000","last_undegraded":"2023-10-06T01:22:56.857247+0000","last_fullsized":"2023-10-06T01:22:56.857247+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:22:55.908368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:22:55.908368+0000","last_clean_scrub_stamp":"2023-10-06T01:22:55.908368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:55:35.329247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T01:22:55.935675+0000","last_change":"2023-10-06T01:22:55.931031+0000","last_active":"2023-10-06T01:22:55.935675+0000","last_peered":"2023-10-06T01:22:55.935675+0000","last_clean":"2023-10-06T01:22:55.935675+0000","last_became_active":"2023-10-06T01:22:55.930742+0000","last_became_peered":"2023-10-06T01:22:55.930742+0000","last_unstale":"2023-10-06T01:22:55.935675+0000","last_undegraded":"2023-10-06T01:22:55.935675+0000","last_fullsized":"2023-10-06T01:22:55.935675+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:22:54.901806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:22:54.901806+0000","last_clean_scrub_stamp":"2023-10-06T01:22:54.901806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:41:45.615324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-06T01:22:56.853821+0000","last_change":"2023-10-06T01:22:56.845700+0000","last_active":"2023-10-06T01:22:56.853821+0000","last_peered":"2023-10-06T01:22:56.853821+0000","last_clean":"2023-10-06T01:22:56.853821+0000","last_became_active":"2023-10-06T01:22:56.845460+0000","last_became_peered":"2023-10-06T01:22:56.845460+0000","last_unstale":"2023-10-06T01:22:56.853821+0000","last_undegraded":"2023-10-06T01:22:56.853821+0000","last_fullsized":"2023-10-06T01:22:56.853821+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:22:55.908368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:22:55.908368+0000","last_clean_scrub_stamp":"2023-10-06T01:22:55.908368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:37:47.029243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-06T01:22:56.833447+0000","last_change":"2023-10-06T01:22:55.939859+0000","last_active":"2023-10-06T01:22:56.833447+0000","last_peered":"2023-10-06T01:22:56.833447+0000","last_clean":"2023-10-06T01:22:56.833447+0000","last_became_active":"2023-10-06T01:22:55.939545+0000","last_became_peered":"2023-10-06T01:22:55.939545+0000","last_unstale":"2023-10-06T01:22:56.833447+0000","last_undegraded":"2023-10-06T01:22:56.833447+0000","last_fullsized":"2023-10-06T01:22:56.833447+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:22:54.901806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:22:54.901806+0000","last_clean_scrub_stamp":"2023-10-06T01:22:54.901806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:07:20.352410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":8,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-06T01:22:56.851466+0000","last_change":"2023-10-06T01:22:56.851466+0000","last_active":"2023-10-06T01:22:56.851466+0000","last_peered":"2023-10-06T01:22:56.851466+0000","last_clean":"2023-10-06T01:22:56.851466+0000","last_became_active":"2023-10-06T01:22:56.851195+0000","last_became_peered":"2023-10-06T01:22:56.851195+0000","last_unstale":"2023-10-06T01:22:56.851466+0000","last_undegraded":"2023-10-06T01:22:56.851466+0000","last_fullsized":"2023-10-06T01:22:56.851466+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:22:55.908368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:22:55.908368+0000","last_clean_scrub_stamp":"2023-10-06T01:22:55.908368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:55:32.218597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.10","version":"38'8","reported_seq":17,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-06T01:22:56.930286+0000","last_change":"2023-10-06T01:22:55.937651+0000","last_active":"2023-10-06T01:22:56.930286+0000","last_peered":"2023-10-06T01:22:56.930286+0000","last_clean":"2023-10-06T01:22:56.930286+0000","last_became_active":"2023-10-06T01:22:55.936005+0000","last_became_peered":"2023-10-06T01:22:55.936005+0000","last_unstale":"2023-10-06T01:22:56.930286+0000","last_undegraded":"2023-10-06T01:22:56.930286+0000","last_fullsized":"2023-10-06T01:22:56.930286+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:22:54.901806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:22:54.901806+0000","last_clean_scrub_stamp":"2023-10-06T01:22:54.901806+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:51:40.781567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-06T01:22:56.847015+0000","last_change":"2023-10-06T01:22:56.838033+0000","last_active":"2023-10-06T01:22:56.847015+0000","last_peered":"2023-10-06T01:22:56.847015+0000","last_clean":"2023-10-06T01:22:56.847015+0000","last_became_active":"2023-10-06T01:22:56.837738+0000","last_became_peered":"2023-10-06T01:22:56.837738+0000","last_unstale":"2023-10-06T01:22:56.847015+0000","last_undegraded":"2023-10-06T01:22:56.847015+0000","last_fullsized":"2023-10-06T01:22:56.847015+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:22:55.908368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:22:55.908368+0000","last_clean_scrub_stamp":"2023-10-06T01:22:55.908368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:42:43.961190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"38'1","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-06T01:22:56.929554+0000","last_change":"2023-10-06T01:22:55.945637+0000","last_active":"2023-10-06T01:22:56.929554+0000","last_peered":"2023-10-06T01:22:56.929554+0000","last_clean":"2023-10-06T01:22:56.929554+0000","last_became_active":"2023-10-06T01:22:55.945345+0000","last_became_peered":"2023-10-06T01:22:55.945345+0000","last_unstale":"2023-10-06T01:22:56.929554+0000","last_undegraded":"2023-10-06T01:22:56.929554+0000","last_fullsized":"2023-10-06T01:22:56.929554+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:22:54.901806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:22:54.901806+0000","last_clean_scrub_stamp":"2023-10-06T01:22:54.901806+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:31:26.901332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":8,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-06T01:22:56.845173+0000","last_change":"2023-10-06T01:22:56.845173+0000","last_active":"2023-10-06T01:22:56.845173+0000","last_peered":"2023-10-06T01:22:56.845173+0000","last_clean":"2023-10-06T01:22:56.845173+0000","last_became_active":"2023-10-06T01:22:56.844861+0000","last_became_peered":"2023-10-06T01:22:56.844861+0000","last_unstale":"2023-10-06T01:22:56.845173+0000","last_undegraded":"2023-10-06T01:22:56.845173+0000","last_fullsized":"2023-10-06T01:22:56.845173+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:22:55.908368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:22:55.908368+0000","last_clean_scrub_stamp":"2023-10-06T01:22:55.908368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:30:04.146182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.e","version":"38'2","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-06T01:22:56.930847+0000","last_change":"2023-10-06T01:22:55.928136+0000","last_active":"2023-10-06T01:22:56.930847+0000","last_peered":"2023-10-06T01:22:56.930847+0000","last_clean":"2023-10-06T01:22:56.930847+0000","last_became_active":"2023-10-06T01:22:55.927884+0000","last_became_peered":"2023-10-06T01:22:55.927884+0000","last_unstale":"2023-10-06T01:22:56.930847+0000","last_undegraded":"2023-10-06T01:22:56.930847+0000","last_fullsized":"2023-10-06T01:22:56.930847+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:22:54.901806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:22:54.901806+0000","last_clean_scrub_stamp":"2023-10-06T01:22:54.901806+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:45:23.823523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-06T01:22:56.860665+0000","last_change":"2023-10-06T01:22:56.856474+0000","last_active":"2023-10-06T01:22:56.860665+0000","last_peered":"2023-10-06T01:22:56.860665+0000","last_clean":"2023-10-06T01:22:56.860665+0000","last_became_active":"2023-10-06T01:22:56.856230+0000","last_became_peered":"2023-10-06T01:22:56.856230+0000","last_unstale":"2023-10-06T01:22:56.860665+0000","last_undegraded":"2023-10-06T01:22:56.860665+0000","last_fullsized":"2023-10-06T01:22:56.860665+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:22:55.908368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:22:55.908368+0000","last_clean_scrub_stamp":"2023-10-06T01:22:55.908368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:34:53.121092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.d","version":"38'1","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-06T01:22:56.932176+0000","last_change":"2023-10-06T01:22:55.928949+0000","last_active":"2023-10-06T01:22:56.932176+0000","last_peered":"2023-10-06T01:22:56.932176+0000","last_clean":"2023-10-06T01:22:56.932176+0000","last_became_active":"2023-10-06T01:22:55.928245+0000","last_became_peered":"2023-10-06T01:22:55.928245+0000","last_unstale":"2023-10-06T01:22:56.932176+0000","last_undegraded":"2023-10-06T01:22:56.932176+0000","last_fullsized":"2023-10-06T01:22:56.932176+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:22:54.901806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:22:54.901806+0000","last_clean_scrub_stamp":"2023-10-06T01:22:54.901806+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:34:52.114529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-06T01:22:56.855420+0000","last_change":"2023-10-06T01:22:56.851623+0000","last_active":"2023-10-06T01:22:56.855420+0000","last_peered":"2023-10-06T01:22:56.855420+0000","last_clean":"2023-10-06T01:22:56.855420+0000","last_became_active":"2023-10-06T01:22:56.851338+0000","last_became_peered":"2023-10-06T01:22:56.851338+0000","last_unstale":"2023-10-06T01:22:56.855420+0000","last_undegraded":"2023-10-06T01:22:56.855420+0000","last_fullsized":"2023-10-06T01:22:56.855420+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:22:55.908368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:22:55.908368+0000","last_clean_scrub_stamp":"2023-10-06T01:22:55.908368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:37:39.783131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-06T01:22:56.833737+0000","last_change":"2023-10-06T01:22:55.945801+0000","last_active":"2023-10-06T01:22:56.833737+0000","last_peered":"2023-10-06T01:22:56.833737+0000","last_clean":"2023-10-06T01:22:56.833737+0000","last_became_active":"2023-10-06T01:22:55.945514+0000","last_became_peered":"2023-10-06T01:22:55.945514+0000","last_unstale":"2023-10-06T01:22:56.833737+0000","last_undegraded":"2023-10-06T01:22:56.833737+0000","last_fullsized":"2023-10-06T01:22:56.833737+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:22:54.901806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:22:54.901806+0000","last_clean_scrub_stamp":"2023-10-06T01:22:54.901806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:30:30.486820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-06T01:22:56.853960+0000","last_change":"2023-10-06T01:22:56.848480+0000","last_active":"2023-10-06T01:22:56.853960+0000","last_peered":"2023-10-06T01:22:56.853960+0000","last_clean":"2023-10-06T01:22:56.853960+0000","last_became_active":"2023-10-06T01:22:56.847550+0000","last_became_peered":"2023-10-06T01:22:56.847550+0000","last_unstale":"2023-10-06T01:22:56.853960+0000","last_undegraded":"2023-10-06T01:22:56.853960+0000","last_fullsized":"2023-10-06T01:22:56.853960+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:22:55.908368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:22:55.908368+0000","last_clean_scrub_stamp":"2023-10-06T01:22:55.908368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:15:20.271419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.b","version":"38'2","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-06T01:22:56.929147+0000","last_change":"2023-10-06T01:22:55.944027+0000","last_active":"2023-10-06T01:22:56.929147+0000","last_peered":"2023-10-06T01:22:56.929147+0000","last_clean":"2023-10-06T01:22:56.929147+0000","last_became_active":"2023-10-06T01:22:55.943708+0000","last_became_peered":"2023-10-06T01:22:55.943708+0000","last_unstale":"2023-10-06T01:22:56.929147+0000","last_undegraded":"2023-10-06T01:22:56.929147+0000","last_fullsized":"2023-10-06T01:22:56.929147+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:22:54.901806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:22:54.901806+0000","last_clean_scrub_stamp":"2023-10-06T01:22:54.901806+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:25:17.648232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-06T01:22:56.847632+0000","last_change":"2023-10-06T01:22:56.839246+0000","last_active":"2023-10-06T01:22:56.847632+0000","last_peered":"2023-10-06T01:22:56.847632+0000","last_clean":"2023-10-06T01:22:56.847632+0000","last_became_active":"2023-10-06T01:22:56.838994+0000","last_became_peered":"2023-10-06T01:22:56.838994+0000","last_unstale":"2023-10-06T01:22:56.847632+0000","last_undegraded":"2023-10-06T01:22:56.847632+0000","last_fullsized":"2023-10-06T01:22:56.847632+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:22:55.908368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:22:55.908368+0000","last_clean_scrub_stamp":"2023-10-06T01:22:55.908368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:08:58.050013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-06T01:22:56.830940+0000","last_change":"2023-10-06T01:22:55.944313+0000","last_active":"2023-10-06T01:22:56.830940+0000","last_peered":"2023-10-06T01:22:56.830940+0000","last_clean":"2023-10-06T01:22:56.830940+0000","last_became_active":"2023-10-06T01:22:55.944039+0000","last_became_peered":"2023-10-06T01:22:55.944039+0000","last_unstale":"2023-10-06T01:22:56.830940+0000","last_undegraded":"2023-10-06T01:22:56.830940+0000","last_fullsized":"2023-10-06T01:22:56.830940+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:22:54.901806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:22:54.901806+0000","last_clean_scrub_stamp":"2023-10-06T01:22:54.901806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:25:17.648232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-06T01:22:56.845523+0000","last_change":"2023-10-06T01:22:56.843180+0000","last_active":"2023-10-06T01:22:56.845523+0000","last_peered":"2023-10-06T01:22:56.845523+0000","last_clean":"2023-10-06T01:22:56.845523+0000","last_became_active":"2023-10-06T01:22:56.842869+0000","last_became_peered":"2023-10-06T01:22:56.842869+0000","last_unstale":"2023-10-06T01:22:56.845523+0000","last_undegraded":"2023-10-06T01:22:56.845523+0000","last_fullsized":"2023-10-06T01:22:56.845523+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:22:55.908368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:22:55.908368+0000","last_clean_scrub_stamp":"2023-10-06T01:22:55.908368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:07:00.581304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T01:22:55.935889+0000","last_change":"2023-10-06T01:22:55.934582+0000","last_active":"2023-10-06T01:22:55.935889+0000","last_peered":"2023-10-06T01:22:55.935889+0000","last_clean":"2023-10-06T01:22:55.935889+0000","last_became_active":"2023-10-06T01:22:55.934319+0000","last_became_peered":"2023-10-06T01:22:55.934319+0000","last_unstale":"2023-10-06T01:22:55.935889+0000","last_undegraded":"2023-10-06T01:22:55.935889+0000","last_fullsized":"2023-10-06T01:22:55.935889+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:22:54.901806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:22:54.901806+0000","last_clean_scrub_stamp":"2023-10-06T01:22:54.901806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:00:43.468689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":8,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-06T01:22:56.849737+0000","last_change":"2023-10-06T01:22:56.849737+0000","last_active":"2023-10-06T01:22:56.849737+0000","last_peered":"2023-10-06T01:22:56.849737+0000","last_clean":"2023-10-06T01:22:56.849737+0000","last_became_active":"2023-10-06T01:22:56.849444+0000","last_became_peered":"2023-10-06T01:22:56.849444+0000","last_unstale":"2023-10-06T01:22:56.849737+0000","last_undegraded":"2023-10-06T01:22:56.849737+0000","last_fullsized":"2023-10-06T01:22:56.849737+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:22:55.908368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:22:55.908368+0000","last_clean_scrub_stamp":"2023-10-06T01:22:55.908368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:55:32.218597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T01:22:55.936218+0000","last_change":"2023-10-06T01:22:55.931736+0000","last_active":"2023-10-06T01:22:55.936218+0000","last_peered":"2023-10-06T01:22:55.936218+0000","last_clean":"2023-10-06T01:22:55.936218+0000","last_became_active":"2023-10-06T01:22:55.931456+0000","last_became_peered":"2023-10-06T01:22:55.931456+0000","last_unstale":"2023-10-06T01:22:55.936218+0000","last_undegraded":"2023-10-06T01:22:55.936218+0000","last_fullsized":"2023-10-06T01:22:55.936218+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:22:54.901806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:22:54.901806+0000","last_clean_scrub_stamp":"2023-10-06T01:22:54.901806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:18:24.831933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-06T01:22:56.857936+0000","last_change":"2023-10-06T01:22:56.852776+0000","last_active":"2023-10-06T01:22:56.857936+0000","last_peered":"2023-10-06T01:22:56.857936+0000","last_clean":"2023-10-06T01:22:56.857936+0000","last_became_active":"2023-10-06T01:22:56.852219+0000","last_became_peered":"2023-10-06T01:22:56.852219+0000","last_unstale":"2023-10-06T01:22:56.857936+0000","last_undegraded":"2023-10-06T01:22:56.857936+0000","last_fullsized":"2023-10-06T01:22:56.857936+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:22:55.908368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:22:55.908368+0000","last_clean_scrub_stamp":"2023-10-06T01:22:55.908368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:51:57.198044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-06T01:22:56.845256+0000","last_change":"2023-10-06T01:22:55.932754+0000","last_active":"2023-10-06T01:22:56.845256+0000","last_peered":"2023-10-06T01:22:56.845256+0000","last_clean":"2023-10-06T01:22:56.845256+0000","last_became_active":"2023-10-06T01:22:55.932420+0000","last_became_peered":"2023-10-06T01:22:55.932420+0000","last_unstale":"2023-10-06T01:22:56.845256+0000","last_undegraded":"2023-10-06T01:22:56.845256+0000","last_fullsized":"2023-10-06T01:22:56.845256+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:22:54.901806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:22:54.901806+0000","last_clean_scrub_stamp":"2023-10-06T01:22:54.901806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:03:23.629683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":31,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-06T01:22:56.842894+0000","last_change":"2023-10-06T01:21:30.601117+0000","last_active":"2023-10-06T01:22:56.842894+0000","last_peered":"2023-10-06T01:22:56.842894+0000","last_clean":"2023-10-06T01:22:56.842894+0000","last_became_active":"2023-10-06T01:21:30.600724+0000","last_became_peered":"2023-10-06T01:21:30.600724+0000","last_unstale":"2023-10-06T01:22:56.842894+0000","last_undegraded":"2023-10-06T01:22:56.842894+0000","last_fullsized":"2023-10-06T01:22:56.842894+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:21:29.586558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:21:29.586558+0000","last_clean_scrub_stamp":"2023-10-06T01:21:29.586558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:47:24.449013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-06T01:22:56.853939+0000","last_change":"2023-10-06T01:22:56.848212+0000","last_active":"2023-10-06T01:22:56.853939+0000","last_peered":"2023-10-06T01:22:56.853939+0000","last_clean":"2023-10-06T01:22:56.853939+0000","last_became_active":"2023-10-06T01:22:56.847892+0000","last_became_peered":"2023-10-06T01:22:56.847892+0000","last_unstale":"2023-10-06T01:22:56.853939+0000","last_undegraded":"2023-10-06T01:22:56.853939+0000","last_fullsized":"2023-10-06T01:22:56.853939+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:22:55.908368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:22:55.908368+0000","last_clean_scrub_stamp":"2023-10-06T01:22:55.908368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:01:10.322200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T01:22:55.943756+0000","last_change":"2023-10-06T01:22:55.942051+0000","last_active":"2023-10-06T01:22:55.943756+0000","last_peered":"2023-10-06T01:22:55.943756+0000","last_clean":"2023-10-06T01:22:55.943756+0000","last_became_active":"2023-10-06T01:22:55.941745+0000","last_became_peered":"2023-10-06T01:22:55.941745+0000","last_unstale":"2023-10-06T01:22:55.943756+0000","last_undegraded":"2023-10-06T01:22:55.943756+0000","last_fullsized":"2023-10-06T01:22:55.943756+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:22:54.901806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:22:54.901806+0000","last_clean_scrub_stamp":"2023-10-06T01:22:54.901806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:34:52.114529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":30,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-06T01:22:56.833818+0000","last_change":"2023-10-06T01:21:30.603434+0000","last_active":"2023-10-06T01:22:56.833818+0000","last_peered":"2023-10-06T01:22:56.833818+0000","last_clean":"2023-10-06T01:22:56.833818+0000","last_became_active":"2023-10-06T01:21:30.603215+0000","last_became_peered":"2023-10-06T01:21:30.603215+0000","last_unstale":"2023-10-06T01:22:56.833818+0000","last_undegraded":"2023-10-06T01:22:56.833818+0000","last_fullsized":"2023-10-06T01:22:56.833818+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:21:29.586558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:21:29.586558+0000","last_clean_scrub_stamp":"2023-10-06T01:21:29.586558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:47:24.449013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":8,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-06T01:22:56.846500+0000","last_change":"2023-10-06T01:22:56.846500+0000","last_active":"2023-10-06T01:22:56.846500+0000","last_peered":"2023-10-06T01:22:56.846500+0000","last_clean":"2023-10-06T01:22:56.846500+0000","last_became_active":"2023-10-06T01:22:56.846191+0000","last_became_peered":"2023-10-06T01:22:56.846191+0000","last_unstale":"2023-10-06T01:22:56.846500+0000","last_undegraded":"2023-10-06T01:22:56.846500+0000","last_fullsized":"2023-10-06T01:22:56.846500+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:22:55.908368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:22:55.908368+0000","last_clean_scrub_stamp":"2023-10-06T01:22:55.908368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:53:56.829612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-06T01:22:56.832980+0000","last_change":"2023-10-06T01:22:55.937232+0000","last_active":"2023-10-06T01:22:56.832980+0000","last_peered":"2023-10-06T01:22:56.832980+0000","last_clean":"2023-10-06T01:22:56.832980+0000","last_became_active":"2023-10-06T01:22:55.936953+0000","last_became_peered":"2023-10-06T01:22:55.936953+0000","last_unstale":"2023-10-06T01:22:56.832980+0000","last_undegraded":"2023-10-06T01:22:56.832980+0000","last_fullsized":"2023-10-06T01:22:56.832980+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:22:54.901806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:22:54.901806+0000","last_clean_scrub_stamp":"2023-10-06T01:22:54.901806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:34:51.873484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":29,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-06T01:22:56.832700+0000","last_change":"2023-10-06T01:21:30.604889+0000","last_active":"2023-10-06T01:22:56.832700+0000","last_peered":"2023-10-06T01:22:56.832700+0000","last_clean":"2023-10-06T01:22:56.832700+0000","last_became_active":"2023-10-06T01:21:30.604535+0000","last_became_peered":"2023-10-06T01:21:30.604535+0000","last_unstale":"2023-10-06T01:22:56.832700+0000","last_undegraded":"2023-10-06T01:22:56.832700+0000","last_fullsized":"2023-10-06T01:22:56.832700+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:21:29.586558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:21:29.586558+0000","last_clean_scrub_stamp":"2023-10-06T01:21:29.586558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:17:59.434982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"17'117","reported_seq":177,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T01:22:55.923096+0000","last_change":"2023-10-06T01:21:31.602437+0000","last_active":"2023-10-06T01:22:55.923096+0000","last_peered":"2023-10-06T01:22:55.923096+0000","last_clean":"2023-10-06T01:22:55.923096+0000","last_became_active":"2023-10-06T01:21:31.601431+0000","last_became_peered":"2023-10-06T01:21:31.601431+0000","last_unstale":"2023-10-06T01:22:55.923096+0000","last_undegraded":"2023-10-06T01:22:55.923096+0000","last_fullsized":"2023-10-06T01:22:55.923096+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:21:30.589171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:21:30.589171+0000","last_clean_scrub_stamp":"2023-10-06T01:21:30.589171+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T01:48:45.877807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":8,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-06T01:22:56.856289+0000","last_change":"2023-10-06T01:22:56.856289+0000","last_active":"2023-10-06T01:22:56.856289+0000","last_peered":"2023-10-06T01:22:56.856289+0000","last_clean":"2023-10-06T01:22:56.856289+0000","last_became_active":"2023-10-06T01:22:56.856037+0000","last_became_peered":"2023-10-06T01:22:56.856037+0000","last_unstale":"2023-10-06T01:22:56.856289+0000","last_undegraded":"2023-10-06T01:22:56.856289+0000","last_fullsized":"2023-10-06T01:22:56.856289+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:22:55.908368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:22:55.908368+0000","last_clean_scrub_stamp":"2023-10-06T01:22:55.908368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:01:10.322200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T01:22:55.944491+0000","last_change":"2023-10-06T01:22:55.942749+0000","last_active":"2023-10-06T01:22:55.944491+0000","last_peered":"2023-10-06T01:22:55.944491+0000","last_clean":"2023-10-06T01:22:55.944491+0000","last_became_active":"2023-10-06T01:22:55.942395+0000","last_became_peered":"2023-10-06T01:22:55.942395+0000","last_unstale":"2023-10-06T01:22:55.944491+0000","last_undegraded":"2023-10-06T01:22:55.944491+0000","last_fullsized":"2023-10-06T01:22:55.944491+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:22:54.901806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:22:54.901806+0000","last_clean_scrub_stamp":"2023-10-06T01:22:54.901806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:07:20.352410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":28,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T01:22:55.921620+0000","last_change":"2023-10-06T01:21:31.338236+0000","last_active":"2023-10-06T01:22:55.921620+0000","last_peered":"2023-10-06T01:22:55.921620+0000","last_clean":"2023-10-06T01:22:55.921620+0000","last_became_active":"2023-10-06T01:21:31.337918+0000","last_became_peered":"2023-10-06T01:21:31.337918+0000","last_unstale":"2023-10-06T01:22:55.921620+0000","last_undegraded":"2023-10-06T01:22:55.921620+0000","last_fullsized":"2023-10-06T01:22:55.921620+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:21:29.586558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:21:29.586558+0000","last_clean_scrub_stamp":"2023-10-06T01:21:29.586558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:02:13.010488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":8,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-06T01:22:56.857594+0000","last_change":"2023-10-06T01:22:56.857594+0000","last_active":"2023-10-06T01:22:56.857594+0000","last_peered":"2023-10-06T01:22:56.857594+0000","last_clean":"2023-10-06T01:22:56.857594+0000","last_became_active":"2023-10-06T01:22:56.857330+0000","last_became_peered":"2023-10-06T01:22:56.857330+0000","last_unstale":"2023-10-06T01:22:56.857594+0000","last_undegraded":"2023-10-06T01:22:56.857594+0000","last_fullsized":"2023-10-06T01:22:56.857594+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:22:55.908368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:22:55.908368+0000","last_clean_scrub_stamp":"2023-10-06T01:22:55.908368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:51:57.198044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"38'2","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-06T01:22:56.933362+0000","last_change":"2023-10-06T01:22:55.946268+0000","last_active":"2023-10-06T01:22:56.933362+0000","last_peered":"2023-10-06T01:22:56.933362+0000","last_clean":"2023-10-06T01:22:56.933362+0000","last_became_active":"2023-10-06T01:22:55.945458+0000","last_became_peered":"2023-10-06T01:22:55.945458+0000","last_unstale":"2023-10-06T01:22:56.933362+0000","last_undegraded":"2023-10-06T01:22:56.933362+0000","last_fullsized":"2023-10-06T01:22:56.933362+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:22:54.901806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:22:54.901806+0000","last_clean_scrub_stamp":"2023-10-06T01:22:54.901806+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:18:24.831933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":28,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T01:22:55.923005+0000","last_change":"2023-10-06T01:21:31.338209+0000","last_active":"2023-10-06T01:22:55.923005+0000","last_peered":"2023-10-06T01:22:55.923005+0000","last_clean":"2023-10-06T01:22:55.923005+0000","last_became_active":"2023-10-06T01:21:31.337870+0000","last_became_peered":"2023-10-06T01:21:31.337870+0000","last_unstale":"2023-10-06T01:22:55.923005+0000","last_undegraded":"2023-10-06T01:22:55.923005+0000","last_fullsized":"2023-10-06T01:22:55.923005+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:21:29.586558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:21:29.586558+0000","last_clean_scrub_stamp":"2023-10-06T01:21:29.586558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:53:47.117299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-06T01:22:56.855097+0000","last_change":"2023-10-06T01:22:56.850461+0000","last_active":"2023-10-06T01:22:56.855097+0000","last_peered":"2023-10-06T01:22:56.855097+0000","last_clean":"2023-10-06T01:22:56.855097+0000","last_became_active":"2023-10-06T01:22:56.850140+0000","last_became_peered":"2023-10-06T01:22:56.850140+0000","last_unstale":"2023-10-06T01:22:56.855097+0000","last_undegraded":"2023-10-06T01:22:56.855097+0000","last_fullsized":"2023-10-06T01:22:56.855097+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:22:55.908368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:22:55.908368+0000","last_clean_scrub_stamp":"2023-10-06T01:22:55.908368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:35:21.678412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.6","version":"39'1","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-06T01:22:58.126875+0000","last_change":"2023-10-06T01:22:55.938429+0000","last_active":"2023-10-06T01:22:58.126875+0000","last_peered":"2023-10-06T01:22:58.126875+0000","last_clean":"2023-10-06T01:22:58.126875+0000","last_became_active":"2023-10-06T01:22:55.938154+0000","last_became_peered":"2023-10-06T01:22:55.938154+0000","last_unstale":"2023-10-06T01:22:58.126875+0000","last_undegraded":"2023-10-06T01:22:58.126875+0000","last_fullsized":"2023-10-06T01:22:58.126875+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:22:54.901806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:22:54.901806+0000","last_clean_scrub_stamp":"2023-10-06T01:22:54.901806+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:09:14.927578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":29,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-06T01:22:56.830864+0000","last_change":"2023-10-06T01:21:31.338177+0000","last_active":"2023-10-06T01:22:56.830864+0000","last_peered":"2023-10-06T01:22:56.830864+0000","last_clean":"2023-10-06T01:22:56.830864+0000","last_became_active":"2023-10-06T01:21:31.337872+0000","last_became_peered":"2023-10-06T01:21:31.337872+0000","last_unstale":"2023-10-06T01:22:56.830864+0000","last_undegraded":"2023-10-06T01:22:56.830864+0000","last_fullsized":"2023-10-06T01:22:56.830864+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:21:29.586558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:21:29.586558+0000","last_clean_scrub_stamp":"2023-10-06T01:21:29.586558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:17:59.434982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-06T01:22:56.853174+0000","last_change":"2023-10-06T01:22:56.841234+0000","last_active":"2023-10-06T01:22:56.853174+0000","last_peered":"2023-10-06T01:22:56.853174+0000","last_clean":"2023-10-06T01:22:56.853174+0000","last_became_active":"2023-10-06T01:22:56.840833+0000","last_became_peered":"2023-10-06T01:22:56.840833+0000","last_unstale":"2023-10-06T01:22:56.853174+0000","last_undegraded":"2023-10-06T01:22:56.853174+0000","last_fullsized":"2023-10-06T01:22:56.853174+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:22:55.908368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:22:55.908368+0000","last_clean_scrub_stamp":"2023-10-06T01:22:55.908368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:23:52.574138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-06T01:22:56.833162+0000","last_change":"2023-10-06T01:22:55.942117+0000","last_active":"2023-10-06T01:22:56.833162+0000","last_peered":"2023-10-06T01:22:56.833162+0000","last_clean":"2023-10-06T01:22:56.833162+0000","last_became_active":"2023-10-06T01:22:55.941811+0000","last_became_peered":"2023-10-06T01:22:55.941811+0000","last_unstale":"2023-10-06T01:22:56.833162+0000","last_undegraded":"2023-10-06T01:22:56.833162+0000","last_fullsized":"2023-10-06T01:22:56.833162+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:22:54.901806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:22:54.901806+0000","last_clean_scrub_stamp":"2023-10-06T01:22:54.901806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:17:16.798223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":29,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-06T01:22:56.833043+0000","last_change":"2023-10-06T01:21:31.338181+0000","last_active":"2023-10-06T01:22:56.833043+0000","last_peered":"2023-10-06T01:22:56.833043+0000","last_clean":"2023-10-06T01:22:56.833043+0000","last_became_active":"2023-10-06T01:21:31.337820+0000","last_became_peered":"2023-10-06T01:21:31.337820+0000","last_unstale":"2023-10-06T01:22:56.833043+0000","last_undegraded":"2023-10-06T01:22:56.833043+0000","last_fullsized":"2023-10-06T01:22:56.833043+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:21:29.586558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:21:29.586558+0000","last_clean_scrub_stamp":"2023-10-06T01:21:29.586558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:44:49.740873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-06T01:22:56.856429+0000","last_change":"2023-10-06T01:22:56.852988+0000","last_active":"2023-10-06T01:22:56.856429+0000","last_peered":"2023-10-06T01:22:56.856429+0000","last_clean":"2023-10-06T01:22:56.856429+0000","last_became_active":"2023-10-06T01:22:56.852678+0000","last_became_peered":"2023-10-06T01:22:56.852678+0000","last_unstale":"2023-10-06T01:22:56.856429+0000","last_undegraded":"2023-10-06T01:22:56.856429+0000","last_fullsized":"2023-10-06T01:22:56.856429+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:22:55.908368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:22:55.908368+0000","last_clean_scrub_stamp":"2023-10-06T01:22:55.908368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:42:29.916205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T01:22:55.940571+0000","last_change":"2023-10-06T01:22:55.937412+0000","last_active":"2023-10-06T01:22:55.940571+0000","last_peered":"2023-10-06T01:22:55.940571+0000","last_clean":"2023-10-06T01:22:55.940571+0000","last_became_active":"2023-10-06T01:22:55.935678+0000","last_became_peered":"2023-10-06T01:22:55.935678+0000","last_unstale":"2023-10-06T01:22:55.940571+0000","last_undegraded":"2023-10-06T01:22:55.940571+0000","last_fullsized":"2023-10-06T01:22:55.940571+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:22:54.901806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:22:54.901806+0000","last_clean_scrub_stamp":"2023-10-06T01:22:54.901806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:35:20.671849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":29,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-06T01:22:56.837929+0000","last_change":"2023-10-06T01:21:30.604007+0000","last_active":"2023-10-06T01:22:56.837929+0000","last_peered":"2023-10-06T01:22:56.837929+0000","last_clean":"2023-10-06T01:22:56.837929+0000","last_became_active":"2023-10-06T01:21:30.603673+0000","last_became_peered":"2023-10-06T01:21:30.603673+0000","last_unstale":"2023-10-06T01:22:56.837929+0000","last_undegraded":"2023-10-06T01:22:56.837929+0000","last_fullsized":"2023-10-06T01:22:56.837929+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:21:29.586558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:21:29.586558+0000","last_clean_scrub_stamp":"2023-10-06T01:21:29.586558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:53:47.117299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574870,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298300,"kb_used_data":1012,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073540,"statfs":{"total":96636764160,"available":96331304960,"internally_reserved":0,"allocated":1036288,"data_stored":785500,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 01:22:29 2023","interfaces":[{"interface":"back","average":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":0.93700000000000006,"5min":0.93700000000000006,"15min":0.93700000000000006},"last":0.60199999999999998},{"interface":"front","average":{"1min":0.65900000000000003,"5min":0.65900000000000003,"15min":0.65900000000000003},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.96999999999999997,"5min":0.96999999999999997,"15min":0.96999999999999997},"last":0.80400000000000005}]},{"osd":1,"last update":"Fri Oct 6 01:22:29 2023","interfaces":[{"interface":"back","average":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":0.89400000000000002,"5min":0.89400000000000002,"15min":0.89400000000000002},"last":0.64100000000000001},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":0.91400000000000003,"5min":0.91400000000000003,"15min":0.91400000000000003},"last":0.70899999999999996}]},{"osd":2,"last update":"Fri Oct 6 01:22:29 2023","interfaces":[{"interface":"back","average":{"1min":0.67300000000000004,"5min":0.67300000000000004,"15min":0.67300000000000004},"min":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":0.82899999999999996,"5min":0.82899999999999996,"15min":0.82899999999999996},"last":0.55300000000000005},{"interface":"front","average":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.93600000000000005,"5min":0.93600000000000005,"15min":0.93600000000000005},"last":0.77000000000000002}]},{"osd":3,"last update":"Fri Oct 6 01:22:29 2023","interfaces":[{"interface":"back","average":{"1min":0.748,"5min":0.748,"15min":0.748},"min":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":1.0660000000000001,"5min":1.0660000000000001,"15min":1.0660000000000001},"last":0.75800000000000001},{"interface":"front","average":{"1min":0.755,"5min":0.755,"15min":0.755},"min":{"1min":0.623,"5min":0.623,"15min":0.623},"max":{"1min":0.89400000000000002,"5min":0.89400000000000002,"15min":0.89400000000000002},"last":0.61899999999999999}]},{"osd":4,"last update":"Fri Oct 6 01:22:29 2023","interfaces":[{"interface":"back","average":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":1.01,"5min":1.01,"15min":1.01},"last":0.53400000000000003},{"interface":"front","average":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":0.86199999999999999,"5min":0.86199999999999999,"15min":0.86199999999999999},"last":0.56699999999999995}]},{"osd":5,"last update":"Fri Oct 6 01:22:29 2023","interfaces":[{"interface":"back","average":{"1min":0.66300000000000003,"5min":0.66300000000000003,"15min":0.66300000000000003},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":0.91600000000000004,"5min":0.91600000000000004,"15min":0.91600000000000004},"last":0.498},{"interface":"front","average":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"min":{"1min":0.503,"5min":0.503,"15min":0.503},"max":{"1min":0.96599999999999997,"5min":0.96599999999999997,"15min":0.96599999999999997},"last":0.73199999999999998}]},{"osd":6,"last update":"Fri Oct 6 01:22:29 2023","interfaces":[{"interface":"back","average":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":0.99199999999999999,"5min":0.99199999999999999,"15min":0.99199999999999999},"last":0.79200000000000004},{"interface":"front","average":{"1min":0.75600000000000001,"5min":0.75600000000000001,"15min":0.75600000000000001},"min":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":1.1000000000000001,"5min":1.1000000000000001,"15min":1.1000000000000001},"last":0.66200000000000003}]}]},{"osd":6,"up_from":13,"seq":55834574870,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297736,"kb_used_data":448,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074104,"statfs":{"total":96636764160,"available":96331882496,"internally_reserved":0,"allocated":458752,"data_stored":202647,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 01:22:30 2023","interfaces":[{"interface":"back","average":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.9279999999999999,"5min":1.9279999999999999,"15min":1.9279999999999999},"last":0.44500000000000001},{"interface":"front","average":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"min":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":2.3420000000000001,"5min":2.3420000000000001,"15min":2.3420000000000001},"last":0.69799999999999995}]},{"osd":1,"last update":"Fri Oct 6 01:22:30 2023","interfaces":[{"interface":"back","average":{"1min":1.262,"5min":1.262,"15min":1.262},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":12.529,"5min":12.529,"15min":12.529},"last":0.65000000000000002},{"interface":"front","average":{"1min":0.88300000000000001,"5min":0.88300000000000001,"15min":0.88300000000000001},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":3.98,"5min":3.98,"15min":3.98},"last":0.65900000000000003}]},{"osd":2,"last update":"Fri Oct 6 01:22:30 2023","interfaces":[{"interface":"back","average":{"1min":0.93899999999999995,"5min":0.93899999999999995,"15min":0.93899999999999995},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":5.4859999999999998,"5min":5.4859999999999998,"15min":5.4859999999999998},"last":0.505},{"interface":"front","average":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"min":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":2.718,"5min":2.718,"15min":2.718},"last":0.56200000000000006}]},{"osd":3,"last update":"Fri Oct 6 01:22:30 2023","interfaces":[{"interface":"back","average":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":2.5129999999999999,"5min":2.5129999999999999,"15min":2.5129999999999999},"last":0.59999999999999998},{"interface":"front","average":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":0.79200000000000004},"min":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":1.9870000000000001,"5min":1.9870000000000001,"15min":1.9870000000000001},"last":0.68000000000000005}]},{"osd":4,"last update":"Fri Oct 6 01:22:30 2023","interfaces":[{"interface":"back","average":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":3.1480000000000001,"5min":3.1480000000000001,"15min":3.1480000000000001},"last":0.46300000000000002},{"interface":"front","average":{"1min":0.82199999999999995,"5min":0.82199999999999995,"15min":0.82199999999999995},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":2.4769999999999999,"5min":2.4769999999999999,"15min":2.4769999999999999},"last":0.746}]},{"osd":5,"last update":"Fri Oct 6 01:22:30 2023","interfaces":[{"interface":"back","average":{"1min":0.95999999999999996,"5min":0.95999999999999996,"15min":0.95999999999999996},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":5.4279999999999999,"5min":5.4279999999999999,"15min":5.4279999999999999},"last":0.63},{"interface":"front","average":{"1min":0.86199999999999999,"5min":0.86199999999999999,"15min":0.86199999999999999},"min":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":2.6739999999999999,"5min":2.6739999999999999,"15min":2.6739999999999999},"last":0.71599999999999997}]},{"osd":7,"last update":"Fri Oct 6 01:22:30 2023","interfaces":[{"interface":"back","average":{"1min":0.88400000000000001,"5min":0.88400000000000001,"15min":0.88400000000000001},"min":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":2.7719999999999998,"5min":2.7719999999999998,"15min":2.7719999999999998},"last":0.77400000000000002},{"interface":"front","average":{"1min":1.109,"5min":1.109,"15min":1.109},"min":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":7.1440000000000001,"5min":7.1440000000000001,"15min":7.1440000000000001},"last":0.73399999999999999}]}]},{"osd":1,"up_from":13,"seq":55834574868,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302404,"kb_used_data":1020,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069436,"statfs":{"total":96636764160,"available":96327102464,"internally_reserved":0,"allocated":1044480,"data_stored":791463,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 01:22:29 2023","interfaces":[{"interface":"back","average":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"min":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"last":0.41499999999999998},{"interface":"front","average":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"last":0.52100000000000002}]},{"osd":2,"last update":"Fri Oct 6 01:22:29 2023","interfaces":[{"interface":"back","average":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":1.073,"5min":1.073,"15min":1.073},"last":0.51000000000000001},{"interface":"front","average":{"1min":0.496,"5min":0.496,"15min":0.496},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"last":0.46100000000000002}]},{"osd":3,"last update":"Fri Oct 6 01:22:29 2023","interfaces":[{"interface":"back","average":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"last":0.496},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.93400000000000005,"5min":0.93400000000000005,"15min":0.93400000000000005},"last":0.55900000000000005}]},{"osd":4,"last update":"Fri Oct 6 01:22:29 2023","interfaces":[{"interface":"back","average":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"min":{"1min":0.505,"5min":0.505,"15min":0.505},"max":{"1min":1.534,"5min":1.534,"15min":1.534},"last":0.86599999999999999},{"interface":"front","average":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"min":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"max":{"1min":1.742,"5min":1.742,"15min":1.742},"last":0.84599999999999997}]},{"osd":5,"last update":"Fri Oct 6 01:22:29 2023","interfaces":[{"interface":"back","average":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"min":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":1.4790000000000001,"5min":1.4790000000000001,"15min":1.4790000000000001},"last":0.88600000000000001},{"interface":"front","average":{"1min":0.82499999999999996,"5min":0.82499999999999996,"15min":0.82499999999999996},"min":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"max":{"1min":1.581,"5min":1.581,"15min":1.581},"last":0.73199999999999998}]},{"osd":6,"last update":"Fri Oct 6 01:22:29 2023","interfaces":[{"interface":"back","average":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":0.79700000000000004},"min":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"max":{"1min":1.51,"5min":1.51,"15min":1.51},"last":0.878},{"interface":"front","average":{"1min":0.81200000000000006,"5min":0.81200000000000006,"15min":0.81200000000000006},"min":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":1.26,"5min":1.26,"15min":1.26},"last":0.93000000000000005}]},{"osd":7,"last update":"Fri Oct 6 01:22:29 2023","interfaces":[{"interface":"back","average":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":0.84099999999999997},"min":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"max":{"1min":1.7070000000000001,"5min":1.7070000000000001,"15min":1.7070000000000001},"last":0.96899999999999997},{"interface":"front","average":{"1min":0.876,"5min":0.876,"15min":0.876},"min":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":1.633,"5min":1.633,"15min":1.633},"last":0.81399999999999995}]}]},{"osd":0,"up_from":13,"seq":55834574869,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301812,"kb_used_data":428,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94070028,"statfs":{"total":96636764160,"available":96327708672,"internally_reserved":0,"allocated":438272,"data_stored":194098,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Oct 6 01:22:29 2023","interfaces":[{"interface":"back","average":{"1min":0.65900000000000003,"5min":0.65900000000000003,"15min":0.65900000000000003},"min":{"1min":0.27800000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":2.8559999999999999,"5min":2.8559999999999999,"15min":2.8559999999999999},"last":0.36599999999999999},{"interface":"front","average":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":2.944,"5min":2.944,"15min":2.944},"last":0.42099999999999999}]},{"osd":2,"last update":"Fri Oct 6 01:22:29 2023","interfaces":[{"interface":"back","average":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":2.8940000000000001,"5min":2.8940000000000001,"15min":2.8940000000000001},"last":0.48799999999999999},{"interface":"front","average":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":2.9820000000000002,"5min":2.9820000000000002,"15min":2.9820000000000002},"last":0.50600000000000001}]},{"osd":3,"last update":"Fri Oct 6 01:22:29 2023","interfaces":[{"interface":"back","average":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"min":{"1min":0.28399999999999997,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":2.7559999999999998,"5min":2.7559999999999998,"15min":2.7559999999999998},"last":0.40000000000000002},{"interface":"front","average":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":2.8140000000000001,"5min":2.8140000000000001,"15min":2.8140000000000001},"last":0.442}]},{"osd":4,"last update":"Fri Oct 6 01:22:29 2023","interfaces":[{"interface":"back","average":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.81299999999999994},"min":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.397,"5min":1.397,"15min":1.397},"last":0.83399999999999996},{"interface":"front","average":{"1min":0.86399999999999999,"5min":0.86399999999999999,"15min":0.86399999999999999},"min":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"max":{"1min":1.833,"5min":1.833,"15min":1.833},"last":0.67400000000000004}]},{"osd":5,"last update":"Fri Oct 6 01:22:29 2023","interfaces":[{"interface":"back","average":{"1min":0.84199999999999997,"5min":0.84199999999999997,"15min":0.84199999999999997},"min":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":1.4430000000000001,"5min":1.4430000000000001,"15min":1.4430000000000001},"last":0.74299999999999999},{"interface":"front","average":{"1min":0.81499999999999995,"5min":0.81499999999999995,"15min":0.81499999999999995},"min":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":1.4359999999999999,"5min":1.4359999999999999,"15min":1.4359999999999999},"last":0.73099999999999998}]},{"osd":6,"last update":"Fri Oct 6 01:22:29 2023","interfaces":[{"interface":"back","average":{"1min":0.93100000000000005,"5min":0.93100000000000005,"15min":0.93100000000000005},"min":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":1.8740000000000001,"5min":1.8740000000000001,"15min":1.8740000000000001},"last":0.623},{"interface":"front","average":{"1min":0.85899999999999999,"5min":0.85899999999999999,"15min":0.85899999999999999},"min":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"max":{"1min":1.361,"5min":1.361,"15min":1.361},"last":0.80100000000000005}]},{"osd":7,"last update":"Fri Oct 6 01:22:29 2023","interfaces":[{"interface":"back","average":{"1min":0.871,"5min":0.871,"15min":0.871},"min":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"max":{"1min":1.413,"5min":1.413,"15min":1.413},"last":0.71199999999999997},{"interface":"front","average":{"1min":0.83699999999999997,"5min":0.83699999999999997,"15min":0.83699999999999997},"min":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":1.2929999999999999,"5min":1.2929999999999999,"15min":1.2929999999999999},"last":0.77600000000000002}]}]},{"osd":2,"up_from":13,"seq":55834574868,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301840,"kb_used_data":456,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94070000,"statfs":{"total":96636764160,"available":96327680000,"internally_reserved":0,"allocated":466944,"data_stored":203561,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 01:22:30 2023","interfaces":[{"interface":"back","average":{"1min":0.497,"5min":0.497,"15min":0.497},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.96599999999999997,"5min":0.96599999999999997,"15min":0.96599999999999997},"last":0.44700000000000001},{"interface":"front","average":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":1,"5min":1,"15min":1},"last":0.372}]},{"osd":1,"last update":"Fri Oct 6 01:22:30 2023","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":1.296,"5min":1.296,"15min":1.296},"last":0.42499999999999999},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":1.1379999999999999,"5min":1.1379999999999999,"15min":1.1379999999999999},"last":0.51500000000000001}]},{"osd":3,"last update":"Fri Oct 6 01:22:30 2023","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":1.222,"5min":1.222,"15min":1.222},"last":0.53200000000000003},{"interface":"front","average":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"last":0.57599999999999996}]},{"osd":4,"last update":"Fri Oct 6 01:22:30 2023","interfaces":[{"interface":"back","average":{"1min":0.73699999999999999,"5min":0.73699999999999999,"15min":0.73699999999999999},"min":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"max":{"1min":1.0700000000000001,"5min":1.0700000000000001,"15min":1.0700000000000001},"last":0.89300000000000002},{"interface":"front","average":{"1min":0.83999999999999997,"5min":0.83999999999999997,"15min":0.83999999999999997},"min":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":1.5469999999999999,"5min":1.5469999999999999,"15min":1.5469999999999999},"last":0.97599999999999998}]},{"osd":5,"last update":"Fri Oct 6 01:22:30 2023","interfaces":[{"interface":"back","average":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":1.5940000000000001,"5min":1.5940000000000001,"15min":1.5940000000000001},"last":0.876},{"interface":"front","average":{"1min":0.88400000000000001,"5min":0.88400000000000001,"15min":0.88400000000000001},"min":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":1.7669999999999999,"5min":1.7669999999999999,"15min":1.7669999999999999},"last":0.92300000000000004}]},{"osd":6,"last update":"Fri Oct 6 01:22:30 2023","interfaces":[{"interface":"back","average":{"1min":0.93600000000000005,"5min":0.93600000000000005,"15min":0.93600000000000005},"min":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":2.0510000000000002,"5min":2.0510000000000002,"15min":2.0510000000000002},"last":0.85599999999999998},{"interface":"front","average":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":0.79200000000000004},"min":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":1.633,"5min":1.633,"15min":1.633},"last":0.94599999999999995}]},{"osd":7,"last update":"Fri Oct 6 01:22:30 2023","interfaces":[{"interface":"back","average":{"1min":0.84299999999999997,"5min":0.84299999999999997,"15min":0.84299999999999997},"min":{"1min":0.62,"5min":0.62,"15min":0.62},"max":{"1min":1.4670000000000001,"5min":1.4670000000000001,"15min":1.4670000000000001},"last":0.91000000000000003},{"interface":"front","average":{"1min":0.88600000000000001,"5min":0.88600000000000001,"15min":0.88600000000000001},"min":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":1.8,"5min":1.8,"15min":1.8},"last":0.96299999999999997}]}]},{"osd":3,"up_from":13,"seq":55834574868,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301824,"kb_used_data":440,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94070016,"statfs":{"total":96636764160,"available":96327696384,"internally_reserved":0,"allocated":450560,"data_stored":195652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 01:22:29 2023","interfaces":[{"interface":"back","average":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"min":{"1min":0.29399999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"last":0.317},{"interface":"front","average":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.69199999999999995,"5min":0.69199999999999995,"15min":0.69199999999999995},"last":0.42599999999999999}]},{"osd":1,"last update":"Fri Oct 6 01:22:29 2023","interfaces":[{"interface":"back","average":{"1min":0.504,"5min":0.504,"15min":0.504},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":1.075,"5min":1.075,"15min":1.075},"last":0.45300000000000001},{"interface":"front","average":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.66000000000000003,"5min":0.66000000000000003,"15min":0.66000000000000003},"last":0.47799999999999998}]},{"osd":2,"last update":"Fri Oct 6 01:22:29 2023","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":1.4319999999999999,"5min":1.4319999999999999,"15min":1.4319999999999999},"last":0.497},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":1.532,"5min":1.532,"15min":1.532},"last":0.51300000000000001}]},{"osd":4,"last update":"Fri Oct 6 01:22:29 2023","interfaces":[{"interface":"back","average":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":1.1080000000000001,"5min":1.1080000000000001,"15min":1.1080000000000001},"last":0.89900000000000002},{"interface":"front","average":{"1min":0.86099999999999999,"5min":0.86099999999999999,"15min":0.86099999999999999},"min":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":1.353,"5min":1.353,"15min":1.353},"last":0.84799999999999998}]},{"osd":5,"last update":"Fri Oct 6 01:22:29 2023","interfaces":[{"interface":"back","average":{"1min":0.79900000000000004,"5min":0.79900000000000004,"15min":0.79900000000000004},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.3149999999999999,"5min":1.3149999999999999,"15min":1.3149999999999999},"last":0.873},{"interface":"front","average":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"min":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"max":{"1min":1.155,"5min":1.155,"15min":1.155},"last":0.67900000000000005}]},{"osd":6,"last update":"Fri Oct 6 01:22:29 2023","interfaces":[{"interface":"back","average":{"1min":0.86799999999999999,"5min":0.86799999999999999,"15min":0.86799999999999999},"min":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":1.1479999999999999,"5min":1.1479999999999999,"15min":1.1479999999999999},"last":0.85999999999999999},{"interface":"front","average":{"1min":0.871,"5min":0.871,"15min":0.871},"min":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.3779999999999999,"5min":1.3779999999999999,"15min":1.3779999999999999},"last":0.81999999999999995}]},{"osd":7,"last update":"Fri Oct 6 01:22:29 2023","interfaces":[{"interface":"back","average":{"1min":0.86099999999999999,"5min":0.86099999999999999,"15min":0.86099999999999999},"min":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"max":{"1min":1.075,"5min":1.075,"15min":1.075},"last":0.79300000000000004},{"interface":"front","average":{"1min":0.90400000000000003,"5min":0.90400000000000003,"15min":0.90400000000000003},"min":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"max":{"1min":1.097,"5min":1.097,"15min":1.097},"last":0.80400000000000005}]}]},{"osd":4,"up_from":13,"seq":55834574868,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297740,"kb_used_data":452,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074100,"statfs":{"total":96636764160,"available":96331878400,"internally_reserved":0,"allocated":462848,"data_stored":203539,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 01:22:32 2023","interfaces":[{"interface":"back","average":{"1min":0.624,"5min":0.624,"15min":0.624},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.93000000000000005,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.53600000000000003},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":0.96499999999999997,"5min":0.96499999999999997,"15min":0.96499999999999997},"last":0.65500000000000003}]},{"osd":1,"last update":"Fri Oct 6 01:22:32 2023","interfaces":[{"interface":"back","average":{"1min":0.66700000000000004,"5min":0.66700000000000004,"15min":0.66700000000000004},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":1.04,"5min":1.04,"15min":1.04},"last":0.60099999999999998},{"interface":"front","average":{"1min":0.68899999999999995,"5min":0.68899999999999995,"15min":0.68899999999999995},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":0.92000000000000004,"5min":0.92000000000000004,"15min":0.92000000000000004},"last":0.72499999999999998}]},{"osd":2,"last update":"Fri Oct 6 01:22:32 2023","interfaces":[{"interface":"back","average":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"min":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.087,"5min":1.087,"15min":1.087},"last":0.78000000000000003},{"interface":"front","average":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":0.93100000000000005,"5min":0.93100000000000005,"15min":0.93100000000000005},"last":0.67900000000000005}]},{"osd":3,"last update":"Fri Oct 6 01:22:32 2023","interfaces":[{"interface":"back","average":{"1min":0.73699999999999999,"5min":0.73699999999999999,"15min":0.73699999999999999},"min":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":1.0189999999999999,"5min":1.0189999999999999,"15min":1.0189999999999999},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.80100000000000005,"5min":0.80100000000000005,"15min":0.80100000000000005},"min":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":1.143,"5min":1.143,"15min":1.143},"last":0.82699999999999996}]},{"osd":5,"last update":"Fri Oct 6 01:22:32 2023","interfaces":[{"interface":"back","average":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.96499999999999997,"5min":0.96499999999999997,"15min":0.96499999999999997},"last":0.63400000000000001},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"min":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":0.97999999999999998,"5min":0.97999999999999998,"15min":0.97999999999999998},"last":0.69199999999999995}]},{"osd":6,"last update":"Fri Oct 6 01:22:32 2023","interfaces":[{"interface":"back","average":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":1.1779999999999999,"5min":1.1779999999999999,"15min":1.1779999999999999},"last":0.64400000000000002},{"interface":"front","average":{"1min":0.79900000000000004,"5min":0.79900000000000004,"15min":0.79900000000000004},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":1.1379999999999999,"5min":1.1379999999999999,"15min":1.1379999999999999},"last":0.76500000000000001}]},{"osd":7,"last update":"Fri Oct 6 01:22:32 2023","interfaces":[{"interface":"back","average":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":1.0249999999999999,"5min":1.0249999999999999,"15min":1.0249999999999999},"last":0.751},{"interface":"front","average":{"1min":0.83999999999999997,"5min":0.83999999999999997,"15min":0.83999999999999997},"min":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":1.2290000000000001,"5min":1.2290000000000001,"15min":1.2290000000000001},"last":0.86199999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574870,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297716,"kb_used_data":428,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074124,"statfs":{"total":96636764160,"available":96331902976,"internally_reserved":0,"allocated":438272,"data_stored":194134,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 01:22:32 2023","interfaces":[{"interface":"back","average":{"1min":0.64900000000000002,"5min":0.64900000000000002,"15min":0.64900000000000002},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.94699999999999995,"5min":0.94699999999999995,"15min":0.94699999999999995},"last":0.60999999999999999},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.93500000000000005,"5min":0.93500000000000005,"15min":0.93500000000000005},"last":0.74199999999999999}]},{"osd":1,"last update":"Fri Oct 6 01:22:32 2023","interfaces":[{"interface":"back","average":{"1min":0.628,"5min":0.628,"15min":0.628},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":1.028,"5min":1.028,"15min":1.028},"last":0.86199999999999999},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":1.1000000000000001,"5min":1.1000000000000001,"15min":1.1000000000000001},"last":1.103}]},{"osd":2,"last update":"Fri Oct 6 01:22:32 2023","interfaces":[{"interface":"back","average":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":0.98499999999999999,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.95699999999999996},{"interface":"front","average":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":1.0229999999999999,"5min":1.0229999999999999,"15min":1.0229999999999999},"last":0.80000000000000004}]},{"osd":3,"last update":"Fri Oct 6 01:22:32 2023","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.96999999999999997,"5min":0.96999999999999997,"15min":0.96999999999999997},"last":0.84099999999999997},{"interface":"front","average":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"min":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"max":{"1min":1.6419999999999999,"5min":1.6419999999999999,"15min":1.6419999999999999},"last":1.04}]},{"osd":4,"last update":"Fri Oct 6 01:22:32 2023","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":1.0389999999999999,"5min":1.0389999999999999,"15min":1.0389999999999999},"last":0.71499999999999997},{"interface":"front","average":{"1min":0.65900000000000003,"5min":0.65900000000000003,"15min":0.65900000000000003},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":1.024,"5min":1.024,"15min":1.024},"last":0.93500000000000005}]},{"osd":6,"last update":"Fri Oct 6 01:22:32 2023","interfaces":[{"interface":"back","average":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":1.091,"5min":1.091,"15min":1.091},"last":1.131},{"interface":"front","average":{"1min":0.68899999999999995,"5min":0.68899999999999995,"15min":0.68899999999999995},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":1.0580000000000001,"5min":1.0580000000000001,"15min":1.0580000000000001},"last":1.02}]},{"osd":7,"last update":"Fri Oct 6 01:22:32 2023","interfaces":[{"interface":"back","average":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":1.0660000000000001,"5min":1.0660000000000001,"15min":1.0660000000000001},"last":0.98999999999999999},{"interface":"front","average":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.83599999999999997},"min":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":1.1950000000000001,"5min":1.1950000000000001,"15min":1.1950000000000001},"last":1.198}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":610,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":644,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-06T01:23:01.303 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-06T01:23:01.522 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:01.521+0000 7f298cb9d700 1 Processor -- start 2023-10-06T01:23:01.522 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:01.521+0000 7f298cb9d700 1 -- start start 2023-10-06T01:23:01.524 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:01.522+0000 7f298cb9d700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f298806a5d0 0x7f2988153730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:23:01.524 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:01.522+0000 7f298cb9d700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f298806a9a0 0x7f2988153c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:23:01.524 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:01.523+0000 7f298cb9d700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f29880c9d00 con 0x7f298806df90 2023-10-06T01:23:01.524 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:01.523+0000 7f298cb9d700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f298806f5a0 con 0x7f298806a9a0 2023-10-06T01:23:01.524 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:01.523+0000 7f298cb9d700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f298806eb00 con 0x7f298806a5d0 2023-10-06T01:23:01.524 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:01.523+0000 7f2987fff700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f298806df90 0x7f298806e3f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:51822/0 (socket says 172.21.15.50:51822) 2023-10-06T01:23:01.524 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:01.523+0000 7f2987fff700 1 -- 172.21.15.50:0/3881027628 learned_addr learned my addr 172.21.15.50:0/3881027628 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-10-06T01:23:01.524 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:01.523+0000 7f29877fe700 1 --2- 172.21.15.50:0/3881027628 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f298806a5d0 0x7f2988153730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:23:01.524 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:01.523+0000 7f2986ffd700 1 --2- 172.21.15.50:0/3881027628 >> v2:172.21.15.155:3300/0 conn(0x7f298806a9a0 0x7f2988153c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:23:01.526 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:01.523+0000 7f29867fc700 1 -- 172.21.15.50:0/3881027628 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2788261159 0 0) 0x7f29880c9d00 con 0x7f298806df90 2023-10-06T01:23:01.526 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:01.523+0000 7f29867fc700 1 -- 172.21.15.50:0/3881027628 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2970003570 con 0x7f298806df90 2023-10-06T01:23:01.526 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:01.523+0000 7f29877fe700 1 -- 172.21.15.50:0/3881027628 >> v2:172.21.15.155:3300/0 conn(0x7f298806a9a0 msgr2=0x7f2988153c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:23:01.526 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:01.523+0000 7f29877fe700 1 --2- 172.21.15.50:0/3881027628 >> v2:172.21.15.155:3300/0 conn(0x7f298806a9a0 0x7f2988153c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:23:01.526 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:01.524+0000 7f29877fe700 1 -- 172.21.15.50:0/3881027628 >> v1:172.21.15.50:6789/0 conn(0x7f298806df90 legacy=0x7f298806e3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:23:01.527 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:01.524+0000 7f29877fe700 1 -- 172.21.15.50:0/3881027628 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29880c6750 con 0x7f298806a5d0 2023-10-06T01:23:01.527 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:01.524+0000 7f2986ffd700 1 --2- 172.21.15.50:0/3881027628 >> v2:172.21.15.155:3300/0 conn(0x7f298806a9a0 0x7f2988153c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T01:23:01.527 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:01.524+0000 7f29877fe700 1 --2- 172.21.15.50:0/3881027628 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f298806a5d0 0x7f2988153730 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f29780098e0 tx=0x7f29780091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c884605cb3968e68 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:23:01.527 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:01.524+0000 7f29867fc700 1 -- 172.21.15.50:0/3881027628 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2978011630 con 0x7f298806a5d0 2023-10-06T01:23:01.527 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:01.524+0000 7f29867fc700 1 -- 172.21.15.50:0/3881027628 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2978011790 con 0x7f298806a5d0 2023-10-06T01:23:01.527 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:01.524+0000 7f29867fc700 1 -- 172.21.15.50:0/3881027628 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2978011b30 con 0x7f298806a5d0 2023-10-06T01:23:01.527 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:01.525+0000 7f298cb9d700 1 -- 172.21.15.50:0/3881027628 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f298806a5d0 msgr2=0x7f2988153730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:23:01.527 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:01.525+0000 7f298cb9d700 1 --2- 172.21.15.50:0/3881027628 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f298806a5d0 0x7f2988153730 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f29780098e0 tx=0x7f29780091a0 comp rx=0 tx=0).stop 2023-10-06T01:23:01.528 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:01.525+0000 7f298cb9d700 1 -- 172.21.15.50:0/3881027628 shutdown_connections 2023-10-06T01:23:01.528 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:01.525+0000 7f298cb9d700 1 --2- 172.21.15.50:0/3881027628 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f298806a5d0 0x7f2988153730 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:23:01.528 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:01.525+0000 7f298cb9d700 1 --2- 172.21.15.50:0/3881027628 >> v2:172.21.15.155:3300/0 conn(0x7f298806a9a0 0x7f2988153c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:23:01.528 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:01.525+0000 7f298cb9d700 1 -- 172.21.15.50:0/3881027628 >> 172.21.15.50:0/3881027628 conn(0x7f29880680c0 msgr2=0x7f29880cbf00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:23:01.528 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:01.525+0000 7f298cb9d700 1 -- 172.21.15.50:0/3881027628 shutdown_connections 2023-10-06T01:23:01.528 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:01.525+0000 7f298cb9d700 1 -- 172.21.15.50:0/3881027628 wait complete. 2023-10-06T01:23:01.530 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:01.526+0000 7f298cb9d700 1 Processor -- start 2023-10-06T01:23:01.530 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:01.526+0000 7f298cb9d700 1 -- start start 2023-10-06T01:23:01.533 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:01.527+0000 7f298cb9d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f298806a5d0 0x7f2988169130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:23:01.533 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:01.527+0000 7f298cb9d700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f298806a9a0 0x7f298816cf10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:23:01.533 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:01.527+0000 7f298cb9d700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f298806df90 0x7f29880c2040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:23:01.533 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:01.527+0000 7f298cb9d700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29880afd20 con 0x7f298806a5d0 2023-10-06T01:23:01.533 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:01.527+0000 7f298cb9d700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f298816d8b0 con 0x7f298806a9a0 2023-10-06T01:23:01.533 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:01.527+0000 7f298cb9d700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f298816db90 con 0x7f298806df90 2023-10-06T01:23:01.534 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:01.527+0000 7f29877fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f298806a5d0 0x7f2988169130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:23:01.534 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:01.527+0000 7f29877fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f298806a5d0 0x7f2988169130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:53818/0 (socket says 172.21.15.50:53818) 2023-10-06T01:23:01.534 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:01.527+0000 7f29877fe700 1 -- 172.21.15.50:0/3751036187 learned_addr learned my addr 172.21.15.50:0/3751036187 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-06T01:23:01.534 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:01.528+0000 7f2987fff700 1 --2- 172.21.15.50:0/3751036187 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f298806df90 0x7f29880c2040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:23:01.534 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:01.528+0000 7f2986ffd700 1 --2- 172.21.15.50:0/3751036187 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f298806a9a0 0x7f298816cf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:23:01.534 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:01.528+0000 7f29877fe700 1 -- 172.21.15.50:0/3751036187 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f298806df90 msgr2=0x7f29880c2040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:23:01.534 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:01.528+0000 7f29877fe700 1 --2- 172.21.15.50:0/3751036187 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f298806df90 0x7f29880c2040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:23:01.534 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:01.528+0000 7f29877fe700 1 -- 172.21.15.50:0/3751036187 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f298806a9a0 msgr2=0x7f298816cf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:23:01.534 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:01.528+0000 7f29877fe700 1 --2- 172.21.15.50:0/3751036187 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f298806a9a0 0x7f298816cf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:23:01.534 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:01.528+0000 7f29877fe700 1 -- 172.21.15.50:0/3751036187 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f297c00ba20 con 0x7f298806a5d0 2023-10-06T01:23:01.534 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:01.528+0000 7f29877fe700 1 --2- 172.21.15.50:0/3751036187 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f298806a5d0 0x7f2988169130 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f2978009ed0 tx=0x7f2978017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:23:01.535 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:01.528+0000 7f296f7fe700 1 -- 172.21.15.50:0/3751036187 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2978000d10 con 0x7f298806a5d0 2023-10-06T01:23:01.535 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:01.528+0000 7f296f7fe700 1 -- 172.21.15.50:0/3751036187 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2978011b10 con 0x7f298806a5d0 2023-10-06T01:23:01.535 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:01.528+0000 7f296f7fe700 1 -- 172.21.15.50:0/3751036187 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2978025660 con 0x7f298806a5d0 2023-10-06T01:23:01.535 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:01.529+0000 7f298cb9d700 1 -- 172.21.15.50:0/3751036187 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2978009420 con 0x7f298806a5d0 2023-10-06T01:23:01.535 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:01.529+0000 7f298cb9d700 1 -- 172.21.15.50:0/3751036187 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2988169670 con 0x7f298806a5d0 2023-10-06T01:23:01.535 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:01.530+0000 7f298cb9d700 1 -- 172.21.15.50:0/3751036187 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f29880af810 con 0x7f298806a5d0 2023-10-06T01:23:01.536 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:01.530+0000 7f296f7fe700 1 -- 172.21.15.50:0/3751036187 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f2978025a50 con 0x7f298806a5d0 2023-10-06T01:23:01.536 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:01.532+0000 7f296f7fe700 1 --2- 172.21.15.50:0/3751036187 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f2974066f30 0x7f29740693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:23:01.536 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:01.532+0000 7f296f7fe700 1 -- 172.21.15.50:0/3751036187 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f2978085ff0 con 0x7f298806a5d0 2023-10-06T01:23:01.536 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:01.532+0000 7f2986ffd700 1 --2- 172.21.15.50:0/3751036187 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f2974066f30 0x7f29740693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:23:01.536 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:01.533+0000 7f2986ffd700 1 --2- 172.21.15.50:0/3751036187 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f2974066f30 0x7f29740693e0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f297c00b9f0 tx=0x7f297c00b780 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:23:01.537 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:01.536+0000 7f296f7fe700 1 -- 172.21.15.50:0/3751036187 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f29780b75a0 con 0x7f298806a5d0 2023-10-06T01:23:01.734 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:01.733+0000 7f298cb9d700 1 -- 172.21.15.50:0/3751036187 --> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f29880afe60 con 0x7f2974066f30 2023-10-06T01:23:01.743 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:01.742+0000 7f296f7fe700 1 -- 172.21.15.50:0/3751036187 <== mgr.4099 v2:172.21.15.155:6832/85215 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+311360 (secure 0 0 0) 0x7f297c0088f0 con 0x7f2974066f30 2023-10-06T01:23:01.747 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-10-06T01:23:01.749 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:01.746+0000 7f298cb9d700 1 -- 172.21.15.50:0/3751036187 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f2974066f30 msgr2=0x7f29740693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:23:01.749 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:01.746+0000 7f298cb9d700 1 --2- 172.21.15.50:0/3751036187 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f2974066f30 0x7f29740693e0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f297c00b9f0 tx=0x7f297c00b780 comp rx=0 tx=0).stop 2023-10-06T01:23:01.750 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:01.746+0000 7f298cb9d700 1 -- 172.21.15.50:0/3751036187 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f298806a5d0 msgr2=0x7f2988169130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:23:01.750 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:01.746+0000 7f298cb9d700 1 --2- 172.21.15.50:0/3751036187 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f298806a5d0 0x7f2988169130 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f2978009ed0 tx=0x7f2978017000 comp rx=0 tx=0).stop 2023-10-06T01:23:01.750 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:01.746+0000 7f298cb9d700 1 -- 172.21.15.50:0/3751036187 shutdown_connections 2023-10-06T01:23:01.750 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:01.746+0000 7f298cb9d700 1 --2- 172.21.15.50:0/3751036187 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f298806df90 0x7f29880c2040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:23:01.750 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:01.746+0000 7f298cb9d700 1 --2- 172.21.15.50:0/3751036187 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f298806a5d0 0x7f2988169130 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:23:01.750 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:01.746+0000 7f298cb9d700 1 --2- 172.21.15.50:0/3751036187 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f2974066f30 0x7f29740693e0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:23:01.750 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:01.746+0000 7f298cb9d700 1 --2- 172.21.15.50:0/3751036187 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f298806a9a0 0x7f298816cf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:23:01.750 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:01.746+0000 7f298cb9d700 1 -- 172.21.15.50:0/3751036187 >> 172.21.15.50:0/3751036187 conn(0x7f29880680c0 msgr2=0x7f2988147ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:23:01.750 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:01.746+0000 7f298cb9d700 1 -- 172.21.15.50:0/3751036187 shutdown_connections 2023-10-06T01:23:01.750 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:01.746+0000 7f298cb9d700 1 -- 172.21.15.50:0/3751036187 wait complete. 2023-10-06T01:23:01.751 INFO:teuthology.orchestra.run.smithi050.stderr:dumped all 2023-10-06T01:23:01.765 INFO:teuthology.orchestra.run.smithi050.stdout:{"pg_ready":true,"pg_map":{"version":78,"stamp":"2023-10-06T01:22:59.791139+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":206,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2399372,"kb_used_data":4684,"kb_used_omap":0,"kb_used_meta":2394624,"kb_avail":752575348,"statfs":{"total":773094113280,"available":770637156352,"internally_reserved":0,"allocated":4796416,"data_stored":2770594,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2452094976},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":27,"apply_latency_ms":27,"commit_latency_ns":27000000,"apply_latency_ns":27000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.882100"},"pg_stats":[{"pgid":"7.3f","version":"0'0","reported_seq":8,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-06T01:22:56.849083+0000","last_change":"2023-10-06T01:22:56.849083+0000","last_active":"2023-10-06T01:22:56.849083+0000","last_peered":"2023-10-06T01:22:56.849083+0000","last_clean":"2023-10-06T01:22:56.849083+0000","last_became_active":"2023-10-06T01:22:56.848821+0000","last_became_peered":"2023-10-06T01:22:56.848821+0000","last_unstale":"2023-10-06T01:22:56.849083+0000","last_undegraded":"2023-10-06T01:22:56.849083+0000","last_fullsized":"2023-10-06T01:22:56.849083+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:22:55.908368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:22:55.908368+0000","last_clean_scrub_stamp":"2023-10-06T01:22:55.908368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:01:10.322200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3e","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-06T01:22:56.854780+0000","last_change":"2023-10-06T01:22:56.850163+0000","last_active":"2023-10-06T01:22:56.854780+0000","last_peered":"2023-10-06T01:22:56.854780+0000","last_clean":"2023-10-06T01:22:56.854780+0000","last_became_active":"2023-10-06T01:22:56.849861+0000","last_became_peered":"2023-10-06T01:22:56.849861+0000","last_unstale":"2023-10-06T01:22:56.854780+0000","last_undegraded":"2023-10-06T01:22:56.854780+0000","last_fullsized":"2023-10-06T01:22:56.854780+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:22:55.908368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:22:55.908368+0000","last_clean_scrub_stamp":"2023-10-06T01:22:55.908368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:53:56.829612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3d","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-06T01:22:56.851845+0000","last_change":"2023-10-06T01:22:56.847772+0000","last_active":"2023-10-06T01:22:56.851845+0000","last_peered":"2023-10-06T01:22:56.851845+0000","last_clean":"2023-10-06T01:22:56.851845+0000","last_became_active":"2023-10-06T01:22:56.847485+0000","last_became_peered":"2023-10-06T01:22:56.847485+0000","last_unstale":"2023-10-06T01:22:56.851845+0000","last_undegraded":"2023-10-06T01:22:56.851845+0000","last_fullsized":"2023-10-06T01:22:56.851845+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:22:55.908368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:22:55.908368+0000","last_clean_scrub_stamp":"2023-10-06T01:22:55.908368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:06:45.219470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3c","version":"0'0","reported_seq":8,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-06T01:22:56.853172+0000","last_change":"2023-10-06T01:22:56.853172+0000","last_active":"2023-10-06T01:22:56.853172+0000","last_peered":"2023-10-06T01:22:56.853172+0000","last_clean":"2023-10-06T01:22:56.853172+0000","last_became_active":"2023-10-06T01:22:56.852861+0000","last_became_peered":"2023-10-06T01:22:56.852861+0000","last_unstale":"2023-10-06T01:22:56.853172+0000","last_undegraded":"2023-10-06T01:22:56.853172+0000","last_fullsized":"2023-10-06T01:22:56.853172+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:22:55.908368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:22:55.908368+0000","last_clean_scrub_stamp":"2023-10-06T01:22:55.908368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:07:52.525128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3b","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-06T01:22:56.854742+0000","last_change":"2023-10-06T01:22:56.848726+0000","last_active":"2023-10-06T01:22:56.854742+0000","last_peered":"2023-10-06T01:22:56.854742+0000","last_clean":"2023-10-06T01:22:56.854742+0000","last_became_active":"2023-10-06T01:22:56.848449+0000","last_became_peered":"2023-10-06T01:22:56.848449+0000","last_unstale":"2023-10-06T01:22:56.854742+0000","last_undegraded":"2023-10-06T01:22:56.854742+0000","last_fullsized":"2023-10-06T01:22:56.854742+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:22:55.908368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:22:55.908368+0000","last_clean_scrub_stamp":"2023-10-06T01:22:55.908368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:25:51.642335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3a","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-06T01:22:56.848309+0000","last_change":"2023-10-06T01:22:56.843022+0000","last_active":"2023-10-06T01:22:56.848309+0000","last_peered":"2023-10-06T01:22:56.848309+0000","last_clean":"2023-10-06T01:22:56.848309+0000","last_became_active":"2023-10-06T01:22:56.842774+0000","last_became_peered":"2023-10-06T01:22:56.842774+0000","last_unstale":"2023-10-06T01:22:56.848309+0000","last_undegraded":"2023-10-06T01:22:56.848309+0000","last_fullsized":"2023-10-06T01:22:56.848309+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:22:55.908368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:22:55.908368+0000","last_clean_scrub_stamp":"2023-10-06T01:22:55.908368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:18:50.037609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.39","version":"0'0","reported_seq":8,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-06T01:22:56.855214+0000","last_change":"2023-10-06T01:22:56.855214+0000","last_active":"2023-10-06T01:22:56.855214+0000","last_peered":"2023-10-06T01:22:56.855214+0000","last_clean":"2023-10-06T01:22:56.855214+0000","last_became_active":"2023-10-06T01:22:56.853390+0000","last_became_peered":"2023-10-06T01:22:56.853390+0000","last_unstale":"2023-10-06T01:22:56.855214+0000","last_undegraded":"2023-10-06T01:22:56.855214+0000","last_fullsized":"2023-10-06T01:22:56.855214+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:22:55.908368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:22:55.908368+0000","last_clean_scrub_stamp":"2023-10-06T01:22:55.908368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:55:35.329247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.38","version":"0'0","reported_seq":8,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-06T01:22:56.851791+0000","last_change":"2023-10-06T01:22:56.851791+0000","last_active":"2023-10-06T01:22:56.851791+0000","last_peered":"2023-10-06T01:22:56.851791+0000","last_clean":"2023-10-06T01:22:56.851791+0000","last_became_active":"2023-10-06T01:22:56.851529+0000","last_became_peered":"2023-10-06T01:22:56.851529+0000","last_unstale":"2023-10-06T01:22:56.851791+0000","last_undegraded":"2023-10-06T01:22:56.851791+0000","last_fullsized":"2023-10-06T01:22:56.851791+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:22:55.908368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:22:55.908368+0000","last_clean_scrub_stamp":"2023-10-06T01:22:55.908368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:56:38.604493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.37","version":"0'0","reported_seq":8,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-06T01:22:56.849144+0000","last_change":"2023-10-06T01:22:56.849144+0000","last_active":"2023-10-06T01:22:56.849144+0000","last_peered":"2023-10-06T01:22:56.849144+0000","last_clean":"2023-10-06T01:22:56.849144+0000","last_became_active":"2023-10-06T01:22:56.848911+0000","last_became_peered":"2023-10-06T01:22:56.848911+0000","last_unstale":"2023-10-06T01:22:56.849144+0000","last_undegraded":"2023-10-06T01:22:56.849144+0000","last_fullsized":"2023-10-06T01:22:56.849144+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:22:55.908368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:22:55.908368+0000","last_clean_scrub_stamp":"2023-10-06T01:22:55.908368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:25:50.057545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.36","version":"0'0","reported_seq":8,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-06T01:22:56.854015+0000","last_change":"2023-10-06T01:22:56.854015+0000","last_active":"2023-10-06T01:22:56.854015+0000","last_peered":"2023-10-06T01:22:56.854015+0000","last_clean":"2023-10-06T01:22:56.854015+0000","last_became_active":"2023-10-06T01:22:56.853761+0000","last_became_peered":"2023-10-06T01:22:56.853761+0000","last_unstale":"2023-10-06T01:22:56.854015+0000","last_undegraded":"2023-10-06T01:22:56.854015+0000","last_fullsized":"2023-10-06T01:22:56.854015+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:22:55.908368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:22:55.908368+0000","last_clean_scrub_stamp":"2023-10-06T01:22:55.908368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:15:20.271419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.35","version":"0'0","reported_seq":8,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-06T01:22:56.855284+0000","last_change":"2023-10-06T01:22:56.855284+0000","last_active":"2023-10-06T01:22:56.855284+0000","last_peered":"2023-10-06T01:22:56.855284+0000","last_clean":"2023-10-06T01:22:56.855284+0000","last_became_active":"2023-10-06T01:22:56.855043+0000","last_became_peered":"2023-10-06T01:22:56.855043+0000","last_unstale":"2023-10-06T01:22:56.855284+0000","last_undegraded":"2023-10-06T01:22:56.855284+0000","last_fullsized":"2023-10-06T01:22:56.855284+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:22:55.908368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:22:55.908368+0000","last_clean_scrub_stamp":"2023-10-06T01:22:55.908368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:37:47.029243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.34","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-06T01:22:56.849048+0000","last_change":"2023-10-06T01:22:56.840367+0000","last_active":"2023-10-06T01:22:56.849048+0000","last_peered":"2023-10-06T01:22:56.849048+0000","last_clean":"2023-10-06T01:22:56.849048+0000","last_became_active":"2023-10-06T01:22:56.840019+0000","last_became_peered":"2023-10-06T01:22:56.840019+0000","last_unstale":"2023-10-06T01:22:56.849048+0000","last_undegraded":"2023-10-06T01:22:56.849048+0000","last_fullsized":"2023-10-06T01:22:56.849048+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:22:55.908368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:22:55.908368+0000","last_clean_scrub_stamp":"2023-10-06T01:22:55.908368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:03:24.636246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.33","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-06T01:22:56.858406+0000","last_change":"2023-10-06T01:22:56.853967+0000","last_active":"2023-10-06T01:22:56.858406+0000","last_peered":"2023-10-06T01:22:56.858406+0000","last_clean":"2023-10-06T01:22:56.858406+0000","last_became_active":"2023-10-06T01:22:56.853665+0000","last_became_peered":"2023-10-06T01:22:56.853665+0000","last_unstale":"2023-10-06T01:22:56.858406+0000","last_undegraded":"2023-10-06T01:22:56.858406+0000","last_fullsized":"2023-10-06T01:22:56.858406+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:22:55.908368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:22:55.908368+0000","last_clean_scrub_stamp":"2023-10-06T01:22:55.908368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:08:58.050013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.32","version":"0'0","reported_seq":8,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-06T01:22:56.855330+0000","last_change":"2023-10-06T01:22:56.855330+0000","last_active":"2023-10-06T01:22:56.855330+0000","last_peered":"2023-10-06T01:22:56.855330+0000","last_clean":"2023-10-06T01:22:56.855330+0000","last_became_active":"2023-10-06T01:22:56.855095+0000","last_became_peered":"2023-10-06T01:22:56.855095+0000","last_unstale":"2023-10-06T01:22:56.855330+0000","last_undegraded":"2023-10-06T01:22:56.855330+0000","last_fullsized":"2023-10-06T01:22:56.855330+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:22:55.908368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:22:55.908368+0000","last_clean_scrub_stamp":"2023-10-06T01:22:55.908368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:18:50.037609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.31","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-06T01:22:56.854026+0000","last_change":"2023-10-06T01:22:56.848287+0000","last_active":"2023-10-06T01:22:56.854026+0000","last_peered":"2023-10-06T01:22:56.854026+0000","last_clean":"2023-10-06T01:22:56.854026+0000","last_became_active":"2023-10-06T01:22:56.847994+0000","last_became_peered":"2023-10-06T01:22:56.847994+0000","last_unstale":"2023-10-06T01:22:56.854026+0000","last_undegraded":"2023-10-06T01:22:56.854026+0000","last_fullsized":"2023-10-06T01:22:56.854026+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:22:55.908368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:22:55.908368+0000","last_clean_scrub_stamp":"2023-10-06T01:22:55.908368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:55:32.218597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.30","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-06T01:22:56.855020+0000","last_change":"2023-10-06T01:22:56.849894+0000","last_active":"2023-10-06T01:22:56.855020+0000","last_peered":"2023-10-06T01:22:56.855020+0000","last_clean":"2023-10-06T01:22:56.855020+0000","last_became_active":"2023-10-06T01:22:56.849643+0000","last_became_peered":"2023-10-06T01:22:56.849643+0000","last_unstale":"2023-10-06T01:22:56.855020+0000","last_undegraded":"2023-10-06T01:22:56.855020+0000","last_fullsized":"2023-10-06T01:22:56.855020+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:22:55.908368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:22:55.908368+0000","last_clean_scrub_stamp":"2023-10-06T01:22:55.908368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:51:41.788130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2f","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-06T01:22:56.856528+0000","last_change":"2023-10-06T01:22:56.854123+0000","last_active":"2023-10-06T01:22:56.856528+0000","last_peered":"2023-10-06T01:22:56.856528+0000","last_clean":"2023-10-06T01:22:56.856528+0000","last_became_active":"2023-10-06T01:22:56.853787+0000","last_became_peered":"2023-10-06T01:22:56.853787+0000","last_unstale":"2023-10-06T01:22:56.856528+0000","last_undegraded":"2023-10-06T01:22:56.856528+0000","last_fullsized":"2023-10-06T01:22:56.856528+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:22:55.908368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:22:55.908368+0000","last_clean_scrub_stamp":"2023-10-06T01:22:55.908368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:18:50.037609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2e","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-06T01:22:56.861138+0000","last_change":"2023-10-06T01:22:56.858937+0000","last_active":"2023-10-06T01:22:56.861138+0000","last_peered":"2023-10-06T01:22:56.861138+0000","last_clean":"2023-10-06T01:22:56.861138+0000","last_became_active":"2023-10-06T01:22:56.858576+0000","last_became_peered":"2023-10-06T01:22:56.858576+0000","last_unstale":"2023-10-06T01:22:56.861138+0000","last_undegraded":"2023-10-06T01:22:56.861138+0000","last_fullsized":"2023-10-06T01:22:56.861138+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:22:55.908368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:22:55.908368+0000","last_clean_scrub_stamp":"2023-10-06T01:22:55.908368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:56:38.604493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2d","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-06T01:22:56.853214+0000","last_change":"2023-10-06T01:22:56.847999+0000","last_active":"2023-10-06T01:22:56.853214+0000","last_peered":"2023-10-06T01:22:56.853214+0000","last_clean":"2023-10-06T01:22:56.853214+0000","last_became_active":"2023-10-06T01:22:56.847691+0000","last_became_peered":"2023-10-06T01:22:56.847691+0000","last_unstale":"2023-10-06T01:22:56.853214+0000","last_undegraded":"2023-10-06T01:22:56.853214+0000","last_fullsized":"2023-10-06T01:22:56.853214+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:22:55.908368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:22:55.908368+0000","last_clean_scrub_stamp":"2023-10-06T01:22:55.908368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:08:58.050013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2c","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-06T01:22:56.846561+0000","last_change":"2023-10-06T01:22:56.845633+0000","last_active":"2023-10-06T01:22:56.846561+0000","last_peered":"2023-10-06T01:22:56.846561+0000","last_clean":"2023-10-06T01:22:56.846561+0000","last_became_active":"2023-10-06T01:22:56.845341+0000","last_became_peered":"2023-10-06T01:22:56.845341+0000","last_unstale":"2023-10-06T01:22:56.846561+0000","last_undegraded":"2023-10-06T01:22:56.846561+0000","last_fullsized":"2023-10-06T01:22:56.846561+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:22:55.908368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:22:55.908368+0000","last_clean_scrub_stamp":"2023-10-06T01:22:55.908368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:03:58.916755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2b","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-06T01:22:56.857962+0000","last_change":"2023-10-06T01:22:56.852933+0000","last_active":"2023-10-06T01:22:56.857962+0000","last_peered":"2023-10-06T01:22:56.857962+0000","last_clean":"2023-10-06T01:22:56.857962+0000","last_became_active":"2023-10-06T01:22:56.852533+0000","last_became_peered":"2023-10-06T01:22:56.852533+0000","last_unstale":"2023-10-06T01:22:56.857962+0000","last_undegraded":"2023-10-06T01:22:56.857962+0000","last_fullsized":"2023-10-06T01:22:56.857962+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:22:55.908368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:22:55.908368+0000","last_clean_scrub_stamp":"2023-10-06T01:22:55.908368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:37:59.339689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.2a","version":"0'0","reported_seq":8,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-06T01:22:56.851077+0000","last_change":"2023-10-06T01:22:56.851077+0000","last_active":"2023-10-06T01:22:56.851077+0000","last_peered":"2023-10-06T01:22:56.851077+0000","last_clean":"2023-10-06T01:22:56.851077+0000","last_became_active":"2023-10-06T01:22:56.850792+0000","last_became_peered":"2023-10-06T01:22:56.850792+0000","last_unstale":"2023-10-06T01:22:56.851077+0000","last_undegraded":"2023-10-06T01:22:56.851077+0000","last_fullsized":"2023-10-06T01:22:56.851077+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:22:55.908368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:22:55.908368+0000","last_clean_scrub_stamp":"2023-10-06T01:22:55.908368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:42:29.916205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.29","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-06T01:22:56.849105+0000","last_change":"2023-10-06T01:22:56.845329+0000","last_active":"2023-10-06T01:22:56.849105+0000","last_peered":"2023-10-06T01:22:56.849105+0000","last_clean":"2023-10-06T01:22:56.849105+0000","last_became_active":"2023-10-06T01:22:56.844846+0000","last_became_peered":"2023-10-06T01:22:56.844846+0000","last_unstale":"2023-10-06T01:22:56.849105+0000","last_undegraded":"2023-10-06T01:22:56.849105+0000","last_fullsized":"2023-10-06T01:22:56.849105+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:22:55.908368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:22:55.908368+0000","last_clean_scrub_stamp":"2023-10-06T01:22:55.908368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:25:18.654795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.28","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-06T01:22:56.850061+0000","last_change":"2023-10-06T01:22:56.843914+0000","last_active":"2023-10-06T01:22:56.850061+0000","last_peered":"2023-10-06T01:22:56.850061+0000","last_clean":"2023-10-06T01:22:56.850061+0000","last_became_active":"2023-10-06T01:22:56.843662+0000","last_became_peered":"2023-10-06T01:22:56.843662+0000","last_unstale":"2023-10-06T01:22:56.850061+0000","last_undegraded":"2023-10-06T01:22:56.850061+0000","last_fullsized":"2023-10-06T01:22:56.850061+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:22:55.908368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:22:55.908368+0000","last_clean_scrub_stamp":"2023-10-06T01:22:55.908368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:23:28.916695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.27","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-06T01:22:56.855367+0000","last_change":"2023-10-06T01:22:56.851243+0000","last_active":"2023-10-06T01:22:56.855367+0000","last_peered":"2023-10-06T01:22:56.855367+0000","last_clean":"2023-10-06T01:22:56.855367+0000","last_became_active":"2023-10-06T01:22:56.850958+0000","last_became_peered":"2023-10-06T01:22:56.850958+0000","last_unstale":"2023-10-06T01:22:56.855367+0000","last_undegraded":"2023-10-06T01:22:56.855367+0000","last_fullsized":"2023-10-06T01:22:56.855367+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:22:55.908368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:22:55.908368+0000","last_clean_scrub_stamp":"2023-10-06T01:22:55.908368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:42:43.961190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.26","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-06T01:22:56.847063+0000","last_change":"2023-10-06T01:22:56.841949+0000","last_active":"2023-10-06T01:22:56.847063+0000","last_peered":"2023-10-06T01:22:56.847063+0000","last_clean":"2023-10-06T01:22:56.847063+0000","last_became_active":"2023-10-06T01:22:56.841487+0000","last_became_peered":"2023-10-06T01:22:56.841487+0000","last_unstale":"2023-10-06T01:22:56.847063+0000","last_undegraded":"2023-10-06T01:22:56.847063+0000","last_fullsized":"2023-10-06T01:22:56.847063+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:22:55.908368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:22:55.908368+0000","last_clean_scrub_stamp":"2023-10-06T01:22:55.908368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:00:44.475252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.25","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-06T01:22:56.861083+0000","last_change":"2023-10-06T01:22:56.856843+0000","last_active":"2023-10-06T01:22:56.861083+0000","last_peered":"2023-10-06T01:22:56.861083+0000","last_clean":"2023-10-06T01:22:56.861083+0000","last_became_active":"2023-10-06T01:22:56.856521+0000","last_became_peered":"2023-10-06T01:22:56.856521+0000","last_unstale":"2023-10-06T01:22:56.861083+0000","last_undegraded":"2023-10-06T01:22:56.861083+0000","last_fullsized":"2023-10-06T01:22:56.861083+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:22:55.908368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:22:55.908368+0000","last_clean_scrub_stamp":"2023-10-06T01:22:55.908368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:30:04.146182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.24","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-06T01:22:56.854828+0000","last_change":"2023-10-06T01:22:56.847316+0000","last_active":"2023-10-06T01:22:56.854828+0000","last_peered":"2023-10-06T01:22:56.854828+0000","last_clean":"2023-10-06T01:22:56.854828+0000","last_became_active":"2023-10-06T01:22:56.846448+0000","last_became_peered":"2023-10-06T01:22:56.846448+0000","last_unstale":"2023-10-06T01:22:56.854828+0000","last_undegraded":"2023-10-06T01:22:56.854828+0000","last_fullsized":"2023-10-06T01:22:56.854828+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:22:55.908368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:22:55.908368+0000","last_clean_scrub_stamp":"2023-10-06T01:22:55.908368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:25:17.049218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.23","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-06T01:22:56.857113+0000","last_change":"2023-10-06T01:22:56.851314+0000","last_active":"2023-10-06T01:22:56.857113+0000","last_peered":"2023-10-06T01:22:56.857113+0000","last_clean":"2023-10-06T01:22:56.857113+0000","last_became_active":"2023-10-06T01:22:56.851049+0000","last_became_peered":"2023-10-06T01:22:56.851049+0000","last_unstale":"2023-10-06T01:22:56.857113+0000","last_undegraded":"2023-10-06T01:22:56.857113+0000","last_fullsized":"2023-10-06T01:22:56.857113+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:22:55.908368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:22:55.908368+0000","last_clean_scrub_stamp":"2023-10-06T01:22:55.908368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:07:21.358973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.22","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-06T01:22:56.856496+0000","last_change":"2023-10-06T01:22:56.854244+0000","last_active":"2023-10-06T01:22:56.856496+0000","last_peered":"2023-10-06T01:22:56.856496+0000","last_clean":"2023-10-06T01:22:56.856496+0000","last_became_active":"2023-10-06T01:22:56.853956+0000","last_became_peered":"2023-10-06T01:22:56.853956+0000","last_unstale":"2023-10-06T01:22:56.856496+0000","last_undegraded":"2023-10-06T01:22:56.856496+0000","last_fullsized":"2023-10-06T01:22:56.856496+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:22:55.908368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:22:55.908368+0000","last_clean_scrub_stamp":"2023-10-06T01:22:55.908368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:51:57.198044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.21","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-06T01:22:56.839899+0000","last_change":"2023-10-06T01:22:56.836978+0000","last_active":"2023-10-06T01:22:56.839899+0000","last_peered":"2023-10-06T01:22:56.839899+0000","last_clean":"2023-10-06T01:22:56.839899+0000","last_became_active":"2023-10-06T01:22:56.836654+0000","last_became_peered":"2023-10-06T01:22:56.836654+0000","last_unstale":"2023-10-06T01:22:56.839899+0000","last_undegraded":"2023-10-06T01:22:56.839899+0000","last_fullsized":"2023-10-06T01:22:56.839899+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:22:55.908368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:22:55.908368+0000","last_clean_scrub_stamp":"2023-10-06T01:22:55.908368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:25:50.057545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.20","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-06T01:22:56.844577+0000","last_change":"2023-10-06T01:22:56.841511+0000","last_active":"2023-10-06T01:22:56.844577+0000","last_peered":"2023-10-06T01:22:56.844577+0000","last_clean":"2023-10-06T01:22:56.844577+0000","last_became_active":"2023-10-06T01:22:56.841266+0000","last_became_peered":"2023-10-06T01:22:56.841266+0000","last_unstale":"2023-10-06T01:22:56.844577+0000","last_undegraded":"2023-10-06T01:22:56.844577+0000","last_fullsized":"2023-10-06T01:22:56.844577+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:22:55.908368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:22:55.908368+0000","last_clean_scrub_stamp":"2023-10-06T01:22:55.908368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:37:39.783131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-06T01:22:56.850943+0000","last_change":"2023-10-06T01:22:56.843877+0000","last_active":"2023-10-06T01:22:56.850943+0000","last_peered":"2023-10-06T01:22:56.850943+0000","last_clean":"2023-10-06T01:22:56.850943+0000","last_became_active":"2023-10-06T01:22:56.843529+0000","last_became_peered":"2023-10-06T01:22:56.843529+0000","last_unstale":"2023-10-06T01:22:56.850943+0000","last_undegraded":"2023-10-06T01:22:56.850943+0000","last_fullsized":"2023-10-06T01:22:56.850943+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:22:55.908368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:22:55.908368+0000","last_clean_scrub_stamp":"2023-10-06T01:22:55.908368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:00:44.475252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"38'4","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-06T01:22:56.929024+0000","last_change":"2023-10-06T01:22:55.945877+0000","last_active":"2023-10-06T01:22:56.929024+0000","last_peered":"2023-10-06T01:22:56.929024+0000","last_clean":"2023-10-06T01:22:56.929024+0000","last_became_active":"2023-10-06T01:22:55.945506+0000","last_became_peered":"2023-10-06T01:22:55.945506+0000","last_unstale":"2023-10-06T01:22:56.929024+0000","last_undegraded":"2023-10-06T01:22:56.929024+0000","last_fullsized":"2023-10-06T01:22:56.929024+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:22:54.901806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:22:54.901806+0000","last_clean_scrub_stamp":"2023-10-06T01:22:54.901806+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:26:32.058068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-06T01:22:56.855340+0000","last_change":"2023-10-06T01:22:56.851143+0000","last_active":"2023-10-06T01:22:56.855340+0000","last_peered":"2023-10-06T01:22:56.855340+0000","last_clean":"2023-10-06T01:22:56.855340+0000","last_became_active":"2023-10-06T01:22:56.850808+0000","last_became_peered":"2023-10-06T01:22:56.850808+0000","last_unstale":"2023-10-06T01:22:56.855340+0000","last_undegraded":"2023-10-06T01:22:56.855340+0000","last_fullsized":"2023-10-06T01:22:56.855340+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:22:55.908368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:22:55.908368+0000","last_clean_scrub_stamp":"2023-10-06T01:22:55.908368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:18:25.838496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1e","version":"38'1","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-06T01:22:56.931342+0000","last_change":"2023-10-06T01:22:55.941792+0000","last_active":"2023-10-06T01:22:56.931342+0000","last_peered":"2023-10-06T01:22:56.931342+0000","last_clean":"2023-10-06T01:22:56.931342+0000","last_became_active":"2023-10-06T01:22:55.941523+0000","last_became_peered":"2023-10-06T01:22:55.941523+0000","last_unstale":"2023-10-06T01:22:56.931342+0000","last_undegraded":"2023-10-06T01:22:56.931342+0000","last_fullsized":"2023-10-06T01:22:56.931342+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:22:54.901806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:22:54.901806+0000","last_clean_scrub_stamp":"2023-10-06T01:22:54.901806+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:23:51.567575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-06T01:22:56.854846+0000","last_change":"2023-10-06T01:22:56.847689+0000","last_active":"2023-10-06T01:22:56.854846+0000","last_peered":"2023-10-06T01:22:56.854846+0000","last_clean":"2023-10-06T01:22:56.854846+0000","last_became_active":"2023-10-06T01:22:56.846794+0000","last_became_peered":"2023-10-06T01:22:56.846794+0000","last_unstale":"2023-10-06T01:22:56.854846+0000","last_undegraded":"2023-10-06T01:22:56.854846+0000","last_fullsized":"2023-10-06T01:22:56.854846+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:22:55.908368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:22:55.908368+0000","last_clean_scrub_stamp":"2023-10-06T01:22:55.908368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:01:10.322200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1d","version":"38'2","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-06T01:22:56.929007+0000","last_change":"2023-10-06T01:22:55.928358+0000","last_active":"2023-10-06T01:22:56.929007+0000","last_peered":"2023-10-06T01:22:56.929007+0000","last_clean":"2023-10-06T01:22:56.929007+0000","last_became_active":"2023-10-06T01:22:55.928004+0000","last_became_peered":"2023-10-06T01:22:55.928004+0000","last_unstale":"2023-10-06T01:22:56.929007+0000","last_undegraded":"2023-10-06T01:22:56.929007+0000","last_fullsized":"2023-10-06T01:22:56.929007+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:22:54.901806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:22:54.901806+0000","last_clean_scrub_stamp":"2023-10-06T01:22:54.901806+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T01:35:12.097687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-06T01:22:56.858276+0000","last_change":"2023-10-06T01:22:56.851529+0000","last_active":"2023-10-06T01:22:56.858276+0000","last_peered":"2023-10-06T01:22:56.858276+0000","last_clean":"2023-10-06T01:22:56.858276+0000","last_became_active":"2023-10-06T01:22:56.851278+0000","last_became_peered":"2023-10-06T01:22:56.851278+0000","last_unstale":"2023-10-06T01:22:56.858276+0000","last_undegraded":"2023-10-06T01:22:56.858276+0000","last_fullsized":"2023-10-06T01:22:56.858276+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:22:55.908368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:22:55.908368+0000","last_clean_scrub_stamp":"2023-10-06T01:22:55.908368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:35:21.678412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"38'2","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-06T01:22:56.935905+0000","last_change":"2023-10-06T01:22:55.936828+0000","last_active":"2023-10-06T01:22:56.935905+0000","last_peered":"2023-10-06T01:22:56.935905+0000","last_clean":"2023-10-06T01:22:56.935905+0000","last_became_active":"2023-10-06T01:22:55.936590+0000","last_became_peered":"2023-10-06T01:22:55.936590+0000","last_unstale":"2023-10-06T01:22:56.935905+0000","last_undegraded":"2023-10-06T01:22:56.935905+0000","last_fullsized":"2023-10-06T01:22:56.935905+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:22:54.901806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:22:54.901806+0000","last_clean_scrub_stamp":"2023-10-06T01:22:54.901806+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:25:17.648232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-06T01:22:56.860580+0000","last_change":"2023-10-06T01:22:56.856186+0000","last_active":"2023-10-06T01:22:56.860580+0000","last_peered":"2023-10-06T01:22:56.860580+0000","last_clean":"2023-10-06T01:22:56.860580+0000","last_became_active":"2023-10-06T01:22:56.855921+0000","last_became_peered":"2023-10-06T01:22:56.855921+0000","last_unstale":"2023-10-06T01:22:56.860580+0000","last_undegraded":"2023-10-06T01:22:56.860580+0000","last_fullsized":"2023-10-06T01:22:56.860580+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:22:55.908368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:22:55.908368+0000","last_clean_scrub_stamp":"2023-10-06T01:22:55.908368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:15:29.318011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"38'1","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-06T01:22:56.929075+0000","last_change":"2023-10-06T01:22:55.942730+0000","last_active":"2023-10-06T01:22:56.929075+0000","last_peered":"2023-10-06T01:22:56.929075+0000","last_clean":"2023-10-06T01:22:56.929075+0000","last_became_active":"2023-10-06T01:22:55.941006+0000","last_became_peered":"2023-10-06T01:22:55.941006+0000","last_unstale":"2023-10-06T01:22:56.929075+0000","last_undegraded":"2023-10-06T01:22:56.929075+0000","last_fullsized":"2023-10-06T01:22:56.929075+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:22:54.901806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:22:54.901806+0000","last_clean_scrub_stamp":"2023-10-06T01:22:54.901806+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:18:24.831933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":8,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-06T01:22:56.845818+0000","last_change":"2023-10-06T01:22:56.845818+0000","last_active":"2023-10-06T01:22:56.845818+0000","last_peered":"2023-10-06T01:22:56.845818+0000","last_clean":"2023-10-06T01:22:56.845818+0000","last_became_active":"2023-10-06T01:22:56.845557+0000","last_became_peered":"2023-10-06T01:22:56.845557+0000","last_unstale":"2023-10-06T01:22:56.845818+0000","last_undegraded":"2023-10-06T01:22:56.845818+0000","last_fullsized":"2023-10-06T01:22:56.845818+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:22:55.908368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:22:55.908368+0000","last_clean_scrub_stamp":"2023-10-06T01:22:55.908368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:25:17.049218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1a","version":"38'1","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-06T01:22:56.928981+0000","last_change":"2023-10-06T01:22:55.933270+0000","last_active":"2023-10-06T01:22:56.928981+0000","last_peered":"2023-10-06T01:22:56.928981+0000","last_clean":"2023-10-06T01:22:56.928981+0000","last_became_active":"2023-10-06T01:22:55.933008+0000","last_became_peered":"2023-10-06T01:22:55.933008+0000","last_unstale":"2023-10-06T01:22:56.928981+0000","last_undegraded":"2023-10-06T01:22:56.928981+0000","last_fullsized":"2023-10-06T01:22:56.928981+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:22:54.901806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:22:54.901806+0000","last_clean_scrub_stamp":"2023-10-06T01:22:54.901806+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:42:33.564210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":8,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-06T01:22:56.850294+0000","last_change":"2023-10-06T01:22:56.850294+0000","last_active":"2023-10-06T01:22:56.850294+0000","last_peered":"2023-10-06T01:22:56.850294+0000","last_clean":"2023-10-06T01:22:56.850294+0000","last_became_active":"2023-10-06T01:22:56.850028+0000","last_became_peered":"2023-10-06T01:22:56.850028+0000","last_unstale":"2023-10-06T01:22:56.850294+0000","last_undegraded":"2023-10-06T01:22:56.850294+0000","last_fullsized":"2023-10-06T01:22:56.850294+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:22:55.908368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:22:55.908368+0000","last_clean_scrub_stamp":"2023-10-06T01:22:55.908368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:37:59.339689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-06T01:22:56.830919+0000","last_change":"2023-10-06T01:22:55.932743+0000","last_active":"2023-10-06T01:22:56.830919+0000","last_peered":"2023-10-06T01:22:56.830919+0000","last_clean":"2023-10-06T01:22:56.830919+0000","last_became_active":"2023-10-06T01:22:55.932494+0000","last_became_peered":"2023-10-06T01:22:55.932494+0000","last_unstale":"2023-10-06T01:22:56.830919+0000","last_undegraded":"2023-10-06T01:22:56.830919+0000","last_fullsized":"2023-10-06T01:22:56.830919+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:22:54.901806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:22:54.901806+0000","last_clean_scrub_stamp":"2023-10-06T01:22:54.901806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:07:20.352410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-06T01:22:56.849083+0000","last_change":"2023-10-06T01:22:56.845113+0000","last_active":"2023-10-06T01:22:56.849083+0000","last_peered":"2023-10-06T01:22:56.849083+0000","last_clean":"2023-10-06T01:22:56.849083+0000","last_became_active":"2023-10-06T01:22:56.844503+0000","last_became_peered":"2023-10-06T01:22:56.844503+0000","last_unstale":"2023-10-06T01:22:56.849083+0000","last_undegraded":"2023-10-06T01:22:56.849083+0000","last_fullsized":"2023-10-06T01:22:56.849083+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:22:55.908368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:22:55.908368+0000","last_clean_scrub_stamp":"2023-10-06T01:22:55.908368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:07:00.581304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T01:22:55.940615+0000","last_change":"2023-10-06T01:22:55.937881+0000","last_active":"2023-10-06T01:22:55.940615+0000","last_peered":"2023-10-06T01:22:55.940615+0000","last_clean":"2023-10-06T01:22:55.940615+0000","last_became_active":"2023-10-06T01:22:55.936260+0000","last_became_peered":"2023-10-06T01:22:55.936260+0000","last_unstale":"2023-10-06T01:22:55.940615+0000","last_undegraded":"2023-10-06T01:22:55.940615+0000","last_fullsized":"2023-10-06T01:22:55.940615+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:22:54.901806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:22:54.901806+0000","last_clean_scrub_stamp":"2023-10-06T01:22:54.901806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:41:45.615324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-06T01:22:56.861105+0000","last_change":"2023-10-06T01:22:56.858651+0000","last_active":"2023-10-06T01:22:56.861105+0000","last_peered":"2023-10-06T01:22:56.861105+0000","last_clean":"2023-10-06T01:22:56.861105+0000","last_became_active":"2023-10-06T01:22:56.858303+0000","last_became_peered":"2023-10-06T01:22:56.858303+0000","last_unstale":"2023-10-06T01:22:56.861105+0000","last_undegraded":"2023-10-06T01:22:56.861105+0000","last_fullsized":"2023-10-06T01:22:56.861105+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:22:55.908368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:22:55.908368+0000","last_clean_scrub_stamp":"2023-10-06T01:22:55.908368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:37:59.339689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-06T01:22:56.844666+0000","last_change":"2023-10-06T01:22:55.933376+0000","last_active":"2023-10-06T01:22:56.844666+0000","last_peered":"2023-10-06T01:22:56.844666+0000","last_clean":"2023-10-06T01:22:56.844666+0000","last_became_active":"2023-10-06T01:22:55.933076+0000","last_became_peered":"2023-10-06T01:22:55.933076+0000","last_unstale":"2023-10-06T01:22:56.844666+0000","last_undegraded":"2023-10-06T01:22:56.844666+0000","last_fullsized":"2023-10-06T01:22:56.844666+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:22:54.901806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:22:54.901806+0000","last_clean_scrub_stamp":"2023-10-06T01:22:54.901806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:53:55.823050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":8,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-06T01:22:56.842286+0000","last_change":"2023-10-06T01:22:56.842286+0000","last_active":"2023-10-06T01:22:56.842286+0000","last_peered":"2023-10-06T01:22:56.842286+0000","last_clean":"2023-10-06T01:22:56.842286+0000","last_became_active":"2023-10-06T01:22:56.842017+0000","last_became_peered":"2023-10-06T01:22:56.842017+0000","last_unstale":"2023-10-06T01:22:56.842286+0000","last_undegraded":"2023-10-06T01:22:56.842286+0000","last_fullsized":"2023-10-06T01:22:56.842286+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:22:55.908368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:22:55.908368+0000","last_clean_scrub_stamp":"2023-10-06T01:22:55.908368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:25:50.057545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T01:22:55.940656+0000","last_change":"2023-10-06T01:22:55.937771+0000","last_active":"2023-10-06T01:22:55.940656+0000","last_peered":"2023-10-06T01:22:55.940656+0000","last_clean":"2023-10-06T01:22:55.940656+0000","last_became_active":"2023-10-06T01:22:55.937514+0000","last_became_peered":"2023-10-06T01:22:55.937514+0000","last_unstale":"2023-10-06T01:22:55.940656+0000","last_undegraded":"2023-10-06T01:22:55.940656+0000","last_fullsized":"2023-10-06T01:22:55.940656+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:22:54.901806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:22:54.901806+0000","last_clean_scrub_stamp":"2023-10-06T01:22:54.901806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:08:57.043450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-06T01:22:56.853997+0000","last_change":"2023-10-06T01:22:56.846213+0000","last_active":"2023-10-06T01:22:56.853997+0000","last_peered":"2023-10-06T01:22:56.853997+0000","last_clean":"2023-10-06T01:22:56.853997+0000","last_became_active":"2023-10-06T01:22:56.845971+0000","last_became_peered":"2023-10-06T01:22:56.845971+0000","last_unstale":"2023-10-06T01:22:56.853997+0000","last_undegraded":"2023-10-06T01:22:56.853997+0000","last_fullsized":"2023-10-06T01:22:56.853997+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:22:55.908368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:22:55.908368+0000","last_clean_scrub_stamp":"2023-10-06T01:22:55.908368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:30:04.146182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"38'3","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-06T01:22:56.936169+0000","last_change":"2023-10-06T01:22:55.942244+0000","last_active":"2023-10-06T01:22:56.936169+0000","last_peered":"2023-10-06T01:22:56.936169+0000","last_clean":"2023-10-06T01:22:56.936169+0000","last_became_active":"2023-10-06T01:22:55.941957+0000","last_became_peered":"2023-10-06T01:22:55.941957+0000","last_unstale":"2023-10-06T01:22:56.936169+0000","last_undegraded":"2023-10-06T01:22:56.936169+0000","last_fullsized":"2023-10-06T01:22:56.936169+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:22:54.901806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:22:54.901806+0000","last_clean_scrub_stamp":"2023-10-06T01:22:54.901806+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:26:32.058068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":8,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-06T01:22:56.850049+0000","last_change":"2023-10-06T01:22:56.850049+0000","last_active":"2023-10-06T01:22:56.850049+0000","last_peered":"2023-10-06T01:22:56.850049+0000","last_clean":"2023-10-06T01:22:56.850049+0000","last_became_active":"2023-10-06T01:22:56.849212+0000","last_became_peered":"2023-10-06T01:22:56.849212+0000","last_unstale":"2023-10-06T01:22:56.850049+0000","last_undegraded":"2023-10-06T01:22:56.850049+0000","last_fullsized":"2023-10-06T01:22:56.850049+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:22:55.908368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:22:55.908368+0000","last_clean_scrub_stamp":"2023-10-06T01:22:55.908368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:25:51.642335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.14","version":"38'6","reported_seq":16,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-06T01:22:56.933698+0000","last_change":"2023-10-06T01:22:55.929382+0000","last_active":"2023-10-06T01:22:56.933698+0000","last_peered":"2023-10-06T01:22:56.933698+0000","last_clean":"2023-10-06T01:22:56.933698+0000","last_became_active":"2023-10-06T01:22:55.929069+0000","last_became_peered":"2023-10-06T01:22:55.929069+0000","last_unstale":"2023-10-06T01:22:56.933698+0000","last_undegraded":"2023-10-06T01:22:56.933698+0000","last_fullsized":"2023-10-06T01:22:56.933698+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:22:54.901806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:22:54.901806+0000","last_clean_scrub_stamp":"2023-10-06T01:22:54.901806+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:45:21.907915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-06T01:22:56.855113+0000","last_change":"2023-10-06T01:22:56.849162+0000","last_active":"2023-10-06T01:22:56.855113+0000","last_peered":"2023-10-06T01:22:56.855113+0000","last_clean":"2023-10-06T01:22:56.855113+0000","last_became_active":"2023-10-06T01:22:56.848894+0000","last_became_peered":"2023-10-06T01:22:56.848894+0000","last_unstale":"2023-10-06T01:22:56.855113+0000","last_undegraded":"2023-10-06T01:22:56.855113+0000","last_fullsized":"2023-10-06T01:22:56.855113+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:22:55.908368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:22:55.908368+0000","last_clean_scrub_stamp":"2023-10-06T01:22:55.908368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:41:46.621887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"38'2","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-06T01:22:56.929264+0000","last_change":"2023-10-06T01:22:55.943190+0000","last_active":"2023-10-06T01:22:56.929264+0000","last_peered":"2023-10-06T01:22:56.929264+0000","last_clean":"2023-10-06T01:22:56.929264+0000","last_became_active":"2023-10-06T01:22:55.942949+0000","last_became_peered":"2023-10-06T01:22:55.942949+0000","last_unstale":"2023-10-06T01:22:56.929264+0000","last_undegraded":"2023-10-06T01:22:56.929264+0000","last_fullsized":"2023-10-06T01:22:56.929264+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:22:54.901806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:22:54.901806+0000","last_clean_scrub_stamp":"2023-10-06T01:22:54.901806+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:34:52.114529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":8,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-06T01:22:56.857247+0000","last_change":"2023-10-06T01:22:56.857247+0000","last_active":"2023-10-06T01:22:56.857247+0000","last_peered":"2023-10-06T01:22:56.857247+0000","last_clean":"2023-10-06T01:22:56.857247+0000","last_became_active":"2023-10-06T01:22:56.856881+0000","last_became_peered":"2023-10-06T01:22:56.856881+0000","last_unstale":"2023-10-06T01:22:56.857247+0000","last_undegraded":"2023-10-06T01:22:56.857247+0000","last_fullsized":"2023-10-06T01:22:56.857247+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:22:55.908368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:22:55.908368+0000","last_clean_scrub_stamp":"2023-10-06T01:22:55.908368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:55:35.329247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T01:22:55.935675+0000","last_change":"2023-10-06T01:22:55.931031+0000","last_active":"2023-10-06T01:22:55.935675+0000","last_peered":"2023-10-06T01:22:55.935675+0000","last_clean":"2023-10-06T01:22:55.935675+0000","last_became_active":"2023-10-06T01:22:55.930742+0000","last_became_peered":"2023-10-06T01:22:55.930742+0000","last_unstale":"2023-10-06T01:22:55.935675+0000","last_undegraded":"2023-10-06T01:22:55.935675+0000","last_fullsized":"2023-10-06T01:22:55.935675+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:22:54.901806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:22:54.901806+0000","last_clean_scrub_stamp":"2023-10-06T01:22:54.901806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:41:45.615324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-06T01:22:56.853821+0000","last_change":"2023-10-06T01:22:56.845700+0000","last_active":"2023-10-06T01:22:56.853821+0000","last_peered":"2023-10-06T01:22:56.853821+0000","last_clean":"2023-10-06T01:22:56.853821+0000","last_became_active":"2023-10-06T01:22:56.845460+0000","last_became_peered":"2023-10-06T01:22:56.845460+0000","last_unstale":"2023-10-06T01:22:56.853821+0000","last_undegraded":"2023-10-06T01:22:56.853821+0000","last_fullsized":"2023-10-06T01:22:56.853821+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:22:55.908368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:22:55.908368+0000","last_clean_scrub_stamp":"2023-10-06T01:22:55.908368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:37:47.029243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-06T01:22:56.833447+0000","last_change":"2023-10-06T01:22:55.939859+0000","last_active":"2023-10-06T01:22:56.833447+0000","last_peered":"2023-10-06T01:22:56.833447+0000","last_clean":"2023-10-06T01:22:56.833447+0000","last_became_active":"2023-10-06T01:22:55.939545+0000","last_became_peered":"2023-10-06T01:22:55.939545+0000","last_unstale":"2023-10-06T01:22:56.833447+0000","last_undegraded":"2023-10-06T01:22:56.833447+0000","last_fullsized":"2023-10-06T01:22:56.833447+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:22:54.901806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:22:54.901806+0000","last_clean_scrub_stamp":"2023-10-06T01:22:54.901806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:07:20.352410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":8,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-06T01:22:56.851466+0000","last_change":"2023-10-06T01:22:56.851466+0000","last_active":"2023-10-06T01:22:56.851466+0000","last_peered":"2023-10-06T01:22:56.851466+0000","last_clean":"2023-10-06T01:22:56.851466+0000","last_became_active":"2023-10-06T01:22:56.851195+0000","last_became_peered":"2023-10-06T01:22:56.851195+0000","last_unstale":"2023-10-06T01:22:56.851466+0000","last_undegraded":"2023-10-06T01:22:56.851466+0000","last_fullsized":"2023-10-06T01:22:56.851466+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:22:55.908368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:22:55.908368+0000","last_clean_scrub_stamp":"2023-10-06T01:22:55.908368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:55:32.218597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.10","version":"38'8","reported_seq":17,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-06T01:22:56.930286+0000","last_change":"2023-10-06T01:22:55.937651+0000","last_active":"2023-10-06T01:22:56.930286+0000","last_peered":"2023-10-06T01:22:56.930286+0000","last_clean":"2023-10-06T01:22:56.930286+0000","last_became_active":"2023-10-06T01:22:55.936005+0000","last_became_peered":"2023-10-06T01:22:55.936005+0000","last_unstale":"2023-10-06T01:22:56.930286+0000","last_undegraded":"2023-10-06T01:22:56.930286+0000","last_fullsized":"2023-10-06T01:22:56.930286+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:22:54.901806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:22:54.901806+0000","last_clean_scrub_stamp":"2023-10-06T01:22:54.901806+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:51:40.781567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-06T01:22:56.847015+0000","last_change":"2023-10-06T01:22:56.838033+0000","last_active":"2023-10-06T01:22:56.847015+0000","last_peered":"2023-10-06T01:22:56.847015+0000","last_clean":"2023-10-06T01:22:56.847015+0000","last_became_active":"2023-10-06T01:22:56.837738+0000","last_became_peered":"2023-10-06T01:22:56.837738+0000","last_unstale":"2023-10-06T01:22:56.847015+0000","last_undegraded":"2023-10-06T01:22:56.847015+0000","last_fullsized":"2023-10-06T01:22:56.847015+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:22:55.908368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:22:55.908368+0000","last_clean_scrub_stamp":"2023-10-06T01:22:55.908368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:42:43.961190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"38'1","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-06T01:22:56.929554+0000","last_change":"2023-10-06T01:22:55.945637+0000","last_active":"2023-10-06T01:22:56.929554+0000","last_peered":"2023-10-06T01:22:56.929554+0000","last_clean":"2023-10-06T01:22:56.929554+0000","last_became_active":"2023-10-06T01:22:55.945345+0000","last_became_peered":"2023-10-06T01:22:55.945345+0000","last_unstale":"2023-10-06T01:22:56.929554+0000","last_undegraded":"2023-10-06T01:22:56.929554+0000","last_fullsized":"2023-10-06T01:22:56.929554+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:22:54.901806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:22:54.901806+0000","last_clean_scrub_stamp":"2023-10-06T01:22:54.901806+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:31:26.901332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":8,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-06T01:22:56.845173+0000","last_change":"2023-10-06T01:22:56.845173+0000","last_active":"2023-10-06T01:22:56.845173+0000","last_peered":"2023-10-06T01:22:56.845173+0000","last_clean":"2023-10-06T01:22:56.845173+0000","last_became_active":"2023-10-06T01:22:56.844861+0000","last_became_peered":"2023-10-06T01:22:56.844861+0000","last_unstale":"2023-10-06T01:22:56.845173+0000","last_undegraded":"2023-10-06T01:22:56.845173+0000","last_fullsized":"2023-10-06T01:22:56.845173+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:22:55.908368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:22:55.908368+0000","last_clean_scrub_stamp":"2023-10-06T01:22:55.908368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:30:04.146182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.e","version":"38'2","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-06T01:22:56.930847+0000","last_change":"2023-10-06T01:22:55.928136+0000","last_active":"2023-10-06T01:22:56.930847+0000","last_peered":"2023-10-06T01:22:56.930847+0000","last_clean":"2023-10-06T01:22:56.930847+0000","last_became_active":"2023-10-06T01:22:55.927884+0000","last_became_peered":"2023-10-06T01:22:55.927884+0000","last_unstale":"2023-10-06T01:22:56.930847+0000","last_undegraded":"2023-10-06T01:22:56.930847+0000","last_fullsized":"2023-10-06T01:22:56.930847+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:22:54.901806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:22:54.901806+0000","last_clean_scrub_stamp":"2023-10-06T01:22:54.901806+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:45:23.823523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-06T01:22:56.860665+0000","last_change":"2023-10-06T01:22:56.856474+0000","last_active":"2023-10-06T01:22:56.860665+0000","last_peered":"2023-10-06T01:22:56.860665+0000","last_clean":"2023-10-06T01:22:56.860665+0000","last_became_active":"2023-10-06T01:22:56.856230+0000","last_became_peered":"2023-10-06T01:22:56.856230+0000","last_unstale":"2023-10-06T01:22:56.860665+0000","last_undegraded":"2023-10-06T01:22:56.860665+0000","last_fullsized":"2023-10-06T01:22:56.860665+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:22:55.908368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:22:55.908368+0000","last_clean_scrub_stamp":"2023-10-06T01:22:55.908368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:34:53.121092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.d","version":"38'1","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-06T01:22:56.932176+0000","last_change":"2023-10-06T01:22:55.928949+0000","last_active":"2023-10-06T01:22:56.932176+0000","last_peered":"2023-10-06T01:22:56.932176+0000","last_clean":"2023-10-06T01:22:56.932176+0000","last_became_active":"2023-10-06T01:22:55.928245+0000","last_became_peered":"2023-10-06T01:22:55.928245+0000","last_unstale":"2023-10-06T01:22:56.932176+0000","last_undegraded":"2023-10-06T01:22:56.932176+0000","last_fullsized":"2023-10-06T01:22:56.932176+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:22:54.901806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:22:54.901806+0000","last_clean_scrub_stamp":"2023-10-06T01:22:54.901806+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:34:52.114529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-06T01:22:56.855420+0000","last_change":"2023-10-06T01:22:56.851623+0000","last_active":"2023-10-06T01:22:56.855420+0000","last_peered":"2023-10-06T01:22:56.855420+0000","last_clean":"2023-10-06T01:22:56.855420+0000","last_became_active":"2023-10-06T01:22:56.851338+0000","last_became_peered":"2023-10-06T01:22:56.851338+0000","last_unstale":"2023-10-06T01:22:56.855420+0000","last_undegraded":"2023-10-06T01:22:56.855420+0000","last_fullsized":"2023-10-06T01:22:56.855420+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:22:55.908368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:22:55.908368+0000","last_clean_scrub_stamp":"2023-10-06T01:22:55.908368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:37:39.783131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-06T01:22:56.833737+0000","last_change":"2023-10-06T01:22:55.945801+0000","last_active":"2023-10-06T01:22:56.833737+0000","last_peered":"2023-10-06T01:22:56.833737+0000","last_clean":"2023-10-06T01:22:56.833737+0000","last_became_active":"2023-10-06T01:22:55.945514+0000","last_became_peered":"2023-10-06T01:22:55.945514+0000","last_unstale":"2023-10-06T01:22:56.833737+0000","last_undegraded":"2023-10-06T01:22:56.833737+0000","last_fullsized":"2023-10-06T01:22:56.833737+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:22:54.901806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:22:54.901806+0000","last_clean_scrub_stamp":"2023-10-06T01:22:54.901806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:30:30.486820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-06T01:22:56.853960+0000","last_change":"2023-10-06T01:22:56.848480+0000","last_active":"2023-10-06T01:22:56.853960+0000","last_peered":"2023-10-06T01:22:56.853960+0000","last_clean":"2023-10-06T01:22:56.853960+0000","last_became_active":"2023-10-06T01:22:56.847550+0000","last_became_peered":"2023-10-06T01:22:56.847550+0000","last_unstale":"2023-10-06T01:22:56.853960+0000","last_undegraded":"2023-10-06T01:22:56.853960+0000","last_fullsized":"2023-10-06T01:22:56.853960+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:22:55.908368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:22:55.908368+0000","last_clean_scrub_stamp":"2023-10-06T01:22:55.908368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:15:20.271419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.b","version":"38'2","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-06T01:22:56.929147+0000","last_change":"2023-10-06T01:22:55.944027+0000","last_active":"2023-10-06T01:22:56.929147+0000","last_peered":"2023-10-06T01:22:56.929147+0000","last_clean":"2023-10-06T01:22:56.929147+0000","last_became_active":"2023-10-06T01:22:55.943708+0000","last_became_peered":"2023-10-06T01:22:55.943708+0000","last_unstale":"2023-10-06T01:22:56.929147+0000","last_undegraded":"2023-10-06T01:22:56.929147+0000","last_fullsized":"2023-10-06T01:22:56.929147+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:22:54.901806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:22:54.901806+0000","last_clean_scrub_stamp":"2023-10-06T01:22:54.901806+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:25:17.648232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-06T01:22:56.847632+0000","last_change":"2023-10-06T01:22:56.839246+0000","last_active":"2023-10-06T01:22:56.847632+0000","last_peered":"2023-10-06T01:22:56.847632+0000","last_clean":"2023-10-06T01:22:56.847632+0000","last_became_active":"2023-10-06T01:22:56.838994+0000","last_became_peered":"2023-10-06T01:22:56.838994+0000","last_unstale":"2023-10-06T01:22:56.847632+0000","last_undegraded":"2023-10-06T01:22:56.847632+0000","last_fullsized":"2023-10-06T01:22:56.847632+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:22:55.908368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:22:55.908368+0000","last_clean_scrub_stamp":"2023-10-06T01:22:55.908368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:08:58.050013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-06T01:22:56.830940+0000","last_change":"2023-10-06T01:22:55.944313+0000","last_active":"2023-10-06T01:22:56.830940+0000","last_peered":"2023-10-06T01:22:56.830940+0000","last_clean":"2023-10-06T01:22:56.830940+0000","last_became_active":"2023-10-06T01:22:55.944039+0000","last_became_peered":"2023-10-06T01:22:55.944039+0000","last_unstale":"2023-10-06T01:22:56.830940+0000","last_undegraded":"2023-10-06T01:22:56.830940+0000","last_fullsized":"2023-10-06T01:22:56.830940+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:22:54.901806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:22:54.901806+0000","last_clean_scrub_stamp":"2023-10-06T01:22:54.901806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:25:17.648232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-06T01:22:56.845523+0000","last_change":"2023-10-06T01:22:56.843180+0000","last_active":"2023-10-06T01:22:56.845523+0000","last_peered":"2023-10-06T01:22:56.845523+0000","last_clean":"2023-10-06T01:22:56.845523+0000","last_became_active":"2023-10-06T01:22:56.842869+0000","last_became_peered":"2023-10-06T01:22:56.842869+0000","last_unstale":"2023-10-06T01:22:56.845523+0000","last_undegraded":"2023-10-06T01:22:56.845523+0000","last_fullsized":"2023-10-06T01:22:56.845523+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:22:55.908368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:22:55.908368+0000","last_clean_scrub_stamp":"2023-10-06T01:22:55.908368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:07:00.581304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T01:22:55.935889+0000","last_change":"2023-10-06T01:22:55.934582+0000","last_active":"2023-10-06T01:22:55.935889+0000","last_peered":"2023-10-06T01:22:55.935889+0000","last_clean":"2023-10-06T01:22:55.935889+0000","last_became_active":"2023-10-06T01:22:55.934319+0000","last_became_peered":"2023-10-06T01:22:55.934319+0000","last_unstale":"2023-10-06T01:22:55.935889+0000","last_undegraded":"2023-10-06T01:22:55.935889+0000","last_fullsized":"2023-10-06T01:22:55.935889+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:22:54.901806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:22:54.901806+0000","last_clean_scrub_stamp":"2023-10-06T01:22:54.901806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:00:43.468689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":8,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-06T01:22:56.849737+0000","last_change":"2023-10-06T01:22:56.849737+0000","last_active":"2023-10-06T01:22:56.849737+0000","last_peered":"2023-10-06T01:22:56.849737+0000","last_clean":"2023-10-06T01:22:56.849737+0000","last_became_active":"2023-10-06T01:22:56.849444+0000","last_became_peered":"2023-10-06T01:22:56.849444+0000","last_unstale":"2023-10-06T01:22:56.849737+0000","last_undegraded":"2023-10-06T01:22:56.849737+0000","last_fullsized":"2023-10-06T01:22:56.849737+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:22:55.908368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:22:55.908368+0000","last_clean_scrub_stamp":"2023-10-06T01:22:55.908368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:55:32.218597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T01:22:55.936218+0000","last_change":"2023-10-06T01:22:55.931736+0000","last_active":"2023-10-06T01:22:55.936218+0000","last_peered":"2023-10-06T01:22:55.936218+0000","last_clean":"2023-10-06T01:22:55.936218+0000","last_became_active":"2023-10-06T01:22:55.931456+0000","last_became_peered":"2023-10-06T01:22:55.931456+0000","last_unstale":"2023-10-06T01:22:55.936218+0000","last_undegraded":"2023-10-06T01:22:55.936218+0000","last_fullsized":"2023-10-06T01:22:55.936218+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:22:54.901806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:22:54.901806+0000","last_clean_scrub_stamp":"2023-10-06T01:22:54.901806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:18:24.831933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-06T01:22:56.857936+0000","last_change":"2023-10-06T01:22:56.852776+0000","last_active":"2023-10-06T01:22:56.857936+0000","last_peered":"2023-10-06T01:22:56.857936+0000","last_clean":"2023-10-06T01:22:56.857936+0000","last_became_active":"2023-10-06T01:22:56.852219+0000","last_became_peered":"2023-10-06T01:22:56.852219+0000","last_unstale":"2023-10-06T01:22:56.857936+0000","last_undegraded":"2023-10-06T01:22:56.857936+0000","last_fullsized":"2023-10-06T01:22:56.857936+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:22:55.908368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:22:55.908368+0000","last_clean_scrub_stamp":"2023-10-06T01:22:55.908368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:51:57.198044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-06T01:22:56.845256+0000","last_change":"2023-10-06T01:22:55.932754+0000","last_active":"2023-10-06T01:22:56.845256+0000","last_peered":"2023-10-06T01:22:56.845256+0000","last_clean":"2023-10-06T01:22:56.845256+0000","last_became_active":"2023-10-06T01:22:55.932420+0000","last_became_peered":"2023-10-06T01:22:55.932420+0000","last_unstale":"2023-10-06T01:22:56.845256+0000","last_undegraded":"2023-10-06T01:22:56.845256+0000","last_fullsized":"2023-10-06T01:22:56.845256+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:22:54.901806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:22:54.901806+0000","last_clean_scrub_stamp":"2023-10-06T01:22:54.901806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:03:23.629683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":31,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-06T01:22:56.842894+0000","last_change":"2023-10-06T01:21:30.601117+0000","last_active":"2023-10-06T01:22:56.842894+0000","last_peered":"2023-10-06T01:22:56.842894+0000","last_clean":"2023-10-06T01:22:56.842894+0000","last_became_active":"2023-10-06T01:21:30.600724+0000","last_became_peered":"2023-10-06T01:21:30.600724+0000","last_unstale":"2023-10-06T01:22:56.842894+0000","last_undegraded":"2023-10-06T01:22:56.842894+0000","last_fullsized":"2023-10-06T01:22:56.842894+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:21:29.586558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:21:29.586558+0000","last_clean_scrub_stamp":"2023-10-06T01:21:29.586558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:47:24.449013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-06T01:22:56.853939+0000","last_change":"2023-10-06T01:22:56.848212+0000","last_active":"2023-10-06T01:22:56.853939+0000","last_peered":"2023-10-06T01:22:56.853939+0000","last_clean":"2023-10-06T01:22:56.853939+0000","last_became_active":"2023-10-06T01:22:56.847892+0000","last_became_peered":"2023-10-06T01:22:56.847892+0000","last_unstale":"2023-10-06T01:22:56.853939+0000","last_undegraded":"2023-10-06T01:22:56.853939+0000","last_fullsized":"2023-10-06T01:22:56.853939+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:22:55.908368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:22:55.908368+0000","last_clean_scrub_stamp":"2023-10-06T01:22:55.908368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:01:10.322200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T01:22:55.943756+0000","last_change":"2023-10-06T01:22:55.942051+0000","last_active":"2023-10-06T01:22:55.943756+0000","last_peered":"2023-10-06T01:22:55.943756+0000","last_clean":"2023-10-06T01:22:55.943756+0000","last_became_active":"2023-10-06T01:22:55.941745+0000","last_became_peered":"2023-10-06T01:22:55.941745+0000","last_unstale":"2023-10-06T01:22:55.943756+0000","last_undegraded":"2023-10-06T01:22:55.943756+0000","last_fullsized":"2023-10-06T01:22:55.943756+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:22:54.901806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:22:54.901806+0000","last_clean_scrub_stamp":"2023-10-06T01:22:54.901806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:34:52.114529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":30,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-06T01:22:56.833818+0000","last_change":"2023-10-06T01:21:30.603434+0000","last_active":"2023-10-06T01:22:56.833818+0000","last_peered":"2023-10-06T01:22:56.833818+0000","last_clean":"2023-10-06T01:22:56.833818+0000","last_became_active":"2023-10-06T01:21:30.603215+0000","last_became_peered":"2023-10-06T01:21:30.603215+0000","last_unstale":"2023-10-06T01:22:56.833818+0000","last_undegraded":"2023-10-06T01:22:56.833818+0000","last_fullsized":"2023-10-06T01:22:56.833818+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:21:29.586558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:21:29.586558+0000","last_clean_scrub_stamp":"2023-10-06T01:21:29.586558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:47:24.449013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":8,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-06T01:22:56.846500+0000","last_change":"2023-10-06T01:22:56.846500+0000","last_active":"2023-10-06T01:22:56.846500+0000","last_peered":"2023-10-06T01:22:56.846500+0000","last_clean":"2023-10-06T01:22:56.846500+0000","last_became_active":"2023-10-06T01:22:56.846191+0000","last_became_peered":"2023-10-06T01:22:56.846191+0000","last_unstale":"2023-10-06T01:22:56.846500+0000","last_undegraded":"2023-10-06T01:22:56.846500+0000","last_fullsized":"2023-10-06T01:22:56.846500+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:22:55.908368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:22:55.908368+0000","last_clean_scrub_stamp":"2023-10-06T01:22:55.908368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:53:56.829612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-06T01:22:56.832980+0000","last_change":"2023-10-06T01:22:55.937232+0000","last_active":"2023-10-06T01:22:56.832980+0000","last_peered":"2023-10-06T01:22:56.832980+0000","last_clean":"2023-10-06T01:22:56.832980+0000","last_became_active":"2023-10-06T01:22:55.936953+0000","last_became_peered":"2023-10-06T01:22:55.936953+0000","last_unstale":"2023-10-06T01:22:56.832980+0000","last_undegraded":"2023-10-06T01:22:56.832980+0000","last_fullsized":"2023-10-06T01:22:56.832980+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:22:54.901806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:22:54.901806+0000","last_clean_scrub_stamp":"2023-10-06T01:22:54.901806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:34:51.873484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":29,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-06T01:22:56.832700+0000","last_change":"2023-10-06T01:21:30.604889+0000","last_active":"2023-10-06T01:22:56.832700+0000","last_peered":"2023-10-06T01:22:56.832700+0000","last_clean":"2023-10-06T01:22:56.832700+0000","last_became_active":"2023-10-06T01:21:30.604535+0000","last_became_peered":"2023-10-06T01:21:30.604535+0000","last_unstale":"2023-10-06T01:22:56.832700+0000","last_undegraded":"2023-10-06T01:22:56.832700+0000","last_fullsized":"2023-10-06T01:22:56.832700+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:21:29.586558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:21:29.586558+0000","last_clean_scrub_stamp":"2023-10-06T01:21:29.586558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:17:59.434982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"17'117","reported_seq":177,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T01:22:55.923096+0000","last_change":"2023-10-06T01:21:31.602437+0000","last_active":"2023-10-06T01:22:55.923096+0000","last_peered":"2023-10-06T01:22:55.923096+0000","last_clean":"2023-10-06T01:22:55.923096+0000","last_became_active":"2023-10-06T01:21:31.601431+0000","last_became_peered":"2023-10-06T01:21:31.601431+0000","last_unstale":"2023-10-06T01:22:55.923096+0000","last_undegraded":"2023-10-06T01:22:55.923096+0000","last_fullsized":"2023-10-06T01:22:55.923096+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:21:30.589171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:21:30.589171+0000","last_clean_scrub_stamp":"2023-10-06T01:21:30.589171+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T01:48:45.877807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":8,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-06T01:22:56.856289+0000","last_change":"2023-10-06T01:22:56.856289+0000","last_active":"2023-10-06T01:22:56.856289+0000","last_peered":"2023-10-06T01:22:56.856289+0000","last_clean":"2023-10-06T01:22:56.856289+0000","last_became_active":"2023-10-06T01:22:56.856037+0000","last_became_peered":"2023-10-06T01:22:56.856037+0000","last_unstale":"2023-10-06T01:22:56.856289+0000","last_undegraded":"2023-10-06T01:22:56.856289+0000","last_fullsized":"2023-10-06T01:22:56.856289+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:22:55.908368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:22:55.908368+0000","last_clean_scrub_stamp":"2023-10-06T01:22:55.908368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:01:10.322200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T01:22:55.944491+0000","last_change":"2023-10-06T01:22:55.942749+0000","last_active":"2023-10-06T01:22:55.944491+0000","last_peered":"2023-10-06T01:22:55.944491+0000","last_clean":"2023-10-06T01:22:55.944491+0000","last_became_active":"2023-10-06T01:22:55.942395+0000","last_became_peered":"2023-10-06T01:22:55.942395+0000","last_unstale":"2023-10-06T01:22:55.944491+0000","last_undegraded":"2023-10-06T01:22:55.944491+0000","last_fullsized":"2023-10-06T01:22:55.944491+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:22:54.901806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:22:54.901806+0000","last_clean_scrub_stamp":"2023-10-06T01:22:54.901806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:07:20.352410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":28,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T01:22:55.921620+0000","last_change":"2023-10-06T01:21:31.338236+0000","last_active":"2023-10-06T01:22:55.921620+0000","last_peered":"2023-10-06T01:22:55.921620+0000","last_clean":"2023-10-06T01:22:55.921620+0000","last_became_active":"2023-10-06T01:21:31.337918+0000","last_became_peered":"2023-10-06T01:21:31.337918+0000","last_unstale":"2023-10-06T01:22:55.921620+0000","last_undegraded":"2023-10-06T01:22:55.921620+0000","last_fullsized":"2023-10-06T01:22:55.921620+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:21:29.586558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:21:29.586558+0000","last_clean_scrub_stamp":"2023-10-06T01:21:29.586558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:02:13.010488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":8,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-06T01:22:56.857594+0000","last_change":"2023-10-06T01:22:56.857594+0000","last_active":"2023-10-06T01:22:56.857594+0000","last_peered":"2023-10-06T01:22:56.857594+0000","last_clean":"2023-10-06T01:22:56.857594+0000","last_became_active":"2023-10-06T01:22:56.857330+0000","last_became_peered":"2023-10-06T01:22:56.857330+0000","last_unstale":"2023-10-06T01:22:56.857594+0000","last_undegraded":"2023-10-06T01:22:56.857594+0000","last_fullsized":"2023-10-06T01:22:56.857594+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:22:55.908368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:22:55.908368+0000","last_clean_scrub_stamp":"2023-10-06T01:22:55.908368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:51:57.198044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"38'2","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-06T01:22:56.933362+0000","last_change":"2023-10-06T01:22:55.946268+0000","last_active":"2023-10-06T01:22:56.933362+0000","last_peered":"2023-10-06T01:22:56.933362+0000","last_clean":"2023-10-06T01:22:56.933362+0000","last_became_active":"2023-10-06T01:22:55.945458+0000","last_became_peered":"2023-10-06T01:22:55.945458+0000","last_unstale":"2023-10-06T01:22:56.933362+0000","last_undegraded":"2023-10-06T01:22:56.933362+0000","last_fullsized":"2023-10-06T01:22:56.933362+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:22:54.901806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:22:54.901806+0000","last_clean_scrub_stamp":"2023-10-06T01:22:54.901806+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:18:24.831933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":28,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T01:22:55.923005+0000","last_change":"2023-10-06T01:21:31.338209+0000","last_active":"2023-10-06T01:22:55.923005+0000","last_peered":"2023-10-06T01:22:55.923005+0000","last_clean":"2023-10-06T01:22:55.923005+0000","last_became_active":"2023-10-06T01:21:31.337870+0000","last_became_peered":"2023-10-06T01:21:31.337870+0000","last_unstale":"2023-10-06T01:22:55.923005+0000","last_undegraded":"2023-10-06T01:22:55.923005+0000","last_fullsized":"2023-10-06T01:22:55.923005+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:21:29.586558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:21:29.586558+0000","last_clean_scrub_stamp":"2023-10-06T01:21:29.586558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:53:47.117299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-06T01:22:56.855097+0000","last_change":"2023-10-06T01:22:56.850461+0000","last_active":"2023-10-06T01:22:56.855097+0000","last_peered":"2023-10-06T01:22:56.855097+0000","last_clean":"2023-10-06T01:22:56.855097+0000","last_became_active":"2023-10-06T01:22:56.850140+0000","last_became_peered":"2023-10-06T01:22:56.850140+0000","last_unstale":"2023-10-06T01:22:56.855097+0000","last_undegraded":"2023-10-06T01:22:56.855097+0000","last_fullsized":"2023-10-06T01:22:56.855097+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:22:55.908368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:22:55.908368+0000","last_clean_scrub_stamp":"2023-10-06T01:22:55.908368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:35:21.678412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.6","version":"39'1","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-06T01:22:58.126875+0000","last_change":"2023-10-06T01:22:55.938429+0000","last_active":"2023-10-06T01:22:58.126875+0000","last_peered":"2023-10-06T01:22:58.126875+0000","last_clean":"2023-10-06T01:22:58.126875+0000","last_became_active":"2023-10-06T01:22:55.938154+0000","last_became_peered":"2023-10-06T01:22:55.938154+0000","last_unstale":"2023-10-06T01:22:58.126875+0000","last_undegraded":"2023-10-06T01:22:58.126875+0000","last_fullsized":"2023-10-06T01:22:58.126875+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:22:54.901806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:22:54.901806+0000","last_clean_scrub_stamp":"2023-10-06T01:22:54.901806+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:09:14.927578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":29,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-06T01:22:56.830864+0000","last_change":"2023-10-06T01:21:31.338177+0000","last_active":"2023-10-06T01:22:56.830864+0000","last_peered":"2023-10-06T01:22:56.830864+0000","last_clean":"2023-10-06T01:22:56.830864+0000","last_became_active":"2023-10-06T01:21:31.337872+0000","last_became_peered":"2023-10-06T01:21:31.337872+0000","last_unstale":"2023-10-06T01:22:56.830864+0000","last_undegraded":"2023-10-06T01:22:56.830864+0000","last_fullsized":"2023-10-06T01:22:56.830864+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:21:29.586558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:21:29.586558+0000","last_clean_scrub_stamp":"2023-10-06T01:21:29.586558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:17:59.434982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-06T01:22:56.853174+0000","last_change":"2023-10-06T01:22:56.841234+0000","last_active":"2023-10-06T01:22:56.853174+0000","last_peered":"2023-10-06T01:22:56.853174+0000","last_clean":"2023-10-06T01:22:56.853174+0000","last_became_active":"2023-10-06T01:22:56.840833+0000","last_became_peered":"2023-10-06T01:22:56.840833+0000","last_unstale":"2023-10-06T01:22:56.853174+0000","last_undegraded":"2023-10-06T01:22:56.853174+0000","last_fullsized":"2023-10-06T01:22:56.853174+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:22:55.908368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:22:55.908368+0000","last_clean_scrub_stamp":"2023-10-06T01:22:55.908368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:23:52.574138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-06T01:22:56.833162+0000","last_change":"2023-10-06T01:22:55.942117+0000","last_active":"2023-10-06T01:22:56.833162+0000","last_peered":"2023-10-06T01:22:56.833162+0000","last_clean":"2023-10-06T01:22:56.833162+0000","last_became_active":"2023-10-06T01:22:55.941811+0000","last_became_peered":"2023-10-06T01:22:55.941811+0000","last_unstale":"2023-10-06T01:22:56.833162+0000","last_undegraded":"2023-10-06T01:22:56.833162+0000","last_fullsized":"2023-10-06T01:22:56.833162+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:22:54.901806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:22:54.901806+0000","last_clean_scrub_stamp":"2023-10-06T01:22:54.901806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:17:16.798223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":29,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-06T01:22:56.833043+0000","last_change":"2023-10-06T01:21:31.338181+0000","last_active":"2023-10-06T01:22:56.833043+0000","last_peered":"2023-10-06T01:22:56.833043+0000","last_clean":"2023-10-06T01:22:56.833043+0000","last_became_active":"2023-10-06T01:21:31.337820+0000","last_became_peered":"2023-10-06T01:21:31.337820+0000","last_unstale":"2023-10-06T01:22:56.833043+0000","last_undegraded":"2023-10-06T01:22:56.833043+0000","last_fullsized":"2023-10-06T01:22:56.833043+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:21:29.586558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:21:29.586558+0000","last_clean_scrub_stamp":"2023-10-06T01:21:29.586558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:44:49.740873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-06T01:22:56.856429+0000","last_change":"2023-10-06T01:22:56.852988+0000","last_active":"2023-10-06T01:22:56.856429+0000","last_peered":"2023-10-06T01:22:56.856429+0000","last_clean":"2023-10-06T01:22:56.856429+0000","last_became_active":"2023-10-06T01:22:56.852678+0000","last_became_peered":"2023-10-06T01:22:56.852678+0000","last_unstale":"2023-10-06T01:22:56.856429+0000","last_undegraded":"2023-10-06T01:22:56.856429+0000","last_fullsized":"2023-10-06T01:22:56.856429+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:22:55.908368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:22:55.908368+0000","last_clean_scrub_stamp":"2023-10-06T01:22:55.908368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:42:29.916205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T01:22:55.940571+0000","last_change":"2023-10-06T01:22:55.937412+0000","last_active":"2023-10-06T01:22:55.940571+0000","last_peered":"2023-10-06T01:22:55.940571+0000","last_clean":"2023-10-06T01:22:55.940571+0000","last_became_active":"2023-10-06T01:22:55.935678+0000","last_became_peered":"2023-10-06T01:22:55.935678+0000","last_unstale":"2023-10-06T01:22:55.940571+0000","last_undegraded":"2023-10-06T01:22:55.940571+0000","last_fullsized":"2023-10-06T01:22:55.940571+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:22:54.901806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:22:54.901806+0000","last_clean_scrub_stamp":"2023-10-06T01:22:54.901806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:35:20.671849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":29,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-06T01:22:56.837929+0000","last_change":"2023-10-06T01:21:30.604007+0000","last_active":"2023-10-06T01:22:56.837929+0000","last_peered":"2023-10-06T01:22:56.837929+0000","last_clean":"2023-10-06T01:22:56.837929+0000","last_became_active":"2023-10-06T01:21:30.603673+0000","last_became_peered":"2023-10-06T01:21:30.603673+0000","last_unstale":"2023-10-06T01:22:56.837929+0000","last_undegraded":"2023-10-06T01:22:56.837929+0000","last_fullsized":"2023-10-06T01:22:56.837929+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:21:29.586558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:21:29.586558+0000","last_clean_scrub_stamp":"2023-10-06T01:21:29.586558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:53:47.117299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574870,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298300,"kb_used_data":1012,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073540,"statfs":{"total":96636764160,"available":96331304960,"internally_reserved":0,"allocated":1036288,"data_stored":785500,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 01:22:29 2023","interfaces":[{"interface":"back","average":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":0.93700000000000006,"5min":0.93700000000000006,"15min":0.93700000000000006},"last":0.60199999999999998},{"interface":"front","average":{"1min":0.65900000000000003,"5min":0.65900000000000003,"15min":0.65900000000000003},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.96999999999999997,"5min":0.96999999999999997,"15min":0.96999999999999997},"last":0.80400000000000005}]},{"osd":1,"last update":"Fri Oct 6 01:22:29 2023","interfaces":[{"interface":"back","average":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":0.89400000000000002,"5min":0.89400000000000002,"15min":0.89400000000000002},"last":0.64100000000000001},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":0.91400000000000003,"5min":0.91400000000000003,"15min":0.91400000000000003},"last":0.70899999999999996}]},{"osd":2,"last update":"Fri Oct 6 01:22:29 2023","interfaces":[{"interface":"back","average":{"1min":0.67300000000000004,"5min":0.67300000000000004,"15min":0.67300000000000004},"min":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":0.82899999999999996,"5min":0.82899999999999996,"15min":0.82899999999999996},"last":0.55300000000000005},{"interface":"front","average":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.93600000000000005,"5min":0.93600000000000005,"15min":0.93600000000000005},"last":0.77000000000000002}]},{"osd":3,"last update":"Fri Oct 6 01:22:29 2023","interfaces":[{"interface":"back","average":{"1min":0.748,"5min":0.748,"15min":0.748},"min":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":1.0660000000000001,"5min":1.0660000000000001,"15min":1.0660000000000001},"last":0.75800000000000001},{"interface":"front","average":{"1min":0.755,"5min":0.755,"15min":0.755},"min":{"1min":0.623,"5min":0.623,"15min":0.623},"max":{"1min":0.89400000000000002,"5min":0.89400000000000002,"15min":0.89400000000000002},"last":0.61899999999999999}]},{"osd":4,"last update":"Fri Oct 6 01:22:29 2023","interfaces":[{"interface":"back","average":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":1.01,"5min":1.01,"15min":1.01},"last":0.53400000000000003},{"interface":"front","average":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":0.86199999999999999,"5min":0.86199999999999999,"15min":0.86199999999999999},"last":0.56699999999999995}]},{"osd":5,"last update":"Fri Oct 6 01:22:29 2023","interfaces":[{"interface":"back","average":{"1min":0.66300000000000003,"5min":0.66300000000000003,"15min":0.66300000000000003},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":0.91600000000000004,"5min":0.91600000000000004,"15min":0.91600000000000004},"last":0.498},{"interface":"front","average":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"min":{"1min":0.503,"5min":0.503,"15min":0.503},"max":{"1min":0.96599999999999997,"5min":0.96599999999999997,"15min":0.96599999999999997},"last":0.73199999999999998}]},{"osd":6,"last update":"Fri Oct 6 01:22:29 2023","interfaces":[{"interface":"back","average":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":0.99199999999999999,"5min":0.99199999999999999,"15min":0.99199999999999999},"last":0.79200000000000004},{"interface":"front","average":{"1min":0.75600000000000001,"5min":0.75600000000000001,"15min":0.75600000000000001},"min":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":1.1000000000000001,"5min":1.1000000000000001,"15min":1.1000000000000001},"last":0.66200000000000003}]}]},{"osd":6,"up_from":13,"seq":55834574870,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297736,"kb_used_data":448,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074104,"statfs":{"total":96636764160,"available":96331882496,"internally_reserved":0,"allocated":458752,"data_stored":202647,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 01:22:30 2023","interfaces":[{"interface":"back","average":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.9279999999999999,"5min":1.9279999999999999,"15min":1.9279999999999999},"last":0.44500000000000001},{"interface":"front","average":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"min":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":2.3420000000000001,"5min":2.3420000000000001,"15min":2.3420000000000001},"last":0.69799999999999995}]},{"osd":1,"last update":"Fri Oct 6 01:22:30 2023","interfaces":[{"interface":"back","average":{"1min":1.262,"5min":1.262,"15min":1.262},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":12.529,"5min":12.529,"15min":12.529},"last":0.65000000000000002},{"interface":"front","average":{"1min":0.88300000000000001,"5min":0.88300000000000001,"15min":0.88300000000000001},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":3.98,"5min":3.98,"15min":3.98},"last":0.65900000000000003}]},{"osd":2,"last update":"Fri Oct 6 01:22:30 2023","interfaces":[{"interface":"back","average":{"1min":0.93899999999999995,"5min":0.93899999999999995,"15min":0.93899999999999995},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":5.4859999999999998,"5min":5.4859999999999998,"15min":5.4859999999999998},"last":0.505},{"interface":"front","average":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"min":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":2.718,"5min":2.718,"15min":2.718},"last":0.56200000000000006}]},{"osd":3,"last update":"Fri Oct 6 01:22:30 2023","interfaces":[{"interface":"back","average":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":2.5129999999999999,"5min":2.5129999999999999,"15min":2.5129999999999999},"last":0.59999999999999998},{"interface":"front","average":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":0.79200000000000004},"min":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":1.9870000000000001,"5min":1.9870000000000001,"15min":1.9870000000000001},"last":0.68000000000000005}]},{"osd":4,"last update":"Fri Oct 6 01:22:30 2023","interfaces":[{"interface":"back","average":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":3.1480000000000001,"5min":3.1480000000000001,"15min":3.1480000000000001},"last":0.46300000000000002},{"interface":"front","average":{"1min":0.82199999999999995,"5min":0.82199999999999995,"15min":0.82199999999999995},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":2.4769999999999999,"5min":2.4769999999999999,"15min":2.4769999999999999},"last":0.746}]},{"osd":5,"last update":"Fri Oct 6 01:22:30 2023","interfaces":[{"interface":"back","average":{"1min":0.95999999999999996,"5min":0.95999999999999996,"15min":0.95999999999999996},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":5.4279999999999999,"5min":5.4279999999999999,"15min":5.4279999999999999},"last":0.63},{"interface":"front","average":{"1min":0.86199999999999999,"5min":0.86199999999999999,"15min":0.86199999999999999},"min":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":2.6739999999999999,"5min":2.6739999999999999,"15min":2.6739999999999999},"last":0.71599999999999997}]},{"osd":7,"last update":"Fri Oct 6 01:22:30 2023","interfaces":[{"interface":"back","average":{"1min":0.88400000000000001,"5min":0.88400000000000001,"15min":0.88400000000000001},"min":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":2.7719999999999998,"5min":2.7719999999999998,"15min":2.7719999999999998},"last":0.77400000000000002},{"interface":"front","average":{"1min":1.109,"5min":1.109,"15min":1.109},"min":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":7.1440000000000001,"5min":7.1440000000000001,"15min":7.1440000000000001},"last":0.73399999999999999}]}]},{"osd":1,"up_from":13,"seq":55834574868,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302404,"kb_used_data":1020,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069436,"statfs":{"total":96636764160,"available":96327102464,"internally_reserved":0,"allocated":1044480,"data_stored":791463,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 01:22:29 2023","interfaces":[{"interface":"back","average":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"min":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"last":0.41499999999999998},{"interface":"front","average":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"last":0.52100000000000002}]},{"osd":2,"last update":"Fri Oct 6 01:22:29 2023","interfaces":[{"interface":"back","average":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":1.073,"5min":1.073,"15min":1.073},"last":0.51000000000000001},{"interface":"front","average":{"1min":0.496,"5min":0.496,"15min":0.496},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"last":0.46100000000000002}]},{"osd":3,"last update":"Fri Oct 6 01:22:29 2023","interfaces":[{"interface":"back","average":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"last":0.496},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.93400000000000005,"5min":0.93400000000000005,"15min":0.93400000000000005},"last":0.55900000000000005}]},{"osd":4,"last update":"Fri Oct 6 01:22:29 2023","interfaces":[{"interface":"back","average":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"min":{"1min":0.505,"5min":0.505,"15min":0.505},"max":{"1min":1.534,"5min":1.534,"15min":1.534},"last":0.86599999999999999},{"interface":"front","average":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"min":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"max":{"1min":1.742,"5min":1.742,"15min":1.742},"last":0.84599999999999997}]},{"osd":5,"last update":"Fri Oct 6 01:22:29 2023","interfaces":[{"interface":"back","average":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"min":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":1.4790000000000001,"5min":1.4790000000000001,"15min":1.4790000000000001},"last":0.88600000000000001},{"interface":"front","average":{"1min":0.82499999999999996,"5min":0.82499999999999996,"15min":0.82499999999999996},"min":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"max":{"1min":1.581,"5min":1.581,"15min":1.581},"last":0.73199999999999998}]},{"osd":6,"last update":"Fri Oct 6 01:22:29 2023","interfaces":[{"interface":"back","average":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":0.79700000000000004},"min":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"max":{"1min":1.51,"5min":1.51,"15min":1.51},"last":0.878},{"interface":"front","average":{"1min":0.81200000000000006,"5min":0.81200000000000006,"15min":0.81200000000000006},"min":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":1.26,"5min":1.26,"15min":1.26},"last":0.93000000000000005}]},{"osd":7,"last update":"Fri Oct 6 01:22:29 2023","interfaces":[{"interface":"back","average":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":0.84099999999999997},"min":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"max":{"1min":1.7070000000000001,"5min":1.7070000000000001,"15min":1.7070000000000001},"last":0.96899999999999997},{"interface":"front","average":{"1min":0.876,"5min":0.876,"15min":0.876},"min":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":1.633,"5min":1.633,"15min":1.633},"last":0.81399999999999995}]}]},{"osd":0,"up_from":13,"seq":55834574869,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301812,"kb_used_data":428,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94070028,"statfs":{"total":96636764160,"available":96327708672,"internally_reserved":0,"allocated":438272,"data_stored":194098,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Oct 6 01:22:29 2023","interfaces":[{"interface":"back","average":{"1min":0.65900000000000003,"5min":0.65900000000000003,"15min":0.65900000000000003},"min":{"1min":0.27800000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":2.8559999999999999,"5min":2.8559999999999999,"15min":2.8559999999999999},"last":0.36599999999999999},{"interface":"front","average":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":2.944,"5min":2.944,"15min":2.944},"last":0.42099999999999999}]},{"osd":2,"last update":"Fri Oct 6 01:22:29 2023","interfaces":[{"interface":"back","average":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":2.8940000000000001,"5min":2.8940000000000001,"15min":2.8940000000000001},"last":0.48799999999999999},{"interface":"front","average":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":2.9820000000000002,"5min":2.9820000000000002,"15min":2.9820000000000002},"last":0.50600000000000001}]},{"osd":3,"last update":"Fri Oct 6 01:22:29 2023","interfaces":[{"interface":"back","average":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"min":{"1min":0.28399999999999997,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":2.7559999999999998,"5min":2.7559999999999998,"15min":2.7559999999999998},"last":0.40000000000000002},{"interface":"front","average":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":2.8140000000000001,"5min":2.8140000000000001,"15min":2.8140000000000001},"last":0.442}]},{"osd":4,"last update":"Fri Oct 6 01:22:29 2023","interfaces":[{"interface":"back","average":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.81299999999999994},"min":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.397,"5min":1.397,"15min":1.397},"last":0.83399999999999996},{"interface":"front","average":{"1min":0.86399999999999999,"5min":0.86399999999999999,"15min":0.86399999999999999},"min":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"max":{"1min":1.833,"5min":1.833,"15min":1.833},"last":0.67400000000000004}]},{"osd":5,"last update":"Fri Oct 6 01:22:29 2023","interfaces":[{"interface":"back","average":{"1min":0.84199999999999997,"5min":0.84199999999999997,"15min":0.84199999999999997},"min":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":1.4430000000000001,"5min":1.4430000000000001,"15min":1.4430000000000001},"last":0.74299999999999999},{"interface":"front","average":{"1min":0.81499999999999995,"5min":0.81499999999999995,"15min":0.81499999999999995},"min":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":1.4359999999999999,"5min":1.4359999999999999,"15min":1.4359999999999999},"last":0.73099999999999998}]},{"osd":6,"last update":"Fri Oct 6 01:22:29 2023","interfaces":[{"interface":"back","average":{"1min":0.93100000000000005,"5min":0.93100000000000005,"15min":0.93100000000000005},"min":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":1.8740000000000001,"5min":1.8740000000000001,"15min":1.8740000000000001},"last":0.623},{"interface":"front","average":{"1min":0.85899999999999999,"5min":0.85899999999999999,"15min":0.85899999999999999},"min":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"max":{"1min":1.361,"5min":1.361,"15min":1.361},"last":0.80100000000000005}]},{"osd":7,"last update":"Fri Oct 6 01:22:29 2023","interfaces":[{"interface":"back","average":{"1min":0.871,"5min":0.871,"15min":0.871},"min":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"max":{"1min":1.413,"5min":1.413,"15min":1.413},"last":0.71199999999999997},{"interface":"front","average":{"1min":0.83699999999999997,"5min":0.83699999999999997,"15min":0.83699999999999997},"min":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":1.2929999999999999,"5min":1.2929999999999999,"15min":1.2929999999999999},"last":0.77600000000000002}]}]},{"osd":2,"up_from":13,"seq":55834574868,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301840,"kb_used_data":456,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94070000,"statfs":{"total":96636764160,"available":96327680000,"internally_reserved":0,"allocated":466944,"data_stored":203561,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 01:22:30 2023","interfaces":[{"interface":"back","average":{"1min":0.497,"5min":0.497,"15min":0.497},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.96599999999999997,"5min":0.96599999999999997,"15min":0.96599999999999997},"last":0.44700000000000001},{"interface":"front","average":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":1,"5min":1,"15min":1},"last":0.372}]},{"osd":1,"last update":"Fri Oct 6 01:22:30 2023","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":1.296,"5min":1.296,"15min":1.296},"last":0.42499999999999999},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":1.1379999999999999,"5min":1.1379999999999999,"15min":1.1379999999999999},"last":0.51500000000000001}]},{"osd":3,"last update":"Fri Oct 6 01:22:30 2023","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":1.222,"5min":1.222,"15min":1.222},"last":0.53200000000000003},{"interface":"front","average":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"last":0.57599999999999996}]},{"osd":4,"last update":"Fri Oct 6 01:22:30 2023","interfaces":[{"interface":"back","average":{"1min":0.73699999999999999,"5min":0.73699999999999999,"15min":0.73699999999999999},"min":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"max":{"1min":1.0700000000000001,"5min":1.0700000000000001,"15min":1.0700000000000001},"last":0.89300000000000002},{"interface":"front","average":{"1min":0.83999999999999997,"5min":0.83999999999999997,"15min":0.83999999999999997},"min":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":1.5469999999999999,"5min":1.5469999999999999,"15min":1.5469999999999999},"last":0.97599999999999998}]},{"osd":5,"last update":"Fri Oct 6 01:22:30 2023","interfaces":[{"interface":"back","average":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":1.5940000000000001,"5min":1.5940000000000001,"15min":1.5940000000000001},"last":0.876},{"interface":"front","average":{"1min":0.88400000000000001,"5min":0.88400000000000001,"15min":0.88400000000000001},"min":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":1.7669999999999999,"5min":1.7669999999999999,"15min":1.7669999999999999},"last":0.92300000000000004}]},{"osd":6,"last update":"Fri Oct 6 01:22:30 2023","interfaces":[{"interface":"back","average":{"1min":0.93600000000000005,"5min":0.93600000000000005,"15min":0.93600000000000005},"min":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":2.0510000000000002,"5min":2.0510000000000002,"15min":2.0510000000000002},"last":0.85599999999999998},{"interface":"front","average":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":0.79200000000000004},"min":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":1.633,"5min":1.633,"15min":1.633},"last":0.94599999999999995}]},{"osd":7,"last update":"Fri Oct 6 01:22:30 2023","interfaces":[{"interface":"back","average":{"1min":0.84299999999999997,"5min":0.84299999999999997,"15min":0.84299999999999997},"min":{"1min":0.62,"5min":0.62,"15min":0.62},"max":{"1min":1.4670000000000001,"5min":1.4670000000000001,"15min":1.4670000000000001},"last":0.91000000000000003},{"interface":"front","average":{"1min":0.88600000000000001,"5min":0.88600000000000001,"15min":0.88600000000000001},"min":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":1.8,"5min":1.8,"15min":1.8},"last":0.96299999999999997}]}]},{"osd":3,"up_from":13,"seq":55834574868,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301824,"kb_used_data":440,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94070016,"statfs":{"total":96636764160,"available":96327696384,"internally_reserved":0,"allocated":450560,"data_stored":195652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 01:22:29 2023","interfaces":[{"interface":"back","average":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"min":{"1min":0.29399999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"last":0.317},{"interface":"front","average":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.69199999999999995,"5min":0.69199999999999995,"15min":0.69199999999999995},"last":0.42599999999999999}]},{"osd":1,"last update":"Fri Oct 6 01:22:29 2023","interfaces":[{"interface":"back","average":{"1min":0.504,"5min":0.504,"15min":0.504},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":1.075,"5min":1.075,"15min":1.075},"last":0.45300000000000001},{"interface":"front","average":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.66000000000000003,"5min":0.66000000000000003,"15min":0.66000000000000003},"last":0.47799999999999998}]},{"osd":2,"last update":"Fri Oct 6 01:22:29 2023","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":1.4319999999999999,"5min":1.4319999999999999,"15min":1.4319999999999999},"last":0.497},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":1.532,"5min":1.532,"15min":1.532},"last":0.51300000000000001}]},{"osd":4,"last update":"Fri Oct 6 01:22:29 2023","interfaces":[{"interface":"back","average":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":1.1080000000000001,"5min":1.1080000000000001,"15min":1.1080000000000001},"last":0.89900000000000002},{"interface":"front","average":{"1min":0.86099999999999999,"5min":0.86099999999999999,"15min":0.86099999999999999},"min":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":1.353,"5min":1.353,"15min":1.353},"last":0.84799999999999998}]},{"osd":5,"last update":"Fri Oct 6 01:22:29 2023","interfaces":[{"interface":"back","average":{"1min":0.79900000000000004,"5min":0.79900000000000004,"15min":0.79900000000000004},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.3149999999999999,"5min":1.3149999999999999,"15min":1.3149999999999999},"last":0.873},{"interface":"front","average":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"min":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"max":{"1min":1.155,"5min":1.155,"15min":1.155},"last":0.67900000000000005}]},{"osd":6,"last update":"Fri Oct 6 01:22:29 2023","interfaces":[{"interface":"back","average":{"1min":0.86799999999999999,"5min":0.86799999999999999,"15min":0.86799999999999999},"min":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":1.1479999999999999,"5min":1.1479999999999999,"15min":1.1479999999999999},"last":0.85999999999999999},{"interface":"front","average":{"1min":0.871,"5min":0.871,"15min":0.871},"min":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.3779999999999999,"5min":1.3779999999999999,"15min":1.3779999999999999},"last":0.81999999999999995}]},{"osd":7,"last update":"Fri Oct 6 01:22:29 2023","interfaces":[{"interface":"back","average":{"1min":0.86099999999999999,"5min":0.86099999999999999,"15min":0.86099999999999999},"min":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"max":{"1min":1.075,"5min":1.075,"15min":1.075},"last":0.79300000000000004},{"interface":"front","average":{"1min":0.90400000000000003,"5min":0.90400000000000003,"15min":0.90400000000000003},"min":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"max":{"1min":1.097,"5min":1.097,"15min":1.097},"last":0.80400000000000005}]}]},{"osd":4,"up_from":13,"seq":55834574868,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297740,"kb_used_data":452,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074100,"statfs":{"total":96636764160,"available":96331878400,"internally_reserved":0,"allocated":462848,"data_stored":203539,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 01:22:32 2023","interfaces":[{"interface":"back","average":{"1min":0.624,"5min":0.624,"15min":0.624},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.93000000000000005,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.53600000000000003},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":0.96499999999999997,"5min":0.96499999999999997,"15min":0.96499999999999997},"last":0.65500000000000003}]},{"osd":1,"last update":"Fri Oct 6 01:22:32 2023","interfaces":[{"interface":"back","average":{"1min":0.66700000000000004,"5min":0.66700000000000004,"15min":0.66700000000000004},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":1.04,"5min":1.04,"15min":1.04},"last":0.60099999999999998},{"interface":"front","average":{"1min":0.68899999999999995,"5min":0.68899999999999995,"15min":0.68899999999999995},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":0.92000000000000004,"5min":0.92000000000000004,"15min":0.92000000000000004},"last":0.72499999999999998}]},{"osd":2,"last update":"Fri Oct 6 01:22:32 2023","interfaces":[{"interface":"back","average":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"min":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.087,"5min":1.087,"15min":1.087},"last":0.78000000000000003},{"interface":"front","average":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":0.93100000000000005,"5min":0.93100000000000005,"15min":0.93100000000000005},"last":0.67900000000000005}]},{"osd":3,"last update":"Fri Oct 6 01:22:32 2023","interfaces":[{"interface":"back","average":{"1min":0.73699999999999999,"5min":0.73699999999999999,"15min":0.73699999999999999},"min":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":1.0189999999999999,"5min":1.0189999999999999,"15min":1.0189999999999999},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.80100000000000005,"5min":0.80100000000000005,"15min":0.80100000000000005},"min":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":1.143,"5min":1.143,"15min":1.143},"last":0.82699999999999996}]},{"osd":5,"last update":"Fri Oct 6 01:22:32 2023","interfaces":[{"interface":"back","average":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.96499999999999997,"5min":0.96499999999999997,"15min":0.96499999999999997},"last":0.63400000000000001},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"min":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":0.97999999999999998,"5min":0.97999999999999998,"15min":0.97999999999999998},"last":0.69199999999999995}]},{"osd":6,"last update":"Fri Oct 6 01:22:32 2023","interfaces":[{"interface":"back","average":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":1.1779999999999999,"5min":1.1779999999999999,"15min":1.1779999999999999},"last":0.64400000000000002},{"interface":"front","average":{"1min":0.79900000000000004,"5min":0.79900000000000004,"15min":0.79900000000000004},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":1.1379999999999999,"5min":1.1379999999999999,"15min":1.1379999999999999},"last":0.76500000000000001}]},{"osd":7,"last update":"Fri Oct 6 01:22:32 2023","interfaces":[{"interface":"back","average":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":1.0249999999999999,"5min":1.0249999999999999,"15min":1.0249999999999999},"last":0.751},{"interface":"front","average":{"1min":0.83999999999999997,"5min":0.83999999999999997,"15min":0.83999999999999997},"min":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":1.2290000000000001,"5min":1.2290000000000001,"15min":1.2290000000000001},"last":0.86199999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574870,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297716,"kb_used_data":428,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074124,"statfs":{"total":96636764160,"available":96331902976,"internally_reserved":0,"allocated":438272,"data_stored":194134,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 01:22:32 2023","interfaces":[{"interface":"back","average":{"1min":0.64900000000000002,"5min":0.64900000000000002,"15min":0.64900000000000002},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.94699999999999995,"5min":0.94699999999999995,"15min":0.94699999999999995},"last":0.60999999999999999},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.93500000000000005,"5min":0.93500000000000005,"15min":0.93500000000000005},"last":0.74199999999999999}]},{"osd":1,"last update":"Fri Oct 6 01:22:32 2023","interfaces":[{"interface":"back","average":{"1min":0.628,"5min":0.628,"15min":0.628},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":1.028,"5min":1.028,"15min":1.028},"last":0.86199999999999999},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":1.1000000000000001,"5min":1.1000000000000001,"15min":1.1000000000000001},"last":1.103}]},{"osd":2,"last update":"Fri Oct 6 01:22:32 2023","interfaces":[{"interface":"back","average":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":0.98499999999999999,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.95699999999999996},{"interface":"front","average":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":1.0229999999999999,"5min":1.0229999999999999,"15min":1.0229999999999999},"last":0.80000000000000004}]},{"osd":3,"last update":"Fri Oct 6 01:22:32 2023","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.96999999999999997,"5min":0.96999999999999997,"15min":0.96999999999999997},"last":0.84099999999999997},{"interface":"front","average":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"min":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"max":{"1min":1.6419999999999999,"5min":1.6419999999999999,"15min":1.6419999999999999},"last":1.04}]},{"osd":4,"last update":"Fri Oct 6 01:22:32 2023","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":1.0389999999999999,"5min":1.0389999999999999,"15min":1.0389999999999999},"last":0.71499999999999997},{"interface":"front","average":{"1min":0.65900000000000003,"5min":0.65900000000000003,"15min":0.65900000000000003},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":1.024,"5min":1.024,"15min":1.024},"last":0.93500000000000005}]},{"osd":6,"last update":"Fri Oct 6 01:22:32 2023","interfaces":[{"interface":"back","average":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":1.091,"5min":1.091,"15min":1.091},"last":1.131},{"interface":"front","average":{"1min":0.68899999999999995,"5min":0.68899999999999995,"15min":0.68899999999999995},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":1.0580000000000001,"5min":1.0580000000000001,"15min":1.0580000000000001},"last":1.02}]},{"osd":7,"last update":"Fri Oct 6 01:22:32 2023","interfaces":[{"interface":"back","average":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":1.0660000000000001,"5min":1.0660000000000001,"15min":1.0660000000000001},"last":0.98999999999999999},{"interface":"front","average":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.83599999999999997},"min":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":1.1950000000000001,"5min":1.1950000000000001,"15min":1.1950000000000001},"last":1.198}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":610,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":644,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-06T01:23:01.772 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-10-06T01:23:01.772 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-10-06T01:23:02.001 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:02.000+0000 7f727f59e700 1 Processor -- start 2023-10-06T01:23:02.002 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:02.001+0000 7f727f59e700 1 -- start start 2023-10-06T01:23:02.003 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:02.002+0000 7f727f59e700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f7280156130 0x7f7280159ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:23:02.003 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:02.002+0000 7f727f59e700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f72800ae0f0 0x7f72800c8a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:23:02.003 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:02.002+0000 7f727f59e700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f72800acb10 con 0x7f72800c8f70 2023-10-06T01:23:02.004 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:02.002+0000 7f727f59e700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7280156500 con 0x7f7280156130 2023-10-06T01:23:02.004 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:02.002+0000 7f727f59e700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f728015a310 con 0x7f72800ae0f0 2023-10-06T01:23:02.004 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:02.002+0000 7f727e59c700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f7280156130 0x7f7280159ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:23:02.004 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:02.002+0000 7f727dd9b700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f72800ae0f0 0x7f72800c8a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:23:02.004 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:02.002+0000 7f727e59c700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f7280156130 0x7f7280159ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.50:50138/0 (socket says 172.21.15.50:50138) 2023-10-06T01:23:02.004 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:02.002+0000 7f727e59c700 1 -- 172.21.15.50:0/1180548796 learned_addr learned my addr 172.21.15.50:0/1180548796 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-06T01:23:02.006 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:02.003+0000 7f727dd9b700 1 -- 172.21.15.50:0/1180548796 >> v2:172.21.15.155:3300/0 conn(0x7f7280156130 msgr2=0x7f7280159ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:23:02.006 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:02.003+0000 7f727dd9b700 1 --2- 172.21.15.50:0/1180548796 >> v2:172.21.15.155:3300/0 conn(0x7f7280156130 0x7f7280159ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:23:02.006 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:02.003+0000 7f727dd9b700 1 -- 172.21.15.50:0/1180548796 >> v1:172.21.15.155:6789/0 conn(0x7f72800c8f70 legacy=0x7f728006e1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:23:02.006 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:02.003+0000 7f727dd9b700 1 -- 172.21.15.50:0/1180548796 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f728015a5f0 con 0x7f72800ae0f0 2023-10-06T01:23:02.006 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:02.003+0000 7f727e59c700 1 --2- 172.21.15.50:0/1180548796 >> v2:172.21.15.155:3300/0 conn(0x7f7280156130 0x7f7280159ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T01:23:02.006 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:02.003+0000 7f727dd9b700 1 --2- 172.21.15.50:0/1180548796 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f72800ae0f0 0x7f72800c8a30 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f727400bb90 tx=0x7f727400b430 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c6b02e391697e3c5 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:23:02.006 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:02.003+0000 7f727d59a700 1 -- 172.21.15.50:0/1180548796 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f727400db40 con 0x7f72800ae0f0 2023-10-06T01:23:02.006 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:02.004+0000 7f727d59a700 1 -- 172.21.15.50:0/1180548796 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f727400dca0 con 0x7f72800ae0f0 2023-10-06T01:23:02.006 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:02.004+0000 7f727d59a700 1 -- 172.21.15.50:0/1180548796 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72740196b0 con 0x7f72800ae0f0 2023-10-06T01:23:02.007 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:02.004+0000 7f727f59e700 1 -- 172.21.15.50:0/1180548796 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f72800ae0f0 msgr2=0x7f72800c8a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:23:02.007 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:02.004+0000 7f727f59e700 1 --2- 172.21.15.50:0/1180548796 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f72800ae0f0 0x7f72800c8a30 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f727400bb90 tx=0x7f727400b430 comp rx=0 tx=0).stop 2023-10-06T01:23:02.007 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:02.004+0000 7f727f59e700 1 -- 172.21.15.50:0/1180548796 shutdown_connections 2023-10-06T01:23:02.007 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:02.004+0000 7f727f59e700 1 --2- 172.21.15.50:0/1180548796 >> v2:172.21.15.155:3300/0 conn(0x7f7280156130 0x7f7280159ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:23:02.007 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:02.004+0000 7f727f59e700 1 --2- 172.21.15.50:0/1180548796 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f72800ae0f0 0x7f72800c8a30 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:23:02.007 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:02.004+0000 7f727f59e700 1 -- 172.21.15.50:0/1180548796 >> 172.21.15.50:0/1180548796 conn(0x7f72800cbf10 msgr2=0x7f72800cc310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:23:02.007 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:02.004+0000 7f727f59e700 1 -- 172.21.15.50:0/1180548796 shutdown_connections 2023-10-06T01:23:02.007 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:02.004+0000 7f727f59e700 1 -- 172.21.15.50:0/1180548796 wait complete. 2023-10-06T01:23:02.010 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:02.006+0000 7f727f59e700 1 Processor -- start 2023-10-06T01:23:02.010 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:02.006+0000 7f727f59e700 1 -- start start 2023-10-06T01:23:02.010 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:02.007+0000 7f727f59e700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f72800ae0f0 0x7f7280159760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:23:02.010 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:02.007+0000 7f727f59e700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f72800c8f70 0x7f72801566d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:23:02.010 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:02.007+0000 7f727f59e700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7280156130 0x7f728016e4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:23:02.010 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:02.007+0000 7f727f59e700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7280157b30 con 0x7f72800c8f70 2023-10-06T01:23:02.010 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:02.007+0000 7f727f59e700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7280156f20 con 0x7f72800ae0f0 2023-10-06T01:23:02.010 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:02.007+0000 7f727f59e700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7280157200 con 0x7f7280156130 2023-10-06T01:23:02.010 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:02.007+0000 7f727e59c700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f72800ae0f0 0x7f7280159760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:23:02.011 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:02.007+0000 7f727dd9b700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f72800c8f70 0x7f72801566d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:23:02.011 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:02.007+0000 7f727e59c700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f72800ae0f0 0x7f7280159760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.50:50146/0 (socket says 172.21.15.50:50146) 2023-10-06T01:23:02.011 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:02.007+0000 7f727e59c700 1 -- 172.21.15.50:0/1841097679 learned_addr learned my addr 172.21.15.50:0/1841097679 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-06T01:23:02.011 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:02.007+0000 7f727ed9d700 1 --2- 172.21.15.50:0/1841097679 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7280156130 0x7f728016e4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:23:02.011 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:02.008+0000 7f727e59c700 1 -- 172.21.15.50:0/1841097679 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7280156130 msgr2=0x7f728016e4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:23:02.011 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:02.008+0000 7f727e59c700 1 --2- 172.21.15.50:0/1841097679 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7280156130 0x7f728016e4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:23:02.011 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:02.008+0000 7f727e59c700 1 -- 172.21.15.50:0/1841097679 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f72800c8f70 msgr2=0x7f72801566d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:23:02.011 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:02.008+0000 7f727e59c700 1 --2- 172.21.15.50:0/1841097679 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f72800c8f70 0x7f72801566d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:23:02.011 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:02.008+0000 7f727e59c700 1 -- 172.21.15.50:0/1841097679 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72700094f0 con 0x7f72800ae0f0 2023-10-06T01:23:02.011 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:02.008+0000 7f727dd9b700 1 --2- 172.21.15.50:0/1841097679 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f72800c8f70 0x7f72801566d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T01:23:02.011 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:02.008+0000 7f727e59c700 1 --2- 172.21.15.50:0/1841097679 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f72800ae0f0 0x7f7280159760 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f727000ec50 tx=0x7f7270009250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:23:02.011 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:02.008+0000 7f726e7fc700 1 -- 172.21.15.50:0/1841097679 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f727000c850 con 0x7f72800ae0f0 2023-10-06T01:23:02.012 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:02.008+0000 7f726e7fc700 1 -- 172.21.15.50:0/1841097679 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f727000c9b0 con 0x7f72800ae0f0 2023-10-06T01:23:02.012 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:02.008+0000 7f726e7fc700 1 -- 172.21.15.50:0/1841097679 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f727000cd30 con 0x7f72800ae0f0 2023-10-06T01:23:02.012 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:02.008+0000 7f727f59e700 1 -- 172.21.15.50:0/1841097679 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f727400b6d0 con 0x7f72800ae0f0 2023-10-06T01:23:02.012 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:02.008+0000 7f727f59e700 1 -- 172.21.15.50:0/1841097679 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f72801577c0 con 0x7f72800ae0f0 2023-10-06T01:23:02.013 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:02.009+0000 7f727f59e700 1 -- 172.21.15.50:0/1841097679 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7280157ec0 con 0x7f72800ae0f0 2023-10-06T01:23:02.013 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:02.011+0000 7f726e7fc700 1 -- 172.21.15.50:0/1841097679 <== mon.1 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f7270005a00 con 0x7f72800ae0f0 2023-10-06T01:23:02.013 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:02.012+0000 7f726e7fc700 1 --2- 172.21.15.50:0/1841097679 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f7260066f30 0x7f72600693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:23:02.013 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:02.012+0000 7f726e7fc700 1 -- 172.21.15.50:0/1841097679 <== mon.1 v2:172.21.15.155:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f7270084a90 con 0x7f72800ae0f0 2023-10-06T01:23:02.013 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:02.012+0000 7f727dd9b700 1 --2- 172.21.15.50:0/1841097679 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f7260066f30 0x7f72600693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:23:02.014 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:02.013+0000 7f727dd9b700 1 --2- 172.21.15.50:0/1841097679 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f7260066f30 0x7f72600693e0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f727400bfd0 tx=0x7f727401b000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:23:02.016 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:02.016+0000 7f726e7fc700 1 -- 172.21.15.50:0/1841097679 <== mon.1 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f7270051a40 con 0x7f72800ae0f0 2023-10-06T01:23:02.302 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:02.301+0000 7f727f59e700 1 -- 172.21.15.50:0/1841097679 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f728005f270 con 0x7f72800ae0f0 2023-10-06T01:23:02.307 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:02.306+0000 7f726e7fc700 1 -- 172.21.15.50:0/1841097679 <== mon.1 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v9) v1 ==== 190+0+0 (secure 0 0 0) 0x7f72700210e0 con 0x7f72800ae0f0 2023-10-06T01:23:02.309 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:02.308+0000 7f727f59e700 1 -- 172.21.15.50:0/1841097679 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f7260066f30 msgr2=0x7f72600693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:23:02.310 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:02.308+0000 7f727f59e700 1 --2- 172.21.15.50:0/1841097679 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f7260066f30 0x7f72600693e0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f727400bfd0 tx=0x7f727401b000 comp rx=0 tx=0).stop 2023-10-06T01:23:02.310 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:02.308+0000 7f727f59e700 1 -- 172.21.15.50:0/1841097679 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f72800ae0f0 msgr2=0x7f7280159760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:23:02.310 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:02.308+0000 7f727f59e700 1 --2- 172.21.15.50:0/1841097679 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f72800ae0f0 0x7f7280159760 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f727000ec50 tx=0x7f7270009250 comp rx=0 tx=0).stop 2023-10-06T01:23:02.310 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:02.308+0000 7f727f59e700 1 -- 172.21.15.50:0/1841097679 shutdown_connections 2023-10-06T01:23:02.310 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:02.308+0000 7f727f59e700 1 --2- 172.21.15.50:0/1841097679 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7280156130 0x7f728016e4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:23:02.310 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:02.308+0000 7f727f59e700 1 --2- 172.21.15.50:0/1841097679 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f7260066f30 0x7f72600693e0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:23:02.310 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:02.308+0000 7f727f59e700 1 --2- 172.21.15.50:0/1841097679 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f72800ae0f0 0x7f7280159760 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:23:02.310 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:02.308+0000 7f727f59e700 1 --2- 172.21.15.50:0/1841097679 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f72800c8f70 0x7f72801566d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:23:02.310 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:02.308+0000 7f727f59e700 1 -- 172.21.15.50:0/1841097679 >> 172.21.15.50:0/1841097679 conn(0x7f72800cbf10 msgr2=0x7f72800acfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:23:02.311 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:02.309+0000 7f727f59e700 1 -- 172.21.15.50:0/1841097679 shutdown_connections 2023-10-06T01:23:02.311 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:02.309+0000 7f727f59e700 1 -- 172.21.15.50:0/1841097679 wait complete. 2023-10-06T01:23:02.311 INFO:teuthology.orchestra.run.smithi050.stderr:updated caps for client.0 2023-10-06T01:23:02.328 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T01:23:02.514 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:02.513+0000 7ff64579d700 1 Processor -- start 2023-10-06T01:23:02.515 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:02.513+0000 7ff64579d700 1 -- start start 2023-10-06T01:23:02.515 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:02.515+0000 7ff64579d700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7ff64006a5d0 0x7ff640153730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:23:02.515 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:02.515+0000 7ff64579d700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff64006a9a0 0x7ff640153c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:23:02.516 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:02.515+0000 7ff64579d700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff6400c9d00 con 0x7ff64006df90 2023-10-06T01:23:02.516 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:02.515+0000 7ff64579d700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff64006f5a0 con 0x7ff64006a5d0 2023-10-06T01:23:02.516 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:02.515+0000 7ff64579d700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff64006eb00 con 0x7ff64006a9a0 2023-10-06T01:23:02.517 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:02.515+0000 7ff63f7fe700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff64006a9a0 0x7ff640153c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:23:02.517 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:02.515+0000 7ff63ffff700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7ff64006a5d0 0x7ff640153730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:23:02.517 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:02.515+0000 7ff63f7fe700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff64006a9a0 0x7ff640153c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3301/0 says I am v2:172.21.15.50:52604/0 (socket says 172.21.15.50:52604) 2023-10-06T01:23:02.517 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:02.515+0000 7ff63f7fe700 1 -- 172.21.15.50:0/3734444997 learned_addr learned my addr 172.21.15.50:0/3734444997 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-06T01:23:02.517 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:02.515+0000 7ff63f7fe700 1 -- 172.21.15.50:0/3734444997 >> v2:172.21.15.155:3300/0 conn(0x7ff64006a5d0 msgr2=0x7ff640153730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:23:02.517 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:02.515+0000 7ff63f7fe700 1 --2- 172.21.15.50:0/3734444997 >> v2:172.21.15.155:3300/0 conn(0x7ff64006a5d0 0x7ff640153730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:23:02.517 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:02.516+0000 7ff63f7fe700 1 -- 172.21.15.50:0/3734444997 >> v1:172.21.15.155:6789/0 conn(0x7ff64006df90 legacy=0x7ff64006e3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:23:02.518 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:02.516+0000 7ff63f7fe700 1 -- 172.21.15.50:0/3734444997 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6400c6750 con 0x7ff64006a9a0 2023-10-06T01:23:02.518 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:02.516+0000 7ff63f7fe700 1 --2- 172.21.15.50:0/3734444997 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff64006a9a0 0x7ff640153c70 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7ff6340099b0 tx=0x7ff634009250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e2d5e26b04b3eebe server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:23:02.518 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:02.516+0000 7ff63effd700 1 -- 172.21.15.50:0/3734444997 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff634009ea0 con 0x7ff64006a9a0 2023-10-06T01:23:02.518 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:02.516+0000 7ff63effd700 1 -- 172.21.15.50:0/3734444997 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff63400b860 con 0x7ff64006a9a0 2023-10-06T01:23:02.518 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:02.516+0000 7ff63effd700 1 -- 172.21.15.50:0/3734444997 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff63400bc00 con 0x7ff64006a9a0 2023-10-06T01:23:02.519 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:02.517+0000 7ff64579d700 1 -- 172.21.15.50:0/3734444997 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff64006a9a0 msgr2=0x7ff640153c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:23:02.519 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:02.517+0000 7ff64579d700 1 --2- 172.21.15.50:0/3734444997 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff64006a9a0 0x7ff640153c70 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7ff6340099b0 tx=0x7ff634009250 comp rx=0 tx=0).stop 2023-10-06T01:23:02.519 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:02.517+0000 7ff64579d700 1 -- 172.21.15.50:0/3734444997 shutdown_connections 2023-10-06T01:23:02.519 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:02.517+0000 7ff64579d700 1 --2- 172.21.15.50:0/3734444997 >> v2:172.21.15.155:3300/0 conn(0x7ff64006a5d0 0x7ff640153730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:23:02.519 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:02.517+0000 7ff64579d700 1 --2- 172.21.15.50:0/3734444997 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff64006a9a0 0x7ff640153c70 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:23:02.519 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:02.517+0000 7ff64579d700 1 -- 172.21.15.50:0/3734444997 >> 172.21.15.50:0/3734444997 conn(0x7ff6400680c0 msgr2=0x7ff6400cbf00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:23:02.519 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:02.517+0000 7ff64579d700 1 -- 172.21.15.50:0/3734444997 shutdown_connections 2023-10-06T01:23:02.519 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:02.517+0000 7ff64579d700 1 -- 172.21.15.50:0/3734444997 wait complete. 2023-10-06T01:23:02.520 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:02.518+0000 7ff64579d700 1 Processor -- start 2023-10-06T01:23:02.520 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:02.518+0000 7ff64579d700 1 -- start start 2023-10-06T01:23:02.521 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:02.519+0000 7ff64579d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff64006a5d0 0x7ff6400cb060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:23:02.521 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:02.519+0000 7ff64579d700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff64006a9a0 0x7ff6400cb5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:23:02.521 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:02.519+0000 7ff64579d700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff64006df90 0x7ff640165220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:23:02.521 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:02.519+0000 7ff64579d700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6401661f0 con 0x7ff64006a5d0 2023-10-06T01:23:02.521 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:02.519+0000 7ff64579d700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6401664d0 con 0x7ff64006a9a0 2023-10-06T01:23:02.521 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:02.519+0000 7ff64579d700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff6401667b0 con 0x7ff64006df90 2023-10-06T01:23:02.521 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:02.519+0000 7ff63f7fe700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff64006a9a0 0x7ff6400cb5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:23:02.521 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:02.519+0000 7ff63ffff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff64006a5d0 0x7ff6400cb060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:23:02.521 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:02.519+0000 7ff63f7fe700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff64006a9a0 0x7ff6400cb5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.50:50166/0 (socket says 172.21.15.50:50166) 2023-10-06T01:23:02.522 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:02.519+0000 7ff63f7fe700 1 -- 172.21.15.50:0/4103838952 learned_addr learned my addr 172.21.15.50:0/4103838952 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-06T01:23:02.522 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:02.519+0000 7ff644f9c700 1 --2- 172.21.15.50:0/4103838952 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff64006df90 0x7ff640165220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:23:02.522 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:02.520+0000 7ff63f7fe700 1 -- 172.21.15.50:0/4103838952 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff64006df90 msgr2=0x7ff640165220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:23:02.522 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:02.520+0000 7ff63f7fe700 1 --2- 172.21.15.50:0/4103838952 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff64006df90 0x7ff640165220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:23:02.522 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:02.520+0000 7ff63f7fe700 1 -- 172.21.15.50:0/4103838952 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff64006a5d0 msgr2=0x7ff6400cb060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:23:02.522 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:02.520+0000 7ff63f7fe700 1 --2- 172.21.15.50:0/4103838952 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff64006a5d0 0x7ff6400cb060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:23:02.522 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:02.520+0000 7ff63f7fe700 1 -- 172.21.15.50:0/4103838952 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6340094f0 con 0x7ff64006a9a0 2023-10-06T01:23:02.522 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:02.520+0000 7ff63ffff700 1 --2- 172.21.15.50:0/4103838952 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff64006a5d0 0x7ff6400cb060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T01:23:02.522 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:02.520+0000 7ff63f7fe700 1 --2- 172.21.15.50:0/4103838952 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff64006a9a0 0x7ff6400cb5a0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7ff6340094c0 tx=0x7ff634019000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:23:02.523 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:02.520+0000 7ff627fff700 1 -- 172.21.15.50:0/4103838952 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff63401e070 con 0x7ff64006a9a0 2023-10-06T01:23:02.523 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:02.520+0000 7ff627fff700 1 -- 172.21.15.50:0/4103838952 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff634000c90 con 0x7ff64006a9a0 2023-10-06T01:23:02.523 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:02.521+0000 7ff64579d700 1 -- 172.21.15.50:0/4103838952 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff640166b00 con 0x7ff64006a9a0 2023-10-06T01:23:02.524 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:02.521+0000 7ff627fff700 1 -- 172.21.15.50:0/4103838952 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff634010470 con 0x7ff64006a9a0 2023-10-06T01:23:02.524 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:02.521+0000 7ff64579d700 1 -- 172.21.15.50:0/4103838952 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff6400b17c0 con 0x7ff64006a9a0 2023-10-06T01:23:02.524 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:02.522+0000 7ff64579d700 1 -- 172.21.15.50:0/4103838952 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff64005f270 con 0x7ff64006a9a0 2023-10-06T01:23:02.524 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:02.522+0000 7ff627fff700 1 -- 172.21.15.50:0/4103838952 <== mon.1 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7ff634022070 con 0x7ff64006a9a0 2023-10-06T01:23:02.524 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:02.523+0000 7ff627fff700 1 --2- 172.21.15.50:0/4103838952 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7ff62c066f30 0x7ff62c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:23:02.524 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:02.523+0000 7ff627fff700 1 -- 172.21.15.50:0/4103838952 <== mon.1 v2:172.21.15.155:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6378+0+0 (secure 0 0 0) 0x7ff634014070 con 0x7ff64006a9a0 2023-10-06T01:23:02.525 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:02.524+0000 7ff63ffff700 1 --2- 172.21.15.50:0/4103838952 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7ff62c066f30 0x7ff62c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:23:02.525 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:02.524+0000 7ff63ffff700 1 --2- 172.21.15.50:0/4103838952 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7ff62c066f30 0x7ff62c0693e0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7ff630011480 tx=0x7ff6300091a0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:23:02.528 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:02.528+0000 7ff627fff700 1 -- 172.21.15.50:0/4103838952 <== mon.1 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff634054780 con 0x7ff64006a9a0 2023-10-06T01:23:02.778 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:02.777+0000 7ff64579d700 1 -- 172.21.15.50:0/4103838952 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff640166610 con 0x7ff64006a9a0 2023-10-06T01:23:02.779 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:02.778+0000 7ff627fff700 1 -- 172.21.15.50:0/4103838952 <== mon.1 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) v1 ==== 94+0+4603 (secure 0 0 0) 0x7ff640166610 con 0x7ff64006a9a0 2023-10-06T01:23:02.779 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-10-06T01:23:02.779 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":18,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4769,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6833/3835292201","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6832","nonce":3835292201},{"type":"v1","addr":"172.21.15.50:6833","nonce":3835292201}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":13},{"gid":4772,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6837/2073318681","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6835","nonce":2073318681},{"type":"v1","addr":"172.21.15.155:6837","nonce":2073318681}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":13},{"gid":4993,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6836/2652534948","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":2652534948},{"type":"v1","addr":"172.21.15.155:6836","nonce":2652534948}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":18,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T01:22:56.416443+0000","modified":"2023-10-06T01:22:59.935058+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5160},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5160":{"gid":5160,"name":"c","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.50:6835/3957156573","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6834","nonce":3957156573},{"type":"v1","addr":"172.21.15.50:6835","nonce":3957156573}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2}]} 2023-10-06T01:23:02.782 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:02.781+0000 7ff64579d700 1 -- 172.21.15.50:0/4103838952 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7ff62c066f30 msgr2=0x7ff62c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:23:02.782 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:02.781+0000 7ff64579d700 1 --2- 172.21.15.50:0/4103838952 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7ff62c066f30 0x7ff62c0693e0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7ff630011480 tx=0x7ff6300091a0 comp rx=0 tx=0).stop 2023-10-06T01:23:02.782 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:02.781+0000 7ff64579d700 1 -- 172.21.15.50:0/4103838952 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff64006a9a0 msgr2=0x7ff6400cb5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:23:02.782 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:02.781+0000 7ff64579d700 1 --2- 172.21.15.50:0/4103838952 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff64006a9a0 0x7ff6400cb5a0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7ff6340094c0 tx=0x7ff634019000 comp rx=0 tx=0).stop 2023-10-06T01:23:02.782 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:02.781+0000 7ff64579d700 1 -- 172.21.15.50:0/4103838952 shutdown_connections 2023-10-06T01:23:02.782 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:02.781+0000 7ff64579d700 1 --2- 172.21.15.50:0/4103838952 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff64006df90 0x7ff640165220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:23:02.782 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:02.781+0000 7ff64579d700 1 --2- 172.21.15.50:0/4103838952 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff64006a5d0 0x7ff6400cb060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:23:02.782 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:02.781+0000 7ff64579d700 1 --2- 172.21.15.50:0/4103838952 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7ff62c066f30 0x7ff62c0693e0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:23:02.783 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:02.781+0000 7ff64579d700 1 --2- 172.21.15.50:0/4103838952 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff64006a9a0 0x7ff6400cb5a0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:23:02.783 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:02.781+0000 7ff64579d700 1 -- 172.21.15.50:0/4103838952 >> 172.21.15.50:0/4103838952 conn(0x7ff6400680c0 msgr2=0x7ff640154b40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:23:02.783 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:02.781+0000 7ff64579d700 1 -- 172.21.15.50:0/4103838952 shutdown_connections 2023-10-06T01:23:02.783 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:02.781+0000 7ff64579d700 1 -- 172.21.15.50:0/4103838952 wait complete. 2023-10-06T01:23:02.783 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 18 2023-10-06T01:23:03.201 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 18, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-10-06T01:22:56.416443+0000', 'modified': '2023-10-06T01:22:59.935058+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5160}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5160': {'gid': 5160, 'name': 'c', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.50:6835/3957156573', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.50:6834', 'nonce': 3957156573}, {'type': 'v1', 'addr': '172.21.15.50:6835', 'nonce': 3957156573}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138320759226367, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [7], 'metadata_pool': 6, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2023-10-06T01:23:03.202 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-10-06T01:23:03.202 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2023-10-06T01:23:03.392 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:03.391+0000 7f954919d700 1 Processor -- start 2023-10-06T01:23:03.393 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:03.391+0000 7f954919d700 1 -- start start 2023-10-06T01:23:03.395 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:03.392+0000 7f954919d700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9544159480 0x7f95440b30d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:23:03.395 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:03.392+0000 7f954919d700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f95440b3610 0x7f95440cbc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:23:03.395 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:03.393+0000 7f954919d700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f95440cb7e0 con 0x7f95440cc1b0 2023-10-06T01:23:03.395 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:03.393+0000 7f954919d700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f95440b08a0 con 0x7f95440b3610 2023-10-06T01:23:03.396 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:03.393+0000 7f954919d700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95440cb190 con 0x7f9544159480 2023-10-06T01:23:03.396 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:03.393+0000 7f954899c700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f95440cc1b0 0x7f95440b2140 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:51828/0 (socket says 172.21.15.50:51828) 2023-10-06T01:23:03.396 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:03.393+0000 7f954899c700 1 -- 172.21.15.50:0/1025980546 learned_addr learned my addr 172.21.15.50:0/1025980546 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-10-06T01:23:03.396 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:03.393+0000 7f95437fe700 1 --2- 172.21.15.50:0/1025980546 >> v2:172.21.15.155:3300/0 conn(0x7f95440b3610 0x7f95440cbc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:23:03.397 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:03.393+0000 7f9543fff700 1 --2- 172.21.15.50:0/1025980546 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9544159480 0x7f95440b30d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:23:03.397 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:03.393+0000 7f9542ffd700 1 -- 172.21.15.50:0/1025980546 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 714024226 0 0) 0x7f95440cb7e0 con 0x7f95440cc1b0 2023-10-06T01:23:03.397 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:03.393+0000 7f9542ffd700 1 -- 172.21.15.50:0/1025980546 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f952c003570 con 0x7f95440cc1b0 2023-10-06T01:23:03.397 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:03.394+0000 7f95437fe700 1 -- 172.21.15.50:0/1025980546 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9544159480 msgr2=0x7f95440b30d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:23:03.397 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:03.394+0000 7f95437fe700 1 --2- 172.21.15.50:0/1025980546 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9544159480 0x7f95440b30d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:23:03.398 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:03.394+0000 7f95437fe700 1 -- 172.21.15.50:0/1025980546 >> v1:172.21.15.50:6789/0 conn(0x7f95440cc1b0 legacy=0x7f95440b2140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:23:03.398 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:03.394+0000 7f95437fe700 1 -- 172.21.15.50:0/1025980546 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95440cb470 con 0x7f95440b3610 2023-10-06T01:23:03.398 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:03.394+0000 7f9543fff700 1 --2- 172.21.15.50:0/1025980546 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9544159480 0x7f95440b30d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T01:23:03.398 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:03.394+0000 7f95437fe700 1 --2- 172.21.15.50:0/1025980546 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f95440b3610 0x7f95440cbc70 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f95380098e0 tx=0x7f95380091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=40b8d4dbca5b22ef server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:23:03.399 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:03.394+0000 7f9542ffd700 1 -- 172.21.15.50:0/1025980546 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9538011630 con 0x7f95440b3610 2023-10-06T01:23:03.399 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:03.394+0000 7f9542ffd700 1 -- 172.21.15.50:0/1025980546 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9538011790 con 0x7f95440b3610 2023-10-06T01:23:03.399 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:03.394+0000 7f9542ffd700 1 -- 172.21.15.50:0/1025980546 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9538011b30 con 0x7f95440b3610 2023-10-06T01:23:03.401 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:03.395+0000 7f954919d700 1 -- 172.21.15.50:0/1025980546 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f95440b3610 msgr2=0x7f95440cbc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:23:03.401 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:03.395+0000 7f954919d700 1 --2- 172.21.15.50:0/1025980546 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f95440b3610 0x7f95440cbc70 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f95380098e0 tx=0x7f95380091a0 comp rx=0 tx=0).stop 2023-10-06T01:23:03.402 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:03.395+0000 7f954919d700 1 -- 172.21.15.50:0/1025980546 shutdown_connections 2023-10-06T01:23:03.402 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:03.395+0000 7f954919d700 1 --2- 172.21.15.50:0/1025980546 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9544159480 0x7f95440b30d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:23:03.402 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:03.395+0000 7f954919d700 1 --2- 172.21.15.50:0/1025980546 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f95440b3610 0x7f95440cbc70 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:23:03.402 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:03.395+0000 7f954919d700 1 -- 172.21.15.50:0/1025980546 >> 172.21.15.50:0/1025980546 conn(0x7f954406ed20 msgr2=0x7f954406f120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:23:03.402 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:03.395+0000 7f954919d700 1 -- 172.21.15.50:0/1025980546 shutdown_connections 2023-10-06T01:23:03.402 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:03.395+0000 7f954919d700 1 -- 172.21.15.50:0/1025980546 wait complete. 2023-10-06T01:23:03.402 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:03.396+0000 7f954919d700 1 Processor -- start 2023-10-06T01:23:03.402 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:03.397+0000 7f954919d700 1 -- start start 2023-10-06T01:23:03.402 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:03.397+0000 7f954919d700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f95440b3610 0x7f954416a330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:23:03.402 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:03.397+0000 7f954919d700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f95440cc1b0 0x7f95440ce8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:23:03.403 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:03.398+0000 7f954919d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9544159480 0x7f954414b730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:23:03.403 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:03.398+0000 7f954919d700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f954416bb50 con 0x7f9544159480 2023-10-06T01:23:03.403 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:03.398+0000 7f954919d700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f954416a870 con 0x7f95440cc1b0 2023-10-06T01:23:03.403 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:03.398+0000 7f954919d700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95440cedf0 con 0x7f95440b3610 2023-10-06T01:23:03.403 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:03.398+0000 7f954899c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9544159480 0x7f954414b730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:23:03.403 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:03.398+0000 7f954899c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9544159480 0x7f954414b730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:53844/0 (socket says 172.21.15.50:53844) 2023-10-06T01:23:03.403 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:03.398+0000 7f954899c700 1 -- 172.21.15.50:0/3205192742 learned_addr learned my addr 172.21.15.50:0/3205192742 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-06T01:23:03.403 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:03.398+0000 7f95437fe700 1 --2- 172.21.15.50:0/3205192742 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f95440cc1b0 0x7f95440ce8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:23:03.403 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:03.398+0000 7f9543fff700 1 --2- 172.21.15.50:0/3205192742 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f95440b3610 0x7f954416a330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:23:03.403 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:03.398+0000 7f954899c700 1 -- 172.21.15.50:0/3205192742 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f95440b3610 msgr2=0x7f954416a330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:23:03.403 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:03.398+0000 7f954899c700 1 --2- 172.21.15.50:0/3205192742 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f95440b3610 0x7f954416a330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:23:03.403 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:03.398+0000 7f954899c700 1 -- 172.21.15.50:0/3205192742 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f95440cc1b0 msgr2=0x7f95440ce8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:23:03.404 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:03.398+0000 7f954899c700 1 --2- 172.21.15.50:0/3205192742 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f95440cc1b0 0x7f95440ce8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:23:03.404 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:03.398+0000 7f954899c700 1 -- 172.21.15.50:0/3205192742 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9534009420 con 0x7f9544159480 2023-10-06T01:23:03.404 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:03.398+0000 7f954899c700 1 --2- 172.21.15.50:0/3205192742 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9544159480 0x7f954414b730 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f953c001460 tx=0x7f953c001ae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:23:03.404 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:03.399+0000 7f952bfff700 1 -- 172.21.15.50:0/3205192742 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f953c00a890 con 0x7f9544159480 2023-10-06T01:23:03.404 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:03.399+0000 7f952bfff700 1 -- 172.21.15.50:0/3205192742 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f953c00a9f0 con 0x7f9544159480 2023-10-06T01:23:03.404 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:03.399+0000 7f954919d700 1 -- 172.21.15.50:0/3205192742 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9538009420 con 0x7f9544159480 2023-10-06T01:23:03.404 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:03.399+0000 7f952bfff700 1 -- 172.21.15.50:0/3205192742 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f953c00ad70 con 0x7f9544159480 2023-10-06T01:23:03.404 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:03.399+0000 7f954919d700 1 -- 172.21.15.50:0/3205192742 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f954416af40 con 0x7f9544159480 2023-10-06T01:23:03.404 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:03.401+0000 7f952bfff700 1 -- 172.21.15.50:0/3205192742 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f953c007300 con 0x7f9544159480 2023-10-06T01:23:03.407 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:03.402+0000 7f952bfff700 1 --2- 172.21.15.50:0/3205192742 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f9530066f30 0x7f95300693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:23:03.407 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:03.402+0000 7f952bfff700 1 -- 172.21.15.50:0/3205192742 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f953c084bb0 con 0x7f9544159480 2023-10-06T01:23:03.407 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:03.402+0000 7f9543fff700 1 --2- 172.21.15.50:0/3205192742 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f9530066f30 0x7f95300693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:23:03.407 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:03.403+0000 7f9543fff700 1 --2- 172.21.15.50:0/3205192742 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f9530066f30 0x7f95300693e0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f9534009ea0 tx=0x7f95340091a0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:23:03.407 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:03.404+0000 7f9558b7db80 1 Processor -- start 2023-10-06T01:23:03.407 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:03.404+0000 7f9558b7db80 1 -- start start 2023-10-06T01:23:03.407 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:03.405+0000 7f9558b7db80 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561015033e50 0x56101500ecc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:23:03.407 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:03.405+0000 7f9558b7db80 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5610150142c0 0x56101500f200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:23:03.407 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:03.405+0000 7f9558b7db80 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x561015015a10 0x56101500f740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:23:03.408 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:03.405+0000 7f9558b7db80 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x561014f69a70 con 0x561015033e50 2023-10-06T01:23:03.408 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:03.405+0000 7f9558b7db80 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x561014f67270 con 0x5610150142c0 2023-10-06T01:23:03.408 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:03.405+0000 7f9558b7db80 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x561014f63060 con 0x561015015a10 2023-10-06T01:23:03.408 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:03.405+0000 7f9543fff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561015033e50 0x56101500ecc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:23:03.408 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:03.405+0000 7f9543fff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561015033e50 0x56101500ecc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:53848/0 (socket says 172.21.15.50:53848) 2023-10-06T01:23:03.408 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:03.405+0000 7f9543fff700 1 -- 172.21.15.50:0/1014874446 learned_addr learned my addr 172.21.15.50:0/1014874446 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-06T01:23:03.408 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:03.405+0000 7f954899c700 1 --2- 172.21.15.50:0/1014874446 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x561015015a10 0x56101500f740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:23:03.408 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:03.405+0000 7f95437fe700 1 --2- 172.21.15.50:0/1014874446 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5610150142c0 0x56101500f200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:23:03.408 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:03.405+0000 7f9543fff700 1 -- 172.21.15.50:0/1014874446 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x561015015a10 msgr2=0x56101500f740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:23:03.408 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:03.405+0000 7f9543fff700 1 --2- 172.21.15.50:0/1014874446 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x561015015a10 0x56101500f740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:23:03.409 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:03.405+0000 7f9543fff700 1 -- 172.21.15.50:0/1014874446 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5610150142c0 msgr2=0x56101500f200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:23:03.409 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:03.405+0000 7f9543fff700 1 --2- 172.21.15.50:0/1014874446 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5610150142c0 0x56101500f200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:23:03.409 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:03.405+0000 7f9543fff700 1 -- 172.21.15.50:0/1014874446 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561014dfd270 con 0x561015033e50 2023-10-06T01:23:03.409 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:03.405+0000 7f954899c700 1 --2- 172.21.15.50:0/1014874446 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x561015015a10 0x56101500f740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T01:23:03.409 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:03.406+0000 7f9543fff700 1 --2- 172.21.15.50:0/1014874446 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561015033e50 0x56101500ecc0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f9534011f60 tx=0x7f9534016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=534258ea84af0f49 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:23:03.409 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:03.406+0000 7f95297fa700 1 -- 172.21.15.50:0/1014874446 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9534014dc0 con 0x561015033e50 2023-10-06T01:23:03.409 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:03.406+0000 7f95297fa700 1 -- 172.21.15.50:0/1014874446 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9534021420 con 0x561015033e50 2023-10-06T01:23:03.409 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:03.406+0000 7f95297fa700 1 -- 172.21.15.50:0/1014874446 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95340217a0 con 0x561015033e50 2023-10-06T01:23:03.414 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:03.406+0000 7f9558b7db80 1 -- 172.21.15.50:0/1014874446 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561015033e50 msgr2=0x56101500ecc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:23:03.414 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:03.406+0000 7f9558b7db80 1 --2- 172.21.15.50:0/1014874446 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561015033e50 0x56101500ecc0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f9534011f60 tx=0x7f9534016000 comp rx=0 tx=0).stop 2023-10-06T01:23:03.414 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:03.407+0000 7f9558b7db80 1 -- 172.21.15.50:0/1014874446 shutdown_connections 2023-10-06T01:23:03.415 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:03.407+0000 7f9558b7db80 1 --2- 172.21.15.50:0/1014874446 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x561015015a10 0x56101500f740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:23:03.415 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:03.407+0000 7f9558b7db80 1 --2- 172.21.15.50:0/1014874446 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561015033e50 0x56101500ecc0 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:23:03.415 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:03.407+0000 7f9558b7db80 1 --2- 172.21.15.50:0/1014874446 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5610150142c0 0x56101500f200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:23:03.415 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:03.407+0000 7f9558b7db80 1 -- 172.21.15.50:0/1014874446 >> 172.21.15.50:0/1014874446 conn(0x561015013e80 msgr2=0x5610150146b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:23:03.415 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:03.407+0000 7f9558b7db80 1 -- 172.21.15.50:0/1014874446 shutdown_connections 2023-10-06T01:23:03.415 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:03.407+0000 7f9558b7db80 1 -- 172.21.15.50:0/1014874446 wait complete. 2023-10-06T01:23:03.415 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:03.407+0000 7f9558b7db80 1 -- start start 2023-10-06T01:23:03.415 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:03.408+0000 7f9558b7db80 1 Processor -- start 2023-10-06T01:23:03.415 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:03.409+0000 7f9558b7db80 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5610150142c0 0x56101503dff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:23:03.415 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:03.409+0000 7f9558b7db80 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x561015015a10 0x5610150585b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:23:03.415 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:03.409+0000 7f9558b7db80 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x561015033e50 0x56101502d570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:23:03.416 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:03.409+0000 7f9558b7db80 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x561014f0e890 con 0x5610150142c0 2023-10-06T01:23:03.416 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:03.409+0000 7f9558b7db80 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x561014f29ea0 con 0x561015015a10 2023-10-06T01:23:03.416 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:03.409+0000 7f9558b7db80 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x561014de5e30 con 0x561015033e50 2023-10-06T01:23:03.416 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:03.409+0000 7f9558b7db80 10 client.0 _ll_register_callbacks cb 0x561014fd6020 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T01:23:03.416 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:03.409+0000 7f9543fff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5610150142c0 0x56101503dff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:23:03.416 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:03.409+0000 7f9543fff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5610150142c0 0x56101503dff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:53858/0 (socket says 172.21.15.50:53858) 2023-10-06T01:23:03.416 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:03.409+0000 7f9543fff700 1 -- 172.21.15.50:0/1053383431 learned_addr learned my addr 172.21.15.50:0/1053383431 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-06T01:23:03.416 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:03.409+0000 7f95437fe700 1 --2- 172.21.15.50:0/1053383431 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x561015015a10 0x5610150585b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:23:03.416 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:03.409+0000 7f954899c700 1 --2- 172.21.15.50:0/1053383431 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x561015033e50 0x56101502d570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:23:03.416 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:03.409+0000 7f9543fff700 1 -- 172.21.15.50:0/1053383431 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x561015033e50 msgr2=0x56101502d570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:23:03.416 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:03.409+0000 7f9543fff700 1 --2- 172.21.15.50:0/1053383431 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x561015033e50 0x56101502d570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:23:03.416 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:03.409+0000 7f9543fff700 1 -- 172.21.15.50:0/1053383431 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x561015015a10 msgr2=0x5610150585b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:23:03.417 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:03.409+0000 7f9543fff700 1 --2- 172.21.15.50:0/1053383431 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x561015015a10 0x5610150585b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:23:03.417 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:03.409+0000 7f9543fff700 1 -- 172.21.15.50:0/1053383431 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f954416af40 con 0x5610150142c0 2023-10-06T01:23:03.417 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:03.410+0000 7f9543fff700 1 --2- 172.21.15.50:0/1053383431 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5610150142c0 0x56101503dff0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f9534009b20 tx=0x7f9534022000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=68089a15f9577f51 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:23:03.417 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:03.410+0000 7f95227fc700 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2023-10-06T01:23:03.417 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:03.410+0000 7f95227fc700 1 -- 172.21.15.50:0/1053383431 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9534021da0 con 0x5610150142c0 2023-10-06T01:23:03.417 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:03.410+0000 7f95227fc700 1 -- 172.21.15.50:0/1053383431 <== mon.0 v2:172.21.15.50:3300/0 2 ==== osd_map(39..39 src has 1..39) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f953402a420 con 0x5610150142c0 2023-10-06T01:23:03.417 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:03.410+0000 7f9558b7db80 1 -- 172.21.15.50:0/1053383431 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x561015007940 con 0x5610150142c0 2023-10-06T01:23:03.417 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:03.410+0000 7f95227fc700 1 -- 172.21.15.50:0/1053383431 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=18) v2 ==== 24+0+0 (secure 0 0 0) 0x7f953402a7f0 con 0x5610150142c0 2023-10-06T01:23:03.417 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:03.410+0000 7f9558b7db80 10 client.5331 fetch_fsmap learned FSMap version 18 2023-10-06T01:23:03.417 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:03.410+0000 7f9558b7db80 1 -- 172.21.15.50:0/1053383431 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=18,monmap=2+}) v3 -- 0x7f9534011c40 con 0x5610150142c0 2023-10-06T01:23:03.417 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:03.410+0000 7f95227fc700 1 -- 172.21.15.50:0/1053383431 <== mon.0 v2:172.21.15.50:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x561015007940 con 0x5610150142c0 2023-10-06T01:23:03.417 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:03.410+0000 7f95227fc700 1 -- 172.21.15.50:0/1053383431 <== mon.0 v2:172.21.15.50:3300/0 5 ==== fsmap(e 18) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f953402a950 con 0x5610150142c0 2023-10-06T01:23:03.418 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:03.410+0000 7f9558b7db80 10 client.5331 fetch_fsmap finished waiting for FSMap version 18 2023-10-06T01:23:03.418 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:03.410+0000 7f9558b7db80 10 client.5331 resolve_mds: resolved name 'c' to daemon mds.c 2023-10-06T01:23:03.418 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:03.411+0000 7f9558b7db80 20 client.5331 populate_metadata read hostname 'smithi050' 2023-10-06T01:23:03.418 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:03.411+0000 7f9558b7db80 1 --2- 172.21.15.50:0/1053383431 >> [v2:172.21.15.50:6834/3957156573,v1:172.21.15.50:6835/3957156573] conn(0x56101502dab0 0x5610150417b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:23:03.418 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:03.411+0000 7f9558b7db80 4 client.5331 mds_command: new command op to 5160 tid=0[{"prefix": "get_command_descriptions"}] 2023-10-06T01:23:03.418 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:03.411+0000 7f9558b7db80 1 -- 172.21.15.50:0/1053383431 --> [v2:172.21.15.50:6834/3957156573,v1:172.21.15.50:6835/3957156573] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x561014fe4870 con 0x56101502dab0 2023-10-06T01:23:03.418 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:03.411+0000 7f95437fe700 1 --2- 172.21.15.50:0/1053383431 >> [v2:172.21.15.50:6834/3957156573,v1:172.21.15.50:6835/3957156573] conn(0x56101502dab0 0x5610150417b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:23:03.418 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:03.411+0000 7f95437fe700 1 --2- 172.21.15.50:0/1053383431 >> [v2:172.21.15.50:6834/3957156573,v1:172.21.15.50:6835/3957156573] conn(0x56101502dab0 0x5610150417b0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3926a3514abea7fb server_cookie=c4a7ce09b6f3c574 in_seq=0 out_seq=0 2023-10-06T01:23:03.418 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:03.411+0000 7f95227fc700 10 client.5331 ms_handle_connect on v2:172.21.15.50:6834/3957156573 2023-10-06T01:23:03.418 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:03.412+0000 7f95227fc700 1 -- 172.21.15.50:0/1053383431 <== mds.0 v2:172.21.15.50:6834/3957156573 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+16954 (crc 0 0 0) 0x561014fe4870 con 0x56101502dab0 2023-10-06T01:23:03.419 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:03.412+0000 7f95227fc700 10 client.5331 handle_command_reply: tid=0 2023-10-06T01:23:03.419 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:03.412+0000 7f9558b7db80 1 client.5331 shutdown 2023-10-06T01:23:03.419 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:03.412+0000 7f9558b7db80 1 -- 172.21.15.50:0/1053383431 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5610150142c0 msgr2=0x56101503dff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:23:03.419 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:03.412+0000 7f9558b7db80 1 --2- 172.21.15.50:0/1053383431 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5610150142c0 0x56101503dff0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f9534009b20 tx=0x7f9534022000 comp rx=0 tx=0).stop 2023-10-06T01:23:03.419 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:03.412+0000 7f9558b7db80 1 -- 172.21.15.50:0/1053383431 shutdown_connections 2023-10-06T01:23:03.419 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:03.412+0000 7f9558b7db80 1 --2- 172.21.15.50:0/1053383431 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x561015033e50 0x56101502d570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:23:03.419 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:03.413+0000 7f9558b7db80 1 --2- 172.21.15.50:0/1053383431 >> [v2:172.21.15.50:6834/3957156573,v1:172.21.15.50:6835/3957156573] conn(0x56101502dab0 0x5610150417b0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:23:03.419 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:03.413+0000 7f9558b7db80 1 --2- 172.21.15.50:0/1053383431 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5610150142c0 0x56101503dff0 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:23:03.419 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:03.413+0000 7f9558b7db80 1 --2- 172.21.15.50:0/1053383431 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x561015015a10 0x5610150585b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:23:03.419 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:03.413+0000 7f95227fc700 0 client.5331 ms_handle_reset on v2:172.21.15.50:6834/3957156573 2023-10-06T01:23:03.419 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:03.413+0000 7f9558b7db80 1 -- 172.21.15.50:0/1053383431 >> 172.21.15.50:0/1053383431 conn(0x561015013e80 msgr2=0x561015033510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:23:03.419 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:03.413+0000 7f9558b7db80 1 -- 172.21.15.50:0/1053383431 shutdown_connections 2023-10-06T01:23:03.420 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:03.413+0000 7f9558b7db80 1 -- 172.21.15.50:0/1053383431 wait complete. 2023-10-06T01:23:03.420 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:03.413+0000 7f9558b7db80 20 client.5331 trim_cache size 0 max 16384 2023-10-06T01:23:03.431 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:03.430+0000 7f9558b7db80 1 Processor -- start 2023-10-06T01:23:03.431 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:03.430+0000 7f9558b7db80 1 -- start start 2023-10-06T01:23:03.433 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:03.431+0000 7f9558b7db80 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5610150142c0 0x56101503db90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:23:03.433 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:03.431+0000 7f9558b7db80 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x561015015a10 0x56101503e0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:23:03.433 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:03.431+0000 7f9558b7db80 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561015033e50 0x56101500fae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:23:03.433 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:03.431+0000 7f9558b7db80 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x56101502e8b0 con 0x561015033e50 2023-10-06T01:23:03.433 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:03.431+0000 7f9558b7db80 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x56101502d750 con 0x5610150142c0 2023-10-06T01:23:03.433 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:03.431+0000 7f9558b7db80 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x56101502f530 con 0x561015015a10 2023-10-06T01:23:03.433 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:03.431+0000 7f954899c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561015033e50 0x56101500fae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:23:03.433 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:03.431+0000 7f954899c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561015033e50 0x56101500fae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:53868/0 (socket says 172.21.15.50:53868) 2023-10-06T01:23:03.434 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:03.431+0000 7f954899c700 1 -- 172.21.15.50:0/567910452 learned_addr learned my addr 172.21.15.50:0/567910452 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-06T01:23:03.434 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:03.431+0000 7f95437fe700 1 --2- 172.21.15.50:0/567910452 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x561015015a10 0x56101503e0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:23:03.434 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:03.431+0000 7f9543fff700 1 --2- 172.21.15.50:0/567910452 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5610150142c0 0x56101503db90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:23:03.434 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:03.432+0000 7f954899c700 1 -- 172.21.15.50:0/567910452 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x561015015a10 msgr2=0x56101503e0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:23:03.434 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:03.432+0000 7f954899c700 1 --2- 172.21.15.50:0/567910452 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x561015015a10 0x56101503e0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:23:03.434 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:03.432+0000 7f954899c700 1 -- 172.21.15.50:0/567910452 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5610150142c0 msgr2=0x56101503db90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:23:03.434 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:03.432+0000 7f954899c700 1 --2- 172.21.15.50:0/567910452 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5610150142c0 0x56101503db90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:23:03.434 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:03.432+0000 7f954899c700 1 -- 172.21.15.50:0/567910452 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561014d9ffe0 con 0x561015033e50 2023-10-06T01:23:03.434 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:03.432+0000 7f95437fe700 1 --2- 172.21.15.50:0/567910452 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x561015015a10 0x56101503e0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T01:23:03.434 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:03.432+0000 7f954899c700 1 --2- 172.21.15.50:0/567910452 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561015033e50 0x56101500fae0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f953c00a340 tx=0x7f953c06a040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dad5355bdbf2f18d server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:23:03.434 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:03.432+0000 7f9529ffb700 1 -- 172.21.15.50:0/567910452 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f953c058a70 con 0x561015033e50 2023-10-06T01:23:03.435 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:03.432+0000 7f9529ffb700 1 -- 172.21.15.50:0/567910452 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f953c05c7c0 con 0x561015033e50 2023-10-06T01:23:03.435 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:03.432+0000 7f9529ffb700 1 -- 172.21.15.50:0/567910452 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f953c053bc0 con 0x561015033e50 2023-10-06T01:23:03.439 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:03.433+0000 7f9558b7db80 1 -- 172.21.15.50:0/567910452 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561015033e50 msgr2=0x56101500fae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:23:03.439 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:03.433+0000 7f9558b7db80 1 --2- 172.21.15.50:0/567910452 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561015033e50 0x56101500fae0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f953c00a340 tx=0x7f953c06a040 comp rx=0 tx=0).stop 2023-10-06T01:23:03.439 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:03.433+0000 7f9558b7db80 1 -- 172.21.15.50:0/567910452 shutdown_connections 2023-10-06T01:23:03.439 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:03.433+0000 7f9558b7db80 1 --2- 172.21.15.50:0/567910452 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561015033e50 0x56101500fae0 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:23:03.439 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:03.433+0000 7f9558b7db80 1 --2- 172.21.15.50:0/567910452 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5610150142c0 0x56101503db90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:23:03.440 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:03.433+0000 7f9558b7db80 1 --2- 172.21.15.50:0/567910452 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x561015015a10 0x56101503e0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:23:03.440 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:03.433+0000 7f9558b7db80 1 -- 172.21.15.50:0/567910452 >> 172.21.15.50:0/567910452 conn(0x561015013e80 msgr2=0x561015058f70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:23:03.440 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:03.433+0000 7f9558b7db80 1 -- 172.21.15.50:0/567910452 shutdown_connections 2023-10-06T01:23:03.440 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:03.433+0000 7f9558b7db80 1 -- 172.21.15.50:0/567910452 wait complete. 2023-10-06T01:23:03.440 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:03.433+0000 7f9558b7db80 1 -- start start 2023-10-06T01:23:03.440 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:03.434+0000 7f9558b7db80 1 Processor -- start 2023-10-06T01:23:03.440 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:03.434+0000 7f9558b7db80 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x5610150142c0 0x561015013000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:23:03.440 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:03.434+0000 7f9558b7db80 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561015015a10 0x5610150b88b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:23:03.440 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:03.434+0000 7f9558b7db80 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x561015033e50 0x5610150b8df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:23:03.440 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:03.434+0000 7f9558b7db80 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x56101503e8e0 con 0x561015015a10 2023-10-06T01:23:03.440 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:03.434+0000 7f9558b7db80 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x561015013b50 con 0x561015033e50 2023-10-06T01:23:03.440 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:03.434+0000 7f9558b7db80 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x56101503eb30 con 0x5610150142c0 2023-10-06T01:23:03.441 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:03.435+0000 7f9558b7db80 10 client.0 _ll_register_callbacks cb 0x561014fd6020 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T01:23:03.441 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:03.435+0000 7f95437fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561015015a10 0x5610150b88b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:23:03.441 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:03.435+0000 7f95437fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561015015a10 0x5610150b88b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:53876/0 (socket says 172.21.15.50:53876) 2023-10-06T01:23:03.441 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:03.435+0000 7f95437fe700 1 -- 172.21.15.50:0/1085195929 learned_addr learned my addr 172.21.15.50:0/1085195929 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-06T01:23:03.441 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:03.435+0000 7f954899c700 1 --2- 172.21.15.50:0/1085195929 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x561015033e50 0x5610150b8df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:23:03.441 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:03.435+0000 7f9543fff700 1 --2- 172.21.15.50:0/1085195929 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x5610150142c0 0x561015013000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:23:03.441 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:03.435+0000 7f95437fe700 1 -- 172.21.15.50:0/1085195929 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x5610150142c0 msgr2=0x561015013000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:23:03.441 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:03.435+0000 7f95437fe700 1 --2- 172.21.15.50:0/1085195929 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x5610150142c0 0x561015013000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:23:03.441 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:03.435+0000 7f95437fe700 1 -- 172.21.15.50:0/1085195929 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x561015033e50 msgr2=0x5610150b8df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:23:03.441 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:03.435+0000 7f95437fe700 1 --2- 172.21.15.50:0/1085195929 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x561015033e50 0x5610150b8df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:23:03.442 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:03.435+0000 7f95437fe700 1 -- 172.21.15.50:0/1085195929 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f95440cb470 con 0x561015015a10 2023-10-06T01:23:03.442 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:03.435+0000 7f9543fff700 1 --2- 172.21.15.50:0/1085195929 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x5610150142c0 0x561015013000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T01:23:03.442 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:03.435+0000 7f95437fe700 1 --2- 172.21.15.50:0/1085195929 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561015015a10 0x5610150b88b0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f9538013000 tx=0x7f9538014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=323aee462cf7690e server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:23:03.442 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:03.435+0000 7f95227fc700 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2023-10-06T01:23:03.442 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:03.436+0000 7f95227fc700 1 -- 172.21.15.50:0/1085195929 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9538021040 con 0x561015015a10 2023-10-06T01:23:03.442 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:03.436+0000 7f95227fc700 1 -- 172.21.15.50:0/1085195929 <== mon.0 v2:172.21.15.50:3300/0 2 ==== osd_map(39..39 src has 1..39) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f9538036da0 con 0x561015015a10 2023-10-06T01:23:03.442 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:03.436+0000 7f9558b7db80 1 -- 172.21.15.50:0/1085195929 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f9534021420 con 0x561015015a10 2023-10-06T01:23:03.442 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:03.436+0000 7f95227fc700 1 -- 172.21.15.50:0/1085195929 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=18) v2 ==== 24+0+0 (secure 0 0 0) 0x7f953802c810 con 0x561015015a10 2023-10-06T01:23:03.442 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:03.436+0000 7f9558b7db80 10 client.5337 fetch_fsmap learned FSMap version 18 2023-10-06T01:23:03.442 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:03.436+0000 7f9558b7db80 1 -- 172.21.15.50:0/1085195929 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=18,monmap=2+}) v3 -- 0x7f953c020070 con 0x561015015a10 2023-10-06T01:23:03.442 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:03.436+0000 7f95227fc700 1 -- 172.21.15.50:0/1085195929 <== mon.0 v2:172.21.15.50:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9534021420 con 0x561015015a10 2023-10-06T01:23:03.443 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:03.436+0000 7f95227fc700 1 -- 172.21.15.50:0/1085195929 <== mon.0 v2:172.21.15.50:3300/0 5 ==== fsmap(e 18) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f953802c970 con 0x561015015a10 2023-10-06T01:23:03.443 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:03.436+0000 7f9558b7db80 10 client.5337 fetch_fsmap finished waiting for FSMap version 18 2023-10-06T01:23:03.443 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:03.436+0000 7f9558b7db80 10 client.5337 resolve_mds: resolved name 'c' to daemon mds.c 2023-10-06T01:23:03.443 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:03.436+0000 7f9558b7db80 20 client.5337 populate_metadata read hostname 'smithi050' 2023-10-06T01:23:03.443 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:03.436+0000 7f9558b7db80 1 --2- 172.21.15.50:0/1085195929 >> [v2:172.21.15.50:6834/3957156573,v1:172.21.15.50:6835/3957156573] conn(0x561015072890 0x561015072c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:23:03.443 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:03.436+0000 7f9558b7db80 4 client.5337 mds_command: new command op to 5160 tid=0[{"prefix": "status"}] 2023-10-06T01:23:03.443 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:03.436+0000 7f9558b7db80 1 -- 172.21.15.50:0/1085195929 --> [v2:172.21.15.50:6834/3957156573,v1:172.21.15.50:6835/3957156573] -- command(tid 0: {"prefix": "status"}) v1 -- 0x561014f05e00 con 0x561015072890 2023-10-06T01:23:03.443 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:03.436+0000 7f9543fff700 1 --2- 172.21.15.50:0/1085195929 >> [v2:172.21.15.50:6834/3957156573,v1:172.21.15.50:6835/3957156573] conn(0x561015072890 0x561015072c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:23:03.443 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:03.437+0000 7f9543fff700 1 --2- 172.21.15.50:0/1085195929 >> [v2:172.21.15.50:6834/3957156573,v1:172.21.15.50:6835/3957156573] conn(0x561015072890 0x561015072c60 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fb4bb40a61073e70 server_cookie=c1a4f447e2b28a49 in_seq=0 out_seq=0 2023-10-06T01:23:03.443 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:03.437+0000 7f95227fc700 10 client.5337 ms_handle_connect on v2:172.21.15.50:6834/3957156573 2023-10-06T01:23:03.444 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:03.437+0000 7f95227fc700 1 -- 172.21.15.50:0/1085195929 <== mds.0 v2:172.21.15.50:6834/3957156573 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+317 (crc 0 0 0) 0x561014f05e00 con 0x561015072890 2023-10-06T01:23:03.444 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:03.437+0000 7f95227fc700 10 client.5337 handle_command_reply: tid=0 2023-10-06T01:23:03.444 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:03.437+0000 7f9558b7db80 1 client.5337 shutdown 2023-10-06T01:23:03.444 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:03.437+0000 7f9558b7db80 1 -- 172.21.15.50:0/1085195929 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561015015a10 msgr2=0x5610150b88b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:23:03.444 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:03.437+0000 7f9558b7db80 1 --2- 172.21.15.50:0/1085195929 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561015015a10 0x5610150b88b0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f9538013000 tx=0x7f9538014000 comp rx=0 tx=0).stop 2023-10-06T01:23:03.444 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:03.437+0000 7f9558b7db80 1 -- 172.21.15.50:0/1085195929 shutdown_connections 2023-10-06T01:23:03.444 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:03.437+0000 7f9558b7db80 1 --2- 172.21.15.50:0/1085195929 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x561015033e50 0x5610150b8df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:23:03.444 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:03.437+0000 7f9558b7db80 1 --2- 172.21.15.50:0/1085195929 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x5610150142c0 0x561015013000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:23:03.444 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:03.437+0000 7f9558b7db80 1 --2- 172.21.15.50:0/1085195929 >> [v2:172.21.15.50:6834/3957156573,v1:172.21.15.50:6835/3957156573] conn(0x561015072890 0x561015072c60 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:23:03.444 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:03.437+0000 7f9558b7db80 1 --2- 172.21.15.50:0/1085195929 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561015015a10 0x5610150b88b0 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:23:03.444 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:03.437+0000 7f9558b7db80 1 -- 172.21.15.50:0/1085195929 >> 172.21.15.50:0/1085195929 conn(0x561015013e80 msgr2=0x561015033230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:23:03.445 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:03.437+0000 7f95227fc700 0 client.5337 ms_handle_reset on v2:172.21.15.50:6834/3957156573 2023-10-06T01:23:03.445 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:03.438+0000 7f9558b7db80 1 -- 172.21.15.50:0/1085195929 shutdown_connections 2023-10-06T01:23:03.445 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:03.438+0000 7f9558b7db80 1 -- 172.21.15.50:0/1085195929 wait complete. 2023-10-06T01:23:03.445 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:03.438+0000 7f9558b7db80 20 client.5337 trim_cache size 0 max 16384 2023-10-06T01:23:03.445 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2023-10-06T01:23:03.445 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_fsid": "0bfd9a6b-1587-4fe4-a89e-e43c00286b4e", 2023-10-06T01:23:03.445 INFO:teuthology.orchestra.run.smithi050.stdout: "whoami": 0, 2023-10-06T01:23:03.445 INFO:teuthology.orchestra.run.smithi050.stdout: "id": 5160, 2023-10-06T01:23:03.445 INFO:teuthology.orchestra.run.smithi050.stdout: "want_state": "up:active", 2023-10-06T01:23:03.446 INFO:teuthology.orchestra.run.smithi050.stdout: "state": "up:active", 2023-10-06T01:23:03.446 INFO:teuthology.orchestra.run.smithi050.stdout: "fs_name": "cephfs", 2023-10-06T01:23:03.446 INFO:teuthology.orchestra.run.smithi050.stdout: "rank_uptime": 6.522236779, 2023-10-06T01:23:03.446 INFO:teuthology.orchestra.run.smithi050.stdout: "mdsmap_epoch": 18, 2023-10-06T01:23:03.446 INFO:teuthology.orchestra.run.smithi050.stdout: "osdmap_epoch": 39, 2023-10-06T01:23:03.446 INFO:teuthology.orchestra.run.smithi050.stdout: "osdmap_epoch_barrier": 39, 2023-10-06T01:23:03.446 INFO:teuthology.orchestra.run.smithi050.stdout: "uptime": 15.31670242 2023-10-06T01:23:03.446 INFO:teuthology.orchestra.run.smithi050.stdout:} 2023-10-06T01:23:03.447 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:03.438+0000 7f954919d700 1 -- 172.21.15.50:0/3205192742 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f9530066f30 msgr2=0x7f95300693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:23:03.447 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:03.438+0000 7f954919d700 1 --2- 172.21.15.50:0/3205192742 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f9530066f30 0x7f95300693e0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f9534009ea0 tx=0x7f95340091a0 comp rx=0 tx=0).stop 2023-10-06T01:23:03.448 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:03.438+0000 7f954919d700 1 -- 172.21.15.50:0/3205192742 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9544159480 msgr2=0x7f954414b730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:23:03.448 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:03.438+0000 7f954919d700 1 --2- 172.21.15.50:0/3205192742 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9544159480 0x7f954414b730 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f953c001460 tx=0x7f953c001ae0 comp rx=0 tx=0).stop 2023-10-06T01:23:03.448 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:03.438+0000 7f954919d700 1 -- 172.21.15.50:0/3205192742 shutdown_connections 2023-10-06T01:23:03.448 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:03.438+0000 7f954919d700 1 --2- 172.21.15.50:0/3205192742 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9544159480 0x7f954414b730 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:23:03.448 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:03.438+0000 7f954919d700 1 --2- 172.21.15.50:0/3205192742 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f95440b3610 0x7f954416a330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:23:03.449 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:03.438+0000 7f954919d700 1 --2- 172.21.15.50:0/3205192742 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f9530066f30 0x7f95300693e0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:23:03.449 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:03.438+0000 7f954919d700 1 --2- 172.21.15.50:0/3205192742 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f95440cc1b0 0x7f95440ce8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:23:03.449 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:03.438+0000 7f954919d700 1 -- 172.21.15.50:0/3205192742 >> 172.21.15.50:0/3205192742 conn(0x7f954406ed20 msgr2=0x7f95440b3af0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:23:03.449 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:03.439+0000 7f954919d700 1 -- 172.21.15.50:0/3205192742 shutdown_connections 2023-10-06T01:23:03.449 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:03.439+0000 7f954919d700 1 -- 172.21.15.50:0/3205192742 wait complete. 2023-10-06T01:23:03.456 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-06T01:23:03.642 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:03.641+0000 7f82f759e700 1 Processor -- start 2023-10-06T01:23:03.642 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:03.641+0000 7f82f759e700 1 -- start start 2023-10-06T01:23:03.645 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:03.643+0000 7f82f759e700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f82f81538f0 0x7f82f80a98e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:23:03.645 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:03.643+0000 7f82f759e700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f82f8153cc0 0x7f82f8159ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:23:03.645 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:03.643+0000 7f82f759e700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f82f815a010 0x7f82f80cabf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:23:03.645 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:03.643+0000 7f82f759e700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f82f815aae0 con 0x7f82f815a010 2023-10-06T01:23:03.645 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:03.643+0000 7f82f759e700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f82f806a890 con 0x7f82f81538f0 2023-10-06T01:23:03.645 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:03.643+0000 7f82f759e700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82f80a9e20 con 0x7f82f8153cc0 2023-10-06T01:23:03.645 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:03.643+0000 7f82f6d9d700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f82f815a010 0x7f82f80cabf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:23:03.645 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:03.643+0000 7f82f5d9b700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f82f8153cc0 0x7f82f8159ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:23:03.646 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:03.643+0000 7f82f659c700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f82f81538f0 0x7f82f80a98e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:23:03.646 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:03.643+0000 7f82f6d9d700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f82f815a010 0x7f82f80cabf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:53878/0 (socket says 172.21.15.50:53878) 2023-10-06T01:23:03.646 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:03.643+0000 7f82f659c700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f82f81538f0 0x7f82f80a98e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.50:50240/0 (socket says 172.21.15.50:50240) 2023-10-06T01:23:03.646 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:03.643+0000 7f82f6d9d700 1 -- 172.21.15.50:0/254695157 learned_addr learned my addr 172.21.15.50:0/254695157 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-06T01:23:03.646 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:03.643+0000 7f82f5d9b700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f82f8153cc0 0x7f82f8159ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3301/0 says I am v2:172.21.15.50:52662/0 (socket says 172.21.15.50:52662) 2023-10-06T01:23:03.646 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:03.643+0000 7f82f6d9d700 1 -- 172.21.15.50:0/254695157 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f82f8153cc0 msgr2=0x7f82f8159ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:23:03.646 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:03.643+0000 7f82f6d9d700 1 --2- 172.21.15.50:0/254695157 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f82f8153cc0 0x7f82f8159ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:23:03.646 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:03.644+0000 7f82f6d9d700 1 -- 172.21.15.50:0/254695157 >> v2:172.21.15.155:3300/0 conn(0x7f82f81538f0 msgr2=0x7f82f80a98e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:23:03.646 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:03.644+0000 7f82f6d9d700 1 --2- 172.21.15.50:0/254695157 >> v2:172.21.15.155:3300/0 conn(0x7f82f81538f0 0x7f82f80a98e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:23:03.647 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:03.644+0000 7f82f6d9d700 1 -- 172.21.15.50:0/254695157 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82f815a520 con 0x7f82f815a010 2023-10-06T01:23:03.647 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:03.644+0000 7f82f659c700 1 --2- 172.21.15.50:0/254695157 >> v2:172.21.15.155:3300/0 conn(0x7f82f81538f0 0x7f82f80a98e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T01:23:03.647 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:03.644+0000 7f82f6d9d700 1 --2- 172.21.15.50:0/254695157 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f82f815a010 0x7f82f80cabf0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f82f80686d0 tx=0x7f82f0009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8e9dbb36f067a0bb server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:23:03.647 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:03.644+0000 7f82f559a700 1 -- 172.21.15.50:0/254695157 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82f000e070 con 0x7f82f815a010 2023-10-06T01:23:03.647 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:03.644+0000 7f82f559a700 1 -- 172.21.15.50:0/254695157 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f82f000b970 con 0x7f82f815a010 2023-10-06T01:23:03.647 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:03.644+0000 7f82f559a700 1 -- 172.21.15.50:0/254695157 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82f00092e0 con 0x7f82f815a010 2023-10-06T01:23:03.650 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:03.645+0000 7f82f759e700 1 -- 172.21.15.50:0/254695157 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f82f815a010 msgr2=0x7f82f80cabf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:23:03.650 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:03.645+0000 7f82f759e700 1 --2- 172.21.15.50:0/254695157 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f82f815a010 0x7f82f80cabf0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f82f80686d0 tx=0x7f82f0009840 comp rx=0 tx=0).stop 2023-10-06T01:23:03.650 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:03.645+0000 7f82f759e700 1 -- 172.21.15.50:0/254695157 shutdown_connections 2023-10-06T01:23:03.650 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:03.645+0000 7f82f759e700 1 --2- 172.21.15.50:0/254695157 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f82f815a010 0x7f82f80cabf0 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:23:03.650 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:03.645+0000 7f82f759e700 1 --2- 172.21.15.50:0/254695157 >> v2:172.21.15.155:3300/0 conn(0x7f82f81538f0 0x7f82f80a98e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:23:03.650 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:03.645+0000 7f82f759e700 1 --2- 172.21.15.50:0/254695157 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f82f8153cc0 0x7f82f8159ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:23:03.651 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:03.645+0000 7f82f759e700 1 -- 172.21.15.50:0/254695157 >> 172.21.15.50:0/254695157 conn(0x7f82f80691d0 msgr2=0x7f82f80cd020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:23:03.651 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:03.645+0000 7f82f759e700 1 -- 172.21.15.50:0/254695157 shutdown_connections 2023-10-06T01:23:03.651 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:03.645+0000 7f82f759e700 1 -- 172.21.15.50:0/254695157 wait complete. 2023-10-06T01:23:03.651 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:03.646+0000 7f82f759e700 1 Processor -- start 2023-10-06T01:23:03.651 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:03.646+0000 7f82f759e700 1 -- start start 2023-10-06T01:23:03.651 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:03.647+0000 7f82f759e700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f82f81538f0 0x7f82f81517d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:23:03.651 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:03.647+0000 7f82f759e700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f82f8153cc0 0x7f82f815cd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:23:03.651 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:03.647+0000 7f82f759e700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f82f815a010 0x7f82f80b2170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:23:03.652 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:03.647+0000 7f82f759e700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82f8151d10 con 0x7f82f815a010 2023-10-06T01:23:03.652 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:03.647+0000 7f82f759e700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82f81695d0 con 0x7f82f8153cc0 2023-10-06T01:23:03.652 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:03.647+0000 7f82f759e700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82f81698b0 con 0x7f82f81538f0 2023-10-06T01:23:03.652 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:03.648+0000 7f82f6d9d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f82f815a010 0x7f82f80b2170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:23:03.652 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:03.648+0000 7f82f6d9d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f82f815a010 0x7f82f80b2170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:53894/0 (socket says 172.21.15.50:53894) 2023-10-06T01:23:03.652 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:03.648+0000 7f82f6d9d700 1 -- 172.21.15.50:0/1407222259 learned_addr learned my addr 172.21.15.50:0/1407222259 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-06T01:23:03.652 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:03.648+0000 7f82f5d9b700 1 --2- 172.21.15.50:0/1407222259 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f82f8153cc0 0x7f82f815cd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:23:03.653 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:03.648+0000 7f82f659c700 1 --2- 172.21.15.50:0/1407222259 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f82f81538f0 0x7f82f81517d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:23:03.653 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:03.648+0000 7f82f6d9d700 1 -- 172.21.15.50:0/1407222259 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f82f81538f0 msgr2=0x7f82f81517d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:23:03.653 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:03.648+0000 7f82f6d9d700 1 --2- 172.21.15.50:0/1407222259 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f82f81538f0 0x7f82f81517d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:23:03.653 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:03.648+0000 7f82f6d9d700 1 -- 172.21.15.50:0/1407222259 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f82f8153cc0 msgr2=0x7f82f815cd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:23:03.653 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:03.648+0000 7f82f6d9d700 1 --2- 172.21.15.50:0/1407222259 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f82f8153cc0 0x7f82f815cd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:23:03.653 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:03.648+0000 7f82f6d9d700 1 -- 172.21.15.50:0/1407222259 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82e8009420 con 0x7f82f815a010 2023-10-06T01:23:03.653 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:03.648+0000 7f82f6d9d700 1 --2- 172.21.15.50:0/1407222259 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f82f815a010 0x7f82f80b2170 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f82f806d880 tx=0x7f82f0018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:23:03.653 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:03.649+0000 7f82e67fc700 1 -- 172.21.15.50:0/1407222259 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82f0008ad0 con 0x7f82f815a010 2023-10-06T01:23:03.653 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:03.649+0000 7f82e67fc700 1 -- 172.21.15.50:0/1407222259 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f82f0008c50 con 0x7f82f815a010 2023-10-06T01:23:03.653 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:03.649+0000 7f82f759e700 1 -- 172.21.15.50:0/1407222259 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f82f0009ae0 con 0x7f82f815a010 2023-10-06T01:23:03.653 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:03.649+0000 7f82e67fc700 1 -- 172.21.15.50:0/1407222259 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82f0026460 con 0x7f82f815a010 2023-10-06T01:23:03.654 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:03.649+0000 7f82f759e700 1 -- 172.21.15.50:0/1407222259 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f82f8169e70 con 0x7f82f815a010 2023-10-06T01:23:03.654 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:03.650+0000 7f82f759e700 1 -- 172.21.15.50:0/1407222259 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f82f80afe50 con 0x7f82f815a010 2023-10-06T01:23:03.655 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:03.651+0000 7f82e67fc700 1 -- 172.21.15.50:0/1407222259 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f82f0003040 con 0x7f82f815a010 2023-10-06T01:23:03.655 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:03.652+0000 7f82e67fc700 1 --2- 172.21.15.50:0/1407222259 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f82d8066f30 0x7f82d80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:23:03.655 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:03.652+0000 7f82e67fc700 1 -- 172.21.15.50:0/1407222259 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f82f0086970 con 0x7f82f815a010 2023-10-06T01:23:03.655 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:03.652+0000 7f82f659c700 1 --2- 172.21.15.50:0/1407222259 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f82d8066f30 0x7f82d80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:23:03.655 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:03.653+0000 7f82f659c700 1 --2- 172.21.15.50:0/1407222259 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f82d8066f30 0x7f82d80693e0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f82f8152a70 tx=0x7f82e80091a0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:23:03.657 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:03.656+0000 7f82e67fc700 1 -- 172.21.15.50:0/1407222259 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f82f80afe50 con 0x7f82f815a010 2023-10-06T01:23:03.907 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:03.906+0000 7f82f759e700 1 -- 172.21.15.50:0/1407222259 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f82f80afe50 con 0x7f82f815a010 2023-10-06T01:23:03.907 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:03.906+0000 7f82e67fc700 1 -- 172.21.15.50:0/1407222259 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v18) v1 ==== 53+0+73 (secure 0 0 0) 0x7f82f80afe50 con 0x7f82f815a010 2023-10-06T01:23:03.907 INFO:teuthology.orchestra.run.smithi050.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-06T01:23:03.910 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:03.908+0000 7f82f759e700 1 -- 172.21.15.50:0/1407222259 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f82d8066f30 msgr2=0x7f82d80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:23:03.910 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:03.908+0000 7f82f759e700 1 --2- 172.21.15.50:0/1407222259 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f82d8066f30 0x7f82d80693e0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f82f8152a70 tx=0x7f82e80091a0 comp rx=0 tx=0).stop 2023-10-06T01:23:03.910 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:03.908+0000 7f82f759e700 1 -- 172.21.15.50:0/1407222259 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f82f815a010 msgr2=0x7f82f80b2170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:23:03.910 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:03.908+0000 7f82f759e700 1 --2- 172.21.15.50:0/1407222259 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f82f815a010 0x7f82f80b2170 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f82f806d880 tx=0x7f82f0018000 comp rx=0 tx=0).stop 2023-10-06T01:23:03.910 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:03.909+0000 7f82f759e700 1 -- 172.21.15.50:0/1407222259 shutdown_connections 2023-10-06T01:23:03.910 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:03.909+0000 7f82f759e700 1 --2- 172.21.15.50:0/1407222259 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f82f815a010 0x7f82f80b2170 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:23:03.910 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:03.909+0000 7f82f759e700 1 --2- 172.21.15.50:0/1407222259 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f82f81538f0 0x7f82f81517d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:23:03.910 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:03.909+0000 7f82f759e700 1 --2- 172.21.15.50:0/1407222259 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f82d8066f30 0x7f82d80693e0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:23:03.911 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:03.909+0000 7f82f759e700 1 --2- 172.21.15.50:0/1407222259 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f82f8153cc0 0x7f82f815cd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:23:03.911 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:03.909+0000 7f82f759e700 1 -- 172.21.15.50:0/1407222259 >> 172.21.15.50:0/1407222259 conn(0x7f82f80691d0 msgr2=0x7f82f80c2f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:23:03.911 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:03.909+0000 7f82f759e700 1 -- 172.21.15.50:0/1407222259 shutdown_connections 2023-10-06T01:23:03.911 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:03.909+0000 7f82f759e700 1 -- 172.21.15.50:0/1407222259 wait complete. 2023-10-06T01:23:03.927 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-10-06T01:23:03.927 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-06T01:23:03.927 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi050.front.sepia.ceph.com 2023-10-06T01:23:03.927 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-10-06T01:23:03.927 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-10-06T01:23:03.927 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-10-06T01:23:03.927 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-10-06T01:23:03.927 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-06T01:23:03.927 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-06T01:23:03.928 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T01:23:03.928 DEBUG:teuthology.orchestra.run.smithi050:> ip addr 2023-10-06T01:23:03.966 INFO:teuthology.orchestra.run.smithi050.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-06T01:23:03.966 INFO:teuthology.orchestra.run.smithi050.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-06T01:23:03.966 INFO:teuthology.orchestra.run.smithi050.stdout: inet 127.0.0.1/8 scope host lo 2023-10-06T01:23:03.966 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft forever preferred_lft forever 2023-10-06T01:23:03.966 INFO:teuthology.orchestra.run.smithi050.stdout: inet6 ::1/128 scope host 2023-10-06T01:23:03.966 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft forever preferred_lft forever 2023-10-06T01:23:03.966 INFO:teuthology.orchestra.run.smithi050.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T01:23:03.966 INFO:teuthology.orchestra.run.smithi050.stdout: link/ether 0c:c4:7a:6b:fd:f8 brd ff:ff:ff:ff:ff:ff 2023-10-06T01:23:03.966 INFO:teuthology.orchestra.run.smithi050.stdout: altname enp7s0f0 2023-10-06T01:23:03.966 INFO:teuthology.orchestra.run.smithi050.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T01:23:03.967 INFO:teuthology.orchestra.run.smithi050.stdout: link/ether 0c:c4:7a:6b:fd:f9 brd ff:ff:ff:ff:ff:ff 2023-10-06T01:23:03.967 INFO:teuthology.orchestra.run.smithi050.stdout: altname enp7s0f1 2023-10-06T01:23:03.967 INFO:teuthology.orchestra.run.smithi050.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-06T01:23:03.967 INFO:teuthology.orchestra.run.smithi050.stdout: link/ether 0c:c4:7a:bd:15:84 brd ff:ff:ff:ff:ff:ff 2023-10-06T01:23:03.967 INFO:teuthology.orchestra.run.smithi050.stdout: altname enp1s0f0 2023-10-06T01:23:03.967 INFO:teuthology.orchestra.run.smithi050.stdout: inet 172.21.15.50/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2023-10-06T01:23:03.967 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft 42170sec preferred_lft 42170sec 2023-10-06T01:23:03.967 INFO:teuthology.orchestra.run.smithi050.stdout: inet6 fe80::ec4:7aff:febd:1584/64 scope link 2023-10-06T01:23:03.967 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft forever preferred_lft forever 2023-10-06T01:23:03.967 INFO:teuthology.orchestra.run.smithi050.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T01:23:03.967 INFO:teuthology.orchestra.run.smithi050.stdout: link/ether 0c:c4:7a:bd:15:85 brd ff:ff:ff:ff:ff:ff 2023-10-06T01:23:03.967 INFO:teuthology.orchestra.run.smithi050.stdout: altname enp1s0f1 2023-10-06T01:23:03.968 INFO:teuthology.orchestra.run.smithi050.stdout:8: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-06T01:23:03.968 INFO:teuthology.orchestra.run.smithi050.stdout: link/ether 6e:d9:e7:45:0d:b7 brd ff:ff:ff:ff:ff:ff 2023-10-06T01:23:03.968 INFO:teuthology.orchestra.run.smithi050.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-10-06T01:23:03.968 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft forever preferred_lft forever 2023-10-06T01:23:03.968 INFO:teuthology.orchestra.run.smithi050.stdout: inet6 fe80::f0e9:6fff:fe2b:7f30/64 scope link 2023-10-06T01:23:03.968 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft forever preferred_lft forever 2023-10-06T01:23:03.968 INFO:teuthology.orchestra.run.smithi050.stdout:9: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-06T01:23:03.968 INFO:teuthology.orchestra.run.smithi050.stdout: link/ether 6e:d9:e7:45:0d:b7 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-06T01:23:03.968 INFO:teuthology.orchestra.run.smithi050.stdout: inet6 fe80::6cd9:e7ff:fe45:db7/64 scope link 2023-10-06T01:23:03.968 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft forever preferred_lft forever 2023-10-06T01:23:03.968 INFO:teuthology.orchestra.run.smithi050.stdout:10: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-06T01:23:03.968 INFO:teuthology.orchestra.run.smithi050.stdout: link/ether aa:17:d3:3f:2d:81 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-10-06T01:23:03.969 INFO:teuthology.orchestra.run.smithi050.stdout: inet6 fe80::a817:d3ff:fe3f:2d81/64 scope link 2023-10-06T01:23:03.969 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft forever preferred_lft forever 2023-10-06T01:23:03.969 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T01:23:03.969 DEBUG:teuthology.orchestra.run.smithi050:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-06T01:23:04.066 INFO:teuthology.orchestra.run.smithi050.stdout:1 2023-10-06T01:23:04.069 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T01:23:04.069 DEBUG:teuthology.orchestra.run.smithi050:> route 2023-10-06T01:23:04.108 INFO:teuthology.orchestra.run.smithi050.stdout:Kernel IP routing table 2023-10-06T01:23:04.108 INFO:teuthology.orchestra.run.smithi050.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-06T01:23:04.108 INFO:teuthology.orchestra.run.smithi050.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2023-10-06T01:23:04.108 INFO:teuthology.orchestra.run.smithi050.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2023-10-06T01:23:04.109 INFO:teuthology.orchestra.run.smithi050.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-06T01:23:04.110 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T01:23:04.110 DEBUG:teuthology.orchestra.run.smithi050:> (cd / && exec bash -c ' 2023-10-06T01:23:04.110 DEBUG:teuthology.orchestra.run.smithi050:> set -e 2023-10-06T01:23:04.110 DEBUG:teuthology.orchestra.run.smithi050:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-10-06T01:23:04.111 DEBUG:teuthology.orchestra.run.smithi050:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-10-06T01:23:04.111 DEBUG:teuthology.orchestra.run.smithi050:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-10-06T01:23:04.111 DEBUG:teuthology.orchestra.run.smithi050:> ') 2023-10-06T01:23:04.302 DEBUG:teuthology.orchestra.run.smithi050:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T01:23:04.307 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T01:23:04.308 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T01:23:04.308 DEBUG:teuthology.orchestra.run.smithi050:> ip netns list 2023-10-06T01:23:04.385 INFO:teuthology.orchestra.run.smithi050.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-10-06T01:23:04.386 INFO:teuthology.orchestra.run.smithi050.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-10-06T01:23:04.386 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-06T01:23:04.386 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T01:23:04.386 DEBUG:teuthology.orchestra.run.smithi050:> sudo ip link set brx.0 up 2023-10-06T01:23:04.502 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-06T01:23:04.502 DEBUG:teuthology.orchestra.run.smithi050:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-10-06T01:23:04.539 INFO:teuthology.orchestra.run.smithi050.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-10-06T01:23:04.539 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-06T01:23:04.539 DEBUG:teuthology.orchestra.run.smithi050:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-10-06T01:23:04.615 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2023-10-06T01:23:04.615 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-10-06T01:23:04.616 DEBUG:teuthology.orchestra.run.smithi050:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-10-06T01:23:04.748 INFO:teuthology.orchestra.run.smithi050.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-10-06T01:23:04.749 INFO:teuthology.orchestra.run.smithi050.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-10-06T01:23:04.749 INFO:teuthology.orchestra.run.smithi050.stdout:invalid new device string format 2023-10-06T01:23:04.764 INFO:teuthology.orchestra.run.smithi050.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-10-06T01:23:04.765 INFO:teuthology.orchestra.run.smithi050.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-10-06T01:23:04.765 INFO:teuthology.orchestra.run.smithi050.stdout:invalid new device string format 2023-10-06T01:23:04.765 INFO:teuthology.orchestra.run.smithi050.stdout:mount.ceph: resolved to: "172.21.15.50:3300,172.21.15.155:3300,172.21.15.155:3301" 2023-10-06T01:23:04.766 INFO:teuthology.orchestra.run.smithi050.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-06T01:23:04.786 INFO:teuthology.orchestra.run.smithi050.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-10-06T01:23:04.786 INFO:teuthology.orchestra.run.smithi050.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-10-06T01:23:04.786 INFO:teuthology.orchestra.run.smithi050.stdout:invalid new device string format 2023-10-06T01:23:04.786 INFO:teuthology.orchestra.run.smithi050.stdout:mount.ceph: resolved to: "172.21.15.50:3300,172.21.15.155:3300,172.21.15.155:3301" 2023-10-06T01:23:04.786 INFO:teuthology.orchestra.run.smithi050.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-06T01:23:04.786 INFO:teuthology.orchestra.run.smithi050.stdout:mount.ceph: resolved to: "172.21.15.50:6789,172.21.15.155:6789,172.21.15.155:6790" 2023-10-06T01:23:04.786 INFO:teuthology.orchestra.run.smithi050.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.50:6789,172.21.15.155:6789,172.21.15.155:6790:/ 2023-10-06T01:23:04.786 INFO:teuthology.orchestra.run.smithi050.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=0bfd9a6b-1587-4fe4-a89e-e43c00286b4e" will pass to kernel 2023-10-06T01:23:04.792 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-10-06T01:23:04.792 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T01:23:04.792 DEBUG:teuthology.orchestra.run.smithi050:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-10-06T01:23:04.860 DEBUG:teuthology.orchestra.run.smithi050:> mktemp -d --suffix=xfstests-dev 2023-10-06T01:23:04.896 INFO:teuthology.orchestra.run.smithi050.stdout:/tmp/tmp.aaWjY8JXYCxfstests-dev 2023-10-06T01:23:04.897 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T01:23:04.897 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec git clone https://git.ceph.com/xfstests-dev.git --depth 1 /tmp/tmp.aaWjY8JXYCxfstests-dev) 2023-10-06T01:23:04.977 INFO:teuthology.orchestra.run.smithi050.stderr:Cloning into '/tmp/tmp.aaWjY8JXYCxfstests-dev'... 2023-10-06T01:23:05.892 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T01:23:05.893 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir test) 2023-10-06T01:23:05.977 DEBUG:teuthology.orchestra.run.smithi050:> mktemp -d --suffix=test 2023-10-06T01:23:06.054 INFO:teuthology.orchestra.run.smithi050.stdout:/tmp/tmp.fjwZDNo4wrtest 2023-10-06T01:23:06.055 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T01:23:06.055 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec sudo ln -s /home/ubuntu/cephtest/mnt.0/test /tmp/tmp.fjwZDNo4wrtest) 2023-10-06T01:23:06.175 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T01:23:06.175 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir scratch) 2023-10-06T01:23:06.214 DEBUG:teuthology.orchestra.run.smithi050:> mktemp -d --suffix=scratch 2023-10-06T01:23:06.291 INFO:teuthology.orchestra.run.smithi050.stdout:/tmp/tmp.nBEGJZsFExscratch 2023-10-06T01:23:06.291 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T01:23:06.292 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec sudo ln -s /home/ubuntu/cephtest/mnt.0/scratch /tmp/tmp.nBEGJZsFExscratch) 2023-10-06T01:23:06.397 INFO:tasks.cephfs.xfstests_dev:distro and version detected is "rhel" and "8.4". 2023-10-06T01:23:06.397 DEBUG:teuthology.orchestra.run.smithi050:> sudo yum install -y acl attr automake bc dbench dump e2fsprogs fio gawk gcc indent libtool lvm2 make psmisc quota sed xfsdump xfsprogs libacl-devel libattr-devel libaio-devel libuuid-devel xfsprogs-devel python2 sqlite xfsprogs-qa-devel 2023-10-06T01:23:06.924 INFO:teuthology.orchestra.run.smithi050.stdout:Updating Subscription Management repositories. 2023-10-06T01:23:07.847 INFO:teuthology.orchestra.run.smithi050.stdout:Last metadata expiration check: 0:04:36 ago on Fri 06 Oct 2023 01:18:31 AM UTC. 2023-10-06T01:23:09.359 INFO:teuthology.orchestra.run.smithi050.stdout:Package acl-2.2.53-1.el8.x86_64 is already installed. 2023-10-06T01:23:09.360 INFO:teuthology.orchestra.run.smithi050.stdout:Package attr-2.4.48-3.el8.x86_64 is already installed. 2023-10-06T01:23:09.361 INFO:teuthology.orchestra.run.smithi050.stdout:Package automake-1.16.1-7.el8.noarch is already installed. 2023-10-06T01:23:09.362 INFO:teuthology.orchestra.run.smithi050.stdout:Package bc-1.07.1-5.el8.x86_64 is already installed. 2023-10-06T01:23:09.363 INFO:teuthology.orchestra.run.smithi050.stdout:Package dbench-4.0-20.el8.x86_64 is already installed. 2023-10-06T01:23:09.365 INFO:teuthology.orchestra.run.smithi050.stdout:Package e2fsprogs-1.45.6-1.el8.x86_64 is already installed. 2023-10-06T01:23:09.366 INFO:teuthology.orchestra.run.smithi050.stdout:Package gawk-4.2.1-2.el8.x86_64 is already installed. 2023-10-06T01:23:09.367 INFO:teuthology.orchestra.run.smithi050.stdout:Package gcc-8.4.1-1.el8.x86_64 is already installed. 2023-10-06T01:23:09.369 INFO:teuthology.orchestra.run.smithi050.stdout:Package libtool-2.4.6-25.el8.x86_64 is already installed. 2023-10-06T01:23:09.370 INFO:teuthology.orchestra.run.smithi050.stdout:Package lvm2-8:2.03.11-5.el8.x86_64 is already installed. 2023-10-06T01:23:09.371 INFO:teuthology.orchestra.run.smithi050.stdout:Package make-1:4.2.1-10.el8.x86_64 is already installed. 2023-10-06T01:23:09.372 INFO:teuthology.orchestra.run.smithi050.stdout:Package psmisc-23.1-5.el8.x86_64 is already installed. 2023-10-06T01:23:09.373 INFO:teuthology.orchestra.run.smithi050.stdout:Package quota-1:4.04-12.el8.x86_64 is already installed. 2023-10-06T01:23:09.374 INFO:teuthology.orchestra.run.smithi050.stdout:Package sed-4.5-2.el8.x86_64 is already installed. 2023-10-06T01:23:09.375 INFO:teuthology.orchestra.run.smithi050.stdout:Package xfsdump-3.1.8-2.el8.x86_64 is already installed. 2023-10-06T01:23:09.376 INFO:teuthology.orchestra.run.smithi050.stdout:Package xfsprogs-5.0.0-8.el8.x86_64 is already installed. 2023-10-06T01:23:09.377 INFO:teuthology.orchestra.run.smithi050.stdout:Package libacl-devel-2.2.53-1.el8.x86_64 is already installed. 2023-10-06T01:23:09.377 INFO:teuthology.orchestra.run.smithi050.stdout:Package libattr-devel-2.4.48-3.el8.x86_64 is already installed. 2023-10-06T01:23:09.378 INFO:teuthology.orchestra.run.smithi050.stdout:Package libaio-devel-0.3.112-1.el8.x86_64 is already installed. 2023-10-06T01:23:09.379 INFO:teuthology.orchestra.run.smithi050.stdout:Package libuuid-devel-2.32.1-27.el8.x86_64 is already installed. 2023-10-06T01:23:09.380 INFO:teuthology.orchestra.run.smithi050.stdout:Package xfsprogs-devel-5.0.0-8.el8.x86_64 is already installed. 2023-10-06T01:23:09.382 INFO:teuthology.orchestra.run.smithi050.stdout:Package sqlite-3.26.0-13.el8.x86_64 is already installed. 2023-10-06T01:23:09.386 INFO:teuthology.orchestra.run.smithi050.stdout:Package xfsprogs-5.0.0-8.el8.x86_64 is already installed. 2023-10-06T01:23:09.905 INFO:teuthology.orchestra.run.smithi050.stdout:Dependencies resolved. 2023-10-06T01:23:09.907 INFO:teuthology.orchestra.run.smithi050.stdout:================================================================================================================== 2023-10-06T01:23:09.907 INFO:teuthology.orchestra.run.smithi050.stdout: Package Arch Version Repository Size 2023-10-06T01:23:09.907 INFO:teuthology.orchestra.run.smithi050.stdout:================================================================================================================== 2023-10-06T01:23:09.907 INFO:teuthology.orchestra.run.smithi050.stdout:Installing: 2023-10-06T01:23:09.907 INFO:teuthology.orchestra.run.smithi050.stdout: dump x86_64 1:0.4-0.36.b46.el8 rhel-8-for-x86_64-baseos-rpms 164 k 2023-10-06T01:23:09.908 INFO:teuthology.orchestra.run.smithi050.stdout: fio x86_64 3.19-3.el8 rhel-8-for-x86_64-appstream-rpms 538 k 2023-10-06T01:23:09.908 INFO:teuthology.orchestra.run.smithi050.stdout: indent x86_64 2.2.13-4.el8 epel 187 k 2023-10-06T01:23:09.908 INFO:teuthology.orchestra.run.smithi050.stdout: python2 x86_64 2.7.18-4.module+el8.4.0+9577+0b56c8de rhel-8-for-x86_64-appstream-rpms 109 k 2023-10-06T01:23:09.908 INFO:teuthology.orchestra.run.smithi050.stdout:Installing dependencies: 2023-10-06T01:23:09.908 INFO:teuthology.orchestra.run.smithi050.stdout: daxctl-libs x86_64 71.1-2.el8 rhel-8-for-x86_64-baseos-rpms 42 k 2023-10-06T01:23:09.908 INFO:teuthology.orchestra.run.smithi050.stdout: libpmemblk x86_64 1.6.1-1.el8 rhel-8-for-x86_64-appstream-rpms 92 k 2023-10-06T01:23:09.908 INFO:teuthology.orchestra.run.smithi050.stdout: ndctl-libs x86_64 71.1-2.el8 rhel-8-for-x86_64-baseos-rpms 78 k 2023-10-06T01:23:09.908 INFO:teuthology.orchestra.run.smithi050.stdout: python2-libs x86_64 2.7.18-4.module+el8.4.0+9577+0b56c8de rhel-8-for-x86_64-appstream-rpms 6.0 M 2023-10-06T01:23:09.908 INFO:teuthology.orchestra.run.smithi050.stdout: python2-pip-wheel noarch 9.0.3-18.module+el8.3.0+7707+eb4bba01 rhel-8-for-x86_64-appstream-rpms 1.0 M 2023-10-06T01:23:09.908 INFO:teuthology.orchestra.run.smithi050.stdout: python2-setuptools-wheel noarch 39.0.1-13.module+el8.4.0+9442+27d0e81c rhel-8-for-x86_64-appstream-rpms 287 k 2023-10-06T01:23:09.908 INFO:teuthology.orchestra.run.smithi050.stdout: rmt x86_64 2:1.5.3-13.el8 rhel-8-for-x86_64-baseos-rpms 51 k 2023-10-06T01:23:09.908 INFO:teuthology.orchestra.run.smithi050.stdout:Installing weak dependencies: 2023-10-06T01:23:09.908 INFO:teuthology.orchestra.run.smithi050.stdout: python2-pip noarch 9.0.3-18.module+el8.3.0+7707+eb4bba01 rhel-8-for-x86_64-appstream-rpms 1.7 M 2023-10-06T01:23:09.909 INFO:teuthology.orchestra.run.smithi050.stdout: python2-setuptools noarch 39.0.1-13.module+el8.4.0+9442+27d0e81c rhel-8-for-x86_64-appstream-rpms 642 k 2023-10-06T01:23:09.909 INFO:teuthology.orchestra.run.smithi050.stdout:Enabling module streams: 2023-10-06T01:23:09.909 INFO:teuthology.orchestra.run.smithi050.stdout: python27 2.7 2023-10-06T01:23:09.909 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-10-06T01:23:09.909 INFO:teuthology.orchestra.run.smithi050.stdout:Transaction Summary 2023-10-06T01:23:09.909 INFO:teuthology.orchestra.run.smithi050.stdout:================================================================================================================== 2023-10-06T01:23:09.909 INFO:teuthology.orchestra.run.smithi050.stdout:Install 13 Packages 2023-10-06T01:23:09.909 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-10-06T01:23:09.910 INFO:teuthology.orchestra.run.smithi050.stdout:Total download size: 11 M 2023-10-06T01:23:09.910 INFO:teuthology.orchestra.run.smithi050.stdout:Installed size: 41 M 2023-10-06T01:23:09.910 INFO:teuthology.orchestra.run.smithi050.stdout:Downloading Packages: 2023-10-06T01:23:10.075 INFO:teuthology.orchestra.run.smithi050.stdout:(1/13): dump-0.4-0.36.b46.el8.x86_64.rpm 1.8 MB/s | 164 kB 00:00 2023-10-06T01:23:10.096 INFO:teuthology.orchestra.run.smithi050.stdout:(2/13): indent-2.2.13-4.el8.x86_64.rpm 1.7 MB/s | 187 kB 00:00 2023-10-06T01:23:10.113 INFO:teuthology.orchestra.run.smithi050.stdout:(3/13): rmt-1.5.3-13.el8.x86_64.rpm 410 kB/s | 51 kB 00:00 2023-10-06T01:23:10.136 INFO:teuthology.orchestra.run.smithi050.stdout:(4/13): daxctl-libs-71.1-2.el8.x86_64.rpm 680 kB/s | 42 kB 00:00 2023-10-06T01:23:10.156 INFO:teuthology.orchestra.run.smithi050.stdout:(5/13): ndctl-libs-71.1-2.el8.x86_64.rpm 1.3 MB/s | 78 kB 00:00 2023-10-06T01:23:10.211 INFO:teuthology.orchestra.run.smithi050.stdout:(6/13): python2-pip-9.0.3-18.module+el8.3.0+770 18 MB/s | 1.7 MB 00:00 2023-10-06T01:23:10.213 INFO:teuthology.orchestra.run.smithi050.stdout:(7/13): libpmemblk-1.6.1-1.el8.x86_64.rpm 1.6 MB/s | 92 kB 00:00 2023-10-06T01:23:10.221 INFO:teuthology.orchestra.run.smithi050.stdout:(8/13): python2-pip-wheel-9.0.3-18.module+el8.3 12 MB/s | 1.0 MB 00:00 2023-10-06T01:23:10.249 INFO:teuthology.orchestra.run.smithi050.stdout:(9/13): python2-2.7.18-4.module+el8.4.0+9577+0b 3.0 MB/s | 109 kB 00:00 2023-10-06T01:23:10.253 INFO:teuthology.orchestra.run.smithi050.stdout:(10/13): fio-3.19-3.el8.x86_64.rpm 13 MB/s | 538 kB 00:00 2023-10-06T01:23:10.289 INFO:teuthology.orchestra.run.smithi050.stdout:(11/13): python2-setuptools-39.0.1-13.module+el 9.2 MB/s | 642 kB 00:00 2023-10-06T01:23:10.334 INFO:teuthology.orchestra.run.smithi050.stdout:(12/13): python2-setuptools-wheel-39.0.1-13.mod 3.5 MB/s | 287 kB 00:00 2023-10-06T01:23:10.385 INFO:teuthology.orchestra.run.smithi050.stdout:(13/13): python2-libs-2.7.18-4.module+el8.4.0+9 44 MB/s | 6.0 MB 00:00 2023-10-06T01:23:10.385 INFO:teuthology.orchestra.run.smithi050.stdout:-------------------------------------------------------------------------------- 2023-10-06T01:23:10.386 INFO:teuthology.orchestra.run.smithi050.stdout:Total 23 MB/s | 11 MB 00:00 2023-10-06T01:23:10.407 INFO:teuthology.orchestra.run.smithi050.stdout:Running transaction check 2023-10-06T01:23:10.439 INFO:teuthology.orchestra.run.smithi050.stdout:Transaction check succeeded. 2023-10-06T01:23:10.439 INFO:teuthology.orchestra.run.smithi050.stdout:Running transaction test 2023-10-06T01:23:10.722 INFO:teuthology.orchestra.run.smithi050.stdout:Transaction test succeeded. 2023-10-06T01:23:10.729 INFO:teuthology.orchestra.run.smithi050.stdout:Running transaction 2023-10-06T01:23:11.354 INFO:teuthology.orchestra.run.smithi050.stdout: Preparing : 1/1 2023-10-06T01:23:11.501 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : daxctl-libs-71.1-2.el8.x86_64 1/13 2023-10-06T01:23:11.606 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: daxctl-libs-71.1-2.el8.x86_64 1/13 2023-10-06T01:23:11.785 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : ndctl-libs-71.1-2.el8.x86_64 2/13 2023-10-06T01:23:11.884 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: ndctl-libs-71.1-2.el8.x86_64 2/13 2023-10-06T01:23:12.043 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : libpmemblk-1.6.1-1.el8.x86_64 3/13 2023-10-06T01:23:12.145 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: libpmemblk-1.6.1-1.el8.x86_64 3/13 2023-10-06T01:23:12.353 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python2-setuptools-wheel-39.0.1-13.module+el8.4.0+ 4/13 2023-10-06T01:23:12.863 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python2-pip-wheel-9.0.3-18.module+el8.3.0+7707+eb4 5/13 2023-10-06T01:23:14.734 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python2-setuptools-39.0.1-13.module+el8.4.0+9442+2 6/13 2023-10-06T01:23:15.094 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python2-libs-2.7.18-4.module+el8.4.0+9577+0b56c8de 7/13 2023-10-06T01:23:15.363 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python2-2.7.18-4.module+el8.4.0+9577+0b56c8de.x86_ 8/13 2023-10-06T01:23:15.963 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: python2-2.7.18-4.module+el8.4.0+9577+0b56c8de.x86_ 8/13 2023-10-06T01:23:16.302 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python2-pip-9.0.3-18.module+el8.3.0+7707+eb4bba01. 9/13 2023-10-06T01:23:16.494 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : rmt-2:1.5.3-13.el8.x86_64 10/13 2023-10-06T01:23:16.789 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : dump-1:0.4-0.36.b46.el8.x86_64 11/13 2023-10-06T01:23:17.146 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : fio-3.19-3.el8.x86_64 12/13 2023-10-06T01:23:17.336 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : indent-2.2.13-4.el8.x86_64 13/13 2023-10-06T01:23:17.824 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: indent-2.2.13-4.el8.x86_64 13/13 2023-10-06T01:23:17.824 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : indent-2.2.13-4.el8.x86_64 1/13 2023-10-06T01:23:17.824 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : dump-1:0.4-0.36.b46.el8.x86_64 2/13 2023-10-06T01:23:17.824 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : rmt-2:1.5.3-13.el8.x86_64 3/13 2023-10-06T01:23:17.824 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : daxctl-libs-71.1-2.el8.x86_64 4/13 2023-10-06T01:23:17.824 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : ndctl-libs-71.1-2.el8.x86_64 5/13 2023-10-06T01:23:17.824 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python2-pip-9.0.3-18.module+el8.3.0+7707+eb4bba01. 6/13 2023-10-06T01:23:17.824 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python2-pip-wheel-9.0.3-18.module+el8.3.0+7707+eb4 7/13 2023-10-06T01:23:17.824 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : libpmemblk-1.6.1-1.el8.x86_64 8/13 2023-10-06T01:23:17.825 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : fio-3.19-3.el8.x86_64 9/13 2023-10-06T01:23:17.825 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python2-2.7.18-4.module+el8.4.0+9577+0b56c8de.x86_ 10/13 2023-10-06T01:23:17.825 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python2-setuptools-39.0.1-13.module+el8.4.0+9442+2 11/13 2023-10-06T01:23:17.825 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python2-libs-2.7.18-4.module+el8.4.0+9577+0b56c8de 12/13 2023-10-06T01:23:19.184 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python2-setuptools-wheel-39.0.1-13.module+el8.4.0+ 13/13 2023-10-06T01:23:19.184 INFO:teuthology.orchestra.run.smithi050.stdout:Last metadata expiration check: 0:04:48 ago on Fri 06 Oct 2023 01:18:31 AM UTC. 2023-10-06T01:23:21.384 INFO:teuthology.orchestra.run.smithi050.stdout:Installed products updated. 2023-10-06T01:23:21.503 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-10-06T01:23:21.503 INFO:teuthology.orchestra.run.smithi050.stdout:Installed: 2023-10-06T01:23:21.503 INFO:teuthology.orchestra.run.smithi050.stdout: daxctl-libs-71.1-2.el8.x86_64 2023-10-06T01:23:21.503 INFO:teuthology.orchestra.run.smithi050.stdout: dump-1:0.4-0.36.b46.el8.x86_64 2023-10-06T01:23:21.503 INFO:teuthology.orchestra.run.smithi050.stdout: fio-3.19-3.el8.x86_64 2023-10-06T01:23:21.503 INFO:teuthology.orchestra.run.smithi050.stdout: indent-2.2.13-4.el8.x86_64 2023-10-06T01:23:21.504 INFO:teuthology.orchestra.run.smithi050.stdout: libpmemblk-1.6.1-1.el8.x86_64 2023-10-06T01:23:21.504 INFO:teuthology.orchestra.run.smithi050.stdout: ndctl-libs-71.1-2.el8.x86_64 2023-10-06T01:23:21.504 INFO:teuthology.orchestra.run.smithi050.stdout: python2-2.7.18-4.module+el8.4.0+9577+0b56c8de.x86_64 2023-10-06T01:23:21.504 INFO:teuthology.orchestra.run.smithi050.stdout: python2-libs-2.7.18-4.module+el8.4.0+9577+0b56c8de.x86_64 2023-10-06T01:23:21.504 INFO:teuthology.orchestra.run.smithi050.stdout: python2-pip-9.0.3-18.module+el8.3.0+7707+eb4bba01.noarch 2023-10-06T01:23:21.504 INFO:teuthology.orchestra.run.smithi050.stdout: python2-pip-wheel-9.0.3-18.module+el8.3.0+7707+eb4bba01.noarch 2023-10-06T01:23:21.504 INFO:teuthology.orchestra.run.smithi050.stdout: python2-setuptools-39.0.1-13.module+el8.4.0+9442+27d0e81c.noarch 2023-10-06T01:23:21.504 INFO:teuthology.orchestra.run.smithi050.stdout: python2-setuptools-wheel-39.0.1-13.module+el8.4.0+9442+27d0e81c.noarch 2023-10-06T01:23:21.505 INFO:teuthology.orchestra.run.smithi050.stdout: rmt-2:1.5.3-13.el8.x86_64 2023-10-06T01:23:21.505 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-10-06T01:23:21.505 INFO:teuthology.orchestra.run.smithi050.stdout:Complete! 2023-10-06T01:23:21.684 DEBUG:teuthology.orchestra.run.smithi050:> sudo useradd fsgqa 2023-10-06T01:23:21.750 INFO:teuthology.orchestra.run.smithi050.stderr:useradd: user 'fsgqa' already exists 2023-10-06T01:23:21.753 DEBUG:teuthology.orchestra.run:got remote process result: 9 2023-10-06T01:23:21.753 DEBUG:teuthology.orchestra.run.smithi050:> sudo groupadd fsgqa 2023-10-06T01:23:21.813 INFO:teuthology.orchestra.run.smithi050.stderr:groupadd: group 'fsgqa' already exists 2023-10-06T01:23:21.816 DEBUG:teuthology.orchestra.run:got remote process result: 9 2023-10-06T01:23:21.816 DEBUG:teuthology.orchestra.run.smithi050:> sudo useradd 123456-fsgqa 2023-10-06T01:23:24.749 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json mon dump 2023-10-06T01:23:24.964 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:24.962+0000 7fdc6bfff700 1 Processor -- start 2023-10-06T01:23:24.965 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:24.962+0000 7fdc6bfff700 1 -- start start 2023-10-06T01:23:24.965 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:24.964+0000 7fdc6bfff700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fdc6c0c1e80 0x7fdc6c0c22e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:23:24.966 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:24.964+0000 7fdc6bfff700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdc6c0c19f0 con 0x7fdc6c140b70 2023-10-06T01:23:24.966 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:24.964+0000 7fdc6bfff700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdc6c0c0de0 con 0x7fdc6c06f190 2023-10-06T01:23:24.966 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:24.964+0000 7fdc6bfff700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdc6c0c7ec0 con 0x7fdc6c0c1e80 2023-10-06T01:23:24.966 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:24.964+0000 7fdc6affd700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fdc6c140b70 0x7fdc6c0aedc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:39028/0 (socket says 172.21.15.50:39028) 2023-10-06T01:23:24.966 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:24.964+0000 7fdc6affd700 1 -- 172.21.15.50:0/2159708784 learned_addr learned my addr 172.21.15.50:0/2159708784 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-10-06T01:23:24.968 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:24.964+0000 7fdc6b7fe700 1 --2- 172.21.15.50:0/2159708784 >> v2:172.21.15.50:3300/0 conn(0x7fdc6c0c1e80 0x7fdc6c0c22e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:23:24.968 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:24.964+0000 7fdc69ffb700 1 -- 172.21.15.50:0/2159708784 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3588771440 0 0) 0x7fdc6c0c19f0 con 0x7fdc6c140b70 2023-10-06T01:23:24.968 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:24.965+0000 7fdc69ffb700 1 -- 172.21.15.50:0/2159708784 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdc54003570 con 0x7fdc6c140b70 2023-10-06T01:23:24.968 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:24.965+0000 7fdc69ffb700 1 -- 172.21.15.50:0/2159708784 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2677510317 0 0) 0x7fdc6c0c0de0 con 0x7fdc6c06f190 2023-10-06T01:23:24.968 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:24.965+0000 7fdc69ffb700 1 -- 172.21.15.50:0/2159708784 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdc6c0c19f0 con 0x7fdc6c06f190 2023-10-06T01:23:24.968 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:24.965+0000 7fdc6b7fe700 1 -- 172.21.15.50:0/2159708784 >> v1:172.21.15.155:6789/0 conn(0x7fdc6c06f190 legacy=0x7fdc6c0c77b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:23:24.968 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:24.965+0000 7fdc6b7fe700 1 -- 172.21.15.50:0/2159708784 >> v1:172.21.15.50:6789/0 conn(0x7fdc6c140b70 legacy=0x7fdc6c0aedc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:23:24.969 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:24.965+0000 7fdc6b7fe700 1 -- 172.21.15.50:0/2159708784 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc6c0c10c0 con 0x7fdc6c0c1e80 2023-10-06T01:23:24.969 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:24.965+0000 7fdc6b7fe700 1 --2- 172.21.15.50:0/2159708784 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdc6c0c1e80 0x7fdc6c0c22e0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7fdc64009e60 tx=0x7fdc64009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6c0dc9b6ca366955 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:23:24.969 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:24.965+0000 7fdc69ffb700 1 -- 172.21.15.50:0/2159708784 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc6400e070 con 0x7fdc6c0c1e80 2023-10-06T01:23:24.969 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:24.965+0000 7fdc69ffb700 1 -- 172.21.15.50:0/2159708784 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc6400bab0 con 0x7fdc6c0c1e80 2023-10-06T01:23:24.969 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:24.965+0000 7fdc69ffb700 1 -- 172.21.15.50:0/2159708784 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc6400be30 con 0x7fdc6c0c1e80 2023-10-06T01:23:24.969 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:24.966+0000 7fdc6bfff700 1 -- 172.21.15.50:0/2159708784 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdc6c0c1e80 msgr2=0x7fdc6c0c22e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:23:24.969 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:24.966+0000 7fdc6bfff700 1 --2- 172.21.15.50:0/2159708784 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdc6c0c1e80 0x7fdc6c0c22e0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7fdc64009e60 tx=0x7fdc64009780 comp rx=0 tx=0).stop 2023-10-06T01:23:24.969 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:24.966+0000 7fdc6bfff700 1 -- 172.21.15.50:0/2159708784 shutdown_connections 2023-10-06T01:23:24.969 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:24.966+0000 7fdc6bfff700 1 --2- 172.21.15.50:0/2159708784 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdc6c0c1e80 0x7fdc6c0c22e0 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:23:24.969 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:24.966+0000 7fdc6bfff700 1 -- 172.21.15.50:0/2159708784 >> 172.21.15.50:0/2159708784 conn(0x7fdc6c0cbef0 msgr2=0x7fdc6c0cc2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:23:24.969 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:24.966+0000 7fdc6bfff700 1 -- 172.21.15.50:0/2159708784 shutdown_connections 2023-10-06T01:23:24.969 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:24.966+0000 7fdc6bfff700 1 -- 172.21.15.50:0/2159708784 wait complete. 2023-10-06T01:23:24.970 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:24.968+0000 7fdc6bfff700 1 Processor -- start 2023-10-06T01:23:24.970 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:24.968+0000 7fdc6bfff700 1 -- start start 2023-10-06T01:23:24.971 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:24.969+0000 7fdc6bfff700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdc6c06f190 0x7fdc6c069fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:23:24.972 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:24.969+0000 7fdc6bfff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdc6c0c1e80 0x7fdc6c138e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:23:24.972 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:24.969+0000 7fdc6bfff700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fdc6c140b70 0x7fdc6c137ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:23:24.972 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:24.969+0000 7fdc6bfff700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc6c0c4210 con 0x7fdc6c0c1e80 2023-10-06T01:23:24.972 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:24.969+0000 7fdc6bfff700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc6c0c9db0 con 0x7fdc6c06f190 2023-10-06T01:23:24.972 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:24.969+0000 7fdc6bfff700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc6c0ca090 con 0x7fdc6c140b70 2023-10-06T01:23:24.972 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:24.969+0000 7fdc6affd700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdc6c06f190 0x7fdc6c069fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:23:24.972 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:24.969+0000 7fdc6a7fc700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdc6c0c1e80 0x7fdc6c138e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:23:24.972 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:24.969+0000 7fdc6affd700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdc6c06f190 0x7fdc6c069fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.50:33688/0 (socket says 172.21.15.50:33688) 2023-10-06T01:23:24.972 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:24.969+0000 7fdc6affd700 1 -- 172.21.15.50:0/2250845234 learned_addr learned my addr 172.21.15.50:0/2250845234 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-06T01:23:24.972 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:24.969+0000 7fdc6b7fe700 1 --2- 172.21.15.50:0/2250845234 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fdc6c140b70 0x7fdc6c137ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:23:24.973 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:24.970+0000 7fdc6affd700 1 -- 172.21.15.50:0/2250845234 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fdc6c140b70 msgr2=0x7fdc6c137ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:23:24.973 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:24.970+0000 7fdc6affd700 1 --2- 172.21.15.50:0/2250845234 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fdc6c140b70 0x7fdc6c137ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:23:24.973 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:24.970+0000 7fdc6affd700 1 -- 172.21.15.50:0/2250845234 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdc6c0c1e80 msgr2=0x7fdc6c138e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:23:24.973 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:24.970+0000 7fdc6affd700 1 --2- 172.21.15.50:0/2250845234 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdc6c0c1e80 0x7fdc6c138e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:23:24.973 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:24.970+0000 7fdc6affd700 1 -- 172.21.15.50:0/2250845234 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc64009a20 con 0x7fdc6c06f190 2023-10-06T01:23:24.973 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:24.970+0000 7fdc6affd700 1 --2- 172.21.15.50:0/2250845234 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdc6c06f190 0x7fdc6c069fc0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fdc5c00c790 tx=0x7fdc5c007e80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:23:24.974 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:24.970+0000 7fdc52ffd700 1 -- 172.21.15.50:0/2250845234 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc5c005b30 con 0x7fdc6c06f190 2023-10-06T01:23:24.974 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:24.970+0000 7fdc52ffd700 1 -- 172.21.15.50:0/2250845234 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc5c005cd0 con 0x7fdc6c06f190 2023-10-06T01:23:24.974 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:24.970+0000 7fdc52ffd700 1 -- 172.21.15.50:0/2250845234 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc5c007320 con 0x7fdc6c06f190 2023-10-06T01:23:24.974 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:24.970+0000 7fdc6bfff700 1 -- 172.21.15.50:0/2250845234 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdc6c0ca370 con 0x7fdc6c06f190 2023-10-06T01:23:24.974 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:24.970+0000 7fdc6bfff700 1 -- 172.21.15.50:0/2250845234 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdc6c0ca930 con 0x7fdc6c06f190 2023-10-06T01:23:24.974 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:24.972+0000 7fdc6bfff700 1 -- 172.21.15.50:0/2250845234 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdc6c05f270 con 0x7fdc6c06f190 2023-10-06T01:23:24.975 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:24.972+0000 7fdc52ffd700 1 -- 172.21.15.50:0/2250845234 <== mon.1 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fdc5c012400 con 0x7fdc6c06f190 2023-10-06T01:23:24.975 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:24.974+0000 7fdc52ffd700 1 --2- 172.21.15.50:0/2250845234 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7fdc58066f30 0x7fdc580693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:23:24.975 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:24.974+0000 7fdc52ffd700 1 -- 172.21.15.50:0/2250845234 <== mon.1 v2:172.21.15.155:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6436+0+0 (secure 0 0 0) 0x7fdc5c083c70 con 0x7fdc6c06f190 2023-10-06T01:23:24.976 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:24.974+0000 7fdc6a7fc700 1 --2- 172.21.15.50:0/2250845234 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7fdc58066f30 0x7fdc580693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:23:24.976 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:24.975+0000 7fdc6a7fc700 1 --2- 172.21.15.50:0/2250845234 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7fdc58066f30 0x7fdc580693e0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fdc6c13b8f0 tx=0x7fdc60007d30 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:23:24.980 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:24.978+0000 7fdc52ffd700 1 -- 172.21.15.50:0/2250845234 <== mon.1 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fdc5c04b5a0 con 0x7fdc6c06f190 2023-10-06T01:23:25.266 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:25.264+0000 7fdc6bfff700 1 -- 172.21.15.50:0/2250845234 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7fdc6c0c2960 con 0x7fdc6c06f190 2023-10-06T01:23:25.267 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:25.266+0000 7fdc52ffd700 1 -- 172.21.15.50:0/2250845234 <== mon.1 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+1271 (secure 0 0 0) 0x7fdc5c017090 con 0x7fdc6c06f190 2023-10-06T01:23:25.267 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-10-06T01:23:25.267 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":1,"fsid":"0bfd9a6b-1587-4fe4-a89e-e43c00286b4e","modified":"2023-10-06T01:20:36.129635Z","created":"2023-10-06T01:20:36.129635Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:3300","nonce":0},{"type":"v1","addr":"172.21.15.50:6789","nonce":0}]},"addr":"172.21.15.50:6789/0","public_addr":"172.21.15.50:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:3300","nonce":0},{"type":"v1","addr":"172.21.15.155:6789","nonce":0}]},"addr":"172.21.15.155:6789/0","public_addr":"172.21.15.155:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:3301","nonce":0},{"type":"v1","addr":"172.21.15.155:6790","nonce":0}]},"addr":"172.21.15.155:6790/0","public_addr":"172.21.15.155:6790/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1,2]} 2023-10-06T01:23:25.270 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:25.268+0000 7fdc6bfff700 1 -- 172.21.15.50:0/2250845234 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7fdc58066f30 msgr2=0x7fdc580693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:23:25.270 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:25.268+0000 7fdc6bfff700 1 --2- 172.21.15.50:0/2250845234 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7fdc58066f30 0x7fdc580693e0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fdc6c13b8f0 tx=0x7fdc60007d30 comp rx=0 tx=0).stop 2023-10-06T01:23:25.270 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:25.268+0000 7fdc6bfff700 1 -- 172.21.15.50:0/2250845234 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdc6c06f190 msgr2=0x7fdc6c069fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:23:25.270 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:25.268+0000 7fdc6bfff700 1 --2- 172.21.15.50:0/2250845234 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdc6c06f190 0x7fdc6c069fc0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fdc5c00c790 tx=0x7fdc5c007e80 comp rx=0 tx=0).stop 2023-10-06T01:23:25.270 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:25.268+0000 7fdc6bfff700 1 -- 172.21.15.50:0/2250845234 shutdown_connections 2023-10-06T01:23:25.270 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:25.268+0000 7fdc6bfff700 1 --2- 172.21.15.50:0/2250845234 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fdc6c140b70 0x7fdc6c137ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:23:25.270 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:25.268+0000 7fdc6bfff700 1 --2- 172.21.15.50:0/2250845234 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7fdc58066f30 0x7fdc580693e0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:23:25.270 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:25.268+0000 7fdc6bfff700 1 --2- 172.21.15.50:0/2250845234 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdc6c06f190 0x7fdc6c069fc0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:23:25.270 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:25.268+0000 7fdc6bfff700 1 --2- 172.21.15.50:0/2250845234 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdc6c0c1e80 0x7fdc6c138e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:23:25.271 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:25.268+0000 7fdc6bfff700 1 -- 172.21.15.50:0/2250845234 >> 172.21.15.50:0/2250845234 conn(0x7fdc6c0cbef0 msgr2=0x7fdc6c0c6780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:23:25.271 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:25.268+0000 7fdc6bfff700 1 -- 172.21.15.50:0/2250845234 shutdown_connections 2023-10-06T01:23:25.271 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:25.268+0000 7fdc6bfff700 1 -- 172.21.15.50:0/2250845234 wait complete. 2023-10-06T01:23:25.271 INFO:teuthology.orchestra.run.smithi050.stderr:dumped monmap epoch 1 2023-10-06T01:23:25.288 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth get-or-create client.admin 2023-10-06T01:23:25.496 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:25.494+0000 7fc977fff700 1 Processor -- start 2023-10-06T01:23:25.496 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:25.494+0000 7fc977fff700 1 -- start start 2023-10-06T01:23:25.497 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:25.495+0000 7fc977fff700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fc97806f190 0x7fc9780c77b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:23:25.497 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:25.495+0000 7fc977fff700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc9780c19f0 con 0x7fc9780c1e80 2023-10-06T01:23:25.498 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:25.495+0000 7fc977fff700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc9780c0de0 con 0x7fc978140b70 2023-10-06T01:23:25.498 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:25.495+0000 7fc977fff700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc9780c10c0 con 0x7fc97806f190 2023-10-06T01:23:25.498 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:25.496+0000 7fc9767fc700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fc97806f190 0x7fc9780c77b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:23:25.498 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:25.496+0000 7fc9777fe700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fc9780c1e80 0x7fc97815af90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:39034/0 (socket says 172.21.15.50:39034) 2023-10-06T01:23:25.498 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:25.496+0000 7fc9777fe700 1 -- 172.21.15.50:0/1466391519 learned_addr learned my addr 172.21.15.50:0/1466391519 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-10-06T01:23:25.498 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:25.496+0000 7fc976ffd700 1 --1- 172.21.15.50:0/1466391519 >> v1:172.21.15.155:6789/0 conn(0x7fc978140b70 0x7fc9780aedc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.155:6789/0 says I am v1:172.21.15.50:57196/0 (socket says 172.21.15.50:57196) 2023-10-06T01:23:25.500 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:25.496+0000 7fc9767fc700 1 -- 172.21.15.50:0/1466391519 >> v1:172.21.15.155:6789/0 conn(0x7fc978140b70 legacy=0x7fc9780aedc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:23:25.500 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:25.496+0000 7fc975ffb700 1 -- 172.21.15.50:0/1466391519 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1219646659 0 0) 0x7fc9780c0de0 con 0x7fc978140b70 2023-10-06T01:23:25.500 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:25.496+0000 7fc9767fc700 1 -- 172.21.15.50:0/1466391519 >> v1:172.21.15.50:6789/0 conn(0x7fc9780c1e80 legacy=0x7fc97815af90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:23:25.500 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:25.496+0000 7fc9767fc700 1 -- 172.21.15.50:0/1466391519 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9780c13a0 con 0x7fc97806f190 2023-10-06T01:23:25.500 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:25.497+0000 7fc9767fc700 1 --2- 172.21.15.50:0/1466391519 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc97806f190 0x7fc9780c77b0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7fc96c0098e0 tx=0x7fc96c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eb813488313e8b04 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:23:25.500 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:25.497+0000 7fc975ffb700 1 -- 172.21.15.50:0/1466391519 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc96c009e80 con 0x7fc97806f190 2023-10-06T01:23:25.500 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:25.497+0000 7fc975ffb700 1 -- 172.21.15.50:0/1466391519 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc96c00b760 con 0x7fc97806f190 2023-10-06T01:23:25.500 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:25.497+0000 7fc975ffb700 1 -- 172.21.15.50:0/1466391519 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc96c00bae0 con 0x7fc97806f190 2023-10-06T01:23:25.500 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:25.497+0000 7fc977fff700 1 -- 172.21.15.50:0/1466391519 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc97806f190 msgr2=0x7fc9780c77b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:23:25.500 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:25.497+0000 7fc977fff700 1 --2- 172.21.15.50:0/1466391519 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc97806f190 0x7fc9780c77b0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7fc96c0098e0 tx=0x7fc96c0091a0 comp rx=0 tx=0).stop 2023-10-06T01:23:25.500 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:25.497+0000 7fc977fff700 1 -- 172.21.15.50:0/1466391519 shutdown_connections 2023-10-06T01:23:25.501 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:25.497+0000 7fc977fff700 1 --2- 172.21.15.50:0/1466391519 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc97806f190 0x7fc9780c77b0 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:23:25.501 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:25.497+0000 7fc977fff700 1 -- 172.21.15.50:0/1466391519 >> 172.21.15.50:0/1466391519 conn(0x7fc9780cbef0 msgr2=0x7fc9780cc2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:23:25.501 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:25.498+0000 7fc977fff700 1 -- 172.21.15.50:0/1466391519 shutdown_connections 2023-10-06T01:23:25.501 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:25.498+0000 7fc977fff700 1 -- 172.21.15.50:0/1466391519 wait complete. 2023-10-06T01:23:25.501 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:25.499+0000 7fc977fff700 1 Processor -- start 2023-10-06T01:23:25.501 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:25.499+0000 7fc977fff700 1 -- start start 2023-10-06T01:23:25.503 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:25.500+0000 7fc977fff700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc97806f190 0x7fc978139c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:23:25.503 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:25.500+0000 7fc977fff700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc9780c1e80 0x7fc978139470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:23:25.503 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:25.500+0000 7fc977fff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc978140b70 0x7fc9780b0e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:23:25.503 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:25.500+0000 7fc977fff700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc97815e5f0 con 0x7fc978140b70 2023-10-06T01:23:25.504 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:25.500+0000 7fc977fff700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9780af110 con 0x7fc9780c1e80 2023-10-06T01:23:25.504 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:25.500+0000 7fc977fff700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc97815e7d0 con 0x7fc97806f190 2023-10-06T01:23:25.504 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:25.500+0000 7fc9777fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc978140b70 0x7fc9780b0e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:23:25.504 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:25.500+0000 7fc9777fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc978140b70 0x7fc9780b0e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:35770/0 (socket says 172.21.15.50:35770) 2023-10-06T01:23:25.504 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:25.500+0000 7fc9777fe700 1 -- 172.21.15.50:0/3478821143 learned_addr learned my addr 172.21.15.50:0/3478821143 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-06T01:23:25.504 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:25.500+0000 7fc976ffd700 1 --2- 172.21.15.50:0/3478821143 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc97806f190 0x7fc978139c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:23:25.504 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:25.500+0000 7fc9767fc700 1 --2- 172.21.15.50:0/3478821143 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc9780c1e80 0x7fc978139470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:23:25.504 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:25.501+0000 7fc9777fe700 1 -- 172.21.15.50:0/3478821143 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc97806f190 msgr2=0x7fc978139c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:23:25.504 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:25.501+0000 7fc9777fe700 1 --2- 172.21.15.50:0/3478821143 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc97806f190 0x7fc978139c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:23:25.504 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:25.501+0000 7fc9777fe700 1 -- 172.21.15.50:0/3478821143 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc9780c1e80 msgr2=0x7fc978139470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:23:25.505 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:25.501+0000 7fc9777fe700 1 --2- 172.21.15.50:0/3478821143 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc9780c1e80 0x7fc978139470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:23:25.505 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:25.501+0000 7fc9777fe700 1 -- 172.21.15.50:0/3478821143 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc96c009420 con 0x7fc978140b70 2023-10-06T01:23:25.505 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:25.501+0000 7fc9777fe700 1 --2- 172.21.15.50:0/3478821143 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc978140b70 0x7fc9780b0e60 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7fc97000ce10 tx=0x7fc970001ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:23:25.505 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:25.501+0000 7fc95effd700 1 -- 172.21.15.50:0/3478821143 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc97000aa40 con 0x7fc978140b70 2023-10-06T01:23:25.505 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:25.501+0000 7fc95effd700 1 -- 172.21.15.50:0/3478821143 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc97000aba0 con 0x7fc978140b70 2023-10-06T01:23:25.505 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:25.501+0000 7fc977fff700 1 -- 172.21.15.50:0/3478821143 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc97815eab0 con 0x7fc978140b70 2023-10-06T01:23:25.505 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:25.501+0000 7fc95effd700 1 -- 172.21.15.50:0/3478821143 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9700070f0 con 0x7fc978140b70 2023-10-06T01:23:25.505 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:25.502+0000 7fc977fff700 1 -- 172.21.15.50:0/3478821143 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc9780b0940 con 0x7fc978140b70 2023-10-06T01:23:25.506 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:25.502+0000 7fc977fff700 1 -- 172.21.15.50:0/3478821143 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc9780b0b30 con 0x7fc978140b70 2023-10-06T01:23:25.506 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:25.503+0000 7fc95effd700 1 -- 172.21.15.50:0/3478821143 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fc970007520 con 0x7fc978140b70 2023-10-06T01:23:25.506 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:25.504+0000 7fc95effd700 1 --2- 172.21.15.50:0/3478821143 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7fc964067000 0x7fc9640694b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:23:25.506 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:25.504+0000 7fc95effd700 1 -- 172.21.15.50:0/3478821143 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6436+0+0 (secure 0 0 0) 0x7fc970084c60 con 0x7fc978140b70 2023-10-06T01:23:25.507 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:25.505+0000 7fc976ffd700 1 --2- 172.21.15.50:0/3478821143 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7fc964067000 0x7fc9640694b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:23:25.507 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:25.505+0000 7fc976ffd700 1 --2- 172.21.15.50:0/3478821143 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7fc964067000 0x7fc9640694b0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fc968000c00 tx=0x7fc968007ed0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:23:25.510 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:25.509+0000 7fc95effd700 1 -- 172.21.15.50:0/3478821143 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fc970051c50 con 0x7fc978140b70 2023-10-06T01:23:25.796 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:25.794+0000 7fc977fff700 1 -- 172.21.15.50:0/3478821143 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "auth get-or-create", "entity": "client.admin"} v 0) v1 -- 0x7fc97805f270 con 0x7fc978140b70 2023-10-06T01:23:25.797 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:25.795+0000 7fc95effd700 1 -- 172.21.15.50:0/3478821143 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "auth get-or-create", "entity": "client.admin"}]=0 v9) v1 ==== 92+0+63 (secure 0 0 0) 0x7fc970055270 con 0x7fc978140b70 2023-10-06T01:23:25.797 INFO:teuthology.orchestra.run.smithi050.stdout:[client.admin] 2023-10-06T01:23:25.797 INFO:teuthology.orchestra.run.smithi050.stdout: key = AQDkYB9l/Gj8GhAAnzbyNWlMyOV84o4C27Jajg== 2023-10-06T01:23:25.799 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:25.797+0000 7fc977fff700 1 -- 172.21.15.50:0/3478821143 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7fc964067000 msgr2=0x7fc9640694b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:23:25.799 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:25.797+0000 7fc977fff700 1 --2- 172.21.15.50:0/3478821143 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7fc964067000 0x7fc9640694b0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fc968000c00 tx=0x7fc968007ed0 comp rx=0 tx=0).stop 2023-10-06T01:23:25.800 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:25.797+0000 7fc977fff700 1 -- 172.21.15.50:0/3478821143 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc978140b70 msgr2=0x7fc9780b0e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:23:25.800 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:25.797+0000 7fc977fff700 1 --2- 172.21.15.50:0/3478821143 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc978140b70 0x7fc9780b0e60 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7fc97000ce10 tx=0x7fc970001ba0 comp rx=0 tx=0).stop 2023-10-06T01:23:25.800 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:25.797+0000 7fc977fff700 1 -- 172.21.15.50:0/3478821143 shutdown_connections 2023-10-06T01:23:25.800 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:25.797+0000 7fc977fff700 1 --2- 172.21.15.50:0/3478821143 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc978140b70 0x7fc9780b0e60 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:23:25.800 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:25.797+0000 7fc977fff700 1 --2- 172.21.15.50:0/3478821143 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc97806f190 0x7fc978139c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:23:25.800 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:25.797+0000 7fc977fff700 1 --2- 172.21.15.50:0/3478821143 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7fc964067000 0x7fc9640694b0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:23:25.800 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:25.797+0000 7fc977fff700 1 --2- 172.21.15.50:0/3478821143 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc9780c1e80 0x7fc978139470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:23:25.800 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:25.797+0000 7fc977fff700 1 -- 172.21.15.50:0/3478821143 >> 172.21.15.50:0/3478821143 conn(0x7fc9780cbef0 msgr2=0x7fc978156c70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:23:25.800 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:25.797+0000 7fc977fff700 1 -- 172.21.15.50:0/3478821143 shutdown_connections 2023-10-06T01:23:25.800 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:23:25.797+0000 7fc977fff700 1 -- 172.21.15.50:0/3478821143 wait complete. 2023-10-06T01:23:25.816 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2023-10-06T01:23:25.817 DEBUG:teuthology.orchestra.run.smithi050:> sudo dd of=/tmp/tmp.aaWjY8JXYCxfstests-dev/local.config 2023-10-06T01:23:25.881 DEBUG:teuthology.orchestra.run.smithi050:> (cd /tmp/tmp.aaWjY8JXYCxfstests-dev && exec sudo make) 2023-10-06T01:23:26.000 INFO:teuthology.orchestra.run.smithi050.stdout:libtoolize -cfi 2023-10-06T01:23:26.543 INFO:teuthology.orchestra.run.smithi050.stdout:libtoolize: putting auxiliary files in '.'. 2023-10-06T01:23:26.543 INFO:teuthology.orchestra.run.smithi050.stdout:libtoolize: copying file './config.guess' 2023-10-06T01:23:26.553 INFO:teuthology.orchestra.run.smithi050.stdout:libtoolize: copying file './config.sub' 2023-10-06T01:23:26.563 INFO:teuthology.orchestra.run.smithi050.stdout:libtoolize: copying file './install-sh' 2023-10-06T01:23:26.574 INFO:teuthology.orchestra.run.smithi050.stdout:libtoolize: copying file './ltmain.sh' 2023-10-06T01:23:26.635 INFO:teuthology.orchestra.run.smithi050.stdout:libtoolize: putting macros in AC_CONFIG_MACRO_DIRS, 'm4'. 2023-10-06T01:23:26.635 INFO:teuthology.orchestra.run.smithi050.stdout:libtoolize: copying file 'm4/libtool.m4' 2023-10-06T01:23:26.647 INFO:teuthology.orchestra.run.smithi050.stdout:libtoolize: copying file 'm4/ltoptions.m4' 2023-10-06T01:23:26.659 INFO:teuthology.orchestra.run.smithi050.stdout:libtoolize: copying file 'm4/ltsugar.m4' 2023-10-06T01:23:26.672 INFO:teuthology.orchestra.run.smithi050.stdout:libtoolize: copying file 'm4/ltversion.m4' 2023-10-06T01:23:26.684 INFO:teuthology.orchestra.run.smithi050.stdout:libtoolize: copying file 'm4/lt~obsolete.m4' 2023-10-06T01:23:26.701 INFO:teuthology.orchestra.run.smithi050.stdout:libtoolize: Consider adding '-I m4' to ACLOCAL_AMFLAGS in Makefile.am. 2023-10-06T01:23:26.704 INFO:teuthology.orchestra.run.smithi050.stdout:cp include/install-sh . 2023-10-06T01:23:26.706 INFO:teuthology.orchestra.run.smithi050.stdout:aclocal -I m4 2023-10-06T01:23:28.007 INFO:teuthology.orchestra.run.smithi050.stdout:autoheader 2023-10-06T01:23:28.380 INFO:teuthology.orchestra.run.smithi050.stdout:autoconf 2023-10-06T01:23:28.594 INFO:teuthology.orchestra.run.smithi050.stdout:./configure \ 2023-10-06T01:23:28.594 INFO:teuthology.orchestra.run.smithi050.stdout: --libexecdir=/usr/lib \ 2023-10-06T01:23:28.594 INFO:teuthology.orchestra.run.smithi050.stdout: --exec_prefix=/var/lib 2023-10-06T01:23:29.226 INFO:teuthology.orchestra.run.smithi050.stdout:checking build system type... x86_64-pc-linux-gnu 2023-10-06T01:23:29.226 INFO:teuthology.orchestra.run.smithi050.stdout:checking host system type... x86_64-pc-linux-gnu 2023-10-06T01:23:29.230 INFO:teuthology.orchestra.run.smithi050.stdout:checking how to print strings... printf 2023-10-06T01:23:29.230 INFO:teuthology.orchestra.run.smithi050.stdout:checking for gcc... gcc 2023-10-06T01:23:29.393 INFO:teuthology.orchestra.run.smithi050.stdout:checking whether the C compiler works... yes 2023-10-06T01:23:29.394 INFO:teuthology.orchestra.run.smithi050.stdout:checking for C compiler default output file name... a.out 2023-10-06T01:23:29.444 INFO:teuthology.orchestra.run.smithi050.stdout:checking for suffix of executables... 2023-10-06T01:23:29.535 INFO:teuthology.orchestra.run.smithi050.stdout:checking whether we are cross compiling... no 2023-10-06T01:23:29.573 INFO:teuthology.orchestra.run.smithi050.stdout:checking for suffix of object files... o 2023-10-06T01:23:29.607 INFO:teuthology.orchestra.run.smithi050.stdout:checking whether we are using the GNU C compiler... yes 2023-10-06T01:23:29.641 INFO:teuthology.orchestra.run.smithi050.stdout:checking whether gcc accepts -g... yes 2023-10-06T01:23:29.690 INFO:teuthology.orchestra.run.smithi050.stdout:checking for gcc option to accept ISO C89... none needed 2023-10-06T01:23:29.697 INFO:teuthology.orchestra.run.smithi050.stdout:checking for a sed that does not truncate output... /bin/sed 2023-10-06T01:23:29.702 INFO:teuthology.orchestra.run.smithi050.stdout:checking for grep that handles long lines and -e... /bin/grep 2023-10-06T01:23:29.705 INFO:teuthology.orchestra.run.smithi050.stdout:checking for egrep... /bin/grep -E 2023-10-06T01:23:29.708 INFO:teuthology.orchestra.run.smithi050.stdout:checking for fgrep... /bin/grep -F 2023-10-06T01:23:29.717 INFO:teuthology.orchestra.run.smithi050.stdout:checking for ld used by gcc... /bin/ld 2023-10-06T01:23:29.720 INFO:teuthology.orchestra.run.smithi050.stdout:checking if the linker (/bin/ld) is GNU ld... yes 2023-10-06T01:23:29.749 INFO:teuthology.orchestra.run.smithi050.stdout:checking for BSD- or MS-compatible name lister (nm)... /bin/nm -B 2023-10-06T01:23:29.790 INFO:teuthology.orchestra.run.smithi050.stdout:checking the name lister (/bin/nm -B) interface... BSD nm 2023-10-06T01:23:29.790 INFO:teuthology.orchestra.run.smithi050.stdout:checking whether ln -s works... yes 2023-10-06T01:23:29.816 INFO:teuthology.orchestra.run.smithi050.stdout:checking the maximum length of command line arguments... 1572864 2023-10-06T01:23:29.823 INFO:teuthology.orchestra.run.smithi050.stdout:checking how to convert x86_64-pc-linux-gnu file names to x86_64-pc-linux-gnu format... func_convert_file_noop 2023-10-06T01:23:29.823 INFO:teuthology.orchestra.run.smithi050.stdout:checking how to convert x86_64-pc-linux-gnu file names to toolchain format... func_convert_file_noop 2023-10-06T01:23:29.823 INFO:teuthology.orchestra.run.smithi050.stdout:checking for /bin/ld option to reload object files... -r 2023-10-06T01:23:29.823 INFO:teuthology.orchestra.run.smithi050.stdout:checking for objdump... objdump 2023-10-06T01:23:29.824 INFO:teuthology.orchestra.run.smithi050.stdout:checking how to recognize dependent libraries... pass_all 2023-10-06T01:23:29.824 INFO:teuthology.orchestra.run.smithi050.stdout:checking for dlltool... no 2023-10-06T01:23:29.824 INFO:teuthology.orchestra.run.smithi050.stdout:checking how to associate runtime and link libraries... printf %s\n 2023-10-06T01:23:29.825 INFO:teuthology.orchestra.run.smithi050.stdout:checking for ar... ar 2023-10-06T01:23:29.912 INFO:teuthology.orchestra.run.smithi050.stdout:checking for archiver @FILE support... @ 2023-10-06T01:23:29.912 INFO:teuthology.orchestra.run.smithi050.stdout:checking for strip... strip 2023-10-06T01:23:29.913 INFO:teuthology.orchestra.run.smithi050.stdout:checking for ranlib... ranlib 2023-10-06T01:23:29.913 INFO:teuthology.orchestra.run.smithi050.stdout:checking for gawk... gawk 2023-10-06T01:23:30.023 INFO:teuthology.orchestra.run.smithi050.stdout:checking command to parse /bin/nm -B output from gcc object... ok 2023-10-06T01:23:30.026 INFO:teuthology.orchestra.run.smithi050.stdout:checking for sysroot... no 2023-10-06T01:23:30.033 INFO:teuthology.orchestra.run.smithi050.stdout:checking for a working dd... /bin/dd 2023-10-06T01:23:30.041 INFO:teuthology.orchestra.run.smithi050.stdout:checking how to truncate binary pipes... /bin/dd bs=4096 count=1 2023-10-06T01:23:30.069 INFO:teuthology.orchestra.run.smithi050.stdout:checking for mt... no 2023-10-06T01:23:30.075 INFO:teuthology.orchestra.run.smithi050.stdout:checking if : is a manifest tool... no 2023-10-06T01:23:30.126 INFO:teuthology.orchestra.run.smithi050.stdout:checking how to run the C preprocessor... gcc -E 2023-10-06T01:23:30.376 INFO:teuthology.orchestra.run.smithi050.stdout:checking for ANSI C header files... yes 2023-10-06T01:23:30.421 INFO:teuthology.orchestra.run.smithi050.stdout:checking for sys/types.h... yes 2023-10-06T01:23:30.485 INFO:teuthology.orchestra.run.smithi050.stdout:checking for sys/stat.h... yes 2023-10-06T01:23:30.537 INFO:teuthology.orchestra.run.smithi050.stdout:checking for stdlib.h... yes 2023-10-06T01:23:30.590 INFO:teuthology.orchestra.run.smithi050.stdout:checking for string.h... yes 2023-10-06T01:23:30.645 INFO:teuthology.orchestra.run.smithi050.stdout:checking for memory.h... yes 2023-10-06T01:23:30.698 INFO:teuthology.orchestra.run.smithi050.stdout:checking for strings.h... yes 2023-10-06T01:23:30.765 INFO:teuthology.orchestra.run.smithi050.stdout:checking for inttypes.h... yes 2023-10-06T01:23:30.820 INFO:teuthology.orchestra.run.smithi050.stdout:checking for stdint.h... yes 2023-10-06T01:23:30.879 INFO:teuthology.orchestra.run.smithi050.stdout:checking for unistd.h... yes 2023-10-06T01:23:30.942 INFO:teuthology.orchestra.run.smithi050.stdout:checking for dlfcn.h... yes 2023-10-06T01:23:30.951 INFO:teuthology.orchestra.run.smithi050.stdout:checking for objdir... .libs 2023-10-06T01:23:31.087 INFO:teuthology.orchestra.run.smithi050.stdout:checking if gcc supports -fno-rtti -fno-exceptions... no 2023-10-06T01:23:31.087 INFO:teuthology.orchestra.run.smithi050.stdout:checking for gcc option to produce PIC... -fPIC -DPIC 2023-10-06T01:23:31.126 INFO:teuthology.orchestra.run.smithi050.stdout:checking if gcc PIC flag -fPIC -DPIC works... yes 2023-10-06T01:23:31.165 INFO:teuthology.orchestra.run.smithi050.stdout:checking if gcc static flag -static works... no 2023-10-06T01:23:31.220 INFO:teuthology.orchestra.run.smithi050.stdout:checking if gcc supports -c -o file.o... yes 2023-10-06T01:23:31.220 INFO:teuthology.orchestra.run.smithi050.stdout:checking if gcc supports -c -o file.o... (cached) yes 2023-10-06T01:23:31.235 INFO:teuthology.orchestra.run.smithi050.stdout:checking whether the gcc linker (/bin/ld -m elf_x86_64) supports shared libraries... yes 2023-10-06T01:23:31.284 INFO:teuthology.orchestra.run.smithi050.stdout:checking whether -lc should be explicitly linked in... no 2023-10-06T01:23:31.388 INFO:teuthology.orchestra.run.smithi050.stdout:checking dynamic linker characteristics... GNU/Linux ld.so 2023-10-06T01:23:31.388 INFO:teuthology.orchestra.run.smithi050.stdout:checking how to hardcode library paths into programs... immediate 2023-10-06T01:23:31.392 INFO:teuthology.orchestra.run.smithi050.stdout:checking whether stripping libraries is possible... yes 2023-10-06T01:23:31.392 INFO:teuthology.orchestra.run.smithi050.stdout:checking if libtool supports shared libraries... yes 2023-10-06T01:23:31.392 INFO:teuthology.orchestra.run.smithi050.stdout:checking whether to build shared libraries... yes 2023-10-06T01:23:31.392 INFO:teuthology.orchestra.run.smithi050.stdout:checking whether to build static libraries... yes 2023-10-06T01:23:31.405 INFO:teuthology.orchestra.run.smithi050.stdout:checking for gcc... (cached) gcc 2023-10-06T01:23:31.445 INFO:teuthology.orchestra.run.smithi050.stdout:checking whether we are using the GNU C compiler... (cached) yes 2023-10-06T01:23:31.445 INFO:teuthology.orchestra.run.smithi050.stdout:checking whether gcc accepts -g... (cached) yes 2023-10-06T01:23:31.445 INFO:teuthology.orchestra.run.smithi050.stdout:checking for gcc option to accept ISO C89... (cached) none needed 2023-10-06T01:23:31.445 INFO:teuthology.orchestra.run.smithi050.stdout:checking for gmake... /usr/bin/gmake 2023-10-06T01:23:31.446 INFO:teuthology.orchestra.run.smithi050.stderr:./configure: line 12070: test: $(SHELL): binary operator expected 2023-10-06T01:23:31.446 INFO:teuthology.orchestra.run.smithi050.stdout:checking for tar... /bin/tar 2023-10-06T01:23:31.446 INFO:teuthology.orchestra.run.smithi050.stdout:checking for gzip... /bin/gzip 2023-10-06T01:23:31.462 INFO:teuthology.orchestra.run.smithi050.stdout:checking whether gcc -MM is supported... yes 2023-10-06T01:23:31.463 INFO:teuthology.orchestra.run.smithi050.stdout:checking for sort... /bin/sort 2023-10-06T01:23:31.463 INFO:teuthology.orchestra.run.smithi050.stdout:checking whether ln -s works... yes 2023-10-06T01:23:31.463 INFO:teuthology.orchestra.run.smithi050.stdout:checking for rpm... /bin/rpm 2023-10-06T01:23:31.471 INFO:teuthology.orchestra.run.smithi050.stdout:checking for rpmbuild... no 2023-10-06T01:23:31.534 INFO:teuthology.orchestra.run.smithi050.stdout:checking assert.h usability... yes 2023-10-06T01:23:31.550 INFO:teuthology.orchestra.run.smithi050.stdout:checking assert.h presence... yes 2023-10-06T01:23:31.550 INFO:teuthology.orchestra.run.smithi050.stdout:checking for assert.h... yes 2023-10-06T01:23:31.607 INFO:teuthology.orchestra.run.smithi050.stdout:checking bstring.h usability... no 2023-10-06T01:23:31.632 INFO:teuthology.orchestra.run.smithi050.stdout:checking bstring.h presence... no 2023-10-06T01:23:31.632 INFO:teuthology.orchestra.run.smithi050.stdout:checking for bstring.h... no 2023-10-06T01:23:31.682 INFO:teuthology.orchestra.run.smithi050.stdout:checking libgen.h usability... yes 2023-10-06T01:23:31.698 INFO:teuthology.orchestra.run.smithi050.stdout:checking libgen.h presence... yes 2023-10-06T01:23:31.698 INFO:teuthology.orchestra.run.smithi050.stdout:checking for libgen.h... yes 2023-10-06T01:23:31.757 INFO:teuthology.orchestra.run.smithi050.stdout:checking dirent.h usability... yes 2023-10-06T01:23:31.774 INFO:teuthology.orchestra.run.smithi050.stdout:checking dirent.h presence... yes 2023-10-06T01:23:31.774 INFO:teuthology.orchestra.run.smithi050.stdout:checking for dirent.h... yes 2023-10-06T01:23:31.862 INFO:teuthology.orchestra.run.smithi050.stdout:checking errno.h usability... yes 2023-10-06T01:23:31.879 INFO:teuthology.orchestra.run.smithi050.stdout:checking errno.h presence... yes 2023-10-06T01:23:31.879 INFO:teuthology.orchestra.run.smithi050.stdout:checking for errno.h... yes 2023-10-06T01:23:31.937 INFO:teuthology.orchestra.run.smithi050.stdout:checking malloc.h usability... yes 2023-10-06T01:23:31.955 INFO:teuthology.orchestra.run.smithi050.stdout:checking malloc.h presence... yes 2023-10-06T01:23:31.955 INFO:teuthology.orchestra.run.smithi050.stdout:checking for malloc.h... yes 2023-10-06T01:23:32.013 INFO:teuthology.orchestra.run.smithi050.stdout:checking uuid.h usability... no 2023-10-06T01:23:32.037 INFO:teuthology.orchestra.run.smithi050.stdout:checking uuid.h presence... no 2023-10-06T01:23:32.037 INFO:teuthology.orchestra.run.smithi050.stdout:checking for uuid.h... no 2023-10-06T01:23:32.090 INFO:teuthology.orchestra.run.smithi050.stdout:checking uuid/uuid.h usability... yes 2023-10-06T01:23:32.109 INFO:teuthology.orchestra.run.smithi050.stdout:checking uuid/uuid.h presence... yes 2023-10-06T01:23:32.109 INFO:teuthology.orchestra.run.smithi050.stdout:checking for uuid/uuid.h... yes 2023-10-06T01:23:32.167 INFO:teuthology.orchestra.run.smithi050.stdout:checking sys/uuid.h usability... no 2023-10-06T01:23:32.191 INFO:teuthology.orchestra.run.smithi050.stdout:checking sys/uuid.h presence... no 2023-10-06T01:23:32.191 INFO:teuthology.orchestra.run.smithi050.stdout:checking for sys/uuid.h... no 2023-10-06T01:23:32.247 INFO:teuthology.orchestra.run.smithi050.stdout:checking sys/file.h usability... yes 2023-10-06T01:23:32.263 INFO:teuthology.orchestra.run.smithi050.stdout:checking sys/file.h presence... yes 2023-10-06T01:23:32.264 INFO:teuthology.orchestra.run.smithi050.stdout:checking for sys/file.h... yes 2023-10-06T01:23:32.322 INFO:teuthology.orchestra.run.smithi050.stdout:checking sys/fcntl.h usability... yes 2023-10-06T01:23:32.339 INFO:teuthology.orchestra.run.smithi050.stdout:checking sys/fcntl.h presence... yes 2023-10-06T01:23:32.339 INFO:teuthology.orchestra.run.smithi050.stdout:checking for sys/fcntl.h... yes 2023-10-06T01:23:32.397 INFO:teuthology.orchestra.run.smithi050.stdout:checking sys/syssgi.h usability... no 2023-10-06T01:23:32.421 INFO:teuthology.orchestra.run.smithi050.stdout:checking sys/syssgi.h presence... no 2023-10-06T01:23:32.421 INFO:teuthology.orchestra.run.smithi050.stdout:checking for sys/syssgi.h... no 2023-10-06T01:23:32.495 INFO:teuthology.orchestra.run.smithi050.stdout:checking sys/param.h usability... yes 2023-10-06T01:23:32.516 INFO:teuthology.orchestra.run.smithi050.stdout:checking sys/param.h presence... yes 2023-10-06T01:23:32.516 INFO:teuthology.orchestra.run.smithi050.stdout:checking for sys/param.h... yes 2023-10-06T01:23:32.531 INFO:teuthology.orchestra.run.smithi050.stdout:checking for sys/stat.h... (cached) yes 2023-10-06T01:23:32.590 INFO:teuthology.orchestra.run.smithi050.stdout:checking sys/statvfs.h usability... yes 2023-10-06T01:23:32.606 INFO:teuthology.orchestra.run.smithi050.stdout:checking sys/statvfs.h presence... yes 2023-10-06T01:23:32.606 INFO:teuthology.orchestra.run.smithi050.stdout:checking for sys/statvfs.h... yes 2023-10-06T01:23:32.664 INFO:teuthology.orchestra.run.smithi050.stdout:checking sys/time.h usability... yes 2023-10-06T01:23:32.681 INFO:teuthology.orchestra.run.smithi050.stdout:checking sys/time.h presence... yes 2023-10-06T01:23:32.681 INFO:teuthology.orchestra.run.smithi050.stdout:checking for sys/time.h... yes 2023-10-06T01:23:32.761 INFO:teuthology.orchestra.run.smithi050.stdout:checking sys/ioctl.h usability... yes 2023-10-06T01:23:32.777 INFO:teuthology.orchestra.run.smithi050.stdout:checking sys/ioctl.h presence... yes 2023-10-06T01:23:32.778 INFO:teuthology.orchestra.run.smithi050.stdout:checking for sys/ioctl.h... yes 2023-10-06T01:23:32.842 INFO:teuthology.orchestra.run.smithi050.stdout:checking sys/wait.h usability... yes 2023-10-06T01:23:32.861 INFO:teuthology.orchestra.run.smithi050.stdout:checking sys/wait.h presence... yes 2023-10-06T01:23:32.861 INFO:teuthology.orchestra.run.smithi050.stdout:checking for sys/wait.h... yes 2023-10-06T01:23:32.876 INFO:teuthology.orchestra.run.smithi050.stdout:checking for sys/types.h... (cached) yes 2023-10-06T01:23:32.891 INFO:teuthology.orchestra.run.smithi050.stdout:checking for strings.h... (cached) yes 2023-10-06T01:23:32.950 INFO:teuthology.orchestra.run.smithi050.stdout:checking err.h usability... yes 2023-10-06T01:23:32.966 INFO:teuthology.orchestra.run.smithi050.stdout:checking err.h presence... yes 2023-10-06T01:23:32.966 INFO:teuthology.orchestra.run.smithi050.stdout:checking for err.h... yes 2023-10-06T01:23:33.024 INFO:teuthology.orchestra.run.smithi050.stdout:checking linux/falloc.h usability... yes 2023-10-06T01:23:33.040 INFO:teuthology.orchestra.run.smithi050.stdout:checking linux/falloc.h presence... yes 2023-10-06T01:23:33.040 INFO:teuthology.orchestra.run.smithi050.stdout:checking for linux/falloc.h... yes 2023-10-06T01:23:33.097 INFO:teuthology.orchestra.run.smithi050.stdout:checking sys/fs/xfs_fsops.h usability... no 2023-10-06T01:23:33.121 INFO:teuthology.orchestra.run.smithi050.stdout:checking sys/fs/xfs_fsops.h presence... no 2023-10-06T01:23:33.121 INFO:teuthology.orchestra.run.smithi050.stdout:checking for sys/fs/xfs_fsops.h... no 2023-10-06T01:23:33.171 INFO:teuthology.orchestra.run.smithi050.stdout:checking sys/fs/xfs_itable.h usability... no 2023-10-06T01:23:33.196 INFO:teuthology.orchestra.run.smithi050.stdout:checking sys/fs/xfs_itable.h presence... no 2023-10-06T01:23:33.196 INFO:teuthology.orchestra.run.smithi050.stdout:checking for sys/fs/xfs_itable.h... no 2023-10-06T01:23:33.244 INFO:teuthology.orchestra.run.smithi050.stdout:checking xfs/platform_defs.h usability... no 2023-10-06T01:23:33.269 INFO:teuthology.orchestra.run.smithi050.stdout:checking xfs/platform_defs.h presence... no 2023-10-06T01:23:33.269 INFO:teuthology.orchestra.run.smithi050.stdout:checking for xfs/platform_defs.h... no 2023-10-06T01:23:33.318 INFO:teuthology.orchestra.run.smithi050.stdout:checking btrfs/ioctl.h usability... no 2023-10-06T01:23:33.343 INFO:teuthology.orchestra.run.smithi050.stdout:checking btrfs/ioctl.h presence... no 2023-10-06T01:23:33.343 INFO:teuthology.orchestra.run.smithi050.stdout:checking for btrfs/ioctl.h... no 2023-10-06T01:23:33.392 INFO:teuthology.orchestra.run.smithi050.stdout:checking cifs/ioctl.h usability... no 2023-10-06T01:23:33.416 INFO:teuthology.orchestra.run.smithi050.stdout:checking cifs/ioctl.h presence... no 2023-10-06T01:23:33.416 INFO:teuthology.orchestra.run.smithi050.stdout:checking for cifs/ioctl.h... no 2023-10-06T01:23:33.468 INFO:teuthology.orchestra.run.smithi050.stdout:checking sys/mman.h usability... yes 2023-10-06T01:23:33.485 INFO:teuthology.orchestra.run.smithi050.stdout:checking sys/mman.h presence... yes 2023-10-06T01:23:33.485 INFO:teuthology.orchestra.run.smithi050.stdout:checking for sys/mman.h... yes 2023-10-06T01:23:33.523 INFO:teuthology.orchestra.run.smithi050.stdout:checking for xfs/xfs_log_format.h... no 2023-10-06T01:23:33.591 INFO:teuthology.orchestra.run.smithi050.stdout:checking for uuid_compare... no 2023-10-06T01:23:33.647 INFO:teuthology.orchestra.run.smithi050.stdout:checking for uuid_compare in -luuid... yes 2023-10-06T01:23:33.759 INFO:teuthology.orchestra.run.smithi050.stdout:checking for xfs/xfs.h... yes 2023-10-06T01:23:33.791 INFO:teuthology.orchestra.run.smithi050.stdout:checking for xfs/libxfs.h... no 2023-10-06T01:23:33.830 INFO:teuthology.orchestra.run.smithi050.stdout:checking whether xlog_assign_lsn is declared... no 2023-10-06T01:23:33.883 INFO:teuthology.orchestra.run.smithi050.stdout:checking for xfs/xqm.h... yes 2023-10-06T01:23:33.964 INFO:teuthology.orchestra.run.smithi050.stdout:checking xfsctl from xfs/xfs.h... ok 2023-10-06T01:23:34.010 INFO:teuthology.orchestra.run.smithi050.stdout:checking xfs/handle.h usability... yes 2023-10-06T01:23:34.025 INFO:teuthology.orchestra.run.smithi050.stdout:checking xfs/handle.h presence... yes 2023-10-06T01:23:34.025 INFO:teuthology.orchestra.run.smithi050.stdout:checking for xfs/handle.h... yes 2023-10-06T01:23:34.098 INFO:teuthology.orchestra.run.smithi050.stdout:checking for attr_list_by_handle in -lhandle... yes 2023-10-06T01:23:34.145 INFO:teuthology.orchestra.run.smithi050.stdout:checking sys/acl.h usability... yes 2023-10-06T01:23:34.163 INFO:teuthology.orchestra.run.smithi050.stdout:checking sys/acl.h presence... yes 2023-10-06T01:23:34.163 INFO:teuthology.orchestra.run.smithi050.stdout:checking for sys/acl.h... yes 2023-10-06T01:23:34.220 INFO:teuthology.orchestra.run.smithi050.stdout:checking acl/libacl.h usability... yes 2023-10-06T01:23:34.238 INFO:teuthology.orchestra.run.smithi050.stdout:checking acl/libacl.h presence... yes 2023-10-06T01:23:34.239 INFO:teuthology.orchestra.run.smithi050.stdout:checking for acl/libacl.h... yes 2023-10-06T01:23:34.299 INFO:teuthology.orchestra.run.smithi050.stdout:checking for acl_init in -lacl... yes 2023-10-06T01:23:34.344 INFO:teuthology.orchestra.run.smithi050.stdout:checking gdbm-ndbm.h usability... no 2023-10-06T01:23:34.370 INFO:teuthology.orchestra.run.smithi050.stdout:checking gdbm-ndbm.h presence... no 2023-10-06T01:23:34.370 INFO:teuthology.orchestra.run.smithi050.stdout:checking for gdbm-ndbm.h... no 2023-10-06T01:23:34.412 INFO:teuthology.orchestra.run.smithi050.stdout:checking gdbm/ndbm.h usability... no 2023-10-06T01:23:34.414 DEBUG:teuthology.orchestra.run.smithi050:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T01:23:34.418 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T01:23:34.437 INFO:teuthology.orchestra.run.smithi050.stdout:checking gdbm/ndbm.h presence... no 2023-10-06T01:23:34.437 INFO:teuthology.orchestra.run.smithi050.stdout:checking for gdbm/ndbm.h... no 2023-10-06T01:23:34.481 INFO:teuthology.orchestra.run.smithi050.stdout:checking ndbm.h usability... no 2023-10-06T01:23:34.505 INFO:teuthology.orchestra.run.smithi050.stdout:checking ndbm.h presence... no 2023-10-06T01:23:34.506 INFO:teuthology.orchestra.run.smithi050.stdout:checking for ndbm.h... no 2023-10-06T01:23:34.653 INFO:teuthology.orchestra.run.smithi050.stdout:checking libaio.h usability... yes 2023-10-06T01:23:34.674 INFO:teuthology.orchestra.run.smithi050.stdout:checking libaio.h presence... yes 2023-10-06T01:23:34.675 INFO:teuthology.orchestra.run.smithi050.stdout:checking for libaio.h... yes 2023-10-06T01:23:34.720 INFO:teuthology.orchestra.run.smithi050.stdout:checking liburing.h usability... no 2023-10-06T01:23:34.745 INFO:teuthology.orchestra.run.smithi050.stdout:checking liburing.h presence... no 2023-10-06T01:23:34.745 INFO:teuthology.orchestra.run.smithi050.stdout:checking for liburing.h... no 2023-10-06T01:23:34.788 INFO:teuthology.orchestra.run.smithi050.stdout:checking sys/capability.h usability... no 2023-10-06T01:23:34.813 INFO:teuthology.orchestra.run.smithi050.stdout:checking sys/capability.h presence... no 2023-10-06T01:23:34.813 INFO:teuthology.orchestra.run.smithi050.stdout:checking for sys/capability.h... no 2023-10-06T01:23:34.858 INFO:teuthology.orchestra.run.smithi050.stdout:checking linux/fiemap.h usability... yes 2023-10-06T01:23:34.875 INFO:teuthology.orchestra.run.smithi050.stdout:checking linux/fiemap.h presence... yes 2023-10-06T01:23:34.875 INFO:teuthology.orchestra.run.smithi050.stdout:checking for linux/fiemap.h... yes 2023-10-06T01:23:34.937 INFO:teuthology.orchestra.run.smithi050.stdout:checking for fallocate... yes 2023-10-06T01:23:34.997 INFO:teuthology.orchestra.run.smithi050.stdout:checking for open_by_handle_at... yes 2023-10-06T01:23:35.045 INFO:teuthology.orchestra.run.smithi050.stdout:checking sys/prctl.h usability... yes 2023-10-06T01:23:35.062 INFO:teuthology.orchestra.run.smithi050.stdout:checking sys/prctl.h presence... yes 2023-10-06T01:23:35.062 INFO:teuthology.orchestra.run.smithi050.stdout:checking for sys/prctl.h... yes 2023-10-06T01:23:35.110 INFO:teuthology.orchestra.run.smithi050.stdout:checking linux/fs.h usability... yes 2023-10-06T01:23:35.126 INFO:teuthology.orchestra.run.smithi050.stdout:checking linux/fs.h presence... yes 2023-10-06T01:23:35.126 INFO:teuthology.orchestra.run.smithi050.stdout:checking for linux/fs.h... yes 2023-10-06T01:23:35.170 INFO:teuthology.orchestra.run.smithi050.stdout:checking btrfsutil.h usability... no 2023-10-06T01:23:35.194 INFO:teuthology.orchestra.run.smithi050.stdout:checking btrfsutil.h presence... no 2023-10-06T01:23:35.194 INFO:teuthology.orchestra.run.smithi050.stdout:checking for btrfsutil.h... no 2023-10-06T01:23:35.257 INFO:teuthology.orchestra.run.smithi050.stdout:checking for copy_file_range... yes 2023-10-06T01:23:35.321 INFO:teuthology.orchestra.run.smithi050.stdout:checking for SEEK_DATA... yes 2023-10-06T01:23:35.402 INFO:teuthology.orchestra.run.smithi050.stdout:checking for BMV_OF_SHARED... yes 2023-10-06T01:23:35.467 INFO:teuthology.orchestra.run.smithi050.stdout:checking for nftw... yes 2023-10-06T01:23:35.530 INFO:teuthology.orchestra.run.smithi050.stdout:checking for RLIMIT_NOFILE... yes 2023-10-06T01:23:35.568 INFO:teuthology.orchestra.run.smithi050.stdout:checking for FIEXCHANGE_RANGE... no 2023-10-06T01:23:35.628 INFO:teuthology.orchestra.run.smithi050.stdout:checking for renameat2... yes 2023-10-06T01:23:35.690 INFO:teuthology.orchestra.run.smithi050.stdout:checking for reallocarray... yes 2023-10-06T01:23:35.723 INFO:teuthology.orchestra.run.smithi050.stdout:checking for struct mount_attr... no 2023-10-06T01:23:35.801 INFO:teuthology.orchestra.run.smithi050.stdout:checking for struct btrfs_qgroup_limit... yes 2023-10-06T01:23:35.875 INFO:teuthology.orchestra.run.smithi050.stdout:checking for struct btrfs_qgroup_inherit... yes 2023-10-06T01:23:35.951 INFO:teuthology.orchestra.run.smithi050.stdout:checking for struct btrfs_ioctl_vol_args... yes 2023-10-06T01:23:36.024 INFO:teuthology.orchestra.run.smithi050.stdout:checking for struct btrfs_ioctl_vol_args_v2... yes 2023-10-06T01:23:36.099 INFO:teuthology.orchestra.run.smithi050.stdout:checking for struct btrfs_ioctl_ino_lookup_args... yes 2023-10-06T01:23:36.173 INFO:teuthology.orchestra.run.smithi050.stdout:checking for struct btrfs_ioctl_ino_lookup_user_args... yes 2023-10-06T01:23:36.247 INFO:teuthology.orchestra.run.smithi050.stdout:checking for struct btrfs_ioctl_get_subvol_rootref_args... yes 2023-10-06T01:23:36.302 INFO:teuthology.orchestra.run.smithi050.stdout:checking linux/btrfs.h usability... yes 2023-10-06T01:23:36.318 INFO:teuthology.orchestra.run.smithi050.stdout:checking linux/btrfs.h presence... yes 2023-10-06T01:23:36.319 INFO:teuthology.orchestra.run.smithi050.stdout:checking for linux/btrfs.h... yes 2023-10-06T01:23:36.380 INFO:teuthology.orchestra.run.smithi050.stdout:checking linux/btrfs_tree.h usability... yes 2023-10-06T01:23:36.397 INFO:teuthology.orchestra.run.smithi050.stdout:checking linux/btrfs_tree.h presence... yes 2023-10-06T01:23:36.398 INFO:teuthology.orchestra.run.smithi050.stdout:checking for linux/btrfs_tree.h... yes 2023-10-06T01:23:36.472 INFO:teuthology.orchestra.run.smithi050.stdout:checking for struct btrfs_ioctl_vol_args_v2.subvolid... no 2023-10-06T01:23:36.501 INFO:teuthology.orchestra.run.smithi050.stdout:configure: creating ./config.status 2023-10-06T01:23:37.430 INFO:teuthology.orchestra.run.smithi050.stdout:config.status: creating include/builddefs 2023-10-06T01:23:37.459 INFO:teuthology.orchestra.run.smithi050.stdout:config.status: creating include/config.h 2023-10-06T01:23:37.480 INFO:teuthology.orchestra.run.smithi050.stdout:config.status: executing libtool commands 2023-10-06T01:23:37.560 INFO:teuthology.orchestra.run.smithi050.stdout:Building include 2023-10-06T01:23:37.567 INFO:teuthology.orchestra.run.smithi050.stdout:Building lib 2023-10-06T01:23:37.574 INFO:teuthology.orchestra.run.smithi050.stdout: [LTDEP] 2023-10-06T01:23:37.775 INFO:teuthology.orchestra.run.smithi050.stdout: [CC] dataascii.lo 2023-10-06T01:23:37.980 INFO:teuthology.orchestra.run.smithi050.stdout: [CC] databin.lo 2023-10-06T01:23:38.215 INFO:teuthology.orchestra.run.smithi050.stdout: [CC] datapid.lo 2023-10-06T01:23:38.405 INFO:teuthology.orchestra.run.smithi050.stdout: [CC] file_lock.lo 2023-10-06T01:23:38.645 INFO:teuthology.orchestra.run.smithi050.stdout: [CC] forker.lo 2023-10-06T01:23:38.866 INFO:teuthology.orchestra.run.smithi050.stdout: [CC] pattern.lo 2023-10-06T01:23:39.071 INFO:teuthology.orchestra.run.smithi050.stdout: [CC] open_flags.lo 2023-10-06T01:23:39.302 INFO:teuthology.orchestra.run.smithi050.stdout: [CC] random_range.lo 2023-10-06T01:23:39.616 INFO:teuthology.orchestra.run.smithi050.stdout: [CC] string_to_tokens.lo 2023-10-06T01:23:39.814 INFO:teuthology.orchestra.run.smithi050.stdout: [CC] str_to_bytes.lo 2023-10-06T01:23:40.032 INFO:teuthology.orchestra.run.smithi050.stdout: [CC] tlibio.lo 2023-10-06T01:23:40.360 INFO:teuthology.orchestra.run.smithi050.stdout: [CC] write_log.lo 2023-10-06T01:23:40.693 INFO:teuthology.orchestra.run.smithi050.stdout: [CC] random.lo 2023-10-06T01:23:40.896 INFO:teuthology.orchestra.run.smithi050.stdout: [LD] 2023-10-06T01:23:41.027 INFO:teuthology.orchestra.run.smithi050.stdout:Building ltp 2023-10-06T01:23:41.033 INFO:teuthology.orchestra.run.smithi050.stdout: [DEP] 2023-10-06T01:23:41.246 INFO:teuthology.orchestra.run.smithi050.stdout: [CC] doio 2023-10-06T01:23:42.031 INFO:teuthology.orchestra.run.smithi050.stdout: [CC] fsstress 2023-10-06T01:23:43.469 INFO:teuthology.orchestra.run.smithi050.stdout: [CC] fsx 2023-10-06T01:23:44.451 INFO:teuthology.orchestra.run.smithi050.stdout: [CC] growfiles 2023-10-06T01:23:45.072 INFO:teuthology.orchestra.run.smithi050.stdout: [CC] iogen 2023-10-06T01:23:45.535 INFO:teuthology.orchestra.run.smithi050.stdout: [CC] aio-stress 2023-10-06T01:23:46.061 INFO:teuthology.orchestra.run.smithi050.stdout:Building src 2023-10-06T01:23:46.070 INFO:teuthology.orchestra.run.smithi050.stdout: [DEP] 2023-10-06T01:23:48.602 INFO:teuthology.orchestra.run.smithi050.stdout: [DEP] 2023-10-06T01:23:48.652 INFO:teuthology.orchestra.run.smithi050.stdout: [DEP] 2023-10-06T01:23:48.668 INFO:teuthology.orchestra.run.smithi050.stdout: [DEP] 2023-10-06T01:23:49.014 INFO:teuthology.orchestra.run.smithi050.stdout: [DEP] 2023-10-06T01:23:49.055 INFO:teuthology.orchestra.run.smithi050.stdout: [CC] dirstress 2023-10-06T01:23:49.400 INFO:teuthology.orchestra.run.smithi050.stdout: [CC] fill 2023-10-06T01:23:49.655 INFO:teuthology.orchestra.run.smithi050.stdout: [CC] fill2 2023-10-06T01:23:49.990 INFO:teuthology.orchestra.run.smithi050.stdout: [CC] getpagesize 2023-10-06T01:23:50.226 INFO:teuthology.orchestra.run.smithi050.stdout: [CC] holes 2023-10-06T01:23:50.525 INFO:teuthology.orchestra.run.smithi050.stdout: [CC] lstat64 2023-10-06T01:23:50.810 INFO:teuthology.orchestra.run.smithi050.stdout: [CC] nametest 2023-10-06T01:23:51.166 INFO:teuthology.orchestra.run.smithi050.stdout: [CC] permname 2023-10-06T01:23:51.471 INFO:teuthology.orchestra.run.smithi050.stdout: [CC] randholes 2023-10-06T01:23:51.826 INFO:teuthology.orchestra.run.smithi050.stdout: [CC] runas 2023-10-06T01:23:52.109 INFO:teuthology.orchestra.run.smithi050.stdout: [CC] truncfile 2023-10-06T01:23:52.394 INFO:teuthology.orchestra.run.smithi050.stdout: [CC] usemem 2023-10-06T01:23:52.645 INFO:teuthology.orchestra.run.smithi050.stdout: [CC] mmapcat 2023-10-06T01:23:52.898 INFO:teuthology.orchestra.run.smithi050.stdout: [CC] append_reader 2023-10-06T01:23:53.150 INFO:teuthology.orchestra.run.smithi050.stdout: [CC] append_writer 2023-10-06T01:23:53.403 INFO:teuthology.orchestra.run.smithi050.stdout: [CC] dirperf 2023-10-06T01:23:53.728 INFO:teuthology.orchestra.run.smithi050.stdout: [CC] metaperf 2023-10-06T01:23:54.087 INFO:teuthology.orchestra.run.smithi050.stdout: [CC] devzero 2023-10-06T01:23:54.366 INFO:teuthology.orchestra.run.smithi050.stdout: [CC] feature 2023-10-06T01:23:54.687 INFO:teuthology.orchestra.run.smithi050.stdout: [CC] alloc 2023-10-06T01:23:55.006 INFO:teuthology.orchestra.run.smithi050.stdout: [CC] fault 2023-10-06T01:23:55.275 INFO:teuthology.orchestra.run.smithi050.stdout: [CC] fstest 2023-10-06T01:23:55.619 INFO:teuthology.orchestra.run.smithi050.stdout: [CC] t_access_root 2023-10-06T01:23:55.875 INFO:teuthology.orchestra.run.smithi050.stdout: [CC] godown 2023-10-06T01:23:56.150 INFO:teuthology.orchestra.run.smithi050.stdout: [CC] resvtest 2023-10-06T01:23:56.441 INFO:teuthology.orchestra.run.smithi050.stdout: [CC] writemod 2023-10-06T01:23:56.687 INFO:teuthology.orchestra.run.smithi050.stdout: [CC] writev_on_pagefault 2023-10-06T01:23:56.950 INFO:teuthology.orchestra.run.smithi050.stdout: [CC] makeextents 2023-10-06T01:23:57.234 INFO:teuthology.orchestra.run.smithi050.stdout: [CC] itrash 2023-10-06T01:23:57.491 INFO:teuthology.orchestra.run.smithi050.stdout: [CC] rename 2023-10-06T01:23:57.729 INFO:teuthology.orchestra.run.smithi050.stdout: [CC] multi_open_unlink 2023-10-06T01:23:57.997 INFO:teuthology.orchestra.run.smithi050.stdout: [CC] unwritten_sync 2023-10-06T01:23:58.282 INFO:teuthology.orchestra.run.smithi050.stdout: [CC] genhashnames 2023-10-06T01:23:58.570 INFO:teuthology.orchestra.run.smithi050.stdout: [CC] t_holes 2023-10-06T01:23:58.819 INFO:teuthology.orchestra.run.smithi050.stdout: [CC] t_mmap_writev 2023-10-06T01:23:59.069 INFO:teuthology.orchestra.run.smithi050.stdout: [CC] t_truncate_cmtime 2023-10-06T01:23:59.329 INFO:teuthology.orchestra.run.smithi050.stdout: [CC] dirhash_collide 2023-10-06T01:23:59.613 INFO:teuthology.orchestra.run.smithi050.stdout: [CC] t_rename_overwrite 2023-10-06T01:23:59.855 INFO:teuthology.orchestra.run.smithi050.stdout: [CC] holetest 2023-10-06T01:24:00.179 INFO:teuthology.orchestra.run.smithi050.stdout: [CC] t_truncate_self 2023-10-06T01:24:00.419 INFO:teuthology.orchestra.run.smithi050.stdout: [CC] af_unix 2023-10-06T01:24:00.673 INFO:teuthology.orchestra.run.smithi050.stdout: [CC] t_mmap_stale_pmd 2023-10-06T01:24:00.932 INFO:teuthology.orchestra.run.smithi050.stdout: [CC] t_mmap_cow_race 2023-10-06T01:24:01.200 INFO:teuthology.orchestra.run.smithi050.stdout: [CC] t_mmap_fallocate 2023-10-06T01:24:01.451 INFO:teuthology.orchestra.run.smithi050.stdout: [CC] fsync-err 2023-10-06T01:24:01.740 INFO:teuthology.orchestra.run.smithi050.stdout: [CC] t_mmap_write_ro 2023-10-06T01:24:01.992 INFO:teuthology.orchestra.run.smithi050.stdout: [CC] t_ext4_dax_journal_corruption 2023-10-06T01:24:02.253 INFO:teuthology.orchestra.run.smithi050.stdout: [CC] t_ext4_dax_inline_corruption 2023-10-06T01:24:02.510 INFO:teuthology.orchestra.run.smithi050.stdout: [CC] t_ofd_locks 2023-10-06T01:24:02.810 INFO:teuthology.orchestra.run.smithi050.stdout: [CC] t_mmap_collision 2023-10-06T01:24:03.110 INFO:teuthology.orchestra.run.smithi050.stdout: [CC] mmap-write-concurrent 2023-10-06T01:24:03.383 INFO:teuthology.orchestra.run.smithi050.stdout: [CC] t_get_file_time 2023-10-06T01:24:03.632 INFO:teuthology.orchestra.run.smithi050.stdout: [CC] t_create_short_dirs 2023-10-06T01:24:03.901 INFO:teuthology.orchestra.run.smithi050.stdout: [CC] t_create_long_dirs 2023-10-06T01:24:04.168 INFO:teuthology.orchestra.run.smithi050.stdout: [CC] t_enospc 2023-10-06T01:24:04.456 INFO:teuthology.orchestra.run.smithi050.stdout: [CC] t_mmap_writev_overlap 2023-10-06T01:24:04.520 DEBUG:teuthology.orchestra.run.smithi050:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T01:24:04.525 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T01:24:04.729 INFO:teuthology.orchestra.run.smithi050.stdout: [CC] checkpoint_journal 2023-10-06T01:24:04.986 INFO:teuthology.orchestra.run.smithi050.stdout: [CC] mmap-rw-fault 2023-10-06T01:24:05.273 INFO:teuthology.orchestra.run.smithi050.stdout: [CC] allocstale 2023-10-06T01:24:05.547 INFO:teuthology.orchestra.run.smithi050.stdout: [CC] t_mmap_cow_memory_failure 2023-10-06T01:24:05.820 INFO:teuthology.orchestra.run.smithi050.stdout: [CC] fake-dump-rootino 2023-10-06T01:24:06.071 INFO:teuthology.orchestra.run.smithi050.stdout: [CC] dio-buf-fault 2023-10-06T01:24:06.327 INFO:teuthology.orchestra.run.smithi050.stdout: [CC] xfsctl 2023-10-06T01:24:06.619 INFO:teuthology.orchestra.run.smithi050.stdout: [CC] bstat 2023-10-06T01:24:06.931 INFO:teuthology.orchestra.run.smithi050.stdout: [CC] t_mtab 2023-10-06T01:24:07.218 INFO:teuthology.orchestra.run.smithi050.stdout: [CC] getdevicesize 2023-10-06T01:24:07.460 INFO:teuthology.orchestra.run.smithi050.stdout: [CC] preallo_rw_pattern_reader 2023-10-06T01:24:07.723 INFO:teuthology.orchestra.run.smithi050.stdout: [CC] preallo_rw_pattern_writer 2023-10-06T01:24:07.990 INFO:teuthology.orchestra.run.smithi050.stdout: [CC] ftrunc 2023-10-06T01:24:08.239 INFO:teuthology.orchestra.run.smithi050.stdout: [CC] trunc 2023-10-06T01:24:08.504 INFO:teuthology.orchestra.run.smithi050.stdout: [CC] fs_perms 2023-10-06T01:24:08.770 INFO:teuthology.orchestra.run.smithi050.stdout: [CC] testx 2023-10-06T01:24:09.004 INFO:teuthology.orchestra.run.smithi050.stdout: [CC] looptest 2023-10-06T01:24:09.301 INFO:teuthology.orchestra.run.smithi050.stdout: [CC] locktest 2023-10-06T01:24:09.711 INFO:teuthology.orchestra.run.smithi050.stdout: [CC] unwritten_mmap 2023-10-06T01:24:09.980 INFO:teuthology.orchestra.run.smithi050.stdout: [CC] bulkstat_unlink_test 2023-10-06T01:24:10.286 INFO:teuthology.orchestra.run.smithi050.stdout: [CC] deduperace 2023-10-06T01:24:10.586 INFO:teuthology.orchestra.run.smithi050.stdout: [CC] bulkstat_unlink_test_modified 2023-10-06T01:24:10.888 INFO:teuthology.orchestra.run.smithi050.stdout: [CC] t_dir_offset 2023-10-06T01:24:11.137 INFO:teuthology.orchestra.run.smithi050.stdout: [CC] t_futimens 2023-10-06T01:24:11.380 INFO:teuthology.orchestra.run.smithi050.stdout: [CC] t_immutable 2023-10-06T01:24:12.095 INFO:teuthology.orchestra.run.smithi050.stdout: [CC] stale_handle 2023-10-06T01:24:12.370 INFO:teuthology.orchestra.run.smithi050.stdout: [CC] pwrite_mmap_blocked 2023-10-06T01:24:12.626 INFO:teuthology.orchestra.run.smithi050.stdout: [CC] t_dir_offset2 2023-10-06T01:24:12.921 INFO:teuthology.orchestra.run.smithi050.stdout: [CC] seek_sanity_test 2023-10-06T01:24:13.442 INFO:teuthology.orchestra.run.smithi050.stdout: [CC] seek_copy_test 2023-10-06T01:24:13.720 INFO:teuthology.orchestra.run.smithi050.stdout: [CC] t_readdir_1 2023-10-06T01:24:13.972 INFO:teuthology.orchestra.run.smithi050.stdout: [CC] t_readdir_2 2023-10-06T01:24:14.225 INFO:teuthology.orchestra.run.smithi050.stdout: [CC] fsync-tester 2023-10-06T01:24:14.578 INFO:teuthology.orchestra.run.smithi050.stdout: [CC] nsexec 2023-10-06T01:24:14.856 INFO:teuthology.orchestra.run.smithi050.stdout: [CC] cloner 2023-10-06T01:24:15.137 INFO:teuthology.orchestra.run.smithi050.stdout: [CC] renameat2 2023-10-06T01:24:15.408 INFO:teuthology.orchestra.run.smithi050.stdout: [CC] t_getcwd 2023-10-06T01:24:15.669 INFO:teuthology.orchestra.run.smithi050.stdout: [CC] e4compact 2023-10-06T01:24:15.976 INFO:teuthology.orchestra.run.smithi050.stdout: [CC] test-nextquota 2023-10-06T01:24:16.251 INFO:teuthology.orchestra.run.smithi050.stdout: [CC] punch-alternating 2023-10-06T01:24:16.528 INFO:teuthology.orchestra.run.smithi050.stdout: [CC] attr-list-by-handle-cursor-test 2023-10-06T01:24:16.800 INFO:teuthology.orchestra.run.smithi050.stdout: [CC] listxattr 2023-10-06T01:24:17.052 INFO:teuthology.orchestra.run.smithi050.stdout: [CC] dio-interleaved 2023-10-06T01:24:17.314 INFO:teuthology.orchestra.run.smithi050.stdout: [CC] t_dir_type 2023-10-06T01:24:17.572 INFO:teuthology.orchestra.run.smithi050.stdout: [CC] dio-invalidate-cache 2023-10-06T01:24:17.880 INFO:teuthology.orchestra.run.smithi050.stdout: [CC] stat_test 2023-10-06T01:24:18.284 INFO:teuthology.orchestra.run.smithi050.stdout: [CC] t_encrypted_d_revalidate 2023-10-06T01:24:18.553 INFO:teuthology.orchestra.run.smithi050.stdout: [CC] attr_replace_test 2023-10-06T01:24:18.819 INFO:teuthology.orchestra.run.smithi050.stdout: [CC] swapon 2023-10-06T01:24:19.088 INFO:teuthology.orchestra.run.smithi050.stdout: [CC] mkswap 2023-10-06T01:24:19.341 INFO:teuthology.orchestra.run.smithi050.stdout: [CC] t_attr_corruption 2023-10-06T01:24:19.593 INFO:teuthology.orchestra.run.smithi050.stdout: [CC] t_open_tmpfiles 2023-10-06T01:24:19.881 INFO:teuthology.orchestra.run.smithi050.stdout: [CC] fscrypt-crypt-util 2023-10-06T01:24:20.627 INFO:teuthology.orchestra.run.smithi050.stdout: [CC] bulkstat_null_ocount 2023-10-06T01:24:20.894 INFO:teuthology.orchestra.run.smithi050.stdout: [CC] splice-test 2023-10-06T01:24:21.180 INFO:teuthology.orchestra.run.smithi050.stdout: [CC] chprojid_fail 2023-10-06T01:24:21.449 INFO:teuthology.orchestra.run.smithi050.stdout: [CC] detached_mounts_propagation 2023-10-06T01:24:21.740 INFO:teuthology.orchestra.run.smithi050.stdout: [CC] ext4_resize 2023-10-06T01:24:21.996 INFO:teuthology.orchestra.run.smithi050.stdout: [CC] t_readdir_3 2023-10-06T01:24:22.293 INFO:teuthology.orchestra.run.smithi050.stdout: [CC] splice2pipe 2023-10-06T01:24:22.559 INFO:teuthology.orchestra.run.smithi050.stdout: [CC] uuid_ioctl 2023-10-06T01:24:22.819 INFO:teuthology.orchestra.run.smithi050.stdout: [CC] fiemap-tester 2023-10-06T01:24:23.191 INFO:teuthology.orchestra.run.smithi050.stdout: [CC] t_stripealign 2023-10-06T01:24:23.447 INFO:teuthology.orchestra.run.smithi050.stdout: [CC] open_by_handle 2023-10-06T01:24:23.804 INFO:teuthology.orchestra.run.smithi050.stdout: [CC] t_mmap_dio 2023-10-06T01:24:24.071 INFO:teuthology.orchestra.run.smithi050.stdout: [CC] xfsfind 2023-10-06T01:24:24.372 INFO:teuthology.orchestra.run.smithi050.stdout: [CC] fssum 2023-10-06T01:24:24.917 INFO:teuthology.orchestra.run.smithi050.stdout:Building log-writes 2023-10-06T01:24:24.927 INFO:teuthology.orchestra.run.smithi050.stdout: [CC] replay-log 2023-10-06T01:24:25.350 INFO:teuthology.orchestra.run.smithi050.stdout:Building perf 2023-10-06T01:24:25.358 INFO:teuthology.orchestra.run.smithi050.stdout:Building aio-dio-regress 2023-10-06T01:24:25.369 INFO:teuthology.orchestra.run.smithi050.stdout: [CC] aio-dio-append-write-fallocate-race 2023-10-06T01:24:25.649 INFO:teuthology.orchestra.run.smithi050.stdout: [CC] aio-dio-fcntl-race 2023-10-06T01:24:25.920 INFO:teuthology.orchestra.run.smithi050.stdout: [CC] aio-dio-subblock-eof-read 2023-10-06T01:24:26.169 INFO:teuthology.orchestra.run.smithi050.stdout: [CC] aio-dio-append-write-read-race 2023-10-06T01:24:26.452 INFO:teuthology.orchestra.run.smithi050.stdout: [CC] aio-dio-invalidate-readahead 2023-10-06T01:24:26.724 INFO:teuthology.orchestra.run.smithi050.stdout: [CC] aio-dio-hole-filling-race 2023-10-06T01:24:26.982 INFO:teuthology.orchestra.run.smithi050.stdout: [CC] aio-free-ring-with-bogus-nr-pages 2023-10-06T01:24:27.222 INFO:teuthology.orchestra.run.smithi050.stdout: [CC] aio-last-ref-held-by-io 2023-10-06T01:24:27.503 INFO:teuthology.orchestra.run.smithi050.stdout: [CC] aio-dio-cycle-write 2023-10-06T01:24:27.796 INFO:teuthology.orchestra.run.smithi050.stdout: [CC] aio-dio-extend-stat 2023-10-06T01:24:28.070 INFO:teuthology.orchestra.run.smithi050.stdout: [CC] aio-io-setup-with-nonwritable-context-pointer 2023-10-06T01:24:28.307 INFO:teuthology.orchestra.run.smithi050.stdout: [CC] aiocp 2023-10-06T01:24:28.638 INFO:teuthology.orchestra.run.smithi050.stdout: [CC] aio-dio-invalidate-failure 2023-10-06T01:24:28.904 INFO:teuthology.orchestra.run.smithi050.stdout: [CC] aiodio_sparse2 2023-10-06T01:24:29.226 INFO:teuthology.orchestra.run.smithi050.stdout: [CC] aio-dio-cow-race 2023-10-06T01:24:29.487 INFO:teuthology.orchestra.run.smithi050.stdout: [CC] aio-dio-write-verify 2023-10-06T01:24:29.789 INFO:teuthology.orchestra.run.smithi050.stdout: [CC] aio-dio-eof-race 2023-10-06T01:24:30.081 INFO:teuthology.orchestra.run.smithi050.stdout:Building vfs 2023-10-06T01:24:30.091 INFO:teuthology.orchestra.run.smithi050.stdout: [CC] vfstest 2023-10-06T01:24:32.172 INFO:teuthology.orchestra.run.smithi050.stdout: [CC] mount-idmapped 2023-10-06T01:24:32.666 INFO:teuthology.orchestra.run.smithi050.stdout:Building m4 2023-10-06T01:24:32.672 INFO:teuthology.orchestra.run.smithi050.stdout:Building common 2023-10-06T01:24:32.679 INFO:teuthology.orchestra.run.smithi050.stdout:Building tests 2023-10-06T01:24:32.689 INFO:teuthology.orchestra.run.smithi050.stdout:Building perf 2023-10-06T01:24:32.699 INFO:teuthology.orchestra.run.smithi050.stdout: [GROUP] /tmp/tmp.aaWjY8JXYCxfstests-dev/tests/perf/group.list 2023-10-06T01:24:32.739 INFO:teuthology.orchestra.run.smithi050.stdout:Building ext4 2023-10-06T01:24:32.749 INFO:teuthology.orchestra.run.smithi050.stdout: [GROUP] /tmp/tmp.aaWjY8JXYCxfstests-dev/tests/ext4/group.list 2023-10-06T01:24:32.844 INFO:teuthology.orchestra.run.smithi050.stdout:Building ocfs2 2023-10-06T01:24:32.855 INFO:teuthology.orchestra.run.smithi050.stdout: [GROUP] /tmp/tmp.aaWjY8JXYCxfstests-dev/tests/ocfs2/group.list 2023-10-06T01:24:32.890 INFO:teuthology.orchestra.run.smithi050.stdout:Building overlay 2023-10-06T01:24:32.900 INFO:teuthology.orchestra.run.smithi050.stdout: [GROUP] /tmp/tmp.aaWjY8JXYCxfstests-dev/tests/overlay/group.list 2023-10-06T01:24:32.999 INFO:teuthology.orchestra.run.smithi050.stdout:Building cifs 2023-10-06T01:24:33.009 INFO:teuthology.orchestra.run.smithi050.stdout: [GROUP] /tmp/tmp.aaWjY8JXYCxfstests-dev/tests/cifs/group.list 2023-10-06T01:24:33.041 INFO:teuthology.orchestra.run.smithi050.stdout:Building generic 2023-10-06T01:24:33.053 INFO:teuthology.orchestra.run.smithi050.stdout: [GROUP] /tmp/tmp.aaWjY8JXYCxfstests-dev/tests/generic/group.list 2023-10-06T01:24:33.304 INFO:teuthology.orchestra.run.smithi050.stdout:Building shared 2023-10-06T01:24:33.314 INFO:teuthology.orchestra.run.smithi050.stdout: [GROUP] /tmp/tmp.aaWjY8JXYCxfstests-dev/tests/shared/group.list 2023-10-06T01:24:33.357 INFO:teuthology.orchestra.run.smithi050.stdout:Building xfs 2023-10-06T01:24:33.369 INFO:teuthology.orchestra.run.smithi050.stdout: [GROUP] /tmp/tmp.aaWjY8JXYCxfstests-dev/tests/xfs/group.list 2023-10-06T01:24:33.619 INFO:teuthology.orchestra.run.smithi050.stdout:Building f2fs 2023-10-06T01:24:33.629 INFO:teuthology.orchestra.run.smithi050.stdout: [GROUP] /tmp/tmp.aaWjY8JXYCxfstests-dev/tests/f2fs/group.list 2023-10-06T01:24:33.673 INFO:teuthology.orchestra.run.smithi050.stdout:Building udf 2023-10-06T01:24:33.683 INFO:teuthology.orchestra.run.smithi050.stdout: [GROUP] /tmp/tmp.aaWjY8JXYCxfstests-dev/tests/udf/group.list 2023-10-06T01:24:33.712 INFO:teuthology.orchestra.run.smithi050.stdout:Building ceph 2023-10-06T01:24:33.722 INFO:teuthology.orchestra.run.smithi050.stdout: [GROUP] /tmp/tmp.aaWjY8JXYCxfstests-dev/tests/ceph/group.list 2023-10-06T01:24:33.758 INFO:teuthology.orchestra.run.smithi050.stdout:Building nfs 2023-10-06T01:24:33.768 INFO:teuthology.orchestra.run.smithi050.stdout: [GROUP] /tmp/tmp.aaWjY8JXYCxfstests-dev/tests/nfs/group.list 2023-10-06T01:24:33.804 INFO:teuthology.orchestra.run.smithi050.stdout:Building btrfs 2023-10-06T01:24:33.815 INFO:teuthology.orchestra.run.smithi050.stdout: [GROUP] /tmp/tmp.aaWjY8JXYCxfstests-dev/tests/btrfs/group.list 2023-10-06T01:24:33.966 INFO:teuthology.orchestra.run.smithi050.stdout:Building tmpfs 2023-10-06T01:24:33.976 INFO:teuthology.orchestra.run.smithi050.stdout: [GROUP] /tmp/tmp.aaWjY8JXYCxfstests-dev/tests/tmpfs/group.list 2023-10-06T01:24:34.010 INFO:teuthology.orchestra.run.smithi050.stdout:Building selftest 2023-10-06T01:24:34.020 INFO:teuthology.orchestra.run.smithi050.stdout: [GROUP] /tmp/tmp.aaWjY8JXYCxfstests-dev/tests/selftest/group.list 2023-10-06T01:24:34.055 DEBUG:teuthology.orchestra.run.smithi050:> (cd /tmp/tmp.aaWjY8JXYCxfstests-dev && exec sudo make install) 2023-10-06T01:24:34.140 INFO:teuthology.orchestra.run.smithi050.stdout:Building include 2023-10-06T01:24:34.148 INFO:teuthology.orchestra.run.smithi050.stdout:Building lib 2023-10-06T01:24:34.156 INFO:teuthology.orchestra.run.smithi050.stdout:Building ltp 2023-10-06T01:24:34.164 INFO:teuthology.orchestra.run.smithi050.stdout:Building src 2023-10-06T01:24:34.226 INFO:teuthology.orchestra.run.smithi050.stdout:Building log-writes 2023-10-06T01:24:34.233 INFO:teuthology.orchestra.run.smithi050.stdout:Building perf 2023-10-06T01:24:34.240 INFO:teuthology.orchestra.run.smithi050.stdout:Building aio-dio-regress 2023-10-06T01:24:34.248 INFO:teuthology.orchestra.run.smithi050.stdout:Building vfs 2023-10-06T01:24:34.256 INFO:teuthology.orchestra.run.smithi050.stdout:Building m4 2023-10-06T01:24:34.264 INFO:teuthology.orchestra.run.smithi050.stdout:Building common 2023-10-06T01:24:34.271 INFO:teuthology.orchestra.run.smithi050.stdout:Building tests 2023-10-06T01:24:34.281 INFO:teuthology.orchestra.run.smithi050.stdout:Building perf 2023-10-06T01:24:34.291 INFO:teuthology.orchestra.run.smithi050.stdout: [GROUP] /tmp/tmp.aaWjY8JXYCxfstests-dev/tests/perf/group.list 2023-10-06T01:24:34.320 INFO:teuthology.orchestra.run.smithi050.stdout:Building ext4 2023-10-06T01:24:34.330 INFO:teuthology.orchestra.run.smithi050.stdout: [GROUP] /tmp/tmp.aaWjY8JXYCxfstests-dev/tests/ext4/group.list 2023-10-06T01:24:34.424 INFO:teuthology.orchestra.run.smithi050.stdout:Building ocfs2 2023-10-06T01:24:34.434 INFO:teuthology.orchestra.run.smithi050.stdout: [GROUP] /tmp/tmp.aaWjY8JXYCxfstests-dev/tests/ocfs2/group.list 2023-10-06T01:24:34.468 INFO:teuthology.orchestra.run.smithi050.stdout:Building overlay 2023-10-06T01:24:34.478 INFO:teuthology.orchestra.run.smithi050.stdout: [GROUP] /tmp/tmp.aaWjY8JXYCxfstests-dev/tests/overlay/group.list 2023-10-06T01:24:34.576 INFO:teuthology.orchestra.run.smithi050.stdout:Building cifs 2023-10-06T01:24:34.586 INFO:teuthology.orchestra.run.smithi050.stdout: [GROUP] /tmp/tmp.aaWjY8JXYCxfstests-dev/tests/cifs/group.list 2023-10-06T01:24:34.618 INFO:teuthology.orchestra.run.smithi050.stdout:Building generic 2023-10-06T01:24:34.630 INFO:teuthology.orchestra.run.smithi050.stdout: [GROUP] /tmp/tmp.aaWjY8JXYCxfstests-dev/tests/generic/group.list 2023-10-06T01:24:34.634 DEBUG:teuthology.orchestra.run.smithi050:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T01:24:34.638 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T01:24:34.875 INFO:teuthology.orchestra.run.smithi050.stdout:Building shared 2023-10-06T01:24:34.885 INFO:teuthology.orchestra.run.smithi050.stdout: [GROUP] /tmp/tmp.aaWjY8JXYCxfstests-dev/tests/shared/group.list 2023-10-06T01:24:34.929 INFO:teuthology.orchestra.run.smithi050.stdout:Building xfs 2023-10-06T01:24:34.941 INFO:teuthology.orchestra.run.smithi050.stdout: [GROUP] /tmp/tmp.aaWjY8JXYCxfstests-dev/tests/xfs/group.list 2023-10-06T01:24:35.186 INFO:teuthology.orchestra.run.smithi050.stdout:Building f2fs 2023-10-06T01:24:35.196 INFO:teuthology.orchestra.run.smithi050.stdout: [GROUP] /tmp/tmp.aaWjY8JXYCxfstests-dev/tests/f2fs/group.list 2023-10-06T01:24:35.240 INFO:teuthology.orchestra.run.smithi050.stdout:Building udf 2023-10-06T01:24:35.249 INFO:teuthology.orchestra.run.smithi050.stdout: [GROUP] /tmp/tmp.aaWjY8JXYCxfstests-dev/tests/udf/group.list 2023-10-06T01:24:35.278 INFO:teuthology.orchestra.run.smithi050.stdout:Building ceph 2023-10-06T01:24:35.288 INFO:teuthology.orchestra.run.smithi050.stdout: [GROUP] /tmp/tmp.aaWjY8JXYCxfstests-dev/tests/ceph/group.list 2023-10-06T01:24:35.326 INFO:teuthology.orchestra.run.smithi050.stdout:Building nfs 2023-10-06T01:24:35.335 INFO:teuthology.orchestra.run.smithi050.stdout: [GROUP] /tmp/tmp.aaWjY8JXYCxfstests-dev/tests/nfs/group.list 2023-10-06T01:24:35.371 INFO:teuthology.orchestra.run.smithi050.stdout:Building btrfs 2023-10-06T01:24:35.382 INFO:teuthology.orchestra.run.smithi050.stdout: [GROUP] /tmp/tmp.aaWjY8JXYCxfstests-dev/tests/btrfs/group.list 2023-10-06T01:24:35.530 INFO:teuthology.orchestra.run.smithi050.stdout:Building tmpfs 2023-10-06T01:24:35.539 INFO:teuthology.orchestra.run.smithi050.stdout: [GROUP] /tmp/tmp.aaWjY8JXYCxfstests-dev/tests/tmpfs/group.list 2023-10-06T01:24:35.573 INFO:teuthology.orchestra.run.smithi050.stdout:Building selftest 2023-10-06T01:24:35.583 INFO:teuthology.orchestra.run.smithi050.stdout: [GROUP] /tmp/tmp.aaWjY8JXYCxfstests-dev/tests/selftest/group.list 2023-10-06T01:24:35.614 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/gmake --no-print-directory Q=@ -C include install 2023-10-06T01:24:35.616 INFO:teuthology.orchestra.run.smithi050.stdout:gmake[1]: Nothing to be done for 'install'. 2023-10-06T01:24:35.617 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/gmake --no-print-directory Q=@ -C lib install 2023-10-06T01:24:35.620 INFO:teuthology.orchestra.run.smithi050.stdout:gmake[1]: Nothing to be done for 'install'. 2023-10-06T01:24:35.620 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/gmake --no-print-directory Q=@ -C ltp install 2023-10-06T01:24:35.624 INFO:teuthology.orchestra.run.smithi050.stdout:../install-sh -o root -g root -m 755 -d /var/lib/xfstests/ltp 2023-10-06T01:24:35.648 INFO:teuthology.orchestra.run.smithi050.stdout:/bin/sh ../libtool --quiet --mode=install ../install-sh -o root -g root -m 755 doio fsstress fsx growfiles iogen aio-stress /var/lib/xfstests/ltp 2023-10-06T01:24:35.826 INFO:teuthology.orchestra.run.smithi050.stdout:../install-sh -o root -g root -m 755 rwtest.sh /var/lib/xfstests/ltp 2023-10-06T01:24:35.850 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/gmake --no-print-directory Q=@ -C src install 2023-10-06T01:24:35.880 INFO:teuthology.orchestra.run.smithi050.stdout:Building log-writes 2023-10-06T01:24:35.888 INFO:teuthology.orchestra.run.smithi050.stdout:Building perf 2023-10-06T01:24:35.895 INFO:teuthology.orchestra.run.smithi050.stdout:Building aio-dio-regress 2023-10-06T01:24:35.903 INFO:teuthology.orchestra.run.smithi050.stdout:Building vfs 2023-10-06T01:24:35.909 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/gmake -C log-writes install 2023-10-06T01:24:35.911 INFO:teuthology.orchestra.run.smithi050.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/src/log-writes 2023-10-06T01:24:35.936 INFO:teuthology.orchestra.run.smithi050.stdout:../../install-sh -o root -g root -m 755 replay-log /var/lib/xfstests/src/log-writes 2023-10-06T01:24:35.960 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/gmake -C perf install 2023-10-06T01:24:35.963 INFO:teuthology.orchestra.run.smithi050.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/src/perf 2023-10-06T01:24:35.987 INFO:teuthology.orchestra.run.smithi050.stdout:../../install-sh -o root -g root -m 755 ResultData.py fio-insert-and-compare.py FioResultDecoder.py FioCompare.py generate-schema.py fio-results.sql /var/lib/xfstests/src/perf 2023-10-06T01:24:36.051 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/gmake -C aio-dio-regress install 2023-10-06T01:24:36.054 INFO:teuthology.orchestra.run.smithi050.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/src/aio-dio-regress 2023-10-06T01:24:36.077 INFO:teuthology.orchestra.run.smithi050.stdout:../../install-sh -o root -g root -m 755 aio-dio-append-write-fallocate-race aio-dio-fcntl-race aio-dio-subblock-eof-read aio-dio-append-write-read-race aio-dio-invalidate-readahead aio-dio-hole-filling-race aio-free-ring-with-bogus-nr-pages aio-last-ref-held-by-io aio-dio-cycle-write aio-dio-extend-stat aio-io-setup-with-nonwritable-context-pointer aiocp aio-dio-invalidate-failure aiodio_sparse2 aio-dio-cow-race aio-dio-write-verify aio-dio-eof-race /var/lib/xfstests/src/aio-dio-regress 2023-10-06T01:24:36.231 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/gmake -C vfs install 2023-10-06T01:24:36.233 INFO:teuthology.orchestra.run.smithi050.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/src/vfs 2023-10-06T01:24:36.257 INFO:teuthology.orchestra.run.smithi050.stdout:../../install-sh -o root -g root -m 755 vfstest mount-idmapped /var/lib/xfstests/src/vfs 2023-10-06T01:24:36.290 INFO:teuthology.orchestra.run.smithi050.stdout:../install-sh -o root -g root -m 755 -d /var/lib/xfstests/src 2023-10-06T01:24:36.314 INFO:teuthology.orchestra.run.smithi050.stdout:/bin/sh ../libtool --quiet --mode=install ../install-sh -o root -g root -m 755 dirstress fill fill2 getpagesize holes lstat64 nametest permname randholes runas truncfile usemem mmapcat append_reader append_writer dirperf metaperf devzero feature alloc fault fstest t_access_root godown resvtest writemod writev_on_pagefault makeextents itrash rename multi_open_unlink unwritten_sync genhashnames t_holes t_mmap_writev t_truncate_cmtime dirhash_collide t_rename_overwrite holetest t_truncate_self af_unix t_mmap_stale_pmd t_mmap_cow_race t_mmap_fallocate fsync-err t_mmap_write_ro t_ext4_dax_journal_corruption t_ext4_dax_inline_corruption t_ofd_locks t_mmap_collision mmap-write-concurrent t_get_file_time t_create_short_dirs t_create_long_dirs t_enospc t_mmap_writev_overlap checkpoint_journal mmap-rw-fault allocstale t_mmap_cow_memory_failure fake-dump-rootino dio-buf-fault xfsctl bstat t_mtab getdevicesize preallo_rw_pattern_reader preallo_rw_pattern_writer ftrunc trunc fs_perms testx looptest locktest unwritten_mmap bulkstat_unlink_test deduperace bulkstat_unlink_test_modified t_dir_offset t_futimens t_immutable stale_handle pwrite_mmap_blocked t_dir_offset2 seek_sanity_test seek_copy_test t_readdir_1 t_readdir_2 fsync-tester nsexec cloner renameat2 t_getcwd e4compact test-nextquota punch-alternating attr-list-by-handle-cursor-test listxattr dio-interleaved t_dir_type dio-invalidate-cache stat_test t_encrypted_d_revalidate attr_replace_test swapon mkswap t_attr_corruption t_open_tmpfiles fscrypt-crypt-util bulkstat_null_ocount splice-test chprojid_fail detached_mounts_propagation ext4_resize t_readdir_3 splice2pipe uuid_ioctl fiemap-tester t_stripealign open_by_handle t_mmap_dio xfsfind fssum /var/lib/xfstests/src 2023-10-06T01:24:39.355 INFO:teuthology.orchestra.run.smithi050.stdout:/bin/sh ../libtool --quiet --mode=install ../install-sh -o root -g root -m 755 dmerror fill2attr fill2fs fill2fs_check scaleread.sh btrfs_crc32c_forged_name.py popdir.pl popattr.py soak_duration.awk /var/lib/xfstests/src 2023-10-06T01:24:39.601 INFO:teuthology.orchestra.run.smithi050.stdout:/bin/sh ../libtool --quiet --mode=install ../install-sh -o root -g root -m 644 dumpfile /var/lib/xfstests/src 2023-10-06T01:24:39.657 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/gmake --no-print-directory Q=@ -C m4 install 2023-10-06T01:24:39.660 INFO:teuthology.orchestra.run.smithi050.stdout:gmake[1]: Nothing to be done for 'install'. 2023-10-06T01:24:39.660 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/gmake --no-print-directory Q=@ -C common install 2023-10-06T01:24:39.663 INFO:teuthology.orchestra.run.smithi050.stdout:../install-sh -o root -g root -m 755 -d /var/lib/xfstests/common 2023-10-06T01:24:39.687 INFO:teuthology.orchestra.run.smithi050.stdout:../install-sh -o root -g root -m 644 * /var/lib/xfstests/common 2023-10-06T01:24:40.080 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/gmake --no-print-directory Q=@ -C tests install 2023-10-06T01:24:40.083 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.aaWjY8JXYCxfstests-dev/tests/btrfs/ install 2023-10-06T01:24:40.087 INFO:teuthology.orchestra.run.smithi050.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/btrfs 2023-10-06T01:24:40.111 INFO:teuthology.orchestra.run.smithi050.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 007 008 009 010 011 012 013 014 015 016 017 018 019 020 021 022 023 024 025 026 027 028 029 030 031 032 033 034 035 036 037 038 039 040 041 042 043 044 045 046 047 048 049 050 051 052 053 054 055 056 057 058 059 060 061 062 063 064 065 066 067 068 069 070 071 072 073 074 075 076 077 078 079 080 081 082 083 084 085 086 087 088 089 090 091 092 093 094 095 096 097 098 099 100 101 102 103 104 105 106 107 108 109 110 111 112 113 114 115 116 117 118 119 120 121 122 123 124 125 126 127 128 129 130 131 132 133 134 135 136 137 138 139 140 141 142 143 144 145 146 147 148 149 150 151 152 153 154 155 156 157 158 159 160 161 162 163 164 165 166 167 168 169 170 171 172 173 174 175 176 177 178 179 180 181 182 183 184 185 186 187 188 189 190 191 192 193 194 195 196 197 198 199 200 201 202 203 204 205 206 207 208 209 210 211 212 213 214 215 216 217 218 219 220 221 222 223 224 225 226 227 228 229 230 231 232 233 234 235 236 237 238 239 240 241 242 243 244 245 246 247 248 249 250 251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 299 300 /var/lib/xfstests/tests/btrfs 2023-10-06T01:24:42.497 INFO:teuthology.orchestra.run.smithi050.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/btrfs 2023-10-06T01:24:42.521 INFO:teuthology.orchestra.run.smithi050.stdout:../../install-sh -o root -g root -m 644 140.out 056.out 236.out 202.out 008.out 040.out 004.out 047.out 199.out 233.out 055.out 095.out 009.out 033.out 082.out 270.out 088.out 036.out 296.out 225.out 210.out 002.out 125.out 037.out 181.out 152.out 103.out 024.out 243.out 192.out 148.out 282.out 077.out 052.out 256.out 228.out 128.out 028.out 273.out 114.out 274.out 251.out 267.out 043.out 069.out 065.out 209.out 207.out 151.out 195.out 106.out 215.out 115.out 015.out 227.out 250.out 191.out 046.out 051.out 101.out 219.out 119.out 244.out 232.out 143.out 188.out 220.out 120.out 020.out 102.out 171.out 261.out 156.out 217.out 072.out 048.out 062.out 038.out 073.out 129.out 066.out 029.out 229.out 003.out 111.out 011.out 234.out 275.out 134.out 170.out 260.out 034.out 133.out 286.out 161.out 175.out 216.out 116.out 016.out 118.out 110.out 010.out 238.out 281.out 276.out 295.out 138.out 014.out 277.out 145.out 160.out 137.out 091.out 081.out 071.out 061.out 239.out 085.out 265.out 300.out 200.out 100.out 258.out 269.out 208.out 039.out 222.out 169.out 098.out 090.out 080.out 070.out 060.out 206.out 109.out 006.out 167.out 117.out 017.out 246.out 158.out 182.out 204.out 104.out 177.out 254.out 279.out 241.out 235.out 268.out 224.out 025.out 124.out 142.out 172.out 278.out 058.out 262.out 042.out 253.out 297.out 193.out 097.out 271.out 283.out 083.out 135.out 045.out 086.out 053.out 157.out 164.out 257.out 094.out 189.out 139.out 089.out 178.out 001.out 165.out 141.out 214.out 074.out 176.out 012.out 041.out 155.out 064.out 186.out 240.out 252.out 280.out 005.out 223.out 150.out 132.out 179.out 144.out 032.out 057.out 205.out 136.out 146.out 174.out 096.out 198.out 108.out 190.out 173.out 050.out 105.out 263.out 027.out 291.out 187.out 084.out 266.out 153.out 285.out 183.out 123.out 044.out 201.out 019.out 287.out 237.out 067.out 231.out 075.out 163.out 131.out 213.out 113.out 031.out 272.out 078.out 184.out 259.out 293.out 197.out 127.out 230.out 076.out 292.out 130.out 023.out 099.out 092.out 030.out 203.out 063.out 194.out 159.out 249.out 122.out 166.out 022.out 289.out 284.out 255.out 290.out 299.out 154.out 149.out 068.out 185.out 264.out 218.out 018.out 168.out 007.out 093.out 079.out 054.out 059.out 049.out 226.out 126.out 121.out 026.out 180.out 013.out 035.out 221.out 087.out 294.out 212.out 112.out 245.out 021.out 247.out 211.out 107.out 248.out 162.out 147.out 288.out 196.out 242.out /var/lib/xfstests/tests/btrfs 2023-10-06T01:24:44.903 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.aaWjY8JXYCxfstests-dev/tests/ceph/ install 2023-10-06T01:24:44.905 INFO:teuthology.orchestra.run.smithi050.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/ceph 2023-10-06T01:24:44.929 INFO:teuthology.orchestra.run.smithi050.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 /var/lib/xfstests/tests/ceph 2023-10-06T01:24:44.984 INFO:teuthology.orchestra.run.smithi050.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/ceph 2023-10-06T01:24:45.008 INFO:teuthology.orchestra.run.smithi050.stdout:../../install-sh -o root -g root -m 644 005.out 003.out 001.out 004.out 002.out /var/lib/xfstests/tests/ceph 2023-10-06T01:24:45.063 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.aaWjY8JXYCxfstests-dev/tests/cifs/ install 2023-10-06T01:24:45.066 INFO:teuthology.orchestra.run.smithi050.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/cifs 2023-10-06T01:24:45.090 INFO:teuthology.orchestra.run.smithi050.stdout:../../install-sh -o root -g root -m 755 001 /var/lib/xfstests/tests/cifs 2023-10-06T01:24:45.113 INFO:teuthology.orchestra.run.smithi050.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/cifs 2023-10-06T01:24:45.138 INFO:teuthology.orchestra.run.smithi050.stdout:../../install-sh -o root -g root -m 644 001.out /var/lib/xfstests/tests/cifs 2023-10-06T01:24:45.162 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.aaWjY8JXYCxfstests-dev/tests/ext4/ install 2023-10-06T01:24:45.165 INFO:teuthology.orchestra.run.smithi050.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/ext4 2023-10-06T01:24:45.189 INFO:teuthology.orchestra.run.smithi050.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 007 008 009 010 011 012 013 014 015 016 017 018 019 020 021 022 023 024 025 026 027 028 029 030 031 032 033 034 035 036 037 038 039 040 041 042 043 044 045 046 047 048 049 050 051 052 053 054 055 056 057 058 059 271 301 302 303 304 305 306 307 308 /var/lib/xfstests/tests/ext4 2023-10-06T01:24:45.742 INFO:teuthology.orchestra.run.smithi050.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/ext4 2023-10-06T01:24:45.766 INFO:teuthology.orchestra.run.smithi050.stdout:../../install-sh -o root -g root -m 644 001.out.nodelalloc 001.out.default 001.out.nozero 001.cfg 049.out 032.out 039.out 305.out 005.out 008.out 023.out 056.out 308.out 050.out 040.out 307.out 006.out 035.out 021.out 017.out 012.out 009.out 033.out 301.out 019.out 026.out 047.out 303.out 302.out 020.out 002.out 044.out 013.out 031.out 025.out 304.out 003.out 048.out 038.out 052.out 042.out 037.out 029.out 011.out 028.out 055.out 030.out 058.out 034.out 015.out 043.out 053.out 036.out 016.out 027.out 010.out 306.out 022.out 014.out 004.out 057.out 045.out 046.out 271.out 051.out 041.out 024.out 018.out 007.out 054.out 059.out /var/lib/xfstests/tests/ext4 2023-10-06T01:24:46.347 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.aaWjY8JXYCxfstests-dev/tests/f2fs/ install 2023-10-06T01:24:46.349 INFO:teuthology.orchestra.run.smithi050.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/f2fs 2023-10-06T01:24:46.373 INFO:teuthology.orchestra.run.smithi050.stdout:../../install-sh -o root -g root -m 755 001 002 /var/lib/xfstests/tests/f2fs 2023-10-06T01:24:46.404 INFO:teuthology.orchestra.run.smithi050.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/f2fs 2023-10-06T01:24:46.428 INFO:teuthology.orchestra.run.smithi050.stdout:../../install-sh -o root -g root -m 644 001.out 002.out /var/lib/xfstests/tests/f2fs 2023-10-06T01:24:46.460 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.aaWjY8JXYCxfstests-dev/tests/generic/ install 2023-10-06T01:24:46.466 INFO:teuthology.orchestra.run.smithi050.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/generic 2023-10-06T01:24:46.490 INFO:teuthology.orchestra.run.smithi050.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 007 008 009 010 011 012 013 014 015 016 017 018 019 020 021 022 023 024 025 026 027 028 029 030 031 032 033 034 035 036 037 038 039 040 041 042 043 044 045 046 047 048 049 050 051 052 053 054 055 056 057 058 059 060 061 062 063 064 065 066 067 068 069 070 071 072 073 074 075 076 077 078 079 080 081 082 083 084 085 086 087 088 089 090 091 092 093 094 095 096 097 098 099 100 101 102 103 104 105 106 107 108 109 110 111 112 113 114 115 116 117 118 119 120 121 122 123 124 125 126 127 128 129 130 131 132 133 134 135 136 137 138 139 140 141 142 143 144 145 146 147 148 149 150 151 152 153 154 155 156 157 158 159 160 161 162 163 164 165 166 167 168 169 170 171 172 173 174 175 176 177 178 179 180 181 182 183 184 185 186 187 188 189 190 191 192 193 194 195 196 197 198 199 200 201 202 203 204 205 206 207 208 209 210 211 212 213 214 215 216 217 218 219 220 221 222 223 224 225 226 227 228 229 230 231 232 233 234 235 236 237 238 239 240 241 242 243 244 245 246 247 248 249 250 251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300 301 302 303 304 305 306 307 308 309 310 311 312 313 314 315 316 317 318 319 320 321 322 323 324 325 326 327 328 329 330 331 332 333 334 335 336 337 338 339 340 341 342 343 344 345 346 347 348 349 350 351 352 353 354 355 356 357 358 359 360 361 362 363 364 365 366 367 368 369 370 371 372 373 374 375 376 377 378 379 380 381 382 383 384 385 386 387 388 389 390 391 392 393 394 395 396 397 398 399 400 401 402 403 404 405 406 407 408 409 410 411 412 413 414 415 416 417 418 419 420 421 422 423 424 425 426 427 428 429 430 431 432 433 434 435 436 437 438 439 440 441 442 443 444 445 446 447 448 449 450 451 452 453 454 455 456 457 458 459 460 461 462 463 464 465 466 467 468 469 470 472 473 474 475 476 477 478 479 480 481 482 483 484 485 486 487 488 489 490 491 492 493 494 495 496 497 498 499 500 501 502 503 504 505 506 507 508 509 510 511 512 513 514 515 516 517 518 519 520 521 522 523 524 525 526 527 528 529 530 531 532 533 534 535 536 537 538 539 540 541 542 543 544 545 546 547 548 549 550 551 552 553 554 555 556 557 558 559 560 561 562 563 564 565 566 567 568 569 570 571 572 573 574 575 576 577 578 579 580 581 582 583 584 585 586 587 588 589 590 591 592 593 594 595 596 597 598 599 600 601 602 603 604 605 606 607 608 609 610 611 612 613 614 615 616 617 618 619 620 621 622 623 624 625 626 627 628 629 630 631 632 633 634 635 636 637 638 639 640 641 642 643 644 645 646 647 648 649 650 651 652 653 654 655 656 657 658 659 660 661 662 663 664 665 666 667 668 669 670 671 672 673 674 675 676 677 678 679 680 681 682 683 684 685 686 687 688 689 690 691 692 693 694 695 696 697 698 699 700 701 702 703 704 705 706 707 708 709 710 711 712 713 714 715 716 717 718 719 720 721 722 723 724 725 726 727 728 729 730 731 /var/lib/xfstests/tests/generic 2023-10-06T01:24:52.314 INFO:teuthology.orchestra.run.smithi050.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/generic 2023-10-06T01:24:52.337 INFO:teuthology.orchestra.run.smithi050.stdout:../../install-sh -o root -g root -m 644 050.out.xfsquota 035.out.nfs 035.out.default 050.out.nojournal 050.out.default 035.cfg 050.cfg 377.out 537.out 234.out 295.out 033.out 385.out 248.out 696.out 149.out 502.out 088.out 366.out 202.out 137.out 102.out 343.out 110.out 468.out 181.out 571.out 531.out 567.out 192.out 726.out 282.out 472.out 628.out 284.out 528.out 607.out 428.out 659.out 128.out 183.out 389.out 271.out 620.out 273.out 265.out 420.out 087.out 089.out 406.out 195.out 346.out 007.out 466.out 632.out 532.out 591.out 064.out 719.out 111.out 723.out 255.out 011.out 623.out 371.out 319.out 467.out 523.out 119.out 423.out 323.out 155.out 134.out 686.out 638.out 174.out 716.out 161.out 516.out 538.out 316.out 216.out 438.out 041.out 358.out 338.out 287.out 238.out 138.out 474.out 097.out 160.out 647.out 691.out 061.out 258.out 588.out 379.out 039.out 046.out 310.out 098.out 426.out 690.out 573.out 706.out 060.out 506.out 306.out 206.out 106.out 006.out 167.out 217.out 191.out 133.out 117.out 411.out 017.out 542.out 211.out 158.out 177.out 724.out 279.out 524.out 424.out 156.out 324.out 082.out 224.out 313.out 124.out 024.out 278.out 058.out 384.out 447.out 042.out 497.out 487.out 047.out 193.out 526.out 399.out 473.out 135.out 709.out 609.out 365.out 509.out 409.out 309.out 209.out 441.out 157.out 356.out 257.out 341.out 678.out 094.out 337.out 241.out 077.out 714.out 616.out 614.out 514.out 414.out 314.out 440.out 114.out 014.out 342.out 671.out 116.out 667.out 340.out 649.out 572.out 568.out 586.out 240.out 549.out 267.out 633.out 434.out 140.out 708.out 533.out 185.out 508.out 408.out 308.out 433.out 670.out 404.out 104.out 004.out 416.out 141.out 176.out 118.out 640.out 483.out 565.out 297.out 393.out 560.out 333.out 599.out 683.out 199.out 227.out 233.out 245.out 639.out 443.out 540.out 086.out 539.out 711.out 164.out 636.out 339.out 652.out 694.out 617.out 498.out 489.out 139.out 178.out 390.out 552.out 695.out 576.out 357.out 677.out 415.out 175.out 593.out 067.out 452.out 679.out 548.out 015.out 606.out 376.out 352.out 663.out 002.out 394.out 651.out 495.out 188.out 482.out 625.out 283.out 252.out 488.out 148.out 673.out 040.out 325.out 551.out 225.out 096.out 125.out 186.out 222.out 693.out 650.out 152.out 630.out 563.out 674.out 451.out 436.out 392.out 075.out 595.out 578.out 530.out 550.out 052.out 062.out 351.out 276.out 475.out 450.out 517.out 463.out 330.out 069.out 644.out 688.out 350.out 544.out 715.out 395.out 515.out 315.out 344.out 215.out 115.out 597.out 205.out 250.out 681.out 594.out 536.out 577.out 244.out 637.out 336.out 579.out 236.out 405.out 182.out 136.out 598.out 144.out 036.out 198.out 108.out 008.out 680.out 705.out 605.out 505.out 305.out 105.out 005.out 367.out 291.out 437.out 266.out 619.out 189.out 685.out 363.out 562.out 382.out 570.out 388.out 527.out 044.out 689.out 432.out 237.out 190.out 163.out 556.out 413.out 332.out 661.out 664.out 320.out 521.out 582.out 372.out 478.out 612.out 584.out 462.out 173.out 037.out 251.out 492.out 051.out 099.out 660.out 063.out 561.out 668.out 465.out 648.out 362.out 387.out 194.out 721.out 289.out 574.out 477.out 123.out 370.out 519.out 290.out 299.out 581.out 076.out 461.out 646.out 107.out 263.out 658.out 626.out 592.out 380.out 093.out 479.out 547.out 221.out 326.out 480.out 226.out 454.out 126.out 121.out 555.out 499.out 580.out 021.out 485.out 347.out 675.out 702.out 361.out 564.out 294.out 066.out 247.out 585.out 162.out 083.out 147.out 288.out 197.out 396.out 446.out 354.out 355.out 575.out 360.out 431.out 543.out 270.out 261.out 045.out 692.out 634.out 272.out 729.out 378.out 458.out 534.out 151.out 429.out 662.out 503.out 329.out 587.out 303.out 129.out 131.out 368.out 486.out 223.out 132.out 669.out 023.out 459.out 032.out 277.out 146.out 398.out 728.out 296.out 590.out 280.out 484.out 491.out 455.out 016.out 656.out 731.out 374.out 583.out 285.out 631.out 328.out 260.out 501.out 171.out 027.out 101.out 687.out 722.out 331.out 504.out 179.out 231.out 613.out 513.out 213.out 730.out 095.out 013.out 031.out 364.out 645.out 596.out 727.out 078.out 510.out 627.out 184.out 430.out 569.out 427.out 259.out 210.out 449.out 327.out 397.out 643.out 493.out 419.out 127.out 699.out 071.out 445.out 292.out 130.out 219.out 073.out 703.out 603.out 403.out 030.out 203.out 103.out 003.out 025.out 386.out 349.out 055.out 456.out 469.out 622.out 122.out 026.out 522.out 422.out 624.out 322.out 254.out 159.out 249.out 381.out 448.out 166.out 022.out 642.out 684.out 490.out 654.out 435.out 439.out 353.out 375.out 600.out 154.out 566.out 500.out 618.out 518.out 418.out 318.out 264.out 218.out 018.out 232.out 172.out 168.out 034.out 293.out 079.out 054.out 059.out 049.out 348.out 239.out 442.out 228.out 657.out 621.out 476.out 180.out 421.out 712.out 321.out 057.out 512.out 494.out 412.out 312.out 212.out 112.out 256.out 012.out 028.out 682.out 554.out 070.out 373.out 720.out 481.out 243.out 196.out 520.out 242.out 457.out 655.out 120.out 019.out 220.out 629.out 602.out 153.out 402.out 302.out 020.out 529.out 717.out 460.out 417.out 317.out 142.out 092.out 672.out 072.out 068.out 143.out 229.out 038.out 084.out 369.out 262.out 611.out 511.out 029.out 311.out 676.out 187.out 170.out 053.out 065.out 286.out 713.out 043.out 496.out 056.out 545.out 559.out 710.out 610.out 274.out 410.out 701.out 601.out 401.out 301.out 201.out 010.out 001.out 214.out 281.out 048.out 665.out 589.out 113.out 074.out 697.out 145.out 641.out 464.out 091.out 081.out 653.out 700.out 400.out 300.out 200.out 100.out 359.out 541.out 269.out 546.out 698.out 553.out 298.out 169.out 090.out 080.out 707.out 608.out 507.out 407.out 307.out 208.out 109.out 009.out 391.out 230.out 150.out 557.out 453.out 666.out 246.out 725.out 383.out 085.out 704.out 604.out 635.out 334.out 525.out 558.out 304.out 204.out 535.out 425.out 345.out 335.out 207.out 718.out 444.out 235.out 470.out 268.out 253.out 165.out 275.out 615.out /var/lib/xfstests/tests/generic 2023-10-06T01:24:58.206 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.aaWjY8JXYCxfstests-dev/tests/nfs/ install 2023-10-06T01:24:58.208 INFO:teuthology.orchestra.run.smithi050.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/nfs 2023-10-06T01:24:58.232 INFO:teuthology.orchestra.run.smithi050.stdout:../../install-sh -o root -g root -m 755 001 /var/lib/xfstests/tests/nfs 2023-10-06T01:24:58.257 INFO:teuthology.orchestra.run.smithi050.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/nfs 2023-10-06T01:24:58.280 INFO:teuthology.orchestra.run.smithi050.stdout:../../install-sh -o root -g root -m 644 001.out /var/lib/xfstests/tests/nfs 2023-10-06T01:24:58.305 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.aaWjY8JXYCxfstests-dev/tests/ocfs2/ install 2023-10-06T01:24:58.307 INFO:teuthology.orchestra.run.smithi050.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/ocfs2 2023-10-06T01:24:58.331 INFO:teuthology.orchestra.run.smithi050.stdout:../../install-sh -o root -g root -m 755 001 /var/lib/xfstests/tests/ocfs2 2023-10-06T01:24:58.354 INFO:teuthology.orchestra.run.smithi050.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/ocfs2 2023-10-06T01:24:58.378 INFO:teuthology.orchestra.run.smithi050.stdout:../../install-sh -o root -g root -m 644 001.out /var/lib/xfstests/tests/ocfs2 2023-10-06T01:24:58.402 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.aaWjY8JXYCxfstests-dev/tests/overlay/ install 2023-10-06T01:24:58.406 INFO:teuthology.orchestra.run.smithi050.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/overlay 2023-10-06T01:24:58.429 INFO:teuthology.orchestra.run.smithi050.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 007 008 009 010 011 012 013 014 015 016 017 018 019 020 021 022 023 024 025 026 027 028 029 030 031 032 033 034 035 036 037 038 039 040 041 042 043 044 045 046 047 048 049 050 051 052 053 054 055 056 057 058 059 060 061 062 063 064 065 066 067 068 069 070 071 072 073 074 075 076 077 078 079 080 100 101 102 103 104 105 106 107 108 109 110 111 112 113 114 115 116 117 /var/lib/xfstests/tests/overlay 2023-10-06T01:24:59.222 INFO:teuthology.orchestra.run.smithi050.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/overlay 2023-10-06T01:24:59.245 INFO:teuthology.orchestra.run.smithi050.stdout:../../install-sh -o root -g root -m 644 048.out 018.out 020.out 102.out 028.out 024.out 013.out 031.out 015.out 117.out 072.out 078.out 004.out 062.out 038.out 052.out 042.out 076.out 066.out 010.out 003.out 029.out 055.out 023.out 073.out 068.out 053.out 030.out 103.out 063.out 017.out 043.out 077.out 109.out 075.out 116.out 016.out 065.out 041.out 107.out 101.out 022.out 113.out 106.out 014.out 115.out 057.out 035.out 027.out 001.out 114.out 074.out 036.out 111.out 061.out 011.out 026.out 071.out 037.out 058.out 108.out 100.out 064.out 080.out 005.out 079.out 069.out 054.out 059.out 049.out 032.out 039.out 045.out 002.out 025.out 056.out 008.out 110.out 060.out 050.out 105.out 006.out 047.out 021.out 067.out 112.out 046.out 012.out 009.out 007.out 033.out 070.out 040.out 044.out 051.out 019.out 034.out 104.out /var/lib/xfstests/tests/overlay 2023-10-06T01:25:00.039 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.aaWjY8JXYCxfstests-dev/tests/perf/ install 2023-10-06T01:25:00.041 INFO:teuthology.orchestra.run.smithi050.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/perf 2023-10-06T01:25:00.065 INFO:teuthology.orchestra.run.smithi050.stdout:../../install-sh -o root -g root -m 755 001 /var/lib/xfstests/tests/perf 2023-10-06T01:25:00.089 INFO:teuthology.orchestra.run.smithi050.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/perf 2023-10-06T01:25:00.113 INFO:teuthology.orchestra.run.smithi050.stdout:../../install-sh -o root -g root -m 644 001.out /var/lib/xfstests/tests/perf 2023-10-06T01:25:00.137 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.aaWjY8JXYCxfstests-dev/tests/selftest/ install 2023-10-06T01:25:00.140 INFO:teuthology.orchestra.run.smithi050.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/selftest 2023-10-06T01:25:00.164 INFO:teuthology.orchestra.run.smithi050.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 /var/lib/xfstests/tests/selftest 2023-10-06T01:25:00.226 INFO:teuthology.orchestra.run.smithi050.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/selftest 2023-10-06T01:25:00.250 INFO:teuthology.orchestra.run.smithi050.stdout:../../install-sh -o root -g root -m 644 005.out 003.out 006.out 001.out 004.out 002.out /var/lib/xfstests/tests/selftest 2023-10-06T01:25:00.315 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.aaWjY8JXYCxfstests-dev/tests/shared/ install 2023-10-06T01:25:00.317 INFO:teuthology.orchestra.run.smithi050.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/shared 2023-10-06T01:25:00.340 INFO:teuthology.orchestra.run.smithi050.stdout:../../install-sh -o root -g root -m 755 002 032 298 /var/lib/xfstests/tests/shared 2023-10-06T01:25:00.380 INFO:teuthology.orchestra.run.smithi050.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/shared 2023-10-06T01:25:00.404 INFO:teuthology.orchestra.run.smithi050.stdout:../../install-sh -o root -g root -m 644 032.out 298.out 002.out /var/lib/xfstests/tests/shared 2023-10-06T01:25:00.443 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.aaWjY8JXYCxfstests-dev/tests/tmpfs/ install 2023-10-06T01:25:00.446 INFO:teuthology.orchestra.run.smithi050.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/tmpfs 2023-10-06T01:25:00.470 INFO:teuthology.orchestra.run.smithi050.stdout:../../install-sh -o root -g root -m 755 001 /var/lib/xfstests/tests/tmpfs 2023-10-06T01:25:00.494 INFO:teuthology.orchestra.run.smithi050.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/tmpfs 2023-10-06T01:25:00.517 INFO:teuthology.orchestra.run.smithi050.stdout:../../install-sh -o root -g root -m 644 001.out /var/lib/xfstests/tests/tmpfs 2023-10-06T01:25:00.541 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.aaWjY8JXYCxfstests-dev/tests/udf/ install 2023-10-06T01:25:00.544 INFO:teuthology.orchestra.run.smithi050.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/udf 2023-10-06T01:25:00.567 INFO:teuthology.orchestra.run.smithi050.stdout:../../install-sh -o root -g root -m 755 102 /var/lib/xfstests/tests/udf 2023-10-06T01:25:00.591 INFO:teuthology.orchestra.run.smithi050.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/udf 2023-10-06T01:25:00.615 INFO:teuthology.orchestra.run.smithi050.stdout:../../install-sh -o root -g root -m 644 102.out /var/lib/xfstests/tests/udf 2023-10-06T01:25:00.639 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.aaWjY8JXYCxfstests-dev/tests/xfs/ install 2023-10-06T01:25:00.645 INFO:teuthology.orchestra.run.smithi050.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/xfs 2023-10-06T01:25:00.669 INFO:teuthology.orchestra.run.smithi050.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 007 008 009 010 011 012 013 014 015 016 017 018 019 020 021 022 023 024 025 026 027 028 029 030 031 032 033 034 035 036 037 038 039 040 041 042 043 044 045 046 047 048 049 050 051 052 053 054 055 056 057 058 059 060 061 062 063 064 065 066 067 068 069 070 071 072 073 074 075 076 077 078 079 080 081 082 083 084 085 086 087 088 089 090 091 092 093 094 095 096 097 098 099 100 101 102 103 104 105 106 107 108 109 110 111 112 113 114 115 116 117 118 119 120 121 122 123 124 125 126 127 128 129 130 131 132 133 134 135 136 137 138 139 140 141 142 143 144 145 146 147 148 149 150 151 152 153 154 155 156 157 158 159 160 161 162 163 164 165 166 167 168 169 170 171 172 173 174 175 176 177 178 179 180 181 182 183 184 185 186 187 188 189 190 191 192 193 194 195 196 197 198 199 200 201 202 203 204 205 206 207 208 209 210 211 212 213 214 215 216 217 218 219 220 221 222 223 224 225 226 227 228 229 230 231 232 233 234 235 236 237 238 239 240 241 242 243 244 245 246 247 248 249 250 251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300 301 302 303 304 305 306 307 308 309 310 311 312 313 314 315 316 317 318 319 320 321 322 323 324 325 326 327 328 329 330 331 332 333 334 335 336 337 338 339 340 341 342 343 344 345 346 347 348 349 350 351 352 353 354 355 356 357 358 359 360 361 362 363 364 365 366 367 368 369 370 371 372 373 374 375 376 377 378 379 380 381 382 383 384 385 386 387 388 389 390 391 392 393 394 395 396 397 398 399 400 401 402 403 404 405 406 407 408 409 410 411 412 413 414 415 416 417 418 419 420 421 422 423 424 425 426 427 428 429 430 431 432 433 434 435 436 437 438 439 440 441 442 443 444 445 446 447 448 449 450 451 452 453 454 455 456 457 458 459 460 461 462 463 464 465 466 467 468 469 470 471 472 473 474 475 476 477 478 479 480 481 482 483 484 485 486 487 488 489 490 491 492 493 494 495 496 497 498 499 500 501 502 503 504 505 506 507 508 509 510 511 512 513 514 515 516 517 518 519 520 521 522 523 524 525 526 527 528 529 530 531 532 533 534 535 536 537 538 539 540 541 542 543 544 545 546 547 548 549 550 551 552 553 554 555 556 557 558 559 560 561 562 563 564 565 566 567 568 569 570 571 572 573 574 575 576 577 578 579 580 581 582 583 584 585 586 587 588 589 590 591 592 593 594 595 596 597 598 599 600 708 709 710 711 712 713 714 715 716 717 718 719 720 721 722 723 724 725 726 727 728 729 730 731 732 733 734 735 736 737 738 739 740 741 742 743 744 745 746 747 748 749 750 751 752 753 754 755 756 757 758 759 760 761 762 763 764 765 766 767 768 769 770 771 772 773 774 775 776 777 778 779 780 781 782 783 784 785 786 787 788 789 790 791 792 793 794 795 796 797 798 799 800 /var/lib/xfstests/tests/xfs 2023-10-06T01:25:04.756 DEBUG:teuthology.orchestra.run.smithi050:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T01:25:04.761 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T01:25:06.192 INFO:teuthology.orchestra.run.smithi050.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/xfs 2023-10-06T01:25:06.216 INFO:teuthology.orchestra.run.smithi050.stdout:../../install-sh -o root -g root -m 644 096.out.internal 033.out.crc 096.out.external 033.out.default 071.out.64 216.out.classic 216.out.64mblog 071.out.32 216.cfg 033.cfg 185.out 508.out 408.out 308.out 566.out 433.out 108.out 040.out 104.out 047.out 287.out 537.out 234.out 158.out 337.out 082.out 248.out 759.out 088.out 097.out 296.out 137.out 102.out 343.out 110.out 468.out 525.out 181.out 571.out 775.out 531.out 765.out 192.out 282.out 342.out 472.out 528.out 428.out 507.out 128.out 183.out 273.out 420.out 087.out 089.out 406.out 195.out 732.out 466.out 443.out 227.out 532.out 591.out 471.out 111.out 723.out 255.out 011.out 319.out 467.out 523.out 119.out 423.out 323.out 429.out 329.out 587.out 229.out 129.out 131.out 155.out 134.out 260.out 076.out 034.out 445.out 716.out 161.out 246.out 538.out 316.out 418.out 116.out 438.out 358.out 338.out 238.out 295.out 138.out 474.out 160.out 373.out 061.out 085.out 457.out 522.out 772.out 768.out 530.out 258.out 379.out 322.out 039.out 742.out 098.out 426.out 290.out 573.out 060.out 506.out 306.out 206.out 106.out 006.out 447.out 217.out 191.out 117.out 455.out 542.out 442.out 188.out 065.out 177.out 724.out 279.out 281.out 524.out 424.out 413.out 771.out 324.out 224.out 313.out 355.out 124.out 232.out 024.out 278.out 058.out 741.out 113.out 042.out 497.out 487.out 377.out 193.out 799.out 456.out 526.out 399.out 473.out 770.out 045.out 409.out 364.out 391.out 441.out 157.out 740.out 356.out 341.out 494.out 189.out 241.out 540.out 077.out 714.out 514.out 243.out 414.out 314.out 440.out 114.out 014.out 766.out 041.out 277.out 340.out 793.out 156.out 572.out 568.out 586.out 240.out 733.out 092.out 267.out 543.out 140.out 708.out 533.out 335.out 207.out 718.out 235.out 268.out 556.out 253.out 403.out 165.out 303.out 782.out 431.out 784.out 141.out 176.out 169.out 118.out 444.out 483.out 018.out 393.out 333.out 599.out 367.out 199.out 739.out 068.out 233.out 752.out 736.out 015.out 007.out 773.out 086.out 539.out 133.out 711.out 164.out 339.out 239.out 521.out 458.out 489.out 139.out 411.out 484.out 465.out 552.out 763.out 576.out 357.out 515.out 593.out 067.out 186.out 452.out 069.out 548.out 252.out 751.out 563.out 167.out 190.out 352.out 348.out 346.out 394.out 309.out 495.out 785.out 174.out 283.out 750.out 488.out 148.out 325.out 551.out 225.out 125.out 789.out 222.out 152.out 774.out 436.out 392.out 075.out 748.out 578.out 550.out 052.out 062.out 351.out 463.out 430.out 276.out 094.out 475.out 450.out 517.out 744.out 330.out 036.out 762.out 350.out 544.out 728.out 715.out 395.out 151.out 415.out 389.out 315.out 384.out 215.out 115.out 197.out 250.out 791.out 344.out 051.out 536.out 244.out 336.out 150.out 579.out 236.out 505.out 136.out 598.out 144.out 496.out 198.out 008.out 790.out 178.out 050.out 405.out 305.out 205.out 105.out 005.out 027.out 291.out 761.out 437.out 719.out 211.out 727.out 519.out 363.out 562.out 419.out 271.out 570.out 388.out 527.out 056.out 299.out 432.out 237.out 779.out 760.out 163.out 044.out 332.out 796.out 582.out 372.out 478.out 584.out 462.out 220.out 173.out 597.out 037.out 251.out 112.out 020.out 063.out 792.out 561.out 776.out 781.out 746.out 758.out 362.out 387.out 194.out 265.out 588.out 289.out 574.out 516.out 284.out 123.out 560.out 595.out 461.out 477.out 451.out 390.out 786.out 263.out 448.out 592.out 380.out 093.out 479.out 547.out 221.out 326.out 480.out 226.out 454.out 126.out 121.out 555.out 499.out 580.out 460.out 013.out 756.out 485.out 347.out 035.out 361.out 564.out 294.out 066.out 504.out 247.out 747.out 585.out 162.out 083.out 147.out 288.out 396.out 446.out 298.out 575.out 209.out 381.out 360.out 374.out 270.out 261.out 755.out 292.out 304.out 482.out 726.out 729.out 378.out 048.out 534.out 368.out 486.out 223.out 132.out 179.out 023.out 459.out 032.out 798.out 266.out 146.out 107.out 398.out 366.out 590.out 280.out 470.out 767.out 749.out 016.out 091.out 046.out 153.out 731.out 583.out 285.out 788.out 501.out 171.out 581.out 376.out 101.out 385.out 722.out 331.out 743.out 231.out 469.out 513.out 371.out 549.out 213.out 730.out 095.out 031.out 565.out 182.out 596.out 272.out 078.out 754.out 184.out 797.out 569.out 427.out 259.out 210.out 449.out 327.out 397.out 777.out 493.out 010.out 127.out 230.out 769.out 130.out 219.out 073.out 370.out 503.out 030.out 203.out 103.out 003.out 386.out 349.out 055.out 275.out 245.out 026.out 787.out 745.out 422.out 794.out 159.out 249.out 122.out 166.out 022.out 490.out 435.out 439.out 353.out 375.out 154.out 500.out 149.out 518.out 318.out 264.out 218.out 757.out 172.out 168.out 293.out 328.out 079.out 054.out 059.out 202.out 049.out 021.out 738.out 228.out 721.out 476.out 180.out 421.out 712.out 321.out 057.out 512.out 412.out 312.out 212.out 256.out 012.out 764.out 028.out 554.out 365.out 070.out 416.out 720.out 481.out 196.out 520.out 242.out 498.out 320.out 019.out 425.out 120.out 502.out 402.out 302.out 529.out 002.out 717.out 135.out 417.out 317.out 142.out 492.out 017.out 072.out 778.out 143.out 038.out 737.out 084.out 369.out 262.out 594.out 511.out 025.out 029.out 311.out 783.out 187.out 170.out 053.out 286.out 713.out 043.out 175.out 545.out 559.out 710.out 510.out 274.out 410.out 310.out 401.out 301.out 201.out 001.out 734.out 214.out 589.out 753.out 074.out 297.out 145.out 257.out 464.out 491.out 081.out 800.out 600.out 064.out 400.out 300.out 200.out 100.out 359.out 577.out 354.out 541.out 269.out 546.out 382.out 780.out 099.out 553.out 567.out 090.out 080.out 709.out 509.out 407.out 307.out 208.out 109.out 009.out 434.out 557.out 453.out 725.out 735.out 383.out 334.out 404.out 558.out 204.out 535.out 795.out 004.out 345.out 254.out /var/lib/xfstests/tests/xfs 2023-10-06T01:25:11.817 INFO:teuthology.orchestra.run.smithi050.stdout:../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests 2023-10-06T01:25:11.841 INFO:teuthology.orchestra.run.smithi050.stdout:./install-sh -o root -g root -m 755 -d /var/lib/xfstests 2023-10-06T01:25:11.865 INFO:teuthology.orchestra.run.smithi050.stdout:./install-sh -o root -g root -m 755 check /var/lib/xfstests 2023-10-06T01:25:11.889 INFO:teuthology.orchestra.run.smithi050.stdout:./install-sh -o root -g root -m 644 randomize.awk /var/lib/xfstests 2023-10-06T01:25:11.917 INFO:tasks.cephfs.test_acls:client is kernel mounted 2023-10-06T01:25:11.917 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-10-06T01:25:11.917 DEBUG:teuthology.orchestra.run.smithi050:running tests for ACLs from xfstests-dev> (cd /tmp/tmp.aaWjY8JXYCxfstests-dev && exec sudo ./check generic/099) 2023-10-06T01:25:12.400 INFO:teuthology.orchestra.run.smithi050.stdout:FSTYP -- ceph 2023-10-06T01:25:12.412 INFO:teuthology.orchestra.run.smithi050.stdout:PLATFORM -- Linux/x86_64 smithi050 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-10-06T01:25:12.412 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-10-06T01:25:13.639 INFO:teuthology.orchestra.run.smithi050.stdout:generic/099 1s 2023-10-06T01:25:13.652 INFO:teuthology.orchestra.run.smithi050.stdout:Ran: generic/099 2023-10-06T01:25:13.652 INFO:teuthology.orchestra.run.smithi050.stdout:Passed all 1 tests 2023-10-06T01:25:13.658 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-10-06T01:25:13.739 DEBUG:teuthology.orchestra.run.smithi050:> sudo userdel --force --remove fsgqa 2023-10-06T01:25:16.739 DEBUG:teuthology.orchestra.run.smithi050:> sudo userdel --force --remove 123456-fsgqa 2023-10-06T01:25:19.413 DEBUG:teuthology.orchestra.run.smithi050:> sudo groupdel fsgqa 2023-10-06T01:25:19.507 INFO:teuthology.orchestra.run.smithi050.stderr:groupdel: group 'fsgqa' does not exist 2023-10-06T01:25:19.510 DEBUG:teuthology.orchestra.run:got remote process result: 6 2023-10-06T01:25:19.510 DEBUG:teuthology.orchestra.run.smithi050:> sudo rm -rf /tmp/tmp.aaWjY8JXYCxfstests-dev 2023-10-06T01:25:19.776 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-10-06T01:25:19.776 DEBUG:teuthology.orchestra.run.smithi050:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-06T01:25:19.855 DEBUG:teuthology.orchestra.run.smithi155:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-06T01:25:19.946 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-10-06T01:25:19.946 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-10-06T01:25:19.946 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T01:25:19.947 DEBUG:teuthology.orchestra.run.smithi050:> sudo umount /home/ubuntu/cephtest/mnt.0 2023-10-06T01:25:20.029 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi050.front.sepia.ceph.com 2023-10-06T01:25:20.030 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T01:25:20.030 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-10-06T01:25:20.068 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T01:25:20.296 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:20.295+0000 7f5967fff700 1 Processor -- start 2023-10-06T01:25:20.296 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:20.295+0000 7f5967fff700 1 -- start start 2023-10-06T01:25:20.297 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:20.296+0000 7f5967fff700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f5968140b70 0x7f596806f190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:25:20.297 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:20.296+0000 7f5967fff700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f59680c19f0 con 0x7f59680aedc0 2023-10-06T01:25:20.297 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:20.296+0000 7f5967fff700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f59680c0de0 con 0x7f59680af230 2023-10-06T01:25:20.297 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:20.296+0000 7f5967fff700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f59680af690 con 0x7f5968140b70 2023-10-06T01:25:20.299 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:20.296+0000 7f59667fc700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f59680aedc0 0x7f59680c1e80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:43652/0 (socket says 172.21.15.50:43652) 2023-10-06T01:25:20.299 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:20.296+0000 7f59667fc700 1 -- 172.21.15.50:0/4203791599 learned_addr learned my addr 172.21.15.50:0/4203791599 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-10-06T01:25:20.299 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:20.296+0000 7f5966ffd700 1 --2- 172.21.15.50:0/4203791599 >> v2:172.21.15.155:3300/0 conn(0x7f5968140b70 0x7f596806f190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:25:20.299 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:20.297+0000 7f5965ffb700 1 -- 172.21.15.50:0/4203791599 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1470701057 0 0) 0x7f59680c19f0 con 0x7f59680aedc0 2023-10-06T01:25:20.299 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:20.297+0000 7f5965ffb700 1 -- 172.21.15.50:0/4203791599 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5950003570 con 0x7f59680aedc0 2023-10-06T01:25:20.299 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:20.297+0000 7f5965ffb700 1 -- 172.21.15.50:0/4203791599 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 174158901 0 0) 0x7f59680c0de0 con 0x7f59680af230 2023-10-06T01:25:20.299 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:20.297+0000 7f5965ffb700 1 -- 172.21.15.50:0/4203791599 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f59680c19f0 con 0x7f59680af230 2023-10-06T01:25:20.300 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:20.297+0000 7f5966ffd700 1 -- 172.21.15.50:0/4203791599 >> v1:172.21.15.155:6789/0 conn(0x7f59680af230 legacy=0x7f59680c77b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:25:20.300 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:20.297+0000 7f5966ffd700 1 -- 172.21.15.50:0/4203791599 >> v1:172.21.15.50:6789/0 conn(0x7f59680aedc0 legacy=0x7f59680c1e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:25:20.300 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:20.297+0000 7f5966ffd700 1 -- 172.21.15.50:0/4203791599 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59680c10c0 con 0x7f5968140b70 2023-10-06T01:25:20.300 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:20.297+0000 7f5966ffd700 1 --2- 172.21.15.50:0/4203791599 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5968140b70 0x7f596806f190 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f59580098e0 tx=0x7f59580091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f92ef3048df15e89 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:25:20.300 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:20.298+0000 7f5965ffb700 1 -- 172.21.15.50:0/4203791599 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5958011630 con 0x7f5968140b70 2023-10-06T01:25:20.300 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:20.298+0000 7f5965ffb700 1 -- 172.21.15.50:0/4203791599 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5958011790 con 0x7f5968140b70 2023-10-06T01:25:20.300 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:20.298+0000 7f5965ffb700 1 -- 172.21.15.50:0/4203791599 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5958011b30 con 0x7f5968140b70 2023-10-06T01:25:20.300 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:20.298+0000 7f5967fff700 1 -- 172.21.15.50:0/4203791599 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5968140b70 msgr2=0x7f596806f190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:25:20.300 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:20.298+0000 7f5967fff700 1 --2- 172.21.15.50:0/4203791599 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5968140b70 0x7f596806f190 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f59580098e0 tx=0x7f59580091a0 comp rx=0 tx=0).stop 2023-10-06T01:25:20.300 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:20.298+0000 7f5967fff700 1 -- 172.21.15.50:0/4203791599 shutdown_connections 2023-10-06T01:25:20.300 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:20.298+0000 7f5967fff700 1 --2- 172.21.15.50:0/4203791599 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5968140b70 0x7f596806f190 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:25:20.301 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:20.298+0000 7f5967fff700 1 -- 172.21.15.50:0/4203791599 >> 172.21.15.50:0/4203791599 conn(0x7f59680cbef0 msgr2=0x7f59680cc2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:25:20.301 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:20.298+0000 7f5967fff700 1 -- 172.21.15.50:0/4203791599 shutdown_connections 2023-10-06T01:25:20.301 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:20.298+0000 7f5967fff700 1 -- 172.21.15.50:0/4203791599 wait complete. 2023-10-06T01:25:20.303 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:20.300+0000 7f5967fff700 1 Processor -- start 2023-10-06T01:25:20.303 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:20.300+0000 7f5967fff700 1 -- start start 2023-10-06T01:25:20.303 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:20.301+0000 7f5967fff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f59680aedc0 0x7f596813c6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:25:20.303 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:20.301+0000 7f5967fff700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f59680af230 0x7f59680b1890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:25:20.303 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:20.301+0000 7f5967fff700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5968140b70 0x7f59680a58a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:25:20.303 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:20.301+0000 7f5967fff700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59680a6fc0 con 0x7f59680aedc0 2023-10-06T01:25:20.304 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:20.301+0000 7f5967fff700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f596813cc10 con 0x7f59680af230 2023-10-06T01:25:20.304 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:20.301+0000 7f5967fff700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f596816d270 con 0x7f5968140b70 2023-10-06T01:25:20.304 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:20.301+0000 7f5966ffd700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f59680aedc0 0x7f596813c6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:25:20.304 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:20.301+0000 7f5966ffd700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f59680aedc0 0x7f596813c6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:56812/0 (socket says 172.21.15.50:56812) 2023-10-06T01:25:20.304 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:20.301+0000 7f5966ffd700 1 -- 172.21.15.50:0/4003353855 learned_addr learned my addr 172.21.15.50:0/4003353855 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-06T01:25:20.304 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:20.301+0000 7f59667fc700 1 --2- 172.21.15.50:0/4003353855 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f59680af230 0x7f59680b1890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:25:20.304 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:20.301+0000 7f59677fe700 1 --2- 172.21.15.50:0/4003353855 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5968140b70 0x7f59680a58a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:25:20.304 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:20.301+0000 7f5966ffd700 1 -- 172.21.15.50:0/4003353855 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5968140b70 msgr2=0x7f59680a58a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:25:20.304 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:20.301+0000 7f5966ffd700 1 --2- 172.21.15.50:0/4003353855 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5968140b70 0x7f59680a58a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:25:20.304 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:20.301+0000 7f5966ffd700 1 -- 172.21.15.50:0/4003353855 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f59680af230 msgr2=0x7f59680b1890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:25:20.304 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:20.301+0000 7f5966ffd700 1 --2- 172.21.15.50:0/4003353855 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f59680af230 0x7f59680b1890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:25:20.304 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:20.301+0000 7f5966ffd700 1 -- 172.21.15.50:0/4003353855 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5958009420 con 0x7f59680aedc0 2023-10-06T01:25:20.305 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:20.302+0000 7f59667fc700 1 --2- 172.21.15.50:0/4003353855 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f59680af230 0x7f59680b1890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T01:25:20.305 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:20.302+0000 7f59677fe700 1 --2- 172.21.15.50:0/4003353855 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5968140b70 0x7f59680a58a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T01:25:20.305 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:20.302+0000 7f5966ffd700 1 --2- 172.21.15.50:0/4003353855 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f59680aedc0 0x7f596813c6d0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f5958009ed0 tx=0x7f5958017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:25:20.305 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:20.302+0000 7f594effd700 1 -- 172.21.15.50:0/4003353855 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f595801f070 con 0x7f59680aedc0 2023-10-06T01:25:20.305 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:20.302+0000 7f594effd700 1 -- 172.21.15.50:0/4003353855 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5958000c90 con 0x7f59680aedc0 2023-10-06T01:25:20.305 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:20.302+0000 7f5967fff700 1 -- 172.21.15.50:0/4003353855 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f59680a6a00 con 0x7f59680aedc0 2023-10-06T01:25:20.305 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:20.302+0000 7f594effd700 1 -- 172.21.15.50:0/4003353855 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5958025420 con 0x7f59680aedc0 2023-10-06T01:25:20.305 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:20.302+0000 7f5967fff700 1 -- 172.21.15.50:0/4003353855 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f596816cf00 con 0x7f59680aedc0 2023-10-06T01:25:20.306 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:20.303+0000 7f5967fff700 1 -- 172.21.15.50:0/4003353855 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f596805f270 con 0x7f59680aedc0 2023-10-06T01:25:20.306 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:20.304+0000 7f594effd700 1 -- 172.21.15.50:0/4003353855 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f5958023070 con 0x7f59680aedc0 2023-10-06T01:25:20.306 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:20.305+0000 7f594effd700 1 --2- 172.21.15.50:0/4003353855 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f5954066f30 0x7f59540693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:25:20.306 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:20.305+0000 7f594effd700 1 -- 172.21.15.50:0/4003353855 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6436+0+0 (secure 0 0 0) 0x7f5958085ce0 con 0x7f59680aedc0 2023-10-06T01:25:20.306 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:20.305+0000 7f59667fc700 1 --2- 172.21.15.50:0/4003353855 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f5954066f30 0x7f59540693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:25:20.307 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:20.306+0000 7f59667fc700 1 --2- 172.21.15.50:0/4003353855 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f5954066f30 0x7f59540693e0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f59680cc5a0 tx=0x7f595c009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:25:20.311 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:20.310+0000 7f594effd700 1 -- 172.21.15.50:0/4003353855 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f5958052bd0 con 0x7f59680aedc0 2023-10-06T01:25:20.556 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:20.555+0000 7f5967fff700 1 -- 172.21.15.50:0/4003353855 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f59680c2960 con 0x7f59680aedc0 2023-10-06T01:25:20.557 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:20.556+0000 7f594effd700 1 -- 172.21.15.50:0/4003353855 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) v1 ==== 94+0+4603 (secure 0 0 0) 0x7f595802a020 con 0x7f59680aedc0 2023-10-06T01:25:20.557 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-10-06T01:25:20.557 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":18,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4769,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6833/3835292201","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6832","nonce":3835292201},{"type":"v1","addr":"172.21.15.50:6833","nonce":3835292201}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":13},{"gid":4772,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6837/2073318681","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6835","nonce":2073318681},{"type":"v1","addr":"172.21.15.155:6837","nonce":2073318681}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":13},{"gid":4993,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6836/2652534948","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":2652534948},{"type":"v1","addr":"172.21.15.155:6836","nonce":2652534948}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":18,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T01:22:56.416443+0000","modified":"2023-10-06T01:22:59.935058+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5160},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5160":{"gid":5160,"name":"c","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.50:6835/3957156573","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6834","nonce":3957156573},{"type":"v1","addr":"172.21.15.50:6835","nonce":3957156573}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2}]} 2023-10-06T01:25:20.560 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:20.558+0000 7f5967fff700 1 -- 172.21.15.50:0/4003353855 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f5954066f30 msgr2=0x7f59540693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:25:20.560 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:20.558+0000 7f5967fff700 1 --2- 172.21.15.50:0/4003353855 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f5954066f30 0x7f59540693e0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f59680cc5a0 tx=0x7f595c009040 comp rx=0 tx=0).stop 2023-10-06T01:25:20.560 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:20.558+0000 7f5967fff700 1 -- 172.21.15.50:0/4003353855 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f59680aedc0 msgr2=0x7f596813c6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:25:20.560 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:20.558+0000 7f5967fff700 1 --2- 172.21.15.50:0/4003353855 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f59680aedc0 0x7f596813c6d0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f5958009ed0 tx=0x7f5958017000 comp rx=0 tx=0).stop 2023-10-06T01:25:20.560 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:20.559+0000 7f5967fff700 1 -- 172.21.15.50:0/4003353855 shutdown_connections 2023-10-06T01:25:20.560 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:20.559+0000 7f5967fff700 1 --2- 172.21.15.50:0/4003353855 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5968140b70 0x7f59680a58a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:25:20.560 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:20.559+0000 7f5967fff700 1 --2- 172.21.15.50:0/4003353855 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f59680aedc0 0x7f596813c6d0 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:25:20.560 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:20.559+0000 7f5967fff700 1 --2- 172.21.15.50:0/4003353855 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f5954066f30 0x7f59540693e0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:25:20.560 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:20.559+0000 7f5967fff700 1 --2- 172.21.15.50:0/4003353855 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f59680af230 0x7f59680b1890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:25:20.561 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:20.559+0000 7f5967fff700 1 -- 172.21.15.50:0/4003353855 >> 172.21.15.50:0/4003353855 conn(0x7f59680cbef0 msgr2=0x7f596813f810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:25:20.561 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:20.559+0000 7f5967fff700 1 -- 172.21.15.50:0/4003353855 shutdown_connections 2023-10-06T01:25:20.561 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:20.559+0000 7f5967fff700 1 -- 172.21.15.50:0/4003353855 wait complete. 2023-10-06T01:25:20.561 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 18 2023-10-06T01:25:20.578 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T01:25:20.764 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:20.764+0000 7f661cb9d700 1 Processor -- start 2023-10-06T01:25:20.765 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:20.764+0000 7f661cb9d700 1 -- start start 2023-10-06T01:25:20.767 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:20.765+0000 7f661cb9d700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f6618140b70 0x7f661806f190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:25:20.767 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:20.765+0000 7f661cb9d700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f66180aedc0 0x7f66180af230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:25:20.767 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:20.765+0000 7f661cb9d700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f66180c1e80 0x7f66180c22e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:25:20.767 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:20.765+0000 7f661cb9d700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f66180c19f0 con 0x7f6618140b70 2023-10-06T01:25:20.767 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:20.765+0000 7f661cb9d700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f66180c0de0 con 0x7f66180aedc0 2023-10-06T01:25:20.767 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:20.765+0000 7f661cb9d700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f66180c10c0 con 0x7f66180c1e80 2023-10-06T01:25:20.768 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:20.765+0000 7f66177fe700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f6618140b70 0x7f661806f190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:25:20.768 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:20.765+0000 7f66177fe700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f6618140b70 0x7f661806f190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:56820/0 (socket says 172.21.15.50:56820) 2023-10-06T01:25:20.768 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:20.765+0000 7f66177fe700 1 -- 172.21.15.50:0/1188092783 learned_addr learned my addr 172.21.15.50:0/1188092783 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-06T01:25:20.768 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:20.766+0000 7f6616ffd700 1 --2- 172.21.15.50:0/1188092783 >> v2:172.21.15.155:3300/0 conn(0x7f66180aedc0 0x7f66180af230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:25:20.768 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:20.766+0000 7f6617fff700 1 --2- 172.21.15.50:0/1188092783 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f66180c1e80 0x7f66180c22e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:25:20.768 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:20.766+0000 7f66177fe700 1 -- 172.21.15.50:0/1188092783 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f66180c1e80 msgr2=0x7f66180c22e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:25:20.768 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:20.766+0000 7f66177fe700 1 --2- 172.21.15.50:0/1188092783 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f66180c1e80 0x7f66180c22e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:25:20.768 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:20.766+0000 7f66177fe700 1 -- 172.21.15.50:0/1188092783 >> v2:172.21.15.155:3300/0 conn(0x7f66180aedc0 msgr2=0x7f66180af230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:25:20.768 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:20.766+0000 7f66177fe700 1 --2- 172.21.15.50:0/1188092783 >> v2:172.21.15.155:3300/0 conn(0x7f66180aedc0 0x7f66180af230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:25:20.768 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:20.766+0000 7f66177fe700 1 -- 172.21.15.50:0/1188092783 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66180c13a0 con 0x7f6618140b70 2023-10-06T01:25:20.768 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:20.766+0000 7f6616ffd700 1 --2- 172.21.15.50:0/1188092783 >> v2:172.21.15.155:3300/0 conn(0x7f66180aedc0 0x7f66180af230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T01:25:20.769 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:20.766+0000 7f66177fe700 1 --2- 172.21.15.50:0/1188092783 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6618140b70 0x7f661806f190 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f66180c2f50 tx=0x7f6608009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6b4c5cbe1789bf3a server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:25:20.769 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:20.766+0000 7f66167fc700 1 -- 172.21.15.50:0/1188092783 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f660800b860 con 0x7f6618140b70 2023-10-06T01:25:20.769 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:20.766+0000 7f66167fc700 1 -- 172.21.15.50:0/1188092783 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f660800b9c0 con 0x7f6618140b70 2023-10-06T01:25:20.769 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:20.766+0000 7f66167fc700 1 -- 172.21.15.50:0/1188092783 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f660800bd60 con 0x7f6618140b70 2023-10-06T01:25:20.770 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:20.767+0000 7f661cb9d700 1 -- 172.21.15.50:0/1188092783 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6618140b70 msgr2=0x7f661806f190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:25:20.770 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:20.767+0000 7f661cb9d700 1 --2- 172.21.15.50:0/1188092783 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6618140b70 0x7f661806f190 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f66180c2f50 tx=0x7f6608009250 comp rx=0 tx=0).stop 2023-10-06T01:25:20.770 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:20.767+0000 7f661cb9d700 1 -- 172.21.15.50:0/1188092783 shutdown_connections 2023-10-06T01:25:20.770 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:20.767+0000 7f661cb9d700 1 --2- 172.21.15.50:0/1188092783 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f66180c1e80 0x7f66180c22e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:25:20.770 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:20.767+0000 7f661cb9d700 1 --2- 172.21.15.50:0/1188092783 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6618140b70 0x7f661806f190 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:25:20.770 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:20.767+0000 7f661cb9d700 1 --2- 172.21.15.50:0/1188092783 >> v2:172.21.15.155:3300/0 conn(0x7f66180aedc0 0x7f66180af230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:25:20.770 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:20.767+0000 7f661cb9d700 1 -- 172.21.15.50:0/1188092783 >> 172.21.15.50:0/1188092783 conn(0x7f66180cbef0 msgr2=0x7f66180cc2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:25:20.771 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:20.767+0000 7f661cb9d700 1 -- 172.21.15.50:0/1188092783 shutdown_connections 2023-10-06T01:25:20.771 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:20.767+0000 7f661cb9d700 1 -- 172.21.15.50:0/1188092783 wait complete. 2023-10-06T01:25:20.771 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:20.768+0000 7f661cb9d700 1 Processor -- start 2023-10-06T01:25:20.771 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:20.769+0000 7f661cb9d700 1 -- start start 2023-10-06T01:25:20.773 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:20.770+0000 7f661cb9d700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f66180aedc0 0x7f66180b0ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:25:20.773 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:20.770+0000 7f661cb9d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f66180c1e80 0x7f66181568e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:25:20.773 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:20.770+0000 7f661cb9d700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6618140b70 0x7f661812e270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:25:20.773 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:20.770+0000 7f661cb9d700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6618157dd0 con 0x7f66180c1e80 2023-10-06T01:25:20.773 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:20.770+0000 7f661cb9d700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66180b1410 con 0x7f6618140b70 2023-10-06T01:25:20.773 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:20.770+0000 7f661cb9d700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f66180b1c30 con 0x7f66180aedc0 2023-10-06T01:25:20.773 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:20.770+0000 7f6616ffd700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f66180c1e80 0x7f66181568e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:25:20.773 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:20.770+0000 7f6616ffd700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f66180c1e80 0x7f66181568e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:56822/0 (socket says 172.21.15.50:56822) 2023-10-06T01:25:20.773 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:20.770+0000 7f6616ffd700 1 -- 172.21.15.50:0/587206881 learned_addr learned my addr 172.21.15.50:0/587206881 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-06T01:25:20.773 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:20.770+0000 7f66177fe700 1 --2- 172.21.15.50:0/587206881 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f66180aedc0 0x7f66180b0ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:25:20.774 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:20.770+0000 7f6617fff700 1 --2- 172.21.15.50:0/587206881 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6618140b70 0x7f661812e270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:25:20.774 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:20.770+0000 7f6616ffd700 1 -- 172.21.15.50:0/587206881 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f66180aedc0 msgr2=0x7f66180b0ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:25:20.774 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:20.770+0000 7f6616ffd700 1 --2- 172.21.15.50:0/587206881 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f66180aedc0 0x7f66180b0ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:25:20.774 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:20.770+0000 7f6616ffd700 1 -- 172.21.15.50:0/587206881 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6618140b70 msgr2=0x7f661812e270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:25:20.774 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:20.770+0000 7f6616ffd700 1 --2- 172.21.15.50:0/587206881 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6618140b70 0x7f661812e270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:25:20.774 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:20.770+0000 7f6616ffd700 1 -- 172.21.15.50:0/587206881 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66080094f0 con 0x7f66180c1e80 2023-10-06T01:25:20.774 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:20.771+0000 7f6616ffd700 1 --2- 172.21.15.50:0/587206881 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f66180c1e80 0x7f66181568e0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f660c00e8d0 tx=0x7f660c008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:25:20.774 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:20.771+0000 7f65ff7fe700 1 -- 172.21.15.50:0/587206881 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f660c00ee70 con 0x7f66180c1e80 2023-10-06T01:25:20.774 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:20.771+0000 7f65ff7fe700 1 -- 172.21.15.50:0/587206881 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f660c00c5e0 con 0x7f66180c1e80 2023-10-06T01:25:20.774 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:20.771+0000 7f65ff7fe700 1 -- 172.21.15.50:0/587206881 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f660c00c980 con 0x7f66180c1e80 2023-10-06T01:25:20.774 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:20.771+0000 7f661cb9d700 1 -- 172.21.15.50:0/587206881 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f66180b1670 con 0x7f66180c1e80 2023-10-06T01:25:20.775 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:20.771+0000 7f661cb9d700 1 -- 172.21.15.50:0/587206881 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6618157a60 con 0x7f66180c1e80 2023-10-06T01:25:20.775 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:20.772+0000 7f661cb9d700 1 -- 172.21.15.50:0/587206881 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f661805f270 con 0x7f66180c1e80 2023-10-06T01:25:20.775 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:20.773+0000 7f65ff7fe700 1 -- 172.21.15.50:0/587206881 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f660c013410 con 0x7f66180c1e80 2023-10-06T01:25:20.775 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:20.773+0000 7f65ff7fe700 1 --2- 172.21.15.50:0/587206881 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f6604066f30 0x7f66040693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:25:20.776 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:20.774+0000 7f65ff7fe700 1 -- 172.21.15.50:0/587206881 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6436+0+0 (secure 0 0 0) 0x7f660c0846c0 con 0x7f66180c1e80 2023-10-06T01:25:20.776 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:20.774+0000 7f66177fe700 1 --2- 172.21.15.50:0/587206881 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f6604066f30 0x7f66040693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:25:20.776 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:20.775+0000 7f66177fe700 1 --2- 172.21.15.50:0/587206881 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f6604066f30 0x7f66040693e0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f66180c2f50 tx=0x7f6608017000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:25:20.778 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:20.778+0000 7f65ff7fe700 1 -- 172.21.15.50:0/587206881 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f660c0515b0 con 0x7f66180c1e80 2023-10-06T01:25:20.986 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:20.985+0000 7f661cb9d700 1 -- 172.21.15.50:0/587206881 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f66180c2960 con 0x7f66180c1e80 2023-10-06T01:25:20.987 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:20.986+0000 7f65ff7fe700 1 -- 172.21.15.50:0/587206881 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v41) v1 ==== 74+0+17167 (secure 0 0 0) 0x7f660c054bd0 con 0x7f66180c1e80 2023-10-06T01:25:20.988 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-10-06T01:25:20.988 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":41,"fsid":"0bfd9a6b-1587-4fe4-a89e-e43c00286b4e","created":"2023-10-06T01:21:16.828801+0000","modified":"2023-10-06T01:23:25.862497+0000","last_up_change":"2023-10-06T01:21:28.584523+0000","last_in_change":"2023-10-06T01:21:20.179863+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-10-06T01:21:29.304225+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":".mgr","create_time":"2023-10-06T01:21:29.835490+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2023-10-06T01:22:54.641549+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":7,"pool_name":"cephfs_data","create_time":"2023-10-06T01:22:55.389647+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"39","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"9060727a-3959-4de3-8363-c5c5d7826c9a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":87837},{"type":"v1","addr":"172.21.15.50:6801","nonce":87837}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":87837},{"type":"v1","addr":"172.21.15.50:6803","nonce":87837}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":87837},{"type":"v1","addr":"172.21.15.50:6807","nonce":87837}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":87837},{"type":"v1","addr":"172.21.15.50:6805","nonce":87837}]},"public_addr":"172.21.15.50:6801/87837","cluster_addr":"172.21.15.50:6803/87837","heartbeat_back_addr":"172.21.15.50:6807/87837","heartbeat_front_addr":"172.21.15.50:6805/87837","state":["exists","up"]},{"osd":1,"uuid":"5ad9ef12-b579-47ea-b690-90ba887e2cef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":87853},{"type":"v1","addr":"172.21.15.50:6809","nonce":87853}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":87853},{"type":"v1","addr":"172.21.15.50:6811","nonce":87853}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":87853},{"type":"v1","addr":"172.21.15.50:6815","nonce":87853}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":87853},{"type":"v1","addr":"172.21.15.50:6813","nonce":87853}]},"public_addr":"172.21.15.50:6809/87853","cluster_addr":"172.21.15.50:6811/87853","heartbeat_back_addr":"172.21.15.50:6815/87853","heartbeat_front_addr":"172.21.15.50:6813/87853","state":["exists","up"]},{"osd":2,"uuid":"c7aee044-6f75-436f-90e1-ba42a57359bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6821","nonce":87855},{"type":"v1","addr":"172.21.15.50:6822","nonce":87855}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6824","nonce":87855},{"type":"v1","addr":"172.21.15.50:6826","nonce":87855}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":87855},{"type":"v1","addr":"172.21.15.50:6831","nonce":87855}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":87855},{"type":"v1","addr":"172.21.15.50:6829","nonce":87855}]},"public_addr":"172.21.15.50:6822/87855","cluster_addr":"172.21.15.50:6826/87855","heartbeat_back_addr":"172.21.15.50:6831/87855","heartbeat_front_addr":"172.21.15.50:6829/87855","state":["exists","up"]},{"osd":3,"uuid":"d9b901c8-e8b2-44af-9508-f453120a96c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":87856},{"type":"v1","addr":"172.21.15.50:6817","nonce":87856}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":87856},{"type":"v1","addr":"172.21.15.50:6819","nonce":87856}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6825","nonce":87856},{"type":"v1","addr":"172.21.15.50:6827","nonce":87856}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6820","nonce":87856},{"type":"v1","addr":"172.21.15.50:6823","nonce":87856}]},"public_addr":"172.21.15.50:6817/87856","cluster_addr":"172.21.15.50:6819/87856","heartbeat_back_addr":"172.21.15.50:6827/87856","heartbeat_front_addr":"172.21.15.50:6823/87856","state":["exists","up"]},{"osd":4,"uuid":"2b3c6b38-e3e9-4301-9445-60fd3fe8ce03","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":85805},{"type":"v1","addr":"172.21.15.155:6801","nonce":85805}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":85805},{"type":"v1","addr":"172.21.15.155:6803","nonce":85805}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6806","nonce":85805},{"type":"v1","addr":"172.21.15.155:6807","nonce":85805}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6804","nonce":85805},{"type":"v1","addr":"172.21.15.155:6805","nonce":85805}]},"public_addr":"172.21.15.155:6801/85805","cluster_addr":"172.21.15.155:6803/85805","heartbeat_back_addr":"172.21.15.155:6807/85805","heartbeat_front_addr":"172.21.15.155:6805/85805","state":["exists","up"]},{"osd":5,"uuid":"417b5f8f-65f1-4c94-91a7-a6ce03fe1679","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6816","nonce":85807},{"type":"v1","addr":"172.21.15.155:6818","nonce":85807}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6820","nonce":85807},{"type":"v1","addr":"172.21.15.155:6822","nonce":85807}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6828","nonce":85807},{"type":"v1","addr":"172.21.15.155:6830","nonce":85807}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6824","nonce":85807},{"type":"v1","addr":"172.21.15.155:6826","nonce":85807}]},"public_addr":"172.21.15.155:6818/85807","cluster_addr":"172.21.15.155:6822/85807","heartbeat_back_addr":"172.21.15.155:6830/85807","heartbeat_front_addr":"172.21.15.155:6826/85807","state":["exists","up"]},{"osd":6,"uuid":"c150cff3-aee4-4714-9c08-d182b1ba9ffd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6808","nonce":85806},{"type":"v1","addr":"172.21.15.155:6809","nonce":85806}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6810","nonce":85806},{"type":"v1","addr":"172.21.15.155:6811","nonce":85806}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6814","nonce":85806},{"type":"v1","addr":"172.21.15.155:6815","nonce":85806}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6812","nonce":85806},{"type":"v1","addr":"172.21.15.155:6813","nonce":85806}]},"public_addr":"172.21.15.155:6809/85806","cluster_addr":"172.21.15.155:6811/85806","heartbeat_back_addr":"172.21.15.155:6815/85806","heartbeat_front_addr":"172.21.15.155:6813/85806","state":["exists","up"]},{"osd":7,"uuid":"71107f0e-04d1-4e72-a0ec-0faf6af003e7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6817","nonce":85832},{"type":"v1","addr":"172.21.15.155:6819","nonce":85832}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6821","nonce":85832},{"type":"v1","addr":"172.21.15.155:6823","nonce":85832}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6829","nonce":85832},{"type":"v1","addr":"172.21.15.155:6831","nonce":85832}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6825","nonce":85832},{"type":"v1","addr":"172.21.15.155:6827","nonce":85832}]},"public_addr":"172.21.15.155:6819/85832","cluster_addr":"172.21.15.155:6823/85832","heartbeat_back_addr":"172.21.15.155:6831/85832","heartbeat_front_addr":"172.21.15.155:6827/85832","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:21:25.423389+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:21:25.472661+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:21:25.817562+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:21:25.551257+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:21:25.407818+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:21:25.557976+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:21:25.747299+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:21:25.827576+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"7.36","mappings":[{"from":0,"to":5}]},{"pgid":"7.3b","mappings":[{"from":0,"to":4}]}],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T01:25:20.990 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:20.989+0000 7f661cb9d700 1 -- 172.21.15.50:0/587206881 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f6604066f30 msgr2=0x7f66040693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:25:20.990 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:20.989+0000 7f661cb9d700 1 --2- 172.21.15.50:0/587206881 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f6604066f30 0x7f66040693e0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f66180c2f50 tx=0x7f6608017000 comp rx=0 tx=0).stop 2023-10-06T01:25:20.990 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:20.989+0000 7f661cb9d700 1 -- 172.21.15.50:0/587206881 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f66180c1e80 msgr2=0x7f66181568e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:25:20.990 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:20.989+0000 7f661cb9d700 1 --2- 172.21.15.50:0/587206881 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f66180c1e80 0x7f66181568e0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f660c00e8d0 tx=0x7f660c008040 comp rx=0 tx=0).stop 2023-10-06T01:25:20.990 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:20.989+0000 7f661cb9d700 1 -- 172.21.15.50:0/587206881 shutdown_connections 2023-10-06T01:25:20.990 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:20.989+0000 7f661cb9d700 1 --2- 172.21.15.50:0/587206881 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f6604066f30 0x7f66040693e0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:25:20.991 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:20.989+0000 7f661cb9d700 1 --2- 172.21.15.50:0/587206881 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6618140b70 0x7f661812e270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:25:20.991 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:20.989+0000 7f661cb9d700 1 --2- 172.21.15.50:0/587206881 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f66180aedc0 0x7f66180b0ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:25:20.991 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:20.989+0000 7f661cb9d700 1 --2- 172.21.15.50:0/587206881 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f66180c1e80 0x7f66181568e0 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:25:20.991 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:20.989+0000 7f661cb9d700 1 -- 172.21.15.50:0/587206881 >> 172.21.15.50:0/587206881 conn(0x7f66180cbef0 msgr2=0x7f661813d7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:25:20.991 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:20.989+0000 7f661cb9d700 1 -- 172.21.15.50:0/587206881 shutdown_connections 2023-10-06T01:25:20.991 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:20.989+0000 7f661cb9d700 1 -- 172.21.15.50:0/587206881 wait complete. 2023-10-06T01:25:21.008 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-10-06T01:21:29.304225+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-10-06T01:21:29.835490+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 6, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-06T01:22:54.641549+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '38', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 7, 'pool_name': 'cephfs_data', 'create_time': '2023-10-06T01:22:55.389647+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '39', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-06T01:25:21.008 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-10-06T01:25:21.198 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:21.197+0000 7f1eeef9d700 1 Processor -- start 2023-10-06T01:25:21.198 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:21.197+0000 7f1eeef9d700 1 -- start start 2023-10-06T01:25:21.200 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:21.199+0000 7f1eeef9d700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1ee8156000 0x7f1ee80c89f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:25:21.201 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:21.199+0000 7f1eeef9d700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f1ee806e1a0 0x7f1ee806e5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:25:21.201 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:21.199+0000 7f1eeef9d700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1ee80ad650 con 0x7f1ee80b0020 2023-10-06T01:25:21.201 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:21.199+0000 7f1eeef9d700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1ee80c8f30 con 0x7f1ee806e1a0 2023-10-06T01:25:21.201 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:21.199+0000 7f1eeef9d700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ee806eb30 con 0x7f1ee8156000 2023-10-06T01:25:21.201 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:21.199+0000 7f1eed79a700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f1ee806e1a0 0x7f1ee806e5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:25:21.201 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:21.199+0000 7f1eed79a700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f1ee806e1a0 0x7f1ee806e5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:56838/0 (socket says 172.21.15.50:56838) 2023-10-06T01:25:21.201 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:21.199+0000 7f1eed79a700 1 -- 172.21.15.50:0/3744010153 learned_addr learned my addr 172.21.15.50:0/3744010153 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-06T01:25:21.201 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:21.199+0000 7f1eedf9b700 1 --2- 172.21.15.50:0/3744010153 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1ee8156000 0x7f1ee80c89f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:25:21.201 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:21.199+0000 7f1eed79a700 1 -- 172.21.15.50:0/3744010153 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1ee8156000 msgr2=0x7f1ee80c89f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:25:21.201 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:21.199+0000 7f1eed79a700 1 --2- 172.21.15.50:0/3744010153 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1ee8156000 0x7f1ee80c89f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:25:21.201 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:21.199+0000 7f1eed79a700 1 -- 172.21.15.50:0/3744010153 >> v1:172.21.15.155:6789/0 conn(0x7f1ee80b0020 legacy=0x7f1ee80b0460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:25:21.202 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:21.199+0000 7f1eed79a700 1 -- 172.21.15.50:0/3744010153 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ee80b0b70 con 0x7f1ee806e1a0 2023-10-06T01:25:21.202 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:21.199+0000 7f1eedf9b700 1 --2- 172.21.15.50:0/3744010153 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1ee8156000 0x7f1ee80c89f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T01:25:21.202 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:21.200+0000 7f1eed79a700 1 --2- 172.21.15.50:0/3744010153 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1ee806e1a0 0x7f1ee806e5f0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f1ed80099b0 tx=0x7f1ed8009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9ec19ee5f84a0edf server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:25:21.202 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:21.200+0000 7f1eecf99700 1 -- 172.21.15.50:0/3744010153 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ed800b8b0 con 0x7f1ee806e1a0 2023-10-06T01:25:21.202 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:21.200+0000 7f1eecf99700 1 -- 172.21.15.50:0/3744010153 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ed800ba10 con 0x7f1ee806e1a0 2023-10-06T01:25:21.202 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:21.200+0000 7f1eecf99700 1 -- 172.21.15.50:0/3744010153 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ed800bdb0 con 0x7f1ee806e1a0 2023-10-06T01:25:21.203 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:21.200+0000 7f1eeef9d700 1 -- 172.21.15.50:0/3744010153 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1ee806e1a0 msgr2=0x7f1ee806e5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:25:21.203 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:21.200+0000 7f1eeef9d700 1 --2- 172.21.15.50:0/3744010153 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1ee806e1a0 0x7f1ee806e5f0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f1ed80099b0 tx=0x7f1ed8009250 comp rx=0 tx=0).stop 2023-10-06T01:25:21.203 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:21.200+0000 7f1eeef9d700 1 -- 172.21.15.50:0/3744010153 shutdown_connections 2023-10-06T01:25:21.203 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:21.200+0000 7f1eeef9d700 1 --2- 172.21.15.50:0/3744010153 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1ee8156000 0x7f1ee80c89f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:25:21.203 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:21.200+0000 7f1eeef9d700 1 --2- 172.21.15.50:0/3744010153 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1ee806e1a0 0x7f1ee806e5f0 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:25:21.204 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:21.200+0000 7f1eeef9d700 1 -- 172.21.15.50:0/3744010153 >> 172.21.15.50:0/3744010153 conn(0x7f1ee80cbed0 msgr2=0x7f1ee80cc2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:25:21.204 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:21.201+0000 7f1eeef9d700 1 -- 172.21.15.50:0/3744010153 shutdown_connections 2023-10-06T01:25:21.204 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:21.201+0000 7f1eeef9d700 1 -- 172.21.15.50:0/3744010153 wait complete. 2023-10-06T01:25:21.204 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:21.202+0000 7f1eeef9d700 1 Processor -- start 2023-10-06T01:25:21.204 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:21.202+0000 7f1eeef9d700 1 -- start start 2023-10-06T01:25:21.205 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:21.203+0000 7f1eeef9d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1ee806e1a0 0x7f1ee8167ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:25:21.206 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:21.203+0000 7f1eeef9d700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1ee80b0020 0x7f1ee81563d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:25:21.206 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:21.203+0000 7f1eeef9d700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1ee8156000 0x7f1ee80af480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:25:21.206 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:21.203+0000 7f1eeef9d700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ee8167a50 con 0x7f1ee806e1a0 2023-10-06T01:25:21.206 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:21.203+0000 7f1eeef9d700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ee8167420 con 0x7f1ee80b0020 2023-10-06T01:25:21.206 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:21.203+0000 7f1eeef9d700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ee8156db0 con 0x7f1ee8156000 2023-10-06T01:25:21.206 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:21.203+0000 7f1eedf9b700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1ee806e1a0 0x7f1ee8167ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:25:21.206 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:21.203+0000 7f1eedf9b700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1ee806e1a0 0x7f1ee8167ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:56848/0 (socket says 172.21.15.50:56848) 2023-10-06T01:25:21.206 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:21.203+0000 7f1eedf9b700 1 -- 172.21.15.50:0/2011374770 learned_addr learned my addr 172.21.15.50:0/2011374770 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-06T01:25:21.206 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:21.204+0000 7f1eee79c700 1 --2- 172.21.15.50:0/2011374770 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1ee8156000 0x7f1ee80af480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:25:21.206 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:21.204+0000 7f1eed79a700 1 --2- 172.21.15.50:0/2011374770 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1ee80b0020 0x7f1ee81563d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:25:21.207 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:21.204+0000 7f1eedf9b700 1 -- 172.21.15.50:0/2011374770 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1ee8156000 msgr2=0x7f1ee80af480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:25:21.207 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:21.204+0000 7f1eedf9b700 1 --2- 172.21.15.50:0/2011374770 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1ee8156000 0x7f1ee80af480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:25:21.207 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:21.204+0000 7f1eedf9b700 1 -- 172.21.15.50:0/2011374770 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1ee80b0020 msgr2=0x7f1ee81563d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:25:21.207 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:21.204+0000 7f1eedf9b700 1 --2- 172.21.15.50:0/2011374770 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1ee80b0020 0x7f1ee81563d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:25:21.207 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:21.204+0000 7f1eedf9b700 1 -- 172.21.15.50:0/2011374770 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ed80094f0 con 0x7f1ee806e1a0 2023-10-06T01:25:21.207 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:21.204+0000 7f1eed79a700 1 --2- 172.21.15.50:0/2011374770 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1ee80b0020 0x7f1ee81563d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T01:25:21.207 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:21.204+0000 7f1eee79c700 1 --2- 172.21.15.50:0/2011374770 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1ee8156000 0x7f1ee80af480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T01:25:21.207 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:21.204+0000 7f1eedf9b700 1 --2- 172.21.15.50:0/2011374770 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1ee806e1a0 0x7f1ee8167ee0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f1ee400c850 tx=0x7f1ee4008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:25:21.207 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:21.204+0000 7f1eddffb700 1 -- 172.21.15.50:0/2011374770 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ee4011600 con 0x7f1ee806e1a0 2023-10-06T01:25:21.207 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:21.204+0000 7f1eddffb700 1 -- 172.21.15.50:0/2011374770 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ee4011760 con 0x7f1ee806e1a0 2023-10-06T01:25:21.207 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:21.204+0000 7f1eddffb700 1 -- 172.21.15.50:0/2011374770 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ee4011b00 con 0x7f1ee806e1a0 2023-10-06T01:25:21.207 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:21.204+0000 7f1eeef9d700 1 -- 172.21.15.50:0/2011374770 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1ee8157090 con 0x7f1ee806e1a0 2023-10-06T01:25:21.208 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:21.205+0000 7f1eeef9d700 1 -- 172.21.15.50:0/2011374770 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1ee8148e60 con 0x7f1ee806e1a0 2023-10-06T01:25:21.208 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:21.205+0000 7f1eeef9d700 1 -- 172.21.15.50:0/2011374770 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1ee8167d30 con 0x7f1ee806e1a0 2023-10-06T01:25:21.208 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:21.206+0000 7f1eddffb700 1 -- 172.21.15.50:0/2011374770 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f1ee40073b0 con 0x7f1ee806e1a0 2023-10-06T01:25:21.209 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:21.208+0000 7f1eddffb700 1 --2- 172.21.15.50:0/2011374770 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f1ecc066f30 0x7f1ecc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:25:21.209 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:21.208+0000 7f1eddffb700 1 -- 172.21.15.50:0/2011374770 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6436+0+0 (secure 0 0 0) 0x7f1ee4084890 con 0x7f1ee806e1a0 2023-10-06T01:25:21.209 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:21.209+0000 7f1eed79a700 1 --2- 172.21.15.50:0/2011374770 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f1ecc066f30 0x7f1ecc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:25:21.210 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:21.209+0000 7f1eed79a700 1 --2- 172.21.15.50:0/2011374770 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f1ecc066f30 0x7f1ecc0693e0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f1ed80099b0 tx=0x7f1ed8016000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:25:21.212 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:21.212+0000 7f1eddffb700 1 -- 172.21.15.50:0/2011374770 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f1ee4051780 con 0x7f1ee806e1a0 2023-10-06T01:25:21.413 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:21.412+0000 7f1eeef9d700 1 -- 172.21.15.50:0/2011374770 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f1ee805f270 con 0x7f1ee806e1a0 2023-10-06T01:25:21.414 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:21.413+0000 7f1eddffb700 1 -- 172.21.15.50:0/2011374770 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v41) v1 ==== 92+0+10 (secure 0 0 0) 0x7f1ee4054da0 con 0x7f1ee806e1a0 2023-10-06T01:25:21.414 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 8 2023-10-06T01:25:21.416 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:21.415+0000 7f1eeef9d700 1 -- 172.21.15.50:0/2011374770 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f1ecc066f30 msgr2=0x7f1ecc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:25:21.416 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:21.415+0000 7f1eeef9d700 1 --2- 172.21.15.50:0/2011374770 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f1ecc066f30 0x7f1ecc0693e0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f1ed80099b0 tx=0x7f1ed8016000 comp rx=0 tx=0).stop 2023-10-06T01:25:21.416 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:21.415+0000 7f1eeef9d700 1 -- 172.21.15.50:0/2011374770 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1ee806e1a0 msgr2=0x7f1ee8167ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:25:21.417 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:21.415+0000 7f1eeef9d700 1 --2- 172.21.15.50:0/2011374770 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1ee806e1a0 0x7f1ee8167ee0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f1ee400c850 tx=0x7f1ee4008040 comp rx=0 tx=0).stop 2023-10-06T01:25:21.417 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:21.415+0000 7f1eeef9d700 1 -- 172.21.15.50:0/2011374770 shutdown_connections 2023-10-06T01:25:21.417 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:21.415+0000 7f1eeef9d700 1 --2- 172.21.15.50:0/2011374770 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1ee8156000 0x7f1ee80af480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:25:21.417 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:21.415+0000 7f1eeef9d700 1 --2- 172.21.15.50:0/2011374770 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1ee806e1a0 0x7f1ee8167ee0 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:25:21.417 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:21.415+0000 7f1eeef9d700 1 --2- 172.21.15.50:0/2011374770 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f1ecc066f30 0x7f1ecc0693e0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:25:21.417 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:21.415+0000 7f1eeef9d700 1 --2- 172.21.15.50:0/2011374770 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1ee80b0020 0x7f1ee81563d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:25:21.417 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:21.415+0000 7f1eeef9d700 1 -- 172.21.15.50:0/2011374770 >> 172.21.15.50:0/2011374770 conn(0x7f1ee80cbed0 msgr2=0x7f1ee806d190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:25:21.417 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:21.415+0000 7f1eeef9d700 1 -- 172.21.15.50:0/2011374770 shutdown_connections 2023-10-06T01:25:21.417 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:21.415+0000 7f1eeef9d700 1 -- 172.21.15.50:0/2011374770 wait complete. 2023-10-06T01:25:21.434 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-06T01:25:21.624 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:21.623+0000 7f7c2f59d700 1 Processor -- start 2023-10-06T01:25:21.624 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:21.623+0000 7f7c2f59d700 1 -- start start 2023-10-06T01:25:21.626 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:21.625+0000 7f7c2f59d700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f7c28159210 0x7f7c280cda80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:25:21.626 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:21.625+0000 7f7c2f59d700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f7c281595e0 0x7f7c280aebf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:25:21.627 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:21.625+0000 7f7c2f59d700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7c280aa430 con 0x7f7c280675f0 2023-10-06T01:25:21.627 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:21.625+0000 7f7c2f59d700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7c280a9e50 con 0x7f7c28159210 2023-10-06T01:25:21.627 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:21.625+0000 7f7c2f59d700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7c280af4b0 con 0x7f7c281595e0 2023-10-06T01:25:21.627 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:21.625+0000 7f7c2e59b700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f7c28159210 0x7f7c280cda80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:25:21.627 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:21.625+0000 7f7c2e59b700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f7c28159210 0x7f7c280cda80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:56864/0 (socket says 172.21.15.50:56864) 2023-10-06T01:25:21.627 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:21.625+0000 7f7c2e59b700 1 -- 172.21.15.50:0/2534199743 learned_addr learned my addr 172.21.15.50:0/2534199743 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-06T01:25:21.627 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:21.625+0000 7f7c2e59b700 1 -- 172.21.15.50:0/2534199743 >> v2:172.21.15.155:3300/0 conn(0x7f7c281595e0 msgr2=0x7f7c280aebf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:25:21.627 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:21.625+0000 7f7c2e59b700 1 --2- 172.21.15.50:0/2534199743 >> v2:172.21.15.155:3300/0 conn(0x7f7c281595e0 0x7f7c280aebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:25:21.627 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:21.625+0000 7f7c2e59b700 1 -- 172.21.15.50:0/2534199743 >> v1:172.21.15.155:6789/0 conn(0x7f7c280675f0 legacy=0x7f7c28067a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:25:21.627 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:21.625+0000 7f7c2e59b700 1 -- 172.21.15.50:0/2534199743 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c280aa0c0 con 0x7f7c28159210 2023-10-06T01:25:21.627 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:21.626+0000 7f7c2e59b700 1 --2- 172.21.15.50:0/2534199743 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7c28159210 0x7f7c280cda80 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f7c280ac960 tx=0x7f7c24009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=647295612b918051 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:25:21.628 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:21.626+0000 7f7c2d599700 1 -- 172.21.15.50:0/2534199743 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c2400b820 con 0x7f7c28159210 2023-10-06T01:25:21.628 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:21.626+0000 7f7c2d599700 1 -- 172.21.15.50:0/2534199743 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c2400b980 con 0x7f7c28159210 2023-10-06T01:25:21.628 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:21.626+0000 7f7c2d599700 1 -- 172.21.15.50:0/2534199743 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c2400bd20 con 0x7f7c28159210 2023-10-06T01:25:21.629 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:21.626+0000 7f7c2f59d700 1 -- 172.21.15.50:0/2534199743 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7c28159210 msgr2=0x7f7c280cda80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:25:21.629 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:21.626+0000 7f7c2f59d700 1 --2- 172.21.15.50:0/2534199743 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7c28159210 0x7f7c280cda80 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f7c280ac960 tx=0x7f7c24009250 comp rx=0 tx=0).stop 2023-10-06T01:25:21.629 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:21.626+0000 7f7c2f59d700 1 -- 172.21.15.50:0/2534199743 shutdown_connections 2023-10-06T01:25:21.629 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:21.626+0000 7f7c2f59d700 1 --2- 172.21.15.50:0/2534199743 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7c28159210 0x7f7c280cda80 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:25:21.629 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:21.626+0000 7f7c2f59d700 1 --2- 172.21.15.50:0/2534199743 >> v2:172.21.15.155:3300/0 conn(0x7f7c281595e0 0x7f7c280aebf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:25:21.629 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:21.626+0000 7f7c2f59d700 1 -- 172.21.15.50:0/2534199743 >> 172.21.15.50:0/2534199743 conn(0x7f7c280691d0 msgr2=0x7f7c280ccfd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:25:21.629 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:21.627+0000 7f7c2f59d700 1 -- 172.21.15.50:0/2534199743 shutdown_connections 2023-10-06T01:25:21.629 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:21.627+0000 7f7c2f59d700 1 -- 172.21.15.50:0/2534199743 wait complete. 2023-10-06T01:25:21.629 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:21.628+0000 7f7c2f59d700 1 Processor -- start 2023-10-06T01:25:21.630 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:21.628+0000 7f7c2f59d700 1 -- start start 2023-10-06T01:25:21.631 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:21.629+0000 7f7c2f59d700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7c280675f0 0x7f7c2815d890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:25:21.631 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:21.629+0000 7f7c2f59d700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7c28159210 0x7f7c2815ba80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:25:21.632 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:21.629+0000 7f7c2f59d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7c281595e0 0x7f7c28149980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:25:21.632 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:21.629+0000 7f7c2f59d700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c2815cb00 con 0x7f7c281595e0 2023-10-06T01:25:21.632 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:21.629+0000 7f7c2f59d700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c28169350 con 0x7f7c28159210 2023-10-06T01:25:21.632 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:21.629+0000 7f7c2f59d700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c2815bfc0 con 0x7f7c280675f0 2023-10-06T01:25:21.632 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:21.629+0000 7f7c2ed9c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7c281595e0 0x7f7c28149980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:25:21.632 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:21.629+0000 7f7c2ed9c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7c281595e0 0x7f7c28149980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:56866/0 (socket says 172.21.15.50:56866) 2023-10-06T01:25:21.632 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:21.629+0000 7f7c2ed9c700 1 -- 172.21.15.50:0/642102371 learned_addr learned my addr 172.21.15.50:0/642102371 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-06T01:25:21.632 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:21.629+0000 7f7c2dd9a700 1 --2- 172.21.15.50:0/642102371 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7c28159210 0x7f7c2815ba80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:25:21.632 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:21.629+0000 7f7c2e59b700 1 --2- 172.21.15.50:0/642102371 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7c280675f0 0x7f7c2815d890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:25:21.632 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:21.630+0000 7f7c2ed9c700 1 -- 172.21.15.50:0/642102371 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7c280675f0 msgr2=0x7f7c2815d890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:25:21.632 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:21.630+0000 7f7c2ed9c700 1 --2- 172.21.15.50:0/642102371 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7c280675f0 0x7f7c2815d890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:25:21.633 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:21.630+0000 7f7c2ed9c700 1 -- 172.21.15.50:0/642102371 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7c28159210 msgr2=0x7f7c2815ba80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:25:21.633 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:21.630+0000 7f7c2ed9c700 1 --2- 172.21.15.50:0/642102371 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7c28159210 0x7f7c2815ba80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:25:21.633 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:21.630+0000 7f7c2ed9c700 1 -- 172.21.15.50:0/642102371 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c240094f0 con 0x7f7c281595e0 2023-10-06T01:25:21.633 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:21.630+0000 7f7c2ed9c700 1 --2- 172.21.15.50:0/642102371 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7c281595e0 0x7f7c28149980 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f7c2000bbb0 tx=0x7f7c20009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:25:21.633 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:21.630+0000 7f7c1e7fc700 1 -- 172.21.15.50:0/642102371 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c200092e0 con 0x7f7c281595e0 2023-10-06T01:25:21.633 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:21.630+0000 7f7c1e7fc700 1 -- 172.21.15.50:0/642102371 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c2000c630 con 0x7f7c281595e0 2023-10-06T01:25:21.633 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:21.630+0000 7f7c2f59d700 1 -- 172.21.15.50:0/642102371 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7c2815c260 con 0x7f7c281595e0 2023-10-06T01:25:21.633 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:21.630+0000 7f7c1e7fc700 1 -- 172.21.15.50:0/642102371 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c2000c9f0 con 0x7f7c281595e0 2023-10-06T01:25:21.633 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:21.630+0000 7f7c2f59d700 1 -- 172.21.15.50:0/642102371 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7c2815c820 con 0x7f7c281595e0 2023-10-06T01:25:21.634 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:21.631+0000 7f7c2f59d700 1 -- 172.21.15.50:0/642102371 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7c28169510 con 0x7f7c281595e0 2023-10-06T01:25:21.634 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:21.632+0000 7f7c1e7fc700 1 -- 172.21.15.50:0/642102371 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f7c20012070 con 0x7f7c281595e0 2023-10-06T01:25:21.635 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:21.633+0000 7f7c1e7fc700 1 --2- 172.21.15.50:0/642102371 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f7c0c066f30 0x7f7c0c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:25:21.635 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:21.633+0000 7f7c1e7fc700 1 -- 172.21.15.50:0/642102371 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6436+0+0 (secure 0 0 0) 0x7f7c200843f0 con 0x7f7c281595e0 2023-10-06T01:25:21.635 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:21.634+0000 7f7c2e59b700 1 --2- 172.21.15.50:0/642102371 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f7c0c066f30 0x7f7c0c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:25:21.635 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:21.634+0000 7f7c2e59b700 1 --2- 172.21.15.50:0/642102371 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f7c0c066f30 0x7f7c0c0693e0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f7c280ac960 tx=0x7f7c24016000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:25:21.638 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:21.637+0000 7f7c1e7fc700 1 -- 172.21.15.50:0/642102371 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f7c200512e0 con 0x7f7c281595e0 2023-10-06T01:25:21.839 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:21.838+0000 7f7c2f59d700 1 -- 172.21.15.50:0/642102371 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f7c2805f270 con 0x7f7c281595e0 2023-10-06T01:25:21.839 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:21.838+0000 7f7c1e7fc700 1 -- 172.21.15.50:0/642102371 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v41) v1 ==== 93+0+10 (secure 0 0 0) 0x7f7c20054900 con 0x7f7c281595e0 2023-10-06T01:25:21.839 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 1 2023-10-06T01:25:21.842 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:21.841+0000 7f7c2f59d700 1 -- 172.21.15.50:0/642102371 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f7c0c066f30 msgr2=0x7f7c0c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:25:21.842 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:21.841+0000 7f7c2f59d700 1 --2- 172.21.15.50:0/642102371 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f7c0c066f30 0x7f7c0c0693e0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f7c280ac960 tx=0x7f7c24016000 comp rx=0 tx=0).stop 2023-10-06T01:25:21.842 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:21.841+0000 7f7c2f59d700 1 -- 172.21.15.50:0/642102371 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7c281595e0 msgr2=0x7f7c28149980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:25:21.842 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:21.841+0000 7f7c2f59d700 1 --2- 172.21.15.50:0/642102371 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7c281595e0 0x7f7c28149980 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f7c2000bbb0 tx=0x7f7c20009840 comp rx=0 tx=0).stop 2023-10-06T01:25:21.842 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:21.841+0000 7f7c2f59d700 1 -- 172.21.15.50:0/642102371 shutdown_connections 2023-10-06T01:25:21.842 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:21.841+0000 7f7c2f59d700 1 --2- 172.21.15.50:0/642102371 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7c281595e0 0x7f7c28149980 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:25:21.842 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:21.841+0000 7f7c2f59d700 1 --2- 172.21.15.50:0/642102371 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7c280675f0 0x7f7c2815d890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:25:21.843 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:21.841+0000 7f7c2f59d700 1 --2- 172.21.15.50:0/642102371 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f7c0c066f30 0x7f7c0c0693e0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:25:21.843 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:21.841+0000 7f7c2f59d700 1 --2- 172.21.15.50:0/642102371 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7c28159210 0x7f7c2815ba80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:25:21.843 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:21.841+0000 7f7c2f59d700 1 -- 172.21.15.50:0/642102371 >> 172.21.15.50:0/642102371 conn(0x7f7c280691d0 msgr2=0x7f7c2806b520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:25:21.843 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:21.841+0000 7f7c2f59d700 1 -- 172.21.15.50:0/642102371 shutdown_connections 2023-10-06T01:25:21.843 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:21.841+0000 7f7c2f59d700 1 -- 172.21.15.50:0/642102371 wait complete. 2023-10-06T01:25:21.860 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-06T01:25:22.051 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:22.050+0000 7fd63f59d700 1 Processor -- start 2023-10-06T01:25:22.051 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:22.050+0000 7fd63f59d700 1 -- start start 2023-10-06T01:25:22.053 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:22.052+0000 7fd63f59d700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fd6380cf520 0x7fd6380cdea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:25:22.053 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:22.052+0000 7fd63f59d700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd6380cf090 con 0x7fd63815d5d0 2023-10-06T01:25:22.053 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:22.052+0000 7fd63f59d700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd6380ce480 con 0x7fd63815d9a0 2023-10-06T01:25:22.054 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:22.052+0000 7fd63f59d700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd6380ce760 con 0x7fd6380cf520 2023-10-06T01:25:22.054 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:22.052+0000 7fd63dd9a700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fd6380cf520 0x7fd6380cdea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:25:22.054 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:22.052+0000 7fd63e59b700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fd63815d5d0 0x7fd6380cc1f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:43666/0 (socket says 172.21.15.50:43666) 2023-10-06T01:25:22.054 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:22.052+0000 7fd63e59b700 1 -- 172.21.15.50:0/1341760897 learned_addr learned my addr 172.21.15.50:0/1341760897 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-10-06T01:25:22.055 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:22.053+0000 7fd63dd9a700 1 -- 172.21.15.50:0/1341760897 >> v1:172.21.15.155:6789/0 conn(0x7fd63815d9a0 legacy=0x7fd6381592a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:25:22.055 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:22.053+0000 7fd63dd9a700 1 -- 172.21.15.50:0/1341760897 >> v1:172.21.15.50:6789/0 conn(0x7fd63815d5d0 legacy=0x7fd6380cc1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:25:22.055 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:22.053+0000 7fd63dd9a700 1 -- 172.21.15.50:0/1341760897 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6380cea40 con 0x7fd6380cf520 2023-10-06T01:25:22.055 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:22.053+0000 7fd63dd9a700 1 --2- 172.21.15.50:0/1341760897 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd6380cf520 0x7fd6380cdea0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7fd6280098e0 tx=0x7fd6280091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e9d0628b38ad5f26 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:25:22.056 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:22.053+0000 7fd63d599700 1 -- 172.21.15.50:0/1341760897 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd628009e80 con 0x7fd6380cf520 2023-10-06T01:25:22.056 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:22.054+0000 7fd63d599700 1 -- 172.21.15.50:0/1341760897 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd62800b820 con 0x7fd6380cf520 2023-10-06T01:25:22.056 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:22.054+0000 7fd63d599700 1 -- 172.21.15.50:0/1341760897 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd62800bba0 con 0x7fd6380cf520 2023-10-06T01:25:22.056 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:22.054+0000 7fd63f59d700 1 -- 172.21.15.50:0/1341760897 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd6380cf520 msgr2=0x7fd6380cdea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:25:22.056 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:22.054+0000 7fd63f59d700 1 --2- 172.21.15.50:0/1341760897 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd6380cf520 0x7fd6380cdea0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7fd6280098e0 tx=0x7fd6280091a0 comp rx=0 tx=0).stop 2023-10-06T01:25:22.056 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:22.054+0000 7fd63f59d700 1 -- 172.21.15.50:0/1341760897 shutdown_connections 2023-10-06T01:25:22.056 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:22.054+0000 7fd63f59d700 1 --2- 172.21.15.50:0/1341760897 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd6380cf520 0x7fd6380cdea0 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:25:22.056 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:22.054+0000 7fd63f59d700 1 -- 172.21.15.50:0/1341760897 >> 172.21.15.50:0/1341760897 conn(0x7fd638099520 msgr2=0x7fd63806f500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:25:22.056 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:22.054+0000 7fd63f59d700 1 -- 172.21.15.50:0/1341760897 shutdown_connections 2023-10-06T01:25:22.056 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:22.054+0000 7fd63f59d700 1 -- 172.21.15.50:0/1341760897 wait complete. 2023-10-06T01:25:22.057 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:22.056+0000 7fd63f59d700 1 Processor -- start 2023-10-06T01:25:22.057 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:22.056+0000 7fd63f59d700 1 -- start start 2023-10-06T01:25:22.058 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:22.057+0000 7fd63f59d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd6380cf520 0x7fd6381580f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:25:22.058 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:22.057+0000 7fd63f59d700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd63815d5d0 0x7fd638152920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:25:22.059 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:22.057+0000 7fd63f59d700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd63815d9a0 0x7fd638152e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:25:22.059 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:22.057+0000 7fd63f59d700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6380c7380 con 0x7fd6380cf520 2023-10-06T01:25:22.059 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:22.057+0000 7fd63f59d700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6380c7660 con 0x7fd63815d5d0 2023-10-06T01:25:22.059 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:22.057+0000 7fd63f59d700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6380c7940 con 0x7fd63815d9a0 2023-10-06T01:25:22.059 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:22.057+0000 7fd63e59b700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd6380cf520 0x7fd6381580f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:25:22.059 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:22.057+0000 7fd63e59b700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd6380cf520 0x7fd6381580f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:56892/0 (socket says 172.21.15.50:56892) 2023-10-06T01:25:22.059 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:22.057+0000 7fd63e59b700 1 -- 172.21.15.50:0/1186059440 learned_addr learned my addr 172.21.15.50:0/1186059440 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-06T01:25:22.059 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:22.057+0000 7fd63dd9a700 1 --2- 172.21.15.50:0/1186059440 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd63815d5d0 0x7fd638152920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:25:22.059 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:22.057+0000 7fd63ed9c700 1 --2- 172.21.15.50:0/1186059440 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd63815d9a0 0x7fd638152e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:25:22.059 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:22.058+0000 7fd63e59b700 1 -- 172.21.15.50:0/1186059440 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd63815d9a0 msgr2=0x7fd638152e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:25:22.059 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:22.058+0000 7fd63e59b700 1 --2- 172.21.15.50:0/1186059440 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd63815d9a0 0x7fd638152e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:25:22.060 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:22.058+0000 7fd63e59b700 1 -- 172.21.15.50:0/1186059440 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd63815d5d0 msgr2=0x7fd638152920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:25:22.060 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:22.058+0000 7fd63e59b700 1 --2- 172.21.15.50:0/1186059440 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd63815d5d0 0x7fd638152920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:25:22.060 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:22.058+0000 7fd63e59b700 1 -- 172.21.15.50:0/1186059440 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd628009420 con 0x7fd6380cf520 2023-10-06T01:25:22.060 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:22.058+0000 7fd63e59b700 1 --2- 172.21.15.50:0/1186059440 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd6380cf520 0x7fd6381580f0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7fd63400c5e0 tx=0x7fd634004a80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:25:22.061 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:22.058+0000 7fd62e7fc700 1 -- 172.21.15.50:0/1186059440 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd634005b30 con 0x7fd6380cf520 2023-10-06T01:25:22.061 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:22.058+0000 7fd62e7fc700 1 -- 172.21.15.50:0/1186059440 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd634005cb0 con 0x7fd6380cf520 2023-10-06T01:25:22.061 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:22.058+0000 7fd63f59d700 1 -- 172.21.15.50:0/1186059440 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd6380c7c20 con 0x7fd6380cf520 2023-10-06T01:25:22.061 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:22.058+0000 7fd62e7fc700 1 -- 172.21.15.50:0/1186059440 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd634007320 con 0x7fd6380cf520 2023-10-06T01:25:22.061 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:22.058+0000 7fd63f59d700 1 -- 172.21.15.50:0/1186059440 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd638158630 con 0x7fd6380cf520 2023-10-06T01:25:22.061 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:22.059+0000 7fd63f59d700 1 -- 172.21.15.50:0/1186059440 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd6380c8140 con 0x7fd6380cf520 2023-10-06T01:25:22.061 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:22.060+0000 7fd62e7fc700 1 -- 172.21.15.50:0/1186059440 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fd634007690 con 0x7fd6380cf520 2023-10-06T01:25:22.062 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:22.061+0000 7fd62e7fc700 1 --2- 172.21.15.50:0/1186059440 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7fd61c066f30 0x7fd61c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:25:22.062 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:22.061+0000 7fd62e7fc700 1 -- 172.21.15.50:0/1186059440 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6436+0+0 (secure 0 0 0) 0x7fd634083f10 con 0x7fd6380cf520 2023-10-06T01:25:22.063 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:22.063+0000 7fd63dd9a700 1 --2- 172.21.15.50:0/1186059440 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7fd61c066f30 0x7fd61c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:25:22.064 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:22.064+0000 7fd63dd9a700 1 --2- 172.21.15.50:0/1186059440 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7fd61c066f30 0x7fd61c0693e0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fd6280030c0 tx=0x7fd628016000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:25:22.066 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:22.065+0000 7fd62e7fc700 1 -- 172.21.15.50:0/1186059440 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd6380c8140 con 0x7fd6380cf520 2023-10-06T01:25:22.268 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:22.267+0000 7fd63f59d700 1 -- 172.21.15.50:0/1186059440 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fd6380883e0 con 0x7fd6380cf520 2023-10-06T01:25:22.268 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:22.268+0000 7fd62e7fc700 1 -- 172.21.15.50:0/1186059440 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v41) v1 ==== 104+0+11 (secure 0 0 0) 0x7fd6340170a0 con 0x7fd6380cf520 2023-10-06T01:25:22.268 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 32 2023-10-06T01:25:22.271 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:22.270+0000 7fd63f59d700 1 -- 172.21.15.50:0/1186059440 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7fd61c066f30 msgr2=0x7fd61c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:25:22.271 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:22.270+0000 7fd63f59d700 1 --2- 172.21.15.50:0/1186059440 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7fd61c066f30 0x7fd61c0693e0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fd6280030c0 tx=0x7fd628016000 comp rx=0 tx=0).stop 2023-10-06T01:25:22.271 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:22.270+0000 7fd63f59d700 1 -- 172.21.15.50:0/1186059440 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd6380cf520 msgr2=0x7fd6381580f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:25:22.271 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:22.270+0000 7fd63f59d700 1 --2- 172.21.15.50:0/1186059440 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd6380cf520 0x7fd6381580f0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7fd63400c5e0 tx=0x7fd634004a80 comp rx=0 tx=0).stop 2023-10-06T01:25:22.272 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:22.270+0000 7fd63f59d700 1 -- 172.21.15.50:0/1186059440 shutdown_connections 2023-10-06T01:25:22.272 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:22.270+0000 7fd63f59d700 1 --2- 172.21.15.50:0/1186059440 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd63815d9a0 0x7fd638152e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:25:22.272 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:22.270+0000 7fd63f59d700 1 --2- 172.21.15.50:0/1186059440 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd6380cf520 0x7fd6381580f0 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:25:22.272 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:22.270+0000 7fd63f59d700 1 --2- 172.21.15.50:0/1186059440 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7fd61c066f30 0x7fd61c0693e0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:25:22.272 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:22.270+0000 7fd63f59d700 1 --2- 172.21.15.50:0/1186059440 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd63815d5d0 0x7fd638152920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:25:22.272 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:22.270+0000 7fd63f59d700 1 -- 172.21.15.50:0/1186059440 >> 172.21.15.50:0/1186059440 conn(0x7fd638099520 msgr2=0x7fd638153740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:25:22.272 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:22.270+0000 7fd63f59d700 1 -- 172.21.15.50:0/1186059440 shutdown_connections 2023-10-06T01:25:22.272 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:22.270+0000 7fd63f59d700 1 -- 172.21.15.50:0/1186059440 wait complete. 2023-10-06T01:25:22.289 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-06T01:25:22.479 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:22.478+0000 7ff44359d700 1 Processor -- start 2023-10-06T01:25:22.479 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:22.478+0000 7ff44359d700 1 -- start start 2023-10-06T01:25:22.481 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:22.480+0000 7ff44359d700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff43c159190 0x7ff43c0af500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:25:22.481 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:22.480+0000 7ff44359d700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7ff43c159560 0x7ff43c068600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:25:22.481 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:22.480+0000 7ff44359d700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff43c0ab340 con 0x7ff43c068b40 2023-10-06T01:25:22.481 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:22.480+0000 7ff44359d700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff43c068fe0 con 0x7ff43c159560 2023-10-06T01:25:22.481 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:22.480+0000 7ff44359d700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff43c0aa730 con 0x7ff43c159190 2023-10-06T01:25:22.481 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:22.480+0000 7ff441d9a700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7ff43c159560 0x7ff43c068600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:25:22.481 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:22.480+0000 7ff441d9a700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7ff43c159560 0x7ff43c068600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:56904/0 (socket says 172.21.15.50:56904) 2023-10-06T01:25:22.481 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:22.480+0000 7ff441d9a700 1 -- 172.21.15.50:0/2938341182 learned_addr learned my addr 172.21.15.50:0/2938341182 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-06T01:25:22.481 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:22.480+0000 7ff44259b700 1 --2- 172.21.15.50:0/2938341182 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff43c159190 0x7ff43c0af500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:25:22.483 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:22.480+0000 7ff441d9a700 1 -- 172.21.15.50:0/2938341182 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff43c159190 msgr2=0x7ff43c0af500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:25:22.483 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:22.480+0000 7ff441d9a700 1 --2- 172.21.15.50:0/2938341182 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff43c159190 0x7ff43c0af500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:25:22.483 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:22.480+0000 7ff441d9a700 1 -- 172.21.15.50:0/2938341182 >> v1:172.21.15.155:6789/0 conn(0x7ff43c068b40 legacy=0x7ff43c0a99c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:25:22.484 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:22.480+0000 7ff441d9a700 1 -- 172.21.15.50:0/2938341182 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff43c0aaa10 con 0x7ff43c159560 2023-10-06T01:25:22.484 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:22.480+0000 7ff441599700 1 -- 172.21.15.50:0/2938341182 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3096016606 0 0) 0x7ff43c0ab340 con 0x7ff43c068b40 2023-10-06T01:25:22.484 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:22.481+0000 7ff441d9a700 1 --2- 172.21.15.50:0/2938341182 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff43c159560 0x7ff43c068600 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7ff42c0099b0 tx=0x7ff42c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=74fa78957c1d1bf3 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:25:22.484 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:22.481+0000 7ff441599700 1 -- 172.21.15.50:0/2938341182 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff42c009ea0 con 0x7ff43c159560 2023-10-06T01:25:22.484 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:22.481+0000 7ff441599700 1 -- 172.21.15.50:0/2938341182 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff42c00b860 con 0x7ff43c159560 2023-10-06T01:25:22.484 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:22.481+0000 7ff441599700 1 -- 172.21.15.50:0/2938341182 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff42c00bc00 con 0x7ff43c159560 2023-10-06T01:25:22.484 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:22.481+0000 7ff44359d700 1 -- 172.21.15.50:0/2938341182 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff43c159560 msgr2=0x7ff43c068600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:25:22.484 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:22.481+0000 7ff44359d700 1 --2- 172.21.15.50:0/2938341182 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff43c159560 0x7ff43c068600 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7ff42c0099b0 tx=0x7ff42c009250 comp rx=0 tx=0).stop 2023-10-06T01:25:22.484 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:22.482+0000 7ff44359d700 1 -- 172.21.15.50:0/2938341182 shutdown_connections 2023-10-06T01:25:22.484 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:22.482+0000 7ff44359d700 1 --2- 172.21.15.50:0/2938341182 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff43c159190 0x7ff43c0af500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:25:22.484 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:22.482+0000 7ff44359d700 1 --2- 172.21.15.50:0/2938341182 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff43c159560 0x7ff43c068600 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:25:22.484 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:22.482+0000 7ff44359d700 1 -- 172.21.15.50:0/2938341182 >> 172.21.15.50:0/2938341182 conn(0x7ff43c06da50 msgr2=0x7ff43c06de50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:25:22.485 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:22.482+0000 7ff44359d700 1 -- 172.21.15.50:0/2938341182 shutdown_connections 2023-10-06T01:25:22.485 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:22.482+0000 7ff44359d700 1 -- 172.21.15.50:0/2938341182 wait complete. 2023-10-06T01:25:22.487 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:22.483+0000 7ff44359d700 1 Processor -- start 2023-10-06T01:25:22.487 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:22.483+0000 7ff44359d700 1 -- start start 2023-10-06T01:25:22.487 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:22.484+0000 7ff44359d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff43c068b40 0x7ff43c14c950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:25:22.487 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:22.484+0000 7ff44359d700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff43c159190 0x7ff43c15a380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:25:22.487 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:22.484+0000 7ff44359d700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff43c159560 0x7ff43c157b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:25:22.488 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:22.484+0000 7ff44359d700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff43c14f950 con 0x7ff43c068b40 2023-10-06T01:25:22.488 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:22.484+0000 7ff44359d700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff43c14fb80 con 0x7ff43c159190 2023-10-06T01:25:22.488 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:22.484+0000 7ff44359d700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff43c14fe60 con 0x7ff43c159560 2023-10-06T01:25:22.488 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:22.484+0000 7ff44259b700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff43c068b40 0x7ff43c14c950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:25:22.488 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:22.484+0000 7ff44259b700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff43c068b40 0x7ff43c14c950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:56908/0 (socket says 172.21.15.50:56908) 2023-10-06T01:25:22.488 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:22.484+0000 7ff44259b700 1 -- 172.21.15.50:0/2217994392 learned_addr learned my addr 172.21.15.50:0/2217994392 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-06T01:25:22.488 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:22.485+0000 7ff441d9a700 1 --2- 172.21.15.50:0/2217994392 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff43c159190 0x7ff43c15a380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:25:22.488 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:22.485+0000 7ff442d9c700 1 --2- 172.21.15.50:0/2217994392 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff43c159560 0x7ff43c157b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:25:22.488 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:22.485+0000 7ff44259b700 1 -- 172.21.15.50:0/2217994392 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff43c159560 msgr2=0x7ff43c157b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:25:22.488 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:22.485+0000 7ff44259b700 1 --2- 172.21.15.50:0/2217994392 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff43c159560 0x7ff43c157b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:25:22.488 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:22.485+0000 7ff44259b700 1 -- 172.21.15.50:0/2217994392 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff43c159190 msgr2=0x7ff43c15a380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:25:22.488 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:22.485+0000 7ff44259b700 1 --2- 172.21.15.50:0/2217994392 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff43c159190 0x7ff43c15a380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:25:22.489 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:22.485+0000 7ff44259b700 1 -- 172.21.15.50:0/2217994392 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff42c0094f0 con 0x7ff43c068b40 2023-10-06T01:25:22.489 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:22.485+0000 7ff441d9a700 1 --2- 172.21.15.50:0/2217994392 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff43c159190 0x7ff43c15a380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T01:25:22.489 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:22.485+0000 7ff442d9c700 1 --2- 172.21.15.50:0/2217994392 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff43c159560 0x7ff43c157b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T01:25:22.489 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:22.485+0000 7ff44259b700 1 --2- 172.21.15.50:0/2217994392 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff43c068b40 0x7ff43c14c950 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7ff43800ec80 tx=0x7ff438009120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:25:22.489 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:22.485+0000 7ff4327fc700 1 -- 172.21.15.50:0/2217994392 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff43800c9d0 con 0x7ff43c068b40 2023-10-06T01:25:22.489 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:22.485+0000 7ff4327fc700 1 -- 172.21.15.50:0/2217994392 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff43800cb30 con 0x7ff43c068b40 2023-10-06T01:25:22.489 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:22.485+0000 7ff4327fc700 1 -- 172.21.15.50:0/2217994392 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff438013470 con 0x7ff43c068b40 2023-10-06T01:25:22.489 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:22.485+0000 7ff44359d700 1 -- 172.21.15.50:0/2217994392 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff43c150140 con 0x7ff43c068b40 2023-10-06T01:25:22.489 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:22.485+0000 7ff44359d700 1 -- 172.21.15.50:0/2217994392 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff43c150700 con 0x7ff43c068b40 2023-10-06T01:25:22.489 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:22.486+0000 7ff44359d700 1 -- 172.21.15.50:0/2217994392 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff43c05f270 con 0x7ff43c068b40 2023-10-06T01:25:22.490 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:22.487+0000 7ff4327fc700 1 -- 172.21.15.50:0/2217994392 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7ff438013860 con 0x7ff43c068b40 2023-10-06T01:25:22.490 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:22.488+0000 7ff4327fc700 1 --2- 172.21.15.50:0/2217994392 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7ff420066f30 0x7ff4200693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:25:22.490 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:22.488+0000 7ff4327fc700 1 -- 172.21.15.50:0/2217994392 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6436+0+0 (secure 0 0 0) 0x7ff438084ff0 con 0x7ff43c068b40 2023-10-06T01:25:22.490 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:22.489+0000 7ff441d9a700 1 --2- 172.21.15.50:0/2217994392 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7ff420066f30 0x7ff4200693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:25:22.491 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:22.489+0000 7ff441d9a700 1 --2- 172.21.15.50:0/2217994392 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7ff420066f30 0x7ff4200693e0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7ff42c0099b0 tx=0x7ff42c017000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:25:22.493 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:22.492+0000 7ff4327fc700 1 -- 172.21.15.50:0/2217994392 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff438051ee0 con 0x7ff43c068b40 2023-10-06T01:25:22.696 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:22.695+0000 7ff44359d700 1 -- 172.21.15.50:0/2217994392 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7ff43c15ad10 con 0x7ff43c068b40 2023-10-06T01:25:22.697 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:22.696+0000 7ff4327fc700 1 -- 172.21.15.50:0/2217994392 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v41) v1 ==== 100+0+11 (secure 0 0 0) 0x7ff4380170a0 con 0x7ff43c068b40 2023-10-06T01:25:22.697 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 64 2023-10-06T01:25:22.699 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:22.698+0000 7ff44359d700 1 -- 172.21.15.50:0/2217994392 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7ff420066f30 msgr2=0x7ff4200693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:25:22.699 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:22.698+0000 7ff44359d700 1 --2- 172.21.15.50:0/2217994392 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7ff420066f30 0x7ff4200693e0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7ff42c0099b0 tx=0x7ff42c017000 comp rx=0 tx=0).stop 2023-10-06T01:25:22.699 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:22.698+0000 7ff44359d700 1 -- 172.21.15.50:0/2217994392 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff43c068b40 msgr2=0x7ff43c14c950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:25:22.699 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:22.698+0000 7ff44359d700 1 --2- 172.21.15.50:0/2217994392 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff43c068b40 0x7ff43c14c950 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7ff43800ec80 tx=0x7ff438009120 comp rx=0 tx=0).stop 2023-10-06T01:25:22.700 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:22.698+0000 7ff44359d700 1 -- 172.21.15.50:0/2217994392 shutdown_connections 2023-10-06T01:25:22.700 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:22.698+0000 7ff44359d700 1 --2- 172.21.15.50:0/2217994392 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff43c159560 0x7ff43c157b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:25:22.700 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:22.698+0000 7ff44359d700 1 --2- 172.21.15.50:0/2217994392 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff43c068b40 0x7ff43c14c950 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:25:22.700 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:22.698+0000 7ff44359d700 1 --2- 172.21.15.50:0/2217994392 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7ff420066f30 0x7ff4200693e0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:25:22.700 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:22.698+0000 7ff44359d700 1 --2- 172.21.15.50:0/2217994392 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff43c159190 0x7ff43c15a380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:25:22.700 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:22.698+0000 7ff44359d700 1 -- 172.21.15.50:0/2217994392 >> 172.21.15.50:0/2217994392 conn(0x7ff43c06da50 msgr2=0x7ff43c068350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:25:22.700 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:22.698+0000 7ff44359d700 1 -- 172.21.15.50:0/2217994392 shutdown_connections 2023-10-06T01:25:22.700 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:22.698+0000 7ff44359d700 1 -- 172.21.15.50:0/2217994392 wait complete. 2023-10-06T01:25:22.716 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T01:25:22.906 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:22.905+0000 7f984b39d700 1 Processor -- start 2023-10-06T01:25:22.906 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:22.905+0000 7f984b39d700 1 -- start start 2023-10-06T01:25:22.909 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:22.906+0000 7f984b39d700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f98441571e0 0x7f984406a3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:25:22.910 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:22.906+0000 7f984b39d700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f984406f210 0x7f98440afda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:25:22.910 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:22.906+0000 7f984b39d700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f98440aea10 con 0x7f98440c99d0 2023-10-06T01:25:22.910 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:22.906+0000 7f984b39d700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f984406abf0 con 0x7f98441571e0 2023-10-06T01:25:22.910 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:22.906+0000 7f984b39d700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f984406aed0 con 0x7f984406f210 2023-10-06T01:25:22.910 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:22.906+0000 7f984a39b700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f98441571e0 0x7f984406a3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:25:22.910 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:22.906+0000 7f984a39b700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f98441571e0 0x7f984406a3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:56912/0 (socket says 172.21.15.50:56912) 2023-10-06T01:25:22.911 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:22.906+0000 7f984a39b700 1 -- 172.21.15.50:0/2825026125 learned_addr learned my addr 172.21.15.50:0/2825026125 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-06T01:25:22.911 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:22.907+0000 7f9849b9a700 1 --2- 172.21.15.50:0/2825026125 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f984406f210 0x7f98440afda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:25:22.911 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:22.907+0000 7f984a39b700 1 -- 172.21.15.50:0/2825026125 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f984406f210 msgr2=0x7f98440afda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:25:22.911 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:22.907+0000 7f984a39b700 1 --2- 172.21.15.50:0/2825026125 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f984406f210 0x7f98440afda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:25:22.911 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:22.907+0000 7f984a39b700 1 -- 172.21.15.50:0/2825026125 >> v1:172.21.15.155:6789/0 conn(0x7f98440c99d0 legacy=0x7f98440aeea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:25:22.911 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:22.907+0000 7f984a39b700 1 -- 172.21.15.50:0/2825026125 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f984406b1b0 con 0x7f98441571e0 2023-10-06T01:25:22.911 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:22.907+0000 7f984a39b700 1 --2- 172.21.15.50:0/2825026125 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f98441571e0 0x7f984406a3a0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f9840009990 tx=0x7f9840009220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c2b5ca8ccf35ca53 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:25:22.912 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:22.907+0000 7f9849399700 1 -- 172.21.15.50:0/2825026125 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9840005c10 con 0x7f98441571e0 2023-10-06T01:25:22.912 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:22.907+0000 7f9849399700 1 -- 172.21.15.50:0/2825026125 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9840005d70 con 0x7f98441571e0 2023-10-06T01:25:22.912 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:22.907+0000 7f9849399700 1 -- 172.21.15.50:0/2825026125 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f984000b880 con 0x7f98441571e0 2023-10-06T01:25:22.912 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:22.908+0000 7f984b39d700 1 -- 172.21.15.50:0/2825026125 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f98441571e0 msgr2=0x7f984406a3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:25:22.912 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:22.908+0000 7f984b39d700 1 --2- 172.21.15.50:0/2825026125 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f98441571e0 0x7f984406a3a0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f9840009990 tx=0x7f9840009220 comp rx=0 tx=0).stop 2023-10-06T01:25:22.912 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:22.908+0000 7f984b39d700 1 -- 172.21.15.50:0/2825026125 shutdown_connections 2023-10-06T01:25:22.912 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:22.908+0000 7f984b39d700 1 --2- 172.21.15.50:0/2825026125 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f98441571e0 0x7f984406a3a0 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:25:22.912 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:22.908+0000 7f984b39d700 1 --2- 172.21.15.50:0/2825026125 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f984406f210 0x7f98440afda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:25:22.912 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:22.908+0000 7f984b39d700 1 -- 172.21.15.50:0/2825026125 >> 172.21.15.50:0/2825026125 conn(0x7f9844068700 msgr2=0x7f9844068b00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:25:22.912 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:22.908+0000 7f984b39d700 1 -- 172.21.15.50:0/2825026125 shutdown_connections 2023-10-06T01:25:22.913 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:22.908+0000 7f984b39d700 1 -- 172.21.15.50:0/2825026125 wait complete. 2023-10-06T01:25:22.915 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:22.910+0000 7f984b39d700 1 Processor -- start 2023-10-06T01:25:22.915 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:22.910+0000 7f984b39d700 1 -- start start 2023-10-06T01:25:22.915 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:22.911+0000 7f984b39d700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f984406f210 0x7f9844146390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:25:22.915 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:22.911+0000 7f984b39d700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f98440c99d0 0x7f984415e240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:25:22.915 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:22.911+0000 7f984b39d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f98441571e0 0x7f98441531d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:25:22.915 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:22.911+0000 7f984b39d700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98440b0300 con 0x7f98441571e0 2023-10-06T01:25:22.915 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:22.911+0000 7f984b39d700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f984415be40 con 0x7f984406f210 2023-10-06T01:25:22.916 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:22.911+0000 7f984b39d700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f98440afd80 con 0x7f98440c99d0 2023-10-06T01:25:22.916 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:22.911+0000 7f984ab9c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f98441571e0 0x7f98441531d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:25:22.916 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:22.911+0000 7f984ab9c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f98441571e0 0x7f98441531d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:56920/0 (socket says 172.21.15.50:56920) 2023-10-06T01:25:22.916 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:22.911+0000 7f984ab9c700 1 -- 172.21.15.50:0/1790911149 learned_addr learned my addr 172.21.15.50:0/1790911149 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-06T01:25:22.916 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:22.911+0000 7f9849b9a700 1 --2- 172.21.15.50:0/1790911149 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f98440c99d0 0x7f984415e240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:25:22.916 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:22.911+0000 7f984a39b700 1 --2- 172.21.15.50:0/1790911149 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f984406f210 0x7f9844146390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:25:22.916 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:22.911+0000 7f984ab9c700 1 -- 172.21.15.50:0/1790911149 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f98440c99d0 msgr2=0x7f984415e240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:25:22.916 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:22.911+0000 7f984ab9c700 1 --2- 172.21.15.50:0/1790911149 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f98440c99d0 0x7f984415e240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:25:22.916 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:22.911+0000 7f984ab9c700 1 -- 172.21.15.50:0/1790911149 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f984406f210 msgr2=0x7f9844146390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:25:22.916 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:22.911+0000 7f984ab9c700 1 --2- 172.21.15.50:0/1790911149 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f984406f210 0x7f9844146390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:25:22.916 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:22.911+0000 7f984ab9c700 1 -- 172.21.15.50:0/1790911149 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9840009480 con 0x7f98441571e0 2023-10-06T01:25:22.916 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:22.912+0000 7f984ab9c700 1 --2- 172.21.15.50:0/1790911149 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f98441571e0 0x7f98441531d0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f983c00c840 tx=0x7f983c001670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:25:22.917 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:22.912+0000 7f983a7fc700 1 -- 172.21.15.50:0/1790911149 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f983c012630 con 0x7f98441571e0 2023-10-06T01:25:22.917 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:22.912+0000 7f983a7fc700 1 -- 172.21.15.50:0/1790911149 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f983c0127b0 con 0x7f98441571e0 2023-10-06T01:25:22.917 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:22.912+0000 7f983a7fc700 1 -- 172.21.15.50:0/1790911149 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f983c012b70 con 0x7f98441571e0 2023-10-06T01:25:22.917 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:22.912+0000 7f984b39d700 1 -- 172.21.15.50:0/1790911149 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f98441468d0 con 0x7f98441571e0 2023-10-06T01:25:22.917 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:22.912+0000 7f984b39d700 1 -- 172.21.15.50:0/1790911149 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f98440b2700 con 0x7f98441571e0 2023-10-06T01:25:22.917 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:22.913+0000 7f984b39d700 1 -- 172.21.15.50:0/1790911149 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f98440b2560 con 0x7f98441571e0 2023-10-06T01:25:22.917 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:22.914+0000 7f983a7fc700 1 -- 172.21.15.50:0/1790911149 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f983c003030 con 0x7f98441571e0 2023-10-06T01:25:22.918 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:22.915+0000 7f983a7fc700 1 --2- 172.21.15.50:0/1790911149 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f9828066f30 0x7f98280693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:25:22.918 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:22.915+0000 7f983a7fc700 1 -- 172.21.15.50:0/1790911149 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6436+0+0 (secure 0 0 0) 0x7f983c084780 con 0x7f98441571e0 2023-10-06T01:25:22.918 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:22.915+0000 7f984a39b700 1 --2- 172.21.15.50:0/1790911149 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f9828066f30 0x7f98280693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:25:22.918 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:22.916+0000 7f984a39b700 1 --2- 172.21.15.50:0/1790911149 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f9828066f30 0x7f98280693e0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f984416c9a0 tx=0x7f9840016000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:25:22.920 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:22.919+0000 7f983a7fc700 1 -- 172.21.15.50:0/1790911149 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f98440b2560 con 0x7f98441571e0 2023-10-06T01:25:23.169 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:23.168+0000 7f984b39d700 1 -- 172.21.15.50:0/1790911149 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f98440b2560 con 0x7f98441571e0 2023-10-06T01:25:23.170 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:23.169+0000 7f983a7fc700 1 -- 172.21.15.50:0/1790911149 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) v1 ==== 94+0+4603 (secure 0 0 0) 0x7f98440b2560 con 0x7f98441571e0 2023-10-06T01:25:23.170 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-10-06T01:25:23.170 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":18,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4769,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6833/3835292201","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6832","nonce":3835292201},{"type":"v1","addr":"172.21.15.50:6833","nonce":3835292201}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":13},{"gid":4772,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6837/2073318681","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6835","nonce":2073318681},{"type":"v1","addr":"172.21.15.155:6837","nonce":2073318681}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":13},{"gid":4993,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6836/2652534948","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":2652534948},{"type":"v1","addr":"172.21.15.155:6836","nonce":2652534948}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":18,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T01:22:56.416443+0000","modified":"2023-10-06T01:22:59.935058+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5160},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5160":{"gid":5160,"name":"c","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.50:6835/3957156573","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6834","nonce":3957156573},{"type":"v1","addr":"172.21.15.50:6835","nonce":3957156573}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2}]} 2023-10-06T01:25:23.172 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:23.171+0000 7f984b39d700 1 -- 172.21.15.50:0/1790911149 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f9828066f30 msgr2=0x7f98280693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:25:23.172 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:23.171+0000 7f984b39d700 1 --2- 172.21.15.50:0/1790911149 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f9828066f30 0x7f98280693e0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f984416c9a0 tx=0x7f9840016000 comp rx=0 tx=0).stop 2023-10-06T01:25:23.172 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:23.171+0000 7f984b39d700 1 -- 172.21.15.50:0/1790911149 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f98441571e0 msgr2=0x7f98441531d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:25:23.173 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:23.171+0000 7f984b39d700 1 --2- 172.21.15.50:0/1790911149 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f98441571e0 0x7f98441531d0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f983c00c840 tx=0x7f983c001670 comp rx=0 tx=0).stop 2023-10-06T01:25:23.173 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:23.171+0000 7f984b39d700 1 -- 172.21.15.50:0/1790911149 shutdown_connections 2023-10-06T01:25:23.173 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:23.171+0000 7f984b39d700 1 --2- 172.21.15.50:0/1790911149 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f98441571e0 0x7f98441531d0 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:25:23.173 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:23.171+0000 7f984b39d700 1 --2- 172.21.15.50:0/1790911149 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f9828066f30 0x7f98280693e0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:25:23.173 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:23.171+0000 7f984b39d700 1 --2- 172.21.15.50:0/1790911149 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f984406f210 0x7f9844146390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:25:23.173 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:23.171+0000 7f984b39d700 1 --2- 172.21.15.50:0/1790911149 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f98440c99d0 0x7f984415e240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:25:23.173 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:23.171+0000 7f984b39d700 1 -- 172.21.15.50:0/1790911149 >> 172.21.15.50:0/1790911149 conn(0x7f9844068700 msgr2=0x7f98440c8f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:25:23.173 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:23.171+0000 7f984b39d700 1 -- 172.21.15.50:0/1790911149 shutdown_connections 2023-10-06T01:25:23.173 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:23.171+0000 7f984b39d700 1 -- 172.21.15.50:0/1790911149 wait complete. 2023-10-06T01:25:23.174 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 18 2023-10-06T01:25:23.190 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T01:25:23.377 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:23.377+0000 7fc04d79d700 1 Processor -- start 2023-10-06T01:25:23.378 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:23.377+0000 7fc04d79d700 1 -- start start 2023-10-06T01:25:23.379 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:23.378+0000 7fc04d79d700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fc0481592d0 0x7fc0480ce320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:25:23.379 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:23.378+0000 7fc04d79d700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc0480cb310 con 0x7fc0481596a0 2023-10-06T01:25:23.379 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:23.378+0000 7fc04d79d700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc0480cb5f0 con 0x7fc0480af5a0 2023-10-06T01:25:23.379 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:23.378+0000 7fc04d79d700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc0480cb8d0 con 0x7fc0481592d0 2023-10-06T01:25:23.380 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:23.378+0000 7fc047fff700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fc0481592d0 0x7fc0480ce320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:25:23.380 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:23.378+0000 7fc0477fe700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fc0481596a0 0x7fc0480aee90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:43676/0 (socket says 172.21.15.50:43676) 2023-10-06T01:25:23.380 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:23.378+0000 7fc0477fe700 1 -- 172.21.15.50:0/1839947586 learned_addr learned my addr 172.21.15.50:0/1839947586 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-10-06T01:25:23.381 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:23.379+0000 7fc047fff700 1 -- 172.21.15.50:0/1839947586 >> v1:172.21.15.155:6789/0 conn(0x7fc0480af5a0 legacy=0x7fc04815d3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:25:23.381 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:23.379+0000 7fc047fff700 1 -- 172.21.15.50:0/1839947586 >> v1:172.21.15.50:6789/0 conn(0x7fc0481596a0 legacy=0x7fc0480aee90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:25:23.381 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:23.379+0000 7fc047fff700 1 -- 172.21.15.50:0/1839947586 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0480caea0 con 0x7fc0481592d0 2023-10-06T01:25:23.381 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:23.379+0000 7fc046ffd700 1 -- 172.21.15.50:0/1839947586 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 584875855 0 0) 0x7fc0480cb310 con 0x7fc0481596a0 2023-10-06T01:25:23.381 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:23.379+0000 7fc047fff700 1 --2- 172.21.15.50:0/1839947586 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc0481592d0 0x7fc0480ce320 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7fc0380098e0 tx=0x7fc0380091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2859cd8e1e25c1bc server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:25:23.381 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:23.379+0000 7fc046ffd700 1 -- 172.21.15.50:0/1839947586 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc038009e80 con 0x7fc0481592d0 2023-10-06T01:25:23.382 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:23.379+0000 7fc046ffd700 1 -- 172.21.15.50:0/1839947586 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc03800b820 con 0x7fc0481592d0 2023-10-06T01:25:23.382 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:23.379+0000 7fc046ffd700 1 -- 172.21.15.50:0/1839947586 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc03800bba0 con 0x7fc0481592d0 2023-10-06T01:25:23.382 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:23.380+0000 7fc04d79d700 1 -- 172.21.15.50:0/1839947586 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc0481592d0 msgr2=0x7fc0480ce320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:25:23.382 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:23.380+0000 7fc04d79d700 1 --2- 172.21.15.50:0/1839947586 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc0481592d0 0x7fc0480ce320 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7fc0380098e0 tx=0x7fc0380091a0 comp rx=0 tx=0).stop 2023-10-06T01:25:23.382 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:23.380+0000 7fc04d79d700 1 -- 172.21.15.50:0/1839947586 shutdown_connections 2023-10-06T01:25:23.382 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:23.380+0000 7fc04d79d700 1 --2- 172.21.15.50:0/1839947586 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc0481592d0 0x7fc0480ce320 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:25:23.382 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:23.380+0000 7fc04d79d700 1 -- 172.21.15.50:0/1839947586 >> 172.21.15.50:0/1839947586 conn(0x7fc048068130 msgr2=0x7fc048068530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:25:23.382 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:23.380+0000 7fc04d79d700 1 -- 172.21.15.50:0/1839947586 shutdown_connections 2023-10-06T01:25:23.382 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:23.380+0000 7fc04d79d700 1 -- 172.21.15.50:0/1839947586 wait complete. 2023-10-06T01:25:23.383 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:23.381+0000 7fc04d79d700 1 Processor -- start 2023-10-06T01:25:23.383 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:23.382+0000 7fc04d79d700 1 -- start start 2023-10-06T01:25:23.384 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:23.382+0000 7fc04d79d700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc0480af5a0 0x7fc04815aff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:25:23.385 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:23.382+0000 7fc04d79d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc0481592d0 0x7fc048150f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:25:23.385 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:23.382+0000 7fc04d79d700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc0481596a0 0x7fc04815b7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:25:23.385 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:23.383+0000 7fc04d79d700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc04815b530 con 0x7fc0481592d0 2023-10-06T01:25:23.385 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:23.383+0000 7fc04d79d700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0480c6d50 con 0x7fc0481596a0 2023-10-06T01:25:23.385 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:23.383+0000 7fc04d79d700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc0480c6140 con 0x7fc0480af5a0 2023-10-06T01:25:23.385 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:23.383+0000 7fc0477fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc0481592d0 0x7fc048150f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:25:23.385 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:23.383+0000 7fc0477fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc0481592d0 0x7fc048150f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:56944/0 (socket says 172.21.15.50:56944) 2023-10-06T01:25:23.385 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:23.383+0000 7fc0477fe700 1 -- 172.21.15.50:0/1670974070 learned_addr learned my addr 172.21.15.50:0/1670974070 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-06T01:25:23.385 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:23.383+0000 7fc0477fe700 1 -- 172.21.15.50:0/1670974070 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc0480af5a0 msgr2=0x7fc04815aff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:25:23.385 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:23.383+0000 7fc0477fe700 1 --2- 172.21.15.50:0/1670974070 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc0480af5a0 0x7fc04815aff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:25:23.385 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:23.383+0000 7fc0477fe700 1 -- 172.21.15.50:0/1670974070 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc0481596a0 msgr2=0x7fc04815b7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:25:23.386 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:23.383+0000 7fc0477fe700 1 --2- 172.21.15.50:0/1670974070 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc0481596a0 0x7fc04815b7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:25:23.386 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:23.383+0000 7fc0477fe700 1 -- 172.21.15.50:0/1670974070 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc038009420 con 0x7fc0481592d0 2023-10-06T01:25:23.386 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:23.383+0000 7fc0477fe700 1 --2- 172.21.15.50:0/1670974070 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc0481592d0 0x7fc048150f20 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7fc03c00c610 tx=0x7fc03c000fe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:25:23.386 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:23.384+0000 7fc02ffff700 1 -- 172.21.15.50:0/1670974070 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc03c005b30 con 0x7fc0481592d0 2023-10-06T01:25:23.386 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:23.384+0000 7fc02ffff700 1 -- 172.21.15.50:0/1670974070 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc03c005c90 con 0x7fc0481592d0 2023-10-06T01:25:23.386 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:23.384+0000 7fc04d79d700 1 -- 172.21.15.50:0/1670974070 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc0480c6420 con 0x7fc0481592d0 2023-10-06T01:25:23.386 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:23.384+0000 7fc02ffff700 1 -- 172.21.15.50:0/1670974070 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc03c007300 con 0x7fc0481592d0 2023-10-06T01:25:23.386 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:23.384+0000 7fc04d79d700 1 -- 172.21.15.50:0/1670974070 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc0480c69e0 con 0x7fc0481592d0 2023-10-06T01:25:23.387 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:23.385+0000 7fc04d79d700 1 -- 172.21.15.50:0/1670974070 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc0480c70e0 con 0x7fc0481592d0 2023-10-06T01:25:23.387 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:23.386+0000 7fc02ffff700 1 -- 172.21.15.50:0/1670974070 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fc03c01b3b0 con 0x7fc0481592d0 2023-10-06T01:25:23.387 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:23.387+0000 7fc02ffff700 1 --2- 172.21.15.50:0/1670974070 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7fc034066f30 0x7fc0340693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:25:23.387 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:23.387+0000 7fc02ffff700 1 -- 172.21.15.50:0/1670974070 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6436+0+0 (secure 0 0 0) 0x7fc03c083d70 con 0x7fc0481592d0 2023-10-06T01:25:23.388 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:23.387+0000 7fc047fff700 1 --2- 172.21.15.50:0/1670974070 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7fc034066f30 0x7fc0340693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:25:23.388 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:23.388+0000 7fc047fff700 1 --2- 172.21.15.50:0/1670974070 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7fc034066f30 0x7fc0340693e0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fc0380098e0 tx=0x7fc038016000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:25:23.391 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:23.391+0000 7fc02ffff700 1 -- 172.21.15.50:0/1670974070 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fc03c050d00 con 0x7fc0481592d0 2023-10-06T01:25:23.594 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:23.593+0000 7fc04d79d700 1 -- 172.21.15.50:0/1670974070 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc04805f270 con 0x7fc0481592d0 2023-10-06T01:25:23.595 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:23.594+0000 7fc02ffff700 1 -- 172.21.15.50:0/1670974070 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v41) v1 ==== 74+0+17167 (secure 0 0 0) 0x7fc03c017020 con 0x7fc0481592d0 2023-10-06T01:25:23.595 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-10-06T01:25:23.596 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":41,"fsid":"0bfd9a6b-1587-4fe4-a89e-e43c00286b4e","created":"2023-10-06T01:21:16.828801+0000","modified":"2023-10-06T01:23:25.862497+0000","last_up_change":"2023-10-06T01:21:28.584523+0000","last_in_change":"2023-10-06T01:21:20.179863+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-10-06T01:21:29.304225+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":".mgr","create_time":"2023-10-06T01:21:29.835490+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2023-10-06T01:22:54.641549+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":7,"pool_name":"cephfs_data","create_time":"2023-10-06T01:22:55.389647+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"39","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"9060727a-3959-4de3-8363-c5c5d7826c9a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":87837},{"type":"v1","addr":"172.21.15.50:6801","nonce":87837}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":87837},{"type":"v1","addr":"172.21.15.50:6803","nonce":87837}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":87837},{"type":"v1","addr":"172.21.15.50:6807","nonce":87837}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":87837},{"type":"v1","addr":"172.21.15.50:6805","nonce":87837}]},"public_addr":"172.21.15.50:6801/87837","cluster_addr":"172.21.15.50:6803/87837","heartbeat_back_addr":"172.21.15.50:6807/87837","heartbeat_front_addr":"172.21.15.50:6805/87837","state":["exists","up"]},{"osd":1,"uuid":"5ad9ef12-b579-47ea-b690-90ba887e2cef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":87853},{"type":"v1","addr":"172.21.15.50:6809","nonce":87853}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":87853},{"type":"v1","addr":"172.21.15.50:6811","nonce":87853}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":87853},{"type":"v1","addr":"172.21.15.50:6815","nonce":87853}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":87853},{"type":"v1","addr":"172.21.15.50:6813","nonce":87853}]},"public_addr":"172.21.15.50:6809/87853","cluster_addr":"172.21.15.50:6811/87853","heartbeat_back_addr":"172.21.15.50:6815/87853","heartbeat_front_addr":"172.21.15.50:6813/87853","state":["exists","up"]},{"osd":2,"uuid":"c7aee044-6f75-436f-90e1-ba42a57359bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6821","nonce":87855},{"type":"v1","addr":"172.21.15.50:6822","nonce":87855}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6824","nonce":87855},{"type":"v1","addr":"172.21.15.50:6826","nonce":87855}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":87855},{"type":"v1","addr":"172.21.15.50:6831","nonce":87855}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":87855},{"type":"v1","addr":"172.21.15.50:6829","nonce":87855}]},"public_addr":"172.21.15.50:6822/87855","cluster_addr":"172.21.15.50:6826/87855","heartbeat_back_addr":"172.21.15.50:6831/87855","heartbeat_front_addr":"172.21.15.50:6829/87855","state":["exists","up"]},{"osd":3,"uuid":"d9b901c8-e8b2-44af-9508-f453120a96c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":87856},{"type":"v1","addr":"172.21.15.50:6817","nonce":87856}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":87856},{"type":"v1","addr":"172.21.15.50:6819","nonce":87856}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6825","nonce":87856},{"type":"v1","addr":"172.21.15.50:6827","nonce":87856}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6820","nonce":87856},{"type":"v1","addr":"172.21.15.50:6823","nonce":87856}]},"public_addr":"172.21.15.50:6817/87856","cluster_addr":"172.21.15.50:6819/87856","heartbeat_back_addr":"172.21.15.50:6827/87856","heartbeat_front_addr":"172.21.15.50:6823/87856","state":["exists","up"]},{"osd":4,"uuid":"2b3c6b38-e3e9-4301-9445-60fd3fe8ce03","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":85805},{"type":"v1","addr":"172.21.15.155:6801","nonce":85805}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":85805},{"type":"v1","addr":"172.21.15.155:6803","nonce":85805}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6806","nonce":85805},{"type":"v1","addr":"172.21.15.155:6807","nonce":85805}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6804","nonce":85805},{"type":"v1","addr":"172.21.15.155:6805","nonce":85805}]},"public_addr":"172.21.15.155:6801/85805","cluster_addr":"172.21.15.155:6803/85805","heartbeat_back_addr":"172.21.15.155:6807/85805","heartbeat_front_addr":"172.21.15.155:6805/85805","state":["exists","up"]},{"osd":5,"uuid":"417b5f8f-65f1-4c94-91a7-a6ce03fe1679","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6816","nonce":85807},{"type":"v1","addr":"172.21.15.155:6818","nonce":85807}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6820","nonce":85807},{"type":"v1","addr":"172.21.15.155:6822","nonce":85807}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6828","nonce":85807},{"type":"v1","addr":"172.21.15.155:6830","nonce":85807}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6824","nonce":85807},{"type":"v1","addr":"172.21.15.155:6826","nonce":85807}]},"public_addr":"172.21.15.155:6818/85807","cluster_addr":"172.21.15.155:6822/85807","heartbeat_back_addr":"172.21.15.155:6830/85807","heartbeat_front_addr":"172.21.15.155:6826/85807","state":["exists","up"]},{"osd":6,"uuid":"c150cff3-aee4-4714-9c08-d182b1ba9ffd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6808","nonce":85806},{"type":"v1","addr":"172.21.15.155:6809","nonce":85806}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6810","nonce":85806},{"type":"v1","addr":"172.21.15.155:6811","nonce":85806}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6814","nonce":85806},{"type":"v1","addr":"172.21.15.155:6815","nonce":85806}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6812","nonce":85806},{"type":"v1","addr":"172.21.15.155:6813","nonce":85806}]},"public_addr":"172.21.15.155:6809/85806","cluster_addr":"172.21.15.155:6811/85806","heartbeat_back_addr":"172.21.15.155:6815/85806","heartbeat_front_addr":"172.21.15.155:6813/85806","state":["exists","up"]},{"osd":7,"uuid":"71107f0e-04d1-4e72-a0ec-0faf6af003e7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6817","nonce":85832},{"type":"v1","addr":"172.21.15.155:6819","nonce":85832}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6821","nonce":85832},{"type":"v1","addr":"172.21.15.155:6823","nonce":85832}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6829","nonce":85832},{"type":"v1","addr":"172.21.15.155:6831","nonce":85832}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6825","nonce":85832},{"type":"v1","addr":"172.21.15.155:6827","nonce":85832}]},"public_addr":"172.21.15.155:6819/85832","cluster_addr":"172.21.15.155:6823/85832","heartbeat_back_addr":"172.21.15.155:6831/85832","heartbeat_front_addr":"172.21.15.155:6827/85832","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:21:25.423389+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:21:25.472661+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:21:25.817562+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:21:25.551257+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:21:25.407818+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:21:25.557976+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:21:25.747299+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:21:25.827576+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"7.36","mappings":[{"from":0,"to":5}]},{"pgid":"7.3b","mappings":[{"from":0,"to":4}]}],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T01:25:23.598 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:23.596+0000 7fc04d79d700 1 -- 172.21.15.50:0/1670974070 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7fc034066f30 msgr2=0x7fc0340693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:25:23.598 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:23.596+0000 7fc04d79d700 1 --2- 172.21.15.50:0/1670974070 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7fc034066f30 0x7fc0340693e0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fc0380098e0 tx=0x7fc038016000 comp rx=0 tx=0).stop 2023-10-06T01:25:23.598 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:23.596+0000 7fc04d79d700 1 -- 172.21.15.50:0/1670974070 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc0481592d0 msgr2=0x7fc048150f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:25:23.598 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:23.596+0000 7fc04d79d700 1 --2- 172.21.15.50:0/1670974070 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc0481592d0 0x7fc048150f20 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7fc03c00c610 tx=0x7fc03c000fe0 comp rx=0 tx=0).stop 2023-10-06T01:25:23.598 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:23.596+0000 7fc04d79d700 1 -- 172.21.15.50:0/1670974070 shutdown_connections 2023-10-06T01:25:23.598 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:23.596+0000 7fc04d79d700 1 --2- 172.21.15.50:0/1670974070 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7fc034066f30 0x7fc0340693e0 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:25:23.598 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:23.596+0000 7fc04d79d700 1 --2- 172.21.15.50:0/1670974070 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc0481596a0 0x7fc04815b7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:25:23.598 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:23.596+0000 7fc04d79d700 1 --2- 172.21.15.50:0/1670974070 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc0480af5a0 0x7fc04815aff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:25:23.599 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:23.596+0000 7fc04d79d700 1 --2- 172.21.15.50:0/1670974070 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc0481592d0 0x7fc048150f20 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:25:23.599 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:23.596+0000 7fc04d79d700 1 -- 172.21.15.50:0/1670974070 >> 172.21.15.50:0/1670974070 conn(0x7fc048068130 msgr2=0x7fc0480cfb00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:25:23.599 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:23.597+0000 7fc04d79d700 1 -- 172.21.15.50:0/1670974070 shutdown_connections 2023-10-06T01:25:23.599 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:23.597+0000 7fc04d79d700 1 -- 172.21.15.50:0/1670974070 wait complete. 2023-10-06T01:25:23.615 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-10-06T01:25:23.616 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T01:25:23.803 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:23.802+0000 7f897e79d700 1 Processor -- start 2023-10-06T01:25:23.803 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:23.802+0000 7f897e79d700 1 -- start start 2023-10-06T01:25:23.804 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:23.803+0000 7f897e79d700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f8978158df0 0x7f897806d750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:25:23.804 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:23.804+0000 7f897e79d700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f89780c15d0 0x7f89780c1a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:25:23.805 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:23.804+0000 7f897e79d700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f89780c7a00 con 0x7f89781591c0 2023-10-06T01:25:23.805 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:23.804+0000 7f897e79d700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f89780c1f90 con 0x7f8978158df0 2023-10-06T01:25:23.805 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:23.804+0000 7f897e79d700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f897806e950 con 0x7f89780c15d0 2023-10-06T01:25:23.807 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:23.804+0000 7f897df9c700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f89780c15d0 0x7f89780c1a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:25:23.807 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:23.804+0000 7f897d79b700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f8978158df0 0x7f897806d750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:25:23.807 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:23.804+0000 7f897df9c700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f89780c15d0 0x7f89780c1a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3301/0 says I am v2:172.21.15.50:54558/0 (socket says 172.21.15.50:54558) 2023-10-06T01:25:23.807 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:23.804+0000 7f897cf9a700 1 --1- >> v1:172.21.15.155:6789/0 conn(0x7f89781591c0 0x7f89780c72f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.155:6789/0 says I am v1:172.21.15.50:41218/0 (socket says 172.21.15.50:41218) 2023-10-06T01:25:23.807 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:23.804+0000 7f897df9c700 1 -- 172.21.15.50:0/1821485440 learned_addr learned my addr 172.21.15.50:0/1821485440 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-06T01:25:23.807 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:23.804+0000 7f897d79b700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f8978158df0 0x7f897806d750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.50:60764/0 (socket says 172.21.15.50:60764) 2023-10-06T01:25:23.807 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:23.805+0000 7f897d79b700 1 -- 172.21.15.50:0/1821485440 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f89780c15d0 msgr2=0x7f89780c1a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:25:23.807 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:23.805+0000 7f897d79b700 1 --2- 172.21.15.50:0/1821485440 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f89780c15d0 0x7f89780c1a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:25:23.807 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:23.805+0000 7f897d79b700 1 -- 172.21.15.50:0/1821485440 >> v1:172.21.15.155:6789/0 conn(0x7f89781591c0 legacy=0x7f89780c72f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:25:23.808 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:23.805+0000 7f897d79b700 1 -- 172.21.15.50:0/1821485440 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89780caad0 con 0x7f8978158df0 2023-10-06T01:25:23.808 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:23.805+0000 7f896ffff700 1 -- 172.21.15.50:0/1821485440 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1052990161 0 0) 0x7f89780c7a00 con 0x7f89781591c0 2023-10-06T01:25:23.808 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:23.805+0000 7f897d79b700 1 --2- 172.21.15.50:0/1821485440 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8978158df0 0x7f897806d750 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f8974009910 tx=0x7f89740091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=615736c2443cc62b server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:25:23.808 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:23.805+0000 7f896ffff700 1 -- 172.21.15.50:0/1821485440 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f897400b640 con 0x7f8978158df0 2023-10-06T01:25:23.808 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:23.805+0000 7f896ffff700 1 -- 172.21.15.50:0/1821485440 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f897400b7a0 con 0x7f8978158df0 2023-10-06T01:25:23.808 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:23.805+0000 7f896ffff700 1 -- 172.21.15.50:0/1821485440 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f897400bb60 con 0x7f8978158df0 2023-10-06T01:25:23.808 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:23.806+0000 7f897e79d700 1 -- 172.21.15.50:0/1821485440 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8978158df0 msgr2=0x7f897806d750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:25:23.808 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:23.806+0000 7f897e79d700 1 --2- 172.21.15.50:0/1821485440 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8978158df0 0x7f897806d750 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f8974009910 tx=0x7f89740091a0 comp rx=0 tx=0).stop 2023-10-06T01:25:23.808 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:23.806+0000 7f897e79d700 1 -- 172.21.15.50:0/1821485440 shutdown_connections 2023-10-06T01:25:23.808 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:23.806+0000 7f897e79d700 1 --2- 172.21.15.50:0/1821485440 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8978158df0 0x7f897806d750 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:25:23.808 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:23.806+0000 7f897e79d700 1 --2- 172.21.15.50:0/1821485440 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f89780c15d0 0x7f89780c1a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:25:23.809 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:23.806+0000 7f897e79d700 1 -- 172.21.15.50:0/1821485440 >> 172.21.15.50:0/1821485440 conn(0x7f89780cbef0 msgr2=0x7f89780cc2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:25:23.809 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:23.806+0000 7f897e79d700 1 -- 172.21.15.50:0/1821485440 shutdown_connections 2023-10-06T01:25:23.809 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:23.806+0000 7f897e79d700 1 -- 172.21.15.50:0/1821485440 wait complete. 2023-10-06T01:25:23.811 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:23.807+0000 7f897e79d700 1 Processor -- start 2023-10-06T01:25:23.811 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:23.808+0000 7f897e79d700 1 -- start start 2023-10-06T01:25:23.811 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:23.808+0000 7f897e79d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f89780c15d0 0x7f8978155b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:25:23.811 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:23.808+0000 7f897e79d700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8978158df0 0x7f8978145ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:25:23.811 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:23.809+0000 7f897e79d700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f89781591c0 0x7f89780adcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:25:23.811 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:23.809+0000 7f897e79d700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89780af2f0 con 0x7f89780c15d0 2023-10-06T01:25:23.811 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:23.809+0000 7f897e79d700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89780af5d0 con 0x7f8978158df0 2023-10-06T01:25:23.812 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:23.809+0000 7f897e79d700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89780af8b0 con 0x7f89781591c0 2023-10-06T01:25:23.812 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:23.809+0000 7f897d79b700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f89780c15d0 0x7f8978155b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:25:23.812 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:23.809+0000 7f897d79b700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f89780c15d0 0x7f8978155b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:56960/0 (socket says 172.21.15.50:56960) 2023-10-06T01:25:23.812 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:23.809+0000 7f897d79b700 1 -- 172.21.15.50:0/924882629 learned_addr learned my addr 172.21.15.50:0/924882629 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-06T01:25:23.812 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:23.809+0000 7f897cf9a700 1 --2- 172.21.15.50:0/924882629 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8978158df0 0x7f8978145ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:25:23.812 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:23.809+0000 7f897df9c700 1 --2- 172.21.15.50:0/924882629 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f89781591c0 0x7f89780adcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:25:23.812 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:23.809+0000 7f897d79b700 1 -- 172.21.15.50:0/924882629 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f89781591c0 msgr2=0x7f89780adcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:25:23.812 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:23.809+0000 7f897d79b700 1 --2- 172.21.15.50:0/924882629 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f89781591c0 0x7f89780adcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:25:23.812 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:23.809+0000 7f897d79b700 1 -- 172.21.15.50:0/924882629 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8978158df0 msgr2=0x7f8978145ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:25:23.812 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:23.809+0000 7f897d79b700 1 --2- 172.21.15.50:0/924882629 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8978158df0 0x7f8978145ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:25:23.812 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:23.809+0000 7f897d79b700 1 -- 172.21.15.50:0/924882629 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8974009420 con 0x7f89780c15d0 2023-10-06T01:25:23.813 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:23.809+0000 7f897df9c700 1 --2- 172.21.15.50:0/924882629 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f89781591c0 0x7f89780adcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T01:25:23.813 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:23.810+0000 7f897d79b700 1 --2- 172.21.15.50:0/924882629 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f89780c15d0 0x7f8978155b90 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f8974009fb0 tx=0x7f8974017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:25:23.813 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:23.810+0000 7f896d7fa700 1 -- 172.21.15.50:0/924882629 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f897401f070 con 0x7f89780c15d0 2023-10-06T01:25:23.813 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:23.810+0000 7f896d7fa700 1 -- 172.21.15.50:0/924882629 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8974000bc0 con 0x7f89780c15d0 2023-10-06T01:25:23.813 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:23.810+0000 7f896d7fa700 1 -- 172.21.15.50:0/924882629 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8974025420 con 0x7f89780c15d0 2023-10-06T01:25:23.813 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:23.810+0000 7f897e79d700 1 -- 172.21.15.50:0/924882629 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f89780afb90 con 0x7f89780c15d0 2023-10-06T01:25:23.813 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:23.810+0000 7f897e79d700 1 -- 172.21.15.50:0/924882629 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f89780ac390 con 0x7f89780c15d0 2023-10-06T01:25:23.814 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:23.811+0000 7f897e79d700 1 -- 172.21.15.50:0/924882629 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f897805f270 con 0x7f89780c15d0 2023-10-06T01:25:23.814 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:23.812+0000 7f896d7fa700 1 -- 172.21.15.50:0/924882629 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f8974023070 con 0x7f89780c15d0 2023-10-06T01:25:23.814 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:23.813+0000 7f896d7fa700 1 --2- 172.21.15.50:0/924882629 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f895c066f30 0x7f895c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:25:23.814 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:23.813+0000 7f896d7fa700 1 -- 172.21.15.50:0/924882629 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6436+0+0 (secure 0 0 0) 0x7f8974085d50 con 0x7f89780c15d0 2023-10-06T01:25:23.814 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:23.813+0000 7f897cf9a700 1 --2- 172.21.15.50:0/924882629 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f895c066f30 0x7f895c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:25:23.815 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:23.814+0000 7f897cf9a700 1 --2- 172.21.15.50:0/924882629 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f895c066f30 0x7f895c0693e0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f897814c420 tx=0x7f8968007bf0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:25:23.818 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:23.817+0000 7f896d7fa700 1 -- 172.21.15.50:0/924882629 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f8974052c40 con 0x7f89780c15d0 2023-10-06T01:25:24.066 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:24.066+0000 7f897e79d700 1 -- 172.21.15.50:0/924882629 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f897806da80 con 0x7f89780c15d0 2023-10-06T01:25:24.067 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:24.066+0000 7f896d7fa700 1 -- 172.21.15.50:0/924882629 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) v1 ==== 94+0+4603 (secure 0 0 0) 0x7f8974015090 con 0x7f89780c15d0 2023-10-06T01:25:24.067 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-10-06T01:25:24.067 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":18,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4769,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6833/3835292201","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6832","nonce":3835292201},{"type":"v1","addr":"172.21.15.50:6833","nonce":3835292201}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":13},{"gid":4772,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6837/2073318681","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6835","nonce":2073318681},{"type":"v1","addr":"172.21.15.155:6837","nonce":2073318681}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":13},{"gid":4993,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6836/2652534948","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":2652534948},{"type":"v1","addr":"172.21.15.155:6836","nonce":2652534948}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":18,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T01:22:56.416443+0000","modified":"2023-10-06T01:22:59.935058+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5160},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5160":{"gid":5160,"name":"c","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.50:6835/3957156573","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6834","nonce":3957156573},{"type":"v1","addr":"172.21.15.50:6835","nonce":3957156573}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2}]} 2023-10-06T01:25:24.069 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:24.068+0000 7f897e79d700 1 -- 172.21.15.50:0/924882629 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f895c066f30 msgr2=0x7f895c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:25:24.070 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:24.068+0000 7f897e79d700 1 --2- 172.21.15.50:0/924882629 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f895c066f30 0x7f895c0693e0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f897814c420 tx=0x7f8968007bf0 comp rx=0 tx=0).stop 2023-10-06T01:25:24.070 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:24.068+0000 7f897e79d700 1 -- 172.21.15.50:0/924882629 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f89780c15d0 msgr2=0x7f8978155b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:25:24.070 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:24.068+0000 7f897e79d700 1 --2- 172.21.15.50:0/924882629 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f89780c15d0 0x7f8978155b90 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f8974009fb0 tx=0x7f8974017000 comp rx=0 tx=0).stop 2023-10-06T01:25:24.070 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:24.069+0000 7f897e79d700 1 -- 172.21.15.50:0/924882629 shutdown_connections 2023-10-06T01:25:24.070 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:24.069+0000 7f897e79d700 1 --2- 172.21.15.50:0/924882629 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f89781591c0 0x7f89780adcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:25:24.070 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:24.069+0000 7f897e79d700 1 --2- 172.21.15.50:0/924882629 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f89780c15d0 0x7f8978155b90 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:25:24.070 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:24.069+0000 7f897e79d700 1 --2- 172.21.15.50:0/924882629 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f895c066f30 0x7f895c0693e0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:25:24.070 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:24.069+0000 7f897e79d700 1 --2- 172.21.15.50:0/924882629 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8978158df0 0x7f8978145ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:25:24.070 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:24.069+0000 7f897e79d700 1 -- 172.21.15.50:0/924882629 >> 172.21.15.50:0/924882629 conn(0x7f89780cbef0 msgr2=0x7f8978157fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:25:24.070 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:24.069+0000 7f897e79d700 1 -- 172.21.15.50:0/924882629 shutdown_connections 2023-10-06T01:25:24.070 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:24.069+0000 7f897e79d700 1 -- 172.21.15.50:0/924882629 wait complete. 2023-10-06T01:25:24.071 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 18 2023-10-06T01:25:24.088 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T01:25:24.277 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:24.276+0000 7f1609d9d700 1 Processor -- start 2023-10-06T01:25:24.277 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:24.276+0000 7f1609d9d700 1 -- start start 2023-10-06T01:25:24.278 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:24.277+0000 7f1609d9d700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f16040c79f0 0x7f16040c9ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:25:24.278 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:24.277+0000 7f1609d9d700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1604159a60 0x7f1604159eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:25:24.278 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:24.277+0000 7f1609d9d700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f16040c9a60 con 0x7f16040675f0 2023-10-06T01:25:24.278 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:24.277+0000 7f1609d9d700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f160415a590 con 0x7f16040c79f0 2023-10-06T01:25:24.279 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:24.277+0000 7f1609d9d700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f160415a870 con 0x7f1604159a60 2023-10-06T01:25:24.279 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:24.277+0000 7f1608d9b700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f16040c79f0 0x7f16040c9ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:25:24.279 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:24.277+0000 7f160959c700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f16040675f0 0x7f16040679f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:43688/0 (socket says 172.21.15.50:43688) 2023-10-06T01:25:24.279 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:24.277+0000 7f160959c700 1 -- 172.21.15.50:0/2771766290 learned_addr learned my addr 172.21.15.50:0/2771766290 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-10-06T01:25:24.279 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:24.278+0000 7f1603fff700 1 --2- 172.21.15.50:0/2771766290 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1604159a60 0x7f1604159eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:25:24.280 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:24.278+0000 7f16037fe700 1 -- 172.21.15.50:0/2771766290 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4277467013 0 0) 0x7f16040c9a60 con 0x7f16040675f0 2023-10-06T01:25:24.280 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:24.278+0000 7f1608d9b700 1 -- 172.21.15.50:0/2771766290 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1604159a60 msgr2=0x7f1604159eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:25:24.281 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:24.278+0000 7f1608d9b700 1 --2- 172.21.15.50:0/2771766290 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1604159a60 0x7f1604159eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:25:24.281 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:24.278+0000 7f1608d9b700 1 -- 172.21.15.50:0/2771766290 >> v1:172.21.15.50:6789/0 conn(0x7f16040675f0 legacy=0x7f16040679f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:25:24.281 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:24.278+0000 7f1608d9b700 1 -- 172.21.15.50:0/2771766290 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16040c96f0 con 0x7f16040c79f0 2023-10-06T01:25:24.281 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:24.278+0000 7f1608d9b700 1 --2- 172.21.15.50:0/2771766290 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f16040c79f0 0x7f16040c9ef0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f15f80098d0 tx=0x7f15f8009120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1fab0a55adbc260 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:25:24.281 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:24.278+0000 7f16037fe700 1 -- 172.21.15.50:0/2771766290 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15f8005c10 con 0x7f16040c79f0 2023-10-06T01:25:24.281 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:24.279+0000 7f16037fe700 1 -- 172.21.15.50:0/2771766290 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f15f8005d70 con 0x7f16040c79f0 2023-10-06T01:25:24.281 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:24.279+0000 7f16037fe700 1 -- 172.21.15.50:0/2771766290 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15f8006280 con 0x7f16040c79f0 2023-10-06T01:25:24.281 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:24.279+0000 7f1609d9d700 1 -- 172.21.15.50:0/2771766290 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f16040c79f0 msgr2=0x7f16040c9ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:25:24.281 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:24.279+0000 7f1609d9d700 1 --2- 172.21.15.50:0/2771766290 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f16040c79f0 0x7f16040c9ef0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f15f80098d0 tx=0x7f15f8009120 comp rx=0 tx=0).stop 2023-10-06T01:25:24.281 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:24.279+0000 7f1609d9d700 1 -- 172.21.15.50:0/2771766290 shutdown_connections 2023-10-06T01:25:24.281 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:24.279+0000 7f1609d9d700 1 --2- 172.21.15.50:0/2771766290 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f16040c79f0 0x7f16040c9ef0 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:25:24.281 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:24.279+0000 7f1609d9d700 1 --2- 172.21.15.50:0/2771766290 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1604159a60 0x7f1604159eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:25:24.282 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:24.279+0000 7f1609d9d700 1 -- 172.21.15.50:0/2771766290 >> 172.21.15.50:0/2771766290 conn(0x7f1604068700 msgr2=0x7f1604068b00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:25:24.282 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:24.279+0000 7f1609d9d700 1 -- 172.21.15.50:0/2771766290 shutdown_connections 2023-10-06T01:25:24.282 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:24.279+0000 7f1609d9d700 1 -- 172.21.15.50:0/2771766290 wait complete. 2023-10-06T01:25:24.283 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:24.281+0000 7f1609d9d700 1 Processor -- start 2023-10-06T01:25:24.283 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:24.281+0000 7f1609d9d700 1 -- start start 2023-10-06T01:25:24.283 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:24.282+0000 7f1609d9d700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f16040675f0 0x7f16041584c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:25:24.283 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:24.282+0000 7f1609d9d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f16040c79f0 0x7f16040c1440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:25:24.284 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:24.282+0000 7f1609d9d700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1604159a60 0x7f1604160a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:25:24.284 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:24.282+0000 7f1609d9d700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16040c2950 con 0x7f16040c79f0 2023-10-06T01:25:24.284 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:24.282+0000 7f1609d9d700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16040c1d40 con 0x7f16040675f0 2023-10-06T01:25:24.284 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:24.282+0000 7f1609d9d700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16040c2020 con 0x7f1604159a60 2023-10-06T01:25:24.284 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:24.282+0000 7f1603fff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f16040c79f0 0x7f16040c1440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:25:24.284 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:24.282+0000 7f1603fff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f16040c79f0 0x7f16040c1440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:56980/0 (socket says 172.21.15.50:56980) 2023-10-06T01:25:24.284 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:24.282+0000 7f1603fff700 1 -- 172.21.15.50:0/2609273966 learned_addr learned my addr 172.21.15.50:0/2609273966 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-06T01:25:24.284 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:24.282+0000 7f160959c700 1 --2- 172.21.15.50:0/2609273966 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1604159a60 0x7f1604160a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:25:24.284 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:24.282+0000 7f1608d9b700 1 --2- 172.21.15.50:0/2609273966 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f16040675f0 0x7f16041584c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:25:24.284 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:24.282+0000 7f1603fff700 1 -- 172.21.15.50:0/2609273966 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1604159a60 msgr2=0x7f1604160a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:25:24.284 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:24.282+0000 7f1603fff700 1 --2- 172.21.15.50:0/2609273966 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1604159a60 0x7f1604160a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:25:24.284 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:24.282+0000 7f1603fff700 1 -- 172.21.15.50:0/2609273966 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f16040675f0 msgr2=0x7f16041584c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:25:24.285 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:24.282+0000 7f1603fff700 1 --2- 172.21.15.50:0/2609273966 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f16040675f0 0x7f16041584c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:25:24.285 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:24.282+0000 7f1603fff700 1 -- 172.21.15.50:0/2609273966 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15f80093c0 con 0x7f16040c79f0 2023-10-06T01:25:24.285 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:24.283+0000 7f1603fff700 1 --2- 172.21.15.50:0/2609273966 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f16040c79f0 0x7f16040c1440 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f15f000e930 tx=0x7f15f00091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:25:24.286 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:24.283+0000 7f1600ff9700 1 -- 172.21.15.50:0/2609273966 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15f000eed0 con 0x7f16040c79f0 2023-10-06T01:25:24.286 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:24.283+0000 7f1600ff9700 1 -- 172.21.15.50:0/2609273966 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f15f000c850 con 0x7f16040c79f0 2023-10-06T01:25:24.286 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:24.283+0000 7f1600ff9700 1 -- 172.21.15.50:0/2609273966 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15f000cbf0 con 0x7f16040c79f0 2023-10-06T01:25:24.286 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:24.283+0000 7f1609d9d700 1 -- 172.21.15.50:0/2609273966 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f16040c2300 con 0x7f16040c79f0 2023-10-06T01:25:24.286 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:24.283+0000 7f1609d9d700 1 -- 172.21.15.50:0/2609273966 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1604158a00 con 0x7f16040c79f0 2023-10-06T01:25:24.286 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:24.284+0000 7f1609d9d700 1 -- 172.21.15.50:0/2609273966 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f160405f270 con 0x7f16040c79f0 2023-10-06T01:25:24.286 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:24.285+0000 7f1600ff9700 1 -- 172.21.15.50:0/2609273966 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f15f0013470 con 0x7f16040c79f0 2023-10-06T01:25:24.287 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:24.286+0000 7f1600ff9700 1 --2- 172.21.15.50:0/2609273966 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f15e8066f30 0x7f15e80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:25:24.287 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:24.286+0000 7f1600ff9700 1 -- 172.21.15.50:0/2609273966 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6436+0+0 (secure 0 0 0) 0x7f15f0084aa0 con 0x7f16040c79f0 2023-10-06T01:25:24.287 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:24.286+0000 7f1608d9b700 1 --2- 172.21.15.50:0/2609273966 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f15e8066f30 0x7f15e80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:25:24.287 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:24.287+0000 7f1608d9b700 1 --2- 172.21.15.50:0/2609273966 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f15e8066f30 0x7f15e80693e0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f15f8009160 tx=0x7f15f8016000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:25:24.291 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:24.290+0000 7f1600ff9700 1 -- 172.21.15.50:0/2609273966 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f15f0051990 con 0x7f16040c79f0 2023-10-06T01:25:24.542 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:24.542+0000 7f1609d9d700 1 -- 172.21.15.50:0/2609273966 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f160406ebf0 con 0x7f16040c79f0 2023-10-06T01:25:24.543 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:24.542+0000 7f1600ff9700 1 -- 172.21.15.50:0/2609273966 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) v1 ==== 94+0+4603 (secure 0 0 0) 0x7f15f0054fb0 con 0x7f16040c79f0 2023-10-06T01:25:24.543 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-10-06T01:25:24.543 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":18,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4769,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6833/3835292201","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6832","nonce":3835292201},{"type":"v1","addr":"172.21.15.50:6833","nonce":3835292201}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":13},{"gid":4772,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6837/2073318681","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6835","nonce":2073318681},{"type":"v1","addr":"172.21.15.155:6837","nonce":2073318681}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":13},{"gid":4993,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6836/2652534948","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":2652534948},{"type":"v1","addr":"172.21.15.155:6836","nonce":2652534948}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":18,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T01:22:56.416443+0000","modified":"2023-10-06T01:22:59.935058+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5160},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5160":{"gid":5160,"name":"c","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.50:6835/3957156573","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6834","nonce":3957156573},{"type":"v1","addr":"172.21.15.50:6835","nonce":3957156573}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2}]} 2023-10-06T01:25:24.546 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:24.545+0000 7f1609d9d700 1 -- 172.21.15.50:0/2609273966 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f15e8066f30 msgr2=0x7f15e80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:25:24.546 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:24.545+0000 7f1609d9d700 1 --2- 172.21.15.50:0/2609273966 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f15e8066f30 0x7f15e80693e0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f15f8009160 tx=0x7f15f8016000 comp rx=0 tx=0).stop 2023-10-06T01:25:24.546 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:24.545+0000 7f1609d9d700 1 -- 172.21.15.50:0/2609273966 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f16040c79f0 msgr2=0x7f16040c1440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:25:24.546 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:24.545+0000 7f1609d9d700 1 --2- 172.21.15.50:0/2609273966 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f16040c79f0 0x7f16040c1440 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f15f000e930 tx=0x7f15f00091a0 comp rx=0 tx=0).stop 2023-10-06T01:25:24.546 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:24.545+0000 7f1609d9d700 1 -- 172.21.15.50:0/2609273966 shutdown_connections 2023-10-06T01:25:24.546 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:24.545+0000 7f1609d9d700 1 --2- 172.21.15.50:0/2609273966 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1604159a60 0x7f1604160a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:25:24.546 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:24.545+0000 7f1609d9d700 1 --2- 172.21.15.50:0/2609273966 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f15e8066f30 0x7f15e80693e0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:25:24.546 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:24.545+0000 7f1609d9d700 1 --2- 172.21.15.50:0/2609273966 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f16040675f0 0x7f16041584c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:25:24.547 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:24.545+0000 7f1609d9d700 1 --2- 172.21.15.50:0/2609273966 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f16040c79f0 0x7f16040c1440 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:25:24.547 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:24.545+0000 7f1609d9d700 1 -- 172.21.15.50:0/2609273966 >> 172.21.15.50:0/2609273966 conn(0x7f1604068700 msgr2=0x7f16040b0b40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:25:24.547 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:24.545+0000 7f1609d9d700 1 -- 172.21.15.50:0/2609273966 shutdown_connections 2023-10-06T01:25:24.547 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:24.545+0000 7f1609d9d700 1 -- 172.21.15.50:0/2609273966 wait complete. 2023-10-06T01:25:24.547 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 18 2023-10-06T01:25:24.563 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T01:25:24.751 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:24.749+0000 7ff16f59e700 1 Processor -- start 2023-10-06T01:25:24.751 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:24.749+0000 7ff16f59e700 1 -- start start 2023-10-06T01:25:24.753 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:24.750+0000 7ff16f59e700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7ff17013fa30 0x7ff1700c0d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:25:24.753 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:24.750+0000 7ff16f59e700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff1700ca4d0 0x7ff170159f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:25:24.753 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:24.751+0000 7ff16f59e700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff1700c1280 con 0x7ff17013fe00 2023-10-06T01:25:24.753 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:24.751+0000 7ff16f59e700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff1700cb510 con 0x7ff17013fa30 2023-10-06T01:25:24.753 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:24.751+0000 7ff16f59e700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff17006f4c0 con 0x7ff1700ca4d0 2023-10-06T01:25:24.753 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:24.751+0000 7ff16e59c700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7ff17013fa30 0x7ff1700c0d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:25:24.753 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:24.751+0000 7ff16dd9b700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff1700ca4d0 0x7ff170159f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:25:24.753 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:24.751+0000 7ff16e59c700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7ff17013fa30 0x7ff1700c0d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.50:60796/0 (socket says 172.21.15.50:60796) 2023-10-06T01:25:24.754 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:24.751+0000 7ff16dd9b700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff1700ca4d0 0x7ff170159f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3301/0 says I am v2:172.21.15.50:54602/0 (socket says 172.21.15.50:54602) 2023-10-06T01:25:24.754 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:24.751+0000 7ff16e59c700 1 -- 172.21.15.50:0/1217321842 learned_addr learned my addr 172.21.15.50:0/1217321842 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-06T01:25:24.755 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:24.751+0000 7ff16e59c700 1 -- 172.21.15.50:0/1217321842 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff1700ca4d0 msgr2=0x7ff170159f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:25:24.755 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:24.751+0000 7ff16e59c700 1 --2- 172.21.15.50:0/1217321842 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff1700ca4d0 0x7ff170159f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:25:24.755 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:24.752+0000 7ff16e59c700 1 -- 172.21.15.50:0/1217321842 >> v1:172.21.15.155:6789/0 conn(0x7ff17013fe00 legacy=0x7ff17006e060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:25:24.756 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:24.752+0000 7ff16e59c700 1 -- 172.21.15.50:0/1217321842 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1700ca990 con 0x7ff17013fa30 2023-10-06T01:25:24.756 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:24.752+0000 7ff16e59c700 1 --2- 172.21.15.50:0/1217321842 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff17013fa30 0x7ff1700c0d40 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7ff16000bc50 tx=0x7ff16000b4f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c708f4b49dd27653 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:25:24.756 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:24.752+0000 7ff16d59a700 1 -- 172.21.15.50:0/1217321842 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff16000dbf0 con 0x7ff17013fa30 2023-10-06T01:25:24.756 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:24.752+0000 7ff16d59a700 1 -- 172.21.15.50:0/1217321842 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff16000dd50 con 0x7ff17013fa30 2023-10-06T01:25:24.756 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:24.752+0000 7ff16d59a700 1 -- 172.21.15.50:0/1217321842 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1600196b0 con 0x7ff17013fa30 2023-10-06T01:25:24.756 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:24.753+0000 7ff16f59e700 1 -- 172.21.15.50:0/1217321842 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff17013fa30 msgr2=0x7ff1700c0d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:25:24.756 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:24.753+0000 7ff16f59e700 1 --2- 172.21.15.50:0/1217321842 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff17013fa30 0x7ff1700c0d40 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7ff16000bc50 tx=0x7ff16000b4f0 comp rx=0 tx=0).stop 2023-10-06T01:25:24.756 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:24.753+0000 7ff16f59e700 1 -- 172.21.15.50:0/1217321842 shutdown_connections 2023-10-06T01:25:24.756 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:24.753+0000 7ff16f59e700 1 --2- 172.21.15.50:0/1217321842 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff17013fa30 0x7ff1700c0d40 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:25:24.756 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:24.753+0000 7ff16f59e700 1 --2- 172.21.15.50:0/1217321842 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff1700ca4d0 0x7ff170159f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:25:24.756 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:24.753+0000 7ff16f59e700 1 -- 172.21.15.50:0/1217321842 >> 172.21.15.50:0/1217321842 conn(0x7ff1700cbef0 msgr2=0x7ff1700cc2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:25:24.757 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:24.753+0000 7ff16f59e700 1 -- 172.21.15.50:0/1217321842 shutdown_connections 2023-10-06T01:25:24.757 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:24.753+0000 7ff16f59e700 1 -- 172.21.15.50:0/1217321842 wait complete. 2023-10-06T01:25:24.759 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:24.754+0000 7ff16f59e700 1 Processor -- start 2023-10-06T01:25:24.759 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:24.754+0000 7ff16f59e700 1 -- start start 2023-10-06T01:25:24.759 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:24.755+0000 7ff16f59e700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff1700ca4d0 0x7ff17016ace0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:25:24.759 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:24.755+0000 7ff16f59e700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff17013fa30 0x7ff17013df70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:25:24.759 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:24.755+0000 7ff16f59e700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff17013fe00 0x7ff1700acf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:25:24.759 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:24.755+0000 7ff16f59e700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff17016b220 con 0x7ff17013fe00 2023-10-06T01:25:24.759 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:24.755+0000 7ff16f59e700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff17013e4b0 con 0x7ff1700ca4d0 2023-10-06T01:25:24.759 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:24.755+0000 7ff16f59e700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff1700aa2b0 con 0x7ff17013fa30 2023-10-06T01:25:24.759 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:24.756+0000 7ff16ed9d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff17013fe00 0x7ff1700acf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:25:24.760 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:24.756+0000 7ff16ed9d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff17013fe00 0x7ff1700acf80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:56994/0 (socket says 172.21.15.50:56994) 2023-10-06T01:25:24.760 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:24.756+0000 7ff16ed9d700 1 -- 172.21.15.50:0/3891937426 learned_addr learned my addr 172.21.15.50:0/3891937426 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-06T01:25:24.760 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:24.756+0000 7ff16e59c700 1 --2- 172.21.15.50:0/3891937426 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff1700ca4d0 0x7ff17016ace0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:25:24.760 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:24.756+0000 7ff16dd9b700 1 --2- 172.21.15.50:0/3891937426 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff17013fa30 0x7ff17013df70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:25:24.760 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:24.756+0000 7ff16ed9d700 1 -- 172.21.15.50:0/3891937426 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff17013fa30 msgr2=0x7ff17013df70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:25:24.760 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:24.756+0000 7ff16ed9d700 1 --2- 172.21.15.50:0/3891937426 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff17013fa30 0x7ff17013df70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:25:24.760 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:24.756+0000 7ff16ed9d700 1 -- 172.21.15.50:0/3891937426 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff1700ca4d0 msgr2=0x7ff17016ace0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:25:24.760 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:24.756+0000 7ff16ed9d700 1 --2- 172.21.15.50:0/3891937426 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff1700ca4d0 0x7ff17016ace0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:25:24.760 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:24.756+0000 7ff16ed9d700 1 -- 172.21.15.50:0/3891937426 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff16000b790 con 0x7ff17013fe00 2023-10-06T01:25:24.760 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:24.757+0000 7ff16ed9d700 1 --2- 172.21.15.50:0/3891937426 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff17013fe00 0x7ff1700acf80 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7ff16800c910 tx=0x7ff1680016f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:25:24.760 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:24.757+0000 7ff15e7fc700 1 -- 172.21.15.50:0/3891937426 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff168012630 con 0x7ff17013fe00 2023-10-06T01:25:24.760 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:24.757+0000 7ff15e7fc700 1 -- 172.21.15.50:0/3891937426 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff168012790 con 0x7ff17013fe00 2023-10-06T01:25:24.761 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:24.757+0000 7ff16f59e700 1 -- 172.21.15.50:0/3891937426 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff1700ad4c0 con 0x7ff17013fe00 2023-10-06T01:25:24.761 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:24.757+0000 7ff15e7fc700 1 -- 172.21.15.50:0/3891937426 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff168012b50 con 0x7ff17013fe00 2023-10-06T01:25:24.761 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:24.757+0000 7ff16f59e700 1 -- 172.21.15.50:0/3891937426 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff1700a9c60 con 0x7ff17013fe00 2023-10-06T01:25:24.761 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:24.758+0000 7ff16f59e700 1 -- 172.21.15.50:0/3891937426 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff17005f270 con 0x7ff17013fe00 2023-10-06T01:25:24.761 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:24.759+0000 7ff15e7fc700 1 -- 172.21.15.50:0/3891937426 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7ff16801b450 con 0x7ff17013fe00 2023-10-06T01:25:24.762 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:24.761+0000 7ff15e7fc700 1 --2- 172.21.15.50:0/3891937426 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7ff150066f30 0x7ff1500693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:25:24.762 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:24.761+0000 7ff15e7fc700 1 -- 172.21.15.50:0/3891937426 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6436+0+0 (secure 0 0 0) 0x7ff168084a00 con 0x7ff17013fe00 2023-10-06T01:25:24.763 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:24.761+0000 7ff16e59c700 1 --2- 172.21.15.50:0/3891937426 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7ff150066f30 0x7ff1500693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:25:24.763 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:24.762+0000 7ff16e59c700 1 --2- 172.21.15.50:0/3891937426 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7ff150066f30 0x7ff1500693e0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7ff16000bc50 tx=0x7ff16001b000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:25:24.766 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:24.765+0000 7ff15e7fc700 1 -- 172.21.15.50:0/3891937426 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff1680518f0 con 0x7ff17013fe00 2023-10-06T01:25:24.971 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:24.969+0000 7ff16f59e700 1 -- 172.21.15.50:0/3891937426 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff1700aa090 con 0x7ff17013fe00 2023-10-06T01:25:24.971 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:24.970+0000 7ff15e7fc700 1 -- 172.21.15.50:0/3891937426 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v41) v1 ==== 74+0+17167 (secure 0 0 0) 0x7ff168054f10 con 0x7ff17013fe00 2023-10-06T01:25:24.972 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-10-06T01:25:24.972 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":41,"fsid":"0bfd9a6b-1587-4fe4-a89e-e43c00286b4e","created":"2023-10-06T01:21:16.828801+0000","modified":"2023-10-06T01:23:25.862497+0000","last_up_change":"2023-10-06T01:21:28.584523+0000","last_in_change":"2023-10-06T01:21:20.179863+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-10-06T01:21:29.304225+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":".mgr","create_time":"2023-10-06T01:21:29.835490+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2023-10-06T01:22:54.641549+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":7,"pool_name":"cephfs_data","create_time":"2023-10-06T01:22:55.389647+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"39","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"9060727a-3959-4de3-8363-c5c5d7826c9a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":87837},{"type":"v1","addr":"172.21.15.50:6801","nonce":87837}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":87837},{"type":"v1","addr":"172.21.15.50:6803","nonce":87837}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":87837},{"type":"v1","addr":"172.21.15.50:6807","nonce":87837}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":87837},{"type":"v1","addr":"172.21.15.50:6805","nonce":87837}]},"public_addr":"172.21.15.50:6801/87837","cluster_addr":"172.21.15.50:6803/87837","heartbeat_back_addr":"172.21.15.50:6807/87837","heartbeat_front_addr":"172.21.15.50:6805/87837","state":["exists","up"]},{"osd":1,"uuid":"5ad9ef12-b579-47ea-b690-90ba887e2cef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":87853},{"type":"v1","addr":"172.21.15.50:6809","nonce":87853}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":87853},{"type":"v1","addr":"172.21.15.50:6811","nonce":87853}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":87853},{"type":"v1","addr":"172.21.15.50:6815","nonce":87853}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":87853},{"type":"v1","addr":"172.21.15.50:6813","nonce":87853}]},"public_addr":"172.21.15.50:6809/87853","cluster_addr":"172.21.15.50:6811/87853","heartbeat_back_addr":"172.21.15.50:6815/87853","heartbeat_front_addr":"172.21.15.50:6813/87853","state":["exists","up"]},{"osd":2,"uuid":"c7aee044-6f75-436f-90e1-ba42a57359bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6821","nonce":87855},{"type":"v1","addr":"172.21.15.50:6822","nonce":87855}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6824","nonce":87855},{"type":"v1","addr":"172.21.15.50:6826","nonce":87855}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":87855},{"type":"v1","addr":"172.21.15.50:6831","nonce":87855}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":87855},{"type":"v1","addr":"172.21.15.50:6829","nonce":87855}]},"public_addr":"172.21.15.50:6822/87855","cluster_addr":"172.21.15.50:6826/87855","heartbeat_back_addr":"172.21.15.50:6831/87855","heartbeat_front_addr":"172.21.15.50:6829/87855","state":["exists","up"]},{"osd":3,"uuid":"d9b901c8-e8b2-44af-9508-f453120a96c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":87856},{"type":"v1","addr":"172.21.15.50:6817","nonce":87856}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":87856},{"type":"v1","addr":"172.21.15.50:6819","nonce":87856}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6825","nonce":87856},{"type":"v1","addr":"172.21.15.50:6827","nonce":87856}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6820","nonce":87856},{"type":"v1","addr":"172.21.15.50:6823","nonce":87856}]},"public_addr":"172.21.15.50:6817/87856","cluster_addr":"172.21.15.50:6819/87856","heartbeat_back_addr":"172.21.15.50:6827/87856","heartbeat_front_addr":"172.21.15.50:6823/87856","state":["exists","up"]},{"osd":4,"uuid":"2b3c6b38-e3e9-4301-9445-60fd3fe8ce03","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":85805},{"type":"v1","addr":"172.21.15.155:6801","nonce":85805}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":85805},{"type":"v1","addr":"172.21.15.155:6803","nonce":85805}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6806","nonce":85805},{"type":"v1","addr":"172.21.15.155:6807","nonce":85805}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6804","nonce":85805},{"type":"v1","addr":"172.21.15.155:6805","nonce":85805}]},"public_addr":"172.21.15.155:6801/85805","cluster_addr":"172.21.15.155:6803/85805","heartbeat_back_addr":"172.21.15.155:6807/85805","heartbeat_front_addr":"172.21.15.155:6805/85805","state":["exists","up"]},{"osd":5,"uuid":"417b5f8f-65f1-4c94-91a7-a6ce03fe1679","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6816","nonce":85807},{"type":"v1","addr":"172.21.15.155:6818","nonce":85807}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6820","nonce":85807},{"type":"v1","addr":"172.21.15.155:6822","nonce":85807}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6828","nonce":85807},{"type":"v1","addr":"172.21.15.155:6830","nonce":85807}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6824","nonce":85807},{"type":"v1","addr":"172.21.15.155:6826","nonce":85807}]},"public_addr":"172.21.15.155:6818/85807","cluster_addr":"172.21.15.155:6822/85807","heartbeat_back_addr":"172.21.15.155:6830/85807","heartbeat_front_addr":"172.21.15.155:6826/85807","state":["exists","up"]},{"osd":6,"uuid":"c150cff3-aee4-4714-9c08-d182b1ba9ffd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6808","nonce":85806},{"type":"v1","addr":"172.21.15.155:6809","nonce":85806}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6810","nonce":85806},{"type":"v1","addr":"172.21.15.155:6811","nonce":85806}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6814","nonce":85806},{"type":"v1","addr":"172.21.15.155:6815","nonce":85806}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6812","nonce":85806},{"type":"v1","addr":"172.21.15.155:6813","nonce":85806}]},"public_addr":"172.21.15.155:6809/85806","cluster_addr":"172.21.15.155:6811/85806","heartbeat_back_addr":"172.21.15.155:6815/85806","heartbeat_front_addr":"172.21.15.155:6813/85806","state":["exists","up"]},{"osd":7,"uuid":"71107f0e-04d1-4e72-a0ec-0faf6af003e7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6817","nonce":85832},{"type":"v1","addr":"172.21.15.155:6819","nonce":85832}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6821","nonce":85832},{"type":"v1","addr":"172.21.15.155:6823","nonce":85832}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6829","nonce":85832},{"type":"v1","addr":"172.21.15.155:6831","nonce":85832}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6825","nonce":85832},{"type":"v1","addr":"172.21.15.155:6827","nonce":85832}]},"public_addr":"172.21.15.155:6819/85832","cluster_addr":"172.21.15.155:6823/85832","heartbeat_back_addr":"172.21.15.155:6831/85832","heartbeat_front_addr":"172.21.15.155:6827/85832","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:21:25.423389+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:21:25.472661+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:21:25.817562+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:21:25.551257+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:21:25.407818+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:21:25.557976+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:21:25.747299+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:21:25.827576+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"7.36","mappings":[{"from":0,"to":5}]},{"pgid":"7.3b","mappings":[{"from":0,"to":4}]}],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T01:25:24.974 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:24.972+0000 7ff16f59e700 1 -- 172.21.15.50:0/3891937426 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7ff150066f30 msgr2=0x7ff1500693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:25:24.974 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:24.972+0000 7ff16f59e700 1 --2- 172.21.15.50:0/3891937426 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7ff150066f30 0x7ff1500693e0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7ff16000bc50 tx=0x7ff16001b000 comp rx=0 tx=0).stop 2023-10-06T01:25:24.974 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:24.972+0000 7ff16f59e700 1 -- 172.21.15.50:0/3891937426 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff17013fe00 msgr2=0x7ff1700acf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:25:24.975 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:24.972+0000 7ff16f59e700 1 --2- 172.21.15.50:0/3891937426 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff17013fe00 0x7ff1700acf80 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7ff16800c910 tx=0x7ff1680016f0 comp rx=0 tx=0).stop 2023-10-06T01:25:24.975 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:24.972+0000 7ff16f59e700 1 -- 172.21.15.50:0/3891937426 shutdown_connections 2023-10-06T01:25:24.975 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:24.972+0000 7ff16f59e700 1 --2- 172.21.15.50:0/3891937426 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff17013fe00 0x7ff1700acf80 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:25:24.975 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:24.972+0000 7ff16f59e700 1 --2- 172.21.15.50:0/3891937426 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7ff150066f30 0x7ff1500693e0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:25:24.975 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:24.972+0000 7ff16f59e700 1 --2- 172.21.15.50:0/3891937426 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff1700ca4d0 0x7ff17016ace0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:25:24.975 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:24.972+0000 7ff16f59e700 1 --2- 172.21.15.50:0/3891937426 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff17013fa30 0x7ff17013df70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:25:24.975 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:24.972+0000 7ff16f59e700 1 -- 172.21.15.50:0/3891937426 >> 172.21.15.50:0/3891937426 conn(0x7ff1700cbef0 msgr2=0x7ff1700ae1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:25:24.975 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:24.972+0000 7ff16f59e700 1 -- 172.21.15.50:0/3891937426 shutdown_connections 2023-10-06T01:25:24.975 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:24.972+0000 7ff16f59e700 1 -- 172.21.15.50:0/3891937426 wait complete. 2023-10-06T01:25:24.992 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-10-06T01:25:25.180 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:25.179+0000 7f49a719d700 1 Processor -- start 2023-10-06T01:25:25.181 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:25.179+0000 7f49a719d700 1 -- start start 2023-10-06T01:25:25.182 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:25.180+0000 7f49a719d700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f49a00c79f0 0x7f49a00c9ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:25:25.182 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:25.180+0000 7f49a719d700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f49a0159a60 0x7f49a0159eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:25:25.182 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:25.180+0000 7f49a719d700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f49a00675f0 0x7f49a00679f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:25:25.182 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:25.180+0000 7f49a719d700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f49a00c9a60 con 0x7f49a00c79f0 2023-10-06T01:25:25.182 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:25.180+0000 7f49a719d700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f49a0067f30 con 0x7f49a00675f0 2023-10-06T01:25:25.182 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:25.180+0000 7f49a719d700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f49a015a590 con 0x7f49a0159a60 2023-10-06T01:25:25.182 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:25.180+0000 7f49a619b700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f49a00c79f0 0x7f49a00c9ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:25:25.183 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:25.180+0000 7f49a619b700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f49a00c79f0 0x7f49a00c9ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:47908/0 (socket says 172.21.15.50:47908) 2023-10-06T01:25:25.183 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:25.180+0000 7f49a619b700 1 -- 172.21.15.50:0/142265066 learned_addr learned my addr 172.21.15.50:0/142265066 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-06T01:25:25.184 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:25.181+0000 7f49a599a700 1 --2- 172.21.15.50:0/142265066 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f49a0159a60 0x7f49a0159eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:25:25.184 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:25.181+0000 7f49a619b700 1 -- 172.21.15.50:0/142265066 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f49a0159a60 msgr2=0x7f49a0159eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:25:25.184 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:25.181+0000 7f49a699c700 1 --2- 172.21.15.50:0/142265066 >> v2:172.21.15.155:3300/0 conn(0x7f49a00675f0 0x7f49a00679f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:25:25.185 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:25.181+0000 7f49a619b700 1 --2- 172.21.15.50:0/142265066 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f49a0159a60 0x7f49a0159eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:25:25.185 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:25.181+0000 7f49a619b700 1 -- 172.21.15.50:0/142265066 >> v2:172.21.15.155:3300/0 conn(0x7f49a00675f0 msgr2=0x7f49a00679f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:25:25.185 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:25.181+0000 7f49a619b700 1 --2- 172.21.15.50:0/142265066 >> v2:172.21.15.155:3300/0 conn(0x7f49a00675f0 0x7f49a00679f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:25:25.185 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:25.181+0000 7f49a619b700 1 -- 172.21.15.50:0/142265066 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49a015a870 con 0x7f49a00c79f0 2023-10-06T01:25:25.185 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:25.181+0000 7f49a599a700 1 --2- 172.21.15.50:0/142265066 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f49a0159a60 0x7f49a0159eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T01:25:25.185 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:25.181+0000 7f49a699c700 1 --2- 172.21.15.50:0/142265066 >> v2:172.21.15.155:3300/0 conn(0x7f49a00675f0 0x7f49a00679f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T01:25:25.185 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:25.181+0000 7f49a619b700 1 --2- 172.21.15.50:0/142265066 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f49a00c79f0 0x7f49a00c9ef0 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f49a006f800 tx=0x7f499c009220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=11f1decbf4eeeaa server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:25:25.185 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:25.181+0000 7f49a5199700 1 -- 172.21.15.50:0/142265066 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f499c005c10 con 0x7f49a00c79f0 2023-10-06T01:25:25.185 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:25.181+0000 7f49a5199700 1 -- 172.21.15.50:0/142265066 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f499c005d70 con 0x7f49a00c79f0 2023-10-06T01:25:25.185 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:25.181+0000 7f49a5199700 1 -- 172.21.15.50:0/142265066 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f499c00b880 con 0x7f49a00c79f0 2023-10-06T01:25:25.185 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:25.182+0000 7f49a719d700 1 -- 172.21.15.50:0/142265066 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f49a00c79f0 msgr2=0x7f49a00c9ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:25:25.185 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:25.182+0000 7f49a719d700 1 --2- 172.21.15.50:0/142265066 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f49a00c79f0 0x7f49a00c9ef0 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f49a006f800 tx=0x7f499c009220 comp rx=0 tx=0).stop 2023-10-06T01:25:25.186 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:25.182+0000 7f49a719d700 1 -- 172.21.15.50:0/142265066 shutdown_connections 2023-10-06T01:25:25.186 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:25.182+0000 7f49a719d700 1 --2- 172.21.15.50:0/142265066 >> v2:172.21.15.155:3300/0 conn(0x7f49a00675f0 0x7f49a00679f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:25:25.186 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:25.182+0000 7f49a719d700 1 --2- 172.21.15.50:0/142265066 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f49a00c79f0 0x7f49a00c9ef0 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:25:25.186 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:25.182+0000 7f49a719d700 1 --2- 172.21.15.50:0/142265066 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f49a0159a60 0x7f49a0159eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:25:25.186 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:25.182+0000 7f49a719d700 1 -- 172.21.15.50:0/142265066 >> 172.21.15.50:0/142265066 conn(0x7f49a0068700 msgr2=0x7f49a0068b00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:25:25.186 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:25.182+0000 7f49a719d700 1 -- 172.21.15.50:0/142265066 shutdown_connections 2023-10-06T01:25:25.186 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:25.182+0000 7f49a719d700 1 -- 172.21.15.50:0/142265066 wait complete. 2023-10-06T01:25:25.188 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:25.183+0000 7f49a719d700 1 Processor -- start 2023-10-06T01:25:25.188 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:25.184+0000 7f49a719d700 1 -- start start 2023-10-06T01:25:25.188 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:25.184+0000 7f49a719d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f49a00675f0 0x7f49a01580c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:25:25.188 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:25.184+0000 7f49a719d700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f49a00c79f0 0x7f49a0169ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:25:25.188 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:25.184+0000 7f49a719d700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f49a0159a60 0x7f49a00a98f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:25:25.188 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:25.184+0000 7f49a719d700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49a016ae60 con 0x7f49a00675f0 2023-10-06T01:25:25.188 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:25.184+0000 7f49a719d700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49a00ad510 con 0x7f49a0159a60 2023-10-06T01:25:25.188 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:25.184+0000 7f49a719d700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f49a0158600 con 0x7f49a00c79f0 2023-10-06T01:25:25.188 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:25.185+0000 7f49a619b700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f49a00675f0 0x7f49a01580c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:25:25.189 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:25.185+0000 7f49a619b700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f49a00675f0 0x7f49a01580c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:47924/0 (socket says 172.21.15.50:47924) 2023-10-06T01:25:25.189 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:25.185+0000 7f49a619b700 1 -- 172.21.15.50:0/3169630991 learned_addr learned my addr 172.21.15.50:0/3169630991 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-06T01:25:25.189 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:25.185+0000 7f49a619b700 1 -- 172.21.15.50:0/3169630991 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f49a00c79f0 msgr2=0x7f49a0169ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:25:25.189 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:25.185+0000 7f49a619b700 1 --2- 172.21.15.50:0/3169630991 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f49a00c79f0 0x7f49a0169ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:25:25.189 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:25.185+0000 7f49a619b700 1 -- 172.21.15.50:0/3169630991 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f49a0159a60 msgr2=0x7f49a00a98f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:25:25.189 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:25.185+0000 7f49a619b700 1 --2- 172.21.15.50:0/3169630991 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f49a0159a60 0x7f49a00a98f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:25:25.189 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:25.185+0000 7f49a619b700 1 -- 172.21.15.50:0/3169630991 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f499c009480 con 0x7f49a00675f0 2023-10-06T01:25:25.189 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:25.185+0000 7f49a619b700 1 --2- 172.21.15.50:0/3169630991 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f49a00675f0 0x7f49a01580c0 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f499c00b3c0 tx=0x7f499c016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:25:25.189 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:25.186+0000 7f49967fc700 1 -- 172.21.15.50:0/3169630991 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f499c011920 con 0x7f49a00675f0 2023-10-06T01:25:25.189 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:25.186+0000 7f49967fc700 1 -- 172.21.15.50:0/3169630991 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f499c020070 con 0x7f49a00675f0 2023-10-06T01:25:25.189 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:25.186+0000 7f49967fc700 1 -- 172.21.15.50:0/3169630991 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f499c011cb0 con 0x7f49a00675f0 2023-10-06T01:25:25.189 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:25.186+0000 7f49a719d700 1 -- 172.21.15.50:0/3169630991 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f49a016a8a0 con 0x7f49a00675f0 2023-10-06T01:25:25.190 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:25.186+0000 7f49a719d700 1 -- 172.21.15.50:0/3169630991 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f49a00ad7b0 con 0x7f49a00675f0 2023-10-06T01:25:25.190 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:25.187+0000 7f49a719d700 1 -- 172.21.15.50:0/3169630991 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f49a005f270 con 0x7f49a00675f0 2023-10-06T01:25:25.190 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:25.188+0000 7f49967fc700 1 -- 172.21.15.50:0/3169630991 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f499c022030 con 0x7f49a00675f0 2023-10-06T01:25:25.190 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:25.188+0000 7f49967fc700 1 --2- 172.21.15.50:0/3169630991 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f4984066f30 0x7f49840693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:25:25.191 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:25.188+0000 7f49967fc700 1 -- 172.21.15.50:0/3169630991 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6436+0+0 (secure 0 0 0) 0x7f499c086450 con 0x7f49a00675f0 2023-10-06T01:25:25.191 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:25.189+0000 7f49a599a700 1 --2- 172.21.15.50:0/3169630991 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f4984066f30 0x7f49840693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:25:25.192 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:25.190+0000 7f49a599a700 1 --2- 172.21.15.50:0/3169630991 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f4984066f30 0x7f49840693e0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f49a00ab430 tx=0x7f4990008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:25:25.194 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:25.193+0000 7f49967fc700 1 -- 172.21.15.50:0/3169630991 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f499c053340 con 0x7f49a00675f0 2023-10-06T01:25:25.440 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:25.438+0000 7f49a719d700 1 -- 172.21.15.50:0/3169630991 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f49a00b09a0 con 0x7f49a00675f0 2023-10-06T01:25:25.440 INFO:tasks.ceph.mon.a.smithi050.stderr:2023-10-06T01:25:25.439+0000 7f6cf57f1700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-10-06T01:25:25.445 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:25.444+0000 7f49967fc700 1 -- 172.21.15.50:0/3169630991 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v19) v1 ==== 161+0+0 (secure 0 0 0) 0x7f499c056960 con 0x7f49a00675f0 2023-10-06T01:25:25.449 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:25.447+0000 7f49a719d700 1 -- 172.21.15.50:0/3169630991 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f4984066f30 msgr2=0x7f49840693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:25:25.449 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:25.447+0000 7f49a719d700 1 --2- 172.21.15.50:0/3169630991 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f4984066f30 0x7f49840693e0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f49a00ab430 tx=0x7f4990008040 comp rx=0 tx=0).stop 2023-10-06T01:25:25.449 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:25.447+0000 7f49a719d700 1 -- 172.21.15.50:0/3169630991 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f49a00675f0 msgr2=0x7f49a01580c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:25:25.450 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:25.447+0000 7f49a719d700 1 --2- 172.21.15.50:0/3169630991 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f49a00675f0 0x7f49a01580c0 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f499c00b3c0 tx=0x7f499c016000 comp rx=0 tx=0).stop 2023-10-06T01:25:25.450 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:25.447+0000 7f49a719d700 1 -- 172.21.15.50:0/3169630991 shutdown_connections 2023-10-06T01:25:25.450 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:25.447+0000 7f49a719d700 1 --2- 172.21.15.50:0/3169630991 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f4984066f30 0x7f49840693e0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:25:25.450 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:25.447+0000 7f49a719d700 1 --2- 172.21.15.50:0/3169630991 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f49a0159a60 0x7f49a00a98f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:25:25.450 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:25.447+0000 7f49a719d700 1 --2- 172.21.15.50:0/3169630991 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f49a00675f0 0x7f49a01580c0 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:25:25.450 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:25.447+0000 7f49a719d700 1 --2- 172.21.15.50:0/3169630991 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f49a00c79f0 0x7f49a0169ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:25:25.450 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:25.447+0000 7f49a719d700 1 -- 172.21.15.50:0/3169630991 >> 172.21.15.50:0/3169630991 conn(0x7f49a0068700 msgr2=0x7f49a00b0060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:25:25.450 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:25.447+0000 7f49a719d700 1 -- 172.21.15.50:0/3169630991 shutdown_connections 2023-10-06T01:25:25.450 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:25.447+0000 7f49a719d700 1 -- 172.21.15.50:0/3169630991 wait complete. 2023-10-06T01:25:25.451 INFO:teuthology.orchestra.run.smithi050.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-10-06T01:25:25.468 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-10-06T01:25:25.511 INFO:tasks.ceph.mds.c.smithi050.stdout:starting mds.c at 2023-10-06T01:25:25.661 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:25.659+0000 7f58e499d700 1 Processor -- start 2023-10-06T01:25:25.661 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:25.659+0000 7f58e499d700 1 -- start start 2023-10-06T01:25:25.664 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:25.661+0000 7f58e499d700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f58e014c350 0x7f58e0156ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:25:25.664 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:25.661+0000 7f58e499d700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f58e014c720 0x7f58e0155dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:25:25.664 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:25.661+0000 7f58e499d700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f58e00ad650 con 0x7f58e0156310 2023-10-06T01:25:25.664 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:25.661+0000 7f58e499d700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f58e01568c0 con 0x7f58e014c720 2023-10-06T01:25:25.664 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:25.661+0000 7f58e499d700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58e0156ba0 con 0x7f58e014c350 2023-10-06T01:25:25.664 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:25.661+0000 7f58deffd700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f58e014c720 0x7f58e0155dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:25:25.664 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:25.661+0000 7f58deffd700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f58e014c720 0x7f58e0155dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:47940/0 (socket says 172.21.15.50:47940) 2023-10-06T01:25:25.664 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:25.661+0000 7f58deffd700 1 -- 172.21.15.50:0/535017467 learned_addr learned my addr 172.21.15.50:0/535017467 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-06T01:25:25.665 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:25.661+0000 7f58df7fe700 1 --2- 172.21.15.50:0/535017467 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f58e014c350 0x7f58e0156ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:25:25.665 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:25.662+0000 7f58deffd700 1 -- 172.21.15.50:0/535017467 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f58e014c350 msgr2=0x7f58e0156ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:25:25.665 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:25.662+0000 7f58deffd700 1 --2- 172.21.15.50:0/535017467 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f58e014c350 0x7f58e0156ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:25:25.665 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:25.662+0000 7f58deffd700 1 -- 172.21.15.50:0/535017467 >> v1:172.21.15.155:6789/0 conn(0x7f58e0156310 legacy=0x7f58e006ea30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:25:25.665 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:25.662+0000 7f58deffd700 1 -- 172.21.15.50:0/535017467 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58e00ad000 con 0x7f58e014c720 2023-10-06T01:25:25.665 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:25.662+0000 7f58deffd700 1 --2- 172.21.15.50:0/535017467 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f58e014c720 0x7f58e0155dd0 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f58d40099e0 tx=0x7f58d4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cc037d9cc24cc67e server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:25:25.665 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:25.662+0000 7f58de7fc700 1 -- 172.21.15.50:0/535017467 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58d400b820 con 0x7f58e014c720 2023-10-06T01:25:25.665 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:25.662+0000 7f58de7fc700 1 -- 172.21.15.50:0/535017467 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f58d400b980 con 0x7f58e014c720 2023-10-06T01:25:25.665 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:25.662+0000 7f58de7fc700 1 -- 172.21.15.50:0/535017467 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58d400bd20 con 0x7f58e014c720 2023-10-06T01:25:25.666 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:25.663+0000 7f58e499d700 1 -- 172.21.15.50:0/535017467 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f58e014c720 msgr2=0x7f58e0155dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:25:25.666 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:25.663+0000 7f58e499d700 1 --2- 172.21.15.50:0/535017467 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f58e014c720 0x7f58e0155dd0 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f58d40099e0 tx=0x7f58d4009250 comp rx=0 tx=0).stop 2023-10-06T01:25:25.666 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:25.663+0000 7f58e499d700 1 -- 172.21.15.50:0/535017467 shutdown_connections 2023-10-06T01:25:25.667 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:25.663+0000 7f58e499d700 1 --2- 172.21.15.50:0/535017467 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f58e014c350 0x7f58e0156ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:25:25.667 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:25.663+0000 7f58e499d700 1 --2- 172.21.15.50:0/535017467 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f58e014c720 0x7f58e0155dd0 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:25:25.667 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:25.663+0000 7f58e499d700 1 -- 172.21.15.50:0/535017467 >> 172.21.15.50:0/535017467 conn(0x7f58e00cbed0 msgr2=0x7f58e00cc2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:25:25.667 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:25.663+0000 7f58e499d700 1 -- 172.21.15.50:0/535017467 shutdown_connections 2023-10-06T01:25:25.667 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:25.663+0000 7f58e499d700 1 -- 172.21.15.50:0/535017467 wait complete. 2023-10-06T01:25:25.667 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:25.664+0000 7f58e499d700 1 Processor -- start 2023-10-06T01:25:25.667 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:25.664+0000 7f58e499d700 1 -- start start 2023-10-06T01:25:25.668 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:25.665+0000 7f58e499d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f58e014c350 0x7f58e01379c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:25:25.669 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:25.665+0000 7f58e499d700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f58e014c720 0x7f58e014a8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:25:25.669 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:25.665+0000 7f58e499d700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f58e0156310 0x7f58e0150e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:25:25.669 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:25.665+0000 7f58e499d700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58e0152480 con 0x7f58e014c350 2023-10-06T01:25:25.669 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:25.665+0000 7f58e499d700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58e0151870 con 0x7f58e0156310 2023-10-06T01:25:25.669 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:25.665+0000 7f58e499d700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58e0151b50 con 0x7f58e014c720 2023-10-06T01:25:25.669 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:25.666+0000 7f58df7fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f58e014c350 0x7f58e01379c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:25:25.669 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:25.666+0000 7f58df7fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f58e014c350 0x7f58e01379c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:47948/0 (socket says 172.21.15.50:47948) 2023-10-06T01:25:25.669 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:25.666+0000 7f58df7fe700 1 -- 172.21.15.50:0/3815864205 learned_addr learned my addr 172.21.15.50:0/3815864205 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-06T01:25:25.669 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:25.666+0000 7f58dffff700 1 --2- 172.21.15.50:0/3815864205 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f58e0156310 0x7f58e0150e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:25:25.669 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:25.666+0000 7f58deffd700 1 --2- 172.21.15.50:0/3815864205 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f58e014c720 0x7f58e014a8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:25:25.669 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:25.666+0000 7f58df7fe700 1 -- 172.21.15.50:0/3815864205 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f58e014c720 msgr2=0x7f58e014a8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:25:25.670 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:25.666+0000 7f58df7fe700 1 --2- 172.21.15.50:0/3815864205 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f58e014c720 0x7f58e014a8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:25:25.670 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:25.666+0000 7f58df7fe700 1 -- 172.21.15.50:0/3815864205 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f58e0156310 msgr2=0x7f58e0150e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:25:25.670 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:25.666+0000 7f58df7fe700 1 --2- 172.21.15.50:0/3815864205 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f58e0156310 0x7f58e0150e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:25:25.670 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:25.666+0000 7f58df7fe700 1 -- 172.21.15.50:0/3815864205 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58d40094f0 con 0x7f58e014c350 2023-10-06T01:25:25.670 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:25.666+0000 7f58df7fe700 1 --2- 172.21.15.50:0/3815864205 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f58e014c350 0x7f58e01379c0 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f58d000d860 tx=0x7f58d0008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:25:25.670 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:25.666+0000 7f58c77fe700 1 -- 172.21.15.50:0/3815864205 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58d0009610 con 0x7f58e014c350 2023-10-06T01:25:25.670 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:25.667+0000 7f58c77fe700 1 -- 172.21.15.50:0/3815864205 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f58d0009770 con 0x7f58e014c350 2023-10-06T01:25:25.670 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:25.667+0000 7f58e499d700 1 -- 172.21.15.50:0/3815864205 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f58e0151e30 con 0x7f58e014c350 2023-10-06T01:25:25.670 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:25.667+0000 7f58c77fe700 1 -- 172.21.15.50:0/3815864205 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58d0009b30 con 0x7f58e014c350 2023-10-06T01:25:25.670 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:25.667+0000 7f58e499d700 1 -- 172.21.15.50:0/3815864205 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f58e014ae10 con 0x7f58e014c350 2023-10-06T01:25:25.671 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:25.668+0000 7f58e499d700 1 -- 172.21.15.50:0/3815864205 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f58e005f270 con 0x7f58e014c350 2023-10-06T01:25:25.671 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:25.668+0000 7f58c77fe700 1 -- 172.21.15.50:0/3815864205 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f58d001e460 con 0x7f58e014c350 2023-10-06T01:25:25.671 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:25.669+0000 7f58c77fe700 1 --2- 172.21.15.50:0/3815864205 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f58cc066f30 0x7f58cc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:25:25.671 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:25.669+0000 7f58c77fe700 1 -- 172.21.15.50:0/3815864205 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6522+0+0 (secure 0 0 0) 0x7f58d0084f70 con 0x7f58e014c350 2023-10-06T01:25:25.672 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:25.670+0000 7f58deffd700 1 --2- 172.21.15.50:0/3815864205 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f58cc066f30 0x7f58cc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:25:25.672 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:25.671+0000 7f58deffd700 1 --2- 172.21.15.50:0/3815864205 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f58cc066f30 0x7f58cc0693e0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f58d40099e0 tx=0x7f58d4017000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:25:25.675 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:25.673+0000 7f58c77fe700 1 -- 172.21.15.50:0/3815864205 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f58d0051e10 con 0x7f58e014c350 2023-10-06T01:25:25.925 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:25.923+0000 7f58e499d700 1 -- 172.21.15.50:0/3815864205 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f58e0152760 con 0x7f58e014c350 2023-10-06T01:25:26.449 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:26.447+0000 7f58c77fe700 1 -- 172.21.15.50:0/3815864205 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v20) v1 ==== 104+0+0 (secure 0 0 0) 0x7f58d0055430 con 0x7f58e014c350 2023-10-06T01:25:26.452 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:26.450+0000 7f58e499d700 1 -- 172.21.15.50:0/3815864205 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f58cc066f30 msgr2=0x7f58cc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:25:26.453 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:26.450+0000 7f58e499d700 1 --2- 172.21.15.50:0/3815864205 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f58cc066f30 0x7f58cc0693e0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f58d40099e0 tx=0x7f58d4017000 comp rx=0 tx=0).stop 2023-10-06T01:25:26.453 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:26.450+0000 7f58e499d700 1 -- 172.21.15.50:0/3815864205 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f58e014c350 msgr2=0x7f58e01379c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:25:26.453 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:26.450+0000 7f58e499d700 1 --2- 172.21.15.50:0/3815864205 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f58e014c350 0x7f58e01379c0 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f58d000d860 tx=0x7f58d0008040 comp rx=0 tx=0).stop 2023-10-06T01:25:26.453 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:26.450+0000 7f58e499d700 1 -- 172.21.15.50:0/3815864205 shutdown_connections 2023-10-06T01:25:26.453 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:26.450+0000 7f58e499d700 1 --2- 172.21.15.50:0/3815864205 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f58cc066f30 0x7f58cc0693e0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:25:26.453 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:26.450+0000 7f58e499d700 1 --2- 172.21.15.50:0/3815864205 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f58e0156310 0x7f58e0150e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:25:26.453 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:26.450+0000 7f58e499d700 1 --2- 172.21.15.50:0/3815864205 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f58e014c350 0x7f58e01379c0 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:25:26.453 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:26.450+0000 7f58e499d700 1 --2- 172.21.15.50:0/3815864205 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f58e014c720 0x7f58e014a8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:25:26.453 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:26.450+0000 7f58e499d700 1 -- 172.21.15.50:0/3815864205 >> 172.21.15.50:0/3815864205 conn(0x7f58e00cbed0 msgr2=0x7f58e0157be0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:25:26.453 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:26.451+0000 7f58e499d700 1 -- 172.21.15.50:0/3815864205 shutdown_connections 2023-10-06T01:25:26.454 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:26.451+0000 7f58e499d700 1 -- 172.21.15.50:0/3815864205 wait complete. 2023-10-06T01:25:26.472 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-10-06T01:25:26.706 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:26.704+0000 7f56aa39d700 1 Processor -- start 2023-10-06T01:25:26.706 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:26.704+0000 7f56aa39d700 1 -- start start 2023-10-06T01:25:26.708 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:26.705+0000 7f56aa39d700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f56a4159330 0x7f56a40b25e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:25:26.708 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:26.705+0000 7f56aa39d700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f56a40b4370 0x7f56a40b0bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:25:26.708 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:26.705+0000 7f56aa39d700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f56a40cffc0 con 0x7f56a40b5e50 2023-10-06T01:25:26.708 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:26.705+0000 7f56aa39d700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f56a40afbb0 con 0x7f56a4159330 2023-10-06T01:25:26.708 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:26.705+0000 7f56aa39d700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f56a40b2b20 con 0x7f56a40b4370 2023-10-06T01:25:26.708 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:26.705+0000 7f56a939b700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f56a4159330 0x7f56a40b25e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:25:26.708 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:26.706+0000 7f56a939b700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f56a4159330 0x7f56a40b25e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:47964/0 (socket says 172.21.15.50:47964) 2023-10-06T01:25:26.708 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:26.706+0000 7f56a939b700 1 -- 172.21.15.50:0/64413599 learned_addr learned my addr 172.21.15.50:0/64413599 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-06T01:25:26.708 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:26.706+0000 7f56a9b9c700 1 --2- 172.21.15.50:0/64413599 >> v2:172.21.15.155:3300/0 conn(0x7f56a40b4370 0x7f56a40b0bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:25:26.709 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:26.706+0000 7f56a939b700 1 -- 172.21.15.50:0/64413599 >> v2:172.21.15.155:3300/0 conn(0x7f56a40b4370 msgr2=0x7f56a40b0bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:25:26.709 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:26.706+0000 7f56a939b700 1 --2- 172.21.15.50:0/64413599 >> v2:172.21.15.155:3300/0 conn(0x7f56a40b4370 0x7f56a40b0bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:25:26.709 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:26.706+0000 7f56a939b700 1 -- 172.21.15.50:0/64413599 >> v1:172.21.15.155:6789/0 conn(0x7f56a40b5e50 legacy=0x7f56a40b3c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:25:26.709 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:26.706+0000 7f56a939b700 1 -- 172.21.15.50:0/64413599 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56a40afe00 con 0x7f56a4159330 2023-10-06T01:25:26.709 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:26.706+0000 7f56a939b700 1 --2- 172.21.15.50:0/64413599 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f56a4159330 0x7f56a40b25e0 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f56a40af8f0 tx=0x7f56a0009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=77984ead824b4992 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:25:26.710 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:26.706+0000 7f569bfff700 1 -- 172.21.15.50:0/64413599 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56a000b860 con 0x7f56a4159330 2023-10-06T01:25:26.710 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:26.707+0000 7f569bfff700 1 -- 172.21.15.50:0/64413599 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f56a000b9c0 con 0x7f56a4159330 2023-10-06T01:25:26.710 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:26.707+0000 7f569bfff700 1 -- 172.21.15.50:0/64413599 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56a000bd60 con 0x7f56a4159330 2023-10-06T01:25:26.710 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:26.707+0000 7f56aa39d700 1 -- 172.21.15.50:0/64413599 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f56a4159330 msgr2=0x7f56a40b25e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:25:26.710 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:26.707+0000 7f56aa39d700 1 --2- 172.21.15.50:0/64413599 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f56a4159330 0x7f56a40b25e0 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f56a40af8f0 tx=0x7f56a0009250 comp rx=0 tx=0).stop 2023-10-06T01:25:26.710 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:26.707+0000 7f56aa39d700 1 -- 172.21.15.50:0/64413599 shutdown_connections 2023-10-06T01:25:26.710 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:26.707+0000 7f56aa39d700 1 --2- 172.21.15.50:0/64413599 >> v2:172.21.15.155:3300/0 conn(0x7f56a40b4370 0x7f56a40b0bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:25:26.710 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:26.707+0000 7f56aa39d700 1 --2- 172.21.15.50:0/64413599 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f56a4159330 0x7f56a40b25e0 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:25:26.710 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:26.707+0000 7f56aa39d700 1 -- 172.21.15.50:0/64413599 >> 172.21.15.50:0/64413599 conn(0x7f56a4099520 msgr2=0x7f56a406f500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:25:26.711 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:26.707+0000 7f56aa39d700 1 -- 172.21.15.50:0/64413599 shutdown_connections 2023-10-06T01:25:26.711 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:26.707+0000 7f56aa39d700 1 -- 172.21.15.50:0/64413599 wait complete. 2023-10-06T01:25:26.712 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:26.709+0000 7f56aa39d700 1 Processor -- start 2023-10-06T01:25:26.712 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:26.709+0000 7f56aa39d700 1 -- start start 2023-10-06T01:25:26.712 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:26.710+0000 7f56aa39d700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f56a40b4370 0x7f56a40cf200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:25:26.712 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:26.710+0000 7f56aa39d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f56a40b5e50 0x7f56a4147810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:25:26.712 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:26.710+0000 7f56aa39d700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f56a4159330 0x7f56a4099f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:25:26.712 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:26.710+0000 7f56aa39d700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56a4155630 con 0x7f56a40b5e50 2023-10-06T01:25:26.712 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:26.710+0000 7f56aa39d700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56a40af6f0 con 0x7f56a4159330 2023-10-06T01:25:26.712 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:26.710+0000 7f56aa39d700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56a4146770 con 0x7f56a40b4370 2023-10-06T01:25:26.713 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:26.710+0000 7f56a8b9a700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f56a40b5e50 0x7f56a4147810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:25:26.713 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:26.710+0000 7f56a8b9a700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f56a40b5e50 0x7f56a4147810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:47972/0 (socket says 172.21.15.50:47972) 2023-10-06T01:25:26.713 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:26.710+0000 7f56a8b9a700 1 -- 172.21.15.50:0/1487142600 learned_addr learned my addr 172.21.15.50:0/1487142600 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-06T01:25:26.713 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:26.710+0000 7f56a9b9c700 1 --2- 172.21.15.50:0/1487142600 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f56a4159330 0x7f56a4099f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:25:26.713 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:26.710+0000 7f56a939b700 1 --2- 172.21.15.50:0/1487142600 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f56a40b4370 0x7f56a40cf200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:25:26.714 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:26.711+0000 7f56a8b9a700 1 -- 172.21.15.50:0/1487142600 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f56a40b4370 msgr2=0x7f56a40cf200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:25:26.714 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:26.711+0000 7f56a8b9a700 1 --2- 172.21.15.50:0/1487142600 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f56a40b4370 0x7f56a40cf200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:25:26.714 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:26.711+0000 7f56a8b9a700 1 -- 172.21.15.50:0/1487142600 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f56a4159330 msgr2=0x7f56a4099f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:25:26.714 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:26.711+0000 7f56a8b9a700 1 --2- 172.21.15.50:0/1487142600 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f56a4159330 0x7f56a4099f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:25:26.714 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:26.711+0000 7f56a8b9a700 1 -- 172.21.15.50:0/1487142600 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56a00094f0 con 0x7f56a40b5e50 2023-10-06T01:25:26.715 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:26.711+0000 7f56a8b9a700 1 --2- 172.21.15.50:0/1487142600 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f56a40b5e50 0x7f56a4147810 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f569400c590 tx=0x7f569400c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:25:26.715 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:26.711+0000 7f56997fa700 1 -- 172.21.15.50:0/1487142600 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5694011590 con 0x7f56a40b5e50 2023-10-06T01:25:26.715 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:26.711+0000 7f56997fa700 1 -- 172.21.15.50:0/1487142600 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f56940116f0 con 0x7f56a40b5e50 2023-10-06T01:25:26.715 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:26.711+0000 7f56997fa700 1 -- 172.21.15.50:0/1487142600 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5694011ab0 con 0x7f56a40b5e50 2023-10-06T01:25:26.715 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:26.711+0000 7f56aa39d700 1 -- 172.21.15.50:0/1487142600 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f56a4146a50 con 0x7f56a40b5e50 2023-10-06T01:25:26.715 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:26.711+0000 7f56aa39d700 1 -- 172.21.15.50:0/1487142600 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f56a4147010 con 0x7f56a40b5e50 2023-10-06T01:25:26.715 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:26.712+0000 7f56aa39d700 1 -- 172.21.15.50:0/1487142600 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f56a405f270 con 0x7f56a40b5e50 2023-10-06T01:25:26.716 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:26.713+0000 7f56997fa700 1 -- 172.21.15.50:0/1487142600 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f569401b3b0 con 0x7f56a40b5e50 2023-10-06T01:25:26.716 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:26.714+0000 7f56997fa700 1 --2- 172.21.15.50:0/1487142600 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f5688066f30 0x7f56880693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:25:26.716 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:26.714+0000 7f56997fa700 1 -- 172.21.15.50:0/1487142600 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6522+0+0 (secure 0 0 0) 0x7f5694083e20 con 0x7f56a40b5e50 2023-10-06T01:25:26.716 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:26.714+0000 7f56a939b700 1 --2- 172.21.15.50:0/1487142600 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f5688066f30 0x7f56880693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:25:26.717 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:26.715+0000 7f56a939b700 1 --2- 172.21.15.50:0/1487142600 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f5688066f30 0x7f56880693e0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f56a40af8f0 tx=0x7f56a0017000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:25:26.719 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:26.718+0000 7f56997fa700 1 -- 172.21.15.50:0/1487142600 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f5694050cc0 con 0x7f56a40b5e50 2023-10-06T01:25:26.921 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:26.920+0000 7f56aa39d700 1 -- 172.21.15.50:0/1487142600 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f56a4156f60 con 0x7f56a40b5e50 2023-10-06T01:25:27.904 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:27.902+0000 7f56997fa700 1 -- 172.21.15.50:0/1487142600 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v43) v1 ==== 181+0+0 (secure 0 0 0) 0x7f5694017070 con 0x7f56a40b5e50 2023-10-06T01:25:27.910 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:27.908+0000 7f56aa39d700 1 -- 172.21.15.50:0/1487142600 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f5688066f30 msgr2=0x7f56880693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:25:27.910 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:27.908+0000 7f56aa39d700 1 --2- 172.21.15.50:0/1487142600 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f5688066f30 0x7f56880693e0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f56a40af8f0 tx=0x7f56a0017000 comp rx=0 tx=0).stop 2023-10-06T01:25:27.910 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:27.908+0000 7f56aa39d700 1 -- 172.21.15.50:0/1487142600 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f56a40b5e50 msgr2=0x7f56a4147810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:25:27.911 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:27.908+0000 7f56aa39d700 1 --2- 172.21.15.50:0/1487142600 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f56a40b5e50 0x7f56a4147810 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f569400c590 tx=0x7f569400c950 comp rx=0 tx=0).stop 2023-10-06T01:25:27.911 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:27.908+0000 7f56aa39d700 1 -- 172.21.15.50:0/1487142600 shutdown_connections 2023-10-06T01:25:27.911 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:27.908+0000 7f56aa39d700 1 --2- 172.21.15.50:0/1487142600 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f5688066f30 0x7f56880693e0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:25:27.911 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:27.908+0000 7f56aa39d700 1 --2- 172.21.15.50:0/1487142600 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f56a4159330 0x7f56a4099f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:25:27.911 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:27.908+0000 7f56aa39d700 1 --2- 172.21.15.50:0/1487142600 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f56a40b4370 0x7f56a40cf200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:25:27.911 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:27.908+0000 7f56aa39d700 1 --2- 172.21.15.50:0/1487142600 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f56a40b5e50 0x7f56a4147810 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:25:27.911 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:27.908+0000 7f56aa39d700 1 -- 172.21.15.50:0/1487142600 >> 172.21.15.50:0/1487142600 conn(0x7f56a4099520 msgr2=0x7f56a4069000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:25:27.911 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:27.909+0000 7f56aa39d700 1 -- 172.21.15.50:0/1487142600 shutdown_connections 2023-10-06T01:25:27.912 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:27.909+0000 7f56aa39d700 1 -- 172.21.15.50:0/1487142600 wait complete. 2023-10-06T01:25:27.912 INFO:teuthology.orchestra.run.smithi050.stderr:pool 'cephfs_metadata' removed 2023-10-06T01:25:27.932 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-10-06T01:25:28.129 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:28.127+0000 7f02df59e700 1 Processor -- start 2023-10-06T01:25:28.129 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:28.127+0000 7f02df59e700 1 -- start start 2023-10-06T01:25:28.131 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:28.129+0000 7f02df59e700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f02e0154da0 0x7f02e00b0fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:25:28.131 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:28.129+0000 7f02df59e700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f02e00b14f0 0x7f02e00c9990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:25:28.131 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:28.129+0000 7f02df59e700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f02e00b1940 con 0x7f02e00c9ed0 2023-10-06T01:25:28.131 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:28.129+0000 7f02df59e700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f02e0155170 con 0x7f02e0154da0 2023-10-06T01:25:28.131 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:28.129+0000 7f02df59e700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f02e00cb340 con 0x7f02e00b14f0 2023-10-06T01:25:28.131 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:28.129+0000 7f02de59c700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f02e0154da0 0x7f02e00b0fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:25:28.131 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:28.129+0000 7f02ddd9b700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f02e00b14f0 0x7f02e00c9990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:25:28.131 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:28.129+0000 7f02de59c700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f02e0154da0 0x7f02e00b0fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.50:34028/0 (socket says 172.21.15.50:34028) 2023-10-06T01:25:28.131 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:28.129+0000 7f02de59c700 1 -- 172.21.15.50:0/3935319354 learned_addr learned my addr 172.21.15.50:0/3935319354 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-06T01:25:28.133 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:28.130+0000 7f02dd59a700 1 -- 172.21.15.50:0/3935319354 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3836460378 0 0) 0x7f02e00b1940 con 0x7f02e00c9ed0 2023-10-06T01:25:28.133 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:28.130+0000 7f02ddd9b700 1 -- 172.21.15.50:0/3935319354 >> v2:172.21.15.155:3300/0 conn(0x7f02e0154da0 msgr2=0x7f02e00b0fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:25:28.133 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:28.130+0000 7f02ddd9b700 1 --2- 172.21.15.50:0/3935319354 >> v2:172.21.15.155:3300/0 conn(0x7f02e0154da0 0x7f02e00b0fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:25:28.133 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:28.130+0000 7f02ddd9b700 1 -- 172.21.15.50:0/3935319354 >> v1:172.21.15.155:6789/0 conn(0x7f02e00c9ed0 legacy=0x7f02e006e170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:25:28.133 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:28.130+0000 7f02ddd9b700 1 -- 172.21.15.50:0/3935319354 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02e00ca730 con 0x7f02e00b14f0 2023-10-06T01:25:28.133 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:28.130+0000 7f02de59c700 1 --2- 172.21.15.50:0/3935319354 >> v2:172.21.15.155:3300/0 conn(0x7f02e0154da0 0x7f02e00b0fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T01:25:28.133 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:28.130+0000 7f02ddd9b700 1 --2- 172.21.15.50:0/3935319354 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f02e00b14f0 0x7f02e00c9990 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f02d40098e0 tx=0x7f02d40091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=dbe5b59f1c5a90a8 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:25:28.134 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:28.130+0000 7f02dd59a700 1 -- 172.21.15.50:0/3935319354 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02d400b640 con 0x7f02e00b14f0 2023-10-06T01:25:28.134 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:28.130+0000 7f02dd59a700 1 -- 172.21.15.50:0/3935319354 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f02d400b7a0 con 0x7f02e00b14f0 2023-10-06T01:25:28.134 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:28.130+0000 7f02dd59a700 1 -- 172.21.15.50:0/3935319354 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02d400bb40 con 0x7f02e00b14f0 2023-10-06T01:25:28.134 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:28.131+0000 7f02df59e700 1 -- 172.21.15.50:0/3935319354 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f02e00b14f0 msgr2=0x7f02e00c9990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:25:28.134 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:28.131+0000 7f02df59e700 1 --2- 172.21.15.50:0/3935319354 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f02e00b14f0 0x7f02e00c9990 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f02d40098e0 tx=0x7f02d40091a0 comp rx=0 tx=0).stop 2023-10-06T01:25:28.134 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:28.131+0000 7f02df59e700 1 -- 172.21.15.50:0/3935319354 shutdown_connections 2023-10-06T01:25:28.134 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:28.131+0000 7f02df59e700 1 --2- 172.21.15.50:0/3935319354 >> v2:172.21.15.155:3300/0 conn(0x7f02e0154da0 0x7f02e00b0fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:25:28.134 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:28.131+0000 7f02df59e700 1 --2- 172.21.15.50:0/3935319354 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f02e00b14f0 0x7f02e00c9990 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:25:28.134 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:28.131+0000 7f02df59e700 1 -- 172.21.15.50:0/3935319354 >> 172.21.15.50:0/3935319354 conn(0x7f02e00cbee0 msgr2=0x7f02e00cc2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:25:28.134 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:28.131+0000 7f02df59e700 1 -- 172.21.15.50:0/3935319354 shutdown_connections 2023-10-06T01:25:28.134 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:28.131+0000 7f02df59e700 1 -- 172.21.15.50:0/3935319354 wait complete. 2023-10-06T01:25:28.136 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:28.132+0000 7f02df59e700 1 Processor -- start 2023-10-06T01:25:28.136 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:28.133+0000 7f02df59e700 1 -- start start 2023-10-06T01:25:28.136 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:28.133+0000 7f02df59e700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f02e00b14f0 0x7f02e0151be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:25:28.136 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:28.133+0000 7f02df59e700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f02e00c9ed0 0x7f02e0169ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:25:28.136 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:28.133+0000 7f02df59e700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f02e0154da0 0x7f02e00c51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:25:28.136 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:28.133+0000 7f02df59e700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02e00c63c0 con 0x7f02e00b14f0 2023-10-06T01:25:28.137 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:28.133+0000 7f02df59e700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02e00c6e50 con 0x7f02e00c9ed0 2023-10-06T01:25:28.137 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:28.133+0000 7f02df59e700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f02e016a010 con 0x7f02e0154da0 2023-10-06T01:25:28.137 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:28.134+0000 7f02de59c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f02e00b14f0 0x7f02e0151be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:25:28.137 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:28.134+0000 7f02de59c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f02e00b14f0 0x7f02e0151be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:47980/0 (socket says 172.21.15.50:47980) 2023-10-06T01:25:28.137 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:28.134+0000 7f02de59c700 1 -- 172.21.15.50:0/4049913834 learned_addr learned my addr 172.21.15.50:0/4049913834 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-06T01:25:28.137 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:28.134+0000 7f02ddd9b700 1 --2- 172.21.15.50:0/4049913834 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f02e00c9ed0 0x7f02e0169ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:25:28.137 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:28.134+0000 7f02ded9d700 1 --2- 172.21.15.50:0/4049913834 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f02e0154da0 0x7f02e00c51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:25:28.137 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:28.134+0000 7f02de59c700 1 -- 172.21.15.50:0/4049913834 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f02e0154da0 msgr2=0x7f02e00c51b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:25:28.137 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:28.134+0000 7f02de59c700 1 --2- 172.21.15.50:0/4049913834 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f02e0154da0 0x7f02e00c51b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:25:28.137 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:28.134+0000 7f02de59c700 1 -- 172.21.15.50:0/4049913834 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f02e00c9ed0 msgr2=0x7f02e0169ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:25:28.137 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:28.134+0000 7f02de59c700 1 --2- 172.21.15.50:0/4049913834 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f02e00c9ed0 0x7f02e0169ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:25:28.137 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:28.134+0000 7f02de59c700 1 -- 172.21.15.50:0/4049913834 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02d00094f0 con 0x7f02e00b14f0 2023-10-06T01:25:28.138 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:28.134+0000 7f02ddd9b700 1 --2- 172.21.15.50:0/4049913834 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f02e00c9ed0 0x7f02e0169ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T01:25:28.138 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:28.134+0000 7f02de59c700 1 --2- 172.21.15.50:0/4049913834 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f02e00b14f0 0x7f02e0151be0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f02d000ec50 tx=0x7f02d0009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:25:28.139 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:28.135+0000 7f02ce7fc700 1 -- 172.21.15.50:0/4049913834 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02d000c9d0 con 0x7f02e00b14f0 2023-10-06T01:25:28.139 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:28.135+0000 7f02ce7fc700 1 -- 172.21.15.50:0/4049913834 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f02d000cb30 con 0x7f02e00b14f0 2023-10-06T01:25:28.139 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:28.135+0000 7f02df59e700 1 -- 172.21.15.50:0/4049913834 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f02d4009420 con 0x7f02e00b14f0 2023-10-06T01:25:28.139 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:28.135+0000 7f02ce7fc700 1 -- 172.21.15.50:0/4049913834 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02d0013470 con 0x7f02e00b14f0 2023-10-06T01:25:28.139 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:28.135+0000 7f02df59e700 1 -- 172.21.15.50:0/4049913834 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f02e00c5e00 con 0x7f02e00b14f0 2023-10-06T01:25:28.139 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:28.136+0000 7f02df59e700 1 -- 172.21.15.50:0/4049913834 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f02e005f270 con 0x7f02e00b14f0 2023-10-06T01:25:28.139 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:28.137+0000 7f02ce7fc700 1 -- 172.21.15.50:0/4049913834 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f02d0013860 con 0x7f02e00b14f0 2023-10-06T01:25:28.140 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:28.138+0000 7f02ce7fc700 1 --2- 172.21.15.50:0/4049913834 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f02c0066f30 0x7f02c00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:25:28.140 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:28.138+0000 7f02ce7fc700 1 -- 172.21.15.50:0/4049913834 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 6084+0+0 (secure 0 0 0) 0x7f02d0084f90 con 0x7f02e00b14f0 2023-10-06T01:25:28.140 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:28.138+0000 7f02ddd9b700 1 --2- 172.21.15.50:0/4049913834 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f02c0066f30 0x7f02c00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:25:28.140 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:28.139+0000 7f02ddd9b700 1 --2- 172.21.15.50:0/4049913834 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f02c0066f30 0x7f02c00693e0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f02d40091e0 tx=0x7f02d4017000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:25:28.144 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:28.142+0000 7f02ce7fc700 1 -- 172.21.15.50:0/4049913834 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f02d0051fe0 con 0x7f02e00b14f0 2023-10-06T01:25:28.346 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:28.344+0000 7f02df59e700 1 -- 172.21.15.50:0/4049913834 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f02e01521a0 con 0x7f02e00b14f0 2023-10-06T01:25:28.905 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:28.903+0000 7f02ce7fc700 1 -- 172.21.15.50:0/4049913834 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v44) v1 ==== 169+0+0 (secure 0 0 0) 0x7f02d0055600 con 0x7f02e00b14f0 2023-10-06T01:25:28.911 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:28.909+0000 7f02df59e700 1 -- 172.21.15.50:0/4049913834 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f02c0066f30 msgr2=0x7f02c00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:25:28.911 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:28.909+0000 7f02df59e700 1 --2- 172.21.15.50:0/4049913834 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f02c0066f30 0x7f02c00693e0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f02d40091e0 tx=0x7f02d4017000 comp rx=0 tx=0).stop 2023-10-06T01:25:28.911 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:28.909+0000 7f02df59e700 1 -- 172.21.15.50:0/4049913834 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f02e00b14f0 msgr2=0x7f02e0151be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:25:28.912 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:28.909+0000 7f02df59e700 1 --2- 172.21.15.50:0/4049913834 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f02e00b14f0 0x7f02e0151be0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f02d000ec50 tx=0x7f02d0009250 comp rx=0 tx=0).stop 2023-10-06T01:25:28.912 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:28.909+0000 7f02df59e700 1 -- 172.21.15.50:0/4049913834 shutdown_connections 2023-10-06T01:25:28.912 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:28.909+0000 7f02df59e700 1 --2- 172.21.15.50:0/4049913834 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f02e0154da0 0x7f02e00c51b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:25:28.912 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:28.909+0000 7f02df59e700 1 --2- 172.21.15.50:0/4049913834 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f02e00b14f0 0x7f02e0151be0 secure :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f02d000ec50 tx=0x7f02d0009250 comp rx=0 tx=0).stop 2023-10-06T01:25:28.912 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:28.909+0000 7f02df59e700 1 --2- 172.21.15.50:0/4049913834 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f02c0066f30 0x7f02c00693e0 secure :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f02d40091e0 tx=0x7f02d4017000 comp rx=0 tx=0).stop 2023-10-06T01:25:28.912 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:28.909+0000 7f02df59e700 1 --2- 172.21.15.50:0/4049913834 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f02e00c9ed0 0x7f02e0169ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:25:28.912 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:28.909+0000 7f02df59e700 1 -- 172.21.15.50:0/4049913834 >> 172.21.15.50:0/4049913834 conn(0x7f02e00cbee0 msgr2=0x7f02e01556c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:25:28.913 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:28.911+0000 7f02df59e700 1 -- 172.21.15.50:0/4049913834 shutdown_connections 2023-10-06T01:25:28.913 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:28.911+0000 7f02df59e700 1 -- 172.21.15.50:0/4049913834 wait complete. 2023-10-06T01:25:28.916 INFO:teuthology.orchestra.run.smithi050.stderr:pool 'cephfs_data' removed 2023-10-06T01:25:28.935 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-10-06T01:25:29.125 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:29.123+0000 7ff29f19d700 1 Processor -- start 2023-10-06T01:25:29.130 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:29.124+0000 7ff29f19d700 1 -- start start 2023-10-06T01:25:29.134 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:29.125+0000 7ff29f19d700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7ff298156000 0x7ff2980c89f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:25:29.134 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:29.125+0000 7ff29f19d700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff2980b0730 0x7ff29806e5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:25:29.134 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:29.125+0000 7ff29f19d700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff2980ad650 con 0x7ff29806e1a0 2023-10-06T01:25:29.134 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:29.125+0000 7ff29f19d700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff2980c8f30 con 0x7ff298156000 2023-10-06T01:25:29.135 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:29.125+0000 7ff29f19d700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff29806eb30 con 0x7ff2980b0730 2023-10-06T01:25:29.135 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:29.126+0000 7ff29e19b700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7ff298156000 0x7ff2980c89f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:25:29.135 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:29.126+0000 7ff29d99a700 1 --1- >> v1:172.21.15.155:6789/0 conn(0x7ff29806e1a0 0x7ff2980b0020 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.155:6789/0 says I am v1:172.21.15.50:41182/0 (socket says 172.21.15.50:41182) 2023-10-06T01:25:29.135 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:29.126+0000 7ff29d99a700 1 -- 172.21.15.50:0/1293481545 learned_addr learned my addr 172.21.15.50:0/1293481545 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-10-06T01:25:29.135 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:29.126+0000 7ff29e99c700 1 --2- 172.21.15.50:0/1293481545 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff2980b0730 0x7ff29806e5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:25:29.135 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:29.126+0000 7ff29e19b700 1 -- 172.21.15.50:0/1293481545 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff2980b0730 msgr2=0x7ff29806e5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:25:29.135 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:29.126+0000 7ff29e19b700 1 --2- 172.21.15.50:0/1293481545 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff2980b0730 0x7ff29806e5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:25:29.135 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:29.126+0000 7ff29e19b700 1 -- 172.21.15.50:0/1293481545 >> v1:172.21.15.155:6789/0 conn(0x7ff29806e1a0 legacy=0x7ff2980b0020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:25:29.135 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:29.126+0000 7ff29e19b700 1 -- 172.21.15.50:0/1293481545 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2980b0b40 con 0x7ff298156000 2023-10-06T01:25:29.135 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:29.127+0000 7ff29e19b700 1 --2- 172.21.15.50:0/1293481545 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff298156000 0x7ff2980c89f0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7ff29400bb90 tx=0x7ff29400b430 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5b724cd3ec5c15ae server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:25:29.135 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:29.127+0000 7ff29d199700 1 -- 172.21.15.50:0/1293481545 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff29400dbd0 con 0x7ff298156000 2023-10-06T01:25:29.136 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:29.127+0000 7ff29d199700 1 -- 172.21.15.50:0/1293481545 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff29400dd30 con 0x7ff298156000 2023-10-06T01:25:29.136 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:29.127+0000 7ff29d199700 1 -- 172.21.15.50:0/1293481545 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff29400dea0 con 0x7ff298156000 2023-10-06T01:25:29.136 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:29.127+0000 7ff29f19d700 1 -- 172.21.15.50:0/1293481545 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff298156000 msgr2=0x7ff2980c89f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:25:29.136 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:29.127+0000 7ff29f19d700 1 --2- 172.21.15.50:0/1293481545 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff298156000 0x7ff2980c89f0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7ff29400bb90 tx=0x7ff29400b430 comp rx=0 tx=0).stop 2023-10-06T01:25:29.136 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:29.127+0000 7ff29f19d700 1 -- 172.21.15.50:0/1293481545 shutdown_connections 2023-10-06T01:25:29.136 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:29.127+0000 7ff29f19d700 1 --2- 172.21.15.50:0/1293481545 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff298156000 0x7ff2980c89f0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:25:29.136 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:29.127+0000 7ff29f19d700 1 --2- 172.21.15.50:0/1293481545 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff2980b0730 0x7ff29806e5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:25:29.136 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:29.128+0000 7ff29f19d700 1 -- 172.21.15.50:0/1293481545 >> 172.21.15.50:0/1293481545 conn(0x7ff2980cbed0 msgr2=0x7ff2980cc2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:25:29.136 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:29.128+0000 7ff29f19d700 1 -- 172.21.15.50:0/1293481545 shutdown_connections 2023-10-06T01:25:29.136 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:29.128+0000 7ff29f19d700 1 -- 172.21.15.50:0/1293481545 wait complete. 2023-10-06T01:25:29.136 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:29.129+0000 7ff29f19d700 1 Processor -- start 2023-10-06T01:25:29.136 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:29.129+0000 7ff29f19d700 1 -- start start 2023-10-06T01:25:29.137 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:29.130+0000 7ff29f19d700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff29806e1a0 0x7ff29814c120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:25:29.137 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:29.130+0000 7ff29f19d700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff2980b0730 0x7ff2980c7840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:25:29.137 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:29.130+0000 7ff29f19d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff298156000 0x7ff298154ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:25:29.137 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:29.130+0000 7ff29f19d700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2980c60e0 con 0x7ff298156000 2023-10-06T01:25:29.137 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:29.130+0000 7ff29f19d700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2980c54d0 con 0x7ff2980b0730 2023-10-06T01:25:29.137 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:29.130+0000 7ff29f19d700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2980c57b0 con 0x7ff29806e1a0 2023-10-06T01:25:29.137 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:29.130+0000 7ff29e99c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff298156000 0x7ff298154ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:25:29.137 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:29.130+0000 7ff29e99c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff298156000 0x7ff298154ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:47986/0 (socket says 172.21.15.50:47986) 2023-10-06T01:25:29.137 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:29.130+0000 7ff29e99c700 1 -- 172.21.15.50:0/2162518508 learned_addr learned my addr 172.21.15.50:0/2162518508 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-06T01:25:29.137 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:29.130+0000 7ff29e19b700 1 --2- 172.21.15.50:0/2162518508 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff29806e1a0 0x7ff29814c120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:25:29.137 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:29.131+0000 7ff29d99a700 1 --2- 172.21.15.50:0/2162518508 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff2980b0730 0x7ff2980c7840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:25:29.137 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:29.131+0000 7ff29e99c700 1 -- 172.21.15.50:0/2162518508 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff29806e1a0 msgr2=0x7ff29814c120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:25:29.138 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:29.131+0000 7ff29e99c700 1 --2- 172.21.15.50:0/2162518508 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff29806e1a0 0x7ff29814c120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:25:29.138 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:29.131+0000 7ff29e99c700 1 -- 172.21.15.50:0/2162518508 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff2980b0730 msgr2=0x7ff2980c7840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:25:29.138 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:29.131+0000 7ff29e99c700 1 --2- 172.21.15.50:0/2162518508 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff2980b0730 0x7ff2980c7840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:25:29.138 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:29.131+0000 7ff29e99c700 1 -- 172.21.15.50:0/2162518508 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff29400b6d0 con 0x7ff298156000 2023-10-06T01:25:29.138 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:29.131+0000 7ff29e19b700 1 --2- 172.21.15.50:0/2162518508 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff29806e1a0 0x7ff29814c120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T01:25:29.138 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:29.131+0000 7ff29e99c700 1 --2- 172.21.15.50:0/2162518508 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff298156000 0x7ff298154ab0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7ff290009e90 tx=0x7ff29000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:25:29.138 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:29.131+0000 7ff28e7fc700 1 -- 172.21.15.50:0/2162518508 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff29000cb70 con 0x7ff298156000 2023-10-06T01:25:29.138 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:29.131+0000 7ff28e7fc700 1 -- 172.21.15.50:0/2162518508 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff29000f040 con 0x7ff298156000 2023-10-06T01:25:29.138 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:29.131+0000 7ff29f19d700 1 -- 172.21.15.50:0/2162518508 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff2980c5a90 con 0x7ff298156000 2023-10-06T01:25:29.138 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:29.131+0000 7ff28e7fc700 1 -- 172.21.15.50:0/2162518508 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff290014480 con 0x7ff298156000 2023-10-06T01:25:29.138 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:29.132+0000 7ff29f19d700 1 -- 172.21.15.50:0/2162518508 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff29814c660 con 0x7ff298156000 2023-10-06T01:25:29.139 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:29.132+0000 7ff29f19d700 1 -- 172.21.15.50:0/2162518508 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff29805f270 con 0x7ff298156000 2023-10-06T01:25:29.139 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:29.133+0000 7ff28e7fc700 1 -- 172.21.15.50:0/2162518508 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7ff290014830 con 0x7ff298156000 2023-10-06T01:25:29.139 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:29.135+0000 7ff28e7fc700 1 --2- 172.21.15.50:0/2162518508 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7ff27c066f30 0x7ff27c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:25:29.139 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:29.135+0000 7ff28e7fc700 1 -- 172.21.15.50:0/2162518508 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5612+0+0 (secure 0 0 0) 0x7ff290085220 con 0x7ff298156000 2023-10-06T01:25:29.140 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:29.135+0000 7ff29e19b700 1 --2- 172.21.15.50:0/2162518508 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7ff27c066f30 0x7ff27c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:25:29.140 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:29.136+0000 7ff29e19b700 1 --2- 172.21.15.50:0/2162518508 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7ff27c066f30 0x7ff27c0693e0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7ff29400bfd0 tx=0x7ff29401b000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:25:29.141 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:29.139+0000 7ff28e7fc700 1 -- 172.21.15.50:0/2162518508 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff290052450 con 0x7ff298156000 2023-10-06T01:25:29.352 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:29.350+0000 7ff29f19d700 1 -- 172.21.15.50:0/2162518508 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7ff2980aca40 con 0x7ff298156000 2023-10-06T01:25:29.356 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:29.354+0000 7ff28e7fc700 1 -- 172.21.15.50:0/2162518508 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v11) v1 ==== 104+0+0 (secure 0 0 0) 0x7ff290055a70 con 0x7ff298156000 2023-10-06T01:25:29.359 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:29.356+0000 7ff29f19d700 1 -- 172.21.15.50:0/2162518508 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7ff27c066f30 msgr2=0x7ff27c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:25:29.359 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:29.356+0000 7ff29f19d700 1 --2- 172.21.15.50:0/2162518508 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7ff27c066f30 0x7ff27c0693e0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7ff29400bfd0 tx=0x7ff29401b000 comp rx=0 tx=0).stop 2023-10-06T01:25:29.359 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:29.356+0000 7ff29f19d700 1 -- 172.21.15.50:0/2162518508 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff298156000 msgr2=0x7ff298154ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:25:29.359 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:29.356+0000 7ff29f19d700 1 --2- 172.21.15.50:0/2162518508 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff298156000 0x7ff298154ab0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7ff290009e90 tx=0x7ff29000b040 comp rx=0 tx=0).stop 2023-10-06T01:25:29.359 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:29.357+0000 7ff29f19d700 1 -- 172.21.15.50:0/2162518508 shutdown_connections 2023-10-06T01:25:29.359 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:29.357+0000 7ff29f19d700 1 --2- 172.21.15.50:0/2162518508 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff298156000 0x7ff298154ab0 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:25:29.359 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:29.357+0000 7ff29f19d700 1 --2- 172.21.15.50:0/2162518508 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff29806e1a0 0x7ff29814c120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:25:29.359 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:29.357+0000 7ff29f19d700 1 --2- 172.21.15.50:0/2162518508 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7ff27c066f30 0x7ff27c0693e0 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:25:29.359 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:29.357+0000 7ff29f19d700 1 --2- 172.21.15.50:0/2162518508 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff2980b0730 0x7ff2980c7840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:25:29.359 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:29.357+0000 7ff29f19d700 1 -- 172.21.15.50:0/2162518508 >> 172.21.15.50:0/2162518508 conn(0x7ff2980cbed0 msgr2=0x7ff298153930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:25:29.360 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:29.357+0000 7ff29f19d700 1 -- 172.21.15.50:0/2162518508 shutdown_connections 2023-10-06T01:25:29.360 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:29.357+0000 7ff29f19d700 1 -- 172.21.15.50:0/2162518508 wait complete. 2023-10-06T01:25:29.376 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_acls.TestACLs.test_acls' 2023-10-06T01:25:29.563 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:29.561+0000 7f41d5f9d700 1 Processor -- start 2023-10-06T01:25:29.563 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:29.561+0000 7f41d5f9d700 1 -- start start 2023-10-06T01:25:29.565 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:29.563+0000 7f41d5f9d700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f41d0159360 0x7f41d00cc0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:25:29.565 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:29.563+0000 7f41d5f9d700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f41d015db70 0x7f41d00675f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:25:29.565 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:29.563+0000 7f41d5f9d700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f41d00c1730 con 0x7f41d015cff0 2023-10-06T01:25:29.566 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:29.563+0000 7f41d5f9d700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f41d00c2590 con 0x7f41d015db70 2023-10-06T01:25:29.566 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:29.563+0000 7f41d5f9d700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f41d00c1980 con 0x7f41d0159360 2023-10-06T01:25:29.566 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:29.563+0000 7f41cffff700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f41d015cff0 0x7f41d015d460 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:42966/0 (socket says 172.21.15.50:42966) 2023-10-06T01:25:29.566 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:29.563+0000 7f41cffff700 1 -- 172.21.15.50:0/3030467686 learned_addr learned my addr 172.21.15.50:0/3030467686 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-10-06T01:25:29.566 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:29.563+0000 7f41d579c700 1 --2- 172.21.15.50:0/3030467686 >> v2:172.21.15.50:3300/0 conn(0x7f41d015db70 0x7f41d00675f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:25:29.566 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:29.563+0000 7f41d4f9b700 1 --2- 172.21.15.50:0/3030467686 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f41d0159360 0x7f41d00cc0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:25:29.566 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:29.564+0000 7f41cf7fe700 1 -- 172.21.15.50:0/3030467686 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1959209115 0 0) 0x7f41d00c1730 con 0x7f41d015cff0 2023-10-06T01:25:29.566 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:29.564+0000 7f41cf7fe700 1 -- 172.21.15.50:0/3030467686 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f41c0003570 con 0x7f41d015cff0 2023-10-06T01:25:29.566 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:29.564+0000 7f41d579c700 1 -- 172.21.15.50:0/3030467686 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f41d0159360 msgr2=0x7f41d00cc0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:25:29.566 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:29.564+0000 7f41d579c700 1 --2- 172.21.15.50:0/3030467686 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f41d0159360 0x7f41d00cc0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:25:29.566 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:29.564+0000 7f41d579c700 1 -- 172.21.15.50:0/3030467686 >> v1:172.21.15.50:6789/0 conn(0x7f41d015cff0 legacy=0x7f41d015d460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:25:29.567 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:29.564+0000 7f41d579c700 1 -- 172.21.15.50:0/3030467686 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41d00c1c60 con 0x7f41d015db70 2023-10-06T01:25:29.567 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:29.564+0000 7f41d4f9b700 1 --2- 172.21.15.50:0/3030467686 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f41d0159360 0x7f41d00cc0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T01:25:29.568 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:29.564+0000 7f41d579c700 1 --2- 172.21.15.50:0/3030467686 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f41d015db70 0x7f41d00675f0 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f41c8009e60 tx=0x7f41c8009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dc75fbe81a0785a server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:25:29.568 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:29.564+0000 7f41cf7fe700 1 -- 172.21.15.50:0/3030467686 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41c800e070 con 0x7f41d015db70 2023-10-06T01:25:29.568 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:29.564+0000 7f41cf7fe700 1 -- 172.21.15.50:0/3030467686 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41c800bb60 con 0x7f41d015db70 2023-10-06T01:25:29.568 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:29.564+0000 7f41cf7fe700 1 -- 172.21.15.50:0/3030467686 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41c8012430 con 0x7f41d015db70 2023-10-06T01:25:29.568 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:29.565+0000 7f41d5f9d700 1 -- 172.21.15.50:0/3030467686 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f41d015db70 msgr2=0x7f41d00675f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:25:29.568 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:29.565+0000 7f41d5f9d700 1 --2- 172.21.15.50:0/3030467686 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f41d015db70 0x7f41d00675f0 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f41c8009e60 tx=0x7f41c8009780 comp rx=0 tx=0).stop 2023-10-06T01:25:29.568 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:29.565+0000 7f41d5f9d700 1 -- 172.21.15.50:0/3030467686 shutdown_connections 2023-10-06T01:25:29.568 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:29.565+0000 7f41d5f9d700 1 --2- 172.21.15.50:0/3030467686 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f41d015db70 0x7f41d00675f0 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:25:29.568 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:29.565+0000 7f41d5f9d700 1 --2- 172.21.15.50:0/3030467686 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f41d0159360 0x7f41d00cc0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:25:29.568 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:29.565+0000 7f41d5f9d700 1 -- 172.21.15.50:0/3030467686 >> 172.21.15.50:0/3030467686 conn(0x7f41d00c91e0 msgr2=0x7f41d00c95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:25:29.569 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:29.565+0000 7f41d5f9d700 1 -- 172.21.15.50:0/3030467686 shutdown_connections 2023-10-06T01:25:29.569 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:29.565+0000 7f41d5f9d700 1 -- 172.21.15.50:0/3030467686 wait complete. 2023-10-06T01:25:29.570 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:29.566+0000 7f41d5f9d700 1 Processor -- start 2023-10-06T01:25:29.571 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:29.567+0000 7f41d5f9d700 1 -- start start 2023-10-06T01:25:29.571 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:29.567+0000 7f41d5f9d700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f41d0159360 0x7f41d0159810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:25:29.571 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:29.567+0000 7f41d5f9d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f41d015cff0 0x7f41d00adfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:25:29.571 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:29.567+0000 7f41d5f9d700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f41d015db70 0x7f41d0159f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:25:29.571 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:29.567+0000 7f41d5f9d700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41d00af920 con 0x7f41d015cff0 2023-10-06T01:25:29.571 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:29.568+0000 7f41d5f9d700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41d00aee00 con 0x7f41d0159360 2023-10-06T01:25:29.571 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:29.568+0000 7f41d5f9d700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f41d00ae840 con 0x7f41d015db70 2023-10-06T01:25:29.571 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:29.568+0000 7f41cffff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f41d015cff0 0x7f41d00adfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:25:29.571 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:29.568+0000 7f41cffff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f41d015cff0 0x7f41d00adfa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:48008/0 (socket says 172.21.15.50:48008) 2023-10-06T01:25:29.571 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:29.568+0000 7f41cffff700 1 -- 172.21.15.50:0/2656059762 learned_addr learned my addr 172.21.15.50:0/2656059762 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-06T01:25:29.572 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:29.568+0000 7f41cffff700 1 -- 172.21.15.50:0/2656059762 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f41d015db70 msgr2=0x7f41d0159f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:25:29.572 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:29.568+0000 7f41cffff700 1 --2- 172.21.15.50:0/2656059762 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f41d015db70 0x7f41d0159f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:25:29.572 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:29.568+0000 7f41cffff700 1 -- 172.21.15.50:0/2656059762 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f41d0159360 msgr2=0x7f41d0159810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:25:29.572 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:29.568+0000 7f41cffff700 1 --2- 172.21.15.50:0/2656059762 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f41d0159360 0x7f41d0159810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:25:29.572 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:29.568+0000 7f41cffff700 1 -- 172.21.15.50:0/2656059762 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41c8009a20 con 0x7f41d015cff0 2023-10-06T01:25:29.572 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:29.568+0000 7f41cffff700 1 --2- 172.21.15.50:0/2656059762 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f41d015cff0 0x7f41d00adfa0 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f41bc00c7c0 tx=0x7f41bc007e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:25:29.572 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:29.568+0000 7f41ccff9700 1 -- 172.21.15.50:0/2656059762 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41bc005b30 con 0x7f41d015cff0 2023-10-06T01:25:29.572 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:29.569+0000 7f41ccff9700 1 -- 172.21.15.50:0/2656059762 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41bc005c90 con 0x7f41d015cff0 2023-10-06T01:25:29.572 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:29.569+0000 7f41d5f9d700 1 -- 172.21.15.50:0/2656059762 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f41d00aeb20 con 0x7f41d015cff0 2023-10-06T01:25:29.572 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:29.569+0000 7f41ccff9700 1 -- 172.21.15.50:0/2656059762 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41bc007320 con 0x7f41d015cff0 2023-10-06T01:25:29.572 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:29.569+0000 7f41d5f9d700 1 -- 172.21.15.50:0/2656059762 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f41d0169390 con 0x7f41d015cff0 2023-10-06T01:25:29.573 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:29.570+0000 7f41d5f9d700 1 -- 172.21.15.50:0/2656059762 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f41d005f270 con 0x7f41d015cff0 2023-10-06T01:25:29.573 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:29.571+0000 7f41ccff9700 1 -- 172.21.15.50:0/2656059762 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f41bc01b400 con 0x7f41d015cff0 2023-10-06T01:25:29.573 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:29.571+0000 7f41ccff9700 1 --2- 172.21.15.50:0/2656059762 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f41b4066f30 0x7f41b40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:25:29.573 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:29.572+0000 7f41ccff9700 1 -- 172.21.15.50:0/2656059762 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5612+0+0 (secure 0 0 0) 0x7f41bc083ed0 con 0x7f41d015cff0 2023-10-06T01:25:29.574 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:29.572+0000 7f41d4f9b700 1 --2- 172.21.15.50:0/2656059762 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f41b4066f30 0x7f41b40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:25:29.574 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:29.573+0000 7f41d4f9b700 1 --2- 172.21.15.50:0/2656059762 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f41b4066f30 0x7f41b40693e0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f41c4006fd0 tx=0x7f41c4008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:25:29.577 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:29.575+0000 7f41ccff9700 1 -- 172.21.15.50:0/2656059762 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f41bc051220 con 0x7f41d015cff0 2023-10-06T01:25:29.860 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:29.858+0000 7f41d5f9d700 1 -- 172.21.15.50:0/2656059762 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_acls.TestACLs.test_acls"]} v 0) v1 -- 0x7f41d00afa60 con 0x7f41d015cff0 2023-10-06T01:25:29.912 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:29.911+0000 7f41ccff9700 1 -- 172.21.15.50:0/2656059762 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_acls.TestACLs.test_acls"]}]=0 v174) v1 ==== 120+0+0 (secure 0 0 0) 0x7f41bc054840 con 0x7f41d015cff0 2023-10-06T01:25:29.915 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:29.913+0000 7f41d5f9d700 1 -- 172.21.15.50:0/2656059762 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f41b4066f30 msgr2=0x7f41b40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:25:29.915 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:29.913+0000 7f41d5f9d700 1 --2- 172.21.15.50:0/2656059762 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f41b4066f30 0x7f41b40693e0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f41c4006fd0 tx=0x7f41c4008040 comp rx=0 tx=0).stop 2023-10-06T01:25:29.915 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:29.913+0000 7f41d5f9d700 1 -- 172.21.15.50:0/2656059762 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f41d015cff0 msgr2=0x7f41d00adfa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:25:29.915 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:29.913+0000 7f41d5f9d700 1 --2- 172.21.15.50:0/2656059762 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f41d015cff0 0x7f41d00adfa0 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f41bc00c7c0 tx=0x7f41bc007e00 comp rx=0 tx=0).stop 2023-10-06T01:25:29.916 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:29.913+0000 7f41d5f9d700 1 -- 172.21.15.50:0/2656059762 shutdown_connections 2023-10-06T01:25:29.916 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:29.913+0000 7f41d5f9d700 1 --2- 172.21.15.50:0/2656059762 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f41d015db70 0x7f41d0159f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:25:29.916 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:29.913+0000 7f41d5f9d700 1 --2- 172.21.15.50:0/2656059762 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f41b4066f30 0x7f41b40693e0 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:25:29.916 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:29.913+0000 7f41d5f9d700 1 --2- 172.21.15.50:0/2656059762 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f41d0159360 0x7f41d0159810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:25:29.916 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:29.913+0000 7f41d5f9d700 1 --2- 172.21.15.50:0/2656059762 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f41d015cff0 0x7f41d00adfa0 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:25:29.916 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:29.913+0000 7f41d5f9d700 1 -- 172.21.15.50:0/2656059762 >> 172.21.15.50:0/2656059762 conn(0x7f41d00c91e0 msgr2=0x7f41d00c2ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:25:29.916 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:29.914+0000 7f41d5f9d700 1 -- 172.21.15.50:0/2656059762 shutdown_connections 2023-10-06T01:25:29.916 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:29.914+0000 7f41d5f9d700 1 -- 172.21.15.50:0/2656059762 wait complete. 2023-10-06T01:25:29.933 INFO:tasks.cephfs_test_runner:test_acls (tasks.cephfs.test_acls.TestACLs) ... ok 2023-10-06T01:25:29.933 INFO:tasks.cephfs_test_runner: 2023-10-06T01:25:29.933 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2023-10-06T01:25:29.933 INFO:tasks.cephfs_test_runner:Ran 1 test in 174.517s 2023-10-06T01:25:29.933 INFO:tasks.cephfs_test_runner: 2023-10-06T01:25:29.933 INFO:tasks.cephfs_test_runner:OK 2023-10-06T01:25:29.934 DEBUG:teuthology.run_tasks:Unwinding manager cephfs_test_runner 2023-10-06T01:25:29.943 DEBUG:teuthology.run_tasks:Unwinding manager kclient 2023-10-06T01:25:29.971 INFO:tasks.kclient:Unmounting kernel clients... 2023-10-06T01:25:29.971 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T01:25:29.972 DEBUG:teuthology.orchestra.run.smithi050:> ip netns list 2023-10-06T01:25:30.008 INFO:teuthology.orchestra.run.smithi050.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-10-06T01:25:30.008 INFO:teuthology.orchestra.run.smithi050.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-10-06T01:25:30.009 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T01:25:30.009 DEBUG:teuthology.orchestra.run.smithi050:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.2 2023-10-06T01:25:30.114 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T01:25:30.114 DEBUG:teuthology.orchestra.run.smithi050:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-06T01:25:30.189 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T01:25:30.190 DEBUG:teuthology.orchestra.run.smithi050:> sudo ip link delete ceph-brx 2023-10-06T01:25:30.314 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T01:25:30.314 DEBUG:teuthology.orchestra.run.smithi050:> ip netns list 2023-10-06T01:25:30.353 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T01:25:30.353 DEBUG:teuthology.orchestra.run.smithi050:> sudo ip link delete ceph-brx 2023-10-06T01:25:30.462 INFO:teuthology.orchestra.run.smithi050.stderr:Cannot find device "ceph-brx" 2023-10-06T01:25:30.465 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-06T01:25:30.465 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T01:25:30.466 DEBUG:teuthology.orchestra.run.smithi155:> ip netns list 2023-10-06T01:25:30.507 INFO:teuthology.orchestra.run.smithi155.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2023-10-06T01:25:30.507 INFO:teuthology.orchestra.run.smithi155.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-10-06T01:25:30.508 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T01:25:30.508 DEBUG:teuthology.orchestra.run.smithi155:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.3 2023-10-06T01:25:30.615 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T01:25:30.615 DEBUG:teuthology.orchestra.run.smithi155:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.1 2023-10-06T01:25:30.682 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T01:25:30.682 DEBUG:teuthology.orchestra.run.smithi155:> sudo ip link delete ceph-brx 2023-10-06T01:25:30.799 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T01:25:30.799 DEBUG:teuthology.orchestra.run.smithi155:> ip netns list 2023-10-06T01:25:30.838 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T01:25:30.838 DEBUG:teuthology.orchestra.run.smithi155:> sudo ip link delete ceph-brx 2023-10-06T01:25:30.945 INFO:teuthology.orchestra.run.smithi155.stderr:Cannot find device "ceph-brx" 2023-10-06T01:25:30.947 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-06T01:25:30.948 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2023-10-06T01:25:30.957 INFO:tasks.ceph.ceph_manager.ceph:Canceling any pending splits or merges... 2023-10-06T01:25:30.957 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T01:25:31.150 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:31.149+0000 7fb552d9d700 1 Processor -- start 2023-10-06T01:25:31.150 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:31.149+0000 7fb552d9d700 1 -- start start 2023-10-06T01:25:31.151 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:31.150+0000 7fb552d9d700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fb54c158df0 0x7fb54c06d750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:25:31.151 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:31.150+0000 7fb552d9d700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb54c1591c0 0x7fb54c0c72f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:25:31.151 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:31.150+0000 7fb552d9d700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb54c06e950 con 0x7fb54c0c15d0 2023-10-06T01:25:31.151 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:31.150+0000 7fb552d9d700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb54c0caad0 con 0x7fb54c158df0 2023-10-06T01:25:31.152 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:31.150+0000 7fb552d9d700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb54c06dd40 con 0x7fb54c1591c0 2023-10-06T01:25:31.153 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:31.150+0000 7fb55159a700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb54c1591c0 0x7fb54c0c72f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:25:31.153 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:31.150+0000 7fb55159a700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb54c1591c0 0x7fb54c0c72f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3301/0 says I am v2:172.21.15.50:36014/0 (socket says 172.21.15.50:36014) 2023-10-06T01:25:31.154 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:31.150+0000 7fb55159a700 1 -- 172.21.15.50:0/2440612732 learned_addr learned my addr 172.21.15.50:0/2440612732 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-06T01:25:31.154 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:31.150+0000 7fb55259c700 1 --1- 172.21.15.50:0/2440612732 >> v1:172.21.15.155:6789/0 conn(0x7fb54c0c15d0 0x7fb54c159670 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.155:6789/0 says I am v1:172.21.15.50:41184/0 (socket says 172.21.15.50:41184) 2023-10-06T01:25:31.154 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:31.150+0000 7fb551d9b700 1 --2- 172.21.15.50:0/2440612732 >> v2:172.21.15.155:3300/0 conn(0x7fb54c158df0 0x7fb54c06d750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:25:31.154 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:31.150+0000 7fb55159a700 1 -- 172.21.15.50:0/2440612732 >> v2:172.21.15.155:3300/0 conn(0x7fb54c158df0 msgr2=0x7fb54c06d750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:25:31.154 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:31.150+0000 7fb55159a700 1 --2- 172.21.15.50:0/2440612732 >> v2:172.21.15.155:3300/0 conn(0x7fb54c158df0 0x7fb54c06d750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:25:31.154 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:31.150+0000 7fb55159a700 1 -- 172.21.15.50:0/2440612732 >> v1:172.21.15.155:6789/0 conn(0x7fb54c0c15d0 legacy=0x7fb54c159670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:25:31.154 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:31.150+0000 7fb55159a700 1 -- 172.21.15.50:0/2440612732 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb54c06e020 con 0x7fb54c1591c0 2023-10-06T01:25:31.154 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:31.151+0000 7fb55159a700 1 --2- 172.21.15.50:0/2440612732 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb54c1591c0 0x7fb54c0c72f0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fb53c0099b0 tx=0x7fb53c009250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ae1dba6e0b00ed96 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:25:31.154 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:31.151+0000 7fb550d99700 1 -- 172.21.15.50:0/2440612732 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb53c009ea0 con 0x7fb54c1591c0 2023-10-06T01:25:31.154 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:31.151+0000 7fb550d99700 1 -- 172.21.15.50:0/2440612732 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb53c00b860 con 0x7fb54c1591c0 2023-10-06T01:25:31.154 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:31.151+0000 7fb550d99700 1 -- 172.21.15.50:0/2440612732 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb53c00bc00 con 0x7fb54c1591c0 2023-10-06T01:25:31.155 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:31.151+0000 7fb552d9d700 1 -- 172.21.15.50:0/2440612732 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb54c1591c0 msgr2=0x7fb54c0c72f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:25:31.155 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:31.151+0000 7fb552d9d700 1 --2- 172.21.15.50:0/2440612732 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb54c1591c0 0x7fb54c0c72f0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fb53c0099b0 tx=0x7fb53c009250 comp rx=0 tx=0).stop 2023-10-06T01:25:31.155 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:31.152+0000 7fb552d9d700 1 -- 172.21.15.50:0/2440612732 shutdown_connections 2023-10-06T01:25:31.155 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:31.152+0000 7fb552d9d700 1 --2- 172.21.15.50:0/2440612732 >> v2:172.21.15.155:3300/0 conn(0x7fb54c158df0 0x7fb54c06d750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:25:31.155 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:31.152+0000 7fb552d9d700 1 --2- 172.21.15.50:0/2440612732 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb54c1591c0 0x7fb54c0c72f0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:25:31.155 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:31.152+0000 7fb552d9d700 1 -- 172.21.15.50:0/2440612732 >> 172.21.15.50:0/2440612732 conn(0x7fb54c0cbef0 msgr2=0x7fb54c0cc2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:25:31.155 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:31.152+0000 7fb552d9d700 1 -- 172.21.15.50:0/2440612732 shutdown_connections 2023-10-06T01:25:31.155 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:31.152+0000 7fb552d9d700 1 -- 172.21.15.50:0/2440612732 wait complete. 2023-10-06T01:25:31.157 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:31.153+0000 7fb552d9d700 1 Processor -- start 2023-10-06T01:25:31.157 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:31.153+0000 7fb552d9d700 1 -- start start 2023-10-06T01:25:31.157 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:31.154+0000 7fb552d9d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb54c0c15d0 0x7fb54c0aedc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:25:31.157 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:31.154+0000 7fb552d9d700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb54c158df0 0x7fb54c165fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:25:31.158 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:31.154+0000 7fb552d9d700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb54c1591c0 0x7fb54c166ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:25:31.158 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:31.154+0000 7fb552d9d700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb54c0affb0 con 0x7fb54c0c15d0 2023-10-06T01:25:31.158 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:31.154+0000 7fb552d9d700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb54c166ff0 con 0x7fb54c158df0 2023-10-06T01:25:31.158 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:31.154+0000 7fb552d9d700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb54c0af3a0 con 0x7fb54c1591c0 2023-10-06T01:25:31.158 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:31.154+0000 7fb551d9b700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb54c0c15d0 0x7fb54c0aedc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:25:31.158 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:31.154+0000 7fb551d9b700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb54c0c15d0 0x7fb54c0aedc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:48012/0 (socket says 172.21.15.50:48012) 2023-10-06T01:25:31.158 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:31.154+0000 7fb551d9b700 1 -- 172.21.15.50:0/868660875 learned_addr learned my addr 172.21.15.50:0/868660875 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-06T01:25:31.158 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:31.154+0000 7fb55159a700 1 --2- 172.21.15.50:0/868660875 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb54c158df0 0x7fb54c165fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:25:31.158 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:31.155+0000 7fb55259c700 1 --2- 172.21.15.50:0/868660875 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb54c1591c0 0x7fb54c166ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:25:31.158 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:31.155+0000 7fb551d9b700 1 -- 172.21.15.50:0/868660875 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb54c1591c0 msgr2=0x7fb54c166ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:25:31.158 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:31.155+0000 7fb551d9b700 1 --2- 172.21.15.50:0/868660875 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb54c1591c0 0x7fb54c166ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:25:31.158 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:31.155+0000 7fb551d9b700 1 -- 172.21.15.50:0/868660875 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb54c158df0 msgr2=0x7fb54c165fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:25:31.159 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:31.155+0000 7fb551d9b700 1 --2- 172.21.15.50:0/868660875 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb54c158df0 0x7fb54c165fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:25:31.159 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:31.155+0000 7fb551d9b700 1 -- 172.21.15.50:0/868660875 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb53c0094f0 con 0x7fb54c0c15d0 2023-10-06T01:25:31.159 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:31.155+0000 7fb55259c700 1 --2- 172.21.15.50:0/868660875 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb54c1591c0 0x7fb54c166ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T01:25:31.159 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:31.155+0000 7fb551d9b700 1 --2- 172.21.15.50:0/868660875 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb54c0c15d0 0x7fb54c0aedc0 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7fb54800fa20 tx=0x7fb548009040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:25:31.159 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:31.155+0000 7fb541ffb700 1 -- 172.21.15.50:0/868660875 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb548005c10 con 0x7fb54c0c15d0 2023-10-06T01:25:31.159 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:31.155+0000 7fb541ffb700 1 -- 172.21.15.50:0/868660875 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb548005d70 con 0x7fb54c0c15d0 2023-10-06T01:25:31.159 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:31.155+0000 7fb541ffb700 1 -- 172.21.15.50:0/868660875 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb54800d850 con 0x7fb54c0c15d0 2023-10-06T01:25:31.159 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:31.155+0000 7fb552d9d700 1 -- 172.21.15.50:0/868660875 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb54c0af680 con 0x7fb54c0c15d0 2023-10-06T01:25:31.159 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:31.155+0000 7fb552d9d700 1 -- 172.21.15.50:0/868660875 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb54c0afc40 con 0x7fb54c0c15d0 2023-10-06T01:25:31.160 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:31.156+0000 7fb552d9d700 1 -- 172.21.15.50:0/868660875 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb54c06eae0 con 0x7fb54c0c15d0 2023-10-06T01:25:31.160 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:31.157+0000 7fb541ffb700 1 -- 172.21.15.50:0/868660875 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fb54800dc00 con 0x7fb54c0c15d0 2023-10-06T01:25:31.160 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:31.158+0000 7fb541ffb700 1 --2- 172.21.15.50:0/868660875 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7fb530066f30 0x7fb5300693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:25:31.160 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:31.158+0000 7fb541ffb700 1 -- 172.21.15.50:0/868660875 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5612+0+0 (secure 0 0 0) 0x7fb548084900 con 0x7fb54c0c15d0 2023-10-06T01:25:31.160 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:31.159+0000 7fb55159a700 1 --2- 172.21.15.50:0/868660875 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7fb530066f30 0x7fb5300693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:25:31.161 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:31.159+0000 7fb55159a700 1 --2- 172.21.15.50:0/868660875 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7fb530066f30 0x7fb5300693e0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fb53c0099b0 tx=0x7fb53c017000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:25:31.164 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:31.163+0000 7fb541ffb700 1 -- 172.21.15.50:0/868660875 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb548051b30 con 0x7fb54c0c15d0 2023-10-06T01:25:31.370 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:31.369+0000 7fb552d9d700 1 -- 172.21.15.50:0/868660875 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb54c05f270 con 0x7fb54c0c15d0 2023-10-06T01:25:31.371 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:31.370+0000 7fb541ffb700 1 -- 172.21.15.50:0/868660875 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v44) v1 ==== 74+0+13984 (secure 0 0 0) 0x7fb548055150 con 0x7fb54c0c15d0 2023-10-06T01:25:31.371 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-10-06T01:25:31.371 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":44,"fsid":"0bfd9a6b-1587-4fe4-a89e-e43c00286b4e","created":"2023-10-06T01:21:16.828801+0000","modified":"2023-10-06T01:25:28.901108+0000","last_up_change":"2023-10-06T01:21:28.584523+0000","last_in_change":"2023-10-06T01:21:20.179863+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-10-06T01:21:29.304225+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":".mgr","create_time":"2023-10-06T01:21:29.835490+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"9060727a-3959-4de3-8363-c5c5d7826c9a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":87837},{"type":"v1","addr":"172.21.15.50:6801","nonce":87837}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":87837},{"type":"v1","addr":"172.21.15.50:6803","nonce":87837}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":87837},{"type":"v1","addr":"172.21.15.50:6807","nonce":87837}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":87837},{"type":"v1","addr":"172.21.15.50:6805","nonce":87837}]},"public_addr":"172.21.15.50:6801/87837","cluster_addr":"172.21.15.50:6803/87837","heartbeat_back_addr":"172.21.15.50:6807/87837","heartbeat_front_addr":"172.21.15.50:6805/87837","state":["exists","up"]},{"osd":1,"uuid":"5ad9ef12-b579-47ea-b690-90ba887e2cef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":87853},{"type":"v1","addr":"172.21.15.50:6809","nonce":87853}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":87853},{"type":"v1","addr":"172.21.15.50:6811","nonce":87853}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":87853},{"type":"v1","addr":"172.21.15.50:6815","nonce":87853}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":87853},{"type":"v1","addr":"172.21.15.50:6813","nonce":87853}]},"public_addr":"172.21.15.50:6809/87853","cluster_addr":"172.21.15.50:6811/87853","heartbeat_back_addr":"172.21.15.50:6815/87853","heartbeat_front_addr":"172.21.15.50:6813/87853","state":["exists","up"]},{"osd":2,"uuid":"c7aee044-6f75-436f-90e1-ba42a57359bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6821","nonce":87855},{"type":"v1","addr":"172.21.15.50:6822","nonce":87855}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6824","nonce":87855},{"type":"v1","addr":"172.21.15.50:6826","nonce":87855}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":87855},{"type":"v1","addr":"172.21.15.50:6831","nonce":87855}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":87855},{"type":"v1","addr":"172.21.15.50:6829","nonce":87855}]},"public_addr":"172.21.15.50:6822/87855","cluster_addr":"172.21.15.50:6826/87855","heartbeat_back_addr":"172.21.15.50:6831/87855","heartbeat_front_addr":"172.21.15.50:6829/87855","state":["exists","up"]},{"osd":3,"uuid":"d9b901c8-e8b2-44af-9508-f453120a96c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":87856},{"type":"v1","addr":"172.21.15.50:6817","nonce":87856}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":87856},{"type":"v1","addr":"172.21.15.50:6819","nonce":87856}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6825","nonce":87856},{"type":"v1","addr":"172.21.15.50:6827","nonce":87856}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6820","nonce":87856},{"type":"v1","addr":"172.21.15.50:6823","nonce":87856}]},"public_addr":"172.21.15.50:6817/87856","cluster_addr":"172.21.15.50:6819/87856","heartbeat_back_addr":"172.21.15.50:6827/87856","heartbeat_front_addr":"172.21.15.50:6823/87856","state":["exists","up"]},{"osd":4,"uuid":"2b3c6b38-e3e9-4301-9445-60fd3fe8ce03","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":85805},{"type":"v1","addr":"172.21.15.155:6801","nonce":85805}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":85805},{"type":"v1","addr":"172.21.15.155:6803","nonce":85805}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6806","nonce":85805},{"type":"v1","addr":"172.21.15.155:6807","nonce":85805}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6804","nonce":85805},{"type":"v1","addr":"172.21.15.155:6805","nonce":85805}]},"public_addr":"172.21.15.155:6801/85805","cluster_addr":"172.21.15.155:6803/85805","heartbeat_back_addr":"172.21.15.155:6807/85805","heartbeat_front_addr":"172.21.15.155:6805/85805","state":["exists","up"]},{"osd":5,"uuid":"417b5f8f-65f1-4c94-91a7-a6ce03fe1679","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6816","nonce":85807},{"type":"v1","addr":"172.21.15.155:6818","nonce":85807}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6820","nonce":85807},{"type":"v1","addr":"172.21.15.155:6822","nonce":85807}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6828","nonce":85807},{"type":"v1","addr":"172.21.15.155:6830","nonce":85807}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6824","nonce":85807},{"type":"v1","addr":"172.21.15.155:6826","nonce":85807}]},"public_addr":"172.21.15.155:6818/85807","cluster_addr":"172.21.15.155:6822/85807","heartbeat_back_addr":"172.21.15.155:6830/85807","heartbeat_front_addr":"172.21.15.155:6826/85807","state":["exists","up"]},{"osd":6,"uuid":"c150cff3-aee4-4714-9c08-d182b1ba9ffd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6808","nonce":85806},{"type":"v1","addr":"172.21.15.155:6809","nonce":85806}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6810","nonce":85806},{"type":"v1","addr":"172.21.15.155:6811","nonce":85806}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6814","nonce":85806},{"type":"v1","addr":"172.21.15.155:6815","nonce":85806}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6812","nonce":85806},{"type":"v1","addr":"172.21.15.155:6813","nonce":85806}]},"public_addr":"172.21.15.155:6809/85806","cluster_addr":"172.21.15.155:6811/85806","heartbeat_back_addr":"172.21.15.155:6815/85806","heartbeat_front_addr":"172.21.15.155:6813/85806","state":["exists","up"]},{"osd":7,"uuid":"71107f0e-04d1-4e72-a0ec-0faf6af003e7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6817","nonce":85832},{"type":"v1","addr":"172.21.15.155:6819","nonce":85832}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6821","nonce":85832},{"type":"v1","addr":"172.21.15.155:6823","nonce":85832}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6829","nonce":85832},{"type":"v1","addr":"172.21.15.155:6831","nonce":85832}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6825","nonce":85832},{"type":"v1","addr":"172.21.15.155:6827","nonce":85832}]},"public_addr":"172.21.15.155:6819/85832","cluster_addr":"172.21.15.155:6823/85832","heartbeat_back_addr":"172.21.15.155:6831/85832","heartbeat_front_addr":"172.21.15.155:6827/85832","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:21:25.423389+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:21:25.472661+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:21:25.817562+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:21:25.551257+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:21:25.407818+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:21:25.557976+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:21:25.747299+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:21:25.827576+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.50:6835/3957156573":"2023-10-07T01:25:25.440651+0000","172.21.15.50:6834/3957156573":"2023-10-07T01:25:25.440651+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T01:25:31.374 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:31.373+0000 7fb552d9d700 1 -- 172.21.15.50:0/868660875 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7fb530066f30 msgr2=0x7fb5300693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:25:31.374 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:31.373+0000 7fb552d9d700 1 --2- 172.21.15.50:0/868660875 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7fb530066f30 0x7fb5300693e0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fb53c0099b0 tx=0x7fb53c017000 comp rx=0 tx=0).stop 2023-10-06T01:25:31.374 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:31.373+0000 7fb552d9d700 1 -- 172.21.15.50:0/868660875 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb54c0c15d0 msgr2=0x7fb54c0aedc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:25:31.374 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:31.373+0000 7fb552d9d700 1 --2- 172.21.15.50:0/868660875 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb54c0c15d0 0x7fb54c0aedc0 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7fb54800fa20 tx=0x7fb548009040 comp rx=0 tx=0).stop 2023-10-06T01:25:31.374 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:31.373+0000 7fb552d9d700 1 -- 172.21.15.50:0/868660875 shutdown_connections 2023-10-06T01:25:31.374 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:31.373+0000 7fb552d9d700 1 --2- 172.21.15.50:0/868660875 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb54c1591c0 0x7fb54c166ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:25:31.374 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:31.373+0000 7fb552d9d700 1 --2- 172.21.15.50:0/868660875 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb54c0c15d0 0x7fb54c0aedc0 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:25:31.374 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:31.373+0000 7fb552d9d700 1 --2- 172.21.15.50:0/868660875 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7fb530066f30 0x7fb5300693e0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:25:31.374 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:31.373+0000 7fb552d9d700 1 --2- 172.21.15.50:0/868660875 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb54c158df0 0x7fb54c165fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:25:31.375 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:31.373+0000 7fb552d9d700 1 -- 172.21.15.50:0/868660875 >> 172.21.15.50:0/868660875 conn(0x7fb54c0cbef0 msgr2=0x7fb54c1553d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:25:31.375 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:31.373+0000 7fb552d9d700 1 -- 172.21.15.50:0/868660875 shutdown_connections 2023-10-06T01:25:31.375 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:31.373+0000 7fb552d9d700 1 -- 172.21.15.50:0/868660875 wait complete. 2023-10-06T01:25:31.392 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2023-10-06T01:25:31.392 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-06T01:25:31.579 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:31.578+0000 7fcaba3ff700 1 Processor -- start 2023-10-06T01:25:31.579 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:31.578+0000 7fcaba3ff700 1 -- start start 2023-10-06T01:25:31.580 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:31.580+0000 7fcaba3ff700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fcab406eb00 0x7fcab40ad900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:25:31.581 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:31.580+0000 7fcaba3ff700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcab40acd60 con 0x7fcab406e690 2023-10-06T01:25:31.581 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:31.580+0000 7fcaba3ff700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcab4156910 con 0x7fcab4156540 2023-10-06T01:25:31.581 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:31.580+0000 7fcaba3ff700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcab406f470 con 0x7fcab406eb00 2023-10-06T01:25:31.581 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:31.580+0000 7fcab37fe700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fcab406e690 0x7fcab40ad1f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:42978/0 (socket says 172.21.15.50:42978) 2023-10-06T01:25:31.581 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:31.580+0000 7fcab37fe700 1 -- 172.21.15.50:0/3129249166 learned_addr learned my addr 172.21.15.50:0/3129249166 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-10-06T01:25:31.584 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:31.580+0000 7fcab899c700 1 --2- 172.21.15.50:0/3129249166 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fcab406eb00 0x7fcab40ad900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:25:31.584 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:31.580+0000 7fcab2ffd700 1 -- 172.21.15.50:0/3129249166 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4064398737 0 0) 0x7fcab40acd60 con 0x7fcab406e690 2023-10-06T01:25:31.584 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:31.580+0000 7fcab2ffd700 1 -- 172.21.15.50:0/3129249166 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fca9c003570 con 0x7fcab406e690 2023-10-06T01:25:31.584 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:31.580+0000 7fcab2ffd700 1 -- 172.21.15.50:0/3129249166 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3729373748 0 0) 0x7fcab4156910 con 0x7fcab4156540 2023-10-06T01:25:31.584 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:31.580+0000 7fcab2ffd700 1 -- 172.21.15.50:0/3129249166 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcab40acd60 con 0x7fcab4156540 2023-10-06T01:25:31.584 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:31.580+0000 7fcab2ffd700 1 -- 172.21.15.50:0/3129249166 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2385122615 0 0) 0x7fca9c003570 con 0x7fcab406e690 2023-10-06T01:25:31.584 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:31.581+0000 7fcab2ffd700 1 -- 172.21.15.50:0/3129249166 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fcab406eb00 msgr2=0x7fcab40ad900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:25:31.584 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:31.581+0000 7fcab2ffd700 1 --2- 172.21.15.50:0/3129249166 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fcab406eb00 0x7fcab40ad900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:25:31.584 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:31.581+0000 7fcab2ffd700 1 -- 172.21.15.50:0/3129249166 >> v1:172.21.15.155:6789/0 conn(0x7fcab4156540 legacy=0x7fcab40c7070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:25:31.585 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:31.581+0000 7fcab2ffd700 1 -- 172.21.15.50:0/3129249166 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcab40c7b70 con 0x7fcab406e690 2023-10-06T01:25:31.585 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:31.581+0000 7fcab2ffd700 1 -- 172.21.15.50:0/3129249166 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 347519148 0 0) 0x7fcaa8001470 con 0x7fcab406e690 2023-10-06T01:25:31.585 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:31.581+0000 7fcab2ffd700 1 -- 172.21.15.50:0/3129249166 >> v1:172.21.15.50:6789/0 conn(0x7fcab406e690 legacy=0x7fcab40ad1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:25:31.585 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:31.581+0000 7fcab2ffd700 1 --2- 172.21.15.50:0/3129249166 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fca9c003c20 0x7fca9c004010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:25:31.585 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:31.581+0000 7fcab2ffd700 1 --2- 172.21.15.50:0/3129249166 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fca9c004810 0x7fca9c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:25:31.585 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:31.581+0000 7fcab2ffd700 1 --2- 172.21.15.50:0/3129249166 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fca9c0051c0 0x7fca9c00ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:25:31.585 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:31.581+0000 7fcab2ffd700 1 -- 172.21.15.50:0/3129249166 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcab406f470 con 0x7fca9c0051c0 2023-10-06T01:25:31.585 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:31.581+0000 7fcab2ffd700 1 -- 172.21.15.50:0/3129249166 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca9c00c080 con 0x7fca9c003c20 2023-10-06T01:25:31.585 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:31.581+0000 7fcab2ffd700 1 -- 172.21.15.50:0/3129249166 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca9c00c240 con 0x7fca9c004810 2023-10-06T01:25:31.585 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:31.581+0000 7fcab899c700 1 --2- 172.21.15.50:0/3129249166 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fcab406eb00 0x7fcab40ad900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T01:25:31.585 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:31.581+0000 7fcab899c700 1 --2- 172.21.15.50:0/3129249166 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fca9c0051c0 0x7fca9c00ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:25:31.585 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:31.581+0000 7fcab37fe700 1 --2- 172.21.15.50:0/3129249166 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fca9c004810 0x7fca9c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:25:31.586 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:31.581+0000 7fcab3fff700 1 --2- 172.21.15.50:0/3129249166 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fca9c003c20 0x7fca9c004010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:25:31.586 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:31.581+0000 7fcab899c700 1 -- 172.21.15.50:0/3129249166 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fca9c004810 msgr2=0x7fca9c004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:25:31.586 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:31.581+0000 7fcab899c700 1 --2- 172.21.15.50:0/3129249166 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fca9c004810 0x7fca9c004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:25:31.586 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:31.581+0000 7fcab899c700 1 -- 172.21.15.50:0/3129249166 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fca9c003c20 msgr2=0x7fca9c004010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:25:31.586 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:31.581+0000 7fcab899c700 1 --2- 172.21.15.50:0/3129249166 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fca9c003c20 0x7fca9c004010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:25:31.586 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:31.581+0000 7fcab899c700 1 -- 172.21.15.50:0/3129249166 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca9c003570 con 0x7fca9c0051c0 2023-10-06T01:25:31.586 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:31.582+0000 7fcab899c700 1 --2- 172.21.15.50:0/3129249166 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fca9c0051c0 0x7fca9c00ba60 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7fcab406eed0 tx=0x7fcaac00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=11c1e19cd87ee240 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:25:31.586 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:31.582+0000 7fcab2ffd700 1 -- 172.21.15.50:0/3129249166 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcaac00eaa0 con 0x7fca9c0051c0 2023-10-06T01:25:31.586 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:31.582+0000 7fcab2ffd700 1 -- 172.21.15.50:0/3129249166 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcaac00f040 con 0x7fca9c0051c0 2023-10-06T01:25:31.586 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:31.582+0000 7fcab2ffd700 1 -- 172.21.15.50:0/3129249166 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcaac00ee30 con 0x7fca9c0051c0 2023-10-06T01:25:31.586 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:31.582+0000 7fcaba3ff700 1 -- 172.21.15.50:0/3129249166 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fca9c0051c0 msgr2=0x7fca9c00ba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:25:31.586 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:31.582+0000 7fcaba3ff700 1 --2- 172.21.15.50:0/3129249166 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fca9c0051c0 0x7fca9c00ba60 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7fcab406eed0 tx=0x7fcaac00b040 comp rx=0 tx=0).stop 2023-10-06T01:25:31.587 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:31.582+0000 7fcab899c700 1 -- 172.21.15.50:0/3129249166 reap_dead start 2023-10-06T01:25:31.587 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:31.583+0000 7fcaba3ff700 1 -- 172.21.15.50:0/3129249166 shutdown_connections 2023-10-06T01:25:31.587 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:31.583+0000 7fcaba3ff700 1 -- 172.21.15.50:0/3129249166 >> 172.21.15.50:0/3129249166 conn(0x7fcab40680c0 msgr2=0x7fcab40cc120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:25:31.587 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:31.583+0000 7fcaba3ff700 1 -- 172.21.15.50:0/3129249166 shutdown_connections 2023-10-06T01:25:31.587 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:31.583+0000 7fcaba3ff700 1 -- 172.21.15.50:0/3129249166 wait complete. 2023-10-06T01:25:31.589 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:31.584+0000 7fcaba3ff700 1 Processor -- start 2023-10-06T01:25:31.589 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:31.584+0000 7fcaba3ff700 1 -- start start 2023-10-06T01:25:31.589 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:31.585+0000 7fcaba3ff700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fca9c0051c0 0x7fcab416d770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:25:31.589 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:31.585+0000 7fcaba3ff700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fcab40aaec0 0x7fcab415da90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:25:31.589 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:31.585+0000 7fcaba3ff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcab40cb4f0 0x7fcab40c3130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:25:31.589 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:31.585+0000 7fcaba3ff700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcab416dfc0 con 0x7fcab40cb4f0 2023-10-06T01:25:31.590 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:31.585+0000 7fcaba3ff700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcab416e2a0 con 0x7fcab40aaec0 2023-10-06T01:25:31.590 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:31.585+0000 7fcaba3ff700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcab416e580 con 0x7fca9c0051c0 2023-10-06T01:25:31.590 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:31.585+0000 7fcab899c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcab40cb4f0 0x7fcab40c3130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:25:31.590 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:31.585+0000 7fcab899c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcab40cb4f0 0x7fcab40c3130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:48024/0 (socket says 172.21.15.50:48024) 2023-10-06T01:25:31.590 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:31.585+0000 7fcab899c700 1 -- 172.21.15.50:0/2703953442 learned_addr learned my addr 172.21.15.50:0/2703953442 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-06T01:25:31.590 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:31.585+0000 7fcab3fff700 1 --2- 172.21.15.50:0/2703953442 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fca9c0051c0 0x7fcab416d770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:25:31.590 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:31.585+0000 7fcab37fe700 1 --2- 172.21.15.50:0/2703953442 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fcab40aaec0 0x7fcab415da90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:25:31.590 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:31.586+0000 7fcab899c700 1 -- 172.21.15.50:0/2703953442 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fca9c0051c0 msgr2=0x7fcab416d770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:25:31.590 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:31.586+0000 7fcab899c700 1 --2- 172.21.15.50:0/2703953442 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fca9c0051c0 0x7fcab416d770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:25:31.590 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:31.586+0000 7fcab899c700 1 -- 172.21.15.50:0/2703953442 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fcab40aaec0 msgr2=0x7fcab415da90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:25:31.590 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:31.586+0000 7fcab899c700 1 --2- 172.21.15.50:0/2703953442 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fcab40aaec0 0x7fcab415da90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:25:31.590 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:31.586+0000 7fcab899c700 1 -- 172.21.15.50:0/2703953442 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcab40cacf0 con 0x7fcab40cb4f0 2023-10-06T01:25:31.591 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:31.586+0000 7fcab899c700 1 --2- 172.21.15.50:0/2703953442 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcab40cb4f0 0x7fcab40c3130 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7fcaac015000 tx=0x7fcaac016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:25:31.591 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:31.586+0000 7fca9bfff700 1 -- 172.21.15.50:0/2703953442 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcaac014d50 con 0x7fcab40cb4f0 2023-10-06T01:25:31.591 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:31.586+0000 7fca9bfff700 1 -- 172.21.15.50:0/2703953442 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcaac028470 con 0x7fcab40cb4f0 2023-10-06T01:25:31.591 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:31.586+0000 7fca9bfff700 1 -- 172.21.15.50:0/2703953442 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcaac028830 con 0x7fcab40cb4f0 2023-10-06T01:25:31.591 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:31.586+0000 7fcaba3ff700 1 -- 172.21.15.50:0/2703953442 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcab40cafd0 con 0x7fcab40cb4f0 2023-10-06T01:25:31.591 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:31.586+0000 7fcaba3ff700 1 -- 172.21.15.50:0/2703953442 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcab415dfd0 con 0x7fcab40cb4f0 2023-10-06T01:25:31.591 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:31.587+0000 7fcaba3ff700 1 -- 172.21.15.50:0/2703953442 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcab415e1c0 con 0x7fcab40cb4f0 2023-10-06T01:25:31.591 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:31.588+0000 7fca9bfff700 1 -- 172.21.15.50:0/2703953442 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fcaac025070 con 0x7fcab40cb4f0 2023-10-06T01:25:31.592 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:31.589+0000 7fca9bfff700 1 --2- 172.21.15.50:0/2703953442 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7fcaa0066f30 0x7fcaa00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:25:31.592 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:31.589+0000 7fca9bfff700 1 -- 172.21.15.50:0/2703953442 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5612+0+0 (secure 0 0 0) 0x7fcaac086240 con 0x7fcab40cb4f0 2023-10-06T01:25:31.592 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:31.589+0000 7fcab3fff700 1 --2- 172.21.15.50:0/2703953442 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7fcaa0066f30 0x7fcaa00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:25:31.592 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:31.590+0000 7fcab3fff700 1 --2- 172.21.15.50:0/2703953442 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7fcaa0066f30 0x7fcaa00693e0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fcaa4000c00 tx=0x7fcaa4007d30 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:25:31.594 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:31.593+0000 7fca9bfff700 1 -- 172.21.15.50:0/2703953442 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fcaac053470 con 0x7fcab40cb4f0 2023-10-06T01:25:31.790 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:31.789+0000 7fcaba3ff700 1 -- 172.21.15.50:0/2703953442 --> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fcab406bef0 con 0x7fcaa0066f30 2023-10-06T01:25:31.793 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:31.793+0000 7fca9bfff700 1 -- 172.21.15.50:0/2703953442 <== mgr.4099 v2:172.21.15.155:6832/85215 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+72889 (secure 0 0 0) 0x7fcaa4003940 con 0x7fcaa0066f30 2023-10-06T01:25:31.794 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-10-06T01:25:31.796 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:31.795+0000 7fcaba3ff700 1 -- 172.21.15.50:0/2703953442 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7fcaa0066f30 msgr2=0x7fcaa00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:25:31.796 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:31.795+0000 7fcaba3ff700 1 --2- 172.21.15.50:0/2703953442 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7fcaa0066f30 0x7fcaa00693e0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fcaa4000c00 tx=0x7fcaa4007d30 comp rx=0 tx=0).stop 2023-10-06T01:25:31.796 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:31.795+0000 7fcaba3ff700 1 -- 172.21.15.50:0/2703953442 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcab40cb4f0 msgr2=0x7fcab40c3130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:25:31.796 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:31.795+0000 7fcaba3ff700 1 --2- 172.21.15.50:0/2703953442 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcab40cb4f0 0x7fcab40c3130 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7fcaac015000 tx=0x7fcaac016000 comp rx=0 tx=0).stop 2023-10-06T01:25:31.796 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:31.795+0000 7fcaba3ff700 1 -- 172.21.15.50:0/2703953442 shutdown_connections 2023-10-06T01:25:31.796 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:31.795+0000 7fcaba3ff700 1 --2- 172.21.15.50:0/2703953442 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcab40cb4f0 0x7fcab40c3130 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:25:31.796 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:31.795+0000 7fcaba3ff700 1 --2- 172.21.15.50:0/2703953442 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fca9c0051c0 0x7fcab416d770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:25:31.796 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:31.795+0000 7fcaba3ff700 1 --2- 172.21.15.50:0/2703953442 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7fcaa0066f30 0x7fcaa00693e0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:25:31.797 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:31.795+0000 7fcaba3ff700 1 --2- 172.21.15.50:0/2703953442 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fcab40aaec0 0x7fcab415da90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:25:31.797 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:31.795+0000 7fcaba3ff700 1 -- 172.21.15.50:0/2703953442 >> 172.21.15.50:0/2703953442 conn(0x7fcab40680c0 msgr2=0x7fcab40ae140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:25:31.797 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:31.795+0000 7fcaba3ff700 1 -- 172.21.15.50:0/2703953442 shutdown_connections 2023-10-06T01:25:31.797 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:31.795+0000 7fcaba3ff700 1 -- 172.21.15.50:0/2703953442 wait complete. 2023-10-06T01:25:31.797 INFO:teuthology.orchestra.run.smithi050.stderr:dumped all 2023-10-06T01:25:31.813 INFO:teuthology.orchestra.run.smithi050.stdout:{"pg_ready":true,"pg_map":{"version":158,"stamp":"2023-10-06T01:25:29.828112+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":205,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2399736,"kb_used_data":5048,"kb_used_omap":0,"kb_used_meta":2394624,"kb_avail":752574984,"statfs":{"total":773094113280,"available":770636783616,"internally_reserved":0,"allocated":5169152,"data_stored":2988606,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2452094976},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":12,"apply_latency_ms":12,"commit_latency_ns":12000000,"apply_latency_ns":12000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-768719,"num_objects":-23,"num_object_clones":0,"num_object_copies":-46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-23,"num_whiteouts":0,"num_read":-1,"num_read_kb":-5,"num_write":-147,"num_write_kb":-804,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001187"},"pg_stats":[{"pgid":"1.5","version":"0'0","reported_seq":35,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T01:25:25.447872+0000","last_change":"2023-10-06T01:21:30.601117+0000","last_active":"2023-10-06T01:25:25.447872+0000","last_peered":"2023-10-06T01:25:25.447872+0000","last_clean":"2023-10-06T01:25:25.447872+0000","last_became_active":"2023-10-06T01:21:30.600724+0000","last_became_peered":"2023-10-06T01:21:30.600724+0000","last_unstale":"2023-10-06T01:25:25.447872+0000","last_undegraded":"2023-10-06T01:25:25.447872+0000","last_fullsized":"2023-10-06T01:25:25.447872+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:21:29.586558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:21:29.586558+0000","last_clean_scrub_stamp":"2023-10-06T01:21:29.586558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:47:24.449013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":34,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T01:25:25.876373+0000","last_change":"2023-10-06T01:21:30.603434+0000","last_active":"2023-10-06T01:25:25.876373+0000","last_peered":"2023-10-06T01:25:25.876373+0000","last_clean":"2023-10-06T01:25:25.876373+0000","last_became_active":"2023-10-06T01:21:30.603215+0000","last_became_peered":"2023-10-06T01:21:30.603215+0000","last_unstale":"2023-10-06T01:25:25.876373+0000","last_undegraded":"2023-10-06T01:25:25.876373+0000","last_fullsized":"2023-10-06T01:25:25.876373+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:21:29.586558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:21:29.586558+0000","last_clean_scrub_stamp":"2023-10-06T01:21:29.586558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:47:24.449013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":33,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T01:25:26.475307+0000","last_change":"2023-10-06T01:21:30.604889+0000","last_active":"2023-10-06T01:25:26.475307+0000","last_peered":"2023-10-06T01:25:26.475307+0000","last_clean":"2023-10-06T01:25:26.475307+0000","last_became_active":"2023-10-06T01:21:30.604535+0000","last_became_peered":"2023-10-06T01:21:30.604535+0000","last_unstale":"2023-10-06T01:25:26.475307+0000","last_undegraded":"2023-10-06T01:25:26.475307+0000","last_fullsized":"2023-10-06T01:25:26.475307+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:21:29.586558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:21:29.586558+0000","last_clean_scrub_stamp":"2023-10-06T01:21:29.586558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:17:59.434982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"17'117","reported_seq":182,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T01:25:26.475644+0000","last_change":"2023-10-06T01:21:31.602437+0000","last_active":"2023-10-06T01:25:26.475644+0000","last_peered":"2023-10-06T01:25:26.475644+0000","last_clean":"2023-10-06T01:25:26.475644+0000","last_became_active":"2023-10-06T01:21:31.601431+0000","last_became_peered":"2023-10-06T01:21:31.601431+0000","last_unstale":"2023-10-06T01:25:26.475644+0000","last_undegraded":"2023-10-06T01:25:26.475644+0000","last_fullsized":"2023-10-06T01:25:26.475644+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:21:30.589171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:21:30.589171+0000","last_clean_scrub_stamp":"2023-10-06T01:21:30.589171+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T01:48:45.877807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":33,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T01:25:26.475635+0000","last_change":"2023-10-06T01:21:31.338236+0000","last_active":"2023-10-06T01:25:26.475635+0000","last_peered":"2023-10-06T01:25:26.475635+0000","last_clean":"2023-10-06T01:25:26.475635+0000","last_became_active":"2023-10-06T01:21:31.337918+0000","last_became_peered":"2023-10-06T01:21:31.337918+0000","last_unstale":"2023-10-06T01:25:26.475635+0000","last_undegraded":"2023-10-06T01:25:26.475635+0000","last_fullsized":"2023-10-06T01:25:26.475635+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:21:29.586558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:21:29.586558+0000","last_clean_scrub_stamp":"2023-10-06T01:21:29.586558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:02:13.010488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":33,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T01:25:26.475534+0000","last_change":"2023-10-06T01:21:31.338209+0000","last_active":"2023-10-06T01:25:26.475534+0000","last_peered":"2023-10-06T01:25:26.475534+0000","last_clean":"2023-10-06T01:25:26.475534+0000","last_became_active":"2023-10-06T01:21:31.337870+0000","last_became_peered":"2023-10-06T01:21:31.337870+0000","last_unstale":"2023-10-06T01:25:26.475534+0000","last_undegraded":"2023-10-06T01:25:26.475534+0000","last_fullsized":"2023-10-06T01:25:26.475534+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:21:29.586558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:21:29.586558+0000","last_clean_scrub_stamp":"2023-10-06T01:21:29.586558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:53:47.117299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":33,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T01:25:25.448031+0000","last_change":"2023-10-06T01:21:31.338177+0000","last_active":"2023-10-06T01:25:25.448031+0000","last_peered":"2023-10-06T01:25:25.448031+0000","last_clean":"2023-10-06T01:25:25.448031+0000","last_became_active":"2023-10-06T01:21:31.337872+0000","last_became_peered":"2023-10-06T01:21:31.337872+0000","last_unstale":"2023-10-06T01:25:25.448031+0000","last_undegraded":"2023-10-06T01:25:25.448031+0000","last_fullsized":"2023-10-06T01:25:25.448031+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:21:29.586558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:21:29.586558+0000","last_clean_scrub_stamp":"2023-10-06T01:21:29.586558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:17:59.434982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":33,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T01:25:26.476425+0000","last_change":"2023-10-06T01:21:31.338181+0000","last_active":"2023-10-06T01:25:26.476425+0000","last_peered":"2023-10-06T01:25:26.476425+0000","last_clean":"2023-10-06T01:25:26.476425+0000","last_became_active":"2023-10-06T01:21:31.337820+0000","last_became_peered":"2023-10-06T01:21:31.337820+0000","last_unstale":"2023-10-06T01:25:26.476425+0000","last_undegraded":"2023-10-06T01:25:26.476425+0000","last_fullsized":"2023-10-06T01:25:26.476425+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:21:29.586558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:21:29.586558+0000","last_clean_scrub_stamp":"2023-10-06T01:21:29.586558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:44:49.740873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":33,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T01:25:26.476713+0000","last_change":"2023-10-06T01:21:30.604007+0000","last_active":"2023-10-06T01:25:26.476713+0000","last_peered":"2023-10-06T01:25:26.476713+0000","last_clean":"2023-10-06T01:25:26.476713+0000","last_became_active":"2023-10-06T01:21:30.603673+0000","last_became_peered":"2023-10-06T01:21:30.603673+0000","last_unstale":"2023-10-06T01:25:26.476713+0000","last_undegraded":"2023-10-06T01:25:26.476713+0000","last_fullsized":"2023-10-06T01:25:26.476713+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:21:29.586558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:21:29.586558+0000","last_clean_scrub_stamp":"2023-10-06T01:21:29.586558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:53:47.117299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574900,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298348,"kb_used_data":1060,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073492,"statfs":{"total":96636764160,"available":96331255808,"internally_reserved":0,"allocated":1085440,"data_stored":812583,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 01:24:32 2023","interfaces":[{"interface":"back","average":{"1min":0.67300000000000004,"5min":0.67000000000000004,"15min":0.68500000000000005},"min":{"1min":0.45600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.85999999999999999,"5min":0.93700000000000006,"15min":0.93700000000000006},"last":0.60099999999999998},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.63100000000000001,"15min":0.64900000000000002},"min":{"1min":0.44,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.82299999999999995,"5min":0.96999999999999997,"15min":0.96999999999999997},"last":0.45500000000000002}]},{"osd":1,"last update":"Fri Oct 6 01:24:32 2023","interfaces":[{"interface":"back","average":{"1min":0.66100000000000003,"5min":0.64700000000000002,"15min":0.66100000000000003},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.82899999999999996,"5min":0.89400000000000002,"15min":0.89400000000000002},"last":0.53500000000000003},{"interface":"front","average":{"1min":0.621,"5min":0.66500000000000004,"15min":0.67700000000000005},"min":{"1min":0.47699999999999998,"5min":0.439,"15min":0.439},"max":{"1min":0.78700000000000003,"5min":0.91400000000000003,"15min":0.91400000000000003},"last":0.57299999999999995}]},{"osd":2,"last update":"Fri Oct 6 01:24:32 2023","interfaces":[{"interface":"back","average":{"1min":0.58299999999999996,"5min":0.64000000000000001,"15min":0.66200000000000003},"min":{"1min":0.49299999999999999,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":0.72799999999999998,"5min":0.82899999999999996,"15min":0.82899999999999996},"last":0.62},{"interface":"front","average":{"1min":0.71099999999999997,"5min":0.71299999999999997,"15min":0.73299999999999998},"min":{"1min":0.52000000000000002,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.82499999999999996,"5min":0.93600000000000005,"15min":0.93600000000000005},"last":0.48599999999999999}]},{"osd":3,"last update":"Fri Oct 6 01:24:32 2023","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.71799999999999997,"15min":0.73799999999999999},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":0.89500000000000002,"5min":1.0660000000000001,"15min":1.0660000000000001},"last":0.52500000000000002},{"interface":"front","average":{"1min":0.68100000000000005,"5min":0.72299999999999998,"15min":0.74399999999999999},"min":{"1min":0.61599999999999999,"5min":0.495,"15min":0.495},"max":{"1min":0.84999999999999998,"5min":0.89400000000000002,"15min":0.89400000000000002},"last":0.67500000000000004}]},{"osd":4,"last update":"Fri Oct 6 01:24:32 2023","interfaces":[{"interface":"back","average":{"1min":0.68799999999999994,"5min":0.63900000000000001,"15min":0.63700000000000001},"min":{"1min":0.42699999999999999,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.90500000000000003,"5min":1.01,"15min":1.01},"last":0.72299999999999998},{"interface":"front","average":{"1min":0.65600000000000003,"5min":0.66300000000000003,"15min":0.67300000000000004},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":0.94399999999999995,"5min":0.94399999999999995,"15min":0.94399999999999995},"last":0.64800000000000002}]},{"osd":5,"last update":"Fri Oct 6 01:24:32 2023","interfaces":[{"interface":"back","average":{"1min":0.67800000000000005,"5min":0.65300000000000002,"15min":0.65900000000000003},"min":{"1min":0.49099999999999999,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.98599999999999999,"5min":0.98599999999999999,"15min":0.98599999999999999},"last":0.55800000000000005},{"interface":"front","average":{"1min":0.78600000000000003,"5min":0.73099999999999998,"15min":0.72699999999999998},"min":{"1min":0.54700000000000004,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":0.97999999999999998,"5min":0.97999999999999998,"15min":0.97999999999999998},"last":0.66300000000000003}]},{"osd":6,"last update":"Fri Oct 6 01:24:32 2023","interfaces":[{"interface":"back","average":{"1min":0.78800000000000003,"5min":0.77000000000000002,"15min":0.78100000000000003},"min":{"1min":0.497,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":1,"5min":1,"15min":1},"last":0.81000000000000005},{"interface":"front","average":{"1min":0.72799999999999998,"5min":0.748,"15min":0.753},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":0.97499999999999998,"5min":1.1000000000000001,"15min":1.1000000000000001},"last":0.69499999999999995}]}]},{"osd":6,"up_from":13,"seq":55834574900,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297780,"kb_used_data":492,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074060,"statfs":{"total":96636764160,"available":96331837440,"internally_reserved":0,"allocated":503808,"data_stored":228847,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 01:24:34 2023","interfaces":[{"interface":"back","average":{"1min":0.63600000000000001,"5min":0.71399999999999997,"15min":0.76000000000000001},"min":{"1min":0.45400000000000001,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.80800000000000005,"5min":1.9279999999999999,"15min":1.9279999999999999},"last":0.46200000000000002},{"interface":"front","average":{"1min":0.68500000000000005,"5min":0.77500000000000002,"15min":0.81699999999999995},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":0.81999999999999995,"5min":2.3420000000000001,"15min":2.3420000000000001},"last":0.496}]},{"osd":1,"last update":"Fri Oct 6 01:24:34 2023","interfaces":[{"interface":"back","average":{"1min":0.64000000000000001,"5min":1.0029999999999999,"15min":1.175},"min":{"1min":0.49099999999999999,"5min":0.44,"15min":0.44},"max":{"1min":0.85999999999999999,"5min":12.529,"15min":12.529},"last":0.65800000000000003},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.79100000000000004,"15min":0.85199999999999998},"min":{"1min":0.48799999999999999,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.91100000000000003,"5min":3.98,"15min":3.98},"last":0.92800000000000005}]},{"osd":2,"last update":"Fri Oct 6 01:24:34 2023","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.81200000000000006,"15min":0.89600000000000002},"min":{"1min":0.5,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.78500000000000003,"5min":5.4859999999999998,"15min":5.4859999999999998},"last":0.73899999999999999},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.73199999999999998,"15min":0.77800000000000002},"min":{"1min":0.48299999999999998,"5min":0.443,"15min":0.443},"max":{"1min":0.78600000000000003,"5min":2.718,"15min":2.718},"last":0.79300000000000004}]},{"osd":3,"last update":"Fri Oct 6 01:24:34 2023","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.745,"15min":0.78300000000000003},"min":{"1min":0.48899999999999999,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":0.88400000000000001,"5min":2.5129999999999999,"15min":2.5129999999999999},"last":0.55400000000000005},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.747,"15min":0.77700000000000002},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":0.81599999999999995,"5min":1.9870000000000001,"15min":1.9870000000000001},"last":0.68000000000000005}]},{"osd":4,"last update":"Fri Oct 6 01:24:34 2023","interfaces":[{"interface":"back","average":{"1min":0.66900000000000004,"5min":0.71099999999999997,"15min":0.748},"min":{"1min":0.47199999999999998,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.78900000000000003,"5min":3.1480000000000001,"15min":3.1480000000000001},"last":0.72199999999999998},{"interface":"front","average":{"1min":0.72999999999999998,"5min":0.77000000000000002,"15min":0.80400000000000005},"min":{"1min":0.49199999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.89700000000000002,"5min":2.4769999999999999,"15min":2.4769999999999999},"last":0.97799999999999998}]},{"osd":5,"last update":"Fri Oct 6 01:24:34 2023","interfaces":[{"interface":"back","average":{"1min":0.747,"5min":0.85999999999999999,"15min":0.92600000000000005},"min":{"1min":0.46000000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.88100000000000001,"5min":5.4279999999999999,"15min":5.4279999999999999},"last":0.78200000000000003},{"interface":"front","average":{"1min":0.78200000000000003,"5min":0.81299999999999994,"15min":0.84499999999999997},"min":{"1min":0.65900000000000003,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":0.91700000000000004,"5min":2.6739999999999999,"15min":2.6739999999999999},"last":0.76200000000000001}]},{"osd":7,"last update":"Fri Oct 6 01:24:34 2023","interfaces":[{"interface":"back","average":{"1min":0.76900000000000002,"5min":0.82399999999999995,"15min":0.86399999999999999},"min":{"1min":0.55500000000000005,"5min":0.497,"15min":0.497},"max":{"1min":0.94699999999999995,"5min":2.7719999999999998,"15min":2.7719999999999998},"last":0.81100000000000005},{"interface":"front","average":{"1min":0.77800000000000002,"5min":0.96799999999999997,"15min":1.0620000000000001},"min":{"1min":0.64200000000000002,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":1,"5min":7.1440000000000001,"15min":7.1440000000000001},"last":0.83799999999999997}]}]},{"osd":1,"up_from":13,"seq":55834574898,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302452,"kb_used_data":1068,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069388,"statfs":{"total":96636764160,"available":96327053312,"internally_reserved":0,"allocated":1093632,"data_stored":818237,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 01:24:33 2023","interfaces":[{"interface":"back","average":{"1min":0.437,"5min":0.44900000000000001,"15min":0.45500000000000002},"min":{"1min":0.33000000000000002,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.56499999999999995,"5min":0.70699999999999996,"15min":0.70699999999999996},"last":0.443},{"interface":"front","average":{"1min":0.44400000000000001,"5min":0.48799999999999999,"15min":0.5},"min":{"1min":0.38100000000000001,"5min":0.375,"15min":0.375},"max":{"1min":0.503,"5min":0.752,"15min":0.752},"last":0.42799999999999999}]},{"osd":2,"last update":"Fri Oct 6 01:24:33 2023","interfaces":[{"interface":"back","average":{"1min":0.38600000000000001,"5min":0.44900000000000001,"15min":0.46899999999999997},"min":{"1min":0.314,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.496,"5min":1.073,"15min":1.073},"last":0.35999999999999999},{"interface":"front","average":{"1min":0.45700000000000002,"5min":0.47899999999999998,"15min":0.48999999999999999},"min":{"1min":0.36599999999999999,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.56399999999999995,"5min":0.69999999999999996,"15min":0.69999999999999996},"last":0.48999999999999999}]},{"osd":3,"last update":"Fri Oct 6 01:24:33 2023","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.56399999999999995,"15min":0.57599999999999996},"min":{"1min":0.47699999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.67500000000000004,"5min":0.72799999999999998,"15min":0.72799999999999998},"last":0.51400000000000001},{"interface":"front","average":{"1min":0.48699999999999999,"5min":0.52700000000000002,"15min":0.55100000000000005},"min":{"1min":0.34200000000000003,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.58999999999999997,"5min":0.93400000000000005,"15min":0.93400000000000005},"last":0.379}]},{"osd":4,"last update":"Fri Oct 6 01:24:33 2023","interfaces":[{"interface":"back","average":{"1min":0.74299999999999999,"5min":0.755,"15min":0.77900000000000003},"min":{"1min":0.434,"5min":0.432,"15min":0.432},"max":{"1min":0.96699999999999997,"5min":1.534,"15min":1.534},"last":0.65000000000000002},{"interface":"front","average":{"1min":0.73099999999999998,"5min":0.75900000000000001,"15min":0.78900000000000003},"min":{"1min":0.54600000000000004,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.94699999999999995,"5min":1.742,"15min":1.742},"last":0.73699999999999999}]},{"osd":5,"last update":"Fri Oct 6 01:24:33 2023","interfaces":[{"interface":"back","average":{"1min":0.749,"5min":0.755,"15min":0.77600000000000002},"min":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.0740000000000001,"5min":1.4790000000000001,"15min":1.4790000000000001},"last":0.81200000000000006},{"interface":"front","average":{"1min":0.73399999999999999,"5min":0.77000000000000002,"15min":0.80600000000000005},"min":{"1min":0.51000000000000001,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":0.879,"5min":1.581,"15min":1.581},"last":0.754}]},{"osd":6,"last update":"Fri Oct 6 01:24:33 2023","interfaces":[{"interface":"back","average":{"1min":0.73899999999999999,"5min":0.75800000000000001,"15min":0.78400000000000003},"min":{"1min":0.52600000000000002,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":0.95599999999999996,"5min":1.51,"15min":1.51},"last":0.77500000000000002},{"interface":"front","average":{"1min":0.79300000000000004,"5min":0.78400000000000003,"15min":0.80200000000000005},"min":{"1min":0.624,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":0.98399999999999999,"5min":1.26,"15min":1.26},"last":0.83799999999999997}]},{"osd":7,"last update":"Fri Oct 6 01:24:33 2023","interfaces":[{"interface":"back","average":{"1min":0.76600000000000001,"5min":0.79200000000000004,"15min":0.82399999999999995},"min":{"1min":0.62,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":0.93999999999999995,"5min":1.7070000000000001,"15min":1.7070000000000001},"last":0.71299999999999997},{"interface":"front","average":{"1min":0.79500000000000004,"5min":0.82399999999999995,"15min":0.85799999999999998},"min":{"1min":0.55300000000000005,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":0.999,"5min":1.633,"15min":1.633},"last":0.78100000000000003}]}]},{"osd":0,"up_from":13,"seq":55834574899,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301860,"kb_used_data":476,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069980,"statfs":{"total":96636764160,"available":96327659520,"internally_reserved":0,"allocated":487424,"data_stored":221181,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Oct 6 01:24:33 2023","interfaces":[{"interface":"back","average":{"1min":0.42699999999999999,"5min":0.56299999999999994,"15min":0.627},"min":{"1min":0.27700000000000002,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.92800000000000005,"5min":2.8559999999999999,"15min":2.8559999999999999},"last":0.313},{"interface":"front","average":{"1min":0.42799999999999999,"5min":0.61399999999999999,"15min":0.68899999999999995},"min":{"1min":0.28999999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.68000000000000005,"5min":2.944,"15min":2.944},"last":0.44500000000000001}]},{"osd":2,"last update":"Fri Oct 6 01:24:33 2023","interfaces":[{"interface":"back","average":{"1min":0.48299999999999998,"5min":0.67000000000000004,"15min":0.746},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.58299999999999996,"5min":2.8940000000000001,"15min":2.8940000000000001},"last":0.49399999999999999},{"interface":"front","average":{"1min":0.48999999999999999,"5min":0.67100000000000004,"15min":0.73599999999999999},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.63500000000000001,"5min":2.9820000000000002,"15min":2.9820000000000002},"last":0.51800000000000002}]},{"osd":3,"last update":"Fri Oct 6 01:24:33 2023","interfaces":[{"interface":"back","average":{"1min":0.443,"5min":0.59799999999999998,"15min":0.66600000000000004},"min":{"1min":0.312,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.55400000000000005,"5min":2.7559999999999998,"15min":2.7559999999999998},"last":0.35199999999999998},{"interface":"front","average":{"1min":0.47399999999999998,"5min":0.63700000000000001,"15min":0.70099999999999996},"min":{"1min":0.41999999999999998,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.57299999999999995,"5min":2.8140000000000001,"15min":2.8140000000000001},"last":0.53000000000000003}]},{"osd":4,"last update":"Fri Oct 6 01:24:33 2023","interfaces":[{"interface":"back","average":{"1min":0.73899999999999999,"5min":0.77300000000000002,"15min":0.79900000000000004},"min":{"1min":0.54400000000000004,"5min":0.441,"15min":0.441},"max":{"1min":1.3320000000000001,"5min":1.397,"15min":1.397},"last":0.56299999999999994},{"interface":"front","average":{"1min":0.751,"5min":0.80700000000000005,"15min":0.84499999999999997},"min":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.2929999999999999,"5min":1.833,"15min":1.833},"last":0.755}]},{"osd":5,"last update":"Fri Oct 6 01:24:33 2023","interfaces":[{"interface":"back","average":{"1min":0.74299999999999999,"5min":0.79800000000000004,"15min":0.82699999999999996},"min":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":0.95899999999999996,"5min":1.4430000000000001,"15min":1.4430000000000001},"last":0.66900000000000004},{"interface":"front","average":{"1min":0.749,"5min":0.77500000000000002,"15min":0.80100000000000005},"min":{"1min":0.55600000000000005,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":0.95399999999999996,"5min":1.4359999999999999,"15min":1.4359999999999999},"last":0.68700000000000006}]},{"osd":6,"last update":"Fri Oct 6 01:24:33 2023","interfaces":[{"interface":"back","average":{"1min":0.72799999999999998,"5min":0.84099999999999997,"15min":0.90100000000000002},"min":{"1min":0.54500000000000004,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":0.96999999999999997,"5min":1.8740000000000001,"15min":1.8740000000000001},"last":0.81999999999999995},{"interface":"front","average":{"1min":0.77600000000000002,"5min":0.80900000000000005,"15min":0.84199999999999997},"min":{"1min":0.61399999999999999,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":0.878,"5min":1.361,"15min":1.361},"last":0.59999999999999998}]},{"osd":7,"last update":"Fri Oct 6 01:24:33 2023","interfaces":[{"interface":"back","average":{"1min":0.77800000000000002,"5min":0.82199999999999995,"15min":0.85399999999999998},"min":{"1min":0.55900000000000005,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":1.21,"5min":1.413,"15min":1.413},"last":0.63700000000000001},{"interface":"front","average":{"1min":0.76100000000000001,"5min":0.79400000000000004,"15min":0.82199999999999995},"min":{"1min":0.627,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1.0009999999999999,"5min":1.2929999999999999,"15min":1.2929999999999999},"last":0.622}]}]},{"osd":2,"up_from":13,"seq":55834574898,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301876,"kb_used_data":492,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069964,"statfs":{"total":96636764160,"available":96327643136,"internally_reserved":0,"allocated":503808,"data_stored":228847,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 01:24:36 2023","interfaces":[{"interface":"back","average":{"1min":0.41699999999999998,"5min":0.46700000000000003,"15min":0.48699999999999999},"min":{"1min":0.33000000000000002,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.61799999999999999,"5min":0.96599999999999997,"15min":0.96599999999999997},"last":0.375},{"interface":"front","average":{"1min":0.499,"5min":0.52200000000000002,"15min":0.53900000000000003},"min":{"1min":0.318,"5min":0.31,"15min":0.31},"max":{"1min":0.68200000000000005,"5min":1,"15min":1},"last":0.59599999999999997}]},{"osd":1,"last update":"Fri Oct 6 01:24:36 2023","interfaces":[{"interface":"back","average":{"1min":0.49299999999999999,"5min":0.55000000000000004,"15min":0.57999999999999996},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.64900000000000002,"5min":1.296,"15min":1.296},"last":0.33500000000000002},{"interface":"front","average":{"1min":0.48199999999999998,"5min":0.53800000000000003,"15min":0.56399999999999995},"min":{"1min":0.39000000000000001,"5min":0.313,"15min":0.313},"max":{"1min":0.56799999999999995,"5min":1.1379999999999999,"15min":1.1379999999999999},"last":0.48299999999999998}]},{"osd":3,"last update":"Fri Oct 6 01:24:36 2023","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.60199999999999998,"15min":0.63400000000000001},"min":{"1min":0.45300000000000001,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.65200000000000002,"5min":1.222,"15min":1.222},"last":0.432},{"interface":"front","average":{"1min":0.44900000000000001,"5min":0.48999999999999999,"15min":0.503},"min":{"1min":0.35499999999999998,"5min":0.318,"15min":0.318},"max":{"1min":0.57199999999999995,"5min":0.72099999999999997,"15min":0.72099999999999997},"last":0.46000000000000002}]},{"osd":4,"last update":"Fri Oct 6 01:24:36 2023","interfaces":[{"interface":"back","average":{"1min":0.76300000000000001,"5min":0.73599999999999999,"15min":0.73599999999999999},"min":{"1min":0.58399999999999996,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":0.96799999999999997,"5min":1.0700000000000001,"15min":1.0700000000000001},"last":0.68700000000000006},{"interface":"front","average":{"1min":0.76900000000000002,"5min":0.80500000000000005,"15min":0.82799999999999996},"min":{"1min":0.59599999999999997,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":0.99099999999999999,"5min":1.5469999999999999,"15min":1.5469999999999999},"last":0.79200000000000004}]},{"osd":5,"last update":"Fri Oct 6 01:24:36 2023","interfaces":[{"interface":"back","average":{"1min":0.749,"5min":0.76800000000000002,"15min":0.78600000000000003},"min":{"1min":0.54800000000000004,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":1.0309999999999999,"5min":1.5940000000000001,"15min":1.5940000000000001},"last":0.745},{"interface":"front","average":{"1min":0.72199999999999998,"5min":0.82399999999999995,"15min":0.86399999999999999},"min":{"1min":0.55600000000000005,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":0.91900000000000004,"5min":1.7669999999999999,"15min":1.7669999999999999},"last":0.71799999999999997}]},{"osd":6,"last update":"Fri Oct 6 01:24:36 2023","interfaces":[{"interface":"back","average":{"1min":0.73699999999999999,"5min":0.85599999999999998,"15min":0.90900000000000003},"min":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":1.0029999999999999,"5min":2.0510000000000002,"15min":2.0510000000000002},"last":0.81499999999999995},{"interface":"front","average":{"1min":0.72199999999999998,"5min":0.755,"15min":0.77900000000000003},"min":{"1min":0.55600000000000005,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":0.93600000000000005,"5min":1.633,"15min":1.633},"last":0.61499999999999999}]},{"osd":7,"last update":"Fri Oct 6 01:24:36 2023","interfaces":[{"interface":"back","average":{"1min":0.74299999999999999,"5min":0.80100000000000005,"15min":0.82899999999999996},"min":{"1min":0.54900000000000004,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.0109999999999999,"5min":1.4670000000000001,"15min":1.4670000000000001},"last":0.82799999999999996},{"interface":"front","average":{"1min":0.76500000000000001,"5min":0.83199999999999996,"15min":0.86799999999999999},"min":{"1min":0.60899999999999999,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":0.91800000000000004,"5min":1.8,"15min":1.8},"last":0.65200000000000002}]}]},{"osd":3,"up_from":13,"seq":55834574898,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301876,"kb_used_data":492,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069964,"statfs":{"total":96636764160,"available":96327643136,"internally_reserved":0,"allocated":503808,"data_stored":228847,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 01:24:37 2023","interfaces":[{"interface":"back","average":{"1min":0.43099999999999999,"5min":0.41699999999999998,"15min":0.41499999999999998},"min":{"1min":0.29999999999999999,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.95399999999999996,"5min":0.95399999999999996,"15min":0.95399999999999996},"last":0.32100000000000001},{"interface":"front","average":{"1min":0.42099999999999999,"5min":0.44400000000000001,"15min":0.45800000000000002},"min":{"1min":0.29099999999999998,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.60499999999999998,"5min":0.69199999999999995,"15min":0.69199999999999995},"last":0.35299999999999998}]},{"osd":1,"last update":"Fri Oct 6 01:24:37 2023","interfaces":[{"interface":"back","average":{"1min":0.434,"5min":0.46800000000000003,"15min":0.49199999999999999},"min":{"1min":0.307,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.94099999999999995,"5min":1.075,"15min":1.075},"last":0.40100000000000002},{"interface":"front","average":{"1min":0.499,"5min":0.51500000000000001,"15min":0.52200000000000002},"min":{"1min":0.39400000000000002,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68300000000000005},"last":0.44500000000000001}]},{"osd":2,"last update":"Fri Oct 6 01:24:37 2023","interfaces":[{"interface":"back","average":{"1min":0.47899999999999998,"5min":0.53000000000000003,"15min":0.55000000000000004},"min":{"1min":0.40400000000000003,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.57699999999999996,"5min":1.4319999999999999,"15min":1.4319999999999999},"last":0.46200000000000002},{"interface":"front","average":{"1min":0.52300000000000002,"5min":0.56399999999999995,"15min":0.58499999999999996},"min":{"1min":0.433,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.98999999999999999,"5min":1.532,"15min":1.532},"last":0.47899999999999998}]},{"osd":4,"last update":"Fri Oct 6 01:24:37 2023","interfaces":[{"interface":"back","average":{"1min":0.747,"5min":0.81100000000000005,"15min":0.83999999999999997},"min":{"1min":0.61699999999999999,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":0.91100000000000003,"5min":1.1080000000000001,"15min":1.1080000000000001},"last":0.92000000000000004},{"interface":"front","average":{"1min":0.77200000000000002,"5min":0.81999999999999995,"15min":0.84699999999999998},"min":{"1min":0.65600000000000003,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":1.0509999999999999,"5min":1.353,"15min":1.353},"last":0.80000000000000004}]},{"osd":5,"last update":"Fri Oct 6 01:24:37 2023","interfaces":[{"interface":"back","average":{"1min":0.75,"5min":0.77100000000000002,"15min":0.78900000000000003},"min":{"1min":0.60099999999999998,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":1.0740000000000001,"5min":1.3149999999999999,"15min":1.3149999999999999},"last":0.93300000000000005},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.75700000000000001,"15min":0.78700000000000003},"min":{"1min":0.57999999999999996,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":0.90600000000000003,"5min":1.155,"15min":1.155},"last":0.78900000000000003}]},{"osd":6,"last update":"Fri Oct 6 01:24:37 2023","interfaces":[{"interface":"back","average":{"1min":0.78100000000000003,"5min":0.82499999999999996,"15min":0.85299999999999998},"min":{"1min":0.59299999999999997,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":0.93600000000000005,"5min":1.1479999999999999,"15min":1.1479999999999999},"last":0.71499999999999997},{"interface":"front","average":{"1min":0.78200000000000003,"5min":0.82899999999999996,"15min":0.85699999999999998},"min":{"1min":0.59399999999999997,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.095,"5min":1.3779999999999999,"15min":1.3779999999999999},"last":0.85199999999999998}]},{"osd":7,"last update":"Fri Oct 6 01:24:37 2023","interfaces":[{"interface":"back","average":{"1min":0.71499999999999997,"5min":0.81000000000000005,"15min":0.84399999999999997},"min":{"1min":0.56999999999999995,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":0.97099999999999997,"5min":1.1240000000000001,"15min":1.1240000000000001},"last":1.0409999999999999},{"interface":"front","average":{"1min":0.79100000000000004,"5min":0.84599999999999997,"15min":0.88400000000000001},"min":{"1min":0.65800000000000003,"5min":0.55700000000000005,"15min":0.55700000000000005},"max":{"1min":0.96399999999999997,"5min":1.097,"15min":1.097},"last":0.81799999999999995}]}]},{"osd":4,"up_from":13,"seq":55834574898,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297780,"kb_used_data":492,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074060,"statfs":{"total":96636764160,"available":96331837440,"internally_reserved":0,"allocated":503808,"data_stored":228847,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 01:24:36 2023","interfaces":[{"interface":"back","average":{"1min":0.63500000000000001,"5min":0.63,"15min":0.626},"min":{"1min":0.41199999999999998,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.84199999999999997,"5min":1.298,"15min":1.298},"last":0.73499999999999999},{"interface":"front","average":{"1min":0.63100000000000001,"5min":0.64700000000000002,"15min":0.64900000000000002},"min":{"1min":0.49099999999999999,"5min":0.44,"15min":0.44},"max":{"1min":0.80300000000000005,"5min":1.081,"15min":1.081},"last":0.84499999999999997}]},{"osd":1,"last update":"Fri Oct 6 01:24:36 2023","interfaces":[{"interface":"back","average":{"1min":0.67000000000000004,"5min":0.66300000000000003,"15min":0.66500000000000004},"min":{"1min":0.54700000000000004,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.82799999999999996,"5min":1.264,"15min":1.264},"last":0.82199999999999995},{"interface":"front","average":{"1min":0.67400000000000004,"5min":0.68400000000000005,"15min":0.68700000000000006},"min":{"1min":0.53600000000000003,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":0.89900000000000002,"5min":1.143,"15min":1.143},"last":0.80200000000000005}]},{"osd":2,"last update":"Fri Oct 6 01:24:36 2023","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.70299999999999996,"15min":0.71899999999999997},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":0.80200000000000005,"5min":1.3680000000000001,"15min":1.3680000000000001},"last":0.85399999999999998},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.70999999999999996,"15min":0.72499999999999998},"min":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":0.79300000000000004,"5min":0.95699999999999996,"15min":0.95699999999999996},"last":0.77200000000000002}]},{"osd":3,"last update":"Fri Oct 6 01:24:36 2023","interfaces":[{"interface":"back","average":{"1min":0.63600000000000001,"5min":0.69999999999999996,"15min":0.72399999999999998},"min":{"1min":0.47199999999999998,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.86499999999999999,"5min":1.2090000000000001,"15min":1.2090000000000001},"last":0.873},{"interface":"front","average":{"1min":0.72199999999999998,"5min":0.77100000000000002,"15min":0.79100000000000004},"min":{"1min":0.60999999999999999,"5min":0.505,"15min":0.505},"max":{"1min":0.872,"5min":1.444,"15min":1.444},"last":0.78000000000000003}]},{"osd":5,"last update":"Fri Oct 6 01:24:36 2023","interfaces":[{"interface":"back","average":{"1min":0.67100000000000004,"5min":0.68200000000000005,"15min":0.68799999999999994},"min":{"1min":0.45000000000000001,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.95599999999999996,"5min":0.96499999999999997,"15min":0.96499999999999997},"last":0.63900000000000001},{"interface":"front","average":{"1min":0.65400000000000003,"5min":0.69299999999999995,"15min":0.70499999999999996},"min":{"1min":0.49299999999999999,"5min":0.439,"15min":0.439},"max":{"1min":0.90800000000000003,"5min":0.97999999999999998,"15min":0.97999999999999998},"last":0.749}]},{"osd":6,"last update":"Fri Oct 6 01:24:36 2023","interfaces":[{"interface":"back","average":{"1min":0.68500000000000005,"5min":0.71399999999999997,"15min":0.73399999999999999},"min":{"1min":0.442,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.92300000000000004,"5min":1.1779999999999999,"15min":1.1779999999999999},"last":0.68600000000000005},{"interface":"front","average":{"1min":0.74099999999999999,"5min":0.77500000000000002,"15min":0.79100000000000004},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":1.0009999999999999,"5min":1.1379999999999999,"15min":1.1379999999999999},"last":0.56499999999999995}]},{"osd":7,"last update":"Fri Oct 6 01:24:36 2023","interfaces":[{"interface":"back","average":{"1min":0.72899999999999998,"5min":0.74099999999999999,"15min":0.75900000000000001},"min":{"1min":0.62,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.93899999999999995,"5min":1.0249999999999999,"15min":1.0249999999999999},"last":0.80700000000000005},{"interface":"front","average":{"1min":0.76000000000000001,"5min":0.80100000000000005,"15min":0.82699999999999996},"min":{"1min":0.55700000000000005,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":0.93600000000000005,"5min":1.2290000000000001,"15min":1.2290000000000001},"last":0.59399999999999997}]}]},{"osd":5,"up_from":13,"seq":55834574900,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297764,"kb_used_data":476,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074076,"statfs":{"total":96636764160,"available":96331853824,"internally_reserved":0,"allocated":487424,"data_stored":221217,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 01:24:36 2023","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.623,"15min":0.64000000000000001},"min":{"1min":0.34899999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.82499999999999996,"5min":0.94699999999999995,"15min":0.94699999999999995},"last":0.57399999999999995},{"interface":"front","average":{"1min":0.626,"5min":0.61599999999999999,"15min":0.60599999999999998},"min":{"1min":0.47999999999999998,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.82899999999999996,"5min":0.93500000000000005,"15min":0.93500000000000005},"last":1.9359999999999999}]},{"osd":1,"last update":"Fri Oct 6 01:24:36 2023","interfaces":[{"interface":"back","average":{"1min":0.64800000000000002,"5min":0.63600000000000001,"15min":0.63},"min":{"1min":0.498,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.84699999999999998,"5min":1.028,"15min":1.028},"last":0.64900000000000002},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.66600000000000004,"15min":0.67900000000000005},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.875,"5min":1.103,"15min":1.103},"last":1.502}]},{"osd":2,"last update":"Fri Oct 6 01:24:36 2023","interfaces":[{"interface":"back","average":{"1min":0.65900000000000003,"5min":0.68400000000000005,"15min":0.68799999999999994},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":0.83699999999999997,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":1.4470000000000001},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.66900000000000004,"15min":0.67200000000000004},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":0.93000000000000005,"5min":1.0229999999999999,"15min":1.0229999999999999},"last":0.69099999999999995}]},{"osd":3,"last update":"Fri Oct 6 01:24:36 2023","interfaces":[{"interface":"back","average":{"1min":0.628,"5min":0.64600000000000002,"15min":0.64600000000000002},"min":{"1min":0.52400000000000002,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.84099999999999997,"5min":0.96999999999999997,"15min":0.96999999999999997},"last":1.78},{"interface":"front","average":{"1min":0.69099999999999995,"5min":0.75800000000000001,"15min":0.78600000000000003},"min":{"1min":0.51300000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.90500000000000003,"5min":1.6419999999999999,"15min":1.6419999999999999},"last":1.6799999999999999}]},{"osd":4,"last update":"Fri Oct 6 01:24:36 2023","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.65800000000000003,"15min":0.67200000000000004},"min":{"1min":0.47799999999999998,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.997,"5min":1.0389999999999999,"15min":1.0389999999999999},"last":0.53000000000000003},{"interface":"front","average":{"1min":0.65400000000000003,"5min":0.64700000000000002,"15min":0.65500000000000003},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.85299999999999998,"5min":1.024,"15min":1.024},"last":1.823}]},{"osd":6,"last update":"Fri Oct 6 01:24:36 2023","interfaces":[{"interface":"back","average":{"1min":0.66400000000000003,"5min":0.66000000000000003,"15min":0.66200000000000003},"min":{"1min":0.45500000000000002,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.89500000000000002,"5min":1.131,"15min":1.131},"last":1.748},{"interface":"front","average":{"1min":0.73299999999999998,"5min":0.69199999999999995,"15min":0.68999999999999995},"min":{"1min":0.56299999999999994,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.048,"5min":1.0580000000000001,"15min":1.0580000000000001},"last":1.8620000000000001}]},{"osd":7,"last update":"Fri Oct 6 01:24:36 2023","interfaces":[{"interface":"back","average":{"1min":0.72799999999999998,"5min":0.71999999999999997,"15min":0.71899999999999997},"min":{"1min":0.54100000000000004,"5min":0.438,"15min":0.438},"max":{"1min":0.98399999999999999,"5min":1.0660000000000001,"15min":1.0660000000000001},"last":1.718},{"interface":"front","average":{"1min":0.80000000000000004,"5min":0.81499999999999995,"15min":0.82899999999999996},"min":{"1min":0.64100000000000001,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":1.115,"5min":1.198,"15min":1.198},"last":1.5529999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-06T01:25:31.816 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-06T01:25:32.004 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:32.003+0000 7f7949b9d700 1 Processor -- start 2023-10-06T01:25:32.004 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:32.003+0000 7f7949b9d700 1 -- start start 2023-10-06T01:25:32.007 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:32.004+0000 7f7949b9d700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f794413fa30 0x7f79440c0d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:25:32.007 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:32.004+0000 7f7949b9d700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f79440ca4d0 0x7f7944159f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:25:32.007 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:32.004+0000 7f7949b9d700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f794413fe00 0x7f794415a460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:25:32.007 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:32.004+0000 7f7949b9d700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f79440cb510 con 0x7f794413fe00 2023-10-06T01:25:32.008 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:32.004+0000 7f7949b9d700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f79440c1280 con 0x7f794413fa30 2023-10-06T01:25:32.008 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:32.004+0000 7f7949b9d700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f794406f4c0 con 0x7f79440ca4d0 2023-10-06T01:25:32.008 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:32.005+0000 7f794939c700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f794413fe00 0x7f794415a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:25:32.008 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:32.005+0000 7f794939c700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f794413fe00 0x7f794415a460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:48028/0 (socket says 172.21.15.50:48028) 2023-10-06T01:25:32.008 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:32.005+0000 7f794939c700 1 -- 172.21.15.50:0/1006279219 learned_addr learned my addr 172.21.15.50:0/1006279219 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-06T01:25:32.008 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:32.005+0000 7f7943fff700 1 --2- 172.21.15.50:0/1006279219 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f79440ca4d0 0x7f7944159f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:25:32.008 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:32.005+0000 7f7948b9b700 1 --2- 172.21.15.50:0/1006279219 >> v2:172.21.15.155:3300/0 conn(0x7f794413fa30 0x7f79440c0d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:25:32.008 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:32.005+0000 7f794939c700 1 -- 172.21.15.50:0/1006279219 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f79440ca4d0 msgr2=0x7f7944159f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:25:32.008 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:32.005+0000 7f794939c700 1 --2- 172.21.15.50:0/1006279219 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f79440ca4d0 0x7f7944159f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:25:32.008 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:32.005+0000 7f794939c700 1 -- 172.21.15.50:0/1006279219 >> v2:172.21.15.155:3300/0 conn(0x7f794413fa30 msgr2=0x7f79440c0d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:25:32.008 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:32.005+0000 7f794939c700 1 --2- 172.21.15.50:0/1006279219 >> v2:172.21.15.155:3300/0 conn(0x7f794413fa30 0x7f79440c0d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:25:32.008 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:32.005+0000 7f794939c700 1 -- 172.21.15.50:0/1006279219 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79440ca990 con 0x7f794413fe00 2023-10-06T01:25:32.009 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:32.005+0000 7f7948b9b700 1 --2- 172.21.15.50:0/1006279219 >> v2:172.21.15.155:3300/0 conn(0x7f794413fa30 0x7f79440c0d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T01:25:32.009 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:32.005+0000 7f794939c700 1 --2- 172.21.15.50:0/1006279219 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f794413fe00 0x7f794415a460 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f794406b530 tx=0x7f793c009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7aa6655c99f9a9f0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:25:32.009 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:32.006+0000 7f79437fe700 1 -- 172.21.15.50:0/1006279219 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f793c0092e0 con 0x7f794413fe00 2023-10-06T01:25:32.009 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:32.006+0000 7f79437fe700 1 -- 172.21.15.50:0/1006279219 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f793c00ba20 con 0x7f794413fe00 2023-10-06T01:25:32.009 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:32.006+0000 7f79437fe700 1 -- 172.21.15.50:0/1006279219 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f793c00bde0 con 0x7f794413fe00 2023-10-06T01:25:32.009 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:32.006+0000 7f7949b9d700 1 -- 172.21.15.50:0/1006279219 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f794413fe00 msgr2=0x7f794415a460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:25:32.009 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:32.006+0000 7f7949b9d700 1 --2- 172.21.15.50:0/1006279219 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f794413fe00 0x7f794415a460 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f794406b530 tx=0x7f793c009840 comp rx=0 tx=0).stop 2023-10-06T01:25:32.009 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:32.006+0000 7f7949b9d700 1 -- 172.21.15.50:0/1006279219 shutdown_connections 2023-10-06T01:25:32.009 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:32.006+0000 7f7949b9d700 1 --2- 172.21.15.50:0/1006279219 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f794413fe00 0x7f794415a460 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:25:32.009 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:32.006+0000 7f7949b9d700 1 --2- 172.21.15.50:0/1006279219 >> v2:172.21.15.155:3300/0 conn(0x7f794413fa30 0x7f79440c0d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:25:32.009 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:32.006+0000 7f7949b9d700 1 --2- 172.21.15.50:0/1006279219 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f79440ca4d0 0x7f7944159f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:25:32.009 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:32.006+0000 7f7949b9d700 1 -- 172.21.15.50:0/1006279219 >> 172.21.15.50:0/1006279219 conn(0x7f79440cbef0 msgr2=0x7f79440cc2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:25:32.010 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:32.006+0000 7f7949b9d700 1 -- 172.21.15.50:0/1006279219 shutdown_connections 2023-10-06T01:25:32.010 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:32.006+0000 7f7949b9d700 1 -- 172.21.15.50:0/1006279219 wait complete. 2023-10-06T01:25:32.011 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:32.008+0000 7f7949b9d700 1 Processor -- start 2023-10-06T01:25:32.011 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:32.008+0000 7f7949b9d700 1 -- start start 2023-10-06T01:25:32.012 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:32.009+0000 7f7949b9d700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f79440ca4d0 0x7f79440c3e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:25:32.012 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:32.009+0000 7f7949b9d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f794413fa30 0x7f794415fe80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:25:32.012 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:32.009+0000 7f7949b9d700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f794413fe00 0x7f7944169e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:25:32.012 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:32.009+0000 7f7949b9d700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79441595c0 con 0x7f794413fa30 2023-10-06T01:25:32.012 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:32.009+0000 7f7949b9d700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79440c4e90 con 0x7f794413fe00 2023-10-06T01:25:32.012 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:32.009+0000 7f7949b9d700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f794416b100 con 0x7f79440ca4d0 2023-10-06T01:25:32.012 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:32.009+0000 7f7943fff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f794413fa30 0x7f794415fe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:25:32.012 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:32.009+0000 7f7943fff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f794413fa30 0x7f794415fe80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:48040/0 (socket says 172.21.15.50:48040) 2023-10-06T01:25:32.012 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:32.009+0000 7f7943fff700 1 -- 172.21.15.50:0/4106390090 learned_addr learned my addr 172.21.15.50:0/4106390090 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-06T01:25:32.013 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:32.009+0000 7f7948b9b700 1 --2- 172.21.15.50:0/4106390090 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f79440ca4d0 0x7f79440c3e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:25:32.013 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:32.009+0000 7f794939c700 1 --2- 172.21.15.50:0/4106390090 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f794413fe00 0x7f7944169e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:25:32.013 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:32.009+0000 7f7943fff700 1 -- 172.21.15.50:0/4106390090 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f79440ca4d0 msgr2=0x7f79440c3e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:25:32.013 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:32.010+0000 7f7943fff700 1 --2- 172.21.15.50:0/4106390090 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f79440ca4d0 0x7f79440c3e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:25:32.013 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:32.010+0000 7f7943fff700 1 -- 172.21.15.50:0/4106390090 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f794413fe00 msgr2=0x7f7944169e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:25:32.013 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:32.010+0000 7f7943fff700 1 --2- 172.21.15.50:0/4106390090 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f794413fe00 0x7f7944169e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:25:32.013 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:32.010+0000 7f7943fff700 1 -- 172.21.15.50:0/4106390090 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f793c009ae0 con 0x7f794413fa30 2023-10-06T01:25:32.013 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:32.010+0000 7f7948b9b700 1 --2- 172.21.15.50:0/4106390090 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f79440ca4d0 0x7f79440c3e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T01:25:32.013 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:32.010+0000 7f7943fff700 1 --2- 172.21.15.50:0/4106390090 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f794413fa30 0x7f794415fe80 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f793000e900 tx=0x7f79300091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:25:32.014 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:32.010+0000 7f7940ff9700 1 -- 172.21.15.50:0/4106390090 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7930013680 con 0x7f794413fa30 2023-10-06T01:25:32.014 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:32.010+0000 7f7940ff9700 1 -- 172.21.15.50:0/4106390090 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79300137e0 con 0x7f794413fa30 2023-10-06T01:25:32.014 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:32.010+0000 7f7940ff9700 1 -- 172.21.15.50:0/4106390090 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7930013ba0 con 0x7f794413fa30 2023-10-06T01:25:32.014 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:32.010+0000 7f7949b9d700 1 -- 172.21.15.50:0/4106390090 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f79440c4340 con 0x7f794413fa30 2023-10-06T01:25:32.014 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:32.010+0000 7f7949b9d700 1 -- 172.21.15.50:0/4106390090 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f79440c48d0 con 0x7f794413fa30 2023-10-06T01:25:32.015 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:32.011+0000 7f7949b9d700 1 -- 172.21.15.50:0/4106390090 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f794405f270 con 0x7f794413fa30 2023-10-06T01:25:32.015 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:32.012+0000 7f7940ff9700 1 -- 172.21.15.50:0/4106390090 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f793000c460 con 0x7f794413fa30 2023-10-06T01:25:32.015 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:32.013+0000 7f7940ff9700 1 --2- 172.21.15.50:0/4106390090 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f7928066f00 0x7f79280693b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:25:32.015 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:32.014+0000 7f7940ff9700 1 -- 172.21.15.50:0/4106390090 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5612+0+0 (secure 0 0 0) 0x7f79300846b0 con 0x7f794413fa30 2023-10-06T01:25:32.015 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:32.014+0000 7f7948b9b700 1 --2- 172.21.15.50:0/4106390090 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f7928066f00 0x7f79280693b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:25:32.015 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:32.015+0000 7f7948b9b700 1 --2- 172.21.15.50:0/4106390090 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f7928066f00 0x7f79280693b0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f7938006f00 tx=0x7f7938008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:25:32.019 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:32.018+0000 7f7940ff9700 1 -- 172.21.15.50:0/4106390090 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f79300518e0 con 0x7f794413fa30 2023-10-06T01:25:32.219 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:32.218+0000 7f7949b9d700 1 -- 172.21.15.50:0/4106390090 --> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f79440cac70 con 0x7f7928066f00 2023-10-06T01:25:32.223 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:32.222+0000 7f7940ff9700 1 -- 172.21.15.50:0/4106390090 <== mgr.4099 v2:172.21.15.155:6832/85215 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+72889 (secure 0 0 0) 0x7f79440cac70 con 0x7f7928066f00 2023-10-06T01:25:32.224 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-10-06T01:25:32.226 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:32.224+0000 7f7949b9d700 1 -- 172.21.15.50:0/4106390090 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f7928066f00 msgr2=0x7f79280693b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:25:32.226 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:32.224+0000 7f7949b9d700 1 --2- 172.21.15.50:0/4106390090 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f7928066f00 0x7f79280693b0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f7938006f00 tx=0x7f7938008040 comp rx=0 tx=0).stop 2023-10-06T01:25:32.226 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:32.224+0000 7f7949b9d700 1 -- 172.21.15.50:0/4106390090 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f794413fa30 msgr2=0x7f794415fe80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:25:32.226 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:32.224+0000 7f7949b9d700 1 --2- 172.21.15.50:0/4106390090 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f794413fa30 0x7f794415fe80 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f793000e900 tx=0x7f79300091a0 comp rx=0 tx=0).stop 2023-10-06T01:25:32.226 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:32.225+0000 7f7949b9d700 1 -- 172.21.15.50:0/4106390090 shutdown_connections 2023-10-06T01:25:32.226 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:32.225+0000 7f7949b9d700 1 --2- 172.21.15.50:0/4106390090 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f7928066f00 0x7f79280693b0 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:25:32.226 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:32.225+0000 7f7949b9d700 1 --2- 172.21.15.50:0/4106390090 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f794413fe00 0x7f7944169e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:25:32.226 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:32.225+0000 7f7949b9d700 1 --2- 172.21.15.50:0/4106390090 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f79440ca4d0 0x7f79440c3e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:25:32.226 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:32.225+0000 7f7949b9d700 1 --2- 172.21.15.50:0/4106390090 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f794413fa30 0x7f794415fe80 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:25:32.226 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:32.225+0000 7f7949b9d700 1 -- 172.21.15.50:0/4106390090 >> 172.21.15.50:0/4106390090 conn(0x7f79440cbef0 msgr2=0x7f79440ade10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:25:32.226 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:32.225+0000 7f7949b9d700 1 -- 172.21.15.50:0/4106390090 shutdown_connections 2023-10-06T01:25:32.227 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:32.225+0000 7f7949b9d700 1 -- 172.21.15.50:0/4106390090 wait complete. 2023-10-06T01:25:32.227 INFO:teuthology.orchestra.run.smithi050.stderr:dumped all 2023-10-06T01:25:32.243 INFO:teuthology.orchestra.run.smithi050.stdout:{"pg_ready":true,"pg_map":{"version":159,"stamp":"2023-10-06T01:25:31.828578+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":205,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2399736,"kb_used_data":5048,"kb_used_omap":0,"kb_used_meta":2394624,"kb_avail":752574984,"statfs":{"total":773094113280,"available":770636783616,"internally_reserved":0,"allocated":5169152,"data_stored":2988606,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2452094976},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":12,"apply_latency_ms":12,"commit_latency_ns":12000000,"apply_latency_ns":12000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-768876,"num_objects":-23,"num_object_clones":0,"num_object_copies":-46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-23,"num_whiteouts":0,"num_read":-1,"num_read_kb":-5,"num_write":-150,"num_write_kb":-805,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.383744"},"pg_stats":[{"pgid":"1.5","version":"0'0","reported_seq":35,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T01:25:25.447872+0000","last_change":"2023-10-06T01:21:30.601117+0000","last_active":"2023-10-06T01:25:25.447872+0000","last_peered":"2023-10-06T01:25:25.447872+0000","last_clean":"2023-10-06T01:25:25.447872+0000","last_became_active":"2023-10-06T01:21:30.600724+0000","last_became_peered":"2023-10-06T01:21:30.600724+0000","last_unstale":"2023-10-06T01:25:25.447872+0000","last_undegraded":"2023-10-06T01:25:25.447872+0000","last_fullsized":"2023-10-06T01:25:25.447872+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:21:29.586558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:21:29.586558+0000","last_clean_scrub_stamp":"2023-10-06T01:21:29.586558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:47:24.449013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":34,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T01:25:25.876373+0000","last_change":"2023-10-06T01:21:30.603434+0000","last_active":"2023-10-06T01:25:25.876373+0000","last_peered":"2023-10-06T01:25:25.876373+0000","last_clean":"2023-10-06T01:25:25.876373+0000","last_became_active":"2023-10-06T01:21:30.603215+0000","last_became_peered":"2023-10-06T01:21:30.603215+0000","last_unstale":"2023-10-06T01:25:25.876373+0000","last_undegraded":"2023-10-06T01:25:25.876373+0000","last_fullsized":"2023-10-06T01:25:25.876373+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:21:29.586558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:21:29.586558+0000","last_clean_scrub_stamp":"2023-10-06T01:21:29.586558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:47:24.449013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":33,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T01:25:26.475307+0000","last_change":"2023-10-06T01:21:30.604889+0000","last_active":"2023-10-06T01:25:26.475307+0000","last_peered":"2023-10-06T01:25:26.475307+0000","last_clean":"2023-10-06T01:25:26.475307+0000","last_became_active":"2023-10-06T01:21:30.604535+0000","last_became_peered":"2023-10-06T01:21:30.604535+0000","last_unstale":"2023-10-06T01:25:26.475307+0000","last_undegraded":"2023-10-06T01:25:26.475307+0000","last_fullsized":"2023-10-06T01:25:26.475307+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:21:29.586558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:21:29.586558+0000","last_clean_scrub_stamp":"2023-10-06T01:21:29.586558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:17:59.434982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"17'117","reported_seq":182,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T01:25:26.475644+0000","last_change":"2023-10-06T01:21:31.602437+0000","last_active":"2023-10-06T01:25:26.475644+0000","last_peered":"2023-10-06T01:25:26.475644+0000","last_clean":"2023-10-06T01:25:26.475644+0000","last_became_active":"2023-10-06T01:21:31.601431+0000","last_became_peered":"2023-10-06T01:21:31.601431+0000","last_unstale":"2023-10-06T01:25:26.475644+0000","last_undegraded":"2023-10-06T01:25:26.475644+0000","last_fullsized":"2023-10-06T01:25:26.475644+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:21:30.589171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:21:30.589171+0000","last_clean_scrub_stamp":"2023-10-06T01:21:30.589171+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T01:48:45.877807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":33,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T01:25:26.475635+0000","last_change":"2023-10-06T01:21:31.338236+0000","last_active":"2023-10-06T01:25:26.475635+0000","last_peered":"2023-10-06T01:25:26.475635+0000","last_clean":"2023-10-06T01:25:26.475635+0000","last_became_active":"2023-10-06T01:21:31.337918+0000","last_became_peered":"2023-10-06T01:21:31.337918+0000","last_unstale":"2023-10-06T01:25:26.475635+0000","last_undegraded":"2023-10-06T01:25:26.475635+0000","last_fullsized":"2023-10-06T01:25:26.475635+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:21:29.586558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:21:29.586558+0000","last_clean_scrub_stamp":"2023-10-06T01:21:29.586558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:02:13.010488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":33,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T01:25:26.475534+0000","last_change":"2023-10-06T01:21:31.338209+0000","last_active":"2023-10-06T01:25:26.475534+0000","last_peered":"2023-10-06T01:25:26.475534+0000","last_clean":"2023-10-06T01:25:26.475534+0000","last_became_active":"2023-10-06T01:21:31.337870+0000","last_became_peered":"2023-10-06T01:21:31.337870+0000","last_unstale":"2023-10-06T01:25:26.475534+0000","last_undegraded":"2023-10-06T01:25:26.475534+0000","last_fullsized":"2023-10-06T01:25:26.475534+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:21:29.586558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:21:29.586558+0000","last_clean_scrub_stamp":"2023-10-06T01:21:29.586558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:53:47.117299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":33,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T01:25:25.448031+0000","last_change":"2023-10-06T01:21:31.338177+0000","last_active":"2023-10-06T01:25:25.448031+0000","last_peered":"2023-10-06T01:25:25.448031+0000","last_clean":"2023-10-06T01:25:25.448031+0000","last_became_active":"2023-10-06T01:21:31.337872+0000","last_became_peered":"2023-10-06T01:21:31.337872+0000","last_unstale":"2023-10-06T01:25:25.448031+0000","last_undegraded":"2023-10-06T01:25:25.448031+0000","last_fullsized":"2023-10-06T01:25:25.448031+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:21:29.586558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:21:29.586558+0000","last_clean_scrub_stamp":"2023-10-06T01:21:29.586558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:17:59.434982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":33,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T01:25:26.476425+0000","last_change":"2023-10-06T01:21:31.338181+0000","last_active":"2023-10-06T01:25:26.476425+0000","last_peered":"2023-10-06T01:25:26.476425+0000","last_clean":"2023-10-06T01:25:26.476425+0000","last_became_active":"2023-10-06T01:21:31.337820+0000","last_became_peered":"2023-10-06T01:21:31.337820+0000","last_unstale":"2023-10-06T01:25:26.476425+0000","last_undegraded":"2023-10-06T01:25:26.476425+0000","last_fullsized":"2023-10-06T01:25:26.476425+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:21:29.586558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:21:29.586558+0000","last_clean_scrub_stamp":"2023-10-06T01:21:29.586558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:44:49.740873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":33,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T01:25:26.476713+0000","last_change":"2023-10-06T01:21:30.604007+0000","last_active":"2023-10-06T01:25:26.476713+0000","last_peered":"2023-10-06T01:25:26.476713+0000","last_clean":"2023-10-06T01:25:26.476713+0000","last_became_active":"2023-10-06T01:21:30.603673+0000","last_became_peered":"2023-10-06T01:21:30.603673+0000","last_unstale":"2023-10-06T01:25:26.476713+0000","last_undegraded":"2023-10-06T01:25:26.476713+0000","last_fullsized":"2023-10-06T01:25:26.476713+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:21:29.586558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:21:29.586558+0000","last_clean_scrub_stamp":"2023-10-06T01:21:29.586558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:53:47.117299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574900,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298348,"kb_used_data":1060,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073492,"statfs":{"total":96636764160,"available":96331255808,"internally_reserved":0,"allocated":1085440,"data_stored":812583,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 01:24:32 2023","interfaces":[{"interface":"back","average":{"1min":0.67300000000000004,"5min":0.67000000000000004,"15min":0.68500000000000005},"min":{"1min":0.45600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.85999999999999999,"5min":0.93700000000000006,"15min":0.93700000000000006},"last":0.60099999999999998},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.63100000000000001,"15min":0.64900000000000002},"min":{"1min":0.44,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.82299999999999995,"5min":0.96999999999999997,"15min":0.96999999999999997},"last":0.45500000000000002}]},{"osd":1,"last update":"Fri Oct 6 01:24:32 2023","interfaces":[{"interface":"back","average":{"1min":0.66100000000000003,"5min":0.64700000000000002,"15min":0.66100000000000003},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.82899999999999996,"5min":0.89400000000000002,"15min":0.89400000000000002},"last":0.53500000000000003},{"interface":"front","average":{"1min":0.621,"5min":0.66500000000000004,"15min":0.67700000000000005},"min":{"1min":0.47699999999999998,"5min":0.439,"15min":0.439},"max":{"1min":0.78700000000000003,"5min":0.91400000000000003,"15min":0.91400000000000003},"last":0.57299999999999995}]},{"osd":2,"last update":"Fri Oct 6 01:24:32 2023","interfaces":[{"interface":"back","average":{"1min":0.58299999999999996,"5min":0.64000000000000001,"15min":0.66200000000000003},"min":{"1min":0.49299999999999999,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":0.72799999999999998,"5min":0.82899999999999996,"15min":0.82899999999999996},"last":0.62},{"interface":"front","average":{"1min":0.71099999999999997,"5min":0.71299999999999997,"15min":0.73299999999999998},"min":{"1min":0.52000000000000002,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.82499999999999996,"5min":0.93600000000000005,"15min":0.93600000000000005},"last":0.48599999999999999}]},{"osd":3,"last update":"Fri Oct 6 01:24:32 2023","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.71799999999999997,"15min":0.73799999999999999},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":0.89500000000000002,"5min":1.0660000000000001,"15min":1.0660000000000001},"last":0.52500000000000002},{"interface":"front","average":{"1min":0.68100000000000005,"5min":0.72299999999999998,"15min":0.74399999999999999},"min":{"1min":0.61599999999999999,"5min":0.495,"15min":0.495},"max":{"1min":0.84999999999999998,"5min":0.89400000000000002,"15min":0.89400000000000002},"last":0.67500000000000004}]},{"osd":4,"last update":"Fri Oct 6 01:24:32 2023","interfaces":[{"interface":"back","average":{"1min":0.68799999999999994,"5min":0.63900000000000001,"15min":0.63700000000000001},"min":{"1min":0.42699999999999999,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.90500000000000003,"5min":1.01,"15min":1.01},"last":0.72299999999999998},{"interface":"front","average":{"1min":0.65600000000000003,"5min":0.66300000000000003,"15min":0.67300000000000004},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":0.94399999999999995,"5min":0.94399999999999995,"15min":0.94399999999999995},"last":0.64800000000000002}]},{"osd":5,"last update":"Fri Oct 6 01:24:32 2023","interfaces":[{"interface":"back","average":{"1min":0.67800000000000005,"5min":0.65300000000000002,"15min":0.65900000000000003},"min":{"1min":0.49099999999999999,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.98599999999999999,"5min":0.98599999999999999,"15min":0.98599999999999999},"last":0.55800000000000005},{"interface":"front","average":{"1min":0.78600000000000003,"5min":0.73099999999999998,"15min":0.72699999999999998},"min":{"1min":0.54700000000000004,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":0.97999999999999998,"5min":0.97999999999999998,"15min":0.97999999999999998},"last":0.66300000000000003}]},{"osd":6,"last update":"Fri Oct 6 01:24:32 2023","interfaces":[{"interface":"back","average":{"1min":0.78800000000000003,"5min":0.77000000000000002,"15min":0.78100000000000003},"min":{"1min":0.497,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":1,"5min":1,"15min":1},"last":0.81000000000000005},{"interface":"front","average":{"1min":0.72799999999999998,"5min":0.748,"15min":0.753},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":0.97499999999999998,"5min":1.1000000000000001,"15min":1.1000000000000001},"last":0.69499999999999995}]}]},{"osd":6,"up_from":13,"seq":55834574900,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297780,"kb_used_data":492,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074060,"statfs":{"total":96636764160,"available":96331837440,"internally_reserved":0,"allocated":503808,"data_stored":228847,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 01:24:34 2023","interfaces":[{"interface":"back","average":{"1min":0.63600000000000001,"5min":0.71399999999999997,"15min":0.76000000000000001},"min":{"1min":0.45400000000000001,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.80800000000000005,"5min":1.9279999999999999,"15min":1.9279999999999999},"last":0.46200000000000002},{"interface":"front","average":{"1min":0.68500000000000005,"5min":0.77500000000000002,"15min":0.81699999999999995},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":0.81999999999999995,"5min":2.3420000000000001,"15min":2.3420000000000001},"last":0.496}]},{"osd":1,"last update":"Fri Oct 6 01:24:34 2023","interfaces":[{"interface":"back","average":{"1min":0.64000000000000001,"5min":1.0029999999999999,"15min":1.175},"min":{"1min":0.49099999999999999,"5min":0.44,"15min":0.44},"max":{"1min":0.85999999999999999,"5min":12.529,"15min":12.529},"last":0.65800000000000003},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.79100000000000004,"15min":0.85199999999999998},"min":{"1min":0.48799999999999999,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.91100000000000003,"5min":3.98,"15min":3.98},"last":0.92800000000000005}]},{"osd":2,"last update":"Fri Oct 6 01:24:34 2023","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.81200000000000006,"15min":0.89600000000000002},"min":{"1min":0.5,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.78500000000000003,"5min":5.4859999999999998,"15min":5.4859999999999998},"last":0.73899999999999999},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.73199999999999998,"15min":0.77800000000000002},"min":{"1min":0.48299999999999998,"5min":0.443,"15min":0.443},"max":{"1min":0.78600000000000003,"5min":2.718,"15min":2.718},"last":0.79300000000000004}]},{"osd":3,"last update":"Fri Oct 6 01:24:34 2023","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.745,"15min":0.78300000000000003},"min":{"1min":0.48899999999999999,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":0.88400000000000001,"5min":2.5129999999999999,"15min":2.5129999999999999},"last":0.55400000000000005},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.747,"15min":0.77700000000000002},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":0.81599999999999995,"5min":1.9870000000000001,"15min":1.9870000000000001},"last":0.68000000000000005}]},{"osd":4,"last update":"Fri Oct 6 01:24:34 2023","interfaces":[{"interface":"back","average":{"1min":0.66900000000000004,"5min":0.71099999999999997,"15min":0.748},"min":{"1min":0.47199999999999998,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.78900000000000003,"5min":3.1480000000000001,"15min":3.1480000000000001},"last":0.72199999999999998},{"interface":"front","average":{"1min":0.72999999999999998,"5min":0.77000000000000002,"15min":0.80400000000000005},"min":{"1min":0.49199999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.89700000000000002,"5min":2.4769999999999999,"15min":2.4769999999999999},"last":0.97799999999999998}]},{"osd":5,"last update":"Fri Oct 6 01:24:34 2023","interfaces":[{"interface":"back","average":{"1min":0.747,"5min":0.85999999999999999,"15min":0.92600000000000005},"min":{"1min":0.46000000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.88100000000000001,"5min":5.4279999999999999,"15min":5.4279999999999999},"last":0.78200000000000003},{"interface":"front","average":{"1min":0.78200000000000003,"5min":0.81299999999999994,"15min":0.84499999999999997},"min":{"1min":0.65900000000000003,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":0.91700000000000004,"5min":2.6739999999999999,"15min":2.6739999999999999},"last":0.76200000000000001}]},{"osd":7,"last update":"Fri Oct 6 01:24:34 2023","interfaces":[{"interface":"back","average":{"1min":0.76900000000000002,"5min":0.82399999999999995,"15min":0.86399999999999999},"min":{"1min":0.55500000000000005,"5min":0.497,"15min":0.497},"max":{"1min":0.94699999999999995,"5min":2.7719999999999998,"15min":2.7719999999999998},"last":0.81100000000000005},{"interface":"front","average":{"1min":0.77800000000000002,"5min":0.96799999999999997,"15min":1.0620000000000001},"min":{"1min":0.64200000000000002,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":1,"5min":7.1440000000000001,"15min":7.1440000000000001},"last":0.83799999999999997}]}]},{"osd":1,"up_from":13,"seq":55834574898,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302452,"kb_used_data":1068,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069388,"statfs":{"total":96636764160,"available":96327053312,"internally_reserved":0,"allocated":1093632,"data_stored":818237,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 01:24:33 2023","interfaces":[{"interface":"back","average":{"1min":0.437,"5min":0.44900000000000001,"15min":0.45500000000000002},"min":{"1min":0.33000000000000002,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.56499999999999995,"5min":0.70699999999999996,"15min":0.70699999999999996},"last":0.443},{"interface":"front","average":{"1min":0.44400000000000001,"5min":0.48799999999999999,"15min":0.5},"min":{"1min":0.38100000000000001,"5min":0.375,"15min":0.375},"max":{"1min":0.503,"5min":0.752,"15min":0.752},"last":0.42799999999999999}]},{"osd":2,"last update":"Fri Oct 6 01:24:33 2023","interfaces":[{"interface":"back","average":{"1min":0.38600000000000001,"5min":0.44900000000000001,"15min":0.46899999999999997},"min":{"1min":0.314,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.496,"5min":1.073,"15min":1.073},"last":0.35999999999999999},{"interface":"front","average":{"1min":0.45700000000000002,"5min":0.47899999999999998,"15min":0.48999999999999999},"min":{"1min":0.36599999999999999,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.56399999999999995,"5min":0.69999999999999996,"15min":0.69999999999999996},"last":0.48999999999999999}]},{"osd":3,"last update":"Fri Oct 6 01:24:33 2023","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.56399999999999995,"15min":0.57599999999999996},"min":{"1min":0.47699999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.67500000000000004,"5min":0.72799999999999998,"15min":0.72799999999999998},"last":0.51400000000000001},{"interface":"front","average":{"1min":0.48699999999999999,"5min":0.52700000000000002,"15min":0.55100000000000005},"min":{"1min":0.34200000000000003,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.58999999999999997,"5min":0.93400000000000005,"15min":0.93400000000000005},"last":0.379}]},{"osd":4,"last update":"Fri Oct 6 01:24:33 2023","interfaces":[{"interface":"back","average":{"1min":0.74299999999999999,"5min":0.755,"15min":0.77900000000000003},"min":{"1min":0.434,"5min":0.432,"15min":0.432},"max":{"1min":0.96699999999999997,"5min":1.534,"15min":1.534},"last":0.65000000000000002},{"interface":"front","average":{"1min":0.73099999999999998,"5min":0.75900000000000001,"15min":0.78900000000000003},"min":{"1min":0.54600000000000004,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.94699999999999995,"5min":1.742,"15min":1.742},"last":0.73699999999999999}]},{"osd":5,"last update":"Fri Oct 6 01:24:33 2023","interfaces":[{"interface":"back","average":{"1min":0.749,"5min":0.755,"15min":0.77600000000000002},"min":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.0740000000000001,"5min":1.4790000000000001,"15min":1.4790000000000001},"last":0.81200000000000006},{"interface":"front","average":{"1min":0.73399999999999999,"5min":0.77000000000000002,"15min":0.80600000000000005},"min":{"1min":0.51000000000000001,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":0.879,"5min":1.581,"15min":1.581},"last":0.754}]},{"osd":6,"last update":"Fri Oct 6 01:24:33 2023","interfaces":[{"interface":"back","average":{"1min":0.73899999999999999,"5min":0.75800000000000001,"15min":0.78400000000000003},"min":{"1min":0.52600000000000002,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":0.95599999999999996,"5min":1.51,"15min":1.51},"last":0.77500000000000002},{"interface":"front","average":{"1min":0.79300000000000004,"5min":0.78400000000000003,"15min":0.80200000000000005},"min":{"1min":0.624,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":0.98399999999999999,"5min":1.26,"15min":1.26},"last":0.83799999999999997}]},{"osd":7,"last update":"Fri Oct 6 01:24:33 2023","interfaces":[{"interface":"back","average":{"1min":0.76600000000000001,"5min":0.79200000000000004,"15min":0.82399999999999995},"min":{"1min":0.62,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":0.93999999999999995,"5min":1.7070000000000001,"15min":1.7070000000000001},"last":0.71299999999999997},{"interface":"front","average":{"1min":0.79500000000000004,"5min":0.82399999999999995,"15min":0.85799999999999998},"min":{"1min":0.55300000000000005,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":0.999,"5min":1.633,"15min":1.633},"last":0.78100000000000003}]}]},{"osd":0,"up_from":13,"seq":55834574899,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301860,"kb_used_data":476,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069980,"statfs":{"total":96636764160,"available":96327659520,"internally_reserved":0,"allocated":487424,"data_stored":221181,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Oct 6 01:24:33 2023","interfaces":[{"interface":"back","average":{"1min":0.42699999999999999,"5min":0.56299999999999994,"15min":0.627},"min":{"1min":0.27700000000000002,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.92800000000000005,"5min":2.8559999999999999,"15min":2.8559999999999999},"last":0.313},{"interface":"front","average":{"1min":0.42799999999999999,"5min":0.61399999999999999,"15min":0.68899999999999995},"min":{"1min":0.28999999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.68000000000000005,"5min":2.944,"15min":2.944},"last":0.44500000000000001}]},{"osd":2,"last update":"Fri Oct 6 01:24:33 2023","interfaces":[{"interface":"back","average":{"1min":0.48299999999999998,"5min":0.67000000000000004,"15min":0.746},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.58299999999999996,"5min":2.8940000000000001,"15min":2.8940000000000001},"last":0.49399999999999999},{"interface":"front","average":{"1min":0.48999999999999999,"5min":0.67100000000000004,"15min":0.73599999999999999},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.63500000000000001,"5min":2.9820000000000002,"15min":2.9820000000000002},"last":0.51800000000000002}]},{"osd":3,"last update":"Fri Oct 6 01:24:33 2023","interfaces":[{"interface":"back","average":{"1min":0.443,"5min":0.59799999999999998,"15min":0.66600000000000004},"min":{"1min":0.312,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.55400000000000005,"5min":2.7559999999999998,"15min":2.7559999999999998},"last":0.35199999999999998},{"interface":"front","average":{"1min":0.47399999999999998,"5min":0.63700000000000001,"15min":0.70099999999999996},"min":{"1min":0.41999999999999998,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.57299999999999995,"5min":2.8140000000000001,"15min":2.8140000000000001},"last":0.53000000000000003}]},{"osd":4,"last update":"Fri Oct 6 01:24:33 2023","interfaces":[{"interface":"back","average":{"1min":0.73899999999999999,"5min":0.77300000000000002,"15min":0.79900000000000004},"min":{"1min":0.54400000000000004,"5min":0.441,"15min":0.441},"max":{"1min":1.3320000000000001,"5min":1.397,"15min":1.397},"last":0.56299999999999994},{"interface":"front","average":{"1min":0.751,"5min":0.80700000000000005,"15min":0.84499999999999997},"min":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.2929999999999999,"5min":1.833,"15min":1.833},"last":0.755}]},{"osd":5,"last update":"Fri Oct 6 01:24:33 2023","interfaces":[{"interface":"back","average":{"1min":0.74299999999999999,"5min":0.79800000000000004,"15min":0.82699999999999996},"min":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":0.95899999999999996,"5min":1.4430000000000001,"15min":1.4430000000000001},"last":0.66900000000000004},{"interface":"front","average":{"1min":0.749,"5min":0.77500000000000002,"15min":0.80100000000000005},"min":{"1min":0.55600000000000005,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":0.95399999999999996,"5min":1.4359999999999999,"15min":1.4359999999999999},"last":0.68700000000000006}]},{"osd":6,"last update":"Fri Oct 6 01:24:33 2023","interfaces":[{"interface":"back","average":{"1min":0.72799999999999998,"5min":0.84099999999999997,"15min":0.90100000000000002},"min":{"1min":0.54500000000000004,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":0.96999999999999997,"5min":1.8740000000000001,"15min":1.8740000000000001},"last":0.81999999999999995},{"interface":"front","average":{"1min":0.77600000000000002,"5min":0.80900000000000005,"15min":0.84199999999999997},"min":{"1min":0.61399999999999999,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":0.878,"5min":1.361,"15min":1.361},"last":0.59999999999999998}]},{"osd":7,"last update":"Fri Oct 6 01:24:33 2023","interfaces":[{"interface":"back","average":{"1min":0.77800000000000002,"5min":0.82199999999999995,"15min":0.85399999999999998},"min":{"1min":0.55900000000000005,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":1.21,"5min":1.413,"15min":1.413},"last":0.63700000000000001},{"interface":"front","average":{"1min":0.76100000000000001,"5min":0.79400000000000004,"15min":0.82199999999999995},"min":{"1min":0.627,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1.0009999999999999,"5min":1.2929999999999999,"15min":1.2929999999999999},"last":0.622}]}]},{"osd":2,"up_from":13,"seq":55834574898,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301876,"kb_used_data":492,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069964,"statfs":{"total":96636764160,"available":96327643136,"internally_reserved":0,"allocated":503808,"data_stored":228847,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 01:24:36 2023","interfaces":[{"interface":"back","average":{"1min":0.41699999999999998,"5min":0.46700000000000003,"15min":0.48699999999999999},"min":{"1min":0.33000000000000002,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.61799999999999999,"5min":0.96599999999999997,"15min":0.96599999999999997},"last":0.375},{"interface":"front","average":{"1min":0.499,"5min":0.52200000000000002,"15min":0.53900000000000003},"min":{"1min":0.318,"5min":0.31,"15min":0.31},"max":{"1min":0.68200000000000005,"5min":1,"15min":1},"last":0.59599999999999997}]},{"osd":1,"last update":"Fri Oct 6 01:24:36 2023","interfaces":[{"interface":"back","average":{"1min":0.49299999999999999,"5min":0.55000000000000004,"15min":0.57999999999999996},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.64900000000000002,"5min":1.296,"15min":1.296},"last":0.33500000000000002},{"interface":"front","average":{"1min":0.48199999999999998,"5min":0.53800000000000003,"15min":0.56399999999999995},"min":{"1min":0.39000000000000001,"5min":0.313,"15min":0.313},"max":{"1min":0.56799999999999995,"5min":1.1379999999999999,"15min":1.1379999999999999},"last":0.48299999999999998}]},{"osd":3,"last update":"Fri Oct 6 01:24:36 2023","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.60199999999999998,"15min":0.63400000000000001},"min":{"1min":0.45300000000000001,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.65200000000000002,"5min":1.222,"15min":1.222},"last":0.432},{"interface":"front","average":{"1min":0.44900000000000001,"5min":0.48999999999999999,"15min":0.503},"min":{"1min":0.35499999999999998,"5min":0.318,"15min":0.318},"max":{"1min":0.57199999999999995,"5min":0.72099999999999997,"15min":0.72099999999999997},"last":0.46000000000000002}]},{"osd":4,"last update":"Fri Oct 6 01:24:36 2023","interfaces":[{"interface":"back","average":{"1min":0.76300000000000001,"5min":0.73599999999999999,"15min":0.73599999999999999},"min":{"1min":0.58399999999999996,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":0.96799999999999997,"5min":1.0700000000000001,"15min":1.0700000000000001},"last":0.68700000000000006},{"interface":"front","average":{"1min":0.76900000000000002,"5min":0.80500000000000005,"15min":0.82799999999999996},"min":{"1min":0.59599999999999997,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":0.99099999999999999,"5min":1.5469999999999999,"15min":1.5469999999999999},"last":0.79200000000000004}]},{"osd":5,"last update":"Fri Oct 6 01:24:36 2023","interfaces":[{"interface":"back","average":{"1min":0.749,"5min":0.76800000000000002,"15min":0.78600000000000003},"min":{"1min":0.54800000000000004,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":1.0309999999999999,"5min":1.5940000000000001,"15min":1.5940000000000001},"last":0.745},{"interface":"front","average":{"1min":0.72199999999999998,"5min":0.82399999999999995,"15min":0.86399999999999999},"min":{"1min":0.55600000000000005,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":0.91900000000000004,"5min":1.7669999999999999,"15min":1.7669999999999999},"last":0.71799999999999997}]},{"osd":6,"last update":"Fri Oct 6 01:24:36 2023","interfaces":[{"interface":"back","average":{"1min":0.73699999999999999,"5min":0.85599999999999998,"15min":0.90900000000000003},"min":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":1.0029999999999999,"5min":2.0510000000000002,"15min":2.0510000000000002},"last":0.81499999999999995},{"interface":"front","average":{"1min":0.72199999999999998,"5min":0.755,"15min":0.77900000000000003},"min":{"1min":0.55600000000000005,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":0.93600000000000005,"5min":1.633,"15min":1.633},"last":0.61499999999999999}]},{"osd":7,"last update":"Fri Oct 6 01:24:36 2023","interfaces":[{"interface":"back","average":{"1min":0.74299999999999999,"5min":0.80100000000000005,"15min":0.82899999999999996},"min":{"1min":0.54900000000000004,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.0109999999999999,"5min":1.4670000000000001,"15min":1.4670000000000001},"last":0.82799999999999996},{"interface":"front","average":{"1min":0.76500000000000001,"5min":0.83199999999999996,"15min":0.86799999999999999},"min":{"1min":0.60899999999999999,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":0.91800000000000004,"5min":1.8,"15min":1.8},"last":0.65200000000000002}]}]},{"osd":3,"up_from":13,"seq":55834574898,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301876,"kb_used_data":492,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069964,"statfs":{"total":96636764160,"available":96327643136,"internally_reserved":0,"allocated":503808,"data_stored":228847,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 01:24:37 2023","interfaces":[{"interface":"back","average":{"1min":0.43099999999999999,"5min":0.41699999999999998,"15min":0.41499999999999998},"min":{"1min":0.29999999999999999,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.95399999999999996,"5min":0.95399999999999996,"15min":0.95399999999999996},"last":0.32100000000000001},{"interface":"front","average":{"1min":0.42099999999999999,"5min":0.44400000000000001,"15min":0.45800000000000002},"min":{"1min":0.29099999999999998,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.60499999999999998,"5min":0.69199999999999995,"15min":0.69199999999999995},"last":0.35299999999999998}]},{"osd":1,"last update":"Fri Oct 6 01:24:37 2023","interfaces":[{"interface":"back","average":{"1min":0.434,"5min":0.46800000000000003,"15min":0.49199999999999999},"min":{"1min":0.307,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.94099999999999995,"5min":1.075,"15min":1.075},"last":0.40100000000000002},{"interface":"front","average":{"1min":0.499,"5min":0.51500000000000001,"15min":0.52200000000000002},"min":{"1min":0.39400000000000002,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68300000000000005},"last":0.44500000000000001}]},{"osd":2,"last update":"Fri Oct 6 01:24:37 2023","interfaces":[{"interface":"back","average":{"1min":0.47899999999999998,"5min":0.53000000000000003,"15min":0.55000000000000004},"min":{"1min":0.40400000000000003,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.57699999999999996,"5min":1.4319999999999999,"15min":1.4319999999999999},"last":0.46200000000000002},{"interface":"front","average":{"1min":0.52300000000000002,"5min":0.56399999999999995,"15min":0.58499999999999996},"min":{"1min":0.433,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.98999999999999999,"5min":1.532,"15min":1.532},"last":0.47899999999999998}]},{"osd":4,"last update":"Fri Oct 6 01:24:37 2023","interfaces":[{"interface":"back","average":{"1min":0.747,"5min":0.81100000000000005,"15min":0.83999999999999997},"min":{"1min":0.61699999999999999,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":0.91100000000000003,"5min":1.1080000000000001,"15min":1.1080000000000001},"last":0.92000000000000004},{"interface":"front","average":{"1min":0.77200000000000002,"5min":0.81999999999999995,"15min":0.84699999999999998},"min":{"1min":0.65600000000000003,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":1.0509999999999999,"5min":1.353,"15min":1.353},"last":0.80000000000000004}]},{"osd":5,"last update":"Fri Oct 6 01:24:37 2023","interfaces":[{"interface":"back","average":{"1min":0.75,"5min":0.77100000000000002,"15min":0.78900000000000003},"min":{"1min":0.60099999999999998,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":1.0740000000000001,"5min":1.3149999999999999,"15min":1.3149999999999999},"last":0.93300000000000005},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.75700000000000001,"15min":0.78700000000000003},"min":{"1min":0.57999999999999996,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":0.90600000000000003,"5min":1.155,"15min":1.155},"last":0.78900000000000003}]},{"osd":6,"last update":"Fri Oct 6 01:24:37 2023","interfaces":[{"interface":"back","average":{"1min":0.78100000000000003,"5min":0.82499999999999996,"15min":0.85299999999999998},"min":{"1min":0.59299999999999997,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":0.93600000000000005,"5min":1.1479999999999999,"15min":1.1479999999999999},"last":0.71499999999999997},{"interface":"front","average":{"1min":0.78200000000000003,"5min":0.82899999999999996,"15min":0.85699999999999998},"min":{"1min":0.59399999999999997,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.095,"5min":1.3779999999999999,"15min":1.3779999999999999},"last":0.85199999999999998}]},{"osd":7,"last update":"Fri Oct 6 01:24:37 2023","interfaces":[{"interface":"back","average":{"1min":0.71499999999999997,"5min":0.81000000000000005,"15min":0.84399999999999997},"min":{"1min":0.56999999999999995,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":0.97099999999999997,"5min":1.1240000000000001,"15min":1.1240000000000001},"last":1.0409999999999999},{"interface":"front","average":{"1min":0.79100000000000004,"5min":0.84599999999999997,"15min":0.88400000000000001},"min":{"1min":0.65800000000000003,"5min":0.55700000000000005,"15min":0.55700000000000005},"max":{"1min":0.96399999999999997,"5min":1.097,"15min":1.097},"last":0.81799999999999995}]}]},{"osd":4,"up_from":13,"seq":55834574898,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297780,"kb_used_data":492,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074060,"statfs":{"total":96636764160,"available":96331837440,"internally_reserved":0,"allocated":503808,"data_stored":228847,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 01:24:36 2023","interfaces":[{"interface":"back","average":{"1min":0.63500000000000001,"5min":0.63,"15min":0.626},"min":{"1min":0.41199999999999998,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.84199999999999997,"5min":1.298,"15min":1.298},"last":0.73499999999999999},{"interface":"front","average":{"1min":0.63100000000000001,"5min":0.64700000000000002,"15min":0.64900000000000002},"min":{"1min":0.49099999999999999,"5min":0.44,"15min":0.44},"max":{"1min":0.80300000000000005,"5min":1.081,"15min":1.081},"last":0.84499999999999997}]},{"osd":1,"last update":"Fri Oct 6 01:24:36 2023","interfaces":[{"interface":"back","average":{"1min":0.67000000000000004,"5min":0.66300000000000003,"15min":0.66500000000000004},"min":{"1min":0.54700000000000004,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.82799999999999996,"5min":1.264,"15min":1.264},"last":0.82199999999999995},{"interface":"front","average":{"1min":0.67400000000000004,"5min":0.68400000000000005,"15min":0.68700000000000006},"min":{"1min":0.53600000000000003,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":0.89900000000000002,"5min":1.143,"15min":1.143},"last":0.80200000000000005}]},{"osd":2,"last update":"Fri Oct 6 01:24:36 2023","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.70299999999999996,"15min":0.71899999999999997},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":0.80200000000000005,"5min":1.3680000000000001,"15min":1.3680000000000001},"last":0.85399999999999998},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.70999999999999996,"15min":0.72499999999999998},"min":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":0.79300000000000004,"5min":0.95699999999999996,"15min":0.95699999999999996},"last":0.77200000000000002}]},{"osd":3,"last update":"Fri Oct 6 01:24:36 2023","interfaces":[{"interface":"back","average":{"1min":0.63600000000000001,"5min":0.69999999999999996,"15min":0.72399999999999998},"min":{"1min":0.47199999999999998,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.86499999999999999,"5min":1.2090000000000001,"15min":1.2090000000000001},"last":0.873},{"interface":"front","average":{"1min":0.72199999999999998,"5min":0.77100000000000002,"15min":0.79100000000000004},"min":{"1min":0.60999999999999999,"5min":0.505,"15min":0.505},"max":{"1min":0.872,"5min":1.444,"15min":1.444},"last":0.78000000000000003}]},{"osd":5,"last update":"Fri Oct 6 01:24:36 2023","interfaces":[{"interface":"back","average":{"1min":0.67100000000000004,"5min":0.68200000000000005,"15min":0.68799999999999994},"min":{"1min":0.45000000000000001,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.95599999999999996,"5min":0.96499999999999997,"15min":0.96499999999999997},"last":0.63900000000000001},{"interface":"front","average":{"1min":0.65400000000000003,"5min":0.69299999999999995,"15min":0.70499999999999996},"min":{"1min":0.49299999999999999,"5min":0.439,"15min":0.439},"max":{"1min":0.90800000000000003,"5min":0.97999999999999998,"15min":0.97999999999999998},"last":0.749}]},{"osd":6,"last update":"Fri Oct 6 01:24:36 2023","interfaces":[{"interface":"back","average":{"1min":0.68500000000000005,"5min":0.71399999999999997,"15min":0.73399999999999999},"min":{"1min":0.442,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.92300000000000004,"5min":1.1779999999999999,"15min":1.1779999999999999},"last":0.68600000000000005},{"interface":"front","average":{"1min":0.74099999999999999,"5min":0.77500000000000002,"15min":0.79100000000000004},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":1.0009999999999999,"5min":1.1379999999999999,"15min":1.1379999999999999},"last":0.56499999999999995}]},{"osd":7,"last update":"Fri Oct 6 01:24:36 2023","interfaces":[{"interface":"back","average":{"1min":0.72899999999999998,"5min":0.74099999999999999,"15min":0.75900000000000001},"min":{"1min":0.62,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.93899999999999995,"5min":1.0249999999999999,"15min":1.0249999999999999},"last":0.80700000000000005},{"interface":"front","average":{"1min":0.76000000000000001,"5min":0.80100000000000005,"15min":0.82699999999999996},"min":{"1min":0.55700000000000005,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":0.93600000000000005,"5min":1.2290000000000001,"15min":1.2290000000000001},"last":0.59399999999999997}]}]},{"osd":5,"up_from":13,"seq":55834574900,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297764,"kb_used_data":476,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074076,"statfs":{"total":96636764160,"available":96331853824,"internally_reserved":0,"allocated":487424,"data_stored":221217,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 01:24:36 2023","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.623,"15min":0.64000000000000001},"min":{"1min":0.34899999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.82499999999999996,"5min":0.94699999999999995,"15min":0.94699999999999995},"last":0.57399999999999995},{"interface":"front","average":{"1min":0.626,"5min":0.61599999999999999,"15min":0.60599999999999998},"min":{"1min":0.47999999999999998,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.82899999999999996,"5min":0.93500000000000005,"15min":0.93500000000000005},"last":1.9359999999999999}]},{"osd":1,"last update":"Fri Oct 6 01:24:36 2023","interfaces":[{"interface":"back","average":{"1min":0.64800000000000002,"5min":0.63600000000000001,"15min":0.63},"min":{"1min":0.498,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.84699999999999998,"5min":1.028,"15min":1.028},"last":0.64900000000000002},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.66600000000000004,"15min":0.67900000000000005},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.875,"5min":1.103,"15min":1.103},"last":1.502}]},{"osd":2,"last update":"Fri Oct 6 01:24:36 2023","interfaces":[{"interface":"back","average":{"1min":0.65900000000000003,"5min":0.68400000000000005,"15min":0.68799999999999994},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":0.83699999999999997,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":1.4470000000000001},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.66900000000000004,"15min":0.67200000000000004},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":0.93000000000000005,"5min":1.0229999999999999,"15min":1.0229999999999999},"last":0.69099999999999995}]},{"osd":3,"last update":"Fri Oct 6 01:24:36 2023","interfaces":[{"interface":"back","average":{"1min":0.628,"5min":0.64600000000000002,"15min":0.64600000000000002},"min":{"1min":0.52400000000000002,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.84099999999999997,"5min":0.96999999999999997,"15min":0.96999999999999997},"last":1.78},{"interface":"front","average":{"1min":0.69099999999999995,"5min":0.75800000000000001,"15min":0.78600000000000003},"min":{"1min":0.51300000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.90500000000000003,"5min":1.6419999999999999,"15min":1.6419999999999999},"last":1.6799999999999999}]},{"osd":4,"last update":"Fri Oct 6 01:24:36 2023","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.65800000000000003,"15min":0.67200000000000004},"min":{"1min":0.47799999999999998,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.997,"5min":1.0389999999999999,"15min":1.0389999999999999},"last":0.53000000000000003},{"interface":"front","average":{"1min":0.65400000000000003,"5min":0.64700000000000002,"15min":0.65500000000000003},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.85299999999999998,"5min":1.024,"15min":1.024},"last":1.823}]},{"osd":6,"last update":"Fri Oct 6 01:24:36 2023","interfaces":[{"interface":"back","average":{"1min":0.66400000000000003,"5min":0.66000000000000003,"15min":0.66200000000000003},"min":{"1min":0.45500000000000002,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.89500000000000002,"5min":1.131,"15min":1.131},"last":1.748},{"interface":"front","average":{"1min":0.73299999999999998,"5min":0.69199999999999995,"15min":0.68999999999999995},"min":{"1min":0.56299999999999994,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.048,"5min":1.0580000000000001,"15min":1.0580000000000001},"last":1.8620000000000001}]},{"osd":7,"last update":"Fri Oct 6 01:24:36 2023","interfaces":[{"interface":"back","average":{"1min":0.72799999999999998,"5min":0.71999999999999997,"15min":0.71899999999999997},"min":{"1min":0.54100000000000004,"5min":0.438,"15min":0.438},"max":{"1min":0.98399999999999999,"5min":1.0660000000000001,"15min":1.0660000000000001},"last":1.718},{"interface":"front","average":{"1min":0.80000000000000004,"5min":0.81499999999999995,"15min":0.82899999999999996},"min":{"1min":0.64100000000000001,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":1.115,"5min":1.198,"15min":1.198},"last":1.5529999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-06T01:25:32.246 INFO:tasks.ceph.ceph_manager.ceph:clean! 2023-10-06T01:25:32.246 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-06T01:25:32.434 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:32.434+0000 7fd71099d700 1 Processor -- start 2023-10-06T01:25:32.435 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:32.434+0000 7fd71099d700 1 -- start start 2023-10-06T01:25:32.436 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:32.435+0000 7fd71099d700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fd70c1592d0 0x7fd70c0ce320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:25:32.436 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:32.435+0000 7fd71099d700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fd70c1596a0 0x7fd70c0aee90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:25:32.436 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:32.435+0000 7fd71099d700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd70c0cb310 con 0x7fd70c0ca930 2023-10-06T01:25:32.437 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:32.435+0000 7fd71099d700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd70c0cb5f0 con 0x7fd70c1592d0 2023-10-06T01:25:32.437 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:32.435+0000 7fd71099d700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd70c0cb8d0 con 0x7fd70c1596a0 2023-10-06T01:25:32.437 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:32.436+0000 7fd70b7fe700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fd70c1592d0 0x7fd70c0ce320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:25:32.437 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:32.436+0000 7fd70bfff700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fd70c0ca930 0x7fd70c15d3f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:42982/0 (socket says 172.21.15.50:42982) 2023-10-06T01:25:32.437 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:32.436+0000 7fd70bfff700 1 -- 172.21.15.50:0/1314350714 learned_addr learned my addr 172.21.15.50:0/1314350714 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-10-06T01:25:32.439 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:32.436+0000 7fd70affd700 1 --2- 172.21.15.50:0/1314350714 >> v2:172.21.15.155:3300/0 conn(0x7fd70c1596a0 0x7fd70c0aee90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:25:32.439 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:32.436+0000 7fd70a7fc700 1 -- 172.21.15.50:0/1314350714 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1518111028 0 0) 0x7fd70c0cb310 con 0x7fd70c0ca930 2023-10-06T01:25:32.439 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:32.436+0000 7fd70a7fc700 1 -- 172.21.15.50:0/1314350714 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd6f4003570 con 0x7fd70c0ca930 2023-10-06T01:25:32.439 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:32.436+0000 7fd70b7fe700 1 -- 172.21.15.50:0/1314350714 >> v2:172.21.15.155:3300/0 conn(0x7fd70c1596a0 msgr2=0x7fd70c0aee90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:25:32.439 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:32.436+0000 7fd70b7fe700 1 --2- 172.21.15.50:0/1314350714 >> v2:172.21.15.155:3300/0 conn(0x7fd70c1596a0 0x7fd70c0aee90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:25:32.439 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:32.436+0000 7fd70b7fe700 1 -- 172.21.15.50:0/1314350714 >> v1:172.21.15.50:6789/0 conn(0x7fd70c0ca930 legacy=0x7fd70c15d3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:25:32.439 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:32.436+0000 7fd70b7fe700 1 -- 172.21.15.50:0/1314350714 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd70c0caea0 con 0x7fd70c1592d0 2023-10-06T01:25:32.439 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:32.436+0000 7fd70b7fe700 1 --2- 172.21.15.50:0/1314350714 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd70c1592d0 0x7fd70c0ce320 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7fd70c0afc80 tx=0x7fd6fc0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=524a4af3cdd5e18a server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:25:32.439 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:32.437+0000 7fd70a7fc700 1 -- 172.21.15.50:0/1314350714 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6fc011630 con 0x7fd70c1592d0 2023-10-06T01:25:32.439 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:32.437+0000 7fd70a7fc700 1 -- 172.21.15.50:0/1314350714 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6fc011790 con 0x7fd70c1592d0 2023-10-06T01:25:32.440 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:32.437+0000 7fd70a7fc700 1 -- 172.21.15.50:0/1314350714 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6fc011b10 con 0x7fd70c1592d0 2023-10-06T01:25:32.440 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:32.437+0000 7fd71099d700 1 -- 172.21.15.50:0/1314350714 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd70c1592d0 msgr2=0x7fd70c0ce320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:25:32.440 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:32.437+0000 7fd71099d700 1 --2- 172.21.15.50:0/1314350714 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd70c1592d0 0x7fd70c0ce320 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7fd70c0afc80 tx=0x7fd6fc0091a0 comp rx=0 tx=0).stop 2023-10-06T01:25:32.440 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:32.437+0000 7fd71099d700 1 -- 172.21.15.50:0/1314350714 shutdown_connections 2023-10-06T01:25:32.440 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:32.437+0000 7fd71099d700 1 --2- 172.21.15.50:0/1314350714 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd70c1592d0 0x7fd70c0ce320 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:25:32.440 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:32.437+0000 7fd71099d700 1 --2- 172.21.15.50:0/1314350714 >> v2:172.21.15.155:3300/0 conn(0x7fd70c1596a0 0x7fd70c0aee90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:25:32.440 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:32.437+0000 7fd71099d700 1 -- 172.21.15.50:0/1314350714 >> 172.21.15.50:0/1314350714 conn(0x7fd70c068130 msgr2=0x7fd70c068530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:25:32.440 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:32.437+0000 7fd71099d700 1 -- 172.21.15.50:0/1314350714 shutdown_connections 2023-10-06T01:25:32.440 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:32.437+0000 7fd71099d700 1 -- 172.21.15.50:0/1314350714 wait complete. 2023-10-06T01:25:32.442 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:32.439+0000 7fd71099d700 1 Processor -- start 2023-10-06T01:25:32.442 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:32.439+0000 7fd71099d700 1 -- start start 2023-10-06T01:25:32.442 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:32.440+0000 7fd71099d700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd70c0ca930 0x7fd70c168e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:25:32.442 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:32.440+0000 7fd71099d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd70c1592d0 0x7fd70c15d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:25:32.442 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:32.440+0000 7fd71099d700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd70c1596a0 0x7fd70c15c4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:25:32.443 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:32.440+0000 7fd71099d700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd70c1516f0 con 0x7fd70c1592d0 2023-10-06T01:25:32.443 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:32.440+0000 7fd71099d700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd70c159b20 con 0x7fd70c0ca930 2023-10-06T01:25:32.443 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:32.440+0000 7fd71099d700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd70c15a3c0 con 0x7fd70c1596a0 2023-10-06T01:25:32.443 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:32.440+0000 7fd70affd700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd70c1592d0 0x7fd70c15d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:25:32.443 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:32.440+0000 7fd70affd700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd70c1592d0 0x7fd70c15d3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:48050/0 (socket says 172.21.15.50:48050) 2023-10-06T01:25:32.443 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:32.440+0000 7fd70affd700 1 -- 172.21.15.50:0/2996087887 learned_addr learned my addr 172.21.15.50:0/2996087887 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-06T01:25:32.443 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:32.440+0000 7fd70affd700 1 -- 172.21.15.50:0/2996087887 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd70c1596a0 msgr2=0x7fd70c15c4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:25:32.443 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:32.440+0000 7fd70affd700 1 --2- 172.21.15.50:0/2996087887 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd70c1596a0 0x7fd70c15c4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:25:32.443 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:32.440+0000 7fd70affd700 1 -- 172.21.15.50:0/2996087887 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd70c0ca930 msgr2=0x7fd70c168e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:25:32.443 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:32.440+0000 7fd70affd700 1 --2- 172.21.15.50:0/2996087887 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd70c0ca930 0x7fd70c168e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:25:32.443 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:32.440+0000 7fd70affd700 1 -- 172.21.15.50:0/2996087887 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6fc009420 con 0x7fd70c1592d0 2023-10-06T01:25:32.444 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:32.441+0000 7fd70affd700 1 --2- 172.21.15.50:0/2996087887 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd70c1592d0 0x7fd70c15d3f0 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7fd70000d860 tx=0x7fd700008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:25:32.444 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:32.441+0000 7fd6f37fe700 1 -- 172.21.15.50:0/2996087887 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7000125f0 con 0x7fd70c1592d0 2023-10-06T01:25:32.444 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:32.441+0000 7fd6f37fe700 1 -- 172.21.15.50:0/2996087887 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd700012750 con 0x7fd70c1592d0 2023-10-06T01:25:32.444 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:32.441+0000 7fd71099d700 1 -- 172.21.15.50:0/2996087887 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd70c0c9510 con 0x7fd70c1592d0 2023-10-06T01:25:32.444 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:32.441+0000 7fd6f37fe700 1 -- 172.21.15.50:0/2996087887 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd700012ad0 con 0x7fd70c1592d0 2023-10-06T01:25:32.444 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:32.441+0000 7fd71099d700 1 -- 172.21.15.50:0/2996087887 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd70c15a050 con 0x7fd70c1592d0 2023-10-06T01:25:32.445 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:32.442+0000 7fd71099d700 1 -- 172.21.15.50:0/2996087887 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd70c05f270 con 0x7fd70c1592d0 2023-10-06T01:25:32.445 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:32.443+0000 7fd6f37fe700 1 -- 172.21.15.50:0/2996087887 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fd70001e460 con 0x7fd70c1592d0 2023-10-06T01:25:32.445 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:32.444+0000 7fd6f37fe700 1 --2- 172.21.15.50:0/2996087887 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7fd6f8066f30 0x7fd6f80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:25:32.445 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:32.444+0000 7fd6f37fe700 1 -- 172.21.15.50:0/2996087887 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5612+0+0 (secure 0 0 0) 0x7fd700084c30 con 0x7fd70c1592d0 2023-10-06T01:25:32.445 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:32.444+0000 7fd70b7fe700 1 --2- 172.21.15.50:0/2996087887 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7fd6f8066f30 0x7fd6f80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:25:32.446 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:32.445+0000 7fd70b7fe700 1 --2- 172.21.15.50:0/2996087887 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7fd6f8066f30 0x7fd6f80693e0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fd70c0afc80 tx=0x7fd6fc017000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:25:32.448 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:32.448+0000 7fd6f37fe700 1 -- 172.21.15.50:0/2996087887 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd700051e60 con 0x7fd70c1592d0 2023-10-06T01:25:32.647 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:32.646+0000 7fd71099d700 1 -- 172.21.15.50:0/2996087887 --> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fd70c15a530 con 0x7fd6f8066f30 2023-10-06T01:25:32.650 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:32.649+0000 7fd6f37fe700 1 -- 172.21.15.50:0/2996087887 <== mgr.4099 v2:172.21.15.155:6832/85215 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+72889 (secure 0 0 0) 0x7fd70c15a530 con 0x7fd6f8066f30 2023-10-06T01:25:32.651 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-10-06T01:25:32.653 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:32.651+0000 7fd71099d700 1 -- 172.21.15.50:0/2996087887 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7fd6f8066f30 msgr2=0x7fd6f80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:25:32.653 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:32.652+0000 7fd71099d700 1 --2- 172.21.15.50:0/2996087887 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7fd6f8066f30 0x7fd6f80693e0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fd70c0afc80 tx=0x7fd6fc017000 comp rx=0 tx=0).stop 2023-10-06T01:25:32.653 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:32.652+0000 7fd71099d700 1 -- 172.21.15.50:0/2996087887 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd70c1592d0 msgr2=0x7fd70c15d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:25:32.653 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:32.652+0000 7fd71099d700 1 --2- 172.21.15.50:0/2996087887 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd70c1592d0 0x7fd70c15d3f0 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7fd70000d860 tx=0x7fd700008040 comp rx=0 tx=0).stop 2023-10-06T01:25:32.653 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:32.652+0000 7fd71099d700 1 -- 172.21.15.50:0/2996087887 shutdown_connections 2023-10-06T01:25:32.653 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:32.652+0000 7fd71099d700 1 --2- 172.21.15.50:0/2996087887 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd70c1596a0 0x7fd70c15c4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:25:32.654 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:32.652+0000 7fd71099d700 1 --2- 172.21.15.50:0/2996087887 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7fd6f8066f30 0x7fd6f80693e0 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:25:32.654 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:32.652+0000 7fd71099d700 1 --2- 172.21.15.50:0/2996087887 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd70c0ca930 0x7fd70c168e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:25:32.654 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:32.652+0000 7fd71099d700 1 --2- 172.21.15.50:0/2996087887 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd70c1592d0 0x7fd70c15d3f0 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:25:32.654 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:32.652+0000 7fd71099d700 1 -- 172.21.15.50:0/2996087887 >> 172.21.15.50:0/2996087887 conn(0x7fd70c068130 msgr2=0x7fd70c153cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:25:32.654 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:32.652+0000 7fd71099d700 1 -- 172.21.15.50:0/2996087887 shutdown_connections 2023-10-06T01:25:32.654 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:32.652+0000 7fd71099d700 1 -- 172.21.15.50:0/2996087887 wait complete. 2023-10-06T01:25:32.655 INFO:teuthology.orchestra.run.smithi050.stderr:dumped all 2023-10-06T01:25:32.670 INFO:teuthology.orchestra.run.smithi050.stdout:{"pg_ready":true,"pg_map":{"version":159,"stamp":"2023-10-06T01:25:31.828578+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":205,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2399736,"kb_used_data":5048,"kb_used_omap":0,"kb_used_meta":2394624,"kb_avail":752574984,"statfs":{"total":773094113280,"available":770636783616,"internally_reserved":0,"allocated":5169152,"data_stored":2988606,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2452094976},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":12,"apply_latency_ms":12,"commit_latency_ns":12000000,"apply_latency_ns":12000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-768876,"num_objects":-23,"num_object_clones":0,"num_object_copies":-46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-23,"num_whiteouts":0,"num_read":-1,"num_read_kb":-5,"num_write":-150,"num_write_kb":-805,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.383744"},"pg_stats":[{"pgid":"1.5","version":"0'0","reported_seq":35,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T01:25:25.447872+0000","last_change":"2023-10-06T01:21:30.601117+0000","last_active":"2023-10-06T01:25:25.447872+0000","last_peered":"2023-10-06T01:25:25.447872+0000","last_clean":"2023-10-06T01:25:25.447872+0000","last_became_active":"2023-10-06T01:21:30.600724+0000","last_became_peered":"2023-10-06T01:21:30.600724+0000","last_unstale":"2023-10-06T01:25:25.447872+0000","last_undegraded":"2023-10-06T01:25:25.447872+0000","last_fullsized":"2023-10-06T01:25:25.447872+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:21:29.586558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:21:29.586558+0000","last_clean_scrub_stamp":"2023-10-06T01:21:29.586558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:47:24.449013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":34,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T01:25:25.876373+0000","last_change":"2023-10-06T01:21:30.603434+0000","last_active":"2023-10-06T01:25:25.876373+0000","last_peered":"2023-10-06T01:25:25.876373+0000","last_clean":"2023-10-06T01:25:25.876373+0000","last_became_active":"2023-10-06T01:21:30.603215+0000","last_became_peered":"2023-10-06T01:21:30.603215+0000","last_unstale":"2023-10-06T01:25:25.876373+0000","last_undegraded":"2023-10-06T01:25:25.876373+0000","last_fullsized":"2023-10-06T01:25:25.876373+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:21:29.586558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:21:29.586558+0000","last_clean_scrub_stamp":"2023-10-06T01:21:29.586558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:47:24.449013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":33,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T01:25:26.475307+0000","last_change":"2023-10-06T01:21:30.604889+0000","last_active":"2023-10-06T01:25:26.475307+0000","last_peered":"2023-10-06T01:25:26.475307+0000","last_clean":"2023-10-06T01:25:26.475307+0000","last_became_active":"2023-10-06T01:21:30.604535+0000","last_became_peered":"2023-10-06T01:21:30.604535+0000","last_unstale":"2023-10-06T01:25:26.475307+0000","last_undegraded":"2023-10-06T01:25:26.475307+0000","last_fullsized":"2023-10-06T01:25:26.475307+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:21:29.586558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:21:29.586558+0000","last_clean_scrub_stamp":"2023-10-06T01:21:29.586558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:17:59.434982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"17'117","reported_seq":182,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T01:25:26.475644+0000","last_change":"2023-10-06T01:21:31.602437+0000","last_active":"2023-10-06T01:25:26.475644+0000","last_peered":"2023-10-06T01:25:26.475644+0000","last_clean":"2023-10-06T01:25:26.475644+0000","last_became_active":"2023-10-06T01:21:31.601431+0000","last_became_peered":"2023-10-06T01:21:31.601431+0000","last_unstale":"2023-10-06T01:25:26.475644+0000","last_undegraded":"2023-10-06T01:25:26.475644+0000","last_fullsized":"2023-10-06T01:25:26.475644+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:21:30.589171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:21:30.589171+0000","last_clean_scrub_stamp":"2023-10-06T01:21:30.589171+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T01:48:45.877807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":33,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T01:25:26.475635+0000","last_change":"2023-10-06T01:21:31.338236+0000","last_active":"2023-10-06T01:25:26.475635+0000","last_peered":"2023-10-06T01:25:26.475635+0000","last_clean":"2023-10-06T01:25:26.475635+0000","last_became_active":"2023-10-06T01:21:31.337918+0000","last_became_peered":"2023-10-06T01:21:31.337918+0000","last_unstale":"2023-10-06T01:25:26.475635+0000","last_undegraded":"2023-10-06T01:25:26.475635+0000","last_fullsized":"2023-10-06T01:25:26.475635+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:21:29.586558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:21:29.586558+0000","last_clean_scrub_stamp":"2023-10-06T01:21:29.586558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:02:13.010488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":33,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T01:25:26.475534+0000","last_change":"2023-10-06T01:21:31.338209+0000","last_active":"2023-10-06T01:25:26.475534+0000","last_peered":"2023-10-06T01:25:26.475534+0000","last_clean":"2023-10-06T01:25:26.475534+0000","last_became_active":"2023-10-06T01:21:31.337870+0000","last_became_peered":"2023-10-06T01:21:31.337870+0000","last_unstale":"2023-10-06T01:25:26.475534+0000","last_undegraded":"2023-10-06T01:25:26.475534+0000","last_fullsized":"2023-10-06T01:25:26.475534+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:21:29.586558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:21:29.586558+0000","last_clean_scrub_stamp":"2023-10-06T01:21:29.586558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:53:47.117299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":33,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T01:25:25.448031+0000","last_change":"2023-10-06T01:21:31.338177+0000","last_active":"2023-10-06T01:25:25.448031+0000","last_peered":"2023-10-06T01:25:25.448031+0000","last_clean":"2023-10-06T01:25:25.448031+0000","last_became_active":"2023-10-06T01:21:31.337872+0000","last_became_peered":"2023-10-06T01:21:31.337872+0000","last_unstale":"2023-10-06T01:25:25.448031+0000","last_undegraded":"2023-10-06T01:25:25.448031+0000","last_fullsized":"2023-10-06T01:25:25.448031+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:21:29.586558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:21:29.586558+0000","last_clean_scrub_stamp":"2023-10-06T01:21:29.586558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:17:59.434982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":33,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T01:25:26.476425+0000","last_change":"2023-10-06T01:21:31.338181+0000","last_active":"2023-10-06T01:25:26.476425+0000","last_peered":"2023-10-06T01:25:26.476425+0000","last_clean":"2023-10-06T01:25:26.476425+0000","last_became_active":"2023-10-06T01:21:31.337820+0000","last_became_peered":"2023-10-06T01:21:31.337820+0000","last_unstale":"2023-10-06T01:25:26.476425+0000","last_undegraded":"2023-10-06T01:25:26.476425+0000","last_fullsized":"2023-10-06T01:25:26.476425+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:21:29.586558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:21:29.586558+0000","last_clean_scrub_stamp":"2023-10-06T01:21:29.586558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:44:49.740873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":33,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T01:25:26.476713+0000","last_change":"2023-10-06T01:21:30.604007+0000","last_active":"2023-10-06T01:25:26.476713+0000","last_peered":"2023-10-06T01:25:26.476713+0000","last_clean":"2023-10-06T01:25:26.476713+0000","last_became_active":"2023-10-06T01:21:30.603673+0000","last_became_peered":"2023-10-06T01:21:30.603673+0000","last_unstale":"2023-10-06T01:25:26.476713+0000","last_undegraded":"2023-10-06T01:25:26.476713+0000","last_fullsized":"2023-10-06T01:25:26.476713+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:21:29.586558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:21:29.586558+0000","last_clean_scrub_stamp":"2023-10-06T01:21:29.586558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:53:47.117299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574900,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298348,"kb_used_data":1060,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073492,"statfs":{"total":96636764160,"available":96331255808,"internally_reserved":0,"allocated":1085440,"data_stored":812583,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 01:24:32 2023","interfaces":[{"interface":"back","average":{"1min":0.67300000000000004,"5min":0.67000000000000004,"15min":0.68500000000000005},"min":{"1min":0.45600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.85999999999999999,"5min":0.93700000000000006,"15min":0.93700000000000006},"last":0.60099999999999998},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.63100000000000001,"15min":0.64900000000000002},"min":{"1min":0.44,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.82299999999999995,"5min":0.96999999999999997,"15min":0.96999999999999997},"last":0.45500000000000002}]},{"osd":1,"last update":"Fri Oct 6 01:24:32 2023","interfaces":[{"interface":"back","average":{"1min":0.66100000000000003,"5min":0.64700000000000002,"15min":0.66100000000000003},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.82899999999999996,"5min":0.89400000000000002,"15min":0.89400000000000002},"last":0.53500000000000003},{"interface":"front","average":{"1min":0.621,"5min":0.66500000000000004,"15min":0.67700000000000005},"min":{"1min":0.47699999999999998,"5min":0.439,"15min":0.439},"max":{"1min":0.78700000000000003,"5min":0.91400000000000003,"15min":0.91400000000000003},"last":0.57299999999999995}]},{"osd":2,"last update":"Fri Oct 6 01:24:32 2023","interfaces":[{"interface":"back","average":{"1min":0.58299999999999996,"5min":0.64000000000000001,"15min":0.66200000000000003},"min":{"1min":0.49299999999999999,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":0.72799999999999998,"5min":0.82899999999999996,"15min":0.82899999999999996},"last":0.62},{"interface":"front","average":{"1min":0.71099999999999997,"5min":0.71299999999999997,"15min":0.73299999999999998},"min":{"1min":0.52000000000000002,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.82499999999999996,"5min":0.93600000000000005,"15min":0.93600000000000005},"last":0.48599999999999999}]},{"osd":3,"last update":"Fri Oct 6 01:24:32 2023","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.71799999999999997,"15min":0.73799999999999999},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":0.89500000000000002,"5min":1.0660000000000001,"15min":1.0660000000000001},"last":0.52500000000000002},{"interface":"front","average":{"1min":0.68100000000000005,"5min":0.72299999999999998,"15min":0.74399999999999999},"min":{"1min":0.61599999999999999,"5min":0.495,"15min":0.495},"max":{"1min":0.84999999999999998,"5min":0.89400000000000002,"15min":0.89400000000000002},"last":0.67500000000000004}]},{"osd":4,"last update":"Fri Oct 6 01:24:32 2023","interfaces":[{"interface":"back","average":{"1min":0.68799999999999994,"5min":0.63900000000000001,"15min":0.63700000000000001},"min":{"1min":0.42699999999999999,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.90500000000000003,"5min":1.01,"15min":1.01},"last":0.72299999999999998},{"interface":"front","average":{"1min":0.65600000000000003,"5min":0.66300000000000003,"15min":0.67300000000000004},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":0.94399999999999995,"5min":0.94399999999999995,"15min":0.94399999999999995},"last":0.64800000000000002}]},{"osd":5,"last update":"Fri Oct 6 01:24:32 2023","interfaces":[{"interface":"back","average":{"1min":0.67800000000000005,"5min":0.65300000000000002,"15min":0.65900000000000003},"min":{"1min":0.49099999999999999,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.98599999999999999,"5min":0.98599999999999999,"15min":0.98599999999999999},"last":0.55800000000000005},{"interface":"front","average":{"1min":0.78600000000000003,"5min":0.73099999999999998,"15min":0.72699999999999998},"min":{"1min":0.54700000000000004,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":0.97999999999999998,"5min":0.97999999999999998,"15min":0.97999999999999998},"last":0.66300000000000003}]},{"osd":6,"last update":"Fri Oct 6 01:24:32 2023","interfaces":[{"interface":"back","average":{"1min":0.78800000000000003,"5min":0.77000000000000002,"15min":0.78100000000000003},"min":{"1min":0.497,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":1,"5min":1,"15min":1},"last":0.81000000000000005},{"interface":"front","average":{"1min":0.72799999999999998,"5min":0.748,"15min":0.753},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":0.97499999999999998,"5min":1.1000000000000001,"15min":1.1000000000000001},"last":0.69499999999999995}]}]},{"osd":6,"up_from":13,"seq":55834574900,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297780,"kb_used_data":492,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074060,"statfs":{"total":96636764160,"available":96331837440,"internally_reserved":0,"allocated":503808,"data_stored":228847,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 01:24:34 2023","interfaces":[{"interface":"back","average":{"1min":0.63600000000000001,"5min":0.71399999999999997,"15min":0.76000000000000001},"min":{"1min":0.45400000000000001,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.80800000000000005,"5min":1.9279999999999999,"15min":1.9279999999999999},"last":0.46200000000000002},{"interface":"front","average":{"1min":0.68500000000000005,"5min":0.77500000000000002,"15min":0.81699999999999995},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":0.81999999999999995,"5min":2.3420000000000001,"15min":2.3420000000000001},"last":0.496}]},{"osd":1,"last update":"Fri Oct 6 01:24:34 2023","interfaces":[{"interface":"back","average":{"1min":0.64000000000000001,"5min":1.0029999999999999,"15min":1.175},"min":{"1min":0.49099999999999999,"5min":0.44,"15min":0.44},"max":{"1min":0.85999999999999999,"5min":12.529,"15min":12.529},"last":0.65800000000000003},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.79100000000000004,"15min":0.85199999999999998},"min":{"1min":0.48799999999999999,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.91100000000000003,"5min":3.98,"15min":3.98},"last":0.92800000000000005}]},{"osd":2,"last update":"Fri Oct 6 01:24:34 2023","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.81200000000000006,"15min":0.89600000000000002},"min":{"1min":0.5,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.78500000000000003,"5min":5.4859999999999998,"15min":5.4859999999999998},"last":0.73899999999999999},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.73199999999999998,"15min":0.77800000000000002},"min":{"1min":0.48299999999999998,"5min":0.443,"15min":0.443},"max":{"1min":0.78600000000000003,"5min":2.718,"15min":2.718},"last":0.79300000000000004}]},{"osd":3,"last update":"Fri Oct 6 01:24:34 2023","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.745,"15min":0.78300000000000003},"min":{"1min":0.48899999999999999,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":0.88400000000000001,"5min":2.5129999999999999,"15min":2.5129999999999999},"last":0.55400000000000005},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.747,"15min":0.77700000000000002},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":0.81599999999999995,"5min":1.9870000000000001,"15min":1.9870000000000001},"last":0.68000000000000005}]},{"osd":4,"last update":"Fri Oct 6 01:24:34 2023","interfaces":[{"interface":"back","average":{"1min":0.66900000000000004,"5min":0.71099999999999997,"15min":0.748},"min":{"1min":0.47199999999999998,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.78900000000000003,"5min":3.1480000000000001,"15min":3.1480000000000001},"last":0.72199999999999998},{"interface":"front","average":{"1min":0.72999999999999998,"5min":0.77000000000000002,"15min":0.80400000000000005},"min":{"1min":0.49199999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.89700000000000002,"5min":2.4769999999999999,"15min":2.4769999999999999},"last":0.97799999999999998}]},{"osd":5,"last update":"Fri Oct 6 01:24:34 2023","interfaces":[{"interface":"back","average":{"1min":0.747,"5min":0.85999999999999999,"15min":0.92600000000000005},"min":{"1min":0.46000000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.88100000000000001,"5min":5.4279999999999999,"15min":5.4279999999999999},"last":0.78200000000000003},{"interface":"front","average":{"1min":0.78200000000000003,"5min":0.81299999999999994,"15min":0.84499999999999997},"min":{"1min":0.65900000000000003,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":0.91700000000000004,"5min":2.6739999999999999,"15min":2.6739999999999999},"last":0.76200000000000001}]},{"osd":7,"last update":"Fri Oct 6 01:24:34 2023","interfaces":[{"interface":"back","average":{"1min":0.76900000000000002,"5min":0.82399999999999995,"15min":0.86399999999999999},"min":{"1min":0.55500000000000005,"5min":0.497,"15min":0.497},"max":{"1min":0.94699999999999995,"5min":2.7719999999999998,"15min":2.7719999999999998},"last":0.81100000000000005},{"interface":"front","average":{"1min":0.77800000000000002,"5min":0.96799999999999997,"15min":1.0620000000000001},"min":{"1min":0.64200000000000002,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":1,"5min":7.1440000000000001,"15min":7.1440000000000001},"last":0.83799999999999997}]}]},{"osd":1,"up_from":13,"seq":55834574898,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302452,"kb_used_data":1068,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069388,"statfs":{"total":96636764160,"available":96327053312,"internally_reserved":0,"allocated":1093632,"data_stored":818237,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 01:24:33 2023","interfaces":[{"interface":"back","average":{"1min":0.437,"5min":0.44900000000000001,"15min":0.45500000000000002},"min":{"1min":0.33000000000000002,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.56499999999999995,"5min":0.70699999999999996,"15min":0.70699999999999996},"last":0.443},{"interface":"front","average":{"1min":0.44400000000000001,"5min":0.48799999999999999,"15min":0.5},"min":{"1min":0.38100000000000001,"5min":0.375,"15min":0.375},"max":{"1min":0.503,"5min":0.752,"15min":0.752},"last":0.42799999999999999}]},{"osd":2,"last update":"Fri Oct 6 01:24:33 2023","interfaces":[{"interface":"back","average":{"1min":0.38600000000000001,"5min":0.44900000000000001,"15min":0.46899999999999997},"min":{"1min":0.314,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.496,"5min":1.073,"15min":1.073},"last":0.35999999999999999},{"interface":"front","average":{"1min":0.45700000000000002,"5min":0.47899999999999998,"15min":0.48999999999999999},"min":{"1min":0.36599999999999999,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.56399999999999995,"5min":0.69999999999999996,"15min":0.69999999999999996},"last":0.48999999999999999}]},{"osd":3,"last update":"Fri Oct 6 01:24:33 2023","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.56399999999999995,"15min":0.57599999999999996},"min":{"1min":0.47699999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.67500000000000004,"5min":0.72799999999999998,"15min":0.72799999999999998},"last":0.51400000000000001},{"interface":"front","average":{"1min":0.48699999999999999,"5min":0.52700000000000002,"15min":0.55100000000000005},"min":{"1min":0.34200000000000003,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.58999999999999997,"5min":0.93400000000000005,"15min":0.93400000000000005},"last":0.379}]},{"osd":4,"last update":"Fri Oct 6 01:24:33 2023","interfaces":[{"interface":"back","average":{"1min":0.74299999999999999,"5min":0.755,"15min":0.77900000000000003},"min":{"1min":0.434,"5min":0.432,"15min":0.432},"max":{"1min":0.96699999999999997,"5min":1.534,"15min":1.534},"last":0.65000000000000002},{"interface":"front","average":{"1min":0.73099999999999998,"5min":0.75900000000000001,"15min":0.78900000000000003},"min":{"1min":0.54600000000000004,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.94699999999999995,"5min":1.742,"15min":1.742},"last":0.73699999999999999}]},{"osd":5,"last update":"Fri Oct 6 01:24:33 2023","interfaces":[{"interface":"back","average":{"1min":0.749,"5min":0.755,"15min":0.77600000000000002},"min":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.0740000000000001,"5min":1.4790000000000001,"15min":1.4790000000000001},"last":0.81200000000000006},{"interface":"front","average":{"1min":0.73399999999999999,"5min":0.77000000000000002,"15min":0.80600000000000005},"min":{"1min":0.51000000000000001,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":0.879,"5min":1.581,"15min":1.581},"last":0.754}]},{"osd":6,"last update":"Fri Oct 6 01:24:33 2023","interfaces":[{"interface":"back","average":{"1min":0.73899999999999999,"5min":0.75800000000000001,"15min":0.78400000000000003},"min":{"1min":0.52600000000000002,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":0.95599999999999996,"5min":1.51,"15min":1.51},"last":0.77500000000000002},{"interface":"front","average":{"1min":0.79300000000000004,"5min":0.78400000000000003,"15min":0.80200000000000005},"min":{"1min":0.624,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":0.98399999999999999,"5min":1.26,"15min":1.26},"last":0.83799999999999997}]},{"osd":7,"last update":"Fri Oct 6 01:24:33 2023","interfaces":[{"interface":"back","average":{"1min":0.76600000000000001,"5min":0.79200000000000004,"15min":0.82399999999999995},"min":{"1min":0.62,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":0.93999999999999995,"5min":1.7070000000000001,"15min":1.7070000000000001},"last":0.71299999999999997},{"interface":"front","average":{"1min":0.79500000000000004,"5min":0.82399999999999995,"15min":0.85799999999999998},"min":{"1min":0.55300000000000005,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":0.999,"5min":1.633,"15min":1.633},"last":0.78100000000000003}]}]},{"osd":0,"up_from":13,"seq":55834574899,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301860,"kb_used_data":476,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069980,"statfs":{"total":96636764160,"available":96327659520,"internally_reserved":0,"allocated":487424,"data_stored":221181,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Oct 6 01:24:33 2023","interfaces":[{"interface":"back","average":{"1min":0.42699999999999999,"5min":0.56299999999999994,"15min":0.627},"min":{"1min":0.27700000000000002,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.92800000000000005,"5min":2.8559999999999999,"15min":2.8559999999999999},"last":0.313},{"interface":"front","average":{"1min":0.42799999999999999,"5min":0.61399999999999999,"15min":0.68899999999999995},"min":{"1min":0.28999999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.68000000000000005,"5min":2.944,"15min":2.944},"last":0.44500000000000001}]},{"osd":2,"last update":"Fri Oct 6 01:24:33 2023","interfaces":[{"interface":"back","average":{"1min":0.48299999999999998,"5min":0.67000000000000004,"15min":0.746},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.58299999999999996,"5min":2.8940000000000001,"15min":2.8940000000000001},"last":0.49399999999999999},{"interface":"front","average":{"1min":0.48999999999999999,"5min":0.67100000000000004,"15min":0.73599999999999999},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.63500000000000001,"5min":2.9820000000000002,"15min":2.9820000000000002},"last":0.51800000000000002}]},{"osd":3,"last update":"Fri Oct 6 01:24:33 2023","interfaces":[{"interface":"back","average":{"1min":0.443,"5min":0.59799999999999998,"15min":0.66600000000000004},"min":{"1min":0.312,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.55400000000000005,"5min":2.7559999999999998,"15min":2.7559999999999998},"last":0.35199999999999998},{"interface":"front","average":{"1min":0.47399999999999998,"5min":0.63700000000000001,"15min":0.70099999999999996},"min":{"1min":0.41999999999999998,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.57299999999999995,"5min":2.8140000000000001,"15min":2.8140000000000001},"last":0.53000000000000003}]},{"osd":4,"last update":"Fri Oct 6 01:24:33 2023","interfaces":[{"interface":"back","average":{"1min":0.73899999999999999,"5min":0.77300000000000002,"15min":0.79900000000000004},"min":{"1min":0.54400000000000004,"5min":0.441,"15min":0.441},"max":{"1min":1.3320000000000001,"5min":1.397,"15min":1.397},"last":0.56299999999999994},{"interface":"front","average":{"1min":0.751,"5min":0.80700000000000005,"15min":0.84499999999999997},"min":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.2929999999999999,"5min":1.833,"15min":1.833},"last":0.755}]},{"osd":5,"last update":"Fri Oct 6 01:24:33 2023","interfaces":[{"interface":"back","average":{"1min":0.74299999999999999,"5min":0.79800000000000004,"15min":0.82699999999999996},"min":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":0.95899999999999996,"5min":1.4430000000000001,"15min":1.4430000000000001},"last":0.66900000000000004},{"interface":"front","average":{"1min":0.749,"5min":0.77500000000000002,"15min":0.80100000000000005},"min":{"1min":0.55600000000000005,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":0.95399999999999996,"5min":1.4359999999999999,"15min":1.4359999999999999},"last":0.68700000000000006}]},{"osd":6,"last update":"Fri Oct 6 01:24:33 2023","interfaces":[{"interface":"back","average":{"1min":0.72799999999999998,"5min":0.84099999999999997,"15min":0.90100000000000002},"min":{"1min":0.54500000000000004,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":0.96999999999999997,"5min":1.8740000000000001,"15min":1.8740000000000001},"last":0.81999999999999995},{"interface":"front","average":{"1min":0.77600000000000002,"5min":0.80900000000000005,"15min":0.84199999999999997},"min":{"1min":0.61399999999999999,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":0.878,"5min":1.361,"15min":1.361},"last":0.59999999999999998}]},{"osd":7,"last update":"Fri Oct 6 01:24:33 2023","interfaces":[{"interface":"back","average":{"1min":0.77800000000000002,"5min":0.82199999999999995,"15min":0.85399999999999998},"min":{"1min":0.55900000000000005,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":1.21,"5min":1.413,"15min":1.413},"last":0.63700000000000001},{"interface":"front","average":{"1min":0.76100000000000001,"5min":0.79400000000000004,"15min":0.82199999999999995},"min":{"1min":0.627,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1.0009999999999999,"5min":1.2929999999999999,"15min":1.2929999999999999},"last":0.622}]}]},{"osd":2,"up_from":13,"seq":55834574898,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301876,"kb_used_data":492,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069964,"statfs":{"total":96636764160,"available":96327643136,"internally_reserved":0,"allocated":503808,"data_stored":228847,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 01:24:36 2023","interfaces":[{"interface":"back","average":{"1min":0.41699999999999998,"5min":0.46700000000000003,"15min":0.48699999999999999},"min":{"1min":0.33000000000000002,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.61799999999999999,"5min":0.96599999999999997,"15min":0.96599999999999997},"last":0.375},{"interface":"front","average":{"1min":0.499,"5min":0.52200000000000002,"15min":0.53900000000000003},"min":{"1min":0.318,"5min":0.31,"15min":0.31},"max":{"1min":0.68200000000000005,"5min":1,"15min":1},"last":0.59599999999999997}]},{"osd":1,"last update":"Fri Oct 6 01:24:36 2023","interfaces":[{"interface":"back","average":{"1min":0.49299999999999999,"5min":0.55000000000000004,"15min":0.57999999999999996},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.64900000000000002,"5min":1.296,"15min":1.296},"last":0.33500000000000002},{"interface":"front","average":{"1min":0.48199999999999998,"5min":0.53800000000000003,"15min":0.56399999999999995},"min":{"1min":0.39000000000000001,"5min":0.313,"15min":0.313},"max":{"1min":0.56799999999999995,"5min":1.1379999999999999,"15min":1.1379999999999999},"last":0.48299999999999998}]},{"osd":3,"last update":"Fri Oct 6 01:24:36 2023","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.60199999999999998,"15min":0.63400000000000001},"min":{"1min":0.45300000000000001,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.65200000000000002,"5min":1.222,"15min":1.222},"last":0.432},{"interface":"front","average":{"1min":0.44900000000000001,"5min":0.48999999999999999,"15min":0.503},"min":{"1min":0.35499999999999998,"5min":0.318,"15min":0.318},"max":{"1min":0.57199999999999995,"5min":0.72099999999999997,"15min":0.72099999999999997},"last":0.46000000000000002}]},{"osd":4,"last update":"Fri Oct 6 01:24:36 2023","interfaces":[{"interface":"back","average":{"1min":0.76300000000000001,"5min":0.73599999999999999,"15min":0.73599999999999999},"min":{"1min":0.58399999999999996,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":0.96799999999999997,"5min":1.0700000000000001,"15min":1.0700000000000001},"last":0.68700000000000006},{"interface":"front","average":{"1min":0.76900000000000002,"5min":0.80500000000000005,"15min":0.82799999999999996},"min":{"1min":0.59599999999999997,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":0.99099999999999999,"5min":1.5469999999999999,"15min":1.5469999999999999},"last":0.79200000000000004}]},{"osd":5,"last update":"Fri Oct 6 01:24:36 2023","interfaces":[{"interface":"back","average":{"1min":0.749,"5min":0.76800000000000002,"15min":0.78600000000000003},"min":{"1min":0.54800000000000004,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":1.0309999999999999,"5min":1.5940000000000001,"15min":1.5940000000000001},"last":0.745},{"interface":"front","average":{"1min":0.72199999999999998,"5min":0.82399999999999995,"15min":0.86399999999999999},"min":{"1min":0.55600000000000005,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":0.91900000000000004,"5min":1.7669999999999999,"15min":1.7669999999999999},"last":0.71799999999999997}]},{"osd":6,"last update":"Fri Oct 6 01:24:36 2023","interfaces":[{"interface":"back","average":{"1min":0.73699999999999999,"5min":0.85599999999999998,"15min":0.90900000000000003},"min":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":1.0029999999999999,"5min":2.0510000000000002,"15min":2.0510000000000002},"last":0.81499999999999995},{"interface":"front","average":{"1min":0.72199999999999998,"5min":0.755,"15min":0.77900000000000003},"min":{"1min":0.55600000000000005,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":0.93600000000000005,"5min":1.633,"15min":1.633},"last":0.61499999999999999}]},{"osd":7,"last update":"Fri Oct 6 01:24:36 2023","interfaces":[{"interface":"back","average":{"1min":0.74299999999999999,"5min":0.80100000000000005,"15min":0.82899999999999996},"min":{"1min":0.54900000000000004,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.0109999999999999,"5min":1.4670000000000001,"15min":1.4670000000000001},"last":0.82799999999999996},{"interface":"front","average":{"1min":0.76500000000000001,"5min":0.83199999999999996,"15min":0.86799999999999999},"min":{"1min":0.60899999999999999,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":0.91800000000000004,"5min":1.8,"15min":1.8},"last":0.65200000000000002}]}]},{"osd":3,"up_from":13,"seq":55834574898,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301876,"kb_used_data":492,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069964,"statfs":{"total":96636764160,"available":96327643136,"internally_reserved":0,"allocated":503808,"data_stored":228847,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 01:24:37 2023","interfaces":[{"interface":"back","average":{"1min":0.43099999999999999,"5min":0.41699999999999998,"15min":0.41499999999999998},"min":{"1min":0.29999999999999999,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.95399999999999996,"5min":0.95399999999999996,"15min":0.95399999999999996},"last":0.32100000000000001},{"interface":"front","average":{"1min":0.42099999999999999,"5min":0.44400000000000001,"15min":0.45800000000000002},"min":{"1min":0.29099999999999998,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.60499999999999998,"5min":0.69199999999999995,"15min":0.69199999999999995},"last":0.35299999999999998}]},{"osd":1,"last update":"Fri Oct 6 01:24:37 2023","interfaces":[{"interface":"back","average":{"1min":0.434,"5min":0.46800000000000003,"15min":0.49199999999999999},"min":{"1min":0.307,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.94099999999999995,"5min":1.075,"15min":1.075},"last":0.40100000000000002},{"interface":"front","average":{"1min":0.499,"5min":0.51500000000000001,"15min":0.52200000000000002},"min":{"1min":0.39400000000000002,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68300000000000005},"last":0.44500000000000001}]},{"osd":2,"last update":"Fri Oct 6 01:24:37 2023","interfaces":[{"interface":"back","average":{"1min":0.47899999999999998,"5min":0.53000000000000003,"15min":0.55000000000000004},"min":{"1min":0.40400000000000003,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.57699999999999996,"5min":1.4319999999999999,"15min":1.4319999999999999},"last":0.46200000000000002},{"interface":"front","average":{"1min":0.52300000000000002,"5min":0.56399999999999995,"15min":0.58499999999999996},"min":{"1min":0.433,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.98999999999999999,"5min":1.532,"15min":1.532},"last":0.47899999999999998}]},{"osd":4,"last update":"Fri Oct 6 01:24:37 2023","interfaces":[{"interface":"back","average":{"1min":0.747,"5min":0.81100000000000005,"15min":0.83999999999999997},"min":{"1min":0.61699999999999999,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":0.91100000000000003,"5min":1.1080000000000001,"15min":1.1080000000000001},"last":0.92000000000000004},{"interface":"front","average":{"1min":0.77200000000000002,"5min":0.81999999999999995,"15min":0.84699999999999998},"min":{"1min":0.65600000000000003,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":1.0509999999999999,"5min":1.353,"15min":1.353},"last":0.80000000000000004}]},{"osd":5,"last update":"Fri Oct 6 01:24:37 2023","interfaces":[{"interface":"back","average":{"1min":0.75,"5min":0.77100000000000002,"15min":0.78900000000000003},"min":{"1min":0.60099999999999998,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":1.0740000000000001,"5min":1.3149999999999999,"15min":1.3149999999999999},"last":0.93300000000000005},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.75700000000000001,"15min":0.78700000000000003},"min":{"1min":0.57999999999999996,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":0.90600000000000003,"5min":1.155,"15min":1.155},"last":0.78900000000000003}]},{"osd":6,"last update":"Fri Oct 6 01:24:37 2023","interfaces":[{"interface":"back","average":{"1min":0.78100000000000003,"5min":0.82499999999999996,"15min":0.85299999999999998},"min":{"1min":0.59299999999999997,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":0.93600000000000005,"5min":1.1479999999999999,"15min":1.1479999999999999},"last":0.71499999999999997},{"interface":"front","average":{"1min":0.78200000000000003,"5min":0.82899999999999996,"15min":0.85699999999999998},"min":{"1min":0.59399999999999997,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.095,"5min":1.3779999999999999,"15min":1.3779999999999999},"last":0.85199999999999998}]},{"osd":7,"last update":"Fri Oct 6 01:24:37 2023","interfaces":[{"interface":"back","average":{"1min":0.71499999999999997,"5min":0.81000000000000005,"15min":0.84399999999999997},"min":{"1min":0.56999999999999995,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":0.97099999999999997,"5min":1.1240000000000001,"15min":1.1240000000000001},"last":1.0409999999999999},{"interface":"front","average":{"1min":0.79100000000000004,"5min":0.84599999999999997,"15min":0.88400000000000001},"min":{"1min":0.65800000000000003,"5min":0.55700000000000005,"15min":0.55700000000000005},"max":{"1min":0.96399999999999997,"5min":1.097,"15min":1.097},"last":0.81799999999999995}]}]},{"osd":4,"up_from":13,"seq":55834574898,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297780,"kb_used_data":492,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074060,"statfs":{"total":96636764160,"available":96331837440,"internally_reserved":0,"allocated":503808,"data_stored":228847,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 01:24:36 2023","interfaces":[{"interface":"back","average":{"1min":0.63500000000000001,"5min":0.63,"15min":0.626},"min":{"1min":0.41199999999999998,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.84199999999999997,"5min":1.298,"15min":1.298},"last":0.73499999999999999},{"interface":"front","average":{"1min":0.63100000000000001,"5min":0.64700000000000002,"15min":0.64900000000000002},"min":{"1min":0.49099999999999999,"5min":0.44,"15min":0.44},"max":{"1min":0.80300000000000005,"5min":1.081,"15min":1.081},"last":0.84499999999999997}]},{"osd":1,"last update":"Fri Oct 6 01:24:36 2023","interfaces":[{"interface":"back","average":{"1min":0.67000000000000004,"5min":0.66300000000000003,"15min":0.66500000000000004},"min":{"1min":0.54700000000000004,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.82799999999999996,"5min":1.264,"15min":1.264},"last":0.82199999999999995},{"interface":"front","average":{"1min":0.67400000000000004,"5min":0.68400000000000005,"15min":0.68700000000000006},"min":{"1min":0.53600000000000003,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":0.89900000000000002,"5min":1.143,"15min":1.143},"last":0.80200000000000005}]},{"osd":2,"last update":"Fri Oct 6 01:24:36 2023","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.70299999999999996,"15min":0.71899999999999997},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":0.80200000000000005,"5min":1.3680000000000001,"15min":1.3680000000000001},"last":0.85399999999999998},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.70999999999999996,"15min":0.72499999999999998},"min":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":0.79300000000000004,"5min":0.95699999999999996,"15min":0.95699999999999996},"last":0.77200000000000002}]},{"osd":3,"last update":"Fri Oct 6 01:24:36 2023","interfaces":[{"interface":"back","average":{"1min":0.63600000000000001,"5min":0.69999999999999996,"15min":0.72399999999999998},"min":{"1min":0.47199999999999998,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.86499999999999999,"5min":1.2090000000000001,"15min":1.2090000000000001},"last":0.873},{"interface":"front","average":{"1min":0.72199999999999998,"5min":0.77100000000000002,"15min":0.79100000000000004},"min":{"1min":0.60999999999999999,"5min":0.505,"15min":0.505},"max":{"1min":0.872,"5min":1.444,"15min":1.444},"last":0.78000000000000003}]},{"osd":5,"last update":"Fri Oct 6 01:24:36 2023","interfaces":[{"interface":"back","average":{"1min":0.67100000000000004,"5min":0.68200000000000005,"15min":0.68799999999999994},"min":{"1min":0.45000000000000001,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.95599999999999996,"5min":0.96499999999999997,"15min":0.96499999999999997},"last":0.63900000000000001},{"interface":"front","average":{"1min":0.65400000000000003,"5min":0.69299999999999995,"15min":0.70499999999999996},"min":{"1min":0.49299999999999999,"5min":0.439,"15min":0.439},"max":{"1min":0.90800000000000003,"5min":0.97999999999999998,"15min":0.97999999999999998},"last":0.749}]},{"osd":6,"last update":"Fri Oct 6 01:24:36 2023","interfaces":[{"interface":"back","average":{"1min":0.68500000000000005,"5min":0.71399999999999997,"15min":0.73399999999999999},"min":{"1min":0.442,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.92300000000000004,"5min":1.1779999999999999,"15min":1.1779999999999999},"last":0.68600000000000005},{"interface":"front","average":{"1min":0.74099999999999999,"5min":0.77500000000000002,"15min":0.79100000000000004},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":1.0009999999999999,"5min":1.1379999999999999,"15min":1.1379999999999999},"last":0.56499999999999995}]},{"osd":7,"last update":"Fri Oct 6 01:24:36 2023","interfaces":[{"interface":"back","average":{"1min":0.72899999999999998,"5min":0.74099999999999999,"15min":0.75900000000000001},"min":{"1min":0.62,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.93899999999999995,"5min":1.0249999999999999,"15min":1.0249999999999999},"last":0.80700000000000005},{"interface":"front","average":{"1min":0.76000000000000001,"5min":0.80100000000000005,"15min":0.82699999999999996},"min":{"1min":0.55700000000000005,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":0.93600000000000005,"5min":1.2290000000000001,"15min":1.2290000000000001},"last":0.59399999999999997}]}]},{"osd":5,"up_from":13,"seq":55834574900,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297764,"kb_used_data":476,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074076,"statfs":{"total":96636764160,"available":96331853824,"internally_reserved":0,"allocated":487424,"data_stored":221217,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 01:24:36 2023","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.623,"15min":0.64000000000000001},"min":{"1min":0.34899999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.82499999999999996,"5min":0.94699999999999995,"15min":0.94699999999999995},"last":0.57399999999999995},{"interface":"front","average":{"1min":0.626,"5min":0.61599999999999999,"15min":0.60599999999999998},"min":{"1min":0.47999999999999998,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.82899999999999996,"5min":0.93500000000000005,"15min":0.93500000000000005},"last":1.9359999999999999}]},{"osd":1,"last update":"Fri Oct 6 01:24:36 2023","interfaces":[{"interface":"back","average":{"1min":0.64800000000000002,"5min":0.63600000000000001,"15min":0.63},"min":{"1min":0.498,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.84699999999999998,"5min":1.028,"15min":1.028},"last":0.64900000000000002},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.66600000000000004,"15min":0.67900000000000005},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.875,"5min":1.103,"15min":1.103},"last":1.502}]},{"osd":2,"last update":"Fri Oct 6 01:24:36 2023","interfaces":[{"interface":"back","average":{"1min":0.65900000000000003,"5min":0.68400000000000005,"15min":0.68799999999999994},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":0.83699999999999997,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":1.4470000000000001},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.66900000000000004,"15min":0.67200000000000004},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":0.93000000000000005,"5min":1.0229999999999999,"15min":1.0229999999999999},"last":0.69099999999999995}]},{"osd":3,"last update":"Fri Oct 6 01:24:36 2023","interfaces":[{"interface":"back","average":{"1min":0.628,"5min":0.64600000000000002,"15min":0.64600000000000002},"min":{"1min":0.52400000000000002,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.84099999999999997,"5min":0.96999999999999997,"15min":0.96999999999999997},"last":1.78},{"interface":"front","average":{"1min":0.69099999999999995,"5min":0.75800000000000001,"15min":0.78600000000000003},"min":{"1min":0.51300000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.90500000000000003,"5min":1.6419999999999999,"15min":1.6419999999999999},"last":1.6799999999999999}]},{"osd":4,"last update":"Fri Oct 6 01:24:36 2023","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.65800000000000003,"15min":0.67200000000000004},"min":{"1min":0.47799999999999998,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.997,"5min":1.0389999999999999,"15min":1.0389999999999999},"last":0.53000000000000003},{"interface":"front","average":{"1min":0.65400000000000003,"5min":0.64700000000000002,"15min":0.65500000000000003},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.85299999999999998,"5min":1.024,"15min":1.024},"last":1.823}]},{"osd":6,"last update":"Fri Oct 6 01:24:36 2023","interfaces":[{"interface":"back","average":{"1min":0.66400000000000003,"5min":0.66000000000000003,"15min":0.66200000000000003},"min":{"1min":0.45500000000000002,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.89500000000000002,"5min":1.131,"15min":1.131},"last":1.748},{"interface":"front","average":{"1min":0.73299999999999998,"5min":0.69199999999999995,"15min":0.68999999999999995},"min":{"1min":0.56299999999999994,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.048,"5min":1.0580000000000001,"15min":1.0580000000000001},"last":1.8620000000000001}]},{"osd":7,"last update":"Fri Oct 6 01:24:36 2023","interfaces":[{"interface":"back","average":{"1min":0.72799999999999998,"5min":0.71999999999999997,"15min":0.71899999999999997},"min":{"1min":0.54100000000000004,"5min":0.438,"15min":0.438},"max":{"1min":0.98399999999999999,"5min":1.0660000000000001,"15min":1.0660000000000001},"last":1.718},{"interface":"front","average":{"1min":0.80000000000000004,"5min":0.81499999999999995,"15min":0.82899999999999996},"min":{"1min":0.64100000000000001,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":1.115,"5min":1.198,"15min":1.198},"last":1.5529999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-06T01:25:32.673 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T01:25:32.859 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:32.858+0000 7fd21e99d700 1 Processor -- start 2023-10-06T01:25:32.859 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:32.858+0000 7fd21e99d700 1 -- start start 2023-10-06T01:25:32.861 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:32.859+0000 7fd21e99d700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd218159390 0x7fd218159760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:25:32.861 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:32.859+0000 7fd21e99d700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fd2180ced20 0x7fd2180698e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:25:32.861 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:32.860+0000 7fd21e99d700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd21806a220 con 0x7fd218069e20 2023-10-06T01:25:32.862 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:32.860+0000 7fd21e99d700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd2180687a0 con 0x7fd2180ced20 2023-10-06T01:25:32.862 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:32.860+0000 7fd21e99d700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd218068a80 con 0x7fd218159390 2023-10-06T01:25:32.862 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:32.860+0000 7fd21d99b700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd218159390 0x7fd218159760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:25:32.862 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:32.860+0000 7fd21d99b700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd218159390 0x7fd218159760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3301/0 says I am v2:172.21.15.50:36090/0 (socket says 172.21.15.50:36090) 2023-10-06T01:25:32.862 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:32.860+0000 7fd21d99b700 1 -- 172.21.15.50:0/1324326883 learned_addr learned my addr 172.21.15.50:0/1324326883 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-06T01:25:32.862 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:32.860+0000 7fd21d19a700 1 --2- 172.21.15.50:0/1324326883 >> v2:172.21.15.155:3300/0 conn(0x7fd2180ced20 0x7fd2180698e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:25:32.862 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:32.860+0000 7fd21d99b700 1 -- 172.21.15.50:0/1324326883 >> v2:172.21.15.155:3300/0 conn(0x7fd2180ced20 msgr2=0x7fd2180698e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:25:32.862 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:32.860+0000 7fd21d99b700 1 --2- 172.21.15.50:0/1324326883 >> v2:172.21.15.155:3300/0 conn(0x7fd2180ced20 0x7fd2180698e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:25:32.862 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:32.860+0000 7fd21d99b700 1 -- 172.21.15.50:0/1324326883 >> v1:172.21.15.155:6789/0 conn(0x7fd218069e20 legacy=0x7fd2180abc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:25:32.863 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:32.860+0000 7fd21d99b700 1 -- 172.21.15.50:0/1324326883 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd218068d60 con 0x7fd218159390 2023-10-06T01:25:32.863 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:32.861+0000 7fd21d99b700 1 --2- 172.21.15.50:0/1324326883 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd218159390 0x7fd218159760 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fd2140099b0 tx=0x7fd214009250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=51f1b84fe13191c7 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:25:32.864 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:32.861+0000 7fd21c999700 1 -- 172.21.15.50:0/1324326883 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd214009ea0 con 0x7fd218159390 2023-10-06T01:25:32.864 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:32.861+0000 7fd21c999700 1 -- 172.21.15.50:0/1324326883 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd21400b860 con 0x7fd218159390 2023-10-06T01:25:32.864 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:32.861+0000 7fd21c999700 1 -- 172.21.15.50:0/1324326883 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd21400bc00 con 0x7fd218159390 2023-10-06T01:25:32.864 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:32.862+0000 7fd21e99d700 1 -- 172.21.15.50:0/1324326883 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd218159390 msgr2=0x7fd218159760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:25:32.864 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:32.862+0000 7fd21e99d700 1 --2- 172.21.15.50:0/1324326883 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd218159390 0x7fd218159760 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fd2140099b0 tx=0x7fd214009250 comp rx=0 tx=0).stop 2023-10-06T01:25:32.865 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:32.862+0000 7fd21e99d700 1 -- 172.21.15.50:0/1324326883 shutdown_connections 2023-10-06T01:25:32.865 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:32.862+0000 7fd21e99d700 1 --2- 172.21.15.50:0/1324326883 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd218159390 0x7fd218159760 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:25:32.865 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:32.862+0000 7fd21e99d700 1 --2- 172.21.15.50:0/1324326883 >> v2:172.21.15.155:3300/0 conn(0x7fd2180ced20 0x7fd2180698e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:25:32.865 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:32.862+0000 7fd21e99d700 1 -- 172.21.15.50:0/1324326883 >> 172.21.15.50:0/1324326883 conn(0x7fd218067dd0 msgr2=0x7fd2180ce160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:25:32.865 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:32.862+0000 7fd21e99d700 1 -- 172.21.15.50:0/1324326883 shutdown_connections 2023-10-06T01:25:32.865 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:32.862+0000 7fd21e99d700 1 -- 172.21.15.50:0/1324326883 wait complete. 2023-10-06T01:25:32.865 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:32.863+0000 7fd21e99d700 1 Processor -- start 2023-10-06T01:25:32.865 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:32.863+0000 7fd21e99d700 1 -- start start 2023-10-06T01:25:32.868 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:32.864+0000 7fd21e99d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd218069e20 0x7fd2181529a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:25:32.868 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:32.864+0000 7fd21e99d700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd2180ced20 0x7fd218099cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:25:32.868 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:32.864+0000 7fd21e99d700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd218159390 0x7fd21809a200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:25:32.868 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:32.864+0000 7fd21e99d700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2180990b0 con 0x7fd218069e20 2023-10-06T01:25:32.868 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:32.864+0000 7fd21e99d700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd218158790 con 0x7fd2180ced20 2023-10-06T01:25:32.868 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:32.864+0000 7fd21e99d700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd218098a60 con 0x7fd218159390 2023-10-06T01:25:32.868 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:32.864+0000 7fd21d99b700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd218069e20 0x7fd2181529a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:25:32.868 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:32.865+0000 7fd21d99b700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd218069e20 0x7fd2181529a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:48062/0 (socket says 172.21.15.50:48062) 2023-10-06T01:25:32.869 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:32.865+0000 7fd21d99b700 1 -- 172.21.15.50:0/1260845939 learned_addr learned my addr 172.21.15.50:0/1260845939 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-06T01:25:32.869 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:32.865+0000 7fd21d19a700 1 --2- 172.21.15.50:0/1260845939 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd2180ced20 0x7fd218099cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:25:32.869 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:32.865+0000 7fd21e19c700 1 --2- 172.21.15.50:0/1260845939 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd218159390 0x7fd21809a200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:25:32.869 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:32.865+0000 7fd21d99b700 1 -- 172.21.15.50:0/1260845939 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd218159390 msgr2=0x7fd21809a200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:25:32.869 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:32.865+0000 7fd21d99b700 1 --2- 172.21.15.50:0/1260845939 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd218159390 0x7fd21809a200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:25:32.869 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:32.865+0000 7fd21d99b700 1 -- 172.21.15.50:0/1260845939 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd2180ced20 msgr2=0x7fd218099cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:25:32.869 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:32.865+0000 7fd21d99b700 1 --2- 172.21.15.50:0/1260845939 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd2180ced20 0x7fd218099cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:25:32.869 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:32.865+0000 7fd21d99b700 1 -- 172.21.15.50:0/1260845939 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2140094f0 con 0x7fd218069e20 2023-10-06T01:25:32.869 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:32.865+0000 7fd21d99b700 1 --2- 172.21.15.50:0/1260845939 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd218069e20 0x7fd2181529a0 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7fd218068bc0 tx=0x7fd214017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:25:32.870 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:32.865+0000 7fd20dffb700 1 -- 172.21.15.50:0/1260845939 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd214000d10 con 0x7fd218069e20 2023-10-06T01:25:32.870 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:32.866+0000 7fd20dffb700 1 -- 172.21.15.50:0/1260845939 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd21400bbe0 con 0x7fd218069e20 2023-10-06T01:25:32.870 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:32.866+0000 7fd21e99d700 1 -- 172.21.15.50:0/1260845939 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd218098d40 con 0x7fd218069e20 2023-10-06T01:25:32.870 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:32.866+0000 7fd20dffb700 1 -- 172.21.15.50:0/1260845939 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd21401a6a0 con 0x7fd218069e20 2023-10-06T01:25:32.870 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:32.866+0000 7fd21e99d700 1 -- 172.21.15.50:0/1260845939 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd218152ee0 con 0x7fd218069e20 2023-10-06T01:25:32.870 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:32.867+0000 7fd21e99d700 1 -- 172.21.15.50:0/1260845939 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd21805f270 con 0x7fd218069e20 2023-10-06T01:25:32.871 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:32.867+0000 7fd20dffb700 1 -- 172.21.15.50:0/1260845939 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fd21401aa10 con 0x7fd218069e20 2023-10-06T01:25:32.871 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:32.868+0000 7fd20dffb700 1 --2- 172.21.15.50:0/1260845939 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7fd1fc066f30 0x7fd1fc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:25:32.871 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:32.868+0000 7fd20dffb700 1 -- 172.21.15.50:0/1260845939 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5612+0+0 (secure 0 0 0) 0x7fd214085e60 con 0x7fd218069e20 2023-10-06T01:25:32.871 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:32.869+0000 7fd21d19a700 1 --2- 172.21.15.50:0/1260845939 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7fd1fc066f30 0x7fd1fc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:25:32.871 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:32.869+0000 7fd21d19a700 1 --2- 172.21.15.50:0/1260845939 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7fd1fc066f30 0x7fd1fc0693e0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fd21816c420 tx=0x7fd2080091a0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:25:32.873 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:32.872+0000 7fd20dffb700 1 -- 172.21.15.50:0/1260845939 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd214053090 con 0x7fd218069e20 2023-10-06T01:25:33.078 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:33.078+0000 7fd21e99d700 1 -- 172.21.15.50:0/1260845939 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd218069040 con 0x7fd218069e20 2023-10-06T01:25:33.079 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:33.079+0000 7fd20dffb700 1 -- 172.21.15.50:0/1260845939 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v44) v1 ==== 74+0+13984 (secure 0 0 0) 0x7fd2140566b0 con 0x7fd218069e20 2023-10-06T01:25:33.080 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-10-06T01:25:33.080 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":44,"fsid":"0bfd9a6b-1587-4fe4-a89e-e43c00286b4e","created":"2023-10-06T01:21:16.828801+0000","modified":"2023-10-06T01:25:28.901108+0000","last_up_change":"2023-10-06T01:21:28.584523+0000","last_in_change":"2023-10-06T01:21:20.179863+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-10-06T01:21:29.304225+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":".mgr","create_time":"2023-10-06T01:21:29.835490+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"9060727a-3959-4de3-8363-c5c5d7826c9a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":87837},{"type":"v1","addr":"172.21.15.50:6801","nonce":87837}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":87837},{"type":"v1","addr":"172.21.15.50:6803","nonce":87837}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":87837},{"type":"v1","addr":"172.21.15.50:6807","nonce":87837}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":87837},{"type":"v1","addr":"172.21.15.50:6805","nonce":87837}]},"public_addr":"172.21.15.50:6801/87837","cluster_addr":"172.21.15.50:6803/87837","heartbeat_back_addr":"172.21.15.50:6807/87837","heartbeat_front_addr":"172.21.15.50:6805/87837","state":["exists","up"]},{"osd":1,"uuid":"5ad9ef12-b579-47ea-b690-90ba887e2cef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":87853},{"type":"v1","addr":"172.21.15.50:6809","nonce":87853}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":87853},{"type":"v1","addr":"172.21.15.50:6811","nonce":87853}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":87853},{"type":"v1","addr":"172.21.15.50:6815","nonce":87853}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":87853},{"type":"v1","addr":"172.21.15.50:6813","nonce":87853}]},"public_addr":"172.21.15.50:6809/87853","cluster_addr":"172.21.15.50:6811/87853","heartbeat_back_addr":"172.21.15.50:6815/87853","heartbeat_front_addr":"172.21.15.50:6813/87853","state":["exists","up"]},{"osd":2,"uuid":"c7aee044-6f75-436f-90e1-ba42a57359bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6821","nonce":87855},{"type":"v1","addr":"172.21.15.50:6822","nonce":87855}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6824","nonce":87855},{"type":"v1","addr":"172.21.15.50:6826","nonce":87855}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":87855},{"type":"v1","addr":"172.21.15.50:6831","nonce":87855}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":87855},{"type":"v1","addr":"172.21.15.50:6829","nonce":87855}]},"public_addr":"172.21.15.50:6822/87855","cluster_addr":"172.21.15.50:6826/87855","heartbeat_back_addr":"172.21.15.50:6831/87855","heartbeat_front_addr":"172.21.15.50:6829/87855","state":["exists","up"]},{"osd":3,"uuid":"d9b901c8-e8b2-44af-9508-f453120a96c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":87856},{"type":"v1","addr":"172.21.15.50:6817","nonce":87856}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":87856},{"type":"v1","addr":"172.21.15.50:6819","nonce":87856}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6825","nonce":87856},{"type":"v1","addr":"172.21.15.50:6827","nonce":87856}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6820","nonce":87856},{"type":"v1","addr":"172.21.15.50:6823","nonce":87856}]},"public_addr":"172.21.15.50:6817/87856","cluster_addr":"172.21.15.50:6819/87856","heartbeat_back_addr":"172.21.15.50:6827/87856","heartbeat_front_addr":"172.21.15.50:6823/87856","state":["exists","up"]},{"osd":4,"uuid":"2b3c6b38-e3e9-4301-9445-60fd3fe8ce03","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":85805},{"type":"v1","addr":"172.21.15.155:6801","nonce":85805}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":85805},{"type":"v1","addr":"172.21.15.155:6803","nonce":85805}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6806","nonce":85805},{"type":"v1","addr":"172.21.15.155:6807","nonce":85805}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6804","nonce":85805},{"type":"v1","addr":"172.21.15.155:6805","nonce":85805}]},"public_addr":"172.21.15.155:6801/85805","cluster_addr":"172.21.15.155:6803/85805","heartbeat_back_addr":"172.21.15.155:6807/85805","heartbeat_front_addr":"172.21.15.155:6805/85805","state":["exists","up"]},{"osd":5,"uuid":"417b5f8f-65f1-4c94-91a7-a6ce03fe1679","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6816","nonce":85807},{"type":"v1","addr":"172.21.15.155:6818","nonce":85807}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6820","nonce":85807},{"type":"v1","addr":"172.21.15.155:6822","nonce":85807}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6828","nonce":85807},{"type":"v1","addr":"172.21.15.155:6830","nonce":85807}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6824","nonce":85807},{"type":"v1","addr":"172.21.15.155:6826","nonce":85807}]},"public_addr":"172.21.15.155:6818/85807","cluster_addr":"172.21.15.155:6822/85807","heartbeat_back_addr":"172.21.15.155:6830/85807","heartbeat_front_addr":"172.21.15.155:6826/85807","state":["exists","up"]},{"osd":6,"uuid":"c150cff3-aee4-4714-9c08-d182b1ba9ffd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6808","nonce":85806},{"type":"v1","addr":"172.21.15.155:6809","nonce":85806}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6810","nonce":85806},{"type":"v1","addr":"172.21.15.155:6811","nonce":85806}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6814","nonce":85806},{"type":"v1","addr":"172.21.15.155:6815","nonce":85806}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6812","nonce":85806},{"type":"v1","addr":"172.21.15.155:6813","nonce":85806}]},"public_addr":"172.21.15.155:6809/85806","cluster_addr":"172.21.15.155:6811/85806","heartbeat_back_addr":"172.21.15.155:6815/85806","heartbeat_front_addr":"172.21.15.155:6813/85806","state":["exists","up"]},{"osd":7,"uuid":"71107f0e-04d1-4e72-a0ec-0faf6af003e7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6817","nonce":85832},{"type":"v1","addr":"172.21.15.155:6819","nonce":85832}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6821","nonce":85832},{"type":"v1","addr":"172.21.15.155:6823","nonce":85832}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6829","nonce":85832},{"type":"v1","addr":"172.21.15.155:6831","nonce":85832}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6825","nonce":85832},{"type":"v1","addr":"172.21.15.155:6827","nonce":85832}]},"public_addr":"172.21.15.155:6819/85832","cluster_addr":"172.21.15.155:6823/85832","heartbeat_back_addr":"172.21.15.155:6831/85832","heartbeat_front_addr":"172.21.15.155:6827/85832","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:21:25.423389+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:21:25.472661+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:21:25.817562+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:21:25.551257+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:21:25.407818+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:21:25.557976+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:21:25.747299+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:21:25.827576+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.50:6835/3957156573":"2023-10-07T01:25:25.440651+0000","172.21.15.50:6834/3957156573":"2023-10-07T01:25:25.440651+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T01:25:33.082 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:33.081+0000 7fd21e99d700 1 -- 172.21.15.50:0/1260845939 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7fd1fc066f30 msgr2=0x7fd1fc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:25:33.082 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:33.081+0000 7fd21e99d700 1 --2- 172.21.15.50:0/1260845939 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7fd1fc066f30 0x7fd1fc0693e0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fd21816c420 tx=0x7fd2080091a0 comp rx=0 tx=0).stop 2023-10-06T01:25:33.082 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:33.081+0000 7fd21e99d700 1 -- 172.21.15.50:0/1260845939 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd218069e20 msgr2=0x7fd2181529a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:25:33.082 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:33.081+0000 7fd21e99d700 1 --2- 172.21.15.50:0/1260845939 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd218069e20 0x7fd2181529a0 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7fd218068bc0 tx=0x7fd214017000 comp rx=0 tx=0).stop 2023-10-06T01:25:33.082 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:33.081+0000 7fd21e99d700 1 -- 172.21.15.50:0/1260845939 shutdown_connections 2023-10-06T01:25:33.082 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:33.081+0000 7fd21e99d700 1 --2- 172.21.15.50:0/1260845939 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd218159390 0x7fd21809a200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:25:33.082 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:33.081+0000 7fd21e99d700 1 --2- 172.21.15.50:0/1260845939 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd218069e20 0x7fd2181529a0 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:25:33.082 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:33.081+0000 7fd21e99d700 1 --2- 172.21.15.50:0/1260845939 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7fd1fc066f30 0x7fd1fc0693e0 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:25:33.083 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:33.081+0000 7fd21e99d700 1 --2- 172.21.15.50:0/1260845939 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd2180ced20 0x7fd218099cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:25:33.083 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:33.081+0000 7fd21e99d700 1 -- 172.21.15.50:0/1260845939 >> 172.21.15.50:0/1260845939 conn(0x7fd218067dd0 msgr2=0x7fd2180ac610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:25:33.083 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:33.081+0000 7fd21e99d700 1 -- 172.21.15.50:0/1260845939 shutdown_connections 2023-10-06T01:25:33.083 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:33.081+0000 7fd21e99d700 1 -- 172.21.15.50:0/1260845939 wait complete. 2023-10-06T01:25:34.101 INFO:tasks.ceph:Scrubbing osd.0 2023-10-06T01:25:34.101 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2023-10-06T01:25:34.304 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:34.303+0000 7fb3e739d700 1 Processor -- start 2023-10-06T01:25:34.304 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:34.303+0000 7fb3e739d700 1 -- start start 2023-10-06T01:25:34.305 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:34.304+0000 7fb3e739d700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fb3e01562a0 0x7fb3e00b00d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:25:34.305 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:34.304+0000 7fb3e739d700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fb3e00b0610 0x7fb3e006e170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:25:34.306 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:34.304+0000 7fb3e739d700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb3e00ac9b0 con 0x7fb3e0155ed0 2023-10-06T01:25:34.306 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:34.305+0000 7fb3e739d700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb3e00acc90 con 0x7fb3e00b0610 2023-10-06T01:25:34.306 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:34.305+0000 7fb3e739d700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb3e00acf70 con 0x7fb3e01562a0 2023-10-06T01:25:34.306 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:34.305+0000 7fb3e6b9c700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fb3e00b0610 0x7fb3e006e170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:25:34.307 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:34.305+0000 7fb3e6b9c700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fb3e00b0610 0x7fb3e006e170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:48076/0 (socket says 172.21.15.50:48076) 2023-10-06T01:25:34.307 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:34.305+0000 7fb3e6b9c700 1 -- 172.21.15.50:0/2764293868 learned_addr learned my addr 172.21.15.50:0/2764293868 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-06T01:25:34.308 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:34.305+0000 7fb3e6b9c700 1 -- 172.21.15.50:0/2764293868 >> v2:172.21.15.155:3300/0 conn(0x7fb3e01562a0 msgr2=0x7fb3e00b00d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:25:34.308 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:34.305+0000 7fb3e6b9c700 1 --2- 172.21.15.50:0/2764293868 >> v2:172.21.15.155:3300/0 conn(0x7fb3e01562a0 0x7fb3e00b00d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:25:34.308 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:34.305+0000 7fb3e6b9c700 1 -- 172.21.15.50:0/2764293868 >> v1:172.21.15.155:6789/0 conn(0x7fb3e0155ed0 legacy=0x7fb3e00c8950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:25:34.308 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:34.305+0000 7fb3e6b9c700 1 -- 172.21.15.50:0/2764293868 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3e00ad250 con 0x7fb3e00b0610 2023-10-06T01:25:34.308 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:34.305+0000 7fb3e6b9c700 1 --2- 172.21.15.50:0/2764293868 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb3e00b0610 0x7fb3e006e170 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7fb3e00716c0 tx=0x7fb3d8009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5be0e62ea4d1929 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:25:34.309 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:34.306+0000 7fb3e5399700 1 -- 172.21.15.50:0/2764293868 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3d800e070 con 0x7fb3e00b0610 2023-10-06T01:25:34.309 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:34.306+0000 7fb3e5399700 1 -- 172.21.15.50:0/2764293868 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb3d800ba10 con 0x7fb3e00b0610 2023-10-06T01:25:34.309 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:34.306+0000 7fb3e5399700 1 -- 172.21.15.50:0/2764293868 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3d80092e0 con 0x7fb3e00b0610 2023-10-06T01:25:34.309 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:34.306+0000 7fb3e739d700 1 -- 172.21.15.50:0/2764293868 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb3e00b0610 msgr2=0x7fb3e006e170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:25:34.309 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:34.306+0000 7fb3e739d700 1 --2- 172.21.15.50:0/2764293868 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb3e00b0610 0x7fb3e006e170 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7fb3e00716c0 tx=0x7fb3d8009840 comp rx=0 tx=0).stop 2023-10-06T01:25:34.309 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:34.306+0000 7fb3e739d700 1 -- 172.21.15.50:0/2764293868 shutdown_connections 2023-10-06T01:25:34.309 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:34.306+0000 7fb3e739d700 1 --2- 172.21.15.50:0/2764293868 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb3e00b0610 0x7fb3e006e170 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:25:34.310 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:34.306+0000 7fb3e739d700 1 --2- 172.21.15.50:0/2764293868 >> v2:172.21.15.155:3300/0 conn(0x7fb3e01562a0 0x7fb3e00b00d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:25:34.310 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:34.306+0000 7fb3e739d700 1 -- 172.21.15.50:0/2764293868 >> 172.21.15.50:0/2764293868 conn(0x7fb3e00cbee0 msgr2=0x7fb3e00cc2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:25:34.310 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:34.306+0000 7fb3e739d700 1 -- 172.21.15.50:0/2764293868 shutdown_connections 2023-10-06T01:25:34.310 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:34.307+0000 7fb3e739d700 1 -- 172.21.15.50:0/2764293868 wait complete. 2023-10-06T01:25:34.312 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:34.308+0000 7fb3e739d700 1 Processor -- start 2023-10-06T01:25:34.312 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:34.308+0000 7fb3e739d700 1 -- start start 2023-10-06T01:25:34.312 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:34.309+0000 7fb3e739d700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb3e00b0610 0x7fb3e0158080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:25:34.313 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:34.309+0000 7fb3e739d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb3e0155ed0 0x7fb3e0150cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:25:34.313 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:34.309+0000 7fb3e739d700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb3e01562a0 0x7fb3e0069790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:25:34.313 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:34.309+0000 7fb3e739d700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3e00c8d70 con 0x7fb3e0155ed0 2023-10-06T01:25:34.313 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:34.309+0000 7fb3e739d700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3e00c9050 con 0x7fb3e01562a0 2023-10-06T01:25:34.313 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:34.309+0000 7fb3e739d700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3e00c9330 con 0x7fb3e00b0610 2023-10-06T01:25:34.313 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:34.309+0000 7fb3e5b9a700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb3e0155ed0 0x7fb3e0150cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:25:34.313 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:34.309+0000 7fb3e5b9a700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb3e0155ed0 0x7fb3e0150cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:48090/0 (socket says 172.21.15.50:48090) 2023-10-06T01:25:34.313 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:34.309+0000 7fb3e5b9a700 1 -- 172.21.15.50:0/4275679121 learned_addr learned my addr 172.21.15.50:0/4275679121 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-06T01:25:34.313 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:34.309+0000 7fb3e6b9c700 1 --2- 172.21.15.50:0/4275679121 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb3e01562a0 0x7fb3e0069790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:25:34.314 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:34.309+0000 7fb3e639b700 1 --2- 172.21.15.50:0/4275679121 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb3e00b0610 0x7fb3e0158080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:25:34.314 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:34.310+0000 7fb3e5b9a700 1 -- 172.21.15.50:0/4275679121 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb3e00b0610 msgr2=0x7fb3e0158080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:25:34.314 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:34.310+0000 7fb3e5b9a700 1 --2- 172.21.15.50:0/4275679121 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb3e00b0610 0x7fb3e0158080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:25:34.314 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:34.310+0000 7fb3e5b9a700 1 -- 172.21.15.50:0/4275679121 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb3e01562a0 msgr2=0x7fb3e0069790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:25:34.315 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:34.310+0000 7fb3e5b9a700 1 --2- 172.21.15.50:0/4275679121 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb3e01562a0 0x7fb3e0069790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:25:34.315 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:34.310+0000 7fb3e5b9a700 1 -- 172.21.15.50:0/4275679121 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3d8009ae0 con 0x7fb3e0155ed0 2023-10-06T01:25:34.315 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:34.310+0000 7fb3e6b9c700 1 --2- 172.21.15.50:0/4275679121 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb3e01562a0 0x7fb3e0069790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T01:25:34.315 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:34.310+0000 7fb3e5b9a700 1 --2- 172.21.15.50:0/4275679121 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb3e0155ed0 0x7fb3e0150cf0 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7fb3d000b810 tx=0x7fb3d0009220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:25:34.315 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:34.310+0000 7fb3d67fc700 1 -- 172.21.15.50:0/4275679121 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3d000f5f0 con 0x7fb3e0155ed0 2023-10-06T01:25:34.316 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:34.310+0000 7fb3d67fc700 1 -- 172.21.15.50:0/4275679121 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb3d000f750 con 0x7fb3e0155ed0 2023-10-06T01:25:34.316 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:34.310+0000 7fb3e739d700 1 -- 172.21.15.50:0/4275679121 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb3e00c9610 con 0x7fb3e0155ed0 2023-10-06T01:25:34.316 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:34.310+0000 7fb3d67fc700 1 -- 172.21.15.50:0/4275679121 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3d000fb10 con 0x7fb3e0155ed0 2023-10-06T01:25:34.316 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:34.310+0000 7fb3e739d700 1 -- 172.21.15.50:0/4275679121 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb3e0159010 con 0x7fb3e0155ed0 2023-10-06T01:25:34.316 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:34.311+0000 7fb3e739d700 1 -- 172.21.15.50:0/4275679121 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fb3e00c91c0 con 0x7fb3e0155ed0 2023-10-06T01:25:34.318 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:34.312+0000 7fb3d67fc700 1 -- 172.21.15.50:0/4275679121 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fb3d0010480 con 0x7fb3e0155ed0 2023-10-06T01:25:34.318 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:34.313+0000 7fb3d67fc700 1 --2- 172.21.15.50:0/4275679121 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7fb3c4066f30 0x7fb3c40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:25:34.318 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:34.313+0000 7fb3d67fc700 1 -- 172.21.15.50:0/4275679121 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5612+0+0 (secure 0 0 0) 0x7fb3d00844b0 con 0x7fb3e0155ed0 2023-10-06T01:25:34.318 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:34.313+0000 7fb3d67fc700 1 --2- 172.21.15.50:0/4275679121 >> [v2:172.21.15.50:6800/87837,v1:172.21.15.50:6801/87837] conn(0x7fb3c406d850 0x7fb3c406fca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:25:34.318 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:34.313+0000 7fb3d67fc700 1 -- 172.21.15.50:0/4275679121 --> [v2:172.21.15.50:6800/87837,v1:172.21.15.50:6801/87837] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fb3c4070370 con 0x7fb3c406d850 2023-10-06T01:25:34.318 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:34.313+0000 7fb3d67fc700 1 -- 172.21.15.50:0/4275679121 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_get_version_reply(handle=1 version=44) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb3d0086a10 con 0x7fb3e0155ed0 2023-10-06T01:25:34.319 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:34.314+0000 7fb3e639b700 1 --2- 172.21.15.50:0/4275679121 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7fb3c4066f30 0x7fb3c40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:25:34.319 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:34.314+0000 7fb3e6b9c700 1 --2- 172.21.15.50:0/4275679121 >> [v2:172.21.15.50:6800/87837,v1:172.21.15.50:6801/87837] conn(0x7fb3c406d850 0x7fb3c406fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:25:34.319 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:34.314+0000 7fb3e6b9c700 1 --2- 172.21.15.50:0/4275679121 >> [v2:172.21.15.50:6800/87837,v1:172.21.15.50:6801/87837] conn(0x7fb3c406d850 0x7fb3c406fca0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:25:34.319 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:34.315+0000 7fb3e639b700 1 --2- 172.21.15.50:0/4275679121 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7fb3c4066f30 0x7fb3c40693e0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fb3dc003870 tx=0x7fb3dc009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:25:34.319 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:34.315+0000 7fb3d67fc700 1 -- 172.21.15.50:0/4275679121 <== osd.0 v2:172.21.15.50:6800/87837 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7fb3c4070370 con 0x7fb3c406d850 2023-10-06T01:25:34.330 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:34.329+0000 7fb3e739d700 1 -- 172.21.15.50:0/4275679121 --> [v2:172.21.15.50:6800/87837,v1:172.21.15.50:6801/87837] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fb3e005f270 con 0x7fb3c406d850 2023-10-06T01:25:34.330 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:34.330+0000 7fb3d67fc700 1 -- 172.21.15.50:0/4275679121 <== osd.0 v2:172.21.15.50:6800/87837 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7fb3e005f270 con 0x7fb3c406d850 2023-10-06T01:25:34.331 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2023-10-06T01:25:34.331 INFO:teuthology.orchestra.run.smithi050.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-10-06T01:25:34.331 INFO:teuthology.orchestra.run.smithi050.stdout:} 2023-10-06T01:25:34.332 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:34.330+0000 7fb3e739d700 1 -- 172.21.15.50:0/4275679121 >> [v2:172.21.15.50:6800/87837,v1:172.21.15.50:6801/87837] conn(0x7fb3c406d850 msgr2=0x7fb3c406fca0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:25:34.332 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:34.330+0000 7fb3e739d700 1 --2- 172.21.15.50:0/4275679121 >> [v2:172.21.15.50:6800/87837,v1:172.21.15.50:6801/87837] conn(0x7fb3c406d850 0x7fb3c406fca0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:25:34.332 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:34.330+0000 7fb3e739d700 1 -- 172.21.15.50:0/4275679121 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7fb3c4066f30 msgr2=0x7fb3c40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:25:34.333 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:34.330+0000 7fb3e739d700 1 --2- 172.21.15.50:0/4275679121 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7fb3c4066f30 0x7fb3c40693e0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fb3dc003870 tx=0x7fb3dc009040 comp rx=0 tx=0).stop 2023-10-06T01:25:34.333 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:34.330+0000 7fb3e739d700 1 -- 172.21.15.50:0/4275679121 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb3e0155ed0 msgr2=0x7fb3e0150cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:25:34.333 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:34.330+0000 7fb3e739d700 1 --2- 172.21.15.50:0/4275679121 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb3e0155ed0 0x7fb3e0150cf0 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7fb3d000b810 tx=0x7fb3d0009220 comp rx=0 tx=0).stop 2023-10-06T01:25:34.333 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:34.330+0000 7fb3e6b9c700 1 -- 172.21.15.50:0/4275679121 reap_dead start 2023-10-06T01:25:34.333 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:34.330+0000 7fb3e739d700 1 -- 172.21.15.50:0/4275679121 shutdown_connections 2023-10-06T01:25:34.333 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:34.330+0000 7fb3e739d700 1 -- 172.21.15.50:0/4275679121 >> 172.21.15.50:0/4275679121 conn(0x7fb3e00cbee0 msgr2=0x7fb3e00a9ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:25:34.333 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:34.331+0000 7fb3e739d700 1 -- 172.21.15.50:0/4275679121 shutdown_connections 2023-10-06T01:25:34.333 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:34.331+0000 7fb3e739d700 1 -- 172.21.15.50:0/4275679121 wait complete. 2023-10-06T01:25:34.348 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2023-10-06T01:25:34.535 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:34.534+0000 7f1e8759e700 1 Processor -- start 2023-10-06T01:25:34.536 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:34.535+0000 7f1e8759e700 1 -- start start 2023-10-06T01:25:34.537 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:34.536+0000 7f1e8759e700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f1e88159390 0x7f1e88159760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:25:34.537 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:34.536+0000 7f1e8759e700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1e88069ff0 0x7f1e88163100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:25:34.537 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:34.536+0000 7f1e8759e700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1e880687a0 con 0x7f1e880ced20 2023-10-06T01:25:34.537 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:34.536+0000 7f1e8759e700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1e88068a80 con 0x7f1e88159390 2023-10-06T01:25:34.537 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:34.536+0000 7f1e8759e700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e88068d60 con 0x7f1e88069ff0 2023-10-06T01:25:34.537 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:34.536+0000 7f1e85d9b700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f1e880ced20 0x7f1e880698e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:42990/0 (socket says 172.21.15.50:42990) 2023-10-06T01:25:34.538 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:34.536+0000 7f1e8659c700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f1e88159390 0x7f1e88159760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:25:34.538 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:34.536+0000 7f1e85d9b700 1 -- 172.21.15.50:0/2209457135 learned_addr learned my addr 172.21.15.50:0/2209457135 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-10-06T01:25:34.539 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:34.537+0000 7f1e8559a700 1 -- 172.21.15.50:0/2209457135 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2103247932 0 0) 0x7f1e880687a0 con 0x7f1e880ced20 2023-10-06T01:25:34.540 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:34.537+0000 7f1e8559a700 1 -- 172.21.15.50:0/2209457135 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1e70003570 con 0x7f1e880ced20 2023-10-06T01:25:34.540 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:34.537+0000 7f1e86d9d700 1 --2- 172.21.15.50:0/2209457135 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1e88069ff0 0x7f1e88163100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:25:34.540 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:34.537+0000 7f1e8659c700 1 -- 172.21.15.50:0/2209457135 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1e88069ff0 msgr2=0x7f1e88163100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:25:34.540 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:34.537+0000 7f1e8659c700 1 --2- 172.21.15.50:0/2209457135 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1e88069ff0 0x7f1e88163100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:25:34.540 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:34.537+0000 7f1e8659c700 1 -- 172.21.15.50:0/2209457135 >> v1:172.21.15.50:6789/0 conn(0x7f1e880ced20 legacy=0x7f1e880698e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:25:34.540 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:34.537+0000 7f1e8659c700 1 -- 172.21.15.50:0/2209457135 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e88069040 con 0x7f1e88159390 2023-10-06T01:25:34.540 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:34.537+0000 7f1e86d9d700 1 --2- 172.21.15.50:0/2209457135 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1e88069ff0 0x7f1e88163100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T01:25:34.540 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:34.537+0000 7f1e8659c700 1 --2- 172.21.15.50:0/2209457135 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1e88159390 0x7f1e88159760 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f1e780098e0 tx=0x7f1e780091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=10b10d5f6d060ef server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:25:34.540 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:34.537+0000 7f1e8559a700 1 -- 172.21.15.50:0/2209457135 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e7800b640 con 0x7f1e88159390 2023-10-06T01:25:34.541 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:34.537+0000 7f1e8559a700 1 -- 172.21.15.50:0/2209457135 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e7800b7a0 con 0x7f1e88159390 2023-10-06T01:25:34.541 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:34.537+0000 7f1e8559a700 1 -- 172.21.15.50:0/2209457135 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e7800bb40 con 0x7f1e88159390 2023-10-06T01:25:34.541 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:34.538+0000 7f1e8759e700 1 -- 172.21.15.50:0/2209457135 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1e88159390 msgr2=0x7f1e88159760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:25:34.541 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:34.538+0000 7f1e8759e700 1 --2- 172.21.15.50:0/2209457135 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1e88159390 0x7f1e88159760 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f1e780098e0 tx=0x7f1e780091a0 comp rx=0 tx=0).stop 2023-10-06T01:25:34.541 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:34.538+0000 7f1e8759e700 1 -- 172.21.15.50:0/2209457135 shutdown_connections 2023-10-06T01:25:34.541 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:34.538+0000 7f1e8759e700 1 --2- 172.21.15.50:0/2209457135 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1e88069ff0 0x7f1e88163100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:25:34.541 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:34.538+0000 7f1e8759e700 1 --2- 172.21.15.50:0/2209457135 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1e88159390 0x7f1e88159760 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:25:34.541 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:34.538+0000 7f1e8759e700 1 -- 172.21.15.50:0/2209457135 >> 172.21.15.50:0/2209457135 conn(0x7f1e88067dd0 msgr2=0x7f1e880ce160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:25:34.541 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:34.538+0000 7f1e8759e700 1 -- 172.21.15.50:0/2209457135 shutdown_connections 2023-10-06T01:25:34.541 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:34.538+0000 7f1e8759e700 1 -- 172.21.15.50:0/2209457135 wait complete. 2023-10-06T01:25:34.544 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:34.539+0000 7f1e8759e700 1 Processor -- start 2023-10-06T01:25:34.544 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:34.539+0000 7f1e8759e700 1 -- start start 2023-10-06T01:25:34.544 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:34.540+0000 7f1e8759e700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1e88069ff0 0x7f1e880b18e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:25:34.544 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:34.540+0000 7f1e8759e700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1e880ced20 0x7f1e88144ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:25:34.545 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:34.540+0000 7f1e8759e700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1e88159390 0x7f1e88157cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:25:34.545 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:34.540+0000 7f1e8759e700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e880b1ef0 con 0x7f1e88159390 2023-10-06T01:25:34.545 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:34.540+0000 7f1e8759e700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e880b21d0 con 0x7f1e88069ff0 2023-10-06T01:25:34.545 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:34.540+0000 7f1e8759e700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e880b24b0 con 0x7f1e880ced20 2023-10-06T01:25:34.545 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:34.541+0000 7f1e86d9d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1e88159390 0x7f1e88157cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:25:34.545 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:34.541+0000 7f1e86d9d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1e88159390 0x7f1e88157cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:48106/0 (socket says 172.21.15.50:48106) 2023-10-06T01:25:34.545 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:34.541+0000 7f1e86d9d700 1 -- 172.21.15.50:0/2716965300 learned_addr learned my addr 172.21.15.50:0/2716965300 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-06T01:25:34.545 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:34.541+0000 7f1e8659c700 1 --2- 172.21.15.50:0/2716965300 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1e88069ff0 0x7f1e880b18e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:25:34.545 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:34.541+0000 7f1e85d9b700 1 --2- 172.21.15.50:0/2716965300 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1e880ced20 0x7f1e88144ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:25:34.545 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:34.541+0000 7f1e86d9d700 1 -- 172.21.15.50:0/2716965300 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1e880ced20 msgr2=0x7f1e88144ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:25:34.546 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:34.541+0000 7f1e86d9d700 1 --2- 172.21.15.50:0/2716965300 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1e880ced20 0x7f1e88144ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:25:34.546 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:34.541+0000 7f1e86d9d700 1 -- 172.21.15.50:0/2716965300 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1e88069ff0 msgr2=0x7f1e880b18e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:25:34.546 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:34.541+0000 7f1e86d9d700 1 --2- 172.21.15.50:0/2716965300 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1e88069ff0 0x7f1e880b18e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:25:34.546 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:34.541+0000 7f1e86d9d700 1 -- 172.21.15.50:0/2716965300 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e78009420 con 0x7f1e88159390 2023-10-06T01:25:34.546 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:34.541+0000 7f1e8659c700 1 --2- 172.21.15.50:0/2716965300 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1e88069ff0 0x7f1e880b18e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T01:25:34.546 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:34.541+0000 7f1e85d9b700 1 --2- 172.21.15.50:0/2716965300 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1e880ced20 0x7f1e88144ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T01:25:34.546 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:34.541+0000 7f1e86d9d700 1 --2- 172.21.15.50:0/2716965300 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1e88159390 0x7f1e88157cf0 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f1e8000a380 tx=0x7f1e80007900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:25:34.546 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:34.541+0000 7f1e767fc700 1 -- 172.21.15.50:0/2716965300 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e8000ae10 con 0x7f1e88159390 2023-10-06T01:25:34.546 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:34.541+0000 7f1e767fc700 1 -- 172.21.15.50:0/2716965300 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e8000d650 con 0x7f1e88159390 2023-10-06T01:25:34.546 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:34.541+0000 7f1e767fc700 1 -- 172.21.15.50:0/2716965300 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e8000da10 con 0x7f1e88159390 2023-10-06T01:25:34.547 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:34.541+0000 7f1e8759e700 1 -- 172.21.15.50:0/2716965300 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1e880b2790 con 0x7f1e88159390 2023-10-06T01:25:34.547 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:34.542+0000 7f1e8759e700 1 -- 172.21.15.50:0/2716965300 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1e88151f10 con 0x7f1e88159390 2023-10-06T01:25:34.547 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:34.542+0000 7f1e8759e700 1 -- 172.21.15.50:0/2716965300 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1e8805f270 con 0x7f1e88159390 2023-10-06T01:25:34.547 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:34.543+0000 7f1e767fc700 1 -- 172.21.15.50:0/2716965300 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f1e8001e3b0 con 0x7f1e88159390 2023-10-06T01:25:34.548 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:34.544+0000 7f1e767fc700 1 --2- 172.21.15.50:0/2716965300 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f1e68066f30 0x7f1e680693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:25:34.548 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:34.545+0000 7f1e767fc700 1 -- 172.21.15.50:0/2716965300 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5612+0+0 (secure 0 0 0) 0x7f1e80084f80 con 0x7f1e88159390 2023-10-06T01:25:34.548 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:34.545+0000 7f1e8659c700 1 --2- 172.21.15.50:0/2716965300 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f1e68066f30 0x7f1e680693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:25:34.548 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:34.546+0000 7f1e8659c700 1 --2- 172.21.15.50:0/2716965300 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f1e68066f30 0x7f1e680693e0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f1e780093f0 tx=0x7f1e78017000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:25:34.549 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:34.548+0000 7f1e767fc700 1 -- 172.21.15.50:0/2716965300 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f1e800521b0 con 0x7f1e88159390 2023-10-06T01:25:34.750 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:34.749+0000 7f1e8759e700 1 -- 172.21.15.50:0/2716965300 --> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) v1 -- 0x7f1e880b2340 con 0x7f1e68066f30 2023-10-06T01:25:34.750 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:34.749+0000 7f1e767fc700 1 -- 172.21.15.50:0/2716965300 <== mgr.4099 v2:172.21.15.155:6832/85215 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f1e880b2340 con 0x7f1e68066f30 2023-10-06T01:25:34.753 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:34.752+0000 7f1e8759e700 1 -- 172.21.15.50:0/2716965300 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f1e68066f30 msgr2=0x7f1e680693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:25:34.753 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:34.752+0000 7f1e8759e700 1 --2- 172.21.15.50:0/2716965300 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f1e68066f30 0x7f1e680693e0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f1e780093f0 tx=0x7f1e78017000 comp rx=0 tx=0).stop 2023-10-06T01:25:34.753 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:34.752+0000 7f1e8759e700 1 -- 172.21.15.50:0/2716965300 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1e88159390 msgr2=0x7f1e88157cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:25:34.753 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:34.752+0000 7f1e8759e700 1 --2- 172.21.15.50:0/2716965300 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1e88159390 0x7f1e88157cf0 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f1e8000a380 tx=0x7f1e80007900 comp rx=0 tx=0).stop 2023-10-06T01:25:34.753 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:34.752+0000 7f1e8759e700 1 -- 172.21.15.50:0/2716965300 shutdown_connections 2023-10-06T01:25:34.754 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:34.752+0000 7f1e8759e700 1 --2- 172.21.15.50:0/2716965300 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1e88159390 0x7f1e88157cf0 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:25:34.754 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:34.752+0000 7f1e8759e700 1 --2- 172.21.15.50:0/2716965300 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f1e68066f30 0x7f1e680693e0 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:25:34.754 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:34.752+0000 7f1e8759e700 1 --2- 172.21.15.50:0/2716965300 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1e88069ff0 0x7f1e880b18e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:25:34.754 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:34.752+0000 7f1e8759e700 1 --2- 172.21.15.50:0/2716965300 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1e880ced20 0x7f1e88144ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:25:34.754 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:34.752+0000 7f1e8759e700 1 -- 172.21.15.50:0/2716965300 >> 172.21.15.50:0/2716965300 conn(0x7f1e88067dd0 msgr2=0x7f1e88069740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:25:34.754 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:34.752+0000 7f1e8759e700 1 -- 172.21.15.50:0/2716965300 shutdown_connections 2023-10-06T01:25:34.754 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:34.752+0000 7f1e8759e700 1 -- 172.21.15.50:0/2716965300 wait complete. 2023-10-06T01:25:34.755 INFO:teuthology.orchestra.run.smithi050.stderr:instructed osd(s) 0 to deep-scrub 2023-10-06T01:25:34.770 INFO:tasks.ceph:Scrubbing osd.1 2023-10-06T01:25:34.771 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2023-10-06T01:25:34.887 DEBUG:teuthology.orchestra.run.smithi050:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T01:25:34.892 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T01:25:34.966 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:34.965+0000 7f13089fe700 1 Processor -- start 2023-10-06T01:25:34.966 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:34.965+0000 7f13089fe700 1 -- start start 2023-10-06T01:25:34.967 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:34.966+0000 7f13089fe700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1304159330 0x7f13040b25e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:25:34.967 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:34.966+0000 7f13089fe700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f13040cffc0 con 0x7f13040b4370 2023-10-06T01:25:34.967 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:34.966+0000 7f13089fe700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f13040afbb0 con 0x7f13040b5e50 2023-10-06T01:25:34.967 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:34.966+0000 7f13089fe700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f13040b2b20 con 0x7f1304159330 2023-10-06T01:25:34.967 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:34.966+0000 7f130359e700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f13040b4370 0x7f13040b0bc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:41302/0 (socket says 172.21.15.50:41302) 2023-10-06T01:25:34.967 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:34.966+0000 7f130359e700 1 -- 172.21.15.50:0/3047085337 learned_addr learned my addr 172.21.15.50:0/3047085337 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-10-06T01:25:34.970 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:34.967+0000 7f1301d9b700 1 -- 172.21.15.50:0/3047085337 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2208300768 0 0) 0x7f13040cffc0 con 0x7f13040b4370 2023-10-06T01:25:34.970 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:34.967+0000 7f1301d9b700 1 -- 172.21.15.50:0/3047085337 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f12ec003570 con 0x7f13040b4370 2023-10-06T01:25:34.970 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:34.967+0000 7f1302d9d700 1 --2- 172.21.15.50:0/3047085337 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1304159330 0x7f13040b25e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:25:34.970 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:34.967+0000 7f1301d9b700 1 -- 172.21.15.50:0/3047085337 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 319851505 0 0) 0x7f12ec003570 con 0x7f13040b4370 2023-10-06T01:25:34.970 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:34.967+0000 7f1301d9b700 1 -- 172.21.15.50:0/3047085337 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1304159330 msgr2=0x7f13040b25e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:25:34.970 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:34.967+0000 7f1301d9b700 1 --2- 172.21.15.50:0/3047085337 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1304159330 0x7f13040b25e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:25:34.970 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:34.967+0000 7f1301d9b700 1 -- 172.21.15.50:0/3047085337 >> v1:172.21.15.155:6789/0 conn(0x7f13040b5e50 legacy=0x7f13040b3c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:25:34.971 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:34.967+0000 7f1301d9b700 1 -- 172.21.15.50:0/3047085337 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13040afe00 con 0x7f13040b4370 2023-10-06T01:25:34.971 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:34.967+0000 7f1301d9b700 1 -- 172.21.15.50:0/3047085337 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 347519148 0 0) 0x7f12fc0017f0 con 0x7f13040b4370 2023-10-06T01:25:34.971 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:34.967+0000 7f1301d9b700 1 -- 172.21.15.50:0/3047085337 >> v1:172.21.15.50:6789/0 conn(0x7f13040b4370 legacy=0x7f13040b0bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:25:34.971 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:34.967+0000 7f1301d9b700 1 --2- 172.21.15.50:0/3047085337 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1304159330 0x7f12ec003a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:25:34.971 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:34.967+0000 7f1301d9b700 1 --2- 172.21.15.50:0/3047085337 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f12ec0040a0 0x7f12ec004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:25:34.971 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:34.967+0000 7f1301d9b700 1 --2- 172.21.15.50:0/3047085337 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f12ec004da0 0x7f12ec005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:25:34.971 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:34.967+0000 7f1301d9b700 1 -- 172.21.15.50:0/3047085337 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13040b2b20 con 0x7f12ec004da0 2023-10-06T01:25:34.971 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:34.967+0000 7f1301d9b700 1 -- 172.21.15.50:0/3047085337 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12ec00bc50 con 0x7f12ec0040a0 2023-10-06T01:25:34.971 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:34.967+0000 7f1301d9b700 1 -- 172.21.15.50:0/3047085337 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12ec00be10 con 0x7f1304159330 2023-10-06T01:25:34.971 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:34.968+0000 7f130359e700 1 --2- 172.21.15.50:0/3047085337 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f12ec004da0 0x7f12ec005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:25:34.971 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:34.968+0000 7f130259c700 1 --2- 172.21.15.50:0/3047085337 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f12ec0040a0 0x7f12ec004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:25:34.971 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:34.968+0000 7f1302d9d700 1 --2- 172.21.15.50:0/3047085337 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1304159330 0x7f12ec003a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:25:34.972 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:34.968+0000 7f130359e700 1 -- 172.21.15.50:0/3047085337 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1304159330 msgr2=0x7f12ec003a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:25:34.972 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:34.968+0000 7f130359e700 1 --2- 172.21.15.50:0/3047085337 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1304159330 0x7f12ec003a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:25:34.972 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:34.968+0000 7f130359e700 1 -- 172.21.15.50:0/3047085337 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f12ec0040a0 msgr2=0x7f12ec004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:25:34.972 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:34.968+0000 7f130359e700 1 --2- 172.21.15.50:0/3047085337 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f12ec0040a0 0x7f12ec004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:25:34.972 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:34.968+0000 7f130359e700 1 -- 172.21.15.50:0/3047085337 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12ec003570 con 0x7f12ec004da0 2023-10-06T01:25:34.972 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:34.968+0000 7f130359e700 1 --2- 172.21.15.50:0/3047085337 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f12ec004da0 0x7f12ec005210 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f13040b4770 tx=0x7f12fc0021f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d9b8d0ce0249355d server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:25:34.972 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:34.968+0000 7f1301d9b700 1 -- 172.21.15.50:0/3047085337 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12fc0070d0 con 0x7f12ec004da0 2023-10-06T01:25:34.972 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:34.968+0000 7f1301d9b700 1 -- 172.21.15.50:0/3047085337 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12fc007230 con 0x7f12ec004da0 2023-10-06T01:25:34.972 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:34.968+0000 7f1301d9b700 1 -- 172.21.15.50:0/3047085337 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12fc0075f0 con 0x7f12ec004da0 2023-10-06T01:25:34.972 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:34.969+0000 7f13089fe700 1 -- 172.21.15.50:0/3047085337 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f12ec004da0 msgr2=0x7f12ec005210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:25:34.972 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:34.969+0000 7f13089fe700 1 --2- 172.21.15.50:0/3047085337 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f12ec004da0 0x7f12ec005210 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f13040b4770 tx=0x7f12fc0021f0 comp rx=0 tx=0).stop 2023-10-06T01:25:34.973 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:34.969+0000 7f130359e700 1 -- 172.21.15.50:0/3047085337 reap_dead start 2023-10-06T01:25:34.973 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:34.969+0000 7f13089fe700 1 -- 172.21.15.50:0/3047085337 shutdown_connections 2023-10-06T01:25:34.973 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:34.969+0000 7f13089fe700 1 -- 172.21.15.50:0/3047085337 >> 172.21.15.50:0/3047085337 conn(0x7f1304099520 msgr2=0x7f130406f500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:25:34.973 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:34.969+0000 7f13089fe700 1 -- 172.21.15.50:0/3047085337 shutdown_connections 2023-10-06T01:25:34.973 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:34.969+0000 7f13089fe700 1 -- 172.21.15.50:0/3047085337 wait complete. 2023-10-06T01:25:34.975 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:34.971+0000 7f13089fe700 1 Processor -- start 2023-10-06T01:25:34.975 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:34.971+0000 7f13089fe700 1 -- start start 2023-10-06T01:25:34.976 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:34.972+0000 7f13089fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f12ec004da0 0x7f1304154210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:25:34.976 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:34.972+0000 7f13089fe700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f13040c5de0 0x7f13040c6be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:25:34.976 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:34.972+0000 7f13089fe700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f130409d130 0x7f130409d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:25:34.976 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:34.972+0000 7f13089fe700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1304154750 con 0x7f12ec004da0 2023-10-06T01:25:34.976 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:34.972+0000 7f13089fe700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f130409db10 con 0x7f13040c5de0 2023-10-06T01:25:34.976 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:34.972+0000 7f13089fe700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f13040c9a60 con 0x7f130409d130 2023-10-06T01:25:34.976 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:34.972+0000 7f1302d9d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f12ec004da0 0x7f1304154210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:25:34.976 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:34.972+0000 7f1302d9d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f12ec004da0 0x7f1304154210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:33644/0 (socket says 172.21.15.50:33644) 2023-10-06T01:25:34.976 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:34.972+0000 7f1302d9d700 1 -- 172.21.15.50:0/3286528617 learned_addr learned my addr 172.21.15.50:0/3286528617 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-06T01:25:34.976 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:34.972+0000 7f130259c700 1 --2- 172.21.15.50:0/3286528617 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f13040c5de0 0x7f13040c6be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:25:34.977 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:34.972+0000 7f130359e700 1 --2- 172.21.15.50:0/3286528617 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f130409d130 0x7f130409d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:25:34.977 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:34.972+0000 7f1302d9d700 1 -- 172.21.15.50:0/3286528617 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f130409d130 msgr2=0x7f130409d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:25:34.977 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:34.972+0000 7f1302d9d700 1 --2- 172.21.15.50:0/3286528617 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f130409d130 0x7f130409d5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:25:34.977 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:34.972+0000 7f1302d9d700 1 -- 172.21.15.50:0/3286528617 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f13040c5de0 msgr2=0x7f13040c6be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:25:34.977 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:34.972+0000 7f1302d9d700 1 --2- 172.21.15.50:0/3286528617 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f13040c5de0 0x7f13040c6be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:25:34.977 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:34.972+0000 7f1302d9d700 1 -- 172.21.15.50:0/3286528617 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13040c8e50 con 0x7f12ec004da0 2023-10-06T01:25:34.977 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:34.972+0000 7f1302d9d700 1 --2- 172.21.15.50:0/3286528617 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f12ec004da0 0x7f1304154210 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f12f4010aa0 tx=0x7f12f4008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:25:34.977 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:34.973+0000 7f12eaffd700 1 -- 172.21.15.50:0/3286528617 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12f400e8d0 con 0x7f12ec004da0 2023-10-06T01:25:34.977 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:34.973+0000 7f12eaffd700 1 -- 172.21.15.50:0/3286528617 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12f400ea30 con 0x7f12ec004da0 2023-10-06T01:25:34.977 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:34.973+0000 7f12eaffd700 1 -- 172.21.15.50:0/3286528617 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12f400edd0 con 0x7f12ec004da0 2023-10-06T01:25:34.977 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:34.973+0000 7f13089fe700 1 -- 172.21.15.50:0/3286528617 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f13040c9130 con 0x7f12ec004da0 2023-10-06T01:25:34.978 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:34.973+0000 7f13089fe700 1 -- 172.21.15.50:0/3286528617 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f13040c96f0 con 0x7f12ec004da0 2023-10-06T01:25:34.978 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:34.974+0000 7f13089fe700 1 -- 172.21.15.50:0/3286528617 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f13040b41b0 con 0x7f12ec004da0 2023-10-06T01:25:34.978 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:34.975+0000 7f12eaffd700 1 -- 172.21.15.50:0/3286528617 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f12f4014640 con 0x7f12ec004da0 2023-10-06T01:25:34.979 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:34.976+0000 7f12eaffd700 1 --2- 172.21.15.50:0/3286528617 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f12f0066f30 0x7f12f00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:25:34.979 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:34.976+0000 7f12eaffd700 1 -- 172.21.15.50:0/3286528617 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5612+0+0 (secure 0 0 0) 0x7f12f4085130 con 0x7f12ec004da0 2023-10-06T01:25:34.979 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:34.976+0000 7f12eaffd700 1 --2- 172.21.15.50:0/3286528617 >> [v2:172.21.15.50:6808/87853,v1:172.21.15.50:6809/87853] conn(0x7f12f006d850 0x7f12f006fca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:25:34.979 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:34.976+0000 7f12eaffd700 1 -- 172.21.15.50:0/3286528617 --> [v2:172.21.15.50:6808/87853,v1:172.21.15.50:6809/87853] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f12f0070370 con 0x7f12f006d850 2023-10-06T01:25:34.979 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:34.976+0000 7f12eaffd700 1 -- 172.21.15.50:0/3286528617 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_get_version_reply(handle=1 version=44) v2 ==== 24+0+0 (secure 0 0 0) 0x7f12f4085420 con 0x7f12ec004da0 2023-10-06T01:25:34.979 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:34.976+0000 7f130259c700 1 --2- 172.21.15.50:0/3286528617 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f12f0066f30 0x7f12f00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:25:34.979 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:34.977+0000 7f130359e700 1 --2- 172.21.15.50:0/3286528617 >> [v2:172.21.15.50:6808/87853,v1:172.21.15.50:6809/87853] conn(0x7f12f006d850 0x7f12f006fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:25:34.979 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:34.977+0000 7f130359e700 1 --2- 172.21.15.50:0/3286528617 >> [v2:172.21.15.50:6808/87853,v1:172.21.15.50:6809/87853] conn(0x7f12f006d850 0x7f12f006fca0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:25:34.980 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:34.977+0000 7f130259c700 1 --2- 172.21.15.50:0/3286528617 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f12f0066f30 0x7f12f00693e0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f13041550d0 tx=0x7f12f8007d30 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:25:34.980 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:34.978+0000 7f12eaffd700 1 -- 172.21.15.50:0/3286528617 <== osd.1 v2:172.21.15.50:6808/87853 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7f12f0070370 con 0x7f12f006d850 2023-10-06T01:25:34.993 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:34.993+0000 7f13089fe700 1 -- 172.21.15.50:0/3286528617 --> [v2:172.21.15.50:6808/87853,v1:172.21.15.50:6809/87853] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f130405f270 con 0x7f12f006d850 2023-10-06T01:25:34.994 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:34.993+0000 7f12eaffd700 1 -- 172.21.15.50:0/3286528617 <== osd.1 v2:172.21.15.50:6808/87853 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f130405f270 con 0x7f12f006d850 2023-10-06T01:25:34.994 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2023-10-06T01:25:34.994 INFO:teuthology.orchestra.run.smithi050.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-10-06T01:25:34.994 INFO:teuthology.orchestra.run.smithi050.stdout:} 2023-10-06T01:25:34.995 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:34.993+0000 7f13089fe700 1 -- 172.21.15.50:0/3286528617 >> [v2:172.21.15.50:6808/87853,v1:172.21.15.50:6809/87853] conn(0x7f12f006d850 msgr2=0x7f12f006fca0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:25:34.995 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:34.993+0000 7f13089fe700 1 --2- 172.21.15.50:0/3286528617 >> [v2:172.21.15.50:6808/87853,v1:172.21.15.50:6809/87853] conn(0x7f12f006d850 0x7f12f006fca0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:25:34.995 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:34.994+0000 7f13089fe700 1 -- 172.21.15.50:0/3286528617 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f12f0066f30 msgr2=0x7f12f00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:25:34.995 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:34.994+0000 7f13089fe700 1 --2- 172.21.15.50:0/3286528617 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f12f0066f30 0x7f12f00693e0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f13041550d0 tx=0x7f12f8007d30 comp rx=0 tx=0).stop 2023-10-06T01:25:34.995 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:34.994+0000 7f13089fe700 1 -- 172.21.15.50:0/3286528617 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f12ec004da0 msgr2=0x7f1304154210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:25:34.995 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:34.994+0000 7f13089fe700 1 --2- 172.21.15.50:0/3286528617 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f12ec004da0 0x7f1304154210 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f12f4010aa0 tx=0x7f12f4008040 comp rx=0 tx=0).stop 2023-10-06T01:25:34.996 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:34.994+0000 7f130359e700 1 -- 172.21.15.50:0/3286528617 reap_dead start 2023-10-06T01:25:34.996 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:34.994+0000 7f13089fe700 1 -- 172.21.15.50:0/3286528617 shutdown_connections 2023-10-06T01:25:34.996 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:34.994+0000 7f13089fe700 1 -- 172.21.15.50:0/3286528617 >> 172.21.15.50:0/3286528617 conn(0x7f1304099520 msgr2=0x7f13040d0280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:25:34.996 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:34.994+0000 7f13089fe700 1 -- 172.21.15.50:0/3286528617 shutdown_connections 2023-10-06T01:25:34.996 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:34.994+0000 7f13089fe700 1 -- 172.21.15.50:0/3286528617 wait complete. 2023-10-06T01:25:35.011 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2023-10-06T01:25:35.240 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:35.239+0000 7fe42359e700 1 Processor -- start 2023-10-06T01:25:35.240 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:35.239+0000 7fe42359e700 1 -- start start 2023-10-06T01:25:35.242 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:35.240+0000 7fe42359e700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fe4241592d0 0x7fe4240ce320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:25:35.242 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:35.240+0000 7fe42359e700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fe4240af5a0 0x7fe42415d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:25:35.243 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:35.240+0000 7fe42359e700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe4240cb310 con 0x7fe4241596a0 2023-10-06T01:25:35.243 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:35.240+0000 7fe42359e700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe4240cb5f0 con 0x7fe4240af5a0 2023-10-06T01:25:35.243 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:35.240+0000 7fe42359e700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe4240cb8d0 con 0x7fe4241592d0 2023-10-06T01:25:35.243 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:35.240+0000 7fe421d9b700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fe4241596a0 0x7fe4240aee90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:41316/0 (socket says 172.21.15.50:41316) 2023-10-06T01:25:35.243 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:35.240+0000 7fe421d9b700 1 -- 172.21.15.50:0/458975389 learned_addr learned my addr 172.21.15.50:0/458975389 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-10-06T01:25:35.243 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:35.241+0000 7fe422d9d700 1 --2- 172.21.15.50:0/458975389 >> v2:172.21.15.50:3300/0 conn(0x7fe4240af5a0 0x7fe42415d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:25:35.243 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:35.241+0000 7fe42259c700 1 --2- 172.21.15.50:0/458975389 >> v2:172.21.15.155:3300/0 conn(0x7fe4241592d0 0x7fe4240ce320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:25:35.243 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:35.241+0000 7fe42159a700 1 -- 172.21.15.50:0/458975389 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2347319527 0 0) 0x7fe4240cb310 con 0x7fe4241596a0 2023-10-06T01:25:35.243 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:35.241+0000 7fe42159a700 1 -- 172.21.15.50:0/458975389 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe40c003570 con 0x7fe4241596a0 2023-10-06T01:25:35.244 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:35.241+0000 7fe422d9d700 1 -- 172.21.15.50:0/458975389 >> v2:172.21.15.155:3300/0 conn(0x7fe4241592d0 msgr2=0x7fe4240ce320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:25:35.244 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:35.241+0000 7fe422d9d700 1 --2- 172.21.15.50:0/458975389 >> v2:172.21.15.155:3300/0 conn(0x7fe4241592d0 0x7fe4240ce320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:25:35.244 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:35.241+0000 7fe422d9d700 1 -- 172.21.15.50:0/458975389 >> v1:172.21.15.50:6789/0 conn(0x7fe4241596a0 legacy=0x7fe4240aee90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:25:35.244 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:35.241+0000 7fe422d9d700 1 -- 172.21.15.50:0/458975389 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4240caea0 con 0x7fe4240af5a0 2023-10-06T01:25:35.244 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:35.241+0000 7fe422d9d700 1 --2- 172.21.15.50:0/458975389 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe4240af5a0 0x7fe42415d3f0 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7fe424069150 tx=0x7fe41c009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=37fdd501135fd205 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:25:35.244 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:35.242+0000 7fe42159a700 1 -- 172.21.15.50:0/458975389 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe41c00e070 con 0x7fe4240af5a0 2023-10-06T01:25:35.244 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:35.242+0000 7fe42159a700 1 -- 172.21.15.50:0/458975389 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe41c00bab0 con 0x7fe4240af5a0 2023-10-06T01:25:35.244 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:35.242+0000 7fe42159a700 1 -- 172.21.15.50:0/458975389 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe41c00be70 con 0x7fe4240af5a0 2023-10-06T01:25:35.247 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:35.242+0000 7fe42359e700 1 -- 172.21.15.50:0/458975389 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe4240af5a0 msgr2=0x7fe42415d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:25:35.248 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:35.242+0000 7fe42359e700 1 --2- 172.21.15.50:0/458975389 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe4240af5a0 0x7fe42415d3f0 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7fe424069150 tx=0x7fe41c009780 comp rx=0 tx=0).stop 2023-10-06T01:25:35.248 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:35.242+0000 7fe42359e700 1 -- 172.21.15.50:0/458975389 shutdown_connections 2023-10-06T01:25:35.248 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:35.242+0000 7fe42359e700 1 --2- 172.21.15.50:0/458975389 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe4240af5a0 0x7fe42415d3f0 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:25:35.248 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:35.242+0000 7fe42359e700 1 --2- 172.21.15.50:0/458975389 >> v2:172.21.15.155:3300/0 conn(0x7fe4241592d0 0x7fe4240ce320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:25:35.248 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:35.242+0000 7fe42359e700 1 -- 172.21.15.50:0/458975389 >> 172.21.15.50:0/458975389 conn(0x7fe424068130 msgr2=0x7fe424068530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:25:35.248 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:35.242+0000 7fe42359e700 1 -- 172.21.15.50:0/458975389 shutdown_connections 2023-10-06T01:25:35.248 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:35.242+0000 7fe42359e700 1 -- 172.21.15.50:0/458975389 wait complete. 2023-10-06T01:25:35.248 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:35.244+0000 7fe42359e700 1 Processor -- start 2023-10-06T01:25:35.248 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:35.244+0000 7fe42359e700 1 -- start start 2023-10-06T01:25:35.249 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:35.245+0000 7fe42359e700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe4240af5a0 0x7fe4240c8630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:25:35.249 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:35.245+0000 7fe42359e700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe4241592d0 0x7fe4240c52e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:25:35.249 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:35.245+0000 7fe42359e700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe4241596a0 0x7fe424152e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:25:35.249 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:35.245+0000 7fe42359e700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4240b6080 con 0x7fe4241592d0 2023-10-06T01:25:35.249 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:35.245+0000 7fe42359e700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4240c8b70 con 0x7fe4240af5a0 2023-10-06T01:25:35.249 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:35.245+0000 7fe42359e700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe4240c99b0 con 0x7fe4241596a0 2023-10-06T01:25:35.249 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:35.245+0000 7fe421d9b700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe4241592d0 0x7fe4240c52e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:25:35.249 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:35.245+0000 7fe421d9b700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe4241592d0 0x7fe4240c52e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:33660/0 (socket says 172.21.15.50:33660) 2023-10-06T01:25:35.249 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:35.245+0000 7fe421d9b700 1 -- 172.21.15.50:0/1995721819 learned_addr learned my addr 172.21.15.50:0/1995721819 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-06T01:25:35.250 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:35.245+0000 7fe42259c700 1 --2- 172.21.15.50:0/1995721819 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe4240af5a0 0x7fe4240c8630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:25:35.250 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:35.245+0000 7fe422d9d700 1 --2- 172.21.15.50:0/1995721819 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe4241596a0 0x7fe424152e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:25:35.250 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:35.245+0000 7fe421d9b700 1 -- 172.21.15.50:0/1995721819 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe4241596a0 msgr2=0x7fe424152e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:25:35.250 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:35.245+0000 7fe421d9b700 1 --2- 172.21.15.50:0/1995721819 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe4241596a0 0x7fe424152e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:25:35.250 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:35.245+0000 7fe421d9b700 1 -- 172.21.15.50:0/1995721819 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe4240af5a0 msgr2=0x7fe4240c8630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:25:35.250 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:35.246+0000 7fe421d9b700 1 --2- 172.21.15.50:0/1995721819 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe4240af5a0 0x7fe4240c8630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:25:35.250 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:35.246+0000 7fe421d9b700 1 -- 172.21.15.50:0/1995721819 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe41c009a20 con 0x7fe4241592d0 2023-10-06T01:25:35.250 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:35.246+0000 7fe421d9b700 1 --2- 172.21.15.50:0/1995721819 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe4241592d0 0x7fe4240c52e0 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7fe41800c560 tx=0x7fe418007dd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:25:35.250 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:35.246+0000 7fe4127fc700 1 -- 172.21.15.50:0/1995721819 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe418005c00 con 0x7fe4241592d0 2023-10-06T01:25:35.251 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:35.246+0000 7fe4127fc700 1 -- 172.21.15.50:0/1995721819 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe418005d60 con 0x7fe4241592d0 2023-10-06T01:25:35.251 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:35.246+0000 7fe42359e700 1 -- 172.21.15.50:0/1995721819 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe4240c8da0 con 0x7fe4241592d0 2023-10-06T01:25:35.251 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:35.246+0000 7fe4127fc700 1 -- 172.21.15.50:0/1995721819 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe418007300 con 0x7fe4241592d0 2023-10-06T01:25:35.251 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:35.246+0000 7fe42359e700 1 -- 172.21.15.50:0/1995721819 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe4240c93e0 con 0x7fe4241592d0 2023-10-06T01:25:35.252 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:35.247+0000 7fe42359e700 1 -- 172.21.15.50:0/1995721819 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe42405f270 con 0x7fe4241592d0 2023-10-06T01:25:35.252 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:35.248+0000 7fe4127fc700 1 -- 172.21.15.50:0/1995721819 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fe41801b3b0 con 0x7fe4241592d0 2023-10-06T01:25:35.252 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:35.249+0000 7fe4127fc700 1 --2- 172.21.15.50:0/1995721819 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7fe404066f30 0x7fe4040693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:25:35.252 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:35.249+0000 7fe4127fc700 1 -- 172.21.15.50:0/1995721819 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5612+0+0 (secure 0 0 0) 0x7fe418083a20 con 0x7fe4241592d0 2023-10-06T01:25:35.252 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:35.249+0000 7fe42259c700 1 --2- 172.21.15.50:0/1995721819 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7fe404066f30 0x7fe4040693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:25:35.252 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:35.250+0000 7fe42259c700 1 --2- 172.21.15.50:0/1995721819 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7fe404066f30 0x7fe4040693e0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fe414009d40 tx=0x7fe414008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:25:35.254 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:35.253+0000 7fe4127fc700 1 -- 172.21.15.50:0/1995721819 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe418050cf0 con 0x7fe4241592d0 2023-10-06T01:25:35.454 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:35.454+0000 7fe42359e700 1 -- 172.21.15.50:0/1995721819 --> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) v1 -- 0x7fe4240c9af0 con 0x7fe404066f30 2023-10-06T01:25:35.455 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:35.454+0000 7fe4127fc700 1 -- 172.21.15.50:0/1995721819 <== mgr.4099 v2:172.21.15.155:6832/85215 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fe4240c9af0 con 0x7fe404066f30 2023-10-06T01:25:35.458 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:35.457+0000 7fe42359e700 1 -- 172.21.15.50:0/1995721819 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7fe404066f30 msgr2=0x7fe4040693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:25:35.458 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:35.457+0000 7fe42359e700 1 --2- 172.21.15.50:0/1995721819 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7fe404066f30 0x7fe4040693e0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fe414009d40 tx=0x7fe414008040 comp rx=0 tx=0).stop 2023-10-06T01:25:35.458 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:35.457+0000 7fe42359e700 1 -- 172.21.15.50:0/1995721819 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe4241592d0 msgr2=0x7fe4240c52e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:25:35.458 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:35.457+0000 7fe42359e700 1 --2- 172.21.15.50:0/1995721819 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe4241592d0 0x7fe4240c52e0 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7fe41800c560 tx=0x7fe418007dd0 comp rx=0 tx=0).stop 2023-10-06T01:25:35.458 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:35.457+0000 7fe42359e700 1 -- 172.21.15.50:0/1995721819 shutdown_connections 2023-10-06T01:25:35.458 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:35.457+0000 7fe42359e700 1 --2- 172.21.15.50:0/1995721819 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe4241596a0 0x7fe424152e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:25:35.458 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:35.457+0000 7fe42359e700 1 --2- 172.21.15.50:0/1995721819 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7fe404066f30 0x7fe4040693e0 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:25:35.459 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:35.457+0000 7fe42359e700 1 --2- 172.21.15.50:0/1995721819 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe4240af5a0 0x7fe4240c8630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:25:35.459 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:35.457+0000 7fe42359e700 1 --2- 172.21.15.50:0/1995721819 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe4241592d0 0x7fe4240c52e0 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:25:35.459 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:35.457+0000 7fe42359e700 1 -- 172.21.15.50:0/1995721819 >> 172.21.15.50:0/1995721819 conn(0x7fe424068130 msgr2=0x7fe4240c5f00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:25:35.459 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:35.457+0000 7fe42359e700 1 -- 172.21.15.50:0/1995721819 shutdown_connections 2023-10-06T01:25:35.459 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:35.457+0000 7fe42359e700 1 -- 172.21.15.50:0/1995721819 wait complete. 2023-10-06T01:25:35.459 INFO:teuthology.orchestra.run.smithi050.stderr:instructed osd(s) 1 to deep-scrub 2023-10-06T01:25:35.475 INFO:tasks.ceph:Scrubbing osd.2 2023-10-06T01:25:35.475 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2023-10-06T01:25:35.667 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:35.666+0000 7f333b59e700 1 Processor -- start 2023-10-06T01:25:35.667 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:35.666+0000 7f333b59e700 1 -- start start 2023-10-06T01:25:35.668 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:35.667+0000 7f333b59e700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f333c155ed0 0x7f333c0c8950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:25:35.668 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:35.667+0000 7f333b59e700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f333c0c8e90 0x7f333c0b00d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:25:35.668 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:35.667+0000 7f333b59e700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f333c0ac9b0 con 0x7f333c1562a0 2023-10-06T01:25:35.668 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:35.667+0000 7f333b59e700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f333c0acc90 con 0x7f333c0c8e90 2023-10-06T01:25:35.668 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:35.667+0000 7f333b59e700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f333c0acf70 con 0x7f333c155ed0 2023-10-06T01:25:35.669 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:35.667+0000 7f3339d9b700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f333c0c8e90 0x7f333c0b00d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:25:35.670 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:35.668+0000 7f3339d9b700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f333c0c8e90 0x7f333c0b00d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:33676/0 (socket says 172.21.15.50:33676) 2023-10-06T01:25:35.670 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:35.668+0000 7f3339d9b700 1 -- 172.21.15.50:0/443367900 learned_addr learned my addr 172.21.15.50:0/443367900 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-06T01:25:35.670 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:35.668+0000 7f333a59c700 1 --2- 172.21.15.50:0/443367900 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f333c155ed0 0x7f333c0c8950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:25:35.670 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:35.668+0000 7f3339d9b700 1 -- 172.21.15.50:0/443367900 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f333c155ed0 msgr2=0x7f333c0c8950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:25:35.670 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:35.668+0000 7f3339d9b700 1 --2- 172.21.15.50:0/443367900 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f333c155ed0 0x7f333c0c8950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:25:35.670 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:35.668+0000 7f3339d9b700 1 -- 172.21.15.50:0/443367900 >> v1:172.21.15.155:6789/0 conn(0x7f333c1562a0 legacy=0x7f333c06e170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:25:35.670 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:35.668+0000 7f3339d9b700 1 -- 172.21.15.50:0/443367900 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f333c0ad250 con 0x7f333c0c8e90 2023-10-06T01:25:35.670 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:35.668+0000 7f333a59c700 1 --2- 172.21.15.50:0/443367900 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f333c155ed0 0x7f333c0c8950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T01:25:35.670 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:35.668+0000 7f3339d9b700 1 --2- 172.21.15.50:0/443367900 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f333c0c8e90 0x7f333c0b00d0 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f33300099b0 tx=0x7f3330009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ed009d55d2b4421a server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:25:35.670 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:35.669+0000 7f333959a700 1 -- 172.21.15.50:0/443367900 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f333000b860 con 0x7f333c0c8e90 2023-10-06T01:25:35.670 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:35.669+0000 7f333959a700 1 -- 172.21.15.50:0/443367900 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f333000b9c0 con 0x7f333c0c8e90 2023-10-06T01:25:35.671 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:35.669+0000 7f333959a700 1 -- 172.21.15.50:0/443367900 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f333000bd60 con 0x7f333c0c8e90 2023-10-06T01:25:35.672 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:35.669+0000 7f333b59e700 1 -- 172.21.15.50:0/443367900 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f333c0c8e90 msgr2=0x7f333c0b00d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:25:35.672 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:35.669+0000 7f333b59e700 1 --2- 172.21.15.50:0/443367900 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f333c0c8e90 0x7f333c0b00d0 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f33300099b0 tx=0x7f3330009250 comp rx=0 tx=0).stop 2023-10-06T01:25:35.672 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:35.669+0000 7f333b59e700 1 -- 172.21.15.50:0/443367900 shutdown_connections 2023-10-06T01:25:35.672 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:35.669+0000 7f333b59e700 1 --2- 172.21.15.50:0/443367900 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f333c155ed0 0x7f333c0c8950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:25:35.672 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:35.669+0000 7f333b59e700 1 --2- 172.21.15.50:0/443367900 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f333c0c8e90 0x7f333c0b00d0 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:25:35.672 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:35.669+0000 7f333b59e700 1 -- 172.21.15.50:0/443367900 >> 172.21.15.50:0/443367900 conn(0x7f333c0cbee0 msgr2=0x7f333c0cc2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:25:35.672 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:35.669+0000 7f333b59e700 1 -- 172.21.15.50:0/443367900 shutdown_connections 2023-10-06T01:25:35.672 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:35.669+0000 7f333b59e700 1 -- 172.21.15.50:0/443367900 wait complete. 2023-10-06T01:25:35.672 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:35.671+0000 7f333b59e700 1 Processor -- start 2023-10-06T01:25:35.672 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:35.671+0000 7f333b59e700 1 -- start start 2023-10-06T01:25:35.675 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:35.672+0000 7f333b59e700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f333c0c8e90 0x7f333c151e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:25:35.675 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:35.672+0000 7f333b59e700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f333c155ed0 0x7f333c0a5eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:25:35.675 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:35.672+0000 7f333b59e700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f333c1562a0 0x7f333c158f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:25:35.675 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:35.672+0000 7f333b59e700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f333c16a7b0 con 0x7f333c1562a0 2023-10-06T01:25:35.675 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:35.672+0000 7f333b59e700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f333c16ad70 con 0x7f333c0c8e90 2023-10-06T01:25:35.675 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:35.672+0000 7f333b59e700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f333c0a57f0 con 0x7f333c155ed0 2023-10-06T01:25:35.675 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:35.672+0000 7f333ad9d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f333c1562a0 0x7f333c158f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:25:35.675 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:35.672+0000 7f333ad9d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f333c1562a0 0x7f333c158f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:33692/0 (socket says 172.21.15.50:33692) 2023-10-06T01:25:35.675 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:35.672+0000 7f333ad9d700 1 -- 172.21.15.50:0/327295122 learned_addr learned my addr 172.21.15.50:0/327295122 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-06T01:25:35.675 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:35.672+0000 7f3339d9b700 1 --2- 172.21.15.50:0/327295122 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f333c155ed0 0x7f333c0a5eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:25:35.676 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:35.672+0000 7f333a59c700 1 --2- 172.21.15.50:0/327295122 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f333c0c8e90 0x7f333c151e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:25:35.676 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:35.673+0000 7f333ad9d700 1 -- 172.21.15.50:0/327295122 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f333c155ed0 msgr2=0x7f333c0a5eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:25:35.676 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:35.673+0000 7f333ad9d700 1 --2- 172.21.15.50:0/327295122 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f333c155ed0 0x7f333c0a5eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:25:35.676 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:35.673+0000 7f333ad9d700 1 -- 172.21.15.50:0/327295122 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f333c0c8e90 msgr2=0x7f333c151e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:25:35.676 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:35.673+0000 7f333ad9d700 1 --2- 172.21.15.50:0/327295122 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f333c0c8e90 0x7f333c151e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:25:35.676 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:35.673+0000 7f333ad9d700 1 -- 172.21.15.50:0/327295122 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33300094f0 con 0x7f333c1562a0 2023-10-06T01:25:35.676 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:35.673+0000 7f3339d9b700 1 --2- 172.21.15.50:0/327295122 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f333c155ed0 0x7f333c0a5eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T01:25:35.676 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:35.673+0000 7f333ad9d700 1 --2- 172.21.15.50:0/327295122 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f333c1562a0 0x7f333c158f50 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f333400c840 tx=0x7f3334001610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:25:35.676 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:35.673+0000 7f332a7fc700 1 -- 172.21.15.50:0/327295122 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3334012630 con 0x7f333c1562a0 2023-10-06T01:25:35.676 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:35.673+0000 7f332a7fc700 1 -- 172.21.15.50:0/327295122 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33340127b0 con 0x7f333c1562a0 2023-10-06T01:25:35.676 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:35.673+0000 7f333b59e700 1 -- 172.21.15.50:0/327295122 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f333c0a5ad0 con 0x7f333c1562a0 2023-10-06T01:25:35.676 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:35.673+0000 7f332a7fc700 1 -- 172.21.15.50:0/327295122 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3334012b70 con 0x7f333c1562a0 2023-10-06T01:25:35.677 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:35.673+0000 7f333b59e700 1 -- 172.21.15.50:0/327295122 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f333c0a63f0 con 0x7f333c1562a0 2023-10-06T01:25:35.677 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:35.674+0000 7f333b59e700 1 -- 172.21.15.50:0/327295122 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f333c159930 con 0x7f333c1562a0 2023-10-06T01:25:35.678 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:35.675+0000 7f332a7fc700 1 -- 172.21.15.50:0/327295122 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f333401a3a0 con 0x7f333c1562a0 2023-10-06T01:25:35.678 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:35.676+0000 7f332a7fc700 1 --2- 172.21.15.50:0/327295122 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f331c066f30 0x7f331c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:25:35.678 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:35.676+0000 7f332a7fc700 1 -- 172.21.15.50:0/327295122 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5612+0+0 (secure 0 0 0) 0x7f3334084530 con 0x7f333c1562a0 2023-10-06T01:25:35.678 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:35.677+0000 7f332a7fc700 1 --2- 172.21.15.50:0/327295122 >> [v2:172.21.15.50:6821/87855,v1:172.21.15.50:6822/87855] conn(0x7f331c06d850 0x7f331c06fca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:25:35.678 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:35.677+0000 7f332a7fc700 1 -- 172.21.15.50:0/327295122 --> [v2:172.21.15.50:6821/87855,v1:172.21.15.50:6822/87855] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f331c070370 con 0x7f331c06d850 2023-10-06T01:25:35.678 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:35.677+0000 7f332a7fc700 1 -- 172.21.15.50:0/327295122 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_get_version_reply(handle=1 version=44) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3334086a90 con 0x7f333c1562a0 2023-10-06T01:25:35.678 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:35.677+0000 7f333a59c700 1 --2- 172.21.15.50:0/327295122 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f331c066f30 0x7f331c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:25:35.678 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:35.677+0000 7f3339d9b700 1 --2- 172.21.15.50:0/327295122 >> [v2:172.21.15.50:6821/87855,v1:172.21.15.50:6822/87855] conn(0x7f331c06d850 0x7f331c06fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:25:35.679 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:35.677+0000 7f3339d9b700 1 --2- 172.21.15.50:0/327295122 >> [v2:172.21.15.50:6821/87855,v1:172.21.15.50:6822/87855] conn(0x7f331c06d850 0x7f331c06fca0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:25:35.679 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:35.677+0000 7f333a59c700 1 --2- 172.21.15.50:0/327295122 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f331c066f30 0x7f331c0693e0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f332c006f00 tx=0x7f332c008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:25:35.679 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:35.678+0000 7f332a7fc700 1 -- 172.21.15.50:0/327295122 <== osd.2 v2:172.21.15.50:6821/87855 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7f331c070370 con 0x7f331c06d850 2023-10-06T01:25:35.693 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:35.693+0000 7f333b59e700 1 -- 172.21.15.50:0/327295122 --> [v2:172.21.15.50:6821/87855,v1:172.21.15.50:6822/87855] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f333c05f270 con 0x7f331c06d850 2023-10-06T01:25:35.694 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:35.693+0000 7f332a7fc700 1 -- 172.21.15.50:0/327295122 <== osd.2 v2:172.21.15.50:6821/87855 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f333c05f270 con 0x7f331c06d850 2023-10-06T01:25:35.694 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2023-10-06T01:25:35.694 INFO:teuthology.orchestra.run.smithi050.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-10-06T01:25:35.694 INFO:teuthology.orchestra.run.smithi050.stdout:} 2023-10-06T01:25:35.695 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:35.693+0000 7f333b59e700 1 -- 172.21.15.50:0/327295122 >> [v2:172.21.15.50:6821/87855,v1:172.21.15.50:6822/87855] conn(0x7f331c06d850 msgr2=0x7f331c06fca0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:25:35.695 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:35.693+0000 7f333b59e700 1 --2- 172.21.15.50:0/327295122 >> [v2:172.21.15.50:6821/87855,v1:172.21.15.50:6822/87855] conn(0x7f331c06d850 0x7f331c06fca0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:25:35.695 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:35.694+0000 7f333b59e700 1 -- 172.21.15.50:0/327295122 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f331c066f30 msgr2=0x7f331c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:25:35.695 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:35.694+0000 7f333b59e700 1 --2- 172.21.15.50:0/327295122 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f331c066f30 0x7f331c0693e0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f332c006f00 tx=0x7f332c008040 comp rx=0 tx=0).stop 2023-10-06T01:25:35.695 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:35.694+0000 7f333b59e700 1 -- 172.21.15.50:0/327295122 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f333c1562a0 msgr2=0x7f333c158f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:25:35.696 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:35.694+0000 7f333b59e700 1 --2- 172.21.15.50:0/327295122 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f333c1562a0 0x7f333c158f50 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f333400c840 tx=0x7f3334001610 comp rx=0 tx=0).stop 2023-10-06T01:25:35.696 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:35.694+0000 7f333ad9d700 1 -- 172.21.15.50:0/327295122 reap_dead start 2023-10-06T01:25:35.696 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:35.694+0000 7f333b59e700 1 -- 172.21.15.50:0/327295122 shutdown_connections 2023-10-06T01:25:35.696 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:35.694+0000 7f333b59e700 1 -- 172.21.15.50:0/327295122 >> 172.21.15.50:0/327295122 conn(0x7f333c0cbee0 msgr2=0x7f333c06d160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:25:35.696 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:35.694+0000 7f333b59e700 1 -- 172.21.15.50:0/327295122 shutdown_connections 2023-10-06T01:25:35.696 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:35.694+0000 7f333b59e700 1 -- 172.21.15.50:0/327295122 wait complete. 2023-10-06T01:25:35.711 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2023-10-06T01:25:35.899 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:35.898+0000 7f4a9ffff700 1 Processor -- start 2023-10-06T01:25:35.899 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:35.898+0000 7f4a9ffff700 1 -- start start 2023-10-06T01:25:35.903 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:35.899+0000 7f4a9ffff700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4aa01596a0 0x7f4aa00aee90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:25:35.903 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:35.899+0000 7f4a9ffff700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4aa00cb310 con 0x7f4aa01592d0 2023-10-06T01:25:35.903 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:35.899+0000 7f4a9ffff700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4aa00cb5f0 con 0x7f4aa00ca930 2023-10-06T01:25:35.903 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:35.899+0000 7f4a9ffff700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4aa00cb8d0 con 0x7f4aa01596a0 2023-10-06T01:25:35.904 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:35.900+0000 7f4a9effd700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f4aa01592d0 0x7f4aa00ce320 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:41330/0 (socket says 172.21.15.50:41330) 2023-10-06T01:25:35.904 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:35.900+0000 7f4a9effd700 1 -- 172.21.15.50:0/811598458 learned_addr learned my addr 172.21.15.50:0/811598458 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-10-06T01:25:35.904 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:35.900+0000 7f4a9e7fc700 1 --2- 172.21.15.50:0/811598458 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4aa01596a0 0x7f4aa00aee90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:25:35.904 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:35.900+0000 7f4a9dffb700 1 -- 172.21.15.50:0/811598458 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1089652468 0 0) 0x7f4aa00cb310 con 0x7f4aa01592d0 2023-10-06T01:25:35.904 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:35.900+0000 7f4a9dffb700 1 -- 172.21.15.50:0/811598458 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4a88003570 con 0x7f4aa01592d0 2023-10-06T01:25:35.904 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:35.900+0000 7f4a9dffb700 1 -- 172.21.15.50:0/811598458 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3429598204 0 0) 0x7f4aa00cb5f0 con 0x7f4aa00ca930 2023-10-06T01:25:35.904 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:35.900+0000 7f4a9dffb700 1 -- 172.21.15.50:0/811598458 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4aa00cb310 con 0x7f4aa00ca930 2023-10-06T01:25:35.904 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:35.900+0000 7f4a9dffb700 1 -- 172.21.15.50:0/811598458 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2814067864 0 0) 0x7f4a88003570 con 0x7f4aa01592d0 2023-10-06T01:25:35.904 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:35.900+0000 7f4a9dffb700 1 -- 172.21.15.50:0/811598458 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4aa01596a0 msgr2=0x7f4aa00aee90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:25:35.904 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:35.900+0000 7f4a9dffb700 1 --2- 172.21.15.50:0/811598458 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4aa01596a0 0x7f4aa00aee90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:25:35.904 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:35.900+0000 7f4a9dffb700 1 -- 172.21.15.50:0/811598458 >> v1:172.21.15.155:6789/0 conn(0x7f4aa00ca930 legacy=0x7f4aa015d3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:25:35.905 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:35.900+0000 7f4a9dffb700 1 -- 172.21.15.50:0/811598458 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4aa00caea0 con 0x7f4aa01592d0 2023-10-06T01:25:35.905 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:35.900+0000 7f4a9dffb700 1 -- 172.21.15.50:0/811598458 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 347519148 0 0) 0x7f4a90001470 con 0x7f4aa01592d0 2023-10-06T01:25:35.905 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:35.900+0000 7f4a9dffb700 1 -- 172.21.15.50:0/811598458 >> v1:172.21.15.50:6789/0 conn(0x7f4aa01592d0 legacy=0x7f4aa00ce320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:25:35.905 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:35.901+0000 7f4a9dffb700 1 --2- 172.21.15.50:0/811598458 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4a88003c20 0x7f4a88004010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:25:35.905 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:35.901+0000 7f4a9dffb700 1 --2- 172.21.15.50:0/811598458 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4a88004810 0x7f4a88004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:25:35.905 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:35.901+0000 7f4a9dffb700 1 --2- 172.21.15.50:0/811598458 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4a880051c0 0x7f4a8800ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:25:35.905 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:35.901+0000 7f4a9dffb700 1 -- 172.21.15.50:0/811598458 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4aa00cb8d0 con 0x7f4a880051c0 2023-10-06T01:25:35.905 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:35.901+0000 7f4a9dffb700 1 -- 172.21.15.50:0/811598458 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a8800c020 con 0x7f4a88003c20 2023-10-06T01:25:35.905 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:35.901+0000 7f4a9dffb700 1 -- 172.21.15.50:0/811598458 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a8800c1e0 con 0x7f4a88004810 2023-10-06T01:25:35.905 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:35.901+0000 7f4a9e7fc700 1 --2- 172.21.15.50:0/811598458 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4aa01596a0 0x7f4aa00aee90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T01:25:35.905 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:35.901+0000 7f4a9f7fe700 1 --2- 172.21.15.50:0/811598458 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4a880051c0 0x7f4a8800ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:25:35.905 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:35.901+0000 7f4a9effd700 1 --2- 172.21.15.50:0/811598458 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4a88003c20 0x7f4a88004010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:25:35.906 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:35.901+0000 7f4a9e7fc700 1 --2- 172.21.15.50:0/811598458 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4a88004810 0x7f4a88004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:25:35.906 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:35.901+0000 7f4a9f7fe700 1 -- 172.21.15.50:0/811598458 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4a88004810 msgr2=0x7f4a88004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:25:35.906 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:35.901+0000 7f4a9f7fe700 1 --2- 172.21.15.50:0/811598458 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4a88004810 0x7f4a88004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:25:35.906 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:35.901+0000 7f4a9f7fe700 1 -- 172.21.15.50:0/811598458 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4a88003c20 msgr2=0x7f4a88004010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:25:35.906 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:35.901+0000 7f4a9f7fe700 1 --2- 172.21.15.50:0/811598458 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4a88003c20 0x7f4a88004010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:25:35.906 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:35.901+0000 7f4a9f7fe700 1 -- 172.21.15.50:0/811598458 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a88003570 con 0x7f4a880051c0 2023-10-06T01:25:35.906 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:35.901+0000 7f4a9f7fe700 1 --2- 172.21.15.50:0/811598458 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4a880051c0 0x7f4a8800ba60 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f4a98002120 tx=0x7f4a980017a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=90a297f682c570a8 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:25:35.906 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:35.902+0000 7f4a9dffb700 1 -- 172.21.15.50:0/811598458 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a98001ab0 con 0x7f4a880051c0 2023-10-06T01:25:35.906 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:35.902+0000 7f4a9dffb700 1 -- 172.21.15.50:0/811598458 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a9800c980 con 0x7f4a880051c0 2023-10-06T01:25:35.906 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:35.902+0000 7f4a9dffb700 1 -- 172.21.15.50:0/811598458 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a9800cd20 con 0x7f4a880051c0 2023-10-06T01:25:35.906 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:35.902+0000 7f4a9ffff700 1 -- 172.21.15.50:0/811598458 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4a880051c0 msgr2=0x7f4a8800ba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:25:35.907 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:35.902+0000 7f4a9ffff700 1 --2- 172.21.15.50:0/811598458 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4a880051c0 0x7f4a8800ba60 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f4a98002120 tx=0x7f4a980017a0 comp rx=0 tx=0).stop 2023-10-06T01:25:35.907 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:35.902+0000 7f4a9f7fe700 1 -- 172.21.15.50:0/811598458 reap_dead start 2023-10-06T01:25:35.907 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:35.902+0000 7f4a9ffff700 1 -- 172.21.15.50:0/811598458 shutdown_connections 2023-10-06T01:25:35.907 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:35.902+0000 7f4a9ffff700 1 -- 172.21.15.50:0/811598458 >> 172.21.15.50:0/811598458 conn(0x7f4aa0068130 msgr2=0x7f4aa0068530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:25:35.907 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:35.902+0000 7f4a9ffff700 1 -- 172.21.15.50:0/811598458 shutdown_connections 2023-10-06T01:25:35.907 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:35.902+0000 7f4a9ffff700 1 -- 172.21.15.50:0/811598458 wait complete. 2023-10-06T01:25:35.909 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:35.904+0000 7f4a9ffff700 1 Processor -- start 2023-10-06T01:25:35.909 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:35.904+0000 7f4a9ffff700 1 -- start start 2023-10-06T01:25:35.910 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:35.905+0000 7f4a9ffff700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4a880051c0 0x7f4aa00c8370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:25:35.910 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:35.905+0000 7f4a9ffff700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4aa00c9a60 0x7f4aa015fdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:25:35.910 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:35.905+0000 7f4a9ffff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4aa0144480 0x7f4aa015d2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:25:35.910 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:35.905+0000 7f4a9ffff700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4aa00c95d0 con 0x7f4aa0144480 2023-10-06T01:25:35.910 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:35.905+0000 7f4a9ffff700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4aa00c89c0 con 0x7f4a880051c0 2023-10-06T01:25:35.910 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:35.905+0000 7f4a9ffff700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4aa00c8ca0 con 0x7f4aa00c9a60 2023-10-06T01:25:35.910 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:35.905+0000 7f4a9f7fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4aa0144480 0x7f4aa015d2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:25:35.910 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:35.905+0000 7f4a9effd700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4a880051c0 0x7f4aa00c8370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:25:35.910 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:35.905+0000 7f4a9e7fc700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4aa00c9a60 0x7f4aa015fdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:25:35.910 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:35.905+0000 7f4a9f7fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4aa0144480 0x7f4aa015d2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:33710/0 (socket says 172.21.15.50:33710) 2023-10-06T01:25:35.910 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:35.905+0000 7f4a9f7fe700 1 -- 172.21.15.50:0/2830929148 learned_addr learned my addr 172.21.15.50:0/2830929148 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-06T01:25:35.911 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:35.905+0000 7f4a9effd700 1 --2- 172.21.15.50:0/2830929148 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4a880051c0 0x7f4aa00c8370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.50:47186/0 (socket says 172.21.15.50:47186) 2023-10-06T01:25:35.911 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:35.906+0000 7f4a9f7fe700 1 -- 172.21.15.50:0/2830929148 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4aa00c9a60 msgr2=0x7f4aa015fdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:25:35.911 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:35.906+0000 7f4a9f7fe700 1 --2- 172.21.15.50:0/2830929148 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4aa00c9a60 0x7f4aa015fdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:25:35.911 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:35.906+0000 7f4a9f7fe700 1 -- 172.21.15.50:0/2830929148 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4a880051c0 msgr2=0x7f4aa00c8370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:25:35.911 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:35.906+0000 7f4a9f7fe700 1 --2- 172.21.15.50:0/2830929148 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4a880051c0 0x7f4aa00c8370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:25:35.911 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:35.906+0000 7f4a9f7fe700 1 -- 172.21.15.50:0/2830929148 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4aa00c8f80 con 0x7f4aa0144480 2023-10-06T01:25:35.911 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:35.906+0000 7f4a9f7fe700 1 --2- 172.21.15.50:0/2830929148 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4aa0144480 0x7f4aa015d2f0 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f4a8800bff0 tx=0x7f4a98016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:25:35.912 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:35.906+0000 7f4a86ffd700 1 -- 172.21.15.50:0/2830929148 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a98012e90 con 0x7f4aa0144480 2023-10-06T01:25:35.912 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:35.906+0000 7f4a86ffd700 1 -- 172.21.15.50:0/2830929148 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a9800c6d0 con 0x7f4aa0144480 2023-10-06T01:25:35.912 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:35.906+0000 7f4a9ffff700 1 -- 172.21.15.50:0/2830929148 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4aa00c9260 con 0x7f4aa0144480 2023-10-06T01:25:35.912 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:35.906+0000 7f4a86ffd700 1 -- 172.21.15.50:0/2830929148 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a980011c0 con 0x7f4aa0144480 2023-10-06T01:25:35.912 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:35.906+0000 7f4a9ffff700 1 -- 172.21.15.50:0/2830929148 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4aa01448f0 con 0x7f4aa0144480 2023-10-06T01:25:35.912 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:35.907+0000 7f4a9ffff700 1 -- 172.21.15.50:0/2830929148 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4aa00c9740 con 0x7f4aa0144480 2023-10-06T01:25:35.912 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:35.908+0000 7f4a86ffd700 1 -- 172.21.15.50:0/2830929148 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f4a98025020 con 0x7f4aa0144480 2023-10-06T01:25:35.913 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:35.909+0000 7f4a86ffd700 1 --2- 172.21.15.50:0/2830929148 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f4a8c066f30 0x7f4a8c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:25:35.913 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:35.909+0000 7f4a86ffd700 1 -- 172.21.15.50:0/2830929148 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5612+0+0 (secure 0 0 0) 0x7f4a98086610 con 0x7f4aa0144480 2023-10-06T01:25:35.913 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:35.910+0000 7f4a9effd700 1 --2- 172.21.15.50:0/2830929148 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f4a8c066f30 0x7f4a8c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:25:35.913 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:35.910+0000 7f4a9effd700 1 --2- 172.21.15.50:0/2830929148 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f4a8c066f30 0x7f4a8c0693e0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f4a90001200 tx=0x7f4a90001df0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:25:35.914 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:35.913+0000 7f4a86ffd700 1 -- 172.21.15.50:0/2830929148 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4a98053900 con 0x7f4aa0144480 2023-10-06T01:25:36.119 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:36.118+0000 7f4a9ffff700 1 -- 172.21.15.50:0/2830929148 --> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) v1 -- 0x7f4aa0144bd0 con 0x7f4a8c066f30 2023-10-06T01:25:36.120 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:36.119+0000 7f4a86ffd700 1 -- 172.21.15.50:0/2830929148 <== mgr.4099 v2:172.21.15.155:6832/85215 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f4aa0144bd0 con 0x7f4a8c066f30 2023-10-06T01:25:36.122 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:36.121+0000 7f4a9ffff700 1 -- 172.21.15.50:0/2830929148 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f4a8c066f30 msgr2=0x7f4a8c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:25:36.123 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:36.121+0000 7f4a9ffff700 1 --2- 172.21.15.50:0/2830929148 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f4a8c066f30 0x7f4a8c0693e0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f4a90001200 tx=0x7f4a90001df0 comp rx=0 tx=0).stop 2023-10-06T01:25:36.123 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:36.121+0000 7f4a9ffff700 1 -- 172.21.15.50:0/2830929148 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4aa0144480 msgr2=0x7f4aa015d2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:25:36.123 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:36.121+0000 7f4a9ffff700 1 --2- 172.21.15.50:0/2830929148 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4aa0144480 0x7f4aa015d2f0 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f4a8800bff0 tx=0x7f4a98016000 comp rx=0 tx=0).stop 2023-10-06T01:25:36.123 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:36.122+0000 7f4a9ffff700 1 -- 172.21.15.50:0/2830929148 shutdown_connections 2023-10-06T01:25:36.123 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:36.122+0000 7f4a9ffff700 1 --2- 172.21.15.50:0/2830929148 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4aa0144480 0x7f4aa015d2f0 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:25:36.123 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:36.122+0000 7f4a9ffff700 1 --2- 172.21.15.50:0/2830929148 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f4a8c066f30 0x7f4a8c0693e0 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:25:36.123 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:36.122+0000 7f4a9ffff700 1 --2- 172.21.15.50:0/2830929148 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4a880051c0 0x7f4aa00c8370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:25:36.123 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:36.122+0000 7f4a9ffff700 1 --2- 172.21.15.50:0/2830929148 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4aa00c9a60 0x7f4aa015fdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:25:36.123 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:36.122+0000 7f4a9ffff700 1 -- 172.21.15.50:0/2830929148 >> 172.21.15.50:0/2830929148 conn(0x7f4aa0068130 msgr2=0x7f4aa00c63e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:25:36.124 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:36.122+0000 7f4a9ffff700 1 -- 172.21.15.50:0/2830929148 shutdown_connections 2023-10-06T01:25:36.124 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:36.122+0000 7f4a9ffff700 1 -- 172.21.15.50:0/2830929148 wait complete. 2023-10-06T01:25:36.124 INFO:teuthology.orchestra.run.smithi050.stderr:instructed osd(s) 2 to deep-scrub 2023-10-06T01:25:36.140 INFO:tasks.ceph:Scrubbing osd.3 2023-10-06T01:25:36.140 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2023-10-06T01:25:36.331 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:36.330+0000 7f3fa919d700 1 Processor -- start 2023-10-06T01:25:36.331 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:36.330+0000 7f3fa919d700 1 -- start start 2023-10-06T01:25:36.333 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:36.331+0000 7f3fa919d700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3fa40cb6c0 0x7f3fa4157010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:25:36.333 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:36.332+0000 7f3fa919d700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f3fa406f110 0x7f3fa40ade80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:25:36.333 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:36.332+0000 7f3fa919d700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3fa4156e50 con 0x7f3fa40cba90 2023-10-06T01:25:36.333 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:36.332+0000 7f3fa919d700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3fa4156b70 con 0x7f3fa406f110 2023-10-06T01:25:36.334 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:36.332+0000 7f3fa919d700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3fa40ad3a0 con 0x7f3fa40cb6c0 2023-10-06T01:25:36.334 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:36.332+0000 7f3fa899c700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f3fa406f110 0x7f3fa40ade80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:25:36.334 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:36.332+0000 7f3fa899c700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f3fa406f110 0x7f3fa40ade80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:33718/0 (socket says 172.21.15.50:33718) 2023-10-06T01:25:36.334 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:36.332+0000 7f3fa899c700 1 -- 172.21.15.50:0/426145383 learned_addr learned my addr 172.21.15.50:0/426145383 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-06T01:25:36.334 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:36.332+0000 7f3fa3fff700 1 --2- 172.21.15.50:0/426145383 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3fa40cb6c0 0x7f3fa4157010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:25:36.334 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:36.332+0000 7f3fa899c700 1 -- 172.21.15.50:0/426145383 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3fa40cb6c0 msgr2=0x7f3fa4157010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:25:36.334 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:36.332+0000 7f3fa899c700 1 --2- 172.21.15.50:0/426145383 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3fa40cb6c0 0x7f3fa4157010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:25:36.334 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:36.332+0000 7f3fa899c700 1 -- 172.21.15.50:0/426145383 >> v1:172.21.15.155:6789/0 conn(0x7f3fa40cba90 legacy=0x7f3fa406ea00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:25:36.334 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:36.332+0000 7f3fa899c700 1 -- 172.21.15.50:0/426145383 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3fa40ad680 con 0x7f3fa406f110 2023-10-06T01:25:36.334 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:36.332+0000 7f3fa3fff700 1 --2- 172.21.15.50:0/426145383 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3fa40cb6c0 0x7f3fa4157010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T01:25:36.334 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:36.333+0000 7f3fa899c700 1 --2- 172.21.15.50:0/426145383 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3fa406f110 0x7f3fa40ade80 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f3f9c00afb0 tx=0x7f3f9c00a950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8085d80d24416a22 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:25:36.336 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:36.333+0000 7f3fa2ffd700 1 -- 172.21.15.50:0/426145383 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f9c00a2e0 con 0x7f3fa406f110 2023-10-06T01:25:36.336 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:36.333+0000 7f3fa2ffd700 1 -- 172.21.15.50:0/426145383 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f9c00cb50 con 0x7f3fa406f110 2023-10-06T01:25:36.336 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:36.333+0000 7f3fa2ffd700 1 -- 172.21.15.50:0/426145383 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f9c008510 con 0x7f3fa406f110 2023-10-06T01:25:36.336 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:36.333+0000 7f3fa919d700 1 -- 172.21.15.50:0/426145383 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3fa406f110 msgr2=0x7f3fa40ade80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:25:36.336 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:36.333+0000 7f3fa919d700 1 --2- 172.21.15.50:0/426145383 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3fa406f110 0x7f3fa40ade80 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f3f9c00afb0 tx=0x7f3f9c00a950 comp rx=0 tx=0).stop 2023-10-06T01:25:36.336 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:36.333+0000 7f3fa919d700 1 -- 172.21.15.50:0/426145383 shutdown_connections 2023-10-06T01:25:36.336 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:36.333+0000 7f3fa919d700 1 --2- 172.21.15.50:0/426145383 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3fa406f110 0x7f3fa40ade80 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:25:36.336 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:36.334+0000 7f3fa919d700 1 --2- 172.21.15.50:0/426145383 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3fa40cb6c0 0x7f3fa4157010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:25:36.336 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:36.334+0000 7f3fa919d700 1 -- 172.21.15.50:0/426145383 >> 172.21.15.50:0/426145383 conn(0x7f3fa40cbee0 msgr2=0x7f3fa40cc2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:25:36.336 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:36.334+0000 7f3fa919d700 1 -- 172.21.15.50:0/426145383 shutdown_connections 2023-10-06T01:25:36.337 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:36.334+0000 7f3fa919d700 1 -- 172.21.15.50:0/426145383 wait complete. 2023-10-06T01:25:36.337 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:36.335+0000 7f3fa919d700 1 Processor -- start 2023-10-06T01:25:36.337 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:36.335+0000 7f3fa919d700 1 -- start start 2023-10-06T01:25:36.339 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:36.336+0000 7f3fa919d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3fa406f110 0x7f3fa4148e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:25:36.339 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:36.336+0000 7f3fa919d700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3fa40cb6c0 0x7f3fa40add80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:25:36.339 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:36.336+0000 7f3fa919d700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3fa40cba90 0x7f3fa40ae2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:25:36.339 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:36.336+0000 7f3fa919d700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3fa4169900 con 0x7f3fa406f110 2023-10-06T01:25:36.339 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:36.336+0000 7f3fa919d700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3fa4168c80 con 0x7f3fa40cb6c0 2023-10-06T01:25:36.339 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:36.336+0000 7f3fa919d700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3fa4168f60 con 0x7f3fa40cba90 2023-10-06T01:25:36.340 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:36.336+0000 7f3fa3fff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3fa406f110 0x7f3fa4148e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:25:36.340 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:36.336+0000 7f3fa3fff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3fa406f110 0x7f3fa4148e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:33730/0 (socket says 172.21.15.50:33730) 2023-10-06T01:25:36.340 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:36.336+0000 7f3fa3fff700 1 -- 172.21.15.50:0/3778684567 learned_addr learned my addr 172.21.15.50:0/3778684567 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-06T01:25:36.340 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:36.336+0000 7f3fa37fe700 1 --2- 172.21.15.50:0/3778684567 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3fa40cb6c0 0x7f3fa40add80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:25:36.340 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:36.336+0000 7f3fa899c700 1 --2- 172.21.15.50:0/3778684567 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3fa40cba90 0x7f3fa40ae2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:25:36.340 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:36.337+0000 7f3fa3fff700 1 -- 172.21.15.50:0/3778684567 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3fa40cba90 msgr2=0x7f3fa40ae2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:25:36.340 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:36.337+0000 7f3fa3fff700 1 --2- 172.21.15.50:0/3778684567 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3fa40cba90 0x7f3fa40ae2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:25:36.340 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:36.337+0000 7f3fa3fff700 1 -- 172.21.15.50:0/3778684567 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3fa40cb6c0 msgr2=0x7f3fa40add80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:25:36.340 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:36.337+0000 7f3fa3fff700 1 --2- 172.21.15.50:0/3778684567 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3fa40cb6c0 0x7f3fa40add80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:25:36.340 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:36.337+0000 7f3fa3fff700 1 -- 172.21.15.50:0/3778684567 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f9c00abf0 con 0x7f3fa406f110 2023-10-06T01:25:36.340 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:36.337+0000 7f3fa37fe700 1 --2- 172.21.15.50:0/3778684567 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3fa40cb6c0 0x7f3fa40add80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T01:25:36.340 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:36.337+0000 7f3fa3fff700 1 --2- 172.21.15.50:0/3778684567 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3fa406f110 0x7f3fa4148e00 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f3f9400e8d0 tx=0x7f3f94008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:25:36.341 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:36.337+0000 7f3f8bfff700 1 -- 172.21.15.50:0/3778684567 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f9400ee70 con 0x7f3fa406f110 2023-10-06T01:25:36.341 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:36.337+0000 7f3f8bfff700 1 -- 172.21.15.50:0/3778684567 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f9400c5e0 con 0x7f3fa406f110 2023-10-06T01:25:36.341 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:36.337+0000 7f3f8bfff700 1 -- 172.21.15.50:0/3778684567 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f9400c980 con 0x7f3fa406f110 2023-10-06T01:25:36.341 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:36.337+0000 7f3fa919d700 1 -- 172.21.15.50:0/3778684567 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3fa4169240 con 0x7f3fa406f110 2023-10-06T01:25:36.341 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:36.337+0000 7f3fa919d700 1 -- 172.21.15.50:0/3778684567 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3fa41484e0 con 0x7f3fa406f110 2023-10-06T01:25:36.341 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:36.338+0000 7f3fa919d700 1 -- 172.21.15.50:0/3778684567 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f3fa405f270 con 0x7f3fa406f110 2023-10-06T01:25:36.342 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:36.339+0000 7f3f8bfff700 1 -- 172.21.15.50:0/3778684567 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f3f94013410 con 0x7f3fa406f110 2023-10-06T01:25:36.342 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:36.340+0000 7f3f8bfff700 1 --2- 172.21.15.50:0/3778684567 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f3f90066f30 0x7f3f900693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:25:36.342 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:36.340+0000 7f3f8bfff700 1 -- 172.21.15.50:0/3778684567 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5612+0+0 (secure 0 0 0) 0x7f3f94084360 con 0x7f3fa406f110 2023-10-06T01:25:36.342 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:36.340+0000 7f3f8bfff700 1 --2- 172.21.15.50:0/3778684567 >> [v2:172.21.15.50:6816/87856,v1:172.21.15.50:6817/87856] conn(0x7f3f9006d850 0x7f3f9006fca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:25:36.342 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:36.340+0000 7f3f8bfff700 1 -- 172.21.15.50:0/3778684567 --> [v2:172.21.15.50:6816/87856,v1:172.21.15.50:6817/87856] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f3f90070370 con 0x7f3f9006d850 2023-10-06T01:25:36.342 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:36.340+0000 7f3f8bfff700 1 -- 172.21.15.50:0/3778684567 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_get_version_reply(handle=1 version=44) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3f94086860 con 0x7f3fa406f110 2023-10-06T01:25:36.343 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:36.341+0000 7f3fa899c700 1 --2- 172.21.15.50:0/3778684567 >> [v2:172.21.15.50:6816/87856,v1:172.21.15.50:6817/87856] conn(0x7f3f9006d850 0x7f3f9006fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:25:36.343 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:36.341+0000 7f3fa37fe700 1 --2- 172.21.15.50:0/3778684567 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f3f90066f30 0x7f3f900693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:25:36.343 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:36.341+0000 7f3fa899c700 1 --2- 172.21.15.50:0/3778684567 >> [v2:172.21.15.50:6816/87856,v1:172.21.15.50:6817/87856] conn(0x7f3f9006d850 0x7f3f9006fca0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:25:36.343 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:36.341+0000 7f3fa37fe700 1 --2- 172.21.15.50:0/3778684567 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f3f90066f30 0x7f3f900693e0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f3f98007fd0 tx=0x7f3f98009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:25:36.343 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:36.342+0000 7f3f8bfff700 1 -- 172.21.15.50:0/3778684567 <== osd.3 v2:172.21.15.50:6816/87856 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7f3f90070370 con 0x7f3f9006d850 2023-10-06T01:25:36.357 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:36.357+0000 7f3fa919d700 1 -- 172.21.15.50:0/3778684567 --> [v2:172.21.15.50:6816/87856,v1:172.21.15.50:6817/87856] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f3fa41696e0 con 0x7f3f9006d850 2023-10-06T01:25:36.358 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:36.357+0000 7f3f8bfff700 1 -- 172.21.15.50:0/3778684567 <== osd.3 v2:172.21.15.50:6816/87856 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f3fa41696e0 con 0x7f3f9006d850 2023-10-06T01:25:36.358 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2023-10-06T01:25:36.358 INFO:teuthology.orchestra.run.smithi050.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-10-06T01:25:36.358 INFO:teuthology.orchestra.run.smithi050.stdout:} 2023-10-06T01:25:36.359 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:36.357+0000 7f3fa919d700 1 -- 172.21.15.50:0/3778684567 >> [v2:172.21.15.50:6816/87856,v1:172.21.15.50:6817/87856] conn(0x7f3f9006d850 msgr2=0x7f3f9006fca0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:25:36.359 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:36.357+0000 7f3fa919d700 1 --2- 172.21.15.50:0/3778684567 >> [v2:172.21.15.50:6816/87856,v1:172.21.15.50:6817/87856] conn(0x7f3f9006d850 0x7f3f9006fca0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:25:36.359 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:36.357+0000 7f3fa919d700 1 -- 172.21.15.50:0/3778684567 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f3f90066f30 msgr2=0x7f3f900693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:25:36.359 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:36.357+0000 7f3fa919d700 1 --2- 172.21.15.50:0/3778684567 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f3f90066f30 0x7f3f900693e0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f3f98007fd0 tx=0x7f3f98009040 comp rx=0 tx=0).stop 2023-10-06T01:25:36.359 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:36.357+0000 7f3fa919d700 1 -- 172.21.15.50:0/3778684567 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3fa406f110 msgr2=0x7f3fa4148e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:25:36.359 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:36.357+0000 7f3fa919d700 1 --2- 172.21.15.50:0/3778684567 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3fa406f110 0x7f3fa4148e00 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f3f9400e8d0 tx=0x7f3f94008040 comp rx=0 tx=0).stop 2023-10-06T01:25:36.360 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:36.357+0000 7f3fa899c700 1 -- 172.21.15.50:0/3778684567 reap_dead start 2023-10-06T01:25:36.360 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:36.358+0000 7f3fa919d700 1 -- 172.21.15.50:0/3778684567 shutdown_connections 2023-10-06T01:25:36.360 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:36.358+0000 7f3fa919d700 1 -- 172.21.15.50:0/3778684567 >> 172.21.15.50:0/3778684567 conn(0x7f3fa40cbee0 msgr2=0x7f3fa414f9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:25:36.360 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:36.358+0000 7f3fa919d700 1 -- 172.21.15.50:0/3778684567 shutdown_connections 2023-10-06T01:25:36.360 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:36.358+0000 7f3fa919d700 1 -- 172.21.15.50:0/3778684567 wait complete. 2023-10-06T01:25:36.375 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2023-10-06T01:25:36.564 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:36.563+0000 7fa4d9d9d700 1 Processor -- start 2023-10-06T01:25:36.564 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:36.563+0000 7fa4d9d9d700 1 -- start start 2023-10-06T01:25:36.565 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:36.564+0000 7fa4d9d9d700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fa4d4159360 0x7fa4d40cc0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:25:36.565 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:36.564+0000 7fa4d9d9d700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa4d40c1730 con 0x7fa4d415cff0 2023-10-06T01:25:36.565 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:36.564+0000 7fa4d9d9d700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa4d40c2590 con 0x7fa4d415dba0 2023-10-06T01:25:36.565 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:36.564+0000 7fa4d9d9d700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa4d40c1980 con 0x7fa4d4159360 2023-10-06T01:25:36.565 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:36.564+0000 7fa4d3fff700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fa4d415cff0 0x7fa4d415d490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:41346/0 (socket says 172.21.15.50:41346) 2023-10-06T01:25:36.566 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:36.565+0000 7fa4d3fff700 1 -- 172.21.15.50:0/1407794820 learned_addr learned my addr 172.21.15.50:0/1407794820 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-10-06T01:25:36.568 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:36.565+0000 7fa4d8d9b700 1 --2- 172.21.15.50:0/1407794820 >> v2:172.21.15.155:3300/0 conn(0x7fa4d4159360 0x7fa4d40cc0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:25:36.568 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:36.565+0000 7fa4d37fe700 1 -- 172.21.15.50:0/1407794820 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3445877716 0 0) 0x7fa4d40c1730 con 0x7fa4d415cff0 2023-10-06T01:25:36.569 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:36.565+0000 7fa4d37fe700 1 -- 172.21.15.50:0/1407794820 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa4c4003570 con 0x7fa4d415cff0 2023-10-06T01:25:36.569 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:36.565+0000 7fa4d37fe700 1 -- 172.21.15.50:0/1407794820 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 829968657 0 0) 0x7fa4c4003570 con 0x7fa4d415cff0 2023-10-06T01:25:36.569 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:36.565+0000 7fa4d37fe700 1 -- 172.21.15.50:0/1407794820 >> v2:172.21.15.155:3300/0 conn(0x7fa4d4159360 msgr2=0x7fa4d40cc0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:25:36.569 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:36.565+0000 7fa4d37fe700 1 --2- 172.21.15.50:0/1407794820 >> v2:172.21.15.155:3300/0 conn(0x7fa4d4159360 0x7fa4d40cc0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:25:36.569 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:36.565+0000 7fa4d37fe700 1 -- 172.21.15.50:0/1407794820 >> v1:172.21.15.155:6789/0 conn(0x7fa4d415dba0 legacy=0x7fa4d40675f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:25:36.569 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:36.565+0000 7fa4d37fe700 1 -- 172.21.15.50:0/1407794820 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4d40c1c60 con 0x7fa4d415cff0 2023-10-06T01:25:36.569 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:36.565+0000 7fa4d37fe700 1 -- 172.21.15.50:0/1407794820 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 347519148 0 0) 0x7fa4c0001470 con 0x7fa4d415cff0 2023-10-06T01:25:36.569 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:36.565+0000 7fa4d37fe700 1 -- 172.21.15.50:0/1407794820 >> v1:172.21.15.50:6789/0 conn(0x7fa4d415cff0 legacy=0x7fa4d415d490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:25:36.569 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:36.565+0000 7fa4d37fe700 1 --2- 172.21.15.50:0/1407794820 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa4c4003a60 0x7fa4c4003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:25:36.569 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:36.565+0000 7fa4d37fe700 1 --2- 172.21.15.50:0/1407794820 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa4c4004810 0x7fa4c4004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:25:36.569 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:36.565+0000 7fa4d37fe700 1 --2- 172.21.15.50:0/1407794820 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa4c40051c0 0x7fa4c400ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:25:36.569 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:36.566+0000 7fa4d37fe700 1 -- 172.21.15.50:0/1407794820 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4d40c1980 con 0x7fa4c4004810 2023-10-06T01:25:36.570 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:36.566+0000 7fa4d37fe700 1 -- 172.21.15.50:0/1407794820 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4c400c050 con 0x7fa4c4003a60 2023-10-06T01:25:36.570 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:36.566+0000 7fa4d37fe700 1 -- 172.21.15.50:0/1407794820 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4c400c210 con 0x7fa4c40051c0 2023-10-06T01:25:36.570 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:36.566+0000 7fa4d3fff700 1 --2- 172.21.15.50:0/1407794820 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa4c4004810 0x7fa4c4004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:25:36.570 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:36.566+0000 7fa4d8d9b700 1 --2- 172.21.15.50:0/1407794820 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa4c4003a60 0x7fa4c4003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:25:36.570 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:36.566+0000 7fa4d959c700 1 --2- 172.21.15.50:0/1407794820 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa4c40051c0 0x7fa4c400ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:25:36.570 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:36.566+0000 7fa4d3fff700 1 -- 172.21.15.50:0/1407794820 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa4c40051c0 msgr2=0x7fa4c400ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:25:36.570 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:36.566+0000 7fa4d3fff700 1 --2- 172.21.15.50:0/1407794820 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa4c40051c0 0x7fa4c400ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:25:36.570 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:36.566+0000 7fa4d3fff700 1 -- 172.21.15.50:0/1407794820 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa4c4003a60 msgr2=0x7fa4c4003e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:25:36.570 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:36.566+0000 7fa4d3fff700 1 --2- 172.21.15.50:0/1407794820 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa4c4003a60 0x7fa4c4003e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:25:36.570 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:36.566+0000 7fa4d3fff700 1 -- 172.21.15.50:0/1407794820 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4c4003570 con 0x7fa4c4004810 2023-10-06T01:25:36.570 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:36.566+0000 7fa4d959c700 1 -- 172.21.15.50:0/1407794820 reap_dead start 2023-10-06T01:25:36.571 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:36.566+0000 7fa4d3fff700 1 --2- 172.21.15.50:0/1407794820 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa4c4004810 0x7fa4c4004c80 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7fa4c000c2d0 tx=0x7fa4c0001df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a97769e917bb1d5 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:25:36.571 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:36.567+0000 7fa4d37fe700 1 -- 172.21.15.50:0/1407794820 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4c000cbc0 con 0x7fa4c4004810 2023-10-06T01:25:36.571 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:36.567+0000 7fa4d37fe700 1 -- 172.21.15.50:0/1407794820 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4c000cd20 con 0x7fa4c4004810 2023-10-06T01:25:36.571 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:36.567+0000 7fa4d37fe700 1 -- 172.21.15.50:0/1407794820 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4c0005b70 con 0x7fa4c4004810 2023-10-06T01:25:36.571 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:36.567+0000 7fa4d9d9d700 1 -- 172.21.15.50:0/1407794820 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa4c4004810 msgr2=0x7fa4c4004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:25:36.571 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:36.567+0000 7fa4d9d9d700 1 --2- 172.21.15.50:0/1407794820 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa4c4004810 0x7fa4c4004c80 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7fa4c000c2d0 tx=0x7fa4c0001df0 comp rx=0 tx=0).stop 2023-10-06T01:25:36.571 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:36.567+0000 7fa4d9d9d700 1 -- 172.21.15.50:0/1407794820 shutdown_connections 2023-10-06T01:25:36.571 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:36.567+0000 7fa4d9d9d700 1 --2- 172.21.15.50:0/1407794820 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa4c4004810 0x7fa4c4004c80 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:25:36.571 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:36.567+0000 7fa4d9d9d700 1 -- 172.21.15.50:0/1407794820 >> 172.21.15.50:0/1407794820 conn(0x7fa4d40c91e0 msgr2=0x7fa4d40c95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:25:36.571 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:36.567+0000 7fa4d9d9d700 1 -- 172.21.15.50:0/1407794820 shutdown_connections 2023-10-06T01:25:36.571 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:36.567+0000 7fa4d9d9d700 1 -- 172.21.15.50:0/1407794820 wait complete. 2023-10-06T01:25:36.573 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:36.569+0000 7fa4d9d9d700 1 Processor -- start 2023-10-06T01:25:36.573 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:36.569+0000 7fa4d9d9d700 1 -- start start 2023-10-06T01:25:36.573 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:36.570+0000 7fa4d9d9d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa4c4004810 0x7fa4d40abc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:25:36.574 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:36.570+0000 7fa4d9d9d700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa4d416a310 0x7fa4d41482c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:25:36.574 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:36.570+0000 7fa4d9d9d700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa4d40675f0 0x7fa4d4067a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:25:36.574 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:36.570+0000 7fa4d9d9d700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4d40acfd0 con 0x7fa4c4004810 2023-10-06T01:25:36.574 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:36.570+0000 7fa4d9d9d700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4d4148800 con 0x7fa4d40675f0 2023-10-06T01:25:36.574 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:36.570+0000 7fa4d9d9d700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4d4067fa0 con 0x7fa4d416a310 2023-10-06T01:25:36.574 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:36.570+0000 7fa4d8d9b700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa4c4004810 0x7fa4d40abc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:25:36.574 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:36.570+0000 7fa4d8d9b700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa4c4004810 0x7fa4d40abc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:33756/0 (socket says 172.21.15.50:33756) 2023-10-06T01:25:36.574 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:36.570+0000 7fa4d8d9b700 1 -- 172.21.15.50:0/3353928801 learned_addr learned my addr 172.21.15.50:0/3353928801 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-06T01:25:36.574 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:36.570+0000 7fa4d3fff700 1 --2- 172.21.15.50:0/3353928801 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa4d416a310 0x7fa4d41482c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:25:36.574 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:36.570+0000 7fa4d959c700 1 --2- 172.21.15.50:0/3353928801 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa4d40675f0 0x7fa4d4067a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:25:36.574 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:36.570+0000 7fa4d8d9b700 1 -- 172.21.15.50:0/3353928801 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa4d416a310 msgr2=0x7fa4d41482c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:25:36.575 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:36.570+0000 7fa4d8d9b700 1 --2- 172.21.15.50:0/3353928801 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa4d416a310 0x7fa4d41482c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:25:36.575 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:36.570+0000 7fa4d8d9b700 1 -- 172.21.15.50:0/3353928801 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa4d40675f0 msgr2=0x7fa4d4067a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:25:36.575 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:36.570+0000 7fa4d8d9b700 1 --2- 172.21.15.50:0/3353928801 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa4d40675f0 0x7fa4d4067a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:25:36.575 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:36.570+0000 7fa4d8d9b700 1 -- 172.21.15.50:0/3353928801 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4d416a780 con 0x7fa4c4004810 2023-10-06T01:25:36.575 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:36.571+0000 7fa4d8d9b700 1 --2- 172.21.15.50:0/3353928801 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa4c4004810 0x7fa4d40abc50 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7fa4c8011ba0 tx=0x7fa4c80091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:25:36.575 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:36.571+0000 7fa4d0ff9700 1 -- 172.21.15.50:0/3353928801 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4c800fac0 con 0x7fa4c4004810 2023-10-06T01:25:36.575 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:36.571+0000 7fa4d0ff9700 1 -- 172.21.15.50:0/3353928801 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4c800fc20 con 0x7fa4c4004810 2023-10-06T01:25:36.575 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:36.571+0000 7fa4d0ff9700 1 -- 172.21.15.50:0/3353928801 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4c8014440 con 0x7fa4c4004810 2023-10-06T01:25:36.575 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:36.571+0000 7fa4d9d9d700 1 -- 172.21.15.50:0/3353928801 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa4d40ac350 con 0x7fa4c4004810 2023-10-06T01:25:36.575 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:36.571+0000 7fa4d9d9d700 1 -- 172.21.15.50:0/3353928801 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa4d40ac910 con 0x7fa4c4004810 2023-10-06T01:25:36.575 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:36.572+0000 7fa4d9d9d700 1 -- 172.21.15.50:0/3353928801 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa4d405f270 con 0x7fa4c4004810 2023-10-06T01:25:36.576 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:36.573+0000 7fa4d0ff9700 1 -- 172.21.15.50:0/3353928801 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fa4c80147f0 con 0x7fa4c4004810 2023-10-06T01:25:36.576 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:36.574+0000 7fa4d0ff9700 1 --2- 172.21.15.50:0/3353928801 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7fa4b8066f30 0x7fa4b80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:25:36.576 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:36.574+0000 7fa4d0ff9700 1 -- 172.21.15.50:0/3353928801 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5612+0+0 (secure 0 0 0) 0x7fa4c8018030 con 0x7fa4c4004810 2023-10-06T01:25:36.576 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:36.574+0000 7fa4d3fff700 1 --2- 172.21.15.50:0/3353928801 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7fa4b8066f30 0x7fa4b80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:25:36.576 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:36.575+0000 7fa4d3fff700 1 --2- 172.21.15.50:0/3353928801 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7fa4b8066f30 0x7fa4b80693e0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fa4d40abba0 tx=0x7fa4c0015000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:25:36.578 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:36.578+0000 7fa4d0ff9700 1 -- 172.21.15.50:0/3353928801 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fa4c8052320 con 0x7fa4c4004810 2023-10-06T01:25:36.783 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:36.782+0000 7fa4d9d9d700 1 -- 172.21.15.50:0/3353928801 --> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) v1 -- 0x7fa4d40c1f40 con 0x7fa4b8066f30 2023-10-06T01:25:36.783 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:36.783+0000 7fa4d0ff9700 1 -- 172.21.15.50:0/3353928801 <== mgr.4099 v2:172.21.15.155:6832/85215 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fa4d40c1f40 con 0x7fa4b8066f30 2023-10-06T01:25:36.786 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:36.785+0000 7fa4d9d9d700 1 -- 172.21.15.50:0/3353928801 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7fa4b8066f30 msgr2=0x7fa4b80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:25:36.787 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:36.785+0000 7fa4d9d9d700 1 --2- 172.21.15.50:0/3353928801 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7fa4b8066f30 0x7fa4b80693e0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fa4d40abba0 tx=0x7fa4c0015000 comp rx=0 tx=0).stop 2023-10-06T01:25:36.787 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:36.785+0000 7fa4d9d9d700 1 -- 172.21.15.50:0/3353928801 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa4c4004810 msgr2=0x7fa4d40abc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:25:36.787 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:36.785+0000 7fa4d9d9d700 1 --2- 172.21.15.50:0/3353928801 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa4c4004810 0x7fa4d40abc50 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7fa4c8011ba0 tx=0x7fa4c80091a0 comp rx=0 tx=0).stop 2023-10-06T01:25:36.787 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:36.785+0000 7fa4d9d9d700 1 -- 172.21.15.50:0/3353928801 shutdown_connections 2023-10-06T01:25:36.787 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:36.785+0000 7fa4d9d9d700 1 --2- 172.21.15.50:0/3353928801 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7fa4b8066f30 0x7fa4b80693e0 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:25:36.787 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:36.785+0000 7fa4d9d9d700 1 --2- 172.21.15.50:0/3353928801 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa4d40675f0 0x7fa4d4067a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:25:36.787 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:36.785+0000 7fa4d9d9d700 1 --2- 172.21.15.50:0/3353928801 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa4c4004810 0x7fa4d40abc50 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:25:36.787 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:36.785+0000 7fa4d9d9d700 1 --2- 172.21.15.50:0/3353928801 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa4d416a310 0x7fa4d41482c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:25:36.787 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:36.785+0000 7fa4d9d9d700 1 -- 172.21.15.50:0/3353928801 >> 172.21.15.50:0/3353928801 conn(0x7fa4d40c91e0 msgr2=0x7fa4d40c8a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:25:36.788 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:36.785+0000 7fa4d9d9d700 1 -- 172.21.15.50:0/3353928801 shutdown_connections 2023-10-06T01:25:36.788 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:36.785+0000 7fa4d9d9d700 1 -- 172.21.15.50:0/3353928801 wait complete. 2023-10-06T01:25:36.788 INFO:teuthology.orchestra.run.smithi050.stderr:instructed osd(s) 3 to deep-scrub 2023-10-06T01:25:36.804 INFO:tasks.ceph:Scrubbing osd.4 2023-10-06T01:25:36.804 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2023-10-06T01:25:36.999 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:36.998+0000 7f427159d700 1 Processor -- start 2023-10-06T01:25:37.000 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:36.999+0000 7f427159d700 1 -- start start 2023-10-06T01:25:37.001 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:37.000+0000 7f427159d700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f426c159420 0x7f426c06ecd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:25:37.001 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:37.000+0000 7f427159d700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f426c0a98e0 0x7f426c0cd7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:25:37.001 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:37.000+0000 7f427159d700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f426c06e840 con 0x7f426c1597f0 2023-10-06T01:25:37.001 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:37.000+0000 7f427159d700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f426c0aa340 con 0x7f426c159420 2023-10-06T01:25:37.001 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:37.000+0000 7f427159d700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f426c06f210 con 0x7f426c0a98e0 2023-10-06T01:25:37.002 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:37.000+0000 7f426b7fe700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f426c0a98e0 0x7f426c0cd7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:25:37.002 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:37.000+0000 7f426bfff700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f426c159420 0x7f426c06ecd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:25:37.003 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:37.000+0000 7f426b7fe700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f426c0a98e0 0x7f426c0cd7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3301/0 says I am v2:172.21.15.50:56476/0 (socket says 172.21.15.50:56476) 2023-10-06T01:25:37.003 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:37.000+0000 7f426b7fe700 1 -- 172.21.15.50:0/1326082244 learned_addr learned my addr 172.21.15.50:0/1326082244 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-06T01:25:37.003 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:37.001+0000 7f426b7fe700 1 -- 172.21.15.50:0/1326082244 >> v2:172.21.15.155:3300/0 conn(0x7f426c159420 msgr2=0x7f426c06ecd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:25:37.003 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:37.001+0000 7f426b7fe700 1 --2- 172.21.15.50:0/1326082244 >> v2:172.21.15.155:3300/0 conn(0x7f426c159420 0x7f426c06ecd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:25:37.003 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:37.001+0000 7f426b7fe700 1 -- 172.21.15.50:0/1326082244 >> v1:172.21.15.155:6789/0 conn(0x7f426c1597f0 legacy=0x7f426c0675f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:25:37.003 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:37.001+0000 7f426b7fe700 1 -- 172.21.15.50:0/1326082244 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f426c0a9d80 con 0x7f426c0a98e0 2023-10-06T01:25:37.003 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:37.001+0000 7f426bfff700 1 --2- 172.21.15.50:0/1326082244 >> v2:172.21.15.155:3300/0 conn(0x7f426c159420 0x7f426c06ecd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T01:25:37.003 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:37.001+0000 7f426b7fe700 1 --2- 172.21.15.50:0/1326082244 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f426c0a98e0 0x7f426c0cd7a0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f42600099b0 tx=0x7f4260009250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=96f8f0b70725a04d server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:25:37.003 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:37.001+0000 7f426affd700 1 -- 172.21.15.50:0/1326082244 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4260009ea0 con 0x7f426c0a98e0 2023-10-06T01:25:37.003 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:37.002+0000 7f426affd700 1 -- 172.21.15.50:0/1326082244 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f426000b860 con 0x7f426c0a98e0 2023-10-06T01:25:37.004 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:37.002+0000 7f426affd700 1 -- 172.21.15.50:0/1326082244 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f426000bc00 con 0x7f426c0a98e0 2023-10-06T01:25:37.004 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:37.002+0000 7f427159d700 1 -- 172.21.15.50:0/1326082244 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f426c0a98e0 msgr2=0x7f426c0cd7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:25:37.005 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:37.002+0000 7f427159d700 1 --2- 172.21.15.50:0/1326082244 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f426c0a98e0 0x7f426c0cd7a0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f42600099b0 tx=0x7f4260009250 comp rx=0 tx=0).stop 2023-10-06T01:25:37.005 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:37.002+0000 7f427159d700 1 -- 172.21.15.50:0/1326082244 shutdown_connections 2023-10-06T01:25:37.005 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:37.002+0000 7f427159d700 1 --2- 172.21.15.50:0/1326082244 >> v2:172.21.15.155:3300/0 conn(0x7f426c159420 0x7f426c06ecd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:25:37.005 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:37.002+0000 7f427159d700 1 --2- 172.21.15.50:0/1326082244 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f426c0a98e0 0x7f426c0cd7a0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:25:37.005 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:37.002+0000 7f427159d700 1 -- 172.21.15.50:0/1326082244 >> 172.21.15.50:0/1326082244 conn(0x7f426c0691d0 msgr2=0x7f426c0ccfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:25:37.005 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:37.002+0000 7f427159d700 1 -- 172.21.15.50:0/1326082244 shutdown_connections 2023-10-06T01:25:37.005 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:37.002+0000 7f427159d700 1 -- 172.21.15.50:0/1326082244 wait complete. 2023-10-06T01:25:37.005 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:37.004+0000 7f427159d700 1 Processor -- start 2023-10-06T01:25:37.005 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:37.004+0000 7f427159d700 1 -- start start 2023-10-06T01:25:37.007 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:37.005+0000 7f427159d700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f426c0a98e0 0x7f426c0b2790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:25:37.007 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:37.005+0000 7f427159d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f426c159420 0x7f426c13e8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:25:37.007 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:37.005+0000 7f427159d700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f426c1597f0 0x7f426c150a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:25:37.007 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:37.005+0000 7f427159d700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f426c0b1760 con 0x7f426c159420 2023-10-06T01:25:37.007 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:37.005+0000 7f427159d700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f426c14ec30 con 0x7f426c0a98e0 2023-10-06T01:25:37.007 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:37.005+0000 7f427159d700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f426c0b0b50 con 0x7f426c1597f0 2023-10-06T01:25:37.007 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:37.005+0000 7f426b7fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f426c159420 0x7f426c13e8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:25:37.008 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:37.005+0000 7f426b7fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f426c159420 0x7f426c13e8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:33772/0 (socket says 172.21.15.50:33772) 2023-10-06T01:25:37.008 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:37.005+0000 7f426b7fe700 1 -- 172.21.15.50:0/1409303674 learned_addr learned my addr 172.21.15.50:0/1409303674 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-06T01:25:37.008 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:37.005+0000 7f426bfff700 1 --2- 172.21.15.50:0/1409303674 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f426c0a98e0 0x7f426c0b2790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:25:37.008 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:37.005+0000 7f4270d9c700 1 --2- 172.21.15.50:0/1409303674 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f426c1597f0 0x7f426c150a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:25:37.008 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:37.006+0000 7f426b7fe700 1 -- 172.21.15.50:0/1409303674 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f426c1597f0 msgr2=0x7f426c150a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:25:37.008 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:37.006+0000 7f426b7fe700 1 --2- 172.21.15.50:0/1409303674 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f426c1597f0 0x7f426c150a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:25:37.008 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:37.006+0000 7f426b7fe700 1 -- 172.21.15.50:0/1409303674 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f426c0a98e0 msgr2=0x7f426c0b2790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:25:37.008 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:37.006+0000 7f426b7fe700 1 --2- 172.21.15.50:0/1409303674 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f426c0a98e0 0x7f426c0b2790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:25:37.008 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:37.006+0000 7f426b7fe700 1 -- 172.21.15.50:0/1409303674 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f425c009420 con 0x7f426c159420 2023-10-06T01:25:37.008 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:37.006+0000 7f426b7fe700 1 --2- 172.21.15.50:0/1409303674 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f426c159420 0x7f426c13e8c0 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f426c06f350 tx=0x7f4260017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:25:37.008 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:37.006+0000 7f4253fff700 1 -- 172.21.15.50:0/1409303674 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4260000d10 con 0x7f426c159420 2023-10-06T01:25:37.009 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:37.006+0000 7f4253fff700 1 -- 172.21.15.50:0/1409303674 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f426000bbe0 con 0x7f426c159420 2023-10-06T01:25:37.009 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:37.006+0000 7f4253fff700 1 -- 172.21.15.50:0/1409303674 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4260011670 con 0x7f426c159420 2023-10-06T01:25:37.009 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:37.006+0000 7f427159d700 1 -- 172.21.15.50:0/1409303674 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f42600094f0 con 0x7f426c159420 2023-10-06T01:25:37.009 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:37.006+0000 7f427159d700 1 -- 172.21.15.50:0/1409303674 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f426c0b1110 con 0x7f426c159420 2023-10-06T01:25:37.009 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:37.007+0000 7f427159d700 1 -- 172.21.15.50:0/1409303674 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f426c14bf70 con 0x7f426c159420 2023-10-06T01:25:37.009 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:37.008+0000 7f4253fff700 1 -- 172.21.15.50:0/1409303674 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f4260011aa0 con 0x7f426c159420 2023-10-06T01:25:37.010 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:37.009+0000 7f4253fff700 1 --2- 172.21.15.50:0/1409303674 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f4258066f30 0x7f42580693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:25:37.010 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:37.009+0000 7f4253fff700 1 -- 172.21.15.50:0/1409303674 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5612+0+0 (secure 0 0 0) 0x7f4260085dd0 con 0x7f426c159420 2023-10-06T01:25:37.010 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:37.009+0000 7f4253fff700 1 --2- 172.21.15.50:0/1409303674 >> [v2:172.21.15.155:6800/85805,v1:172.21.15.155:6801/85805] conn(0x7f425806d6e0 0x7f425806fb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:25:37.011 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:37.009+0000 7f4253fff700 1 -- 172.21.15.50:0/1409303674 --> [v2:172.21.15.155:6800/85805,v1:172.21.15.155:6801/85805] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f4258070200 con 0x7f425806d6e0 2023-10-06T01:25:37.011 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:37.009+0000 7f4253fff700 1 -- 172.21.15.50:0/1409303674 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_get_version_reply(handle=1 version=44) v2 ==== 24+0+0 (secure 0 0 0) 0x7f42600882d0 con 0x7f426c159420 2023-10-06T01:25:37.011 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:37.009+0000 7f426bfff700 1 --2- 172.21.15.50:0/1409303674 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f4258066f30 0x7f42580693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:25:37.011 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:37.010+0000 7f4270d9c700 1 --2- 172.21.15.50:0/1409303674 >> [v2:172.21.15.155:6800/85805,v1:172.21.15.155:6801/85805] conn(0x7f425806d6e0 0x7f425806fb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:25:37.011 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:37.010+0000 7f426bfff700 1 --2- 172.21.15.50:0/1409303674 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f4258066f30 0x7f42580693e0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f425c009f40 tx=0x7f425c0091a0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:25:37.011 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:37.010+0000 7f4270d9c700 1 --2- 172.21.15.50:0/1409303674 >> [v2:172.21.15.155:6800/85805,v1:172.21.15.155:6801/85805] conn(0x7f425806d6e0 0x7f425806fb30 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:25:37.012 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:37.011+0000 7f4253fff700 1 -- 172.21.15.50:0/1409303674 <== osd.4 v2:172.21.15.155:6800/85805 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7f4258070200 con 0x7f425806d6e0 2023-10-06T01:25:37.026 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:37.025+0000 7f427159d700 1 -- 172.21.15.50:0/1409303674 --> [v2:172.21.15.155:6800/85805,v1:172.21.15.155:6801/85805] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f426c05f270 con 0x7f425806d6e0 2023-10-06T01:25:37.027 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:37.026+0000 7f4253fff700 1 -- 172.21.15.50:0/1409303674 <== osd.4 v2:172.21.15.155:6800/85805 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f426c05f270 con 0x7f425806d6e0 2023-10-06T01:25:37.027 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2023-10-06T01:25:37.027 INFO:teuthology.orchestra.run.smithi050.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-10-06T01:25:37.027 INFO:teuthology.orchestra.run.smithi050.stdout:} 2023-10-06T01:25:37.028 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:37.027+0000 7f427159d700 1 -- 172.21.15.50:0/1409303674 >> [v2:172.21.15.155:6800/85805,v1:172.21.15.155:6801/85805] conn(0x7f425806d6e0 msgr2=0x7f425806fb30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:25:37.028 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:37.027+0000 7f427159d700 1 --2- 172.21.15.50:0/1409303674 >> [v2:172.21.15.155:6800/85805,v1:172.21.15.155:6801/85805] conn(0x7f425806d6e0 0x7f425806fb30 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:25:37.028 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:37.027+0000 7f427159d700 1 -- 172.21.15.50:0/1409303674 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f4258066f30 msgr2=0x7f42580693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:25:37.028 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:37.027+0000 7f427159d700 1 --2- 172.21.15.50:0/1409303674 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f4258066f30 0x7f42580693e0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f425c009f40 tx=0x7f425c0091a0 comp rx=0 tx=0).stop 2023-10-06T01:25:37.029 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:37.027+0000 7f427159d700 1 -- 172.21.15.50:0/1409303674 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f426c159420 msgr2=0x7f426c13e8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:25:37.029 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:37.027+0000 7f427159d700 1 --2- 172.21.15.50:0/1409303674 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f426c159420 0x7f426c13e8c0 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f426c06f350 tx=0x7f4260017000 comp rx=0 tx=0).stop 2023-10-06T01:25:37.029 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:37.027+0000 7f4270d9c700 1 -- 172.21.15.50:0/1409303674 reap_dead start 2023-10-06T01:25:37.029 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:37.027+0000 7f427159d700 1 -- 172.21.15.50:0/1409303674 shutdown_connections 2023-10-06T01:25:37.029 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:37.027+0000 7f427159d700 1 -- 172.21.15.50:0/1409303674 >> 172.21.15.50:0/1409303674 conn(0x7f426c0691d0 msgr2=0x7f426c0c9de0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:25:37.029 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:37.027+0000 7f427159d700 1 -- 172.21.15.50:0/1409303674 shutdown_connections 2023-10-06T01:25:37.029 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:37.027+0000 7f427159d700 1 -- 172.21.15.50:0/1409303674 wait complete. 2023-10-06T01:25:37.044 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2023-10-06T01:25:37.232 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:37.231+0000 7f294359e700 1 Processor -- start 2023-10-06T01:25:37.233 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:37.231+0000 7f294359e700 1 -- start start 2023-10-06T01:25:37.233 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:37.233+0000 7f294359e700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f29440c7740 0x7f29440c1450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:25:37.234 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:37.233+0000 7f294359e700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f294406e950 con 0x7f29440c72f0 2023-10-06T01:25:37.234 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:37.233+0000 7f294359e700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f294406dd40 con 0x7f294406d750 2023-10-06T01:25:37.234 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:37.233+0000 7f294359e700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f294406db20 con 0x7f29440c7740 2023-10-06T01:25:37.234 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:37.233+0000 7f2941d9b700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f29440c72f0 0x7f29440c0d40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:41356/0 (socket says 172.21.15.50:41356) 2023-10-06T01:25:37.234 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:37.233+0000 7f2941d9b700 1 -- 172.21.15.50:0/351292091 learned_addr learned my addr 172.21.15.50:0/351292091 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-10-06T01:25:37.234 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:37.233+0000 7f2942d9d700 1 --2- 172.21.15.50:0/351292091 >> v2:172.21.15.50:3300/0 conn(0x7f29440c7740 0x7f29440c1450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:25:37.236 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:37.233+0000 7f294159a700 1 -- 172.21.15.50:0/351292091 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3506209092 0 0) 0x7f294406e950 con 0x7f29440c72f0 2023-10-06T01:25:37.236 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:37.233+0000 7f294159a700 1 -- 172.21.15.50:0/351292091 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f292c003570 con 0x7f29440c72f0 2023-10-06T01:25:37.236 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:37.233+0000 7f2942d9d700 1 -- 172.21.15.50:0/351292091 >> v1:172.21.15.155:6789/0 conn(0x7f294406d750 legacy=0x7f2944158df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:25:37.236 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:37.233+0000 7f2942d9d700 1 -- 172.21.15.50:0/351292091 >> v1:172.21.15.50:6789/0 conn(0x7f29440c72f0 legacy=0x7f29440c0d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:25:37.236 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:37.233+0000 7f2942d9d700 1 -- 172.21.15.50:0/351292091 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f294406e020 con 0x7f29440c7740 2023-10-06T01:25:37.236 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:37.234+0000 7f2942d9d700 1 --2- 172.21.15.50:0/351292091 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f29440c7740 0x7f29440c1450 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f293c009e60 tx=0x7f293c009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c1ed628f081101bf server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:25:37.236 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:37.234+0000 7f294159a700 1 -- 172.21.15.50:0/351292091 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f293c00e070 con 0x7f29440c7740 2023-10-06T01:25:37.236 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:37.234+0000 7f294159a700 1 -- 172.21.15.50:0/351292091 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f293c00bb60 con 0x7f29440c7740 2023-10-06T01:25:37.236 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:37.234+0000 7f294159a700 1 -- 172.21.15.50:0/351292091 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f293c012430 con 0x7f29440c7740 2023-10-06T01:25:37.236 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:37.235+0000 7f294359e700 1 -- 172.21.15.50:0/351292091 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f29440c7740 msgr2=0x7f29440c1450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:25:37.236 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:37.235+0000 7f294359e700 1 --2- 172.21.15.50:0/351292091 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f29440c7740 0x7f29440c1450 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f293c009e60 tx=0x7f293c009780 comp rx=0 tx=0).stop 2023-10-06T01:25:37.237 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:37.235+0000 7f294359e700 1 -- 172.21.15.50:0/351292091 shutdown_connections 2023-10-06T01:25:37.237 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:37.235+0000 7f294359e700 1 --2- 172.21.15.50:0/351292091 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f29440c7740 0x7f29440c1450 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:25:37.237 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:37.235+0000 7f294359e700 1 -- 172.21.15.50:0/351292091 >> 172.21.15.50:0/351292091 conn(0x7f29440cbef0 msgr2=0x7f29440cc2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:25:37.237 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:37.235+0000 7f294359e700 1 -- 172.21.15.50:0/351292091 shutdown_connections 2023-10-06T01:25:37.237 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:37.235+0000 7f294359e700 1 -- 172.21.15.50:0/351292091 wait complete. 2023-10-06T01:25:37.237 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:37.236+0000 7f294359e700 1 Processor -- start 2023-10-06T01:25:37.237 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:37.236+0000 7f294359e700 1 -- start start 2023-10-06T01:25:37.239 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:37.237+0000 7f294359e700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f294406d750 0x7f29441535c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:25:37.239 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:37.237+0000 7f294359e700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f29440c72f0 0x7f294406a4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:25:37.239 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:37.237+0000 7f294359e700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f29440c7740 0x7f29440ab740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:25:37.239 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:37.237+0000 7f294359e700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2944153b00 con 0x7f29440c7740 2023-10-06T01:25:37.240 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:37.237+0000 7f294359e700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f294406a040 con 0x7f294406d750 2023-10-06T01:25:37.240 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:37.237+0000 7f294359e700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2944069430 con 0x7f29440c72f0 2023-10-06T01:25:37.240 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:37.237+0000 7f2942d9d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f29440c7740 0x7f29440ab740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:25:37.240 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:37.237+0000 7f2942d9d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f29440c7740 0x7f29440ab740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:33792/0 (socket says 172.21.15.50:33792) 2023-10-06T01:25:37.240 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:37.237+0000 7f2942d9d700 1 -- 172.21.15.50:0/2299933523 learned_addr learned my addr 172.21.15.50:0/2299933523 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-06T01:25:37.240 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:37.238+0000 7f2941d9b700 1 --2- 172.21.15.50:0/2299933523 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f29440c72f0 0x7f294406a4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:25:37.240 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:37.238+0000 7f294259c700 1 --2- 172.21.15.50:0/2299933523 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f294406d750 0x7f29441535c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:25:37.240 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:37.238+0000 7f2942d9d700 1 -- 172.21.15.50:0/2299933523 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f29440c72f0 msgr2=0x7f294406a4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:25:37.240 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:37.238+0000 7f2942d9d700 1 --2- 172.21.15.50:0/2299933523 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f29440c72f0 0x7f294406a4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:25:37.240 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:37.238+0000 7f2942d9d700 1 -- 172.21.15.50:0/2299933523 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f294406d750 msgr2=0x7f29441535c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:25:37.240 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:37.238+0000 7f2942d9d700 1 --2- 172.21.15.50:0/2299933523 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f294406d750 0x7f29441535c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:25:37.240 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:37.238+0000 7f2942d9d700 1 -- 172.21.15.50:0/2299933523 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f293c009a20 con 0x7f29440c7740 2023-10-06T01:25:37.241 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:37.238+0000 7f2942d9d700 1 --2- 172.21.15.50:0/2299933523 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f29440c7740 0x7f29440ab740 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f293c013000 tx=0x7f293c019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:25:37.241 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:37.238+0000 7f29327fc700 1 -- 172.21.15.50:0/2299933523 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f293c01e630 con 0x7f29440c7740 2023-10-06T01:25:37.241 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:37.238+0000 7f29327fc700 1 -- 172.21.15.50:0/2299933523 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f293c01e790 con 0x7f29440c7740 2023-10-06T01:25:37.241 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:37.238+0000 7f29327fc700 1 -- 172.21.15.50:0/2299933523 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f293c01eb50 con 0x7f29440c7740 2023-10-06T01:25:37.241 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:37.238+0000 7f294359e700 1 -- 172.21.15.50:0/2299933523 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2944069710 con 0x7f29440c7740 2023-10-06T01:25:37.241 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:37.239+0000 7f294359e700 1 -- 172.21.15.50:0/2299933523 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2944069cd0 con 0x7f29440c7740 2023-10-06T01:25:37.241 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:37.240+0000 7f294359e700 1 -- 172.21.15.50:0/2299933523 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f294405f270 con 0x7f29440c7740 2023-10-06T01:25:37.242 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:37.240+0000 7f29327fc700 1 -- 172.21.15.50:0/2299933523 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f293c024070 con 0x7f29440c7740 2023-10-06T01:25:37.242 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:37.241+0000 7f29327fc700 1 --2- 172.21.15.50:0/2299933523 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f2924066f30 0x7f29240693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:25:37.242 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:37.241+0000 7f29327fc700 1 -- 172.21.15.50:0/2299933523 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5612+0+0 (secure 0 0 0) 0x7f293c086d10 con 0x7f29440c7740 2023-10-06T01:25:37.242 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:37.242+0000 7f294259c700 1 --2- 172.21.15.50:0/2299933523 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f2924066f30 0x7f29240693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:25:37.243 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:37.243+0000 7f294259c700 1 --2- 172.21.15.50:0/2299933523 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f2924066f30 0x7f29240693e0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f2944068eb0 tx=0x7f2934009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:25:37.246 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:37.246+0000 7f29327fc700 1 -- 172.21.15.50:0/2299933523 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f293c053fe0 con 0x7f29440c7740 2023-10-06T01:25:37.447 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:37.446+0000 7f294359e700 1 -- 172.21.15.50:0/2299933523 --> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "4", "target": ["mon-mgr", ""]}) v1 -- 0x7f2944156400 con 0x7f2924066f30 2023-10-06T01:25:37.448 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:37.447+0000 7f29327fc700 1 -- 172.21.15.50:0/2299933523 <== mgr.4099 v2:172.21.15.155:6832/85215 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 4 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f2944156400 con 0x7f2924066f30 2023-10-06T01:25:37.451 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:37.450+0000 7f294359e700 1 -- 172.21.15.50:0/2299933523 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f2924066f30 msgr2=0x7f29240693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:25:37.451 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:37.450+0000 7f294359e700 1 --2- 172.21.15.50:0/2299933523 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f2924066f30 0x7f29240693e0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f2944068eb0 tx=0x7f2934009040 comp rx=0 tx=0).stop 2023-10-06T01:25:37.451 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:37.450+0000 7f294359e700 1 -- 172.21.15.50:0/2299933523 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f29440c7740 msgr2=0x7f29440ab740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:25:37.451 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:37.450+0000 7f294359e700 1 --2- 172.21.15.50:0/2299933523 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f29440c7740 0x7f29440ab740 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f293c013000 tx=0x7f293c019000 comp rx=0 tx=0).stop 2023-10-06T01:25:37.451 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:37.450+0000 7f294359e700 1 -- 172.21.15.50:0/2299933523 shutdown_connections 2023-10-06T01:25:37.451 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:37.450+0000 7f294359e700 1 --2- 172.21.15.50:0/2299933523 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f29440c7740 0x7f29440ab740 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:25:37.451 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:37.450+0000 7f294359e700 1 --2- 172.21.15.50:0/2299933523 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f2924066f30 0x7f29240693e0 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:25:37.451 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:37.450+0000 7f294359e700 1 --2- 172.21.15.50:0/2299933523 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f294406d750 0x7f29441535c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:25:37.451 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:37.450+0000 7f294359e700 1 --2- 172.21.15.50:0/2299933523 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f29440c72f0 0x7f294406a4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:25:37.451 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:37.450+0000 7f294359e700 1 -- 172.21.15.50:0/2299933523 >> 172.21.15.50:0/2299933523 conn(0x7f29440cbef0 msgr2=0x7f29440c0d40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:25:37.452 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:37.450+0000 7f294359e700 1 -- 172.21.15.50:0/2299933523 shutdown_connections 2023-10-06T01:25:37.452 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:37.450+0000 7f294359e700 1 -- 172.21.15.50:0/2299933523 wait complete. 2023-10-06T01:25:37.452 INFO:teuthology.orchestra.run.smithi050.stderr:instructed osd(s) 4 to deep-scrub 2023-10-06T01:25:37.468 INFO:tasks.ceph:Scrubbing osd.5 2023-10-06T01:25:37.468 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2023-10-06T01:25:37.660 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:37.659+0000 7fc32319d700 1 Processor -- start 2023-10-06T01:25:37.661 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:37.660+0000 7fc32319d700 1 -- start start 2023-10-06T01:25:37.662 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:37.661+0000 7fc32319d700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fc31c1590b0 0x7fc31c159480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:25:37.662 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:37.661+0000 7fc32319d700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc31c0aba80 con 0x7fc31c0aef10 2023-10-06T01:25:37.662 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:37.661+0000 7fc32319d700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc31c0abd60 con 0x7fc31c06e880 2023-10-06T01:25:37.662 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:37.661+0000 7fc32319d700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc31c0ac040 con 0x7fc31c1590b0 2023-10-06T01:25:37.662 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:37.661+0000 7fc32219b700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fc31c1590b0 0x7fc31c159480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:25:37.662 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:37.661+0000 7fc32199a700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fc31c0aef10 0x7fc31c06e170 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:41362/0 (socket says 172.21.15.50:41362) 2023-10-06T01:25:37.662 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:37.661+0000 7fc32199a700 1 -- 172.21.15.50:0/1054493539 learned_addr learned my addr 172.21.15.50:0/1054493539 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-10-06T01:25:37.664 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:37.662+0000 7fc32219b700 1 -- 172.21.15.50:0/1054493539 >> v1:172.21.15.155:6789/0 conn(0x7fc31c06e880 legacy=0x7fc31c0aad30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:25:37.664 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:37.662+0000 7fc32219b700 1 -- 172.21.15.50:0/1054493539 >> v1:172.21.15.50:6789/0 conn(0x7fc31c0aef10 legacy=0x7fc31c06e170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:25:37.664 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:37.662+0000 7fc32219b700 1 -- 172.21.15.50:0/1054493539 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc31c0ac320 con 0x7fc31c1590b0 2023-10-06T01:25:37.664 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:37.662+0000 7fc32219b700 1 --2- 172.21.15.50:0/1054493539 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc31c1590b0 0x7fc31c159480 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7fc3180098e0 tx=0x7fc3180091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dbf21d9bf926d531 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:25:37.664 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:37.662+0000 7fc321199700 1 -- 172.21.15.50:0/1054493539 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc318009e80 con 0x7fc31c1590b0 2023-10-06T01:25:37.664 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:37.662+0000 7fc321199700 1 -- 172.21.15.50:0/1054493539 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc31800b860 con 0x7fc31c1590b0 2023-10-06T01:25:37.664 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:37.662+0000 7fc321199700 1 -- 172.21.15.50:0/1054493539 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc31800bbe0 con 0x7fc31c1590b0 2023-10-06T01:25:37.664 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:37.663+0000 7fc32319d700 1 -- 172.21.15.50:0/1054493539 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc31c1590b0 msgr2=0x7fc31c159480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:25:37.665 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:37.663+0000 7fc32319d700 1 --2- 172.21.15.50:0/1054493539 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc31c1590b0 0x7fc31c159480 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7fc3180098e0 tx=0x7fc3180091a0 comp rx=0 tx=0).stop 2023-10-06T01:25:37.665 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:37.663+0000 7fc32319d700 1 -- 172.21.15.50:0/1054493539 shutdown_connections 2023-10-06T01:25:37.665 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:37.663+0000 7fc32319d700 1 --2- 172.21.15.50:0/1054493539 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc31c1590b0 0x7fc31c159480 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:25:37.665 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:37.663+0000 7fc32319d700 1 -- 172.21.15.50:0/1054493539 >> 172.21.15.50:0/1054493539 conn(0x7fc31c0cbee0 msgr2=0x7fc31c0cc2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:25:37.665 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:37.663+0000 7fc32319d700 1 -- 172.21.15.50:0/1054493539 shutdown_connections 2023-10-06T01:25:37.665 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:37.663+0000 7fc32319d700 1 -- 172.21.15.50:0/1054493539 wait complete. 2023-10-06T01:25:37.665 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:37.664+0000 7fc32319d700 1 Processor -- start 2023-10-06T01:25:37.666 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:37.664+0000 7fc32319d700 1 -- start start 2023-10-06T01:25:37.667 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:37.665+0000 7fc32319d700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc31c06e880 0x7fc31c149c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:25:37.668 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:37.665+0000 7fc32319d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc31c0aef10 0x7fc31c14c4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:25:37.668 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:37.665+0000 7fc32319d700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc31c1590b0 0x7fc31c14ca30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:25:37.668 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:37.665+0000 7fc32319d700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc31c0c93a0 con 0x7fc31c0aef10 2023-10-06T01:25:37.668 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:37.665+0000 7fc32319d700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc31c0c9680 con 0x7fc31c06e880 2023-10-06T01:25:37.668 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:37.665+0000 7fc32319d700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc31c0c9960 con 0x7fc31c1590b0 2023-10-06T01:25:37.668 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:37.666+0000 7fc32199a700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc31c0aef10 0x7fc31c14c4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:25:37.668 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:37.666+0000 7fc32199a700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc31c0aef10 0x7fc31c14c4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:33818/0 (socket says 172.21.15.50:33818) 2023-10-06T01:25:37.668 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:37.666+0000 7fc32199a700 1 -- 172.21.15.50:0/395750388 learned_addr learned my addr 172.21.15.50:0/395750388 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-06T01:25:37.669 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:37.666+0000 7fc32219b700 1 --2- 172.21.15.50:0/395750388 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc31c06e880 0x7fc31c149c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:25:37.669 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:37.666+0000 7fc32199a700 1 -- 172.21.15.50:0/395750388 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc31c1590b0 msgr2=0x7fc31c14ca30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:25:37.669 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:37.666+0000 7fc32299c700 1 --2- 172.21.15.50:0/395750388 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc31c1590b0 0x7fc31c14ca30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:25:37.669 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:37.666+0000 7fc32199a700 1 --2- 172.21.15.50:0/395750388 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc31c1590b0 0x7fc31c14ca30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:25:37.669 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:37.666+0000 7fc32199a700 1 -- 172.21.15.50:0/395750388 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc31c06e880 msgr2=0x7fc31c149c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:25:37.669 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:37.666+0000 7fc32199a700 1 --2- 172.21.15.50:0/395750388 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc31c06e880 0x7fc31c149c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:25:37.669 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:37.666+0000 7fc32199a700 1 -- 172.21.15.50:0/395750388 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc318009420 con 0x7fc31c0aef10 2023-10-06T01:25:37.669 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:37.666+0000 7fc32219b700 1 --2- 172.21.15.50:0/395750388 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc31c06e880 0x7fc31c149c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T01:25:37.669 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:37.666+0000 7fc32299c700 1 --2- 172.21.15.50:0/395750388 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc31c1590b0 0x7fc31c14ca30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T01:25:37.670 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:37.666+0000 7fc32199a700 1 --2- 172.21.15.50:0/395750388 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc31c0aef10 0x7fc31c14c4f0 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7fc30c00c7c0 tx=0x7fc30c007f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:25:37.670 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:37.666+0000 7fc3127fc700 1 -- 172.21.15.50:0/395750388 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc30c005b30 con 0x7fc31c0aef10 2023-10-06T01:25:37.670 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:37.667+0000 7fc3127fc700 1 -- 172.21.15.50:0/395750388 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc30c005cb0 con 0x7fc31c0aef10 2023-10-06T01:25:37.670 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:37.667+0000 7fc32319d700 1 -- 172.21.15.50:0/395750388 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc31c0c9c40 con 0x7fc31c0aef10 2023-10-06T01:25:37.670 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:37.667+0000 7fc3127fc700 1 -- 172.21.15.50:0/395750388 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc30c004a80 con 0x7fc31c0aef10 2023-10-06T01:25:37.670 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:37.667+0000 7fc32319d700 1 -- 172.21.15.50:0/395750388 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc31c0c8fc0 con 0x7fc31c0aef10 2023-10-06T01:25:37.671 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:37.667+0000 7fc32319d700 1 -- 172.21.15.50:0/395750388 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fc31c0c9510 con 0x7fc31c0aef10 2023-10-06T01:25:37.671 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:37.669+0000 7fc3127fc700 1 -- 172.21.15.50:0/395750388 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fc30c0070f0 con 0x7fc31c0aef10 2023-10-06T01:25:37.672 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:37.669+0000 7fc3127fc700 1 --2- 172.21.15.50:0/395750388 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7fc300066f30 0x7fc3000693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:25:37.672 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:37.669+0000 7fc3127fc700 1 -- 172.21.15.50:0/395750388 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5612+0+0 (secure 0 0 0) 0x7fc30c084110 con 0x7fc31c0aef10 2023-10-06T01:25:37.672 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:37.670+0000 7fc3127fc700 1 --2- 172.21.15.50:0/395750388 >> [v2:172.21.15.155:6816/85807,v1:172.21.15.155:6818/85807] conn(0x7fc30006d850 0x7fc30006fca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:25:37.672 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:37.670+0000 7fc3127fc700 1 -- 172.21.15.50:0/395750388 --> [v2:172.21.15.155:6816/85807,v1:172.21.15.155:6818/85807] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fc300070370 con 0x7fc30006d850 2023-10-06T01:25:37.672 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:37.670+0000 7fc3127fc700 1 -- 172.21.15.50:0/395750388 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_get_version_reply(handle=1 version=44) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc30c084400 con 0x7fc31c0aef10 2023-10-06T01:25:37.672 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:37.670+0000 7fc32219b700 1 --2- 172.21.15.50:0/395750388 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7fc300066f30 0x7fc3000693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:25:37.672 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:37.670+0000 7fc32299c700 1 --2- 172.21.15.50:0/395750388 >> [v2:172.21.15.155:6816/85807,v1:172.21.15.155:6818/85807] conn(0x7fc30006d850 0x7fc30006fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:25:37.672 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:37.671+0000 7fc32219b700 1 --2- 172.21.15.50:0/395750388 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7fc300066f30 0x7fc3000693e0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fc318003080 tx=0x7fc318017000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:25:37.672 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:37.671+0000 7fc32299c700 1 --2- 172.21.15.50:0/395750388 >> [v2:172.21.15.155:6816/85807,v1:172.21.15.155:6818/85807] conn(0x7fc30006d850 0x7fc30006fca0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:25:37.673 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:37.672+0000 7fc3127fc700 1 -- 172.21.15.50:0/395750388 <== osd.5 v2:172.21.15.155:6816/85807 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7fc300070370 con 0x7fc30006d850 2023-10-06T01:25:37.687 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:37.687+0000 7fc32319d700 1 -- 172.21.15.50:0/395750388 --> [v2:172.21.15.155:6816/85807,v1:172.21.15.155:6818/85807] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fc31c05f270 con 0x7fc30006d850 2023-10-06T01:25:37.688 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:37.687+0000 7fc3127fc700 1 -- 172.21.15.50:0/395750388 <== osd.5 v2:172.21.15.155:6816/85807 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7fc31c05f270 con 0x7fc30006d850 2023-10-06T01:25:37.688 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2023-10-06T01:25:37.688 INFO:teuthology.orchestra.run.smithi050.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-10-06T01:25:37.688 INFO:teuthology.orchestra.run.smithi050.stdout:} 2023-10-06T01:25:37.689 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:37.688+0000 7fc32319d700 1 -- 172.21.15.50:0/395750388 >> [v2:172.21.15.155:6816/85807,v1:172.21.15.155:6818/85807] conn(0x7fc30006d850 msgr2=0x7fc30006fca0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:25:37.689 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:37.688+0000 7fc32319d700 1 --2- 172.21.15.50:0/395750388 >> [v2:172.21.15.155:6816/85807,v1:172.21.15.155:6818/85807] conn(0x7fc30006d850 0x7fc30006fca0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:25:37.690 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:37.688+0000 7fc32319d700 1 -- 172.21.15.50:0/395750388 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7fc300066f30 msgr2=0x7fc3000693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:25:37.690 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:37.688+0000 7fc32319d700 1 --2- 172.21.15.50:0/395750388 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7fc300066f30 0x7fc3000693e0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fc318003080 tx=0x7fc318017000 comp rx=0 tx=0).stop 2023-10-06T01:25:37.690 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:37.688+0000 7fc32319d700 1 -- 172.21.15.50:0/395750388 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc31c0aef10 msgr2=0x7fc31c14c4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:25:37.690 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:37.688+0000 7fc32319d700 1 --2- 172.21.15.50:0/395750388 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc31c0aef10 0x7fc31c14c4f0 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7fc30c00c7c0 tx=0x7fc30c007f70 comp rx=0 tx=0).stop 2023-10-06T01:25:37.690 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:37.688+0000 7fc32299c700 1 -- 172.21.15.50:0/395750388 reap_dead start 2023-10-06T01:25:37.690 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:37.688+0000 7fc32319d700 1 -- 172.21.15.50:0/395750388 shutdown_connections 2023-10-06T01:25:37.690 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:37.688+0000 7fc32319d700 1 -- 172.21.15.50:0/395750388 >> 172.21.15.50:0/395750388 conn(0x7fc31c0cbee0 msgr2=0x7fc31c0af730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:25:37.690 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:37.688+0000 7fc32319d700 1 -- 172.21.15.50:0/395750388 shutdown_connections 2023-10-06T01:25:37.690 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:37.688+0000 7fc32319d700 1 -- 172.21.15.50:0/395750388 wait complete. 2023-10-06T01:25:37.705 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2023-10-06T01:25:37.894 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:37.893+0000 7f715179d700 1 Processor -- start 2023-10-06T01:25:37.894 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:37.893+0000 7f715179d700 1 -- start start 2023-10-06T01:25:37.897 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:37.895+0000 7f715179d700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f714c0cc0d0 0x7f714c15d700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:25:37.897 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:37.895+0000 7f715179d700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f714c15dc40 0x7f714c0675f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:25:37.897 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:37.895+0000 7f715179d700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f714c0c1730 con 0x7f714c159360 2023-10-06T01:25:37.897 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:37.895+0000 7f715179d700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f714c0c2590 con 0x7f714c15dc40 2023-10-06T01:25:37.897 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:37.895+0000 7f715179d700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f714c0cc570 con 0x7f714c0cc0d0 2023-10-06T01:25:37.897 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:37.895+0000 7f7150f9c700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f714c15dc40 0x7f714c0675f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:25:37.897 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:37.895+0000 7f714bfff700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f714c159360 0x7f714c15cff0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:41364/0 (socket says 172.21.15.50:41364) 2023-10-06T01:25:37.897 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:37.895+0000 7f714bfff700 1 -- 172.21.15.50:0/2718865030 learned_addr learned my addr 172.21.15.50:0/2718865030 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-10-06T01:25:37.897 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:37.895+0000 7f714b7fe700 1 --2- 172.21.15.50:0/2718865030 >> v2:172.21.15.155:3300/0 conn(0x7f714c0cc0d0 0x7f714c15d700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:25:37.898 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:37.895+0000 7f7150f9c700 1 -- 172.21.15.50:0/2718865030 >> v2:172.21.15.155:3300/0 conn(0x7f714c0cc0d0 msgr2=0x7f714c15d700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:25:37.898 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:37.895+0000 7f7150f9c700 1 --2- 172.21.15.50:0/2718865030 >> v2:172.21.15.155:3300/0 conn(0x7f714c0cc0d0 0x7f714c15d700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:25:37.898 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:37.895+0000 7f714affd700 1 -- 172.21.15.50:0/2718865030 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 267201642 0 0) 0x7f714c0c1730 con 0x7f714c159360 2023-10-06T01:25:37.898 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:37.895+0000 7f7150f9c700 1 -- 172.21.15.50:0/2718865030 >> v1:172.21.15.50:6789/0 conn(0x7f714c159360 legacy=0x7f714c15cff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:25:37.898 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:37.895+0000 7f7150f9c700 1 -- 172.21.15.50:0/2718865030 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f714c0c1980 con 0x7f714c15dc40 2023-10-06T01:25:37.898 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:37.896+0000 7f7150f9c700 1 --2- 172.21.15.50:0/2718865030 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f714c15dc40 0x7f714c0675f0 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f714c06d4f0 tx=0x7f7144009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=db44176fb9b087c7 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:25:37.898 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:37.896+0000 7f714affd700 1 -- 172.21.15.50:0/2718865030 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f714400e070 con 0x7f714c15dc40 2023-10-06T01:25:37.898 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:37.896+0000 7f714affd700 1 -- 172.21.15.50:0/2718865030 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f714400bc30 con 0x7f714c15dc40 2023-10-06T01:25:37.898 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:37.896+0000 7f714affd700 1 -- 172.21.15.50:0/2718865030 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7144012430 con 0x7f714c15dc40 2023-10-06T01:25:37.899 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:37.896+0000 7f715179d700 1 -- 172.21.15.50:0/2718865030 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f714c15dc40 msgr2=0x7f714c0675f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:25:37.899 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:37.896+0000 7f715179d700 1 --2- 172.21.15.50:0/2718865030 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f714c15dc40 0x7f714c0675f0 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f714c06d4f0 tx=0x7f7144009780 comp rx=0 tx=0).stop 2023-10-06T01:25:37.899 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:37.897+0000 7f715179d700 1 -- 172.21.15.50:0/2718865030 shutdown_connections 2023-10-06T01:25:37.900 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:37.897+0000 7f715179d700 1 --2- 172.21.15.50:0/2718865030 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f714c15dc40 0x7f714c0675f0 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:25:37.900 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:37.897+0000 7f715179d700 1 --2- 172.21.15.50:0/2718865030 >> v2:172.21.15.155:3300/0 conn(0x7f714c0cc0d0 0x7f714c15d700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:25:37.900 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:37.897+0000 7f715179d700 1 -- 172.21.15.50:0/2718865030 >> 172.21.15.50:0/2718865030 conn(0x7f714c0c91e0 msgr2=0x7f714c0c95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:25:37.900 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:37.897+0000 7f715179d700 1 -- 172.21.15.50:0/2718865030 shutdown_connections 2023-10-06T01:25:37.900 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:37.897+0000 7f715179d700 1 -- 172.21.15.50:0/2718865030 wait complete. 2023-10-06T01:25:37.900 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:37.898+0000 7f715179d700 1 Processor -- start 2023-10-06T01:25:37.900 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:37.898+0000 7f715179d700 1 -- start start 2023-10-06T01:25:37.902 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:37.899+0000 7f715179d700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f714c0cc0d0 0x7f714c0abe00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:25:37.902 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:37.899+0000 7f715179d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f714c159360 0x7f714c0acee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:25:37.902 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:37.899+0000 7f715179d700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f714c15dc40 0x7f714c143f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:25:37.902 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:37.899+0000 7f715179d700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f714c0ab170 con 0x7f714c159360 2023-10-06T01:25:37.902 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:37.899+0000 7f715179d700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f714c0b1210 con 0x7f714c0cc0d0 2023-10-06T01:25:37.903 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:37.899+0000 7f715179d700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f714c0b14f0 con 0x7f714c15dc40 2023-10-06T01:25:37.903 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:37.899+0000 7f714b7fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f714c159360 0x7f714c0acee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:25:37.903 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:37.899+0000 7f714b7fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f714c159360 0x7f714c0acee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:33840/0 (socket says 172.21.15.50:33840) 2023-10-06T01:25:37.903 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:37.899+0000 7f714b7fe700 1 -- 172.21.15.50:0/1570117034 learned_addr learned my addr 172.21.15.50:0/1570117034 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-06T01:25:37.903 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:37.900+0000 7f714bfff700 1 --2- 172.21.15.50:0/1570117034 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f714c0cc0d0 0x7f714c0abe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:25:37.903 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:37.900+0000 7f7150f9c700 1 --2- 172.21.15.50:0/1570117034 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f714c15dc40 0x7f714c143f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:25:37.903 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:37.900+0000 7f714b7fe700 1 -- 172.21.15.50:0/1570117034 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f714c15dc40 msgr2=0x7f714c143f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:25:37.903 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:37.900+0000 7f714b7fe700 1 --2- 172.21.15.50:0/1570117034 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f714c15dc40 0x7f714c143f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:25:37.903 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:37.900+0000 7f714b7fe700 1 -- 172.21.15.50:0/1570117034 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f714c0cc0d0 msgr2=0x7f714c0abe00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:25:37.903 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:37.900+0000 7f714b7fe700 1 --2- 172.21.15.50:0/1570117034 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f714c0cc0d0 0x7f714c0abe00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:25:37.903 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:37.900+0000 7f714b7fe700 1 -- 172.21.15.50:0/1570117034 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7144009a20 con 0x7f714c159360 2023-10-06T01:25:37.904 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:37.900+0000 7f714b7fe700 1 --2- 172.21.15.50:0/1570117034 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f714c159360 0x7f714c0acee0 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f714000d890 tx=0x7f7140008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:25:37.904 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:37.900+0000 7f7133fff700 1 -- 172.21.15.50:0/1570117034 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f714000b600 con 0x7f714c159360 2023-10-06T01:25:37.904 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:37.900+0000 7f7133fff700 1 -- 172.21.15.50:0/1570117034 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f714000b760 con 0x7f714c159360 2023-10-06T01:25:37.904 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:37.900+0000 7f7133fff700 1 -- 172.21.15.50:0/1570117034 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f714000bae0 con 0x7f714c159360 2023-10-06T01:25:37.904 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:37.900+0000 7f715179d700 1 -- 172.21.15.50:0/1570117034 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f714c0b17d0 con 0x7f714c159360 2023-10-06T01:25:37.904 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:37.900+0000 7f715179d700 1 -- 172.21.15.50:0/1570117034 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f714c0b1d90 con 0x7f714c159360 2023-10-06T01:25:37.904 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:37.901+0000 7f715179d700 1 -- 172.21.15.50:0/1570117034 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f714c05f270 con 0x7f714c159360 2023-10-06T01:25:37.905 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:37.902+0000 7f7133fff700 1 -- 172.21.15.50:0/1570117034 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f714001e460 con 0x7f714c159360 2023-10-06T01:25:37.905 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:37.903+0000 7f7133fff700 1 --2- 172.21.15.50:0/1570117034 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f7138066f30 0x7f71380693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:25:37.905 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:37.904+0000 7f7133fff700 1 -- 172.21.15.50:0/1570117034 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5612+0+0 (secure 0 0 0) 0x7f7140084c20 con 0x7f714c159360 2023-10-06T01:25:37.905 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:37.904+0000 7f714bfff700 1 --2- 172.21.15.50:0/1570117034 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f7138066f30 0x7f71380693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:25:37.905 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:37.905+0000 7f714bfff700 1 --2- 172.21.15.50:0/1570117034 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f7138066f30 0x7f71380693e0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f713c0011e0 tx=0x7f713c009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:25:37.908 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:37.907+0000 7f7133fff700 1 -- 172.21.15.50:0/1570117034 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f7140051e50 con 0x7f714c159360 2023-10-06T01:25:38.111 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:38.111+0000 7f715179d700 1 -- 172.21.15.50:0/1570117034 --> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "5", "target": ["mon-mgr", ""]}) v1 -- 0x7f714c0b1660 con 0x7f7138066f30 2023-10-06T01:25:38.112 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:38.111+0000 7f7133fff700 1 -- 172.21.15.50:0/1570117034 <== mgr.4099 v2:172.21.15.155:6832/85215 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 5 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f714c0b1660 con 0x7f7138066f30 2023-10-06T01:25:38.115 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:38.114+0000 7f715179d700 1 -- 172.21.15.50:0/1570117034 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f7138066f30 msgr2=0x7f71380693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:25:38.115 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:38.114+0000 7f715179d700 1 --2- 172.21.15.50:0/1570117034 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f7138066f30 0x7f71380693e0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f713c0011e0 tx=0x7f713c009040 comp rx=0 tx=0).stop 2023-10-06T01:25:38.115 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:38.114+0000 7f715179d700 1 -- 172.21.15.50:0/1570117034 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f714c159360 msgr2=0x7f714c0acee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:25:38.115 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:38.114+0000 7f715179d700 1 --2- 172.21.15.50:0/1570117034 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f714c159360 0x7f714c0acee0 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f714000d890 tx=0x7f7140008040 comp rx=0 tx=0).stop 2023-10-06T01:25:38.115 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:38.114+0000 7f715179d700 1 -- 172.21.15.50:0/1570117034 shutdown_connections 2023-10-06T01:25:38.115 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:38.114+0000 7f715179d700 1 --2- 172.21.15.50:0/1570117034 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f714c15dc40 0x7f714c143f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:25:38.115 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:38.114+0000 7f715179d700 1 --2- 172.21.15.50:0/1570117034 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f7138066f30 0x7f71380693e0 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:25:38.115 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:38.114+0000 7f715179d700 1 --2- 172.21.15.50:0/1570117034 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f714c0cc0d0 0x7f714c0abe00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:25:38.116 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:38.114+0000 7f715179d700 1 --2- 172.21.15.50:0/1570117034 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f714c159360 0x7f714c0acee0 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:25:38.116 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:38.114+0000 7f715179d700 1 -- 172.21.15.50:0/1570117034 >> 172.21.15.50:0/1570117034 conn(0x7f714c0c91e0 msgr2=0x7f714c155ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:25:38.116 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:38.114+0000 7f715179d700 1 -- 172.21.15.50:0/1570117034 shutdown_connections 2023-10-06T01:25:38.116 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:38.114+0000 7f715179d700 1 -- 172.21.15.50:0/1570117034 wait complete. 2023-10-06T01:25:38.116 INFO:teuthology.orchestra.run.smithi050.stderr:instructed osd(s) 5 to deep-scrub 2023-10-06T01:25:38.132 INFO:tasks.ceph:Scrubbing osd.6 2023-10-06T01:25:38.132 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2023-10-06T01:25:38.324 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:38.323+0000 7f83319ff700 1 Processor -- start 2023-10-06T01:25:38.325 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:38.324+0000 7f83319ff700 1 -- start start 2023-10-06T01:25:38.326 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:38.325+0000 7f83319ff700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f832c0abc20 0x7f832c0abff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:25:38.326 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:38.325+0000 7f83319ff700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f832c06ad20 0x7f832c0a6b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:25:38.326 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:38.325+0000 7f83319ff700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f832c0ac530 con 0x7f832c0ccdb0 2023-10-06T01:25:38.326 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:38.325+0000 7f83319ff700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f832c0ad370 con 0x7f832c06ad20 2023-10-06T01:25:38.326 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:38.325+0000 7f83319ff700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f832c0695d0 con 0x7f832c0abc20 2023-10-06T01:25:38.327 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:38.325+0000 7f832affd700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f832c0abc20 0x7f832c0abff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:25:38.327 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:38.325+0000 7f832b7fe700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f832c06ad20 0x7f832c0a6b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:25:38.328 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:38.325+0000 7f832affd700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f832c0abc20 0x7f832c0abff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3301/0 says I am v2:172.21.15.50:56524/0 (socket says 172.21.15.50:56524) 2023-10-06T01:25:38.328 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:38.325+0000 7f832affd700 1 -- 172.21.15.50:0/3500490551 learned_addr learned my addr 172.21.15.50:0/3500490551 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-06T01:25:38.328 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:38.326+0000 7f832affd700 1 -- 172.21.15.50:0/3500490551 >> v2:172.21.15.155:3300/0 conn(0x7f832c06ad20 msgr2=0x7f832c0a6b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:25:38.328 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:38.326+0000 7f8329ffb700 1 -- 172.21.15.50:0/3500490551 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2750408109 0 0) 0x7f832c0ac530 con 0x7f832c0ccdb0 2023-10-06T01:25:38.328 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:38.326+0000 7f832affd700 1 --2- 172.21.15.50:0/3500490551 >> v2:172.21.15.155:3300/0 conn(0x7f832c06ad20 0x7f832c0a6b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:25:38.328 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:38.326+0000 7f832affd700 1 -- 172.21.15.50:0/3500490551 >> v1:172.21.15.155:6789/0 conn(0x7f832c0ccdb0 legacy=0x7f832c0a63f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:25:38.328 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:38.326+0000 7f832affd700 1 -- 172.21.15.50:0/3500490551 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f832c0ac760 con 0x7f832c0abc20 2023-10-06T01:25:38.328 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:38.326+0000 7f832b7fe700 1 --2- 172.21.15.50:0/3500490551 >> v2:172.21.15.155:3300/0 conn(0x7f832c06ad20 0x7f832c0a6b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T01:25:38.328 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:38.326+0000 7f832affd700 1 --2- 172.21.15.50:0/3500490551 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f832c0abc20 0x7f832c0abff0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f831c0099e0 tx=0x7f831c009250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ddd5317c37f5b2a server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:25:38.328 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:38.327+0000 7f8329ffb700 1 -- 172.21.15.50:0/3500490551 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f831c00b820 con 0x7f832c0abc20 2023-10-06T01:25:38.328 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:38.327+0000 7f8329ffb700 1 -- 172.21.15.50:0/3500490551 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f831c00b980 con 0x7f832c0abc20 2023-10-06T01:25:38.328 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:38.327+0000 7f8329ffb700 1 -- 172.21.15.50:0/3500490551 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f831c00bd20 con 0x7f832c0abc20 2023-10-06T01:25:38.329 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:38.327+0000 7f83319ff700 1 -- 172.21.15.50:0/3500490551 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f832c0abc20 msgr2=0x7f832c0abff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:25:38.329 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:38.327+0000 7f83319ff700 1 --2- 172.21.15.50:0/3500490551 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f832c0abc20 0x7f832c0abff0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f831c0099e0 tx=0x7f831c009250 comp rx=0 tx=0).stop 2023-10-06T01:25:38.330 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:38.327+0000 7f83319ff700 1 -- 172.21.15.50:0/3500490551 shutdown_connections 2023-10-06T01:25:38.330 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:38.327+0000 7f83319ff700 1 --2- 172.21.15.50:0/3500490551 >> v2:172.21.15.155:3300/0 conn(0x7f832c06ad20 0x7f832c0a6b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:25:38.330 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:38.327+0000 7f83319ff700 1 --2- 172.21.15.50:0/3500490551 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f832c0abc20 0x7f832c0abff0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:25:38.330 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:38.327+0000 7f83319ff700 1 -- 172.21.15.50:0/3500490551 >> 172.21.15.50:0/3500490551 conn(0x7f832c0cc110 msgr2=0x7f832c0cc510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:25:38.330 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:38.327+0000 7f83319ff700 1 -- 172.21.15.50:0/3500490551 shutdown_connections 2023-10-06T01:25:38.330 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:38.327+0000 7f83319ff700 1 -- 172.21.15.50:0/3500490551 wait complete. 2023-10-06T01:25:38.330 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:38.329+0000 7f83319ff700 1 Processor -- start 2023-10-06T01:25:38.330 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:38.329+0000 7f83319ff700 1 -- start start 2023-10-06T01:25:38.332 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:38.330+0000 7f83319ff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f832c06ad20 0x7f832c0a8da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:25:38.332 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:38.330+0000 7f83319ff700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f832c0abc20 0x7f832c097e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:25:38.332 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:38.330+0000 7f83319ff700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f832c0ccdb0 0x7f832c15d820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:25:38.332 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:38.330+0000 7f83319ff700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f832c0a9380 con 0x7f832c06ad20 2023-10-06T01:25:38.332 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:38.330+0000 7f83319ff700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f832c0a9660 con 0x7f832c0abc20 2023-10-06T01:25:38.333 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:38.330+0000 7f83319ff700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f832c0a9940 con 0x7f832c0ccdb0 2023-10-06T01:25:38.333 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:38.330+0000 7f832affd700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f832c06ad20 0x7f832c0a8da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:25:38.333 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:38.330+0000 7f832affd700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f832c06ad20 0x7f832c0a8da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:33846/0 (socket says 172.21.15.50:33846) 2023-10-06T01:25:38.333 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:38.330+0000 7f832affd700 1 -- 172.21.15.50:0/3402004549 learned_addr learned my addr 172.21.15.50:0/3402004549 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-06T01:25:38.333 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:38.330+0000 7f832a7fc700 1 --2- 172.21.15.50:0/3402004549 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f832c0abc20 0x7f832c097e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:25:38.333 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:38.330+0000 7f832affd700 1 -- 172.21.15.50:0/3402004549 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f832c0ccdb0 msgr2=0x7f832c15d820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:25:38.333 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:38.330+0000 7f832affd700 1 --2- 172.21.15.50:0/3402004549 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f832c0ccdb0 0x7f832c15d820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:25:38.333 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:38.330+0000 7f832affd700 1 -- 172.21.15.50:0/3402004549 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f832c0abc20 msgr2=0x7f832c097e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:25:38.333 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:38.330+0000 7f832affd700 1 --2- 172.21.15.50:0/3402004549 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f832c0abc20 0x7f832c097e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:25:38.333 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:38.330+0000 7f832affd700 1 -- 172.21.15.50:0/3402004549 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f832400bc30 con 0x7f832c06ad20 2023-10-06T01:25:38.333 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:38.330+0000 7f832a7fc700 1 --2- 172.21.15.50:0/3402004549 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f832c0abc20 0x7f832c097e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T01:25:38.333 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:38.331+0000 7f832affd700 1 --2- 172.21.15.50:0/3402004549 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f832c06ad20 0x7f832c0a8da0 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f832c069710 tx=0x7f831c017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:25:38.334 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:38.331+0000 7f8312ffd700 1 -- 172.21.15.50:0/3402004549 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f831c01f070 con 0x7f832c06ad20 2023-10-06T01:25:38.334 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:38.331+0000 7f8312ffd700 1 -- 172.21.15.50:0/3402004549 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f831c011c40 con 0x7f832c06ad20 2023-10-06T01:25:38.334 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:38.331+0000 7f8312ffd700 1 -- 172.21.15.50:0/3402004549 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f831c00b820 con 0x7f832c06ad20 2023-10-06T01:25:38.334 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:38.331+0000 7f83319ff700 1 -- 172.21.15.50:0/3402004549 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f831c0094f0 con 0x7f832c06ad20 2023-10-06T01:25:38.334 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:38.331+0000 7f83319ff700 1 -- 172.21.15.50:0/3402004549 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f832c0a9f00 con 0x7f832c06ad20 2023-10-06T01:25:38.334 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:38.332+0000 7f83319ff700 1 -- 172.21.15.50:0/3402004549 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f832c064ad0 con 0x7f832c06ad20 2023-10-06T01:25:38.335 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:38.333+0000 7f8312ffd700 1 -- 172.21.15.50:0/3402004549 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f831c023070 con 0x7f832c06ad20 2023-10-06T01:25:38.335 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:38.334+0000 7f8312ffd700 1 --2- 172.21.15.50:0/3402004549 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f8318066f30 0x7f83180693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:25:38.335 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:38.334+0000 7f8312ffd700 1 -- 172.21.15.50:0/3402004549 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5612+0+0 (secure 0 0 0) 0x7f831c0855e0 con 0x7f832c06ad20 2023-10-06T01:25:38.336 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:38.335+0000 7f8312ffd700 1 --2- 172.21.15.50:0/3402004549 >> [v2:172.21.15.155:6808/85806,v1:172.21.15.155:6809/85806] conn(0x7f831806d850 0x7f831806fca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:25:38.336 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:38.335+0000 7f8312ffd700 1 -- 172.21.15.50:0/3402004549 --> [v2:172.21.15.155:6808/85806,v1:172.21.15.155:6809/85806] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f8318070370 con 0x7f831806d850 2023-10-06T01:25:38.336 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:38.335+0000 7f8312ffd700 1 -- 172.21.15.50:0/3402004549 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_get_version_reply(handle=1 version=44) v2 ==== 24+0+0 (secure 0 0 0) 0x7f831c087ae0 con 0x7f832c06ad20 2023-10-06T01:25:38.336 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:38.335+0000 7f832a7fc700 1 --2- 172.21.15.50:0/3402004549 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f8318066f30 0x7f83180693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:25:38.336 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:38.335+0000 7f832b7fe700 1 --2- 172.21.15.50:0/3402004549 >> [v2:172.21.15.155:6808/85806,v1:172.21.15.155:6809/85806] conn(0x7f831806d850 0x7f831806fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:25:38.336 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:38.335+0000 7f832a7fc700 1 --2- 172.21.15.50:0/3402004549 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f8318066f30 0x7f83180693e0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f8320007fd0 tx=0x7f8320009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:25:38.336 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:38.336+0000 7f832b7fe700 1 --2- 172.21.15.50:0/3402004549 >> [v2:172.21.15.155:6808/85806,v1:172.21.15.155:6809/85806] conn(0x7f831806d850 0x7f831806fca0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:25:38.337 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:38.336+0000 7f8312ffd700 1 -- 172.21.15.50:0/3402004549 <== osd.6 v2:172.21.15.155:6808/85806 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7f8318070370 con 0x7f831806d850 2023-10-06T01:25:38.352 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:38.351+0000 7f83319ff700 1 -- 172.21.15.50:0/3402004549 --> [v2:172.21.15.155:6808/85806,v1:172.21.15.155:6809/85806] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f832c04bb80 con 0x7f831806d850 2023-10-06T01:25:38.352 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:38.352+0000 7f8312ffd700 1 -- 172.21.15.50:0/3402004549 <== osd.6 v2:172.21.15.155:6808/85806 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f832c04bb80 con 0x7f831806d850 2023-10-06T01:25:38.353 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2023-10-06T01:25:38.353 INFO:teuthology.orchestra.run.smithi050.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-10-06T01:25:38.353 INFO:teuthology.orchestra.run.smithi050.stdout:} 2023-10-06T01:25:38.354 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:38.352+0000 7f83319ff700 1 -- 172.21.15.50:0/3402004549 >> [v2:172.21.15.155:6808/85806,v1:172.21.15.155:6809/85806] conn(0x7f831806d850 msgr2=0x7f831806fca0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:25:38.354 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:38.352+0000 7f83319ff700 1 --2- 172.21.15.50:0/3402004549 >> [v2:172.21.15.155:6808/85806,v1:172.21.15.155:6809/85806] conn(0x7f831806d850 0x7f831806fca0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:25:38.354 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:38.352+0000 7f83319ff700 1 -- 172.21.15.50:0/3402004549 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f8318066f30 msgr2=0x7f83180693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:25:38.354 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:38.352+0000 7f83319ff700 1 --2- 172.21.15.50:0/3402004549 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f8318066f30 0x7f83180693e0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f8320007fd0 tx=0x7f8320009040 comp rx=0 tx=0).stop 2023-10-06T01:25:38.354 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:38.352+0000 7f83319ff700 1 -- 172.21.15.50:0/3402004549 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f832c06ad20 msgr2=0x7f832c0a8da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:25:38.354 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:38.352+0000 7f83319ff700 1 --2- 172.21.15.50:0/3402004549 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f832c06ad20 0x7f832c0a8da0 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f832c069710 tx=0x7f831c017000 comp rx=0 tx=0).stop 2023-10-06T01:25:38.355 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:38.352+0000 7f832b7fe700 1 -- 172.21.15.50:0/3402004549 reap_dead start 2023-10-06T01:25:38.355 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:38.352+0000 7f83319ff700 1 -- 172.21.15.50:0/3402004549 shutdown_connections 2023-10-06T01:25:38.355 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:38.352+0000 7f83319ff700 1 -- 172.21.15.50:0/3402004549 >> 172.21.15.50:0/3402004549 conn(0x7f832c0cc110 msgr2=0x7f832c0c52c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:25:38.355 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:38.352+0000 7f83319ff700 1 -- 172.21.15.50:0/3402004549 shutdown_connections 2023-10-06T01:25:38.355 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:38.353+0000 7f83319ff700 1 -- 172.21.15.50:0/3402004549 wait complete. 2023-10-06T01:25:38.369 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2023-10-06T01:25:38.558 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:38.557+0000 7f4a4339d700 1 Processor -- start 2023-10-06T01:25:38.559 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:38.558+0000 7f4a4339d700 1 -- start start 2023-10-06T01:25:38.560 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:38.559+0000 7f4a4339d700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f4a3c159a60 0x7f4a3c159ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:25:38.560 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:38.559+0000 7f4a4339d700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f4a3c0675f0 0x7f4a3c067a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:25:38.560 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:38.559+0000 7f4a4339d700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4a3c0c9a60 con 0x7f4a3c0c79f0 2023-10-06T01:25:38.560 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:38.559+0000 7f4a4339d700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4a3c067f70 con 0x7f4a3c0675f0 2023-10-06T01:25:38.560 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:38.559+0000 7f4a4339d700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4a3c15a590 con 0x7f4a3c159a60 2023-10-06T01:25:38.560 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:38.559+0000 7f4a4239b700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f4a3c0c79f0 0x7f4a3c0c9ef0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:41372/0 (socket says 172.21.15.50:41372) 2023-10-06T01:25:38.560 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:38.559+0000 7f4a4239b700 1 -- 172.21.15.50:0/1387309038 learned_addr learned my addr 172.21.15.50:0/1387309038 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-10-06T01:25:38.560 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:38.559+0000 7f4a42b9c700 1 --2- 172.21.15.50:0/1387309038 >> v2:172.21.15.50:3300/0 conn(0x7f4a3c0675f0 0x7f4a3c067a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:25:38.562 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:38.560+0000 7f4a41b9a700 1 --2- 172.21.15.50:0/1387309038 >> v2:172.21.15.155:3300/0 conn(0x7f4a3c159a60 0x7f4a3c159ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:25:38.562 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:38.560+0000 7f4a41399700 1 -- 172.21.15.50:0/1387309038 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4006418528 0 0) 0x7f4a3c0c9a60 con 0x7f4a3c0c79f0 2023-10-06T01:25:38.563 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:38.560+0000 7f4a41399700 1 -- 172.21.15.50:0/1387309038 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4a28003570 con 0x7f4a3c0c79f0 2023-10-06T01:25:38.563 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:38.560+0000 7f4a42b9c700 1 -- 172.21.15.50:0/1387309038 >> v2:172.21.15.155:3300/0 conn(0x7f4a3c159a60 msgr2=0x7f4a3c159ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:25:38.563 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:38.560+0000 7f4a42b9c700 1 --2- 172.21.15.50:0/1387309038 >> v2:172.21.15.155:3300/0 conn(0x7f4a3c159a60 0x7f4a3c159ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:25:38.563 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:38.560+0000 7f4a42b9c700 1 -- 172.21.15.50:0/1387309038 >> v1:172.21.15.50:6789/0 conn(0x7f4a3c0c79f0 legacy=0x7f4a3c0c9ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:25:38.563 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:38.560+0000 7f4a42b9c700 1 -- 172.21.15.50:0/1387309038 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a3c15a870 con 0x7f4a3c0675f0 2023-10-06T01:25:38.563 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:38.560+0000 7f4a42b9c700 1 --2- 172.21.15.50:0/1387309038 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4a3c0675f0 0x7f4a3c067a30 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f4a3c06f800 tx=0x7f4a34009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3ed6f47129398111 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:25:38.563 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:38.560+0000 7f4a41399700 1 -- 172.21.15.50:0/1387309038 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a3400e070 con 0x7f4a3c0675f0 2023-10-06T01:25:38.563 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:38.560+0000 7f4a41399700 1 -- 172.21.15.50:0/1387309038 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a3400bb60 con 0x7f4a3c0675f0 2023-10-06T01:25:38.563 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:38.560+0000 7f4a41399700 1 -- 172.21.15.50:0/1387309038 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a34012430 con 0x7f4a3c0675f0 2023-10-06T01:25:38.563 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:38.561+0000 7f4a4339d700 1 -- 172.21.15.50:0/1387309038 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4a3c0675f0 msgr2=0x7f4a3c067a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:25:38.563 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:38.561+0000 7f4a4339d700 1 --2- 172.21.15.50:0/1387309038 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4a3c0675f0 0x7f4a3c067a30 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f4a3c06f800 tx=0x7f4a34009780 comp rx=0 tx=0).stop 2023-10-06T01:25:38.564 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:38.561+0000 7f4a4339d700 1 -- 172.21.15.50:0/1387309038 shutdown_connections 2023-10-06T01:25:38.564 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:38.561+0000 7f4a4339d700 1 --2- 172.21.15.50:0/1387309038 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4a3c0675f0 0x7f4a3c067a30 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:25:38.564 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:38.561+0000 7f4a4339d700 1 --2- 172.21.15.50:0/1387309038 >> v2:172.21.15.155:3300/0 conn(0x7f4a3c159a60 0x7f4a3c159ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:25:38.564 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:38.561+0000 7f4a4339d700 1 -- 172.21.15.50:0/1387309038 >> 172.21.15.50:0/1387309038 conn(0x7f4a3c068700 msgr2=0x7f4a3c068b00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:25:38.564 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:38.561+0000 7f4a4339d700 1 -- 172.21.15.50:0/1387309038 shutdown_connections 2023-10-06T01:25:38.564 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:38.561+0000 7f4a4339d700 1 -- 172.21.15.50:0/1387309038 wait complete. 2023-10-06T01:25:38.566 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:38.562+0000 7f4a4339d700 1 Processor -- start 2023-10-06T01:25:38.566 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:38.563+0000 7f4a4339d700 1 -- start start 2023-10-06T01:25:38.566 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:38.563+0000 7f4a4339d700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4a3c0675f0 0x7f4a3c1527e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:25:38.566 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:38.564+0000 7f4a4339d700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4a3c0c79f0 0x7f4a3c15d4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:25:38.566 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:38.564+0000 7f4a4339d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4a3c159a60 0x7f4a3c15da00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:25:38.567 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:38.564+0000 7f4a4339d700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a3c0b0e70 con 0x7f4a3c159a60 2023-10-06T01:25:38.567 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:38.564+0000 7f4a4339d700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a3c0b1150 con 0x7f4a3c0c79f0 2023-10-06T01:25:38.567 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:38.564+0000 7f4a4339d700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a3c0b1430 con 0x7f4a3c0675f0 2023-10-06T01:25:38.567 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:38.564+0000 7f4a42b9c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4a3c159a60 0x7f4a3c15da00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:25:38.567 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:38.564+0000 7f4a42b9c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4a3c159a60 0x7f4a3c15da00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:33866/0 (socket says 172.21.15.50:33866) 2023-10-06T01:25:38.567 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:38.564+0000 7f4a42b9c700 1 -- 172.21.15.50:0/2953338979 learned_addr learned my addr 172.21.15.50:0/2953338979 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-06T01:25:38.567 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:38.564+0000 7f4a4239b700 1 --2- 172.21.15.50:0/2953338979 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4a3c0675f0 0x7f4a3c1527e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:25:38.567 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:38.564+0000 7f4a41b9a700 1 --2- 172.21.15.50:0/2953338979 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4a3c0c79f0 0x7f4a3c15d4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:25:38.567 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:38.564+0000 7f4a42b9c700 1 -- 172.21.15.50:0/2953338979 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4a3c0675f0 msgr2=0x7f4a3c1527e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:25:38.567 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:38.564+0000 7f4a42b9c700 1 --2- 172.21.15.50:0/2953338979 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4a3c0675f0 0x7f4a3c1527e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:25:38.567 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:38.564+0000 7f4a42b9c700 1 -- 172.21.15.50:0/2953338979 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4a3c0c79f0 msgr2=0x7f4a3c15d4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:25:38.568 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:38.564+0000 7f4a42b9c700 1 --2- 172.21.15.50:0/2953338979 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4a3c0c79f0 0x7f4a3c15d4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:25:38.568 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:38.564+0000 7f4a42b9c700 1 -- 172.21.15.50:0/2953338979 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a34009a20 con 0x7f4a3c159a60 2023-10-06T01:25:38.568 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:38.564+0000 7f4a41b9a700 1 --2- 172.21.15.50:0/2953338979 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4a3c0c79f0 0x7f4a3c15d4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T01:25:38.568 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:38.564+0000 7f4a42b9c700 1 --2- 172.21.15.50:0/2953338979 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4a3c159a60 0x7f4a3c15da00 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f4a34009fd0 tx=0x7f4a34019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:25:38.568 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:38.565+0000 7f4a327fc700 1 -- 172.21.15.50:0/2953338979 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a34012e00 con 0x7f4a3c159a60 2023-10-06T01:25:38.568 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:38.565+0000 7f4a327fc700 1 -- 172.21.15.50:0/2953338979 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a3401d630 con 0x7f4a3c159a60 2023-10-06T01:25:38.568 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:38.565+0000 7f4a4339d700 1 -- 172.21.15.50:0/2953338979 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4a3c0b1710 con 0x7f4a3c159a60 2023-10-06T01:25:38.568 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:38.565+0000 7f4a327fc700 1 -- 172.21.15.50:0/2953338979 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a3401d9f0 con 0x7f4a3c159a60 2023-10-06T01:25:38.568 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:38.565+0000 7f4a4339d700 1 -- 172.21.15.50:0/2953338979 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4a3c152d20 con 0x7f4a3c159a60 2023-10-06T01:25:38.569 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:38.566+0000 7f4a4339d700 1 -- 172.21.15.50:0/2953338979 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4a3c152f10 con 0x7f4a3c159a60 2023-10-06T01:25:38.569 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:38.567+0000 7f4a327fc700 1 -- 172.21.15.50:0/2953338979 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f4a34024070 con 0x7f4a3c159a60 2023-10-06T01:25:38.569 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:38.568+0000 7f4a327fc700 1 --2- 172.21.15.50:0/2953338979 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f4a20066f30 0x7f4a200693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:25:38.569 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:38.568+0000 7f4a327fc700 1 -- 172.21.15.50:0/2953338979 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5612+0+0 (secure 0 0 0) 0x7f4a34086e00 con 0x7f4a3c159a60 2023-10-06T01:25:38.569 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:38.568+0000 7f4a4239b700 1 --2- 172.21.15.50:0/2953338979 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f4a20066f30 0x7f4a200693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:25:38.570 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:38.569+0000 7f4a4239b700 1 --2- 172.21.15.50:0/2953338979 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f4a20066f30 0x7f4a200693e0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f4a3c157540 tx=0x7f4a38009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:25:38.572 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:38.572+0000 7f4a327fc700 1 -- 172.21.15.50:0/2953338979 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4a34054030 con 0x7f4a3c159a60 2023-10-06T01:25:38.775 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:38.774+0000 7f4a4339d700 1 -- 172.21.15.50:0/2953338979 --> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "6", "target": ["mon-mgr", ""]}) v1 -- 0x7f4a3c0b12c0 con 0x7f4a20066f30 2023-10-06T01:25:38.776 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:38.775+0000 7f4a327fc700 1 -- 172.21.15.50:0/2953338979 <== mgr.4099 v2:172.21.15.155:6832/85215 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 6 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f4a3c0b12c0 con 0x7f4a20066f30 2023-10-06T01:25:38.779 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:38.777+0000 7f4a4339d700 1 -- 172.21.15.50:0/2953338979 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f4a20066f30 msgr2=0x7f4a200693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:25:38.779 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:38.777+0000 7f4a4339d700 1 --2- 172.21.15.50:0/2953338979 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f4a20066f30 0x7f4a200693e0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f4a3c157540 tx=0x7f4a38009040 comp rx=0 tx=0).stop 2023-10-06T01:25:38.779 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:38.777+0000 7f4a4339d700 1 -- 172.21.15.50:0/2953338979 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4a3c159a60 msgr2=0x7f4a3c15da00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:25:38.779 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:38.777+0000 7f4a4339d700 1 --2- 172.21.15.50:0/2953338979 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4a3c159a60 0x7f4a3c15da00 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f4a34009fd0 tx=0x7f4a34019000 comp rx=0 tx=0).stop 2023-10-06T01:25:38.779 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:38.778+0000 7f4a4339d700 1 -- 172.21.15.50:0/2953338979 shutdown_connections 2023-10-06T01:25:38.779 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:38.778+0000 7f4a4339d700 1 --2- 172.21.15.50:0/2953338979 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4a3c159a60 0x7f4a3c15da00 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:25:38.779 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:38.778+0000 7f4a4339d700 1 --2- 172.21.15.50:0/2953338979 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4a3c0675f0 0x7f4a3c1527e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:25:38.781 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:38.778+0000 7f4a4339d700 1 --2- 172.21.15.50:0/2953338979 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f4a20066f30 0x7f4a200693e0 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:25:38.781 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:38.778+0000 7f4a4339d700 1 --2- 172.21.15.50:0/2953338979 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4a3c0c79f0 0x7f4a3c15d4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:25:38.781 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:38.778+0000 7f4a4339d700 1 -- 172.21.15.50:0/2953338979 >> 172.21.15.50:0/2953338979 conn(0x7f4a3c068700 msgr2=0x7f4a3c0c9ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:25:38.781 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:38.778+0000 7f4a4339d700 1 -- 172.21.15.50:0/2953338979 shutdown_connections 2023-10-06T01:25:38.781 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:38.778+0000 7f4a4339d700 1 -- 172.21.15.50:0/2953338979 wait complete. 2023-10-06T01:25:38.782 INFO:teuthology.orchestra.run.smithi050.stderr:instructed osd(s) 6 to deep-scrub 2023-10-06T01:25:38.796 INFO:tasks.ceph:Scrubbing osd.7 2023-10-06T01:25:38.796 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2023-10-06T01:25:38.990 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:38.989+0000 7f13b559d700 1 Processor -- start 2023-10-06T01:25:38.990 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:38.989+0000 7f13b559d700 1 -- start start 2023-10-06T01:25:38.993 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:38.991+0000 7f13b559d700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f13b006f110 0x7f13b00ade80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:25:38.993 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:38.991+0000 7f13b559d700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f13b0156e50 con 0x7f13b00cb6c0 2023-10-06T01:25:38.993 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:38.991+0000 7f13b559d700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f13b0157720 con 0x7f13b00cba90 2023-10-06T01:25:38.993 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:38.991+0000 7f13b559d700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f13b0156b70 con 0x7f13b006f110 2023-10-06T01:25:38.993 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:38.991+0000 7f13affff700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f13b00cb6c0 0x7f13b0157010 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:41380/0 (socket says 172.21.15.50:41380) 2023-10-06T01:25:38.993 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:38.991+0000 7f13affff700 1 -- 172.21.15.50:0/245950553 learned_addr learned my addr 172.21.15.50:0/245950553 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-10-06T01:25:38.993 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:38.991+0000 7f13b4d9c700 1 --2- 172.21.15.50:0/245950553 >> v2:172.21.15.155:3300/0 conn(0x7f13b006f110 0x7f13b00ade80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:25:38.993 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:38.991+0000 7f13aeffd700 1 -- 172.21.15.50:0/245950553 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3638671664 0 0) 0x7f13a0001110 con 0x7f13b00cb6c0 2023-10-06T01:25:38.993 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:38.992+0000 7f13aeffd700 1 -- 172.21.15.50:0/245950553 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1398004680 con 0x7f13b00cb6c0 2023-10-06T01:25:38.993 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:38.992+0000 7f13aeffd700 1 -- 172.21.15.50:0/245950553 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1248608928 0 0) 0x7f13b0157720 con 0x7f13b00cba90 2023-10-06T01:25:38.994 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:38.992+0000 7f13aeffd700 1 -- 172.21.15.50:0/245950553 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f13a0001110 con 0x7f13b00cba90 2023-10-06T01:25:38.994 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:38.992+0000 7f13aeffd700 1 -- 172.21.15.50:0/245950553 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1019622907 0 0) 0x7f1398004680 con 0x7f13b00cb6c0 2023-10-06T01:25:38.994 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:38.992+0000 7f13b4d9c700 1 -- 172.21.15.50:0/245950553 >> v1:172.21.15.155:6789/0 conn(0x7f13b00cba90 legacy=0x7f13b006ea00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:25:38.994 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:38.992+0000 7f13b4d9c700 1 -- 172.21.15.50:0/245950553 >> v1:172.21.15.50:6789/0 conn(0x7f13b00cb6c0 legacy=0x7f13b0157010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:25:38.994 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:38.992+0000 7f13b4d9c700 1 -- 172.21.15.50:0/245950553 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13b00ad3a0 con 0x7f13b006f110 2023-10-06T01:25:38.994 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:38.992+0000 7f13b4d9c700 1 --2- 172.21.15.50:0/245950553 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f13b006f110 0x7f13b00ade80 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f13a8009e60 tx=0x7f13a8009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=287826cd2e96cb11 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:25:38.995 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:38.992+0000 7f13aeffd700 1 -- 172.21.15.50:0/245950553 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13a800e070 con 0x7f13b006f110 2023-10-06T01:25:38.995 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:38.993+0000 7f13aeffd700 1 -- 172.21.15.50:0/245950553 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f13a800b7a0 con 0x7f13b006f110 2023-10-06T01:25:38.996 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:38.993+0000 7f13aeffd700 1 -- 172.21.15.50:0/245950553 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13a0001600 con 0x7f13b006f110 2023-10-06T01:25:38.996 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:38.993+0000 7f13b559d700 1 -- 172.21.15.50:0/245950553 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f13b006f110 msgr2=0x7f13b00ade80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:25:38.996 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:38.993+0000 7f13b559d700 1 --2- 172.21.15.50:0/245950553 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f13b006f110 0x7f13b00ade80 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f13a8009e60 tx=0x7f13a8009780 comp rx=0 tx=0).stop 2023-10-06T01:25:38.996 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:38.993+0000 7f13b559d700 1 -- 172.21.15.50:0/245950553 shutdown_connections 2023-10-06T01:25:38.996 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:38.993+0000 7f13b559d700 1 --2- 172.21.15.50:0/245950553 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f13b006f110 0x7f13b00ade80 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:25:38.996 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:38.993+0000 7f13b559d700 1 -- 172.21.15.50:0/245950553 >> 172.21.15.50:0/245950553 conn(0x7f13b00cbee0 msgr2=0x7f13b00cc2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:25:38.996 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:38.993+0000 7f13b559d700 1 -- 172.21.15.50:0/245950553 shutdown_connections 2023-10-06T01:25:38.996 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:38.993+0000 7f13b559d700 1 -- 172.21.15.50:0/245950553 wait complete. 2023-10-06T01:25:38.996 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:38.995+0000 7f13b559d700 1 Processor -- start 2023-10-06T01:25:38.996 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:38.995+0000 7f13b559d700 1 -- start start 2023-10-06T01:25:38.998 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:38.996+0000 7f13b559d700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f13b006f110 0x7f13b0144a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:25:38.998 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:38.996+0000 7f13b559d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f13b00cb6c0 0x7f13b0167f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:25:38.998 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:38.996+0000 7f13b559d700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f13b00cba90 0x7f13b00a8dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:25:38.999 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:38.996+0000 7f13b559d700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13b0144fd0 con 0x7f13b00cb6c0 2023-10-06T01:25:38.999 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:38.996+0000 7f13b559d700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13b01684d0 con 0x7f13b00cba90 2023-10-06T01:25:38.999 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:38.996+0000 7f13b559d700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f13b00ab200 con 0x7f13b006f110 2023-10-06T01:25:38.999 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:38.996+0000 7f13af7fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f13b00cb6c0 0x7f13b0167f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:25:38.999 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:38.996+0000 7f13af7fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f13b00cb6c0 0x7f13b0167f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:33874/0 (socket says 172.21.15.50:33874) 2023-10-06T01:25:38.999 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:38.996+0000 7f13af7fe700 1 -- 172.21.15.50:0/188992047 learned_addr learned my addr 172.21.15.50:0/188992047 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-06T01:25:38.999 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:38.996+0000 7f13affff700 1 --2- 172.21.15.50:0/188992047 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f13b006f110 0x7f13b0144a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:25:38.999 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:38.996+0000 7f13b4d9c700 1 --2- 172.21.15.50:0/188992047 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f13b00cba90 0x7f13b00a8dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:25:38.999 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:38.996+0000 7f13af7fe700 1 -- 172.21.15.50:0/188992047 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f13b006f110 msgr2=0x7f13b0144a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:25:38.999 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:38.996+0000 7f13af7fe700 1 --2- 172.21.15.50:0/188992047 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f13b006f110 0x7f13b0144a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:25:38.999 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:38.996+0000 7f13af7fe700 1 -- 172.21.15.50:0/188992047 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f13b00cba90 msgr2=0x7f13b00a8dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:25:39.000 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:38.996+0000 7f13af7fe700 1 --2- 172.21.15.50:0/188992047 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f13b00cba90 0x7f13b00a8dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:25:39.000 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:38.996+0000 7f13af7fe700 1 -- 172.21.15.50:0/188992047 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13a8009a20 con 0x7f13b00cb6c0 2023-10-06T01:25:39.000 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:38.997+0000 7f13af7fe700 1 --2- 172.21.15.50:0/188992047 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f13b00cb6c0 0x7f13b0167f90 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f13a400c7c0 tx=0x7f13a4007db0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:25:39.000 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:38.997+0000 7f1397fff700 1 -- 172.21.15.50:0/188992047 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13a4010510 con 0x7f13b00cb6c0 2023-10-06T01:25:39.000 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:38.997+0000 7f1397fff700 1 -- 172.21.15.50:0/188992047 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f13a4010690 con 0x7f13b00cb6c0 2023-10-06T01:25:39.000 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:38.997+0000 7f1397fff700 1 -- 172.21.15.50:0/188992047 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13a4010a50 con 0x7f13b00cb6c0 2023-10-06T01:25:39.000 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:38.997+0000 7f13b559d700 1 -- 172.21.15.50:0/188992047 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f13b00ab4e0 con 0x7f13b00cb6c0 2023-10-06T01:25:39.000 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:38.997+0000 7f13b559d700 1 -- 172.21.15.50:0/188992047 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f13b00abaa0 con 0x7f13b00cb6c0 2023-10-06T01:25:39.001 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:38.998+0000 7f13b559d700 1 -- 172.21.15.50:0/188992047 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f13b00affd0 con 0x7f13b00cb6c0 2023-10-06T01:25:39.001 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:38.999+0000 7f1397fff700 1 -- 172.21.15.50:0/188992047 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f13a401b400 con 0x7f13b00cb6c0 2023-10-06T01:25:39.002 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:39.000+0000 7f1397fff700 1 --2- 172.21.15.50:0/188992047 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f139c066f30 0x7f139c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:25:39.002 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:39.000+0000 7f1397fff700 1 -- 172.21.15.50:0/188992047 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5612+0+0 (secure 0 0 0) 0x7f13a4084200 con 0x7f13b00cb6c0 2023-10-06T01:25:39.002 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:39.000+0000 7f1397fff700 1 --2- 172.21.15.50:0/188992047 >> [v2:172.21.15.155:6817/85832,v1:172.21.15.155:6819/85832] conn(0x7f139c06d850 0x7f139c06fca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:25:39.002 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:39.000+0000 7f1397fff700 1 -- 172.21.15.50:0/188992047 --> [v2:172.21.15.155:6817/85832,v1:172.21.15.155:6819/85832] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f139c070370 con 0x7f139c06d850 2023-10-06T01:25:39.002 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:39.000+0000 7f1397fff700 1 -- 172.21.15.50:0/188992047 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_get_version_reply(handle=1 version=44) v2 ==== 24+0+0 (secure 0 0 0) 0x7f13a4086760 con 0x7f13b00cb6c0 2023-10-06T01:25:39.002 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:39.001+0000 7f13affff700 1 --2- 172.21.15.50:0/188992047 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f139c066f30 0x7f139c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:25:39.002 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:39.001+0000 7f13b4d9c700 1 --2- 172.21.15.50:0/188992047 >> [v2:172.21.15.155:6817/85832,v1:172.21.15.155:6819/85832] conn(0x7f139c06d850 0x7f139c06fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:25:39.003 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:39.001+0000 7f13affff700 1 --2- 172.21.15.50:0/188992047 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f139c066f30 0x7f139c0693e0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f13a0001730 tx=0x7f13a0000bc0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:25:39.003 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:39.001+0000 7f13b4d9c700 1 --2- 172.21.15.50:0/188992047 >> [v2:172.21.15.155:6817/85832,v1:172.21.15.155:6819/85832] conn(0x7f139c06d850 0x7f139c06fca0 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:25:39.003 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:39.002+0000 7f1397fff700 1 -- 172.21.15.50:0/188992047 <== osd.7 v2:172.21.15.155:6817/85832 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7f139c070370 con 0x7f139c06d850 2023-10-06T01:25:39.018 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:39.017+0000 7f13b559d700 1 -- 172.21.15.50:0/188992047 --> [v2:172.21.15.155:6817/85832,v1:172.21.15.155:6819/85832] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f13b005f270 con 0x7f139c06d850 2023-10-06T01:25:39.018 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:39.017+0000 7f1397fff700 1 -- 172.21.15.50:0/188992047 <== osd.7 v2:172.21.15.155:6817/85832 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f13b005f270 con 0x7f139c06d850 2023-10-06T01:25:39.019 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2023-10-06T01:25:39.019 INFO:teuthology.orchestra.run.smithi050.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-10-06T01:25:39.019 INFO:teuthology.orchestra.run.smithi050.stdout:} 2023-10-06T01:25:39.020 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:39.018+0000 7f13b559d700 1 -- 172.21.15.50:0/188992047 >> [v2:172.21.15.155:6817/85832,v1:172.21.15.155:6819/85832] conn(0x7f139c06d850 msgr2=0x7f139c06fca0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:25:39.020 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:39.018+0000 7f13b559d700 1 --2- 172.21.15.50:0/188992047 >> [v2:172.21.15.155:6817/85832,v1:172.21.15.155:6819/85832] conn(0x7f139c06d850 0x7f139c06fca0 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:25:39.020 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:39.018+0000 7f13b559d700 1 -- 172.21.15.50:0/188992047 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f139c066f30 msgr2=0x7f139c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:25:39.020 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:39.018+0000 7f13b559d700 1 --2- 172.21.15.50:0/188992047 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f139c066f30 0x7f139c0693e0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f13a0001730 tx=0x7f13a0000bc0 comp rx=0 tx=0).stop 2023-10-06T01:25:39.020 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:39.018+0000 7f13b559d700 1 -- 172.21.15.50:0/188992047 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f13b00cb6c0 msgr2=0x7f13b0167f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:25:39.020 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:39.018+0000 7f13b559d700 1 --2- 172.21.15.50:0/188992047 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f13b00cb6c0 0x7f13b0167f90 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f13a400c7c0 tx=0x7f13a4007db0 comp rx=0 tx=0).stop 2023-10-06T01:25:39.020 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:39.018+0000 7f13b4d9c700 1 -- 172.21.15.50:0/188992047 reap_dead start 2023-10-06T01:25:39.020 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:39.018+0000 7f13b559d700 1 -- 172.21.15.50:0/188992047 shutdown_connections 2023-10-06T01:25:39.021 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:39.018+0000 7f13b559d700 1 -- 172.21.15.50:0/188992047 >> 172.21.15.50:0/188992047 conn(0x7f13b00cbee0 msgr2=0x7f13b00aec80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:25:39.021 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:39.018+0000 7f13b559d700 1 -- 172.21.15.50:0/188992047 shutdown_connections 2023-10-06T01:25:39.021 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:39.018+0000 7f13b559d700 1 -- 172.21.15.50:0/188992047 wait complete. 2023-10-06T01:25:39.035 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2023-10-06T01:25:39.223 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:39.222+0000 7fea6639d700 1 Processor -- start 2023-10-06T01:25:39.223 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:39.222+0000 7fea6639d700 1 -- start start 2023-10-06T01:25:39.225 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:39.223+0000 7fea6639d700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fea60159360 0x7fea600cc0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:25:39.225 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:39.223+0000 7fea6639d700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fea6015dba0 0x7fea600675f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:25:39.225 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:39.223+0000 7fea6639d700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fea600c1730 con 0x7fea6015cff0 2023-10-06T01:25:39.225 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:39.223+0000 7fea6639d700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fea600c2590 con 0x7fea60159360 2023-10-06T01:25:39.225 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:39.223+0000 7fea6639d700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fea600c1980 con 0x7fea6015dba0 2023-10-06T01:25:39.225 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:39.223+0000 7fea6539b700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fea60159360 0x7fea600cc0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:25:39.225 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:39.223+0000 7fea6539b700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fea60159360 0x7fea600cc0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:33882/0 (socket says 172.21.15.50:33882) 2023-10-06T01:25:39.225 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:39.223+0000 7fea6539b700 1 -- 172.21.15.50:0/4170501306 learned_addr learned my addr 172.21.15.50:0/4170501306 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-06T01:25:39.225 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:39.224+0000 7fea65b9c700 1 --2- 172.21.15.50:0/4170501306 >> v2:172.21.15.155:3300/0 conn(0x7fea6015dba0 0x7fea600675f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:25:39.226 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:39.224+0000 7fea6539b700 1 -- 172.21.15.50:0/4170501306 >> v2:172.21.15.155:3300/0 conn(0x7fea6015dba0 msgr2=0x7fea600675f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:25:39.226 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:39.224+0000 7fea6539b700 1 --2- 172.21.15.50:0/4170501306 >> v2:172.21.15.155:3300/0 conn(0x7fea6015dba0 0x7fea600675f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:25:39.226 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:39.224+0000 7fea6539b700 1 -- 172.21.15.50:0/4170501306 >> v1:172.21.15.155:6789/0 conn(0x7fea6015cff0 legacy=0x7fea6015d490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:25:39.226 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:39.224+0000 7fea6539b700 1 -- 172.21.15.50:0/4170501306 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea600c1c60 con 0x7fea60159360 2023-10-06T01:25:39.226 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:39.224+0000 7fea6539b700 1 --2- 172.21.15.50:0/4170501306 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fea60159360 0x7fea600cc0d0 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7fea600af280 tx=0x7fea5c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1e47e1c0894d6581 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:25:39.227 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:39.224+0000 7fea57fff700 1 -- 172.21.15.50:0/4170501306 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea5c00b860 con 0x7fea60159360 2023-10-06T01:25:39.227 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:39.224+0000 7fea57fff700 1 -- 172.21.15.50:0/4170501306 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea5c00b9c0 con 0x7fea60159360 2023-10-06T01:25:39.227 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:39.224+0000 7fea57fff700 1 -- 172.21.15.50:0/4170501306 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea5c00bd60 con 0x7fea60159360 2023-10-06T01:25:39.227 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:39.225+0000 7fea6639d700 1 -- 172.21.15.50:0/4170501306 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fea60159360 msgr2=0x7fea600cc0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:25:39.227 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:39.225+0000 7fea6639d700 1 --2- 172.21.15.50:0/4170501306 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fea60159360 0x7fea600cc0d0 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7fea600af280 tx=0x7fea5c009250 comp rx=0 tx=0).stop 2023-10-06T01:25:39.227 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:39.225+0000 7fea6639d700 1 -- 172.21.15.50:0/4170501306 shutdown_connections 2023-10-06T01:25:39.227 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:39.225+0000 7fea6639d700 1 --2- 172.21.15.50:0/4170501306 >> v2:172.21.15.155:3300/0 conn(0x7fea6015dba0 0x7fea600675f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:25:39.227 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:39.225+0000 7fea6639d700 1 --2- 172.21.15.50:0/4170501306 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fea60159360 0x7fea600cc0d0 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:25:39.228 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:39.225+0000 7fea6639d700 1 -- 172.21.15.50:0/4170501306 >> 172.21.15.50:0/4170501306 conn(0x7fea600c91e0 msgr2=0x7fea600c95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:25:39.228 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:39.225+0000 7fea6639d700 1 -- 172.21.15.50:0/4170501306 shutdown_connections 2023-10-06T01:25:39.228 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:39.225+0000 7fea6639d700 1 -- 172.21.15.50:0/4170501306 wait complete. 2023-10-06T01:25:39.230 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:39.227+0000 7fea6639d700 1 Processor -- start 2023-10-06T01:25:39.230 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:39.227+0000 7fea6639d700 1 -- start start 2023-10-06T01:25:39.230 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:39.228+0000 7fea6639d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fea60159360 0x7fea6015c0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:25:39.230 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:39.228+0000 7fea6639d700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fea6015cff0 0x7fea60146dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:25:39.231 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:39.228+0000 7fea6639d700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fea6015dba0 0x7fea60147300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:25:39.231 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:39.228+0000 7fea6639d700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea60155a50 con 0x7fea60159360 2023-10-06T01:25:39.231 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:39.228+0000 7fea6639d700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea600af510 con 0x7fea6015cff0 2023-10-06T01:25:39.231 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:39.228+0000 7fea6639d700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea6015a3e0 con 0x7fea6015dba0 2023-10-06T01:25:39.231 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:39.228+0000 7fea6539b700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fea60159360 0x7fea6015c0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:25:39.231 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:39.228+0000 7fea6539b700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fea60159360 0x7fea6015c0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:33892/0 (socket says 172.21.15.50:33892) 2023-10-06T01:25:39.231 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:39.228+0000 7fea6539b700 1 -- 172.21.15.50:0/1553228371 learned_addr learned my addr 172.21.15.50:0/1553228371 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-06T01:25:39.231 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:39.228+0000 7fea64b9a700 1 --2- 172.21.15.50:0/1553228371 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fea6015cff0 0x7fea60146dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:25:39.231 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:39.228+0000 7fea65b9c700 1 --2- 172.21.15.50:0/1553228371 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fea6015dba0 0x7fea60147300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:25:39.231 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:39.228+0000 7fea6539b700 1 -- 172.21.15.50:0/1553228371 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fea6015dba0 msgr2=0x7fea60147300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:25:39.231 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:39.228+0000 7fea6539b700 1 --2- 172.21.15.50:0/1553228371 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fea6015dba0 0x7fea60147300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:25:39.231 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:39.228+0000 7fea6539b700 1 -- 172.21.15.50:0/1553228371 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fea6015cff0 msgr2=0x7fea60146dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:25:39.232 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:39.228+0000 7fea6539b700 1 --2- 172.21.15.50:0/1553228371 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fea6015cff0 0x7fea60146dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:25:39.232 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:39.228+0000 7fea6539b700 1 -- 172.21.15.50:0/1553228371 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea5c0094f0 con 0x7fea60159360 2023-10-06T01:25:39.232 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:39.228+0000 7fea64b9a700 1 --2- 172.21.15.50:0/1553228371 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fea6015cff0 0x7fea60146dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T01:25:39.232 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:39.229+0000 7fea6539b700 1 --2- 172.21.15.50:0/1553228371 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fea60159360 0x7fea6015c0d0 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7fea60071890 tx=0x7fea5c017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:25:39.232 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:39.229+0000 7fea557fa700 1 -- 172.21.15.50:0/1553228371 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea5c011e60 con 0x7fea60159360 2023-10-06T01:25:39.232 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:39.229+0000 7fea557fa700 1 -- 172.21.15.50:0/1553228371 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea5c01a630 con 0x7fea60159360 2023-10-06T01:25:39.232 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:39.229+0000 7fea557fa700 1 -- 172.21.15.50:0/1553228371 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea5c01a9f0 con 0x7fea60159360 2023-10-06T01:25:39.232 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:39.229+0000 7fea6639d700 1 -- 172.21.15.50:0/1553228371 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fea6015a6c0 con 0x7fea60159360 2023-10-06T01:25:39.232 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:39.229+0000 7fea6639d700 1 -- 172.21.15.50:0/1553228371 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fea600afa40 con 0x7fea60159360 2023-10-06T01:25:39.233 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:39.230+0000 7fea6639d700 1 -- 172.21.15.50:0/1553228371 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fea6005f270 con 0x7fea60159360 2023-10-06T01:25:39.233 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:39.231+0000 7fea557fa700 1 -- 172.21.15.50:0/1553228371 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fea5c02d440 con 0x7fea60159360 2023-10-06T01:25:39.233 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:39.232+0000 7fea557fa700 1 --2- 172.21.15.50:0/1553228371 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7fea44066f30 0x7fea440693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:25:39.233 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:39.232+0000 7fea557fa700 1 -- 172.21.15.50:0/1553228371 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5612+0+0 (secure 0 0 0) 0x7fea5c086240 con 0x7fea60159360 2023-10-06T01:25:39.233 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:39.233+0000 7fea64b9a700 1 --2- 172.21.15.50:0/1553228371 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7fea44066f30 0x7fea440693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:25:39.234 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:39.233+0000 7fea64b9a700 1 --2- 172.21.15.50:0/1553228371 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7fea44066f30 0x7fea440693e0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fea50007fd0 tx=0x7fea50009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:25:39.238 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:39.237+0000 7fea557fa700 1 -- 172.21.15.50:0/1553228371 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fea5c053470 con 0x7fea60159360 2023-10-06T01:25:39.437 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:39.437+0000 7fea6639d700 1 -- 172.21.15.50:0/1553228371 --> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "7", "target": ["mon-mgr", ""]}) v1 -- 0x7fea600c1510 con 0x7fea44066f30 2023-10-06T01:25:39.438 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:39.437+0000 7fea557fa700 1 -- 172.21.15.50:0/1553228371 <== mgr.4099 v2:172.21.15.155:6832/85215 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 7 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fea600c1510 con 0x7fea44066f30 2023-10-06T01:25:39.441 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:39.440+0000 7fea6639d700 1 -- 172.21.15.50:0/1553228371 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7fea44066f30 msgr2=0x7fea440693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:25:39.441 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:39.440+0000 7fea6639d700 1 --2- 172.21.15.50:0/1553228371 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7fea44066f30 0x7fea440693e0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fea50007fd0 tx=0x7fea50009040 comp rx=0 tx=0).stop 2023-10-06T01:25:39.441 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:39.440+0000 7fea6639d700 1 -- 172.21.15.50:0/1553228371 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fea60159360 msgr2=0x7fea6015c0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:25:39.441 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:39.440+0000 7fea6639d700 1 --2- 172.21.15.50:0/1553228371 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fea60159360 0x7fea6015c0d0 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7fea60071890 tx=0x7fea5c017000 comp rx=0 tx=0).stop 2023-10-06T01:25:39.442 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:39.440+0000 7fea6639d700 1 -- 172.21.15.50:0/1553228371 shutdown_connections 2023-10-06T01:25:39.442 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:39.440+0000 7fea6639d700 1 --2- 172.21.15.50:0/1553228371 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fea6015dba0 0x7fea60147300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:25:39.442 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:39.440+0000 7fea6639d700 1 --2- 172.21.15.50:0/1553228371 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fea60159360 0x7fea6015c0d0 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:25:39.442 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:39.440+0000 7fea6639d700 1 --2- 172.21.15.50:0/1553228371 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7fea44066f30 0x7fea440693e0 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:25:39.442 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:39.440+0000 7fea6639d700 1 --2- 172.21.15.50:0/1553228371 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fea6015cff0 0x7fea60146dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:25:39.442 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:39.440+0000 7fea6639d700 1 -- 172.21.15.50:0/1553228371 >> 172.21.15.50:0/1553228371 conn(0x7fea600c91e0 msgr2=0x7fea601562e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:25:39.442 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:39.440+0000 7fea6639d700 1 -- 172.21.15.50:0/1553228371 shutdown_connections 2023-10-06T01:25:39.442 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:39.440+0000 7fea6639d700 1 -- 172.21.15.50:0/1553228371 wait complete. 2023-10-06T01:25:39.443 INFO:teuthology.orchestra.run.smithi050.stderr:instructed osd(s) 7 to deep-scrub 2023-10-06T01:25:39.458 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-06T01:25:39.646 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:39.645+0000 7fe52f59e700 1 Processor -- start 2023-10-06T01:25:39.647 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:39.645+0000 7fe52f59e700 1 -- start start 2023-10-06T01:25:39.647 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:39.646+0000 7fe52f59e700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe530140b70 0x7fe53006f190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:25:39.647 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:39.646+0000 7fe52f59e700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fe5300af230 0x7fe5300c77b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:25:39.648 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:39.646+0000 7fe52f59e700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe5300c19f0 con 0x7fe5300aedc0 2023-10-06T01:25:39.648 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:39.646+0000 7fe52f59e700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe5300c0de0 con 0x7fe5300af230 2023-10-06T01:25:39.648 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:39.646+0000 7fe52f59e700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5300c10c0 con 0x7fe530140b70 2023-10-06T01:25:39.648 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:39.647+0000 7fe52dd9b700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fe5300aedc0 0x7fe5300c1e80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:41390/0 (socket says 172.21.15.50:41390) 2023-10-06T01:25:39.648 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:39.647+0000 7fe52dd9b700 1 -- 172.21.15.50:0/757161580 learned_addr learned my addr 172.21.15.50:0/757161580 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-10-06T01:25:39.648 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:39.647+0000 7fe52ed9d700 1 --2- 172.21.15.50:0/757161580 >> v2:172.21.15.155:3300/0 conn(0x7fe5300af230 0x7fe5300c77b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:25:39.648 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:39.647+0000 7fe52e59c700 1 --2- 172.21.15.50:0/757161580 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe530140b70 0x7fe53006f190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:25:39.650 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:39.647+0000 7fe52d59a700 1 -- 172.21.15.50:0/757161580 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3753000132 0 0) 0x7fe5300c19f0 con 0x7fe5300aedc0 2023-10-06T01:25:39.650 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:39.647+0000 7fe52d59a700 1 -- 172.21.15.50:0/757161580 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe518003570 con 0x7fe5300aedc0 2023-10-06T01:25:39.650 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:39.647+0000 7fe52ed9d700 1 -- 172.21.15.50:0/757161580 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe530140b70 msgr2=0x7fe53006f190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:25:39.650 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:39.647+0000 7fe52ed9d700 1 --2- 172.21.15.50:0/757161580 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe530140b70 0x7fe53006f190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:25:39.650 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:39.647+0000 7fe52ed9d700 1 -- 172.21.15.50:0/757161580 >> v1:172.21.15.50:6789/0 conn(0x7fe5300aedc0 legacy=0x7fe5300c1e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:25:39.650 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:39.647+0000 7fe52ed9d700 1 -- 172.21.15.50:0/757161580 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5300c13a0 con 0x7fe5300af230 2023-10-06T01:25:39.650 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:39.647+0000 7fe52e59c700 1 --2- 172.21.15.50:0/757161580 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe530140b70 0x7fe53006f190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T01:25:39.650 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:39.648+0000 7fe52ed9d700 1 --2- 172.21.15.50:0/757161580 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe5300af230 0x7fe5300c77b0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fe528009e60 tx=0x7fe528009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c9bc71fd3ed0c98d server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:25:39.651 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:39.648+0000 7fe52d59a700 1 -- 172.21.15.50:0/757161580 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe52800e070 con 0x7fe5300af230 2023-10-06T01:25:39.651 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:39.648+0000 7fe52d59a700 1 -- 172.21.15.50:0/757161580 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe52800bab0 con 0x7fe5300af230 2023-10-06T01:25:39.651 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:39.648+0000 7fe52d59a700 1 -- 172.21.15.50:0/757161580 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe52800be70 con 0x7fe5300af230 2023-10-06T01:25:39.651 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:39.649+0000 7fe52f59e700 1 -- 172.21.15.50:0/757161580 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe5300af230 msgr2=0x7fe5300c77b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:25:39.651 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:39.649+0000 7fe52f59e700 1 --2- 172.21.15.50:0/757161580 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe5300af230 0x7fe5300c77b0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fe528009e60 tx=0x7fe528009780 comp rx=0 tx=0).stop 2023-10-06T01:25:39.651 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:39.649+0000 7fe52f59e700 1 -- 172.21.15.50:0/757161580 shutdown_connections 2023-10-06T01:25:39.651 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:39.649+0000 7fe52f59e700 1 --2- 172.21.15.50:0/757161580 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe5300af230 0x7fe5300c77b0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:25:39.651 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:39.649+0000 7fe52f59e700 1 --2- 172.21.15.50:0/757161580 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe530140b70 0x7fe53006f190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:25:39.651 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:39.649+0000 7fe52f59e700 1 -- 172.21.15.50:0/757161580 >> 172.21.15.50:0/757161580 conn(0x7fe5300cbef0 msgr2=0x7fe5300cc2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:25:39.651 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:39.649+0000 7fe52f59e700 1 -- 172.21.15.50:0/757161580 shutdown_connections 2023-10-06T01:25:39.651 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:39.649+0000 7fe52f59e700 1 -- 172.21.15.50:0/757161580 wait complete. 2023-10-06T01:25:39.653 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:39.650+0000 7fe52f59e700 1 Processor -- start 2023-10-06T01:25:39.653 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:39.650+0000 7fe52f59e700 1 -- start start 2023-10-06T01:25:39.653 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:39.651+0000 7fe52f59e700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe5300aedc0 0x7fe5300c47b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:25:39.654 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:39.651+0000 7fe52f59e700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe5300af230 0x7fe5301569e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:25:39.654 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:39.651+0000 7fe52f59e700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe530140b70 0x7fe5301677e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:25:39.654 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:39.651+0000 7fe52f59e700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5300c4cf0 con 0x7fe5300aedc0 2023-10-06T01:25:39.654 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:39.651+0000 7fe52f59e700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe530156f20 con 0x7fe5300af230 2023-10-06T01:25:39.654 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:39.651+0000 7fe52f59e700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe530139ee0 con 0x7fe530140b70 2023-10-06T01:25:39.654 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:39.651+0000 7fe52e59c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe5300aedc0 0x7fe5300c47b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:25:39.654 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:39.652+0000 7fe52e59c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe5300aedc0 0x7fe5300c47b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:33904/0 (socket says 172.21.15.50:33904) 2023-10-06T01:25:39.654 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:39.652+0000 7fe52e59c700 1 -- 172.21.15.50:0/211290462 learned_addr learned my addr 172.21.15.50:0/211290462 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-06T01:25:39.654 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:39.652+0000 7fe52ed9d700 1 --2- 172.21.15.50:0/211290462 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe530140b70 0x7fe5301677e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:25:39.654 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:39.652+0000 7fe52dd9b700 1 --2- 172.21.15.50:0/211290462 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe5300af230 0x7fe5301569e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:25:39.654 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:39.652+0000 7fe52e59c700 1 -- 172.21.15.50:0/211290462 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe530140b70 msgr2=0x7fe5301677e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:25:39.655 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:39.652+0000 7fe52e59c700 1 --2- 172.21.15.50:0/211290462 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe530140b70 0x7fe5301677e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:25:39.655 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:39.652+0000 7fe52e59c700 1 -- 172.21.15.50:0/211290462 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe5300af230 msgr2=0x7fe5301569e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:25:39.655 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:39.652+0000 7fe52e59c700 1 --2- 172.21.15.50:0/211290462 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe5300af230 0x7fe5301569e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:25:39.655 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:39.652+0000 7fe52e59c700 1 -- 172.21.15.50:0/211290462 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe520009420 con 0x7fe5300aedc0 2023-10-06T01:25:39.655 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:39.652+0000 7fe52e59c700 1 --2- 172.21.15.50:0/211290462 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe5300aedc0 0x7fe5300c47b0 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7fe52000ecb0 tx=0x7fe5200091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:25:39.655 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:39.652+0000 7fe51e7fc700 1 -- 172.21.15.50:0/211290462 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe52000c950 con 0x7fe5300aedc0 2023-10-06T01:25:39.655 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:39.652+0000 7fe51e7fc700 1 -- 172.21.15.50:0/211290462 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe52000cab0 con 0x7fe5300aedc0 2023-10-06T01:25:39.655 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:39.652+0000 7fe52f59e700 1 -- 172.21.15.50:0/211290462 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe528009a20 con 0x7fe5300aedc0 2023-10-06T01:25:39.655 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:39.653+0000 7fe51e7fc700 1 -- 172.21.15.50:0/211290462 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe52000ce30 con 0x7fe5300aedc0 2023-10-06T01:25:39.655 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:39.653+0000 7fe52f59e700 1 -- 172.21.15.50:0/211290462 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe53013acb0 con 0x7fe5300aedc0 2023-10-06T01:25:39.656 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:39.654+0000 7fe52f59e700 1 -- 172.21.15.50:0/211290462 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe53005f270 con 0x7fe5300aedc0 2023-10-06T01:25:39.656 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:39.655+0000 7fe51e7fc700 1 -- 172.21.15.50:0/211290462 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fe520013680 con 0x7fe5300aedc0 2023-10-06T01:25:39.656 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:39.656+0000 7fe51e7fc700 1 --2- 172.21.15.50:0/211290462 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7fe510066f30 0x7fe5100693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:25:39.656 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:39.656+0000 7fe51e7fc700 1 -- 172.21.15.50:0/211290462 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5612+0+0 (secure 0 0 0) 0x7fe520084910 con 0x7fe5300aedc0 2023-10-06T01:25:39.657 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:39.656+0000 7fe52dd9b700 1 --2- 172.21.15.50:0/211290462 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7fe510066f30 0x7fe5100693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:25:39.657 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:39.657+0000 7fe52dd9b700 1 --2- 172.21.15.50:0/211290462 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7fe510066f30 0x7fe5100693e0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fe5300c7fd0 tx=0x7fe524009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:25:39.660 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:39.660+0000 7fe51e7fc700 1 -- 172.21.15.50:0/211290462 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe520051b40 con 0x7fe5300aedc0 2023-10-06T01:25:39.858 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:39.857+0000 7fe52f59e700 1 -- 172.21.15.50:0/211290462 --> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fe5300c2960 con 0x7fe510066f30 2023-10-06T01:25:39.861 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:39.860+0000 7fe51e7fc700 1 -- 172.21.15.50:0/211290462 <== mgr.4099 v2:172.21.15.155:6832/85215 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+72508 (secure 0 0 0) 0x7fe5300c2960 con 0x7fe510066f30 2023-10-06T01:25:39.862 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-10-06T01:25:39.864 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:39.863+0000 7fe52f59e700 1 -- 172.21.15.50:0/211290462 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7fe510066f30 msgr2=0x7fe5100693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:25:39.864 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:39.863+0000 7fe52f59e700 1 --2- 172.21.15.50:0/211290462 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7fe510066f30 0x7fe5100693e0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fe5300c7fd0 tx=0x7fe524009040 comp rx=0 tx=0).stop 2023-10-06T01:25:39.864 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:39.863+0000 7fe52f59e700 1 -- 172.21.15.50:0/211290462 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe5300aedc0 msgr2=0x7fe5300c47b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:25:39.864 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:39.863+0000 7fe52f59e700 1 --2- 172.21.15.50:0/211290462 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe5300aedc0 0x7fe5300c47b0 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7fe52000ecb0 tx=0x7fe5200091a0 comp rx=0 tx=0).stop 2023-10-06T01:25:39.864 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:39.863+0000 7fe52f59e700 1 -- 172.21.15.50:0/211290462 shutdown_connections 2023-10-06T01:25:39.864 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:39.863+0000 7fe52f59e700 1 --2- 172.21.15.50:0/211290462 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe530140b70 0x7fe5301677e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:25:39.864 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:39.863+0000 7fe52f59e700 1 --2- 172.21.15.50:0/211290462 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe5300aedc0 0x7fe5300c47b0 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:25:39.864 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:39.863+0000 7fe52f59e700 1 --2- 172.21.15.50:0/211290462 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7fe510066f30 0x7fe5100693e0 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:25:39.865 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:39.863+0000 7fe52f59e700 1 --2- 172.21.15.50:0/211290462 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe5300af230 0x7fe5301569e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:25:39.865 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:39.863+0000 7fe52f59e700 1 -- 172.21.15.50:0/211290462 >> 172.21.15.50:0/211290462 conn(0x7fe5300cbef0 msgr2=0x7fe5300af850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:25:39.865 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:39.863+0000 7fe52f59e700 1 -- 172.21.15.50:0/211290462 shutdown_connections 2023-10-06T01:25:39.865 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:25:39.863+0000 7fe52f59e700 1 -- 172.21.15.50:0/211290462 wait complete. 2023-10-06T01:25:39.865 INFO:teuthology.orchestra.run.smithi050.stderr:dumped all 2023-10-06T01:25:39.881 INFO:teuthology.orchestra.run.smithi050.stdout:{"pg_ready":true,"pg_map":{"version":163,"stamp":"2023-10-06T01:25:39.830559+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2399900,"kb_used_data":5212,"kb_used_omap":0,"kb_used_meta":2394624,"kb_avail":752574820,"statfs":{"total":773094113280,"available":770636615680,"internally_reserved":0,"allocated":5337088,"data_stored":3058658,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2452094976},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.926610"},"pg_stats":[{"pgid":"1.5","version":"0'0","reported_seq":37,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-06T01:25:29.226566+0000","last_change":"2023-10-06T01:21:30.601117+0000","last_active":"2023-10-06T01:25:29.226566+0000","last_peered":"2023-10-06T01:25:29.226566+0000","last_clean":"2023-10-06T01:25:29.226566+0000","last_became_active":"2023-10-06T01:21:30.600724+0000","last_became_peered":"2023-10-06T01:21:30.600724+0000","last_unstale":"2023-10-06T01:25:29.226566+0000","last_undegraded":"2023-10-06T01:25:29.226566+0000","last_fullsized":"2023-10-06T01:25:29.226566+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:21:29.586558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:21:29.586558+0000","last_clean_scrub_stamp":"2023-10-06T01:21:29.586558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":46,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-06T01:25:37.676538+0000","last_change":"2023-10-06T01:25:37.676496+0000","last_active":"2023-10-06T01:25:37.676538+0000","last_peered":"2023-10-06T01:25:37.676538+0000","last_clean":"2023-10-06T01:25:37.676538+0000","last_became_active":"2023-10-06T01:21:30.603215+0000","last_became_peered":"2023-10-06T01:21:30.603215+0000","last_unstale":"2023-10-06T01:25:37.676538+0000","last_undegraded":"2023-10-06T01:25:37.676538+0000","last_fullsized":"2023-10-06T01:25:37.676538+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:25:37.676366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:25:37.676366+0000","last_clean_scrub_stamp":"2023-10-06T01:25:37.676366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T01:36:20.734777+0000","scrub_duration":0.001983074,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":45,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-06T01:25:36.291795+0000","last_change":"2023-10-06T01:25:36.291771+0000","last_active":"2023-10-06T01:25:36.291795+0000","last_peered":"2023-10-06T01:25:36.291795+0000","last_clean":"2023-10-06T01:25:36.291795+0000","last_became_active":"2023-10-06T01:21:30.604535+0000","last_became_peered":"2023-10-06T01:21:30.604535+0000","last_unstale":"2023-10-06T01:25:36.291795+0000","last_undegraded":"2023-10-06T01:25:36.291795+0000","last_fullsized":"2023-10-06T01:25:36.291795+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:25:36.291697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:25:36.291697+0000","last_clean_scrub_stamp":"2023-10-06T01:25:36.291697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:25:18.879286+0000","scrub_duration":0.0019018100000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"17'117","reported_seq":183,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-06T01:25:28.549878+0000","last_change":"2023-10-06T01:21:31.602437+0000","last_active":"2023-10-06T01:25:28.549878+0000","last_peered":"2023-10-06T01:25:28.549878+0000","last_clean":"2023-10-06T01:25:28.549878+0000","last_became_active":"2023-10-06T01:21:31.601431+0000","last_became_peered":"2023-10-06T01:21:31.601431+0000","last_unstale":"2023-10-06T01:25:28.549878+0000","last_undegraded":"2023-10-06T01:25:28.549878+0000","last_fullsized":"2023-10-06T01:25:28.549878+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:21:30.589171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:21:30.589171+0000","last_clean_scrub_stamp":"2023-10-06T01:21:30.589171+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T01:48:45.877807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":34,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-06T01:25:28.550280+0000","last_change":"2023-10-06T01:21:31.338236+0000","last_active":"2023-10-06T01:25:28.550280+0000","last_peered":"2023-10-06T01:25:28.550280+0000","last_clean":"2023-10-06T01:25:28.550280+0000","last_became_active":"2023-10-06T01:21:31.337918+0000","last_became_peered":"2023-10-06T01:21:31.337918+0000","last_unstale":"2023-10-06T01:25:28.550280+0000","last_undegraded":"2023-10-06T01:25:28.550280+0000","last_fullsized":"2023-10-06T01:25:28.550280+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:21:29.586558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:21:29.586558+0000","last_clean_scrub_stamp":"2023-10-06T01:21:29.586558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:02:13.010488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":34,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-06T01:25:28.549771+0000","last_change":"2023-10-06T01:21:31.338209+0000","last_active":"2023-10-06T01:25:28.549771+0000","last_peered":"2023-10-06T01:25:28.549771+0000","last_clean":"2023-10-06T01:25:28.549771+0000","last_became_active":"2023-10-06T01:21:31.337870+0000","last_became_peered":"2023-10-06T01:21:31.337870+0000","last_unstale":"2023-10-06T01:25:28.549771+0000","last_undegraded":"2023-10-06T01:25:28.549771+0000","last_fullsized":"2023-10-06T01:25:28.549771+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:21:29.586558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:21:29.586558+0000","last_clean_scrub_stamp":"2023-10-06T01:21:29.586558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:53:47.117299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":35,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-06T01:25:29.225987+0000","last_change":"2023-10-06T01:21:31.338177+0000","last_active":"2023-10-06T01:25:29.225987+0000","last_peered":"2023-10-06T01:25:29.225987+0000","last_clean":"2023-10-06T01:25:29.225987+0000","last_became_active":"2023-10-06T01:21:31.337872+0000","last_became_peered":"2023-10-06T01:21:31.337872+0000","last_unstale":"2023-10-06T01:25:29.225987+0000","last_undegraded":"2023-10-06T01:25:29.225987+0000","last_fullsized":"2023-10-06T01:25:29.225987+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:21:29.586558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:21:29.586558+0000","last_clean_scrub_stamp":"2023-10-06T01:21:29.586558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":35,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-06T01:25:29.075858+0000","last_change":"2023-10-06T01:21:31.338181+0000","last_active":"2023-10-06T01:25:29.075858+0000","last_peered":"2023-10-06T01:25:29.075858+0000","last_clean":"2023-10-06T01:25:29.075858+0000","last_became_active":"2023-10-06T01:21:31.337820+0000","last_became_peered":"2023-10-06T01:21:31.337820+0000","last_unstale":"2023-10-06T01:25:29.075858+0000","last_undegraded":"2023-10-06T01:25:29.075858+0000","last_fullsized":"2023-10-06T01:25:29.075858+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:21:29.586558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:21:29.586558+0000","last_clean_scrub_stamp":"2023-10-06T01:21:29.586558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":35,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-06T01:25:29.077989+0000","last_change":"2023-10-06T01:21:30.604007+0000","last_active":"2023-10-06T01:25:29.077989+0000","last_peered":"2023-10-06T01:25:29.077989+0000","last_clean":"2023-10-06T01:25:29.077989+0000","last_became_active":"2023-10-06T01:21:30.603673+0000","last_became_peered":"2023-10-06T01:21:30.603673+0000","last_unstale":"2023-10-06T01:25:29.077989+0000","last_undegraded":"2023-10-06T01:25:29.077989+0000","last_fullsized":"2023-10-06T01:25:29.077989+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:21:29.586558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:21:29.586558+0000","last_clean_scrub_stamp":"2023-10-06T01:21:29.586558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574902,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298376,"kb_used_data":1088,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073464,"statfs":{"total":96636764160,"available":96331227136,"internally_reserved":0,"allocated":1114112,"data_stored":825475,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 01:25:34 2023","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.65300000000000002,"15min":0.67900000000000005},"min":{"1min":0.42899999999999999,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.82799999999999996,"5min":0.93700000000000006,"15min":0.93700000000000006},"last":0.74099999999999999},{"interface":"front","average":{"1min":0.61799999999999999,"5min":0.622,"15min":0.64600000000000002},"min":{"1min":0.42399999999999999,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.76900000000000002,"5min":0.96999999999999997,"15min":0.96999999999999997},"last":0.53200000000000003}]},{"osd":1,"last update":"Fri Oct 6 01:25:34 2023","interfaces":[{"interface":"back","average":{"1min":0.67000000000000004,"5min":0.64800000000000002,"15min":0.66200000000000003},"min":{"1min":0.50800000000000001,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.92400000000000004,"5min":0.92400000000000004,"15min":0.92400000000000004},"last":0.61599999999999999},{"interface":"front","average":{"1min":0.626,"5min":0.65400000000000003,"15min":0.67400000000000004},"min":{"1min":0.46400000000000002,"5min":0.439,"15min":0.439},"max":{"1min":0.80600000000000005,"5min":0.91400000000000003,"15min":0.91400000000000003},"last":0.57599999999999996}]},{"osd":2,"last update":"Fri Oct 6 01:25:34 2023","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.63100000000000001,"15min":0.65900000000000003},"min":{"1min":0.47199999999999998,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":0.86699999999999999,"5min":0.86699999999999999,"15min":0.86699999999999999},"last":0.69699999999999995},{"interface":"front","average":{"1min":0.67500000000000004,"5min":0.69899999999999995,"15min":0.72899999999999998},"min":{"1min":0.45600000000000002,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.85699999999999998,"5min":0.93600000000000005,"15min":0.93600000000000005},"last":0.66500000000000004}]},{"osd":3,"last update":"Fri Oct 6 01:25:34 2023","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.70699999999999996,"15min":0.73399999999999999},"min":{"1min":0.50900000000000001,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":0.81299999999999994,"5min":1.0660000000000001,"15min":1.0660000000000001},"last":0.63300000000000001},{"interface":"front","average":{"1min":0.69599999999999995,"5min":0.71099999999999997,"15min":0.73999999999999999},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":0.83399999999999996,"5min":0.89400000000000002,"15min":0.89400000000000002},"last":0.58799999999999997}]},{"osd":4,"last update":"Fri Oct 6 01:25:34 2023","interfaces":[{"interface":"back","average":{"1min":0.68700000000000006,"5min":0.64900000000000002,"15min":0.64000000000000001},"min":{"1min":0.47399999999999998,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.878,"5min":1.01,"15min":1.01},"last":0.441},{"interface":"front","average":{"1min":0.65300000000000002,"5min":0.65800000000000003,"15min":0.67200000000000004},"min":{"1min":0.46100000000000002,"5min":0.441,"15min":0.441},"max":{"1min":0.89200000000000002,"5min":0.94399999999999995,"15min":0.94399999999999995},"last":0.68200000000000005}]},{"osd":5,"last update":"Fri Oct 6 01:25:34 2023","interfaces":[{"interface":"back","average":{"1min":0.64700000000000002,"5min":0.65000000000000002,"15min":0.65800000000000003},"min":{"1min":0.45200000000000001,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.84799999999999998,"5min":0.98599999999999999,"15min":0.98599999999999999},"last":0.64800000000000002},{"interface":"front","average":{"1min":0.76300000000000001,"5min":0.73799999999999999,"15min":0.72999999999999998},"min":{"1min":0.60999999999999999,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":0.91900000000000004,"5min":0.97999999999999998,"15min":0.97999999999999998},"last":0.56599999999999995}]},{"osd":6,"last update":"Fri Oct 6 01:25:34 2023","interfaces":[{"interface":"back","average":{"1min":0.78300000000000003,"5min":0.76900000000000002,"15min":0.78100000000000003},"min":{"1min":0.59399999999999997,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":0.96899999999999997,"5min":1,"15min":1},"last":0.70499999999999996},{"interface":"front","average":{"1min":0.748,"5min":0.746,"15min":0.752},"min":{"1min":0.57499999999999996,"5min":0.438,"15min":0.438},"max":{"1min":0.88500000000000001,"5min":1.1000000000000001,"15min":1.1000000000000001},"last":0.46999999999999997}]}]},{"osd":6,"up_from":13,"seq":55834574902,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297796,"kb_used_data":508,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074044,"statfs":{"total":96636764160,"available":96331821056,"internally_reserved":0,"allocated":520192,"data_stored":235107,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 01:25:34 2023","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.68600000000000005,"15min":0.751},"min":{"1min":0.46200000000000002,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.878,"5min":1.9279999999999999,"15min":1.9279999999999999},"last":0.55600000000000005},{"interface":"front","average":{"1min":0.69399999999999995,"5min":0.746,"15min":0.80800000000000005},"min":{"1min":0.496,"5min":0.433,"15min":0.433},"max":{"1min":0.90900000000000003,"5min":2.3420000000000001,"15min":2.3420000000000001},"last":0.70599999999999996}]},{"osd":1,"last update":"Fri Oct 6 01:25:34 2023","interfaces":[{"interface":"back","average":{"1min":0.624,"5min":0.875,"15min":1.133},"min":{"1min":0.45800000000000002,"5min":0.44,"15min":0.44},"max":{"1min":0.89000000000000001,"5min":12.529,"15min":12.529},"last":0.53000000000000003},{"interface":"front","average":{"1min":0.64900000000000002,"5min":0.74399999999999999,"15min":0.83599999999999997},"min":{"1min":0.42799999999999999,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.94199999999999995,"5min":3.98,"15min":3.98},"last":0.76300000000000001}]},{"osd":2,"last update":"Fri Oct 6 01:25:34 2023","interfaces":[{"interface":"back","average":{"1min":0.66100000000000003,"5min":0.75700000000000001,"15min":0.878},"min":{"1min":0.56200000000000006,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.78500000000000003,"5min":5.4859999999999998,"15min":5.4859999999999998},"last":0.65900000000000003},{"interface":"front","average":{"1min":0.66100000000000003,"5min":0.70399999999999996,"15min":0.76900000000000002},"min":{"1min":0.47699999999999998,"5min":0.443,"15min":0.443},"max":{"1min":0.80600000000000005,"5min":2.718,"15min":2.718},"last":0.747}]},{"osd":3,"last update":"Fri Oct 6 01:25:34 2023","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.71499999999999997,"15min":0.77300000000000002},"min":{"1min":0.48299999999999998,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":0.86099999999999999,"5min":2.5129999999999999,"15min":2.5129999999999999},"last":0.57699999999999996},{"interface":"front","average":{"1min":0.70899999999999996,"5min":0.72999999999999998,"15min":0.77100000000000002},"min":{"1min":0.55000000000000004,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":0.83599999999999997,"5min":1.9870000000000001,"15min":1.9870000000000001},"last":0.77500000000000002}]},{"osd":4,"last update":"Fri Oct 6 01:25:34 2023","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.68400000000000005,"15min":0.73899999999999999},"min":{"1min":0.45300000000000001,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.84499999999999997,"5min":3.1480000000000001,"15min":3.1480000000000001},"last":0.68799999999999994},{"interface":"front","average":{"1min":0.70399999999999996,"5min":0.746,"15min":0.79600000000000004},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.97799999999999998,"5min":2.4769999999999999,"15min":2.4769999999999999},"last":0.85399999999999998}]},{"osd":5,"last update":"Fri Oct 6 01:25:34 2023","interfaces":[{"interface":"back","average":{"1min":0.66600000000000004,"5min":0.80100000000000005,"15min":0.90700000000000003},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.88300000000000001,"5min":5.4279999999999999,"15min":5.4279999999999999},"last":0.81100000000000005},{"interface":"front","average":{"1min":0.74099999999999999,"5min":0.78900000000000003,"15min":0.83699999999999997},"min":{"1min":0.58799999999999997,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":0.91300000000000003,"5min":2.6739999999999999,"15min":2.6739999999999999},"last":0.82799999999999996}]},{"osd":7,"last update":"Fri Oct 6 01:25:34 2023","interfaces":[{"interface":"back","average":{"1min":0.75600000000000001,"5min":0.79800000000000004,"15min":0.85499999999999998},"min":{"1min":0.55100000000000005,"5min":0.497,"15min":0.497},"max":{"1min":0.90000000000000002,"5min":2.7719999999999998,"15min":2.7719999999999998},"last":0.79600000000000004},{"interface":"front","average":{"1min":0.73099999999999998,"5min":0.89200000000000002,"15min":1.036},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.89800000000000002,"5min":7.1440000000000001,"15min":7.1440000000000001},"last":0.88900000000000001}]}]},{"osd":1,"up_from":13,"seq":55834574900,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302468,"kb_used_data":1084,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069372,"statfs":{"total":96636764160,"available":96327036928,"internally_reserved":0,"allocated":1110016,"data_stored":824497,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 01:25:35 2023","interfaces":[{"interface":"back","average":{"1min":0.41199999999999998,"5min":0.44,"15min":0.45200000000000001},"min":{"1min":0.28999999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.80900000000000005,"5min":0.80900000000000005,"15min":0.80900000000000005},"last":0.374},{"interface":"front","average":{"1min":0.48599999999999999,"5min":0.48399999999999999,"15min":0.499},"min":{"1min":0.40400000000000003,"5min":0.375,"15min":0.375},"max":{"1min":0.84299999999999997,"5min":0.84299999999999997,"15min":0.84299999999999997},"last":0.48799999999999999}]},{"osd":2,"last update":"Fri Oct 6 01:25:35 2023","interfaces":[{"interface":"back","average":{"1min":0.42699999999999999,"5min":0.438,"15min":0.46500000000000002},"min":{"1min":0.31,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.77700000000000002,"5min":1.073,"15min":1.073},"last":0.56899999999999995},{"interface":"front","average":{"1min":0.45700000000000002,"5min":0.47099999999999997,"15min":0.48699999999999999},"min":{"1min":0.36699999999999999,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"last":0.42399999999999999}]},{"osd":3,"last update":"Fri Oct 6 01:25:35 2023","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.55700000000000005,"15min":0.57399999999999995},"min":{"1min":0.44400000000000001,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.93300000000000005,"5min":0.93300000000000005,"15min":0.93300000000000005},"last":0.64200000000000002},{"interface":"front","average":{"1min":0.501,"5min":0.51400000000000001,"15min":0.54600000000000004},"min":{"1min":0.35799999999999998,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.79800000000000004,"5min":0.93400000000000005,"15min":0.93400000000000005},"last":0.54500000000000004}]},{"osd":4,"last update":"Fri Oct 6 01:25:35 2023","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":0.73999999999999999,"15min":0.77400000000000002},"min":{"1min":0.48299999999999998,"5min":0.432,"15min":0.432},"max":{"1min":0.94899999999999995,"5min":1.534,"15min":1.534},"last":0.68200000000000005},{"interface":"front","average":{"1min":0.74399999999999999,"5min":0.747,"15min":0.78500000000000003},"min":{"1min":0.56599999999999995,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":1.0629999999999999,"5min":1.742,"15min":1.742},"last":0.70199999999999996}]},{"osd":5,"last update":"Fri Oct 6 01:25:35 2023","interfaces":[{"interface":"back","average":{"1min":0.76400000000000001,"5min":0.75,"15min":0.77400000000000002},"min":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":0.99399999999999999,"5min":1.4790000000000001,"15min":1.4790000000000001},"last":0.72199999999999998},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.752,"15min":0.80000000000000004},"min":{"1min":0.52400000000000002,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":1.075,"5min":1.581,"15min":1.581},"last":0.73999999999999999}]},{"osd":6,"last update":"Fri Oct 6 01:25:35 2023","interfaces":[{"interface":"back","average":{"1min":0.74099999999999999,"5min":0.746,"15min":0.78000000000000003},"min":{"1min":0.55600000000000005,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":0.97999999999999998,"5min":1.51,"15min":1.51},"last":0.76300000000000001},{"interface":"front","average":{"1min":0.74199999999999999,"5min":0.77000000000000002,"15min":0.79800000000000004},"min":{"1min":0.58399999999999996,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":1.0309999999999999,"5min":1.26,"15min":1.26},"last":0.59499999999999997}]},{"osd":7,"last update":"Fri Oct 6 01:25:35 2023","interfaces":[{"interface":"back","average":{"1min":0.751,"5min":0.77400000000000002,"15min":0.81799999999999995},"min":{"1min":0.57299999999999995,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":0.99399999999999999,"5min":1.7070000000000001,"15min":1.7070000000000001},"last":0.66900000000000004},{"interface":"front","average":{"1min":0.76200000000000001,"5min":0.80100000000000005,"15min":0.85099999999999998},"min":{"1min":0.59299999999999997,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.006,"5min":1.633,"15min":1.633},"last":0.78600000000000003}]}]},{"osd":0,"up_from":13,"seq":55834574901,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301888,"kb_used_data":504,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069952,"statfs":{"total":96636764160,"available":96327630848,"internally_reserved":0,"allocated":516096,"data_stored":234129,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Oct 6 01:25:33 2023","interfaces":[{"interface":"back","average":{"1min":0.432,"5min":0.51700000000000002,"15min":0.61099999999999999},"min":{"1min":0.25900000000000001,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.995,"5min":2.8559999999999999,"15min":2.8559999999999999},"last":0.52200000000000002},{"interface":"front","average":{"1min":0.44400000000000001,"5min":0.55800000000000005,"15min":0.67000000000000004},"min":{"1min":0.33900000000000002,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.54200000000000004,"5min":2.944,"15min":2.944},"last":0.38300000000000001}]},{"osd":2,"last update":"Fri Oct 6 01:25:33 2023","interfaces":[{"interface":"back","average":{"1min":0.51500000000000001,"5min":0.61599999999999999,"15min":0.72799999999999998},"min":{"1min":0.41699999999999998,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.874,"5min":2.8940000000000001,"15min":2.8940000000000001},"last":0.56999999999999995},{"interface":"front","average":{"1min":0.51400000000000001,"5min":0.62,"15min":0.71899999999999997},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.69799999999999995,"5min":2.9820000000000002,"15min":2.9820000000000002},"last":0.502}]},{"osd":3,"last update":"Fri Oct 6 01:25:33 2023","interfaces":[{"interface":"back","average":{"1min":0.46700000000000003,"5min":0.55100000000000005,"15min":0.65100000000000002},"min":{"1min":0.35199999999999998,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":1.137,"5min":2.7559999999999998,"15min":2.7559999999999998},"last":0.36099999999999999},{"interface":"front","average":{"1min":0.505,"5min":0.59099999999999997,"15min":0.68600000000000005},"min":{"1min":0.38200000000000001,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":1.0289999999999999,"5min":2.8140000000000001,"15min":2.8140000000000001},"last":0.45800000000000002}]},{"osd":4,"last update":"Fri Oct 6 01:25:33 2023","interfaces":[{"interface":"back","average":{"1min":0.747,"5min":0.75900000000000001,"15min":0.79500000000000004},"min":{"1min":0.53100000000000003,"5min":0.441,"15min":0.441},"max":{"1min":0.90800000000000003,"5min":1.397,"15min":1.397},"last":0.58499999999999996},{"interface":"front","average":{"1min":0.72899999999999998,"5min":0.78000000000000003,"15min":0.83599999999999997},"min":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":0.98899999999999999,"5min":1.833,"15min":1.833},"last":0.60899999999999999}]},{"osd":5,"last update":"Fri Oct 6 01:25:33 2023","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":0.77300000000000002,"15min":0.81899999999999995},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":0.96999999999999997,"5min":1.4430000000000001,"15min":1.4430000000000001},"last":0.71199999999999997},{"interface":"front","average":{"1min":0.77100000000000002,"5min":0.76700000000000002,"15min":0.79900000000000004},"min":{"1min":0.58199999999999996,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":1.0580000000000001,"5min":1.4359999999999999,"15min":1.4359999999999999},"last":0.623}]},{"osd":6,"last update":"Fri Oct 6 01:25:33 2023","interfaces":[{"interface":"back","average":{"1min":0.76100000000000001,"5min":0.80700000000000005,"15min":0.88900000000000001},"min":{"1min":0.63700000000000001,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":0.94799999999999995,"5min":1.8740000000000001,"15min":1.8740000000000001},"last":0.65000000000000002},{"interface":"front","average":{"1min":0.751,"5min":0.78700000000000003,"15min":0.83499999999999996},"min":{"1min":0.57299999999999995,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":1.0109999999999999,"5min":1.361,"15min":1.361},"last":0.84499999999999997}]},{"osd":7,"last update":"Fri Oct 6 01:25:33 2023","interfaces":[{"interface":"back","average":{"1min":0.76200000000000001,"5min":0.80000000000000004,"15min":0.84699999999999998},"min":{"1min":0.58699999999999997,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":1.0940000000000001,"5min":1.413,"15min":1.413},"last":0.77900000000000003},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.77500000000000002,"15min":0.81599999999999995},"min":{"1min":0.57799999999999996,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":0.94699999999999995,"5min":1.2929999999999999,"15min":1.2929999999999999},"last":0.73599999999999999}]}]},{"osd":2,"up_from":13,"seq":55834574900,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301892,"kb_used_data":508,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069948,"statfs":{"total":96636764160,"available":96327626752,"internally_reserved":0,"allocated":520192,"data_stored":235107,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 01:25:38 2023","interfaces":[{"interface":"back","average":{"1min":0.40500000000000003,"5min":0.44800000000000001,"15min":0.47999999999999998},"min":{"1min":0.23899999999999999,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":0.51800000000000002,"5min":0.96599999999999997,"15min":0.96599999999999997},"last":0.51600000000000001},{"interface":"front","average":{"1min":0.44,"5min":0.501,"15min":0.53200000000000003},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.61599999999999999,"5min":1,"15min":1},"last":0.34499999999999997}]},{"osd":1,"last update":"Fri Oct 6 01:25:38 2023","interfaces":[{"interface":"back","average":{"1min":0.47099999999999997,"5min":0.52500000000000002,"15min":0.57199999999999995},"min":{"1min":0.312,"5min":0.312,"15min":0.312},"max":{"1min":0.622,"5min":1.296,"15min":1.296},"last":0.55800000000000005},{"interface":"front","average":{"1min":0.45400000000000001,"5min":0.51300000000000001,"15min":0.55600000000000005},"min":{"1min":0.34999999999999998,"5min":0.313,"15min":0.313},"max":{"1min":0.623,"5min":1.1379999999999999,"15min":1.1379999999999999},"last":0.48499999999999999}]},{"osd":3,"last update":"Fri Oct 6 01:25:38 2023","interfaces":[{"interface":"back","average":{"1min":0.497,"5min":0.57099999999999995,"15min":0.624},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.79900000000000004,"5min":1.222,"15min":1.222},"last":0.495},{"interface":"front","average":{"1min":0.47899999999999998,"5min":0.48399999999999999,"15min":0.501},"min":{"1min":0.36499999999999999,"5min":0.318,"15min":0.318},"max":{"1min":0.61199999999999999,"5min":0.72099999999999997,"15min":0.72099999999999997},"last":0.46500000000000002}]},{"osd":4,"last update":"Fri Oct 6 01:25:38 2023","interfaces":[{"interface":"back","average":{"1min":0.755,"5min":0.73899999999999999,"15min":0.73699999999999999},"min":{"1min":0.64700000000000002,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.109,"5min":1.109,"15min":1.109},"last":1.109},{"interface":"front","average":{"1min":0.78300000000000003,"5min":0.79400000000000004,"15min":0.82399999999999995},"min":{"1min":0.60499999999999998,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":1.101,"5min":1.5469999999999999,"15min":1.5469999999999999},"last":1.101}]},{"osd":5,"last update":"Fri Oct 6 01:25:38 2023","interfaces":[{"interface":"back","average":{"1min":0.73999999999999999,"5min":0.75600000000000001,"15min":0.78200000000000003},"min":{"1min":0.60899999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":0.91700000000000004,"5min":1.5940000000000001,"15min":1.5940000000000001},"last":0.746},{"interface":"front","average":{"1min":0.746,"5min":0.79600000000000004,"15min":0.85399999999999998},"min":{"1min":0.56499999999999995,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":1.0049999999999999,"5min":1.7669999999999999,"15min":1.7669999999999999},"last":0.84699999999999998}]},{"osd":6,"last update":"Fri Oct 6 01:25:38 2023","interfaces":[{"interface":"back","average":{"1min":0.78700000000000003,"5min":0.82599999999999996,"15min":0.89900000000000002},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.0549999999999999,"5min":2.0510000000000002,"15min":2.0510000000000002},"last":1.0409999999999999},{"interface":"front","average":{"1min":0.746,"5min":0.746,"15min":0.77600000000000002},"min":{"1min":0.59799999999999998,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.026,"5min":1.633,"15min":1.633},"last":1.026}]},{"osd":7,"last update":"Fri Oct 6 01:25:38 2023","interfaces":[{"interface":"back","average":{"1min":0.746,"5min":0.78100000000000003,"15min":0.82199999999999995},"min":{"1min":0.57099999999999995,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":0.94699999999999995,"5min":1.4670000000000001,"15min":1.4670000000000001},"last":0.77400000000000002},{"interface":"front","average":{"1min":0.77700000000000002,"5min":0.81000000000000005,"15min":0.85999999999999999},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.0920000000000001,"5min":1.8,"15min":1.8},"last":0.81899999999999995}]}]},{"osd":3,"up_from":13,"seq":55834574900,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301892,"kb_used_data":508,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069948,"statfs":{"total":96636764160,"available":96327626752,"internally_reserved":0,"allocated":520192,"data_stored":235107,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 01:25:38 2023","interfaces":[{"interface":"back","average":{"1min":0.41699999999999998,"5min":0.41799999999999998,"15min":0.41499999999999998},"min":{"1min":0.29899999999999999,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.57299999999999995,"5min":0.95399999999999996,"15min":0.95399999999999996},"last":0.36399999999999999},{"interface":"front","average":{"1min":0.435,"5min":0.438,"15min":0.45600000000000002},"min":{"1min":0.33900000000000002,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.55400000000000005,"5min":0.69199999999999995,"15min":0.69199999999999995},"last":0.38500000000000001}]},{"osd":1,"last update":"Fri Oct 6 01:25:38 2023","interfaces":[{"interface":"back","average":{"1min":0.44500000000000001,"5min":0.45700000000000002,"15min":0.48799999999999999},"min":{"1min":0.35399999999999998,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.55600000000000005,"5min":1.075,"15min":1.075},"last":0.45300000000000001},{"interface":"front","average":{"1min":0.50900000000000001,"5min":0.51200000000000001,"15min":0.52100000000000002},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"last":0.51400000000000001}]},{"osd":2,"last update":"Fri Oct 6 01:25:38 2023","interfaces":[{"interface":"back","average":{"1min":0.498,"5min":0.51800000000000002,"15min":0.54600000000000004},"min":{"1min":0.39400000000000002,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.69099999999999995,"5min":1.4319999999999999,"15min":1.4319999999999999},"last":0.46600000000000003},{"interface":"front","average":{"1min":0.51200000000000001,"5min":0.54700000000000004,"15min":0.57899999999999996},"min":{"1min":0.41399999999999998,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.60799999999999998,"5min":1.532,"15min":1.532},"last":0.41399999999999998}]},{"osd":4,"last update":"Fri Oct 6 01:25:38 2023","interfaces":[{"interface":"back","average":{"1min":0.77000000000000002,"5min":0.79400000000000004,"15min":0.83399999999999996},"min":{"1min":0.61899999999999999,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":0.997,"5min":1.1080000000000001,"15min":1.1080000000000001},"last":0.72599999999999998},{"interface":"front","average":{"1min":0.81299999999999994,"5min":0.81000000000000005,"15min":0.84399999999999997},"min":{"1min":0.58799999999999997,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":1.337,"5min":1.353,"15min":1.353},"last":0.61499999999999999}]},{"osd":5,"last update":"Fri Oct 6 01:25:38 2023","interfaces":[{"interface":"back","average":{"1min":0.69499999999999995,"5min":0.75,"15min":0.78200000000000003},"min":{"1min":0.53100000000000003,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.93300000000000005,"5min":1.3149999999999999,"15min":1.3149999999999999},"last":0.57599999999999996},{"interface":"front","average":{"1min":0.80100000000000005,"5min":0.75700000000000001,"15min":0.78700000000000003},"min":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.294,"5min":1.294,"15min":1.294},"last":0.60199999999999998}]},{"osd":6,"last update":"Fri Oct 6 01:25:38 2023","interfaces":[{"interface":"back","average":{"1min":0.78800000000000003,"5min":0.80900000000000005,"15min":0.84799999999999998},"min":{"1min":0.58099999999999996,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.3580000000000001,"5min":1.3580000000000001,"15min":1.3580000000000001},"last":0.626},{"interface":"front","average":{"1min":0.81999999999999995,"5min":0.81799999999999995,"15min":0.85299999999999998},"min":{"1min":0.63700000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.298,"5min":1.3779999999999999,"15min":1.3779999999999999},"last":0.66400000000000003}]},{"osd":7,"last update":"Fri Oct 6 01:25:38 2023","interfaces":[{"interface":"back","average":{"1min":0.77500000000000002,"5min":0.79300000000000004,"15min":0.83799999999999997},"min":{"1min":0.55900000000000005,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.0409999999999999,"5min":1.1240000000000001,"15min":1.1240000000000001},"last":0.55900000000000005},{"interface":"front","average":{"1min":0.82199999999999995,"5min":0.82999999999999996,"15min":0.879},"min":{"1min":0.56699999999999995,"5min":0.55700000000000005,"15min":0.55700000000000005},"max":{"1min":1.3140000000000001,"5min":1.3140000000000001,"15min":1.3140000000000001},"last":0.67800000000000005}]}]},{"osd":4,"up_from":13,"seq":55834574900,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297796,"kb_used_data":508,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074044,"statfs":{"total":96636764160,"available":96331821056,"internally_reserved":0,"allocated":520192,"data_stored":235107,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 01:25:38 2023","interfaces":[{"interface":"back","average":{"1min":0.66400000000000003,"5min":0.63800000000000001,"15min":0.628},"min":{"1min":0.46200000000000002,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.95499999999999996,"5min":1.298,"15min":1.298},"last":0.56899999999999995},{"interface":"front","average":{"1min":0.625,"5min":0.64200000000000002,"15min":0.64800000000000002},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.84499999999999997,"5min":1.081,"15min":1.081},"last":0.45500000000000002}]},{"osd":1,"last update":"Fri Oct 6 01:25:38 2023","interfaces":[{"interface":"back","average":{"1min":0.64000000000000001,"5min":0.65800000000000003,"15min":0.66400000000000003},"min":{"1min":0.46999999999999997,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.82199999999999995,"5min":1.264,"15min":1.264},"last":0.61099999999999999},{"interface":"front","average":{"1min":0.68799999999999994,"5min":0.68400000000000005,"15min":0.68700000000000006},"min":{"1min":0.48699999999999999,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":0.84999999999999998,"5min":1.143,"15min":1.143},"last":0.52400000000000002}]},{"osd":2,"last update":"Fri Oct 6 01:25:38 2023","interfaces":[{"interface":"back","average":{"1min":0.66800000000000004,"5min":0.69199999999999995,"15min":0.71499999999999997},"min":{"1min":0.57799999999999996,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":0.85399999999999998,"5min":1.3680000000000001,"15min":1.3680000000000001},"last":0.69899999999999995},{"interface":"front","average":{"1min":0.67700000000000005,"5min":0.69899999999999995,"15min":0.72099999999999997},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":0.999,"5min":0.999,"15min":0.999},"last":0.65900000000000003}]},{"osd":3,"last update":"Fri Oct 6 01:25:38 2023","interfaces":[{"interface":"back","average":{"1min":0.69899999999999995,"5min":0.69199999999999995,"15min":0.72199999999999998},"min":{"1min":0.52000000000000002,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":1.0720000000000001,"5min":1.2090000000000001,"15min":1.2090000000000001},"last":0.78500000000000003},{"interface":"front","average":{"1min":0.75900000000000001,"5min":0.76300000000000001,"15min":0.78800000000000003},"min":{"1min":0.59599999999999997,"5min":0.505,"15min":0.505},"max":{"1min":0.84699999999999998,"5min":1.444,"15min":1.444},"last":0.83699999999999997}]},{"osd":5,"last update":"Fri Oct 6 01:25:38 2023","interfaces":[{"interface":"back","average":{"1min":0.73499999999999999,"5min":0.69099999999999995,"15min":0.69099999999999995},"min":{"1min":0.60499999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":1.0389999999999999,"5min":1.0389999999999999,"15min":1.0389999999999999},"last":0.76500000000000001},{"interface":"front","average":{"1min":0.70399999999999996,"5min":0.69099999999999995,"15min":0.70499999999999996},"min":{"1min":0.53600000000000003,"5min":0.439,"15min":0.439},"max":{"1min":0.873,"5min":0.97999999999999998,"15min":0.97999999999999998},"last":0.73099999999999998}]},{"osd":6,"last update":"Fri Oct 6 01:25:38 2023","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.70299999999999996,"15min":0.72999999999999998},"min":{"1min":0.45600000000000002,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.88900000000000001,"5min":1.1779999999999999,"15min":1.1779999999999999},"last":0.74199999999999999},{"interface":"front","average":{"1min":0.77100000000000002,"5min":0.77000000000000002,"15min":0.78900000000000003},"min":{"1min":0.56499999999999995,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":1.087,"5min":1.1379999999999999,"15min":1.1379999999999999},"last":0.71599999999999997}]},{"osd":7,"last update":"Fri Oct 6 01:25:38 2023","interfaces":[{"interface":"back","average":{"1min":0.72799999999999998,"5min":0.73299999999999998,"15min":0.75600000000000001},"min":{"1min":0.53300000000000003,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.91400000000000003,"5min":1.0249999999999999,"15min":1.0249999999999999},"last":0.68200000000000005},{"interface":"front","average":{"1min":0.78400000000000003,"5min":0.79000000000000004,"15min":0.82299999999999995},"min":{"1min":0.57899999999999996,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":0.97499999999999998,"5min":1.2290000000000001,"15min":1.2290000000000001},"last":0.80000000000000004}]}]},{"osd":5,"up_from":13,"seq":55834574902,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297792,"kb_used_data":504,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074048,"statfs":{"total":96636764160,"available":96331825152,"internally_reserved":0,"allocated":516096,"data_stored":234129,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 01:25:36 2023","interfaces":[{"interface":"back","average":{"1min":0.57199999999999995,"5min":0.60699999999999998,"15min":0.63500000000000001},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.746,"5min":0.94699999999999995,"15min":0.94699999999999995},"last":0.35899999999999999},{"interface":"front","average":{"1min":0.67900000000000005,"5min":0.63100000000000001,"15min":0.61099999999999999},"min":{"1min":0.309,"5min":0.309,"15min":0.309},"max":{"1min":1.9359999999999999,"5min":1.9359999999999999,"15min":1.9359999999999999},"last":0.53900000000000003}]},{"osd":1,"last update":"Fri Oct 6 01:25:36 2023","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.63900000000000001,"15min":0.63100000000000001},"min":{"1min":0.44800000000000001,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.78600000000000003,"5min":1.028,"15min":1.028},"last":0.505},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.65600000000000003,"15min":0.67600000000000005},"min":{"1min":0.46100000000000002,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":1.502,"5min":1.502,"15min":1.502},"last":0.49399999999999999}]},{"osd":2,"last update":"Fri Oct 6 01:25:36 2023","interfaces":[{"interface":"back","average":{"1min":0.67300000000000004,"5min":0.68100000000000005,"15min":0.68700000000000006},"min":{"1min":0.52100000000000002,"5min":0.435,"15min":0.435},"max":{"1min":1.4470000000000001,"5min":1.4470000000000001,"15min":1.4470000000000001},"last":0.67500000000000004},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.66500000000000004,"15min":0.67100000000000004},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.84899999999999998,"5min":1.0229999999999999,"15min":1.0229999999999999},"last":0.443}]},{"osd":3,"last update":"Fri Oct 6 01:25:36 2023","interfaces":[{"interface":"back","average":{"1min":0.68700000000000006,"5min":0.65400000000000003,"15min":0.64800000000000002},"min":{"1min":0.49299999999999999,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":1.78,"5min":1.78,"15min":1.78},"last":0.60599999999999998},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.73599999999999999,"15min":0.77800000000000002},"min":{"1min":0.501,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":1.6799999999999999,"5min":1.6799999999999999,"15min":1.6799999999999999},"last":0.57099999999999995}]},{"osd":4,"last update":"Fri Oct 6 01:25:36 2023","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.64900000000000002,"15min":0.66900000000000004},"min":{"1min":0.38700000000000001,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.81899999999999995,"5min":1.0389999999999999,"15min":1.0389999999999999},"last":0.64300000000000002},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.65200000000000002,"15min":0.65600000000000003},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":1.823,"5min":1.823,"15min":1.823},"last":0.66100000000000003}]},{"osd":6,"last update":"Fri Oct 6 01:25:36 2023","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":0.67300000000000004,"15min":0.66700000000000004},"min":{"1min":0.44,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":1.748,"5min":1.748,"15min":1.748},"last":0.621},{"interface":"front","average":{"1min":0.78600000000000003,"5min":0.71099999999999997,"15min":0.69599999999999995},"min":{"1min":0.497,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.8620000000000001,"5min":1.8620000000000001,"15min":1.8620000000000001},"last":0.59199999999999997}]},{"osd":7,"last update":"Fri Oct 6 01:25:36 2023","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":0.72299999999999998,"15min":0.71999999999999997},"min":{"1min":0.45600000000000002,"5min":0.438,"15min":0.438},"max":{"1min":1.718,"5min":1.718,"15min":1.718},"last":0.69099999999999995},{"interface":"front","average":{"1min":0.80800000000000005,"5min":0.81000000000000005,"15min":0.82699999999999996},"min":{"1min":0.63800000000000001,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":1.5529999999999999,"5min":1.5529999999999999,"15min":1.5529999999999999},"last":0.70699999999999996}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-06T01:25:39.886 INFO:tasks.ceph:pgid 1.5 last_scrub_stamp 2023-10-06T01:21:29.586558+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=1, tm_min=21, tm_sec=29, tm_wday=4, tm_yday=279, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=1, tm_min=25, tm_sec=33, tm_wday=4, tm_yday=279, tm_isdst=0) 2023-10-06T01:25:39.886 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2023-10-06T01:21:30.589171+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=1, tm_min=21, tm_sec=30, tm_wday=4, tm_yday=279, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=1, tm_min=25, tm_sec=33, tm_wday=4, tm_yday=279, tm_isdst=0) 2023-10-06T01:25:39.886 INFO:tasks.ceph:pgid 1.2 last_scrub_stamp 2023-10-06T01:21:29.586558+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=1, tm_min=21, tm_sec=29, tm_wday=4, tm_yday=279, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=1, tm_min=25, tm_sec=33, tm_wday=4, tm_yday=279, tm_isdst=0) 2023-10-06T01:25:39.886 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2023-10-06T01:21:29.586558+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=1, tm_min=21, tm_sec=29, tm_wday=4, tm_yday=279, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=1, tm_min=25, tm_sec=33, tm_wday=4, tm_yday=279, tm_isdst=0) 2023-10-06T01:25:39.886 INFO:tasks.ceph:pgid 1.1 last_scrub_stamp 2023-10-06T01:21:29.586558+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=1, tm_min=21, tm_sec=29, tm_wday=4, tm_yday=279, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=1, tm_min=25, tm_sec=33, tm_wday=4, tm_yday=279, tm_isdst=0) 2023-10-06T01:25:39.886 INFO:tasks.ceph:pgid 1.6 last_scrub_stamp 2023-10-06T01:21:29.586558+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=1, tm_min=21, tm_sec=29, tm_wday=4, tm_yday=279, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=1, tm_min=25, tm_sec=33, tm_wday=4, tm_yday=279, tm_isdst=0) 2023-10-06T01:25:39.887 INFO:tasks.ceph:pgid 1.7 last_scrub_stamp 2023-10-06T01:21:29.586558+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=1, tm_min=21, tm_sec=29, tm_wday=4, tm_yday=279, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=1, tm_min=25, tm_sec=33, tm_wday=4, tm_yday=279, tm_isdst=0) 2023-10-06T01:25:39.887 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-10-06T01:25:59.888 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-06T01:26:00.092 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:26:00.091+0000 7f3fb519d700 1 Processor -- start 2023-10-06T01:26:00.092 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:26:00.091+0000 7f3fb519d700 1 -- start start 2023-10-06T01:26:00.093 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:26:00.092+0000 7f3fb519d700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f3fb0158df0 0x7f3fb006d750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:26:00.093 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:26:00.092+0000 7f3fb519d700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f3fb01591c0 0x7f3fb00c72f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:26:00.093 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:26:00.092+0000 7f3fb519d700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3fb006e950 con 0x7f3fb00c15d0 2023-10-06T01:26:00.093 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:26:00.092+0000 7f3fb519d700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3fb00caad0 con 0x7f3fb0158df0 2023-10-06T01:26:00.094 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:26:00.092+0000 7f3fb519d700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3fb006dd40 con 0x7f3fb01591c0 2023-10-06T01:26:00.094 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:26:00.092+0000 7f3fb499c700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f3fb00c15d0 0x7f3fb0159670 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:37642/0 (socket says 172.21.15.50:37642) 2023-10-06T01:26:00.094 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:26:00.092+0000 7f3fb499c700 1 -- 172.21.15.50:0/3524866950 learned_addr learned my addr 172.21.15.50:0/3524866950 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-10-06T01:26:00.094 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:26:00.092+0000 7f3faffff700 1 --2- 172.21.15.50:0/3524866950 >> v2:172.21.15.50:3300/0 conn(0x7f3fb0158df0 0x7f3fb006d750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:26:00.094 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:26:00.093+0000 7f3faf7fe700 1 --2- 172.21.15.50:0/3524866950 >> v2:172.21.15.155:3300/0 conn(0x7f3fb01591c0 0x7f3fb00c72f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:26:00.096 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:26:00.093+0000 7f3faffff700 1 -- 172.21.15.50:0/3524866950 >> v2:172.21.15.155:3300/0 conn(0x7f3fb01591c0 msgr2=0x7f3fb00c72f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:26:00.096 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:26:00.093+0000 7f3faffff700 1 --2- 172.21.15.50:0/3524866950 >> v2:172.21.15.155:3300/0 conn(0x7f3fb01591c0 0x7f3fb00c72f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:26:00.096 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:26:00.093+0000 7f3faffff700 1 -- 172.21.15.50:0/3524866950 >> v1:172.21.15.50:6789/0 conn(0x7f3fb00c15d0 legacy=0x7f3fb0159670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:26:00.097 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:26:00.093+0000 7f3faeffd700 1 -- 172.21.15.50:0/3524866950 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 907452716 0 0) 0x7f3fb006e950 con 0x7f3fb00c15d0 2023-10-06T01:26:00.097 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:26:00.093+0000 7f3faffff700 1 -- 172.21.15.50:0/3524866950 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3fb006e020 con 0x7f3fb0158df0 2023-10-06T01:26:00.097 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:26:00.093+0000 7f3faf7fe700 1 --2- 172.21.15.50:0/3524866950 >> v2:172.21.15.155:3300/0 conn(0x7f3fb01591c0 0x7f3fb00c72f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T01:26:00.097 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:26:00.093+0000 7f3faffff700 1 --2- 172.21.15.50:0/3524866950 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3fb0158df0 0x7f3fb006d750 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f3fb0070050 tx=0x7f3fa00091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ee90ef462059c314 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:26:00.097 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:26:00.093+0000 7f3faeffd700 1 -- 172.21.15.50:0/3524866950 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fa000f6b0 con 0x7f3fb0158df0 2023-10-06T01:26:00.097 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:26:00.094+0000 7f3faeffd700 1 -- 172.21.15.50:0/3524866950 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3fa000f810 con 0x7f3fb0158df0 2023-10-06T01:26:00.097 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:26:00.094+0000 7f3faeffd700 1 -- 172.21.15.50:0/3524866950 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fa000fbb0 con 0x7f3fb0158df0 2023-10-06T01:26:00.097 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:26:00.094+0000 7f3fb519d700 1 -- 172.21.15.50:0/3524866950 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3fb0158df0 msgr2=0x7f3fb006d750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:26:00.097 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:26:00.094+0000 7f3fb519d700 1 --2- 172.21.15.50:0/3524866950 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3fb0158df0 0x7f3fb006d750 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f3fb0070050 tx=0x7f3fa00091a0 comp rx=0 tx=0).stop 2023-10-06T01:26:00.098 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:26:00.094+0000 7f3fb519d700 1 -- 172.21.15.50:0/3524866950 shutdown_connections 2023-10-06T01:26:00.098 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:26:00.094+0000 7f3fb519d700 1 --2- 172.21.15.50:0/3524866950 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3fb0158df0 0x7f3fb006d750 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:26:00.098 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:26:00.094+0000 7f3fb519d700 1 --2- 172.21.15.50:0/3524866950 >> v2:172.21.15.155:3300/0 conn(0x7f3fb01591c0 0x7f3fb00c72f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:26:00.098 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:26:00.094+0000 7f3fb519d700 1 -- 172.21.15.50:0/3524866950 >> 172.21.15.50:0/3524866950 conn(0x7f3fb00cbef0 msgr2=0x7f3fb00cc2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:26:00.098 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:26:00.094+0000 7f3fb519d700 1 -- 172.21.15.50:0/3524866950 shutdown_connections 2023-10-06T01:26:00.098 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:26:00.094+0000 7f3fb519d700 1 -- 172.21.15.50:0/3524866950 wait complete. 2023-10-06T01:26:00.098 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:26:00.096+0000 7f3fb519d700 1 Processor -- start 2023-10-06T01:26:00.098 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:26:00.096+0000 7f3fb519d700 1 -- start start 2023-10-06T01:26:00.100 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:26:00.097+0000 7f3fb519d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3fb00c15d0 0x7f3fb0166b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:26:00.100 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:26:00.097+0000 7f3fb519d700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3fb0158df0 0x7f3fb00afed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:26:00.101 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:26:00.097+0000 7f3fb519d700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3fb01591c0 0x7f3fb016ce10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:26:00.101 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:26:00.097+0000 7f3fb519d700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3fb00b0910 con 0x7f3fb00c15d0 2023-10-06T01:26:00.101 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:26:00.097+0000 7f3fb519d700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3fb00b0bf0 con 0x7f3fb0158df0 2023-10-06T01:26:00.101 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:26:00.097+0000 7f3fb519d700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3fb00b0ed0 con 0x7f3fb01591c0 2023-10-06T01:26:00.101 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:26:00.097+0000 7f3faffff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3fb00c15d0 0x7f3fb0166b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:26:00.101 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:26:00.097+0000 7f3faffff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3fb00c15d0 0x7f3fb0166b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:46368/0 (socket says 172.21.15.50:46368) 2023-10-06T01:26:00.101 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:26:00.097+0000 7f3faffff700 1 -- 172.21.15.50:0/295741867 learned_addr learned my addr 172.21.15.50:0/295741867 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-06T01:26:00.101 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:26:00.097+0000 7f3faf7fe700 1 --2- 172.21.15.50:0/295741867 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3fb0158df0 0x7f3fb00afed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:26:00.101 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:26:00.097+0000 7f3fb499c700 1 --2- 172.21.15.50:0/295741867 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3fb01591c0 0x7f3fb016ce10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:26:00.101 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:26:00.097+0000 7f3faffff700 1 -- 172.21.15.50:0/295741867 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3fb01591c0 msgr2=0x7f3fb016ce10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:26:00.102 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:26:00.097+0000 7f3faffff700 1 --2- 172.21.15.50:0/295741867 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3fb01591c0 0x7f3fb016ce10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:26:00.102 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:26:00.097+0000 7f3faffff700 1 -- 172.21.15.50:0/295741867 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3fb0158df0 msgr2=0x7f3fb00afed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:26:00.102 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:26:00.097+0000 7f3faffff700 1 --2- 172.21.15.50:0/295741867 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3fb0158df0 0x7f3fb00afed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:26:00.102 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:26:00.097+0000 7f3faffff700 1 -- 172.21.15.50:0/295741867 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3fa0009420 con 0x7f3fb00c15d0 2023-10-06T01:26:00.102 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:26:00.097+0000 7f3faf7fe700 1 --2- 172.21.15.50:0/295741867 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3fb0158df0 0x7f3fb00afed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T01:26:00.102 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:26:00.097+0000 7f3fb499c700 1 --2- 172.21.15.50:0/295741867 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3fb01591c0 0x7f3fb016ce10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T01:26:00.102 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:26:00.098+0000 7f3faffff700 1 --2- 172.21.15.50:0/295741867 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3fb00c15d0 0x7f3fb0166b50 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f3fb0071790 tx=0x7f3fa0019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:26:00.102 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:26:00.098+0000 7f3f97fff700 1 -- 172.21.15.50:0/295741867 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fa000fb90 con 0x7f3fb00c15d0 2023-10-06T01:26:00.102 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:26:00.098+0000 7f3f97fff700 1 -- 172.21.15.50:0/295741867 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3fa0010470 con 0x7f3fb00c15d0 2023-10-06T01:26:00.103 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:26:00.098+0000 7f3f97fff700 1 -- 172.21.15.50:0/295741867 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fa00107f0 con 0x7f3fb00c15d0 2023-10-06T01:26:00.103 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:26:00.098+0000 7f3fb519d700 1 -- 172.21.15.50:0/295741867 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3fb016aa80 con 0x7f3fb00c15d0 2023-10-06T01:26:00.103 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:26:00.098+0000 7f3fb519d700 1 -- 172.21.15.50:0/295741867 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3fb016daa0 con 0x7f3fb00c15d0 2023-10-06T01:26:00.103 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:26:00.099+0000 7f3fb519d700 1 -- 172.21.15.50:0/295741867 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3fb005f270 con 0x7f3fb00c15d0 2023-10-06T01:26:00.103 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:26:00.100+0000 7f3f97fff700 1 -- 172.21.15.50:0/295741867 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f3fa002c440 con 0x7f3fb00c15d0 2023-10-06T01:26:00.104 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:26:00.101+0000 7f3f97fff700 1 --2- 172.21.15.50:0/295741867 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f3f9c066f30 0x7f3f9c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:26:00.104 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:26:00.101+0000 7f3f97fff700 1 -- 172.21.15.50:0/295741867 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5612+0+0 (secure 0 0 0) 0x7f3fa0014070 con 0x7f3fb00c15d0 2023-10-06T01:26:00.104 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:26:00.101+0000 7f3faf7fe700 1 --2- 172.21.15.50:0/295741867 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f3f9c066f30 0x7f3f9c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:26:00.104 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:26:00.102+0000 7f3faf7fe700 1 --2- 172.21.15.50:0/295741867 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f3f9c066f30 0x7f3f9c0693e0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f3fa4006f00 tx=0x7f3fa4008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:26:00.106 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:26:00.105+0000 7f3f97fff700 1 -- 172.21.15.50:0/295741867 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f3fa0053130 con 0x7f3fb00c15d0 2023-10-06T01:26:00.304 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:26:00.304+0000 7f3fb519d700 1 -- 172.21.15.50:0/295741867 --> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f3fb00c2420 con 0x7f3f9c066f30 2023-10-06T01:26:00.308 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:26:00.307+0000 7f3f97fff700 1 -- 172.21.15.50:0/295741867 <== mgr.4099 v2:172.21.15.155:6832/85215 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+72776 (secure 0 0 0) 0x7f3fb00c2420 con 0x7f3f9c066f30 2023-10-06T01:26:00.309 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-10-06T01:26:00.310 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:26:00.309+0000 7f3fb519d700 1 -- 172.21.15.50:0/295741867 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f3f9c066f30 msgr2=0x7f3f9c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:26:00.311 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:26:00.309+0000 7f3fb519d700 1 --2- 172.21.15.50:0/295741867 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f3f9c066f30 0x7f3f9c0693e0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f3fa4006f00 tx=0x7f3fa4008040 comp rx=0 tx=0).stop 2023-10-06T01:26:00.311 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:26:00.309+0000 7f3fb519d700 1 -- 172.21.15.50:0/295741867 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3fb00c15d0 msgr2=0x7f3fb0166b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:26:00.311 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:26:00.309+0000 7f3fb519d700 1 --2- 172.21.15.50:0/295741867 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3fb00c15d0 0x7f3fb0166b50 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f3fb0071790 tx=0x7f3fa0019000 comp rx=0 tx=0).stop 2023-10-06T01:26:00.311 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:26:00.309+0000 7f3fb519d700 1 -- 172.21.15.50:0/295741867 shutdown_connections 2023-10-06T01:26:00.311 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:26:00.309+0000 7f3fb519d700 1 --2- 172.21.15.50:0/295741867 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3fb01591c0 0x7f3fb016ce10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:26:00.311 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:26:00.309+0000 7f3fb519d700 1 --2- 172.21.15.50:0/295741867 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3fb00c15d0 0x7f3fb0166b50 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:26:00.311 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:26:00.309+0000 7f3fb519d700 1 --2- 172.21.15.50:0/295741867 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f3f9c066f30 0x7f3f9c0693e0 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:26:00.311 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:26:00.309+0000 7f3fb519d700 1 --2- 172.21.15.50:0/295741867 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3fb0158df0 0x7f3fb00afed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:26:00.311 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:26:00.309+0000 7f3fb519d700 1 -- 172.21.15.50:0/295741867 >> 172.21.15.50:0/295741867 conn(0x7f3fb00cbef0 msgr2=0x7f3fb0157610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:26:00.311 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:26:00.310+0000 7f3fb519d700 1 -- 172.21.15.50:0/295741867 shutdown_connections 2023-10-06T01:26:00.312 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:26:00.310+0000 7f3fb519d700 1 -- 172.21.15.50:0/295741867 wait complete. 2023-10-06T01:26:00.312 INFO:teuthology.orchestra.run.smithi050.stderr:dumped all 2023-10-06T01:26:00.328 INFO:teuthology.orchestra.run.smithi050.stdout:{"pg_ready":true,"pg_map":{"version":173,"stamp":"2023-10-06T01:25:59.835299+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2399900,"kb_used_data":5212,"kb_used_omap":0,"kb_used_meta":2394624,"kb_avail":752574820,"statfs":{"total":773094113280,"available":770636615680,"internally_reserved":0,"allocated":5337088,"data_stored":3058658,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2452094976},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002974"},"pg_stats":[{"pgid":"1.5","version":"0'0","reported_seq":47,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-06T01:25:41.270402+0000","last_change":"2023-10-06T01:25:41.270342+0000","last_active":"2023-10-06T01:25:41.270402+0000","last_peered":"2023-10-06T01:25:41.270402+0000","last_clean":"2023-10-06T01:25:41.270402+0000","last_became_active":"2023-10-06T01:21:30.600724+0000","last_became_peered":"2023-10-06T01:21:30.600724+0000","last_unstale":"2023-10-06T01:25:41.270402+0000","last_undegraded":"2023-10-06T01:25:41.270402+0000","last_fullsized":"2023-10-06T01:25:41.270402+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:25:41.270251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:25:41.270251+0000","last_clean_scrub_stamp":"2023-10-06T01:25:41.270251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:17:08.982645+0000","scrub_duration":0.0022606610000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":46,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-06T01:25:37.676538+0000","last_change":"2023-10-06T01:25:37.676496+0000","last_active":"2023-10-06T01:25:37.676538+0000","last_peered":"2023-10-06T01:25:37.676538+0000","last_clean":"2023-10-06T01:25:37.676538+0000","last_became_active":"2023-10-06T01:21:30.603215+0000","last_became_peered":"2023-10-06T01:21:30.603215+0000","last_unstale":"2023-10-06T01:25:37.676538+0000","last_undegraded":"2023-10-06T01:25:37.676538+0000","last_fullsized":"2023-10-06T01:25:37.676538+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:25:37.676366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:25:37.676366+0000","last_clean_scrub_stamp":"2023-10-06T01:25:37.676366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T01:36:20.734777+0000","scrub_duration":0.001983074,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":45,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-06T01:25:36.291795+0000","last_change":"2023-10-06T01:25:36.291771+0000","last_active":"2023-10-06T01:25:36.291795+0000","last_peered":"2023-10-06T01:25:36.291795+0000","last_clean":"2023-10-06T01:25:36.291795+0000","last_became_active":"2023-10-06T01:21:30.604535+0000","last_became_peered":"2023-10-06T01:21:30.604535+0000","last_unstale":"2023-10-06T01:25:36.291795+0000","last_undegraded":"2023-10-06T01:25:36.291795+0000","last_fullsized":"2023-10-06T01:25:36.291795+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:25:36.291697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:25:36.291697+0000","last_clean_scrub_stamp":"2023-10-06T01:25:36.291697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:25:18.879286+0000","scrub_duration":0.0019018100000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"44'119","reported_seq":196,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-06T01:25:47.878198+0000","last_change":"2023-10-06T01:25:47.878151+0000","last_active":"2023-10-06T01:25:47.878198+0000","last_peered":"2023-10-06T01:25:47.878198+0000","last_clean":"2023-10-06T01:25:47.878198+0000","last_became_active":"2023-10-06T01:21:31.601431+0000","last_became_peered":"2023-10-06T01:21:31.601431+0000","last_unstale":"2023-10-06T01:25:47.878198+0000","last_undegraded":"2023-10-06T01:25:47.878198+0000","last_fullsized":"2023-10-06T01:25:47.878198+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'119","last_scrub_stamp":"2023-10-06T01:25:47.878048+0000","last_deep_scrub":"44'119","last_deep_scrub_stamp":"2023-10-06T01:25:47.878048+0000","last_clean_scrub_stamp":"2023-10-06T01:25:47.878048+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:17:15.590442+0000","scrub_duration":0.0054991190000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":45,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-06T01:25:45.933786+0000","last_change":"2023-10-06T01:25:45.933752+0000","last_active":"2023-10-06T01:25:45.933786+0000","last_peered":"2023-10-06T01:25:45.933786+0000","last_clean":"2023-10-06T01:25:45.933786+0000","last_became_active":"2023-10-06T01:21:31.337918+0000","last_became_peered":"2023-10-06T01:21:31.337918+0000","last_unstale":"2023-10-06T01:25:45.933786+0000","last_undegraded":"2023-10-06T01:25:45.933786+0000","last_fullsized":"2023-10-06T01:25:45.933786+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:25:45.933659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:25:45.933659+0000","last_clean_scrub_stamp":"2023-10-06T01:25:45.933659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:23:00.086001+0000","scrub_duration":0.002266606,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":45,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-06T01:25:43.934534+0000","last_change":"2023-10-06T01:25:43.934501+0000","last_active":"2023-10-06T01:25:43.934534+0000","last_peered":"2023-10-06T01:25:43.934534+0000","last_clean":"2023-10-06T01:25:43.934534+0000","last_became_active":"2023-10-06T01:21:31.337870+0000","last_became_peered":"2023-10-06T01:21:31.337870+0000","last_unstale":"2023-10-06T01:25:43.934534+0000","last_undegraded":"2023-10-06T01:25:43.934534+0000","last_fullsized":"2023-10-06T01:25:43.934534+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:25:43.934415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:25:43.934415+0000","last_clean_scrub_stamp":"2023-10-06T01:25:43.934415+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:51:48.139643+0000","scrub_duration":0.002030301,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":45,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-06T01:25:39.099168+0000","last_change":"2023-10-06T01:25:39.099121+0000","last_active":"2023-10-06T01:25:39.099168+0000","last_peered":"2023-10-06T01:25:39.099168+0000","last_clean":"2023-10-06T01:25:39.099168+0000","last_became_active":"2023-10-06T01:21:31.337872+0000","last_became_peered":"2023-10-06T01:21:31.337872+0000","last_unstale":"2023-10-06T01:25:39.099168+0000","last_undegraded":"2023-10-06T01:25:39.099168+0000","last_fullsized":"2023-10-06T01:25:39.099168+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:25:39.099022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:25:39.099022+0000","last_clean_scrub_stamp":"2023-10-06T01:25:39.099022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:51:43.304249+0000","scrub_duration":0.0020045219999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":45,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-06T01:25:39.458946+0000","last_change":"2023-10-06T01:25:39.458897+0000","last_active":"2023-10-06T01:25:39.458946+0000","last_peered":"2023-10-06T01:25:39.458946+0000","last_clean":"2023-10-06T01:25:39.458946+0000","last_became_active":"2023-10-06T01:21:31.337820+0000","last_became_peered":"2023-10-06T01:21:31.337820+0000","last_unstale":"2023-10-06T01:25:39.458946+0000","last_undegraded":"2023-10-06T01:25:39.458946+0000","last_fullsized":"2023-10-06T01:25:39.458946+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:25:39.458816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:25:39.458816+0000","last_clean_scrub_stamp":"2023-10-06T01:25:39.458816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:06:33.295110+0000","scrub_duration":0.0016817970000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":45,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-06T01:25:43.400606+0000","last_change":"2023-10-06T01:25:43.400572+0000","last_active":"2023-10-06T01:25:43.400606+0000","last_peered":"2023-10-06T01:25:43.400606+0000","last_clean":"2023-10-06T01:25:43.400606+0000","last_became_active":"2023-10-06T01:21:30.603673+0000","last_became_peered":"2023-10-06T01:21:30.603673+0000","last_unstale":"2023-10-06T01:25:43.400606+0000","last_undegraded":"2023-10-06T01:25:43.400606+0000","last_fullsized":"2023-10-06T01:25:43.400606+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:25:43.400472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:25:43.400472+0000","last_clean_scrub_stamp":"2023-10-06T01:25:43.400472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:08:36.340936+0000","scrub_duration":0.0024605180000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574906,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298376,"kb_used_data":1088,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073464,"statfs":{"total":96636764160,"available":96331227136,"internally_reserved":0,"allocated":1114112,"data_stored":825475,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 01:25:34 2023","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.65300000000000002,"15min":0.67900000000000005},"min":{"1min":0.42899999999999999,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.82799999999999996,"5min":0.93700000000000006,"15min":0.93700000000000006},"last":0.77500000000000002},{"interface":"front","average":{"1min":0.61799999999999999,"5min":0.622,"15min":0.64600000000000002},"min":{"1min":0.42399999999999999,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.76900000000000002,"5min":0.96999999999999997,"15min":0.96999999999999997},"last":0.746}]},{"osd":1,"last update":"Fri Oct 6 01:25:34 2023","interfaces":[{"interface":"back","average":{"1min":0.67000000000000004,"5min":0.64800000000000002,"15min":0.66200000000000003},"min":{"1min":0.50800000000000001,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.92400000000000004,"5min":0.92400000000000004,"15min":0.92400000000000004},"last":0.68500000000000005},{"interface":"front","average":{"1min":0.626,"5min":0.65400000000000003,"15min":0.67400000000000004},"min":{"1min":0.46400000000000002,"5min":0.439,"15min":0.439},"max":{"1min":0.80600000000000005,"5min":0.91400000000000003,"15min":0.91400000000000003},"last":0.79400000000000004}]},{"osd":2,"last update":"Fri Oct 6 01:25:34 2023","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.63100000000000001,"15min":0.65900000000000003},"min":{"1min":0.47199999999999998,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":0.86699999999999999,"5min":0.86699999999999999,"15min":0.86699999999999999},"last":0.76400000000000001},{"interface":"front","average":{"1min":0.67500000000000004,"5min":0.69899999999999995,"15min":0.72899999999999998},"min":{"1min":0.45600000000000002,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.85699999999999998,"5min":0.93600000000000005,"15min":0.93600000000000005},"last":0.81799999999999995}]},{"osd":3,"last update":"Fri Oct 6 01:25:34 2023","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.70699999999999996,"15min":0.73399999999999999},"min":{"1min":0.50900000000000001,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":0.81299999999999994,"5min":1.0660000000000001,"15min":1.0660000000000001},"last":0.67100000000000004},{"interface":"front","average":{"1min":0.69599999999999995,"5min":0.71099999999999997,"15min":0.73999999999999999},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":0.83399999999999996,"5min":0.89400000000000002,"15min":0.89400000000000002},"last":0.70899999999999996}]},{"osd":4,"last update":"Fri Oct 6 01:25:34 2023","interfaces":[{"interface":"back","average":{"1min":0.68700000000000006,"5min":0.64900000000000002,"15min":0.64000000000000001},"min":{"1min":0.47399999999999998,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.878,"5min":1.01,"15min":1.01},"last":0.52900000000000003},{"interface":"front","average":{"1min":0.65300000000000002,"5min":0.65800000000000003,"15min":0.67200000000000004},"min":{"1min":0.46100000000000002,"5min":0.441,"15min":0.441},"max":{"1min":0.89200000000000002,"5min":0.94399999999999995,"15min":0.94399999999999995},"last":0.83799999999999997}]},{"osd":5,"last update":"Fri Oct 6 01:25:34 2023","interfaces":[{"interface":"back","average":{"1min":0.64700000000000002,"5min":0.65000000000000002,"15min":0.65800000000000003},"min":{"1min":0.45200000000000001,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.84799999999999998,"5min":0.98599999999999999,"15min":0.98599999999999999},"last":0.63700000000000001},{"interface":"front","average":{"1min":0.76300000000000001,"5min":0.73799999999999999,"15min":0.72999999999999998},"min":{"1min":0.60999999999999999,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":0.91900000000000004,"5min":0.97999999999999998,"15min":0.97999999999999998},"last":0.72499999999999998}]},{"osd":6,"last update":"Fri Oct 6 01:25:34 2023","interfaces":[{"interface":"back","average":{"1min":0.78300000000000003,"5min":0.76900000000000002,"15min":0.78100000000000003},"min":{"1min":0.59399999999999997,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":0.96899999999999997,"5min":1,"15min":1},"last":0.85399999999999998},{"interface":"front","average":{"1min":0.748,"5min":0.746,"15min":0.752},"min":{"1min":0.57499999999999996,"5min":0.438,"15min":0.438},"max":{"1min":0.88500000000000001,"5min":1.1000000000000001,"15min":1.1000000000000001},"last":0.61299999999999999}]}]},{"osd":6,"up_from":13,"seq":55834574906,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297796,"kb_used_data":508,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074044,"statfs":{"total":96636764160,"available":96331821056,"internally_reserved":0,"allocated":520192,"data_stored":235107,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 01:25:34 2023","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.68600000000000005,"15min":0.751},"min":{"1min":0.46200000000000002,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.878,"5min":1.9279999999999999,"15min":1.9279999999999999},"last":0.873},{"interface":"front","average":{"1min":0.69399999999999995,"5min":0.746,"15min":0.80800000000000005},"min":{"1min":0.496,"5min":0.433,"15min":0.433},"max":{"1min":0.90900000000000003,"5min":2.3420000000000001,"15min":2.3420000000000001},"last":0.86099999999999999}]},{"osd":1,"last update":"Fri Oct 6 01:25:34 2023","interfaces":[{"interface":"back","average":{"1min":0.624,"5min":0.875,"15min":1.133},"min":{"1min":0.45800000000000002,"5min":0.44,"15min":0.44},"max":{"1min":0.89000000000000001,"5min":12.529,"15min":12.529},"last":0.72899999999999998},{"interface":"front","average":{"1min":0.64900000000000002,"5min":0.74399999999999999,"15min":0.83599999999999997},"min":{"1min":0.42799999999999999,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.94199999999999995,"5min":3.98,"15min":3.98},"last":0.89800000000000002}]},{"osd":2,"last update":"Fri Oct 6 01:25:34 2023","interfaces":[{"interface":"back","average":{"1min":0.66100000000000003,"5min":0.75700000000000001,"15min":0.878},"min":{"1min":0.56200000000000006,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.78500000000000003,"5min":5.4859999999999998,"15min":5.4859999999999998},"last":0.76700000000000002},{"interface":"front","average":{"1min":0.66100000000000003,"5min":0.70399999999999996,"15min":0.76900000000000002},"min":{"1min":0.47699999999999998,"5min":0.443,"15min":0.443},"max":{"1min":0.80600000000000005,"5min":2.718,"15min":2.718},"last":0.84199999999999997}]},{"osd":3,"last update":"Fri Oct 6 01:25:34 2023","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.71499999999999997,"15min":0.77300000000000002},"min":{"1min":0.48299999999999998,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":0.86099999999999999,"5min":2.5129999999999999,"15min":2.5129999999999999},"last":0.82599999999999996},{"interface":"front","average":{"1min":0.70899999999999996,"5min":0.72999999999999998,"15min":0.77100000000000002},"min":{"1min":0.55000000000000004,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":0.83599999999999997,"5min":1.9870000000000001,"15min":1.9870000000000001},"last":0.97699999999999998}]},{"osd":4,"last update":"Fri Oct 6 01:25:34 2023","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.68400000000000005,"15min":0.73899999999999999},"min":{"1min":0.45300000000000001,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.84499999999999997,"5min":3.1480000000000001,"15min":3.1480000000000001},"last":0.625},{"interface":"front","average":{"1min":0.70399999999999996,"5min":0.746,"15min":0.79600000000000004},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.97799999999999998,"5min":2.4769999999999999,"15min":2.4769999999999999},"last":0.69099999999999995}]},{"osd":5,"last update":"Fri Oct 6 01:25:34 2023","interfaces":[{"interface":"back","average":{"1min":0.66600000000000004,"5min":0.80100000000000005,"15min":0.90700000000000003},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.88300000000000001,"5min":5.4279999999999999,"15min":5.4279999999999999},"last":1.0109999999999999},{"interface":"front","average":{"1min":0.74099999999999999,"5min":0.78900000000000003,"15min":0.83699999999999997},"min":{"1min":0.58799999999999997,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":0.91300000000000003,"5min":2.6739999999999999,"15min":2.6739999999999999},"last":0.92500000000000004}]},{"osd":7,"last update":"Fri Oct 6 01:25:34 2023","interfaces":[{"interface":"back","average":{"1min":0.75600000000000001,"5min":0.79800000000000004,"15min":0.85499999999999998},"min":{"1min":0.55100000000000005,"5min":0.497,"15min":0.497},"max":{"1min":0.90000000000000002,"5min":2.7719999999999998,"15min":2.7719999999999998},"last":0.749},{"interface":"front","average":{"1min":0.73099999999999998,"5min":0.89200000000000002,"15min":1.036},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.89800000000000002,"5min":7.1440000000000001,"15min":7.1440000000000001},"last":1.1020000000000001}]}]},{"osd":1,"up_from":13,"seq":55834574904,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302468,"kb_used_data":1084,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069372,"statfs":{"total":96636764160,"available":96327036928,"internally_reserved":0,"allocated":1110016,"data_stored":824497,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 01:25:35 2023","interfaces":[{"interface":"back","average":{"1min":0.41199999999999998,"5min":0.44,"15min":0.45200000000000001},"min":{"1min":0.28999999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.80900000000000005,"5min":0.80900000000000005,"15min":0.80900000000000005},"last":0.39500000000000002},{"interface":"front","average":{"1min":0.48599999999999999,"5min":0.48399999999999999,"15min":0.499},"min":{"1min":0.40400000000000003,"5min":0.375,"15min":0.375},"max":{"1min":0.84299999999999997,"5min":0.84299999999999997,"15min":0.84299999999999997},"last":0.45600000000000002}]},{"osd":2,"last update":"Fri Oct 6 01:25:35 2023","interfaces":[{"interface":"back","average":{"1min":0.42699999999999999,"5min":0.438,"15min":0.46500000000000002},"min":{"1min":0.31,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.77700000000000002,"5min":1.073,"15min":1.073},"last":0.5},{"interface":"front","average":{"1min":0.45700000000000002,"5min":0.47099999999999997,"15min":0.48699999999999999},"min":{"1min":0.36699999999999999,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"last":0.48799999999999999}]},{"osd":3,"last update":"Fri Oct 6 01:25:35 2023","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.55700000000000005,"15min":0.57399999999999995},"min":{"1min":0.44400000000000001,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.93300000000000005,"5min":0.93300000000000005,"15min":0.93300000000000005},"last":0.55800000000000005},{"interface":"front","average":{"1min":0.501,"5min":0.51400000000000001,"15min":0.54600000000000004},"min":{"1min":0.35799999999999998,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.79800000000000004,"5min":0.93400000000000005,"15min":0.93400000000000005},"last":0.58599999999999997}]},{"osd":4,"last update":"Fri Oct 6 01:25:35 2023","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":0.73999999999999999,"15min":0.77400000000000002},"min":{"1min":0.48299999999999998,"5min":0.432,"15min":0.432},"max":{"1min":0.94899999999999995,"5min":1.534,"15min":1.534},"last":1.0449999999999999},{"interface":"front","average":{"1min":0.74399999999999999,"5min":0.747,"15min":0.78500000000000003},"min":{"1min":0.56599999999999995,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":1.0629999999999999,"5min":1.742,"15min":1.742},"last":0.66000000000000003}]},{"osd":5,"last update":"Fri Oct 6 01:25:35 2023","interfaces":[{"interface":"back","average":{"1min":0.76400000000000001,"5min":0.75,"15min":0.77400000000000002},"min":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":0.99399999999999999,"5min":1.4790000000000001,"15min":1.4790000000000001},"last":1.0660000000000001},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.752,"15min":0.80000000000000004},"min":{"1min":0.52400000000000002,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":1.075,"5min":1.581,"15min":1.581},"last":1.105}]},{"osd":6,"last update":"Fri Oct 6 01:25:35 2023","interfaces":[{"interface":"back","average":{"1min":0.74099999999999999,"5min":0.746,"15min":0.78000000000000003},"min":{"1min":0.55600000000000005,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":0.97999999999999998,"5min":1.51,"15min":1.51},"last":0.755},{"interface":"front","average":{"1min":0.74199999999999999,"5min":0.77000000000000002,"15min":0.79800000000000004},"min":{"1min":0.58399999999999996,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":1.0309999999999999,"5min":1.26,"15min":1.26},"last":0.82199999999999995}]},{"osd":7,"last update":"Fri Oct 6 01:25:35 2023","interfaces":[{"interface":"back","average":{"1min":0.751,"5min":0.77400000000000002,"15min":0.81799999999999995},"min":{"1min":0.57299999999999995,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":0.99399999999999999,"5min":1.7070000000000001,"15min":1.7070000000000001},"last":0.87},{"interface":"front","average":{"1min":0.76200000000000001,"5min":0.80100000000000005,"15min":0.85099999999999998},"min":{"1min":0.59299999999999997,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.006,"5min":1.633,"15min":1.633},"last":0.80200000000000005}]}]},{"osd":0,"up_from":13,"seq":55834574905,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301888,"kb_used_data":504,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069952,"statfs":{"total":96636764160,"available":96327630848,"internally_reserved":0,"allocated":516096,"data_stored":234129,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Oct 6 01:25:33 2023","interfaces":[{"interface":"back","average":{"1min":0.432,"5min":0.51700000000000002,"15min":0.61099999999999999},"min":{"1min":0.25900000000000001,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.995,"5min":2.8559999999999999,"15min":2.8559999999999999},"last":0.34799999999999998},{"interface":"front","average":{"1min":0.44400000000000001,"5min":0.55800000000000005,"15min":0.67000000000000004},"min":{"1min":0.33900000000000002,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.54200000000000004,"5min":2.944,"15min":2.944},"last":0.42399999999999999}]},{"osd":2,"last update":"Fri Oct 6 01:25:33 2023","interfaces":[{"interface":"back","average":{"1min":0.51500000000000001,"5min":0.61599999999999999,"15min":0.72799999999999998},"min":{"1min":0.41699999999999998,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.874,"5min":2.8940000000000001,"15min":2.8940000000000001},"last":0.48399999999999999},{"interface":"front","average":{"1min":0.51400000000000001,"5min":0.62,"15min":0.71899999999999997},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.69799999999999995,"5min":2.9820000000000002,"15min":2.9820000000000002},"last":0.54200000000000004}]},{"osd":3,"last update":"Fri Oct 6 01:25:33 2023","interfaces":[{"interface":"back","average":{"1min":0.46700000000000003,"5min":0.55100000000000005,"15min":0.65100000000000002},"min":{"1min":0.35199999999999998,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":1.137,"5min":2.7559999999999998,"15min":2.7559999999999998},"last":0.52200000000000002},{"interface":"front","average":{"1min":0.505,"5min":0.59099999999999997,"15min":0.68600000000000005},"min":{"1min":0.38200000000000001,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":1.0289999999999999,"5min":2.8140000000000001,"15min":2.8140000000000001},"last":0.56299999999999994}]},{"osd":4,"last update":"Fri Oct 6 01:25:33 2023","interfaces":[{"interface":"back","average":{"1min":0.747,"5min":0.75900000000000001,"15min":0.79500000000000004},"min":{"1min":0.53100000000000003,"5min":0.441,"15min":0.441},"max":{"1min":0.90800000000000003,"5min":1.397,"15min":1.397},"last":0.59799999999999998},{"interface":"front","average":{"1min":0.72899999999999998,"5min":0.78000000000000003,"15min":0.83599999999999997},"min":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":0.98899999999999999,"5min":1.833,"15min":1.833},"last":0.60999999999999999}]},{"osd":5,"last update":"Fri Oct 6 01:25:33 2023","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":0.77300000000000002,"15min":0.81899999999999995},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":0.96999999999999997,"5min":1.4430000000000001,"15min":1.4430000000000001},"last":0.625},{"interface":"front","average":{"1min":0.77100000000000002,"5min":0.76700000000000002,"15min":0.79900000000000004},"min":{"1min":0.58199999999999996,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":1.0580000000000001,"5min":1.4359999999999999,"15min":1.4359999999999999},"last":0.67200000000000004}]},{"osd":6,"last update":"Fri Oct 6 01:25:33 2023","interfaces":[{"interface":"back","average":{"1min":0.76100000000000001,"5min":0.80700000000000005,"15min":0.88900000000000001},"min":{"1min":0.63700000000000001,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":0.94799999999999995,"5min":1.8740000000000001,"15min":1.8740000000000001},"last":0.75700000000000001},{"interface":"front","average":{"1min":0.751,"5min":0.78700000000000003,"15min":0.83499999999999996},"min":{"1min":0.57299999999999995,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":1.0109999999999999,"5min":1.361,"15min":1.361},"last":0.81799999999999995}]},{"osd":7,"last update":"Fri Oct 6 01:25:33 2023","interfaces":[{"interface":"back","average":{"1min":0.76200000000000001,"5min":0.80000000000000004,"15min":0.84699999999999998},"min":{"1min":0.58699999999999997,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":1.0940000000000001,"5min":1.413,"15min":1.413},"last":0.77200000000000002},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.77500000000000002,"15min":0.81599999999999995},"min":{"1min":0.57799999999999996,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":0.94699999999999995,"5min":1.2929999999999999,"15min":1.2929999999999999},"last":0.73699999999999999}]}]},{"osd":2,"up_from":13,"seq":55834574904,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301892,"kb_used_data":508,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069948,"statfs":{"total":96636764160,"available":96327626752,"internally_reserved":0,"allocated":520192,"data_stored":235107,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 01:25:38 2023","interfaces":[{"interface":"back","average":{"1min":0.40500000000000003,"5min":0.44800000000000001,"15min":0.47999999999999998},"min":{"1min":0.23899999999999999,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":0.51800000000000002,"5min":0.96599999999999997,"15min":0.96599999999999997},"last":0.41599999999999998},{"interface":"front","average":{"1min":0.44,"5min":0.501,"15min":0.53200000000000003},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.61599999999999999,"5min":1,"15min":1},"last":0.39000000000000001}]},{"osd":1,"last update":"Fri Oct 6 01:25:38 2023","interfaces":[{"interface":"back","average":{"1min":0.47099999999999997,"5min":0.52500000000000002,"15min":0.57199999999999995},"min":{"1min":0.312,"5min":0.312,"15min":0.312},"max":{"1min":0.622,"5min":1.296,"15min":1.296},"last":0.53000000000000003},{"interface":"front","average":{"1min":0.45400000000000001,"5min":0.51300000000000001,"15min":0.55600000000000005},"min":{"1min":0.34999999999999998,"5min":0.313,"15min":0.313},"max":{"1min":0.623,"5min":1.1379999999999999,"15min":1.1379999999999999},"last":0.67600000000000005}]},{"osd":3,"last update":"Fri Oct 6 01:25:38 2023","interfaces":[{"interface":"back","average":{"1min":0.497,"5min":0.57099999999999995,"15min":0.624},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.79900000000000004,"5min":1.222,"15min":1.222},"last":0.58799999999999997},{"interface":"front","average":{"1min":0.47899999999999998,"5min":0.48399999999999999,"15min":0.501},"min":{"1min":0.36499999999999999,"5min":0.318,"15min":0.318},"max":{"1min":0.61199999999999999,"5min":0.72099999999999997,"15min":0.72099999999999997},"last":0.498}]},{"osd":4,"last update":"Fri Oct 6 01:25:38 2023","interfaces":[{"interface":"back","average":{"1min":0.755,"5min":0.73899999999999999,"15min":0.73699999999999999},"min":{"1min":0.64700000000000002,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.109,"5min":1.109,"15min":1.109},"last":0.60899999999999999},{"interface":"front","average":{"1min":0.78300000000000003,"5min":0.79400000000000004,"15min":0.82399999999999995},"min":{"1min":0.60499999999999998,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":1.101,"5min":1.5469999999999999,"15min":1.5469999999999999},"last":0.78200000000000003}]},{"osd":5,"last update":"Fri Oct 6 01:25:38 2023","interfaces":[{"interface":"back","average":{"1min":0.73999999999999999,"5min":0.75600000000000001,"15min":0.78200000000000003},"min":{"1min":0.60899999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":0.91700000000000004,"5min":1.5940000000000001,"15min":1.5940000000000001},"last":0.82399999999999995},{"interface":"front","average":{"1min":0.746,"5min":0.79600000000000004,"15min":0.85399999999999998},"min":{"1min":0.56499999999999995,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":1.0049999999999999,"5min":1.7669999999999999,"15min":1.7669999999999999},"last":0.69499999999999995}]},{"osd":6,"last update":"Fri Oct 6 01:25:38 2023","interfaces":[{"interface":"back","average":{"1min":0.78700000000000003,"5min":0.82599999999999996,"15min":0.89900000000000002},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.0549999999999999,"5min":2.0510000000000002,"15min":2.0510000000000002},"last":0.64900000000000002},{"interface":"front","average":{"1min":0.746,"5min":0.746,"15min":0.77600000000000002},"min":{"1min":0.59799999999999998,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.026,"5min":1.633,"15min":1.633},"last":0.89100000000000001}]},{"osd":7,"last update":"Fri Oct 6 01:25:38 2023","interfaces":[{"interface":"back","average":{"1min":0.746,"5min":0.78100000000000003,"15min":0.82199999999999995},"min":{"1min":0.57099999999999995,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":0.94699999999999995,"5min":1.4670000000000001,"15min":1.4670000000000001},"last":0.90600000000000003},{"interface":"front","average":{"1min":0.77700000000000002,"5min":0.81000000000000005,"15min":0.85999999999999999},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.0920000000000001,"5min":1.8,"15min":1.8},"last":0.79800000000000004}]}]},{"osd":3,"up_from":13,"seq":55834574904,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301892,"kb_used_data":508,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069948,"statfs":{"total":96636764160,"available":96327626752,"internally_reserved":0,"allocated":520192,"data_stored":235107,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 01:25:38 2023","interfaces":[{"interface":"back","average":{"1min":0.41699999999999998,"5min":0.41799999999999998,"15min":0.41499999999999998},"min":{"1min":0.29899999999999999,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.57299999999999995,"5min":0.95399999999999996,"15min":0.95399999999999996},"last":0.45700000000000002},{"interface":"front","average":{"1min":0.435,"5min":0.438,"15min":0.45600000000000002},"min":{"1min":0.33900000000000002,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.55400000000000005,"5min":0.69199999999999995,"15min":0.69199999999999995},"last":0.437}]},{"osd":1,"last update":"Fri Oct 6 01:25:38 2023","interfaces":[{"interface":"back","average":{"1min":0.44500000000000001,"5min":0.45700000000000002,"15min":0.48799999999999999},"min":{"1min":0.35399999999999998,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.55600000000000005,"5min":1.075,"15min":1.075},"last":0.41299999999999998},{"interface":"front","average":{"1min":0.50900000000000001,"5min":0.51200000000000001,"15min":0.52100000000000002},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"last":0.51900000000000002}]},{"osd":2,"last update":"Fri Oct 6 01:25:38 2023","interfaces":[{"interface":"back","average":{"1min":0.498,"5min":0.51800000000000002,"15min":0.54600000000000004},"min":{"1min":0.39400000000000002,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.69099999999999995,"5min":1.4319999999999999,"15min":1.4319999999999999},"last":0.68700000000000006},{"interface":"front","average":{"1min":0.51200000000000001,"5min":0.54700000000000004,"15min":0.57899999999999996},"min":{"1min":0.41399999999999998,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.60799999999999998,"5min":1.532,"15min":1.532},"last":0.73199999999999998}]},{"osd":4,"last update":"Fri Oct 6 01:25:38 2023","interfaces":[{"interface":"back","average":{"1min":0.77000000000000002,"5min":0.79400000000000004,"15min":0.83399999999999996},"min":{"1min":0.61899999999999999,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":0.997,"5min":1.1080000000000001,"15min":1.1080000000000001},"last":0.83399999999999996},{"interface":"front","average":{"1min":0.81299999999999994,"5min":0.81000000000000005,"15min":0.84399999999999997},"min":{"1min":0.58799999999999997,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":1.337,"5min":1.353,"15min":1.353},"last":0.85899999999999999}]},{"osd":5,"last update":"Fri Oct 6 01:25:38 2023","interfaces":[{"interface":"back","average":{"1min":0.69499999999999995,"5min":0.75,"15min":0.78200000000000003},"min":{"1min":0.53100000000000003,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.93300000000000005,"5min":1.3149999999999999,"15min":1.3149999999999999},"last":0.95699999999999996},{"interface":"front","average":{"1min":0.80100000000000005,"5min":0.75700000000000001,"15min":0.78700000000000003},"min":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.294,"5min":1.294,"15min":1.294},"last":0.81699999999999995}]},{"osd":6,"last update":"Fri Oct 6 01:25:38 2023","interfaces":[{"interface":"back","average":{"1min":0.78800000000000003,"5min":0.80900000000000005,"15min":0.84799999999999998},"min":{"1min":0.58099999999999996,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.3580000000000001,"5min":1.3580000000000001,"15min":1.3580000000000001},"last":0.64800000000000002},{"interface":"front","average":{"1min":0.81999999999999995,"5min":0.81799999999999995,"15min":0.85299999999999998},"min":{"1min":0.63700000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.298,"5min":1.3779999999999999,"15min":1.3779999999999999},"last":0.91100000000000003}]},{"osd":7,"last update":"Fri Oct 6 01:25:38 2023","interfaces":[{"interface":"back","average":{"1min":0.77500000000000002,"5min":0.79300000000000004,"15min":0.83799999999999997},"min":{"1min":0.55900000000000005,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.0409999999999999,"5min":1.1240000000000001,"15min":1.1240000000000001},"last":0.88900000000000001},{"interface":"front","average":{"1min":0.82199999999999995,"5min":0.82999999999999996,"15min":0.879},"min":{"1min":0.56699999999999995,"5min":0.55700000000000005,"15min":0.55700000000000005},"max":{"1min":1.3140000000000001,"5min":1.3140000000000001,"15min":1.3140000000000001},"last":0.874}]}]},{"osd":4,"up_from":13,"seq":55834574904,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297796,"kb_used_data":508,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074044,"statfs":{"total":96636764160,"available":96331821056,"internally_reserved":0,"allocated":520192,"data_stored":235107,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 01:25:38 2023","interfaces":[{"interface":"back","average":{"1min":0.66400000000000003,"5min":0.63800000000000001,"15min":0.628},"min":{"1min":0.46200000000000002,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.95499999999999996,"5min":1.298,"15min":1.298},"last":0.66300000000000003},{"interface":"front","average":{"1min":0.625,"5min":0.64200000000000002,"15min":0.64800000000000002},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.84499999999999997,"5min":1.081,"15min":1.081},"last":0.60599999999999998}]},{"osd":1,"last update":"Fri Oct 6 01:25:38 2023","interfaces":[{"interface":"back","average":{"1min":0.64000000000000001,"5min":0.65800000000000003,"15min":0.66400000000000003},"min":{"1min":0.46999999999999997,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.82199999999999995,"5min":1.264,"15min":1.264},"last":0.57899999999999996},{"interface":"front","average":{"1min":0.68799999999999994,"5min":0.68400000000000005,"15min":0.68700000000000006},"min":{"1min":0.48699999999999999,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":0.84999999999999998,"5min":1.143,"15min":1.143},"last":0.71099999999999997}]},{"osd":2,"last update":"Fri Oct 6 01:25:38 2023","interfaces":[{"interface":"back","average":{"1min":0.66800000000000004,"5min":0.69199999999999995,"15min":0.71499999999999997},"min":{"1min":0.57799999999999996,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":0.85399999999999998,"5min":1.3680000000000001,"15min":1.3680000000000001},"last":0.64300000000000002},{"interface":"front","average":{"1min":0.67700000000000005,"5min":0.69899999999999995,"15min":0.72099999999999997},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":0.999,"5min":0.999,"15min":0.999},"last":0.75800000000000001}]},{"osd":3,"last update":"Fri Oct 6 01:25:38 2023","interfaces":[{"interface":"back","average":{"1min":0.69899999999999995,"5min":0.69199999999999995,"15min":0.72199999999999998},"min":{"1min":0.52000000000000002,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":1.0720000000000001,"5min":1.2090000000000001,"15min":1.2090000000000001},"last":0.83199999999999996},{"interface":"front","average":{"1min":0.75900000000000001,"5min":0.76300000000000001,"15min":0.78800000000000003},"min":{"1min":0.59599999999999997,"5min":0.505,"15min":0.505},"max":{"1min":0.84699999999999998,"5min":1.444,"15min":1.444},"last":0.85699999999999998}]},{"osd":5,"last update":"Fri Oct 6 01:25:38 2023","interfaces":[{"interface":"back","average":{"1min":0.73499999999999999,"5min":0.69099999999999995,"15min":0.69099999999999995},"min":{"1min":0.60499999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":1.0389999999999999,"5min":1.0389999999999999,"15min":1.0389999999999999},"last":0.622},{"interface":"front","average":{"1min":0.70399999999999996,"5min":0.69099999999999995,"15min":0.70499999999999996},"min":{"1min":0.53600000000000003,"5min":0.439,"15min":0.439},"max":{"1min":0.873,"5min":0.97999999999999998,"15min":0.97999999999999998},"last":0.502}]},{"osd":6,"last update":"Fri Oct 6 01:25:38 2023","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.70299999999999996,"15min":0.72999999999999998},"min":{"1min":0.45600000000000002,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.88900000000000001,"5min":1.1779999999999999,"15min":1.1779999999999999},"last":0.68500000000000005},{"interface":"front","average":{"1min":0.77100000000000002,"5min":0.77000000000000002,"15min":0.78900000000000003},"min":{"1min":0.56499999999999995,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":1.087,"5min":1.1379999999999999,"15min":1.1379999999999999},"last":0.54600000000000004}]},{"osd":7,"last update":"Fri Oct 6 01:25:38 2023","interfaces":[{"interface":"back","average":{"1min":0.72799999999999998,"5min":0.73299999999999998,"15min":0.75600000000000001},"min":{"1min":0.53300000000000003,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.91400000000000003,"5min":1.0249999999999999,"15min":1.0249999999999999},"last":0.56399999999999995},{"interface":"front","average":{"1min":0.78400000000000003,"5min":0.79000000000000004,"15min":0.82299999999999995},"min":{"1min":0.57899999999999996,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":0.97499999999999998,"5min":1.2290000000000001,"15min":1.2290000000000001},"last":0.51800000000000002}]}]},{"osd":5,"up_from":13,"seq":55834574906,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297792,"kb_used_data":504,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074048,"statfs":{"total":96636764160,"available":96331825152,"internally_reserved":0,"allocated":516096,"data_stored":234129,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 01:25:36 2023","interfaces":[{"interface":"back","average":{"1min":0.57199999999999995,"5min":0.60699999999999998,"15min":0.63500000000000001},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.746,"5min":0.94699999999999995,"15min":0.94699999999999995},"last":0.73999999999999999},{"interface":"front","average":{"1min":0.67900000000000005,"5min":0.63100000000000001,"15min":0.61099999999999999},"min":{"1min":0.309,"5min":0.309,"15min":0.309},"max":{"1min":1.9359999999999999,"5min":1.9359999999999999,"15min":1.9359999999999999},"last":0.81299999999999994}]},{"osd":1,"last update":"Fri Oct 6 01:25:36 2023","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.63900000000000001,"15min":0.63100000000000001},"min":{"1min":0.44800000000000001,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.78600000000000003,"5min":1.028,"15min":1.028},"last":0.77900000000000003},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.65600000000000003,"15min":0.67600000000000005},"min":{"1min":0.46100000000000002,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":1.502,"5min":1.502,"15min":1.502},"last":0.66200000000000003}]},{"osd":2,"last update":"Fri Oct 6 01:25:36 2023","interfaces":[{"interface":"back","average":{"1min":0.67300000000000004,"5min":0.68100000000000005,"15min":0.68700000000000006},"min":{"1min":0.52100000000000002,"5min":0.435,"15min":0.435},"max":{"1min":1.4470000000000001,"5min":1.4470000000000001,"15min":1.4470000000000001},"last":0.76300000000000001},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.66500000000000004,"15min":0.67100000000000004},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.84899999999999998,"5min":1.0229999999999999,"15min":1.0229999999999999},"last":0.68600000000000005}]},{"osd":3,"last update":"Fri Oct 6 01:25:36 2023","interfaces":[{"interface":"back","average":{"1min":0.68700000000000006,"5min":0.65400000000000003,"15min":0.64800000000000002},"min":{"1min":0.49299999999999999,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":1.78,"5min":1.78,"15min":1.78},"last":0.71299999999999997},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.73599999999999999,"15min":0.77800000000000002},"min":{"1min":0.501,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":1.6799999999999999,"5min":1.6799999999999999,"15min":1.6799999999999999},"last":0.72599999999999998}]},{"osd":4,"last update":"Fri Oct 6 01:25:36 2023","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.64900000000000002,"15min":0.66900000000000004},"min":{"1min":0.38700000000000001,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.81899999999999995,"5min":1.0389999999999999,"15min":1.0389999999999999},"last":0.55200000000000005},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.65200000000000002,"15min":0.65600000000000003},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":1.823,"5min":1.823,"15min":1.823},"last":0.45500000000000002}]},{"osd":6,"last update":"Fri Oct 6 01:25:36 2023","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":0.67300000000000004,"15min":0.66700000000000004},"min":{"1min":0.44,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":1.748,"5min":1.748,"15min":1.748},"last":0.52900000000000003},{"interface":"front","average":{"1min":0.78600000000000003,"5min":0.71099999999999997,"15min":0.69599999999999995},"min":{"1min":0.497,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.8620000000000001,"5min":1.8620000000000001,"15min":1.8620000000000001},"last":0.60099999999999998}]},{"osd":7,"last update":"Fri Oct 6 01:25:36 2023","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":0.72299999999999998,"15min":0.71999999999999997},"min":{"1min":0.45600000000000002,"5min":0.438,"15min":0.438},"max":{"1min":1.718,"5min":1.718,"15min":1.718},"last":0.75600000000000001},{"interface":"front","average":{"1min":0.80800000000000005,"5min":0.81000000000000005,"15min":0.82699999999999996},"min":{"1min":0.63800000000000001,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":1.5529999999999999,"5min":1.5529999999999999,"15min":1.5529999999999999},"last":0.79300000000000004}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-06T01:26:00.330 DEBUG:teuthology.orchestra.run.smithi050:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2023-10-06T01:26:00.511 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:26:00.510+0000 7fa8a9b9d700 1 Processor -- start 2023-10-06T01:26:00.511 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:26:00.510+0000 7fa8a9b9d700 1 -- start start 2023-10-06T01:26:00.513 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:26:00.512+0000 7fa8a9b9d700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fa8a40b0fa0 0x7fa8a4158170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:26:00.513 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:26:00.512+0000 7fa8a9b9d700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa8a406e1a0 0x7fa8a40b1370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:26:00.513 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:26:00.512+0000 7fa8a9b9d700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa8a40adce0 con 0x7fa8a4151170 2023-10-06T01:26:00.513 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:26:00.512+0000 7fa8a9b9d700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa8a41586b0 con 0x7fa8a40b0fa0 2023-10-06T01:26:00.513 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:26:00.512+0000 7fa8a9b9d700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8a406f290 con 0x7fa8a406e1a0 2023-10-06T01:26:00.514 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:26:00.512+0000 7fa8a939c700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fa8a4151170 0x7fa8a41515e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:37652/0 (socket says 172.21.15.50:37652) 2023-10-06T01:26:00.514 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:26:00.512+0000 7fa8a939c700 1 -- 172.21.15.50:0/2142505538 learned_addr learned my addr 172.21.15.50:0/2142505538 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-10-06T01:26:00.514 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:26:00.512+0000 7fa8a3fff700 1 --2- 172.21.15.50:0/2142505538 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa8a406e1a0 0x7fa8a40b1370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:26:00.514 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:26:00.512+0000 7fa8a8b9b700 1 --2- 172.21.15.50:0/2142505538 >> v2:172.21.15.155:3300/0 conn(0x7fa8a40b0fa0 0x7fa8a4158170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:26:00.514 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:26:00.512+0000 7fa8a37fe700 1 -- 172.21.15.50:0/2142505538 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 6480780 0 0) 0x7fa8a40adce0 con 0x7fa8a4151170 2023-10-06T01:26:00.514 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:26:00.513+0000 7fa8a37fe700 1 -- 172.21.15.50:0/2142505538 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa894003570 con 0x7fa8a4151170 2023-10-06T01:26:00.517 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:26:00.513+0000 7fa8a37fe700 1 -- 172.21.15.50:0/2142505538 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3412222809 0 0) 0x7fa894003570 con 0x7fa8a4151170 2023-10-06T01:26:00.517 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:26:00.513+0000 7fa8a37fe700 1 -- 172.21.15.50:0/2142505538 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa8a406e1a0 msgr2=0x7fa8a40b1370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:26:00.517 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:26:00.513+0000 7fa8a37fe700 1 --2- 172.21.15.50:0/2142505538 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa8a406e1a0 0x7fa8a40b1370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:26:00.517 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:26:00.513+0000 7fa8a37fe700 1 -- 172.21.15.50:0/2142505538 >> v2:172.21.15.155:3300/0 conn(0x7fa8a40b0fa0 msgr2=0x7fa8a4158170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:26:00.517 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:26:00.513+0000 7fa8a37fe700 1 --2- 172.21.15.50:0/2142505538 >> v2:172.21.15.155:3300/0 conn(0x7fa8a40b0fa0 0x7fa8a4158170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:26:00.517 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:26:00.513+0000 7fa8a37fe700 1 -- 172.21.15.50:0/2142505538 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8a40b18b0 con 0x7fa8a4151170 2023-10-06T01:26:00.517 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:26:00.513+0000 7fa8a37fe700 1 -- 172.21.15.50:0/2142505538 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 347519148 0 0) 0x7fa89c0017f0 con 0x7fa8a4151170 2023-10-06T01:26:00.517 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:26:00.513+0000 7fa8a37fe700 1 -- 172.21.15.50:0/2142505538 >> v1:172.21.15.50:6789/0 conn(0x7fa8a4151170 legacy=0x7fa8a41515e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:26:00.518 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:26:00.513+0000 7fa8a37fe700 1 --2- 172.21.15.50:0/2142505538 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa894003a60 0x7fa894003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:26:00.518 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:26:00.513+0000 7fa8a37fe700 1 --2- 172.21.15.50:0/2142505538 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa894004810 0x7fa894004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:26:00.518 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:26:00.513+0000 7fa8a37fe700 1 --2- 172.21.15.50:0/2142505538 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa8a406e1a0 0x7fa8940051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:26:00.518 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:26:00.513+0000 7fa8a37fe700 1 -- 172.21.15.50:0/2142505538 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8a41586b0 con 0x7fa894003a60 2023-10-06T01:26:00.518 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:26:00.513+0000 7fa8a37fe700 1 -- 172.21.15.50:0/2142505538 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8a406f290 con 0x7fa894004810 2023-10-06T01:26:00.518 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:26:00.513+0000 7fa8a37fe700 1 -- 172.21.15.50:0/2142505538 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa89400ba60 con 0x7fa8a406e1a0 2023-10-06T01:26:00.518 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:26:00.513+0000 7fa8a8b9b700 1 --2- 172.21.15.50:0/2142505538 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa894003a60 0x7fa894003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:26:00.518 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:26:00.513+0000 7fa8a3fff700 1 --2- 172.21.15.50:0/2142505538 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa894004810 0x7fa894004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:26:00.518 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:26:00.513+0000 7fa8a939c700 1 --2- 172.21.15.50:0/2142505538 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa8a406e1a0 0x7fa8940051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:26:00.518 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:26:00.514+0000 7fa8a8b9b700 1 -- 172.21.15.50:0/2142505538 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa8a406e1a0 msgr2=0x7fa8940051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:26:00.518 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:26:00.514+0000 7fa8a8b9b700 1 --2- 172.21.15.50:0/2142505538 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa8a406e1a0 0x7fa8940051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:26:00.518 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:26:00.514+0000 7fa8a8b9b700 1 -- 172.21.15.50:0/2142505538 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa894004810 msgr2=0x7fa894004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:26:00.519 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:26:00.514+0000 7fa8a8b9b700 1 --2- 172.21.15.50:0/2142505538 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa894004810 0x7fa894004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:26:00.519 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:26:00.514+0000 7fa8a8b9b700 1 -- 172.21.15.50:0/2142505538 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa894003570 con 0x7fa894003a60 2023-10-06T01:26:00.519 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:26:00.514+0000 7fa8a8b9b700 1 --2- 172.21.15.50:0/2142505538 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa894003a60 0x7fa894003e70 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7fa898009c30 tx=0x7fa8980091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=32ac1ecd3984c72e server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:26:00.519 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:26:00.514+0000 7fa8a37fe700 1 -- 172.21.15.50:0/2142505538 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa89800e710 con 0x7fa894003a60 2023-10-06T01:26:00.519 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:26:00.514+0000 7fa8a37fe700 1 -- 172.21.15.50:0/2142505538 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa89800e870 con 0x7fa894003a60 2023-10-06T01:26:00.519 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:26:00.514+0000 7fa8a37fe700 1 -- 172.21.15.50:0/2142505538 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa89800ec30 con 0x7fa894003a60 2023-10-06T01:26:00.519 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:26:00.515+0000 7fa8a9b9d700 1 -- 172.21.15.50:0/2142505538 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa894003a60 msgr2=0x7fa894003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:26:00.519 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:26:00.515+0000 7fa8a9b9d700 1 --2- 172.21.15.50:0/2142505538 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa894003a60 0x7fa894003e70 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7fa898009c30 tx=0x7fa8980091a0 comp rx=0 tx=0).stop 2023-10-06T01:26:00.519 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:26:00.515+0000 7fa8a939c700 1 -- 172.21.15.50:0/2142505538 reap_dead start 2023-10-06T01:26:00.519 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:26:00.515+0000 7fa8a9b9d700 1 -- 172.21.15.50:0/2142505538 shutdown_connections 2023-10-06T01:26:00.519 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:26:00.515+0000 7fa8a9b9d700 1 -- 172.21.15.50:0/2142505538 >> 172.21.15.50:0/2142505538 conn(0x7fa8a40cbed0 msgr2=0x7fa8a40cc2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:26:00.520 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:26:00.515+0000 7fa8a9b9d700 1 -- 172.21.15.50:0/2142505538 shutdown_connections 2023-10-06T01:26:00.520 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:26:00.515+0000 7fa8a9b9d700 1 -- 172.21.15.50:0/2142505538 wait complete. 2023-10-06T01:26:00.520 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:26:00.516+0000 7fa8a9b9d700 1 Processor -- start 2023-10-06T01:26:00.520 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:26:00.516+0000 7fa8a9b9d700 1 -- start start 2023-10-06T01:26:00.523 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:26:00.517+0000 7fa8a9b9d700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa894003a60 0x7fa8a4169f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:26:00.523 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:26:00.517+0000 7fa8a9b9d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa8a4154610 0x7fa8a4150090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:26:00.523 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:26:00.517+0000 7fa8a9b9d700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa8a40c5080 0x7fa8a40c5500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:26:00.523 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:26:00.517+0000 7fa8a9b9d700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8a40c68a0 con 0x7fa8a4154610 2023-10-06T01:26:00.523 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:26:00.517+0000 7fa8a9b9d700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8a40c5a40 con 0x7fa8a40c5080 2023-10-06T01:26:00.523 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:26:00.517+0000 7fa8a9b9d700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8a40a55e0 con 0x7fa894003a60 2023-10-06T01:26:00.523 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:26:00.518+0000 7fa8a3fff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa8a4154610 0x7fa8a4150090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:26:00.524 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:26:00.518+0000 7fa8a3fff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa8a4154610 0x7fa8a4150090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:46388/0 (socket says 172.21.15.50:46388) 2023-10-06T01:26:00.524 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:26:00.518+0000 7fa8a3fff700 1 -- 172.21.15.50:0/347445731 learned_addr learned my addr 172.21.15.50:0/347445731 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-06T01:26:00.524 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:26:00.518+0000 7fa8a939c700 1 --2- 172.21.15.50:0/347445731 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa8a40c5080 0x7fa8a40c5500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:26:00.524 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:26:00.518+0000 7fa8a8b9b700 1 --2- 172.21.15.50:0/347445731 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa894003a60 0x7fa8a4169f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:26:00.524 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:26:00.518+0000 7fa8a3fff700 1 -- 172.21.15.50:0/347445731 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa894003a60 msgr2=0x7fa8a4169f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:26:00.524 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:26:00.518+0000 7fa8a3fff700 1 --2- 172.21.15.50:0/347445731 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa894003a60 0x7fa8a4169f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:26:00.524 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:26:00.518+0000 7fa8a3fff700 1 -- 172.21.15.50:0/347445731 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa8a40c5080 msgr2=0x7fa8a40c5500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:26:00.524 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:26:00.518+0000 7fa8a3fff700 1 --2- 172.21.15.50:0/347445731 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa8a40c5080 0x7fa8a40c5500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:26:00.524 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:26:00.518+0000 7fa8a3fff700 1 -- 172.21.15.50:0/347445731 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8a40c73b0 con 0x7fa8a4154610 2023-10-06T01:26:00.524 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:26:00.518+0000 7fa8a3fff700 1 --2- 172.21.15.50:0/347445731 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa8a4154610 0x7fa8a4150090 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7fa890011b70 tx=0x7fa8900091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:26:00.524 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:26:00.519+0000 7fa8a0ff9700 1 -- 172.21.15.50:0/347445731 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa89000f8e0 con 0x7fa8a4154610 2023-10-06T01:26:00.525 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:26:00.519+0000 7fa8a0ff9700 1 -- 172.21.15.50:0/347445731 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa89000fa40 con 0x7fa8a4154610 2023-10-06T01:26:00.525 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:26:00.519+0000 7fa8a0ff9700 1 -- 172.21.15.50:0/347445731 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa89000fdc0 con 0x7fa8a4154610 2023-10-06T01:26:00.525 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:26:00.519+0000 7fa8a9b9d700 1 -- 172.21.15.50:0/347445731 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa8a40c6a80 con 0x7fa8a4154610 2023-10-06T01:26:00.525 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:26:00.519+0000 7fa8a9b9d700 1 -- 172.21.15.50:0/347445731 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa8a40c7040 con 0x7fa8a4154610 2023-10-06T01:26:00.525 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:26:00.520+0000 7fa8a9b9d700 1 -- 172.21.15.50:0/347445731 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa8a40c7540 con 0x7fa8a4154610 2023-10-06T01:26:00.525 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:26:00.521+0000 7fa8a0ff9700 1 -- 172.21.15.50:0/347445731 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fa890014650 con 0x7fa8a4154610 2023-10-06T01:26:00.525 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:26:00.521+0000 7fa8a0ff9700 1 --2- 172.21.15.50:0/347445731 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7fa888066f30 0x7fa8880693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:26:00.525 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:26:00.522+0000 7fa8a0ff9700 1 -- 172.21.15.50:0/347445731 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5612+0+0 (secure 0 0 0) 0x7fa890018030 con 0x7fa8a4154610 2023-10-06T01:26:00.525 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:26:00.522+0000 7fa8a8b9b700 1 --2- 172.21.15.50:0/347445731 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7fa888066f30 0x7fa8880693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:26:00.526 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:26:00.523+0000 7fa8a8b9b700 1 --2- 172.21.15.50:0/347445731 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7fa888066f30 0x7fa8880693e0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fa8980091e0 tx=0x7fa89801a000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:26:00.526 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:26:00.526+0000 7fa8a0ff9700 1 -- 172.21.15.50:0/347445731 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fa89008a020 con 0x7fa8a4154610 2023-10-06T01:26:00.728 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:26:00.728+0000 7fa8a9b9d700 1 -- 172.21.15.50:0/347445731 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) v1 -- 0x7fa8a405f270 con 0x7fa8a4154610 2023-10-06T01:26:00.732 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:26:00.731+0000 7fa8a0ff9700 1 -- 172.21.15.50:0/347445731 <== mon.0 v2:172.21.15.50:3300/0 7 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7fa890052180 con 0x7fa8a4154610 2023-10-06T01:26:00.732 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:26:00.732+0000 7fa8a0ff9700 1 -- 172.21.15.50:0/347445731 <== mon.0 v2:172.21.15.50:3300/0 8 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v12)=0 v12) v1 ==== 123+0+0 (secure 0 0 0) 0x7fa8900220c0 con 0x7fa8a4154610 2023-10-06T01:26:00.736 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:26:00.734+0000 7fa8a9b9d700 1 -- 172.21.15.50:0/347445731 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7fa888066f30 msgr2=0x7fa8880693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:26:00.736 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:26:00.734+0000 7fa8a9b9d700 1 --2- 172.21.15.50:0/347445731 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7fa888066f30 0x7fa8880693e0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fa8980091e0 tx=0x7fa89801a000 comp rx=0 tx=0).stop 2023-10-06T01:26:00.736 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:26:00.734+0000 7fa8a9b9d700 1 -- 172.21.15.50:0/347445731 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa8a4154610 msgr2=0x7fa8a4150090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:26:00.736 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:26:00.734+0000 7fa8a9b9d700 1 --2- 172.21.15.50:0/347445731 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa8a4154610 0x7fa8a4150090 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7fa890011b70 tx=0x7fa8900091a0 comp rx=0 tx=0).stop 2023-10-06T01:26:00.736 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:26:00.734+0000 7fa8a9b9d700 1 -- 172.21.15.50:0/347445731 shutdown_connections 2023-10-06T01:26:00.737 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:26:00.734+0000 7fa8a9b9d700 1 --2- 172.21.15.50:0/347445731 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7fa888066f30 0x7fa8880693e0 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:26:00.737 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:26:00.734+0000 7fa8a9b9d700 1 --2- 172.21.15.50:0/347445731 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa8a40c5080 0x7fa8a40c5500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:26:00.737 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:26:00.734+0000 7fa8a9b9d700 1 --2- 172.21.15.50:0/347445731 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa894003a60 0x7fa8a4169f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:26:00.737 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:26:00.734+0000 7fa8a9b9d700 1 --2- 172.21.15.50:0/347445731 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa8a4154610 0x7fa8a4150090 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:26:00.737 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:26:00.734+0000 7fa8a9b9d700 1 -- 172.21.15.50:0/347445731 >> 172.21.15.50:0/347445731 conn(0x7fa8a40cbed0 msgr2=0x7fa8a406a9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:26:00.737 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:26:00.734+0000 7fa8a9b9d700 1 -- 172.21.15.50:0/347445731 shutdown_connections 2023-10-06T01:26:00.738 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:26:00.735+0000 7fa8a9b9d700 1 -- 172.21.15.50:0/347445731 wait complete. 2023-10-06T01:26:00.752 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-10-06T01:26:00.753 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T01:26:00.941 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:26:00.940+0000 7f0330b9d700 1 Processor -- start 2023-10-06T01:26:00.942 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:26:00.941+0000 7f0330b9d700 1 -- start start 2023-10-06T01:26:00.945 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:26:00.942+0000 7f0330b9d700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f032c159a60 0x7f032c159ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:26:00.945 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:26:00.942+0000 7f0330b9d700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f032c0675f0 0x7f032c067a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:26:00.945 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:26:00.942+0000 7f0330b9d700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f032c0c9a60 con 0x7f032c0c79f0 2023-10-06T01:26:00.945 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:26:00.942+0000 7f0330b9d700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f032c067f70 con 0x7f032c0675f0 2023-10-06T01:26:00.945 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:26:00.942+0000 7f0330b9d700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f032c15a590 con 0x7f032c159a60 2023-10-06T01:26:00.945 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:26:00.942+0000 7f032bfff700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f032c0675f0 0x7f032c067a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:26:00.945 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:26:00.942+0000 7f032bfff700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f032c0675f0 0x7f032c067a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:46400/0 (socket says 172.21.15.50:46400) 2023-10-06T01:26:00.945 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:26:00.942+0000 7f032bfff700 1 -- 172.21.15.50:0/3313169471 learned_addr learned my addr 172.21.15.50:0/3313169471 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-06T01:26:00.945 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:26:00.942+0000 7f032affd700 1 --2- 172.21.15.50:0/3313169471 >> v2:172.21.15.155:3300/0 conn(0x7f032c159a60 0x7f032c159ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:26:00.945 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:26:00.943+0000 7f032bfff700 1 -- 172.21.15.50:0/3313169471 >> v2:172.21.15.155:3300/0 conn(0x7f032c159a60 msgr2=0x7f032c159ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:26:00.945 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:26:00.943+0000 7f032bfff700 1 --2- 172.21.15.50:0/3313169471 >> v2:172.21.15.155:3300/0 conn(0x7f032c159a60 0x7f032c159ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:26:00.946 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:26:00.943+0000 7f032bfff700 1 -- 172.21.15.50:0/3313169471 >> v1:172.21.15.155:6789/0 conn(0x7f032c0c79f0 legacy=0x7f032c0c9ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:26:00.946 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:26:00.943+0000 7f032bfff700 1 -- 172.21.15.50:0/3313169471 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f032c15a870 con 0x7f032c0675f0 2023-10-06T01:26:00.946 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:26:00.943+0000 7f032bfff700 1 --2- 172.21.15.50:0/3313169471 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f032c0675f0 0x7f032c067a30 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f032c06f800 tx=0x7f0324009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f7836c7d4c8564cd server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:26:00.946 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:26:00.943+0000 7f032a7fc700 1 -- 172.21.15.50:0/3313169471 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f032400e070 con 0x7f032c0675f0 2023-10-06T01:26:00.946 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:26:00.943+0000 7f032a7fc700 1 -- 172.21.15.50:0/3313169471 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f032400ba20 con 0x7f032c0675f0 2023-10-06T01:26:00.946 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:26:00.943+0000 7f032a7fc700 1 -- 172.21.15.50:0/3313169471 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03240092e0 con 0x7f032c0675f0 2023-10-06T01:26:00.946 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:26:00.944+0000 7f0330b9d700 1 -- 172.21.15.50:0/3313169471 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f032c0675f0 msgr2=0x7f032c067a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:26:00.946 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:26:00.944+0000 7f0330b9d700 1 --2- 172.21.15.50:0/3313169471 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f032c0675f0 0x7f032c067a30 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f032c06f800 tx=0x7f0324009840 comp rx=0 tx=0).stop 2023-10-06T01:26:00.946 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:26:00.944+0000 7f0330b9d700 1 -- 172.21.15.50:0/3313169471 shutdown_connections 2023-10-06T01:26:00.946 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:26:00.944+0000 7f0330b9d700 1 --2- 172.21.15.50:0/3313169471 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f032c0675f0 0x7f032c067a30 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:26:00.946 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:26:00.944+0000 7f0330b9d700 1 --2- 172.21.15.50:0/3313169471 >> v2:172.21.15.155:3300/0 conn(0x7f032c159a60 0x7f032c159ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:26:00.947 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:26:00.944+0000 7f0330b9d700 1 -- 172.21.15.50:0/3313169471 >> 172.21.15.50:0/3313169471 conn(0x7f032c068700 msgr2=0x7f032c068b00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:26:00.947 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:26:00.944+0000 7f0330b9d700 1 -- 172.21.15.50:0/3313169471 shutdown_connections 2023-10-06T01:26:00.947 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:26:00.944+0000 7f0330b9d700 1 -- 172.21.15.50:0/3313169471 wait complete. 2023-10-06T01:26:00.948 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:26:00.945+0000 7f0330b9d700 1 Processor -- start 2023-10-06T01:26:00.949 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:26:00.945+0000 7f0330b9d700 1 -- start start 2023-10-06T01:26:00.949 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:26:00.946+0000 7f0330b9d700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f032c0675f0 0x7f032c1424d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:26:00.949 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:26:00.946+0000 7f0330b9d700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f032c0c79f0 0x7f032c15ac90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:26:00.949 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:26:00.946+0000 7f0330b9d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f032c159a60 0x7f032c15b1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:26:00.949 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:26:00.946+0000 7f0330b9d700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f032c0c4d90 con 0x7f032c159a60 2023-10-06T01:26:00.949 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:26:00.946+0000 7f0330b9d700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f032c0c4180 con 0x7f032c0c79f0 2023-10-06T01:26:00.949 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:26:00.946+0000 7f0330b9d700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f032c0c4460 con 0x7f032c0675f0 2023-10-06T01:26:00.949 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:26:00.946+0000 7f032bfff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f032c159a60 0x7f032c15b1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:26:00.949 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:26:00.946+0000 7f032bfff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f032c159a60 0x7f032c15b1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:46410/0 (socket says 172.21.15.50:46410) 2023-10-06T01:26:00.949 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:26:00.946+0000 7f032bfff700 1 -- 172.21.15.50:0/762113666 learned_addr learned my addr 172.21.15.50:0/762113666 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-06T01:26:00.950 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:26:00.947+0000 7f032bfff700 1 -- 172.21.15.50:0/762113666 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f032c0675f0 msgr2=0x7f032c1424d0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-10-06T01:26:00.950 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:26:00.947+0000 7f032bfff700 1 --2- 172.21.15.50:0/762113666 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f032c0675f0 0x7f032c1424d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:26:00.950 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:26:00.947+0000 7f032bfff700 1 -- 172.21.15.50:0/762113666 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f032c0c79f0 msgr2=0x7f032c15ac90 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-10-06T01:26:00.950 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:26:00.947+0000 7f032bfff700 1 --2- 172.21.15.50:0/762113666 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f032c0c79f0 0x7f032c15ac90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:26:00.950 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:26:00.947+0000 7f032bfff700 1 -- 172.21.15.50:0/762113666 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0324009ae0 con 0x7f032c159a60 2023-10-06T01:26:00.950 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:26:00.947+0000 7f032bfff700 1 --2- 172.21.15.50:0/762113666 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f032c159a60 0x7f032c15b1d0 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f032400b6c0 tx=0x7f0324009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:26:00.950 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:26:00.947+0000 7f03137fe700 1 -- 172.21.15.50:0/762113666 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0324008e40 con 0x7f032c159a60 2023-10-06T01:26:00.950 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:26:00.947+0000 7f03137fe700 1 -- 172.21.15.50:0/762113666 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f032400be50 con 0x7f032c159a60 2023-10-06T01:26:00.950 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:26:00.947+0000 7f03137fe700 1 -- 172.21.15.50:0/762113666 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03240256d0 con 0x7f032c159a60 2023-10-06T01:26:00.950 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:26:00.947+0000 7f0330b9d700 1 -- 172.21.15.50:0/762113666 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f032c0c4740 con 0x7f032c159a60 2023-10-06T01:26:00.950 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:26:00.948+0000 7f0330b9d700 1 -- 172.21.15.50:0/762113666 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f032c142a10 con 0x7f032c159a60 2023-10-06T01:26:00.951 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:26:00.949+0000 7f0330b9d700 1 -- 172.21.15.50:0/762113666 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f032c05f270 con 0x7f032c159a60 2023-10-06T01:26:00.951 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:26:00.949+0000 7f03137fe700 1 -- 172.21.15.50:0/762113666 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f0324003040 con 0x7f032c159a60 2023-10-06T01:26:00.951 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:26:00.950+0000 7f03137fe700 1 --2- 172.21.15.50:0/762113666 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f0318066f30 0x7f03180693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:26:00.951 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:26:00.950+0000 7f03137fe700 1 -- 172.21.15.50:0/762113666 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5612+0+0 (secure 0 0 0) 0x7f03240861a0 con 0x7f032c159a60 2023-10-06T01:26:00.952 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:26:00.951+0000 7f032b7fe700 1 --2- 172.21.15.50:0/762113666 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f0318066f30 0x7f03180693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:26:00.953 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:26:00.952+0000 7f032b7fe700 1 --2- 172.21.15.50:0/762113666 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f0318066f30 0x7f03180693e0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f031c0010a0 tx=0x7f031c007ad0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:26:00.955 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:26:00.955+0000 7f03137fe700 1 -- 172.21.15.50:0/762113666 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f0324053500 con 0x7f032c159a60 2023-10-06T01:26:01.201 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:26:01.201+0000 7f0330b9d700 1 -- 172.21.15.50:0/762113666 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f032c06e430 con 0x7f032c159a60 2023-10-06T01:26:01.202 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:26:01.201+0000 7f03137fe700 1 -- 172.21.15.50:0/762113666 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 20 v20) v1 ==== 94+0+3535 (secure 0 0 0) 0x7f0324020de0 con 0x7f032c159a60 2023-10-06T01:26:01.202 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-10-06T01:26:01.202 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":20,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4769,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6833/3835292201","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6832","nonce":3835292201},{"type":"v1","addr":"172.21.15.50:6833","nonce":3835292201}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":13},{"gid":4772,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6837/2073318681","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6835","nonce":2073318681},{"type":"v1","addr":"172.21.15.155:6837","nonce":2073318681}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":13},{"gid":4993,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6836/2652534948","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":2652534948},{"type":"v1","addr":"172.21.15.155:6836","nonce":2652534948}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":5439,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6835/1097694821","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6834","nonce":1097694821},{"type":"v1","addr":"172.21.15.50:6835","nonce":1097694821}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":20}],"filesystems":[]} 2023-10-06T01:26:01.205 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:26:01.204+0000 7f0330b9d700 1 -- 172.21.15.50:0/762113666 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f0318066f30 msgr2=0x7f03180693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:26:01.205 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:26:01.204+0000 7f0330b9d700 1 --2- 172.21.15.50:0/762113666 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f0318066f30 0x7f03180693e0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f031c0010a0 tx=0x7f031c007ad0 comp rx=0 tx=0).stop 2023-10-06T01:26:01.205 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:26:01.204+0000 7f0330b9d700 1 -- 172.21.15.50:0/762113666 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f032c159a60 msgr2=0x7f032c15b1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:26:01.205 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:26:01.204+0000 7f0330b9d700 1 --2- 172.21.15.50:0/762113666 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f032c159a60 0x7f032c15b1d0 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f032400b6c0 tx=0x7f0324009840 comp rx=0 tx=0).stop 2023-10-06T01:26:01.205 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:26:01.204+0000 7f0330b9d700 1 -- 172.21.15.50:0/762113666 shutdown_connections 2023-10-06T01:26:01.205 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:26:01.204+0000 7f0330b9d700 1 --2- 172.21.15.50:0/762113666 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f032c159a60 0x7f032c15b1d0 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:26:01.205 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:26:01.204+0000 7f0330b9d700 1 --2- 172.21.15.50:0/762113666 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f032c0675f0 0x7f032c1424d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:26:01.205 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:26:01.204+0000 7f0330b9d700 1 --2- 172.21.15.50:0/762113666 >> [v2:172.21.15.155:6832/85215,v1:172.21.15.155:6833/85215] conn(0x7f0318066f30 0x7f03180693e0 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:26:01.205 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:26:01.204+0000 7f0330b9d700 1 --2- 172.21.15.50:0/762113666 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f032c0c79f0 0x7f032c15ac90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:26:01.205 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:26:01.204+0000 7f0330b9d700 1 -- 172.21.15.50:0/762113666 >> 172.21.15.50:0/762113666 conn(0x7f032c068700 msgr2=0x7f032c1584e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:26:01.205 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:26:01.204+0000 7f0330b9d700 1 -- 172.21.15.50:0/762113666 shutdown_connections 2023-10-06T01:26:01.206 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-06T01:26:01.204+0000 7f0330b9d700 1 -- 172.21.15.50:0/762113666 wait complete. 2023-10-06T01:26:01.206 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 20 2023-10-06T01:26:01.222 DEBUG:tasks.cephfs.filesystem:already dead... 2023-10-06T01:26:01.222 INFO:teuthology.misc:Shutting down mds daemons... 2023-10-06T01:26:01.222 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-10-06T01:26:01.222 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T01:26:01.235 INFO:tasks.ceph.mds.a:Stopped 2023-10-06T01:26:01.236 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-10-06T01:26:01.236 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T01:26:01.289 INFO:tasks.ceph.mds.c:Stopped 2023-10-06T01:26:01.289 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-10-06T01:26:01.289 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T01:26:01.305 INFO:tasks.ceph.mds.b:Stopped 2023-10-06T01:26:01.305 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-10-06T01:26:01.305 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T01:26:01.361 INFO:tasks.ceph.mds.d:Stopped 2023-10-06T01:26:01.361 INFO:teuthology.misc:Shutting down osd daemons... 2023-10-06T01:26:01.362 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2023-10-06T01:26:01.362 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T01:26:01.398 INFO:tasks.ceph.osd.0:Stopped 2023-10-06T01:26:01.399 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2023-10-06T01:26:01.399 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T01:26:01.481 INFO:tasks.ceph.osd.1:Stopped 2023-10-06T01:26:01.481 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2023-10-06T01:26:01.481 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T01:26:01.534 INFO:tasks.ceph.osd.2:Stopped 2023-10-06T01:26:01.534 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2023-10-06T01:26:01.534 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T01:26:01.583 INFO:tasks.ceph.osd.3:Stopped 2023-10-06T01:26:01.584 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2023-10-06T01:26:01.584 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T01:26:01.626 INFO:tasks.ceph.osd.4:Stopped 2023-10-06T01:26:01.627 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2023-10-06T01:26:01.627 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T01:26:01.673 INFO:tasks.ceph.osd.5:Stopped 2023-10-06T01:26:01.674 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2023-10-06T01:26:01.674 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T01:26:01.714 INFO:tasks.ceph.osd.6:Stopped 2023-10-06T01:26:01.715 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2023-10-06T01:26:01.715 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T01:26:01.765 INFO:tasks.ceph.osd.7:Stopped 2023-10-06T01:26:01.765 INFO:teuthology.misc:Shutting down mgr daemons... 2023-10-06T01:26:01.766 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2023-10-06T01:26:01.766 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T01:26:01.823 INFO:tasks.ceph.mgr.y:Stopped 2023-10-06T01:26:01.824 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2023-10-06T01:26:01.824 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T01:26:01.887 INFO:tasks.ceph.mgr.x:Stopped 2023-10-06T01:26:01.887 INFO:teuthology.misc:Shutting down mon daemons... 2023-10-06T01:26:01.887 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2023-10-06T01:26:01.887 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T01:26:01.913 INFO:tasks.ceph.mon.a:Stopped 2023-10-06T01:26:01.913 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2023-10-06T01:26:01.914 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T01:26:01.931 INFO:tasks.ceph.mon.b:Stopped 2023-10-06T01:26:01.931 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2023-10-06T01:26:01.931 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T01:26:01.989 INFO:tasks.ceph.mon.c:Stopped 2023-10-06T01:26:01.989 INFO:tasks.ceph:Checking cluster log for badness... 2023-10-06T01:26:01.989 DEBUG:teuthology.orchestra.run.smithi050:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v 'overall HEALTH_' | egrep -v '\(FS_DEGRADED\)' | egrep -v '\(MDS_FAILED\)' | egrep -v '\(MDS_DEGRADED\)' | egrep -v '\(FS_WITH_FAILED_MDS\)' | egrep -v '\(MDS_DAMAGE\)' | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(FS_INLINE_DATA_DEPRECATED\)' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | head -n 1 2023-10-06T01:26:02.060 INFO:teuthology.orchestra.run.smithi050.stdout:1696555290.5886528 mon.a (mon.0) 111 : cluster [WRN] Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2023-10-06T01:26:02.061 WARNING:tasks.ceph:Found errors (ERR|WRN|SEC) in cluster log 2023-10-06T01:26:02.061 DEBUG:teuthology.orchestra.run.smithi050:> sudo egrep '\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v 'overall HEALTH_' | egrep -v '\(FS_DEGRADED\)' | egrep -v '\(MDS_FAILED\)' | egrep -v '\(MDS_DEGRADED\)' | egrep -v '\(FS_WITH_FAILED_MDS\)' | egrep -v '\(MDS_DAMAGE\)' | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(FS_INLINE_DATA_DEPRECATED\)' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | head -n 1 2023-10-06T01:26:02.134 DEBUG:teuthology.orchestra.run.smithi050:> sudo egrep '\[ERR\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v 'overall HEALTH_' | egrep -v '\(FS_DEGRADED\)' | egrep -v '\(MDS_FAILED\)' | egrep -v '\(MDS_DEGRADED\)' | egrep -v '\(FS_WITH_FAILED_MDS\)' | egrep -v '\(MDS_DAMAGE\)' | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(FS_INLINE_DATA_DEPRECATED\)' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | head -n 1 2023-10-06T01:26:02.207 DEBUG:teuthology.orchestra.run.smithi050:> sudo egrep '\[WRN\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v 'overall HEALTH_' | egrep -v '\(FS_DEGRADED\)' | egrep -v '\(MDS_FAILED\)' | egrep -v '\(MDS_DEGRADED\)' | egrep -v '\(FS_WITH_FAILED_MDS\)' | egrep -v '\(MDS_DAMAGE\)' | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(FS_INLINE_DATA_DEPRECATED\)' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | head -n 1 2023-10-06T01:26:02.279 INFO:teuthology.orchestra.run.smithi050.stdout:1696555290.5886528 mon.a (mon.0) 111 : cluster [WRN] Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2023-10-06T01:26:02.280 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi050.front.sepia.ceph.com 2023-10-06T01:26:02.281 DEBUG:teuthology.orchestra.run.smithi050:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2023-10-06T01:26:02.672 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi050.front.sepia.ceph.com 2023-10-06T01:26:02.672 DEBUG:teuthology.orchestra.run.smithi050:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2023-10-06T01:26:02.880 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi050.front.sepia.ceph.com 2023-10-06T01:26:02.881 DEBUG:teuthology.orchestra.run.smithi050:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2023-10-06T01:26:03.107 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi050.front.sepia.ceph.com 2023-10-06T01:26:03.107 DEBUG:teuthology.orchestra.run.smithi050:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2023-10-06T01:26:03.315 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi155.front.sepia.ceph.com 2023-10-06T01:26:03.315 DEBUG:teuthology.orchestra.run.smithi155:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2023-10-06T01:26:03.618 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi155.front.sepia.ceph.com 2023-10-06T01:26:03.618 DEBUG:teuthology.orchestra.run.smithi155:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2023-10-06T01:26:03.803 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi155.front.sepia.ceph.com 2023-10-06T01:26:03.803 DEBUG:teuthology.orchestra.run.smithi155:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2023-10-06T01:26:04.034 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi155.front.sepia.ceph.com 2023-10-06T01:26:04.034 DEBUG:teuthology.orchestra.run.smithi155:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2023-10-06T01:26:04.212 INFO:tasks.ceph:Archiving mon data... 2023-10-06T01:26:04.213 DEBUG:teuthology.misc:Transferring archived files from smithi050:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/yuriw-2023-10-05_23:52:50-fs-wip-yuri-testing-2023-10-05-0730-quincy-distro-default-smithi/7412076/data/mon.a.tgz 2023-10-06T01:26:04.213 DEBUG:teuthology.orchestra.run.smithi050:> mktemp 2023-10-06T01:26:04.254 INFO:teuthology.orchestra.run.smithi050.stdout:/tmp/tmp.ce0UzTY8rj 2023-10-06T01:26:04.254 DEBUG:teuthology.orchestra.run.smithi050:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.ce0UzTY8rj 2023-10-06T01:26:04.456 DEBUG:teuthology.orchestra.run.smithi050:> sudo chmod 0666 /tmp/tmp.ce0UzTY8rj 2023-10-06T01:26:04.559 DEBUG:teuthology.orchestra.remote:smithi050:/tmp/tmp.ce0UzTY8rj is 322KB 2023-10-06T01:26:04.648 DEBUG:teuthology.orchestra.run.smithi050:> rm -fr /tmp/tmp.ce0UzTY8rj 2023-10-06T01:26:04.684 DEBUG:teuthology.misc:Transferring archived files from smithi155:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/yuriw-2023-10-05_23:52:50-fs-wip-yuri-testing-2023-10-05-0730-quincy-distro-default-smithi/7412076/data/mon.b.tgz 2023-10-06T01:26:04.684 DEBUG:teuthology.orchestra.run.smithi155:> mktemp 2023-10-06T01:26:04.721 INFO:teuthology.orchestra.run.smithi155.stdout:/tmp/tmp.lueR3I7IO9 2023-10-06T01:26:04.722 DEBUG:teuthology.orchestra.run.smithi155:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.lueR3I7IO9 2023-10-06T01:26:04.924 DEBUG:teuthology.orchestra.run.smithi155:> sudo chmod 0666 /tmp/tmp.lueR3I7IO9 2023-10-06T01:26:05.017 DEBUG:teuthology.orchestra.run.smithi050:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T01:26:05.022 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T01:26:05.027 DEBUG:teuthology.orchestra.remote:smithi155:/tmp/tmp.lueR3I7IO9 is 423KB 2023-10-06T01:26:05.166 DEBUG:teuthology.orchestra.run.smithi155:> rm -fr /tmp/tmp.lueR3I7IO9 2023-10-06T01:26:05.202 DEBUG:teuthology.misc:Transferring archived files from smithi155:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/yuriw-2023-10-05_23:52:50-fs-wip-yuri-testing-2023-10-05-0730-quincy-distro-default-smithi/7412076/data/mon.c.tgz 2023-10-06T01:26:05.202 DEBUG:teuthology.orchestra.run.smithi155:> mktemp 2023-10-06T01:26:05.277 INFO:teuthology.orchestra.run.smithi155.stdout:/tmp/tmp.uR0GOdANnp 2023-10-06T01:26:05.278 DEBUG:teuthology.orchestra.run.smithi155:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.uR0GOdANnp 2023-10-06T01:26:05.465 DEBUG:teuthology.orchestra.run.smithi155:> sudo chmod 0666 /tmp/tmp.uR0GOdANnp 2023-10-06T01:26:05.564 DEBUG:teuthology.orchestra.remote:smithi155:/tmp/tmp.uR0GOdANnp is 423KB 2023-10-06T01:26:05.654 DEBUG:teuthology.orchestra.run.smithi155:> rm -fr /tmp/tmp.uR0GOdANnp 2023-10-06T01:26:05.690 INFO:tasks.ceph:Cleaning ceph cluster... 2023-10-06T01:26:05.690 DEBUG:teuthology.orchestra.run.smithi050:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2023-10-06T01:26:05.695 DEBUG:teuthology.orchestra.run.smithi155:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2023-10-06T01:26:05.791 INFO:tasks.ceph:Checking for errors in any valgrind logs... 2023-10-06T01:26:05.791 DEBUG:teuthology.orchestra.run.smithi050:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2023-10-06T01:26:05.796 DEBUG:teuthology.orchestra.run.smithi155:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2023-10-06T01:26:05.870 INFO:teuthology.orchestra.run.smithi155.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2023-10-06T01:26:05.896 INFO:teuthology.orchestra.run.smithi050.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2023-10-06T01:26:05.911 INFO:tasks.ceph:Archiving crash dumps... 2023-10-06T01:26:05.913 DEBUG:teuthology.misc:Transferring archived files from smithi050:/var/lib/ceph/crash to /home/teuthworker/archive/yuriw-2023-10-05_23:52:50-fs-wip-yuri-testing-2023-10-05-0730-quincy-distro-default-smithi/7412076/remote/smithi050/crash 2023-10-06T01:26:05.914 DEBUG:teuthology.orchestra.run.smithi050:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2023-10-06T01:26:05.975 DEBUG:teuthology.misc:Transferring archived files from smithi155:/var/lib/ceph/crash to /home/teuthworker/archive/yuriw-2023-10-05_23:52:50-fs-wip-yuri-testing-2023-10-05-0730-quincy-distro-default-smithi/7412076/remote/smithi155/crash 2023-10-06T01:26:05.975 DEBUG:teuthology.orchestra.run.smithi155:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2023-10-06T01:26:06.035 INFO:tasks.ceph:Shutting down logrotate 2023-10-06T01:26:06.036 DEBUG:teuthology.orchestra.run.smithi050:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T01:26:06.040 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T01:26:06.134 DEBUG:teuthology.orchestra.run.smithi050:> sudo rm /etc/logrotate.d/ceph-test.conf 2023-10-06T01:26:06.195 DEBUG:teuthology.orchestra.run.smithi155:> sudo rm /etc/logrotate.d/ceph-test.conf 2023-10-06T01:26:06.256 INFO:tasks.ceph:Compressing logs... 2023-10-06T01:26:06.256 DEBUG:teuthology.orchestra.run.smithi050:> sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-10-06T01:26:06.260 DEBUG:teuthology.orchestra.run.smithi155:> sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-10-06T01:26:10.876 INFO:tasks.ceph:Archiving logs... 2023-10-06T01:26:10.876 DEBUG:teuthology.misc:Transferring archived files from smithi050:/var/log/ceph to /home/teuthworker/archive/yuriw-2023-10-05_23:52:50-fs-wip-yuri-testing-2023-10-05-0730-quincy-distro-default-smithi/7412076/remote/smithi050/log 2023-10-06T01:26:10.878 DEBUG:teuthology.orchestra.run.smithi050:> sudo tar c -f - -C /var/log/ceph -- . 2023-10-06T01:26:11.552 DEBUG:teuthology.misc:Transferring archived files from smithi155:/var/log/ceph to /home/teuthworker/archive/yuriw-2023-10-05_23:52:50-fs-wip-yuri-testing-2023-10-05-0730-quincy-distro-default-smithi/7412076/remote/smithi155/log 2023-10-06T01:26:11.553 DEBUG:teuthology.orchestra.run.smithi155:> sudo tar c -f - -C /var/log/ceph -- . 2023-10-06T01:26:12.049 DEBUG:teuthology.run_tasks:Unwinding manager install 2023-10-06T01:26:12.058 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2023-10-06T01:26:12.058 DEBUG:teuthology.orchestra.run.smithi050:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2023-10-06T01:26:12.063 DEBUG:teuthology.orchestra.run.smithi155:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2023-10-06T01:26:12.188 DEBUG:teuthology.run_tasks:Unwinding manager clock 2023-10-06T01:26:12.197 INFO:teuthology.task.clock:Checking final clock skew... 2023-10-06T01:26:12.197 DEBUG:teuthology.orchestra.run.smithi050:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-10-06T01:26:12.202 DEBUG:teuthology.orchestra.run.smithi155:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-10-06T01:26:12.233 INFO:teuthology.orchestra.run.smithi050.stderr:bash: ntpq: command not found 2023-10-06T01:26:12.236 INFO:teuthology.orchestra.run.smithi155.stderr:bash: ntpq: command not found 2023-10-06T01:26:12.238 INFO:teuthology.orchestra.run.smithi050.stdout:210 Number of sources = 4 2023-10-06T01:26:12.239 INFO:teuthology.orchestra.run.smithi050.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-10-06T01:26:12.239 INFO:teuthology.orchestra.run.smithi050.stdout:=============================================================================== 2023-10-06T01:26:12.239 INFO:teuthology.orchestra.run.smithi050.stdout:^+ hv01.front.sepia.ceph.com 2 6 377 16 +138us[ +138us] +/- 101ms 2023-10-06T01:26:12.239 INFO:teuthology.orchestra.run.smithi050.stdout:^* hv02.front.sepia.ceph.com 3 6 377 18 -403us[ -406us] +/- 50ms 2023-10-06T01:26:12.240 INFO:teuthology.orchestra.run.smithi050.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 16 +444us[ +444us] +/- 74ms 2023-10-06T01:26:12.240 INFO:teuthology.orchestra.run.smithi050.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2023-10-06T01:26:12.241 INFO:teuthology.orchestra.run.smithi155.stdout:210 Number of sources = 4 2023-10-06T01:26:12.241 INFO:teuthology.orchestra.run.smithi155.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-10-06T01:26:12.242 INFO:teuthology.orchestra.run.smithi155.stdout:=============================================================================== 2023-10-06T01:26:12.242 INFO:teuthology.orchestra.run.smithi155.stdout:^+ hv01.front.sepia.ceph.com 2 6 377 17 +178us[ +178us] +/- 101ms 2023-10-06T01:26:12.242 INFO:teuthology.orchestra.run.smithi155.stdout:^* hv02.front.sepia.ceph.com 3 6 377 18 -368us[ -351us] +/- 50ms 2023-10-06T01:26:12.242 INFO:teuthology.orchestra.run.smithi155.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 15 +485us[ +485us] +/- 74ms 2023-10-06T01:26:12.242 INFO:teuthology.orchestra.run.smithi155.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2023-10-06T01:26:12.243 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2023-10-06T01:26:12.255 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2023-10-06T01:26:12.256 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2023-10-06T01:26:12.292 DEBUG:teuthology.orchestra.run.smithi050:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2023-10-06T01:26:12.463 DEBUG:teuthology.orchestra.run.smithi155:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2023-10-06T01:26:12.621 DEBUG:teuthology.orchestra.run.smithi050:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-10-06T01:26:12.691 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-06T01:26:12.691 DEBUG:teuthology.orchestra.run.smithi155:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-10-06T01:26:12.758 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-06T01:26:12.759 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2023-10-06T01:26:12.770 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2023-10-06T01:26:12.801 INFO:teuthology.task.internal:Duration was 1158.026443 seconds 2023-10-06T01:26:12.801 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2023-10-06T01:26:12.850 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2023-10-06T01:26:12.851 DEBUG:teuthology.orchestra.run.smithi050:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-10-06T01:26:12.855 DEBUG:teuthology.orchestra.run.smithi155:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-10-06T01:26:12.962 INFO:teuthology.orchestra.run.smithi050.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-10-06T01:26:12.966 INFO:teuthology.orchestra.run.smithi155.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-10-06T01:26:13.396 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2023-10-06T01:26:13.396 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi050.front.sepia.ceph.com 2023-10-06T01:26:13.396 DEBUG:teuthology.orchestra.run.smithi050:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-10-06T01:26:13.449 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi155.front.sepia.ceph.com 2023-10-06T01:26:13.449 DEBUG:teuthology.orchestra.run.smithi155:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-10-06T01:26:13.501 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2023-10-06T01:26:13.501 DEBUG:teuthology.orchestra.run.smithi050:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-10-06T01:26:13.506 DEBUG:teuthology.orchestra.run.smithi155:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-10-06T01:26:13.585 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2023-10-06T01:26:13.585 DEBUG:teuthology.orchestra.run.smithi050:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-10-06T01:26:13.589 DEBUG:teuthology.orchestra.run.smithi155:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-10-06T01:26:13.709 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2023-10-06T01:26:13.720 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2023-10-06T01:26:13.720 DEBUG:teuthology.orchestra.run.smithi050:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-10-06T01:26:13.784 DEBUG:teuthology.orchestra.run.smithi155:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-10-06T01:26:13.846 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2023-10-06T01:26:13.857 DEBUG:teuthology.orchestra.run.smithi050:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-10-06T01:26:13.862 DEBUG:teuthology.orchestra.run.smithi155:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-10-06T01:26:13.919 INFO:teuthology.orchestra.run.smithi050.stdout:kernel.core_pattern = core 2023-10-06T01:26:13.922 INFO:teuthology.orchestra.run.smithi155.stdout:kernel.core_pattern = core 2023-10-06T01:26:13.958 DEBUG:teuthology.orchestra.run.smithi050:> test -e /home/ubuntu/cephtest/archive/coredump 2023-10-06T01:26:13.992 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-06T01:26:13.993 DEBUG:teuthology.orchestra.run.smithi155:> test -e /home/ubuntu/cephtest/archive/coredump 2023-10-06T01:26:14.026 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-06T01:26:14.027 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2023-10-06T01:26:14.038 INFO:teuthology.task.internal:Transferring archived files... 2023-10-06T01:26:14.038 DEBUG:teuthology.misc:Transferring archived files from smithi050:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/yuriw-2023-10-05_23:52:50-fs-wip-yuri-testing-2023-10-05-0730-quincy-distro-default-smithi/7412076/remote/smithi050 2023-10-06T01:26:14.039 DEBUG:teuthology.orchestra.run.smithi050:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-10-06T01:26:14.113 DEBUG:teuthology.misc:Transferring archived files from smithi155:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/yuriw-2023-10-05_23:52:50-fs-wip-yuri-testing-2023-10-05-0730-quincy-distro-default-smithi/7412076/remote/smithi155 2023-10-06T01:26:14.113 DEBUG:teuthology.orchestra.run.smithi155:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-10-06T01:26:14.184 INFO:teuthology.task.internal:Removing archive directory... 2023-10-06T01:26:14.185 DEBUG:teuthology.orchestra.run.smithi050:> rm -rf -- /home/ubuntu/cephtest/archive 2023-10-06T01:26:14.189 DEBUG:teuthology.orchestra.run.smithi155:> rm -rf -- /home/ubuntu/cephtest/archive 2023-10-06T01:26:14.225 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2023-10-06T01:26:14.237 INFO:teuthology.task.internal:Not uploading archives. 2023-10-06T01:26:14.238 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2023-10-06T01:26:14.279 INFO:teuthology.task.internal:Tidying up after the test... 2023-10-06T01:26:14.280 DEBUG:teuthology.orchestra.run.smithi050:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-10-06T01:26:14.285 DEBUG:teuthology.orchestra.run.smithi155:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-10-06T01:26:14.316 INFO:teuthology.orchestra.run.smithi050.stdout: 524293 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Oct 6 01:26 /home/ubuntu/cephtest 2023-10-06T01:26:14.321 INFO:teuthology.orchestra.run.smithi155.stdout: 524293 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Oct 6 01:26 /home/ubuntu/cephtest 2023-10-06T01:26:14.324 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2023-10-06T01:26:14.335 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2023-10-06T01:26:14.427 INFO:teuthology.nuke:Checking targets against current locks 2023-10-06T01:26:14.451 DEBUG:teuthology.nuke:shortname: smithi050 2023-10-06T01:26:14.451 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-10-06T01:26:14.474 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi050.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-10-05_23:52:50-fs-wip-yuri-testing-2023-10-05-0730-quincy-distro-default-smithi/7412076', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.4', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-06 00:57:04.246927', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBKNGwEbc6nlhWoKK2q/JhlTxbDL2wf4lDilA3fqVkNmcpM06tHVG2H4l8DQtDEChZDi+48ybGg1N08TuW8IhDMU='} 2023-10-06T01:26:14.477 DEBUG:teuthology.nuke:shortname: smithi155 2023-10-06T01:26:14.477 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-10-06T01:26:14.498 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi155.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-10-05_23:52:50-fs-wip-yuri-testing-2023-10-05-0730-quincy-distro-default-smithi/7412076', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.4', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-06 00:57:04.248805', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBBYL47B2Oj0XSQy1usBWrapTgdPTyjkqN9X8T4+wAERbtbSyf0pYd/LV/R2exAsVzKanHGm0Q73YeL8X62HIFE0='} 2023-10-06T01:26:14.522 INFO:teuthology.orchestra.console.smithi050:Power off 2023-10-06T01:26:14.523 DEBUG:teuthology.orchestra.console.smithi050:pexpect command: ipmitool -H smithi050.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-06T01:26:14.543 DEBUG:teuthology.orchestra.console.smithi050:power off output: Chassis Power Control: Down/Off 2023-10-06T01:26:14.543 DEBUG:teuthology.orchestra.console.smithi050:pexpect command: ipmitool -H smithi050.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-06T01:26:14.558 INFO:teuthology.orchestra.console.smithi155:Power off 2023-10-06T01:26:14.559 DEBUG:teuthology.orchestra.console.smithi155:pexpect command: ipmitool -H smithi155.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-06T01:26:14.568 DEBUG:teuthology.orchestra.console.smithi050:check power output: Chassis Power is on 2023-10-06T01:26:14.580 DEBUG:teuthology.orchestra.console.smithi155:power off output: Chassis Power Control: Down/Off 2023-10-06T01:26:14.580 DEBUG:teuthology.orchestra.console.smithi155:pexpect command: ipmitool -H smithi155.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-06T01:26:14.603 DEBUG:teuthology.orchestra.console.smithi155:check power output: Chassis Power is on 2023-10-06T01:26:18.570 DEBUG:teuthology.orchestra.console.smithi050:pexpect command: ipmitool -H smithi050.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-06T01:26:18.604 DEBUG:teuthology.orchestra.console.smithi155:pexpect command: ipmitool -H smithi155.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-06T01:26:18.681 DEBUG:teuthology.orchestra.console.smithi050:check power output: Chassis Power is on 2023-10-06T01:26:18.714 DEBUG:teuthology.orchestra.console.smithi155:check power output: Chassis Power is on 2023-10-06T01:26:22.682 DEBUG:teuthology.orchestra.console.smithi050:pexpect command: ipmitool -H smithi050.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-06T01:26:22.714 DEBUG:teuthology.orchestra.console.smithi155:pexpect command: ipmitool -H smithi155.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-06T01:26:22.791 DEBUG:teuthology.orchestra.console.smithi050:check power output: Chassis Power is off 2023-10-06T01:26:22.825 DEBUG:teuthology.orchestra.console.smithi155:check power output: Chassis Power is off 2023-10-06T01:26:22.893 INFO:teuthology.orchestra.console.smithi050:Power off completed 2023-10-06T01:26:22.926 INFO:teuthology.orchestra.console.smithi155:Power off completed 2023-10-06T01:26:23.031 INFO:teuthology.run:Summary data: client.0-kernel-sha1: fef64f93da2bbe59bfa57cc5e0530b4dcd2f9c7c client.1-kernel-sha1: fef64f93da2bbe59bfa57cc5e0530b4dcd2f9c7c description: fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/acls} duration: 1158.0264427661896 failure_reason: '"1696555290.5886528 mon.a (mon.0) 111 : cluster [WRN] Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED)" in cluster log' flavor: default owner: scheduled_yuriw@teuthology success: false 2023-10-06T01:26:23.031 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-06T01:26:23.108 INFO:teuthology.run:FAIL